[Carpet] Lower-dimensional HDF5 output?

Bela Szilagyi szilagyi at aei.mpg.de
Wed Aug 30 17:39:33 CEST 2006


I am in favor of HDF5.  Would there be an option of defining test-runs based 
on HDF output? (this is a Cactus question...)



On Wednesday 30 August 2006 17:33, Erik Schnetter wrote:
> We are currently using ASCII output for 0D and 1D output of grid
> functions.  This has several disadvantages: There is much overhead,
> there are too many files, output happens on a single processor only,
> and the output is currently chunked.
>
> One way out would be to implement lower-dimensional HDF5 output.  I
> imagine the same possibilities as for ASCII output, as in
>
> IOHDF5::out1D_every = 16
> IOHDF5::out1D_vars = "..."
> IOHDF5::out1D_x = yes
> IOHDF5::out1D_x = no
>
> After recovering, it would be much easier to eliminate overlapping
> datasets.
>
> In addition, we could implement IOHDF5::one_file_per_group, which
> would reduce the number of output files.
>
> There would be post-processing tools to create unchunked ASCII files
> from these HDF5 files.
>
> Is there interest for such a feature?  Or would people prefer
> incremental improvements to ASCII output?
>
> -erik

-- 
Bela Szilagyi

Max-Planck-Institut für Gravitationsphysik
Albert-Einstein-Institut
Tel: +49 331 567 7632
Fax: +49 331 567 7649




More information about the developers mailing list