[Carpet] Too many HDF5 files?
Erik Schnetter
schnetter at cct.lsu.edu
Wed Apr 25 15:48:03 CEST 2007
Thomas,
I find that my output directories contain many HDF5 files. There are
many more HDF5 than ASCII files because each processor writes its own
HDF5 file. I assume that the performance win of this approach is
worth it, although I haven't tested it. Should we implement another
method to reduce the number of files? We could e.g. write one output
file per group, per thorn, or even per iteration. Do you have
another suggestion?
If we combine different variables into the same file, is there
anything special that needs to be added? I think it should be
possible to just write several variables into the same file, adding
the meta-information (grid structure etc.) only once. Is that correct?
-erik
--
Erik Schnetter <schnetter at cct.lsu.edu>
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from www.keyserver.net.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: PGP.sig
Type: application/pgp-signature
Size: 186 bytes
Desc: This is a digitally signed message part
Url : /archives/developers/attachments/20070425/f81296ce/attachment.pgp
More information about the developers
mailing list