[Hdf-forum] Slow conversion to binary using h5dump

[Jonathan Kim]

Hi,

It's different from h5copy.

What the original data format? BE or LE?
If it's BE, could you try -b BE and see if any performance difference?

And could you try with smaller size of HDF5 file?  (under 10GB)

Also could you try on other filesystems?  (non-parallel as well)

Since it's the performance issue not a specific bug, more testing results
would be helpful.

Thanks.

- Jonathan

-----Original Message-----
From: hdf-forum-bounces at hdfgroup.org [mailto:hdf-forum-bounces at hdfgroup.org]
On Behalf Of Mark Howison
Sent: Tuesday, January 12, 2010 10:26 AM
To: HDF forum
Subject: [Hdf-forum] Slow conversion to binary using h5dump

Hi, I tried converting a 108GB HDF5 file to binary using the "-b LE"
flag in h5dump, but it ran at a crawling pace, only about 4MB/s. This
is in comparison to an h5copy I did on the same machine (our SGI
Altix) that ran at 600MB/s. The filesystem is GPFS. Any ideas why
h5dump is having so much trouble? Is there a conversion phase (to LE)
that is bogging things down? Thanks, Mark

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum at hdfgroup.org
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org