[hdf-forum] Reading across multiple chunks is very slow

Francesc Alted faltet at pytables.org
Mon Mar 23 08:14:14 EDT 2009


A Sunday 22 March 2009, Elena Pourmal escrigué:
> Hi Francesc,
>
> Noted. We will take a look. Thanks for reporting!

Thanks Elena.  By the way, this observation that Andrew Collette send to 
me privately (by error, I suppose) is also pertinent.

----------  Missatge transmès  ----------

Subject: Re: [hdf-forum] Reading across multiple chunks is very slow
Date: Thursday 19 March 2009
From: Andrew Collette <andrew.collette at gmail.com>
To: Francesc Alted <faltet at pytables.org>

This also seems pathologically slow; 12 seconds to write < 50MB?  For
another data point, I tried changing the dimensions to:

{3, 288, 1978, 1556}

(and corresponding changes to the chunk sizes), and the whole program
now takes less than a second to run.

Andrew Collette

-- 
Francesc Alted

----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe at hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe at hdfgroup.org.





More information about the Hdf-forum mailing list