[hdf-forum] Reading across multiple chunks is very slow
Francesc Alted
faltet at pytables.org
Mon Mar 23 08:14:14 EDT 2009
A Sunday 22 March 2009, Elena Pourmal escrigué:
> Hi Francesc,
>
> Noted. We will take a look. Thanks for reporting!
Thanks Elena. By the way, this observation that Andrew Collette send to
me privately (by error, I suppose) is also pertinent.
---------- Missatge transmès ----------
Subject: Re: [hdf-forum] Reading across multiple chunks is very slow
Date: Thursday 19 March 2009
From: Andrew Collette <andrew.collette at gmail.com>
To: Francesc Alted <faltet at pytables.org>
This also seems pathologically slow; 12 seconds to write < 50MB? For
another data point, I tried changing the dimensions to:
{3, 288, 1978, 1556}
(and corresponding changes to the chunk sizes), and the whole program
now takes less than a second to run.
Andrew Collette
--
Francesc Alted
----------------------------------------------------------------------
This mailing list is for HDF software users discussion.
To subscribe to this list, send a message to hdf-forum-subscribe at hdfgroup.org.
To unsubscribe, send a message to hdf-forum-unsubscribe at hdfgroup.org.
More information about the Hdf-forum
mailing list