[Bioperl-l] dealing with large files
Sendu Bala
bix at sendu.me.uk
Thu Dec 20 17:06:28 UTC 2007
Chris Fields wrote:
> The only way I can think of to fix this would be (as Jason also
> suggested) lightweight objects, or something like the lazy sequence
> object ala the SwissKnife suite (which only bring what you want into
> memory).
>
> Related to that, I have been testing something like that, which uses
> iterators to pass in chunks of data from a stream to handlers to build a
> sequence object. Wouldn't be too hard to reconfigure that to return
> file positions as well. Maybe for the 1.7 release...
Bio::PullParserI is your friend.
More information about the Bioperl-l
mailing list