[Bioperl-l] dealing with large files

Sendu Bala bix at sendu.me.uk
Thu Dec 20 17:06:28 UTC 2007


Chris Fields wrote:
> The only way I can think of to fix this would be (as Jason also 
> suggested) lightweight objects, or something like the lazy sequence 
> object ala the SwissKnife suite (which only bring what you want into 
> memory).
> 
> Related to that, I have been testing something like that, which uses 
> iterators to pass in chunks of data from a stream to handlers to build a 
> sequence object.  Wouldn't be too hard to reconfigure that to return 
> file positions as well.  Maybe for the 1.7 release...

Bio::PullParserI is your friend.



More information about the Bioperl-l mailing list