Bioperl: Memory leak in BLAST modules
Lincoln Stein
lstein@cshl.org
Wed, 28 Oct 1998 16:46:28 -0500
Unfortunately it's still leaking, although maybe not quite so fast. I
don't think I'm going to be able to complete my analysis task at this
rate.
Are there any cycles in the object references that Blast.pm generates?
Lincoln
Steve Chervitz writes:
> Lincoln,
>
> I've been grappling with the memory leak for a while and have a new
> version of Blast.pm that includes a fix for memory leaks when parsing
> streams of reports. This is version 0.063 which you can get from:
>
> http://genome-www.stanford.edu/perlOOP/bioperl/lib/Bio/Tools/Blast.pm
>
> Memory use is still an issue, particularly if you are parsing huge
> reports (on the order of 1 Mb or more) and not imposing significance
> criteria. If you can include even a minimal cutoff (i.e., -signif =>
> 0.01), that should improve memory usage compared to using no cutoff.
>
> Also, when creating individual Blast objects, it's a good idea to
> explicitly destroy them when you're done processing each one
> ($blast_obj->destroy). Using a single $blast_obj variable and
> re-assigning it should accomplish the same thing (but calling
> destroy() makes me feel better ;).
>
> If you (or others) have additional ideas for how to improve memory
> usage, I'd be happy to hear them. Do you know of a good memory
> management tool for Perl that can show reference counts etc. during
> the course of an execution?
>
> I haven't bundled the new version of Blast.pm into a distribution
> package yet since there are other changes I want to include. But look
> for it soon.
>
> Steve
> ___________________________________________________
> Steve A. Chervitz Neomorphic Software
> sac@neomorphic.com 2612b 8th Street
> http://www.neomorphic.com Berkeley, CA 94710
>
>
> Lincoln Stein writes:
> > Does anyone know of a memory leak in the Bio::Tools::Blast module?
> > I've got a script that creates and destroys several thousands of these
> > objects and it is definitely leaking. I don't want spend time
> > debugging the thing if there's a known problem.
> >
> > Lincoln
> >
> > --
> > ========================================================================
> > Lincoln D. Stein Cold Spring Harbor Laboratory
> > lstein@cshl.org Cold Spring Harbor, NY
> > ========================================================================
> > =========== Bioperl Project Mailing List Message Footer =======
> > Project URL: http://bio.perl.org/
> > For info about how to (un)subscribe, where messages are archived, etc:
> > http://www.techfak.uni-bielefeld.de/bcd/Perl/Bio/vsns-bcd-perl.html
> > ====================================================================
> >
> =========== Bioperl Project Mailing List Message Footer =======
> Project URL: http://bio.perl.org/
> For info about how to (un)subscribe, where messages are archived, etc:
> http://www.techfak.uni-bielefeld.de/bcd/Perl/Bio/vsns-bcd-perl.html
> ====================================================================
--
========================================================================
Lincoln D. Stein Cold Spring Harbor Laboratory
lstein@cshl.org Cold Spring Harbor, NY
========================================================================
=========== Bioperl Project Mailing List Message Footer =======
Project URL: http://bio.perl.org/
For info about how to (un)subscribe, where messages are archived, etc:
http://www.techfak.uni-bielefeld.de/bcd/Perl/Bio/vsns-bcd-perl.html
====================================================================