[DAS] ldas server limits

Lincoln Stein lstein@cshl.org
Wed, 26 Jun 2002 10:57:27 -0400


DAS will work well for thousands and possibly millions of features, but will 
become pretty slow for EnsEMBL-scale annotations.  It depends on what you're 
looking for.  If you only want the gene models, then DAS will work fine 
across the whole genome because there are only a few tens of thousands.  If 
you want the 100 million EST alignments, the transit time will be 
prohibitive.

Lincoln

On Tuesday 25 June 2002 09:40 pm, Russell, Archie wrote:
> the DAS advantage was that things would be in a common format from
> different providers.  this makes data integration a snap, but i guess
> doesn't work for large amounts of data.  if i download flatfiles, data
> integration becomes harder--unless they are in some common format like
> GFF--not tab-delimited files meant for loading into tables.  any ideas?
>
> -----Original Message-----
> From: Lincoln Stein [mailto:lstein@cshl.org]
> Sent: Monday, June 24, 2002 2:13 PM
> To: Russell, Archie; 'das@biodas.org'
> Subject: Re: [DAS] ldas server limits
>
>
> Don't even think of doing that!  It would be much more efficient to
> download
>
> the Ensembl flat files.
>
> Lincoln
>
> On Monday 24 June 2002 03:41 pm, Russell, Archie wrote:
> > On Fri, 21 Jun 2002, Tony Cox wrote:
> >
> > +>On Fri, 21 Jun 2002, Lincoln Stein wrote:
> > +>
> > +>OK, lets try it. I've just kicked off a database load - we'll see what
> > +>happens... :)
> > +>
> >
> > >Well, I finally got a bit bored of waiting for the DB to load so I
> > > killed
> >
> > it off
> >
> > >at 41,278,000 records. That's just under 50% of the total data.
> >
> > Could you tell us how long this took to download?  Would this be a
> > reasonable approach to periodically obtaining all of a database like
> > ensembl in a common format (ie DAS)?
> >
> > thanks,
> > archie
> >
> > archie russell
> > 425-636-6312
>
> ---------------------------------------------------------------------------
>
> >--- Notice: This e-mail message, together with any attachments, contains
> > information of Merck & Co., Inc. (Whitehouse Station, New Jersey, USA)
>
> that
>
> > may be confidential, proprietary copyrighted and/or legally privileged,
>
> and
>
> > is intended solely for the use of the individual or entity named on this
> > message. If you are not the intended recipient, and have received this
> > message in error, please immediately return this by e-mail and then
> > delete it.
>
> ===========================================================================
>
> >===
> >
> > _______________________________________________
> > DAS mailing list
> > DAS@biodas.org
> > http://biodas.org/mailman/listinfo/das

-- 
========================================================================
Lincoln D. Stein                           Cold Spring Harbor Laboratory
lstein@cshl.org			                  Cold Spring Harbor, NY
========================================================================