[Biojava-l] Job launching system

Schreiber, Mark mark.schreiber@agresearch.co.nz
Mon, 27 May 2002 10:40:52 +1200


Sounds interesting,

Is there overlap here with J2EE? Not entirely sure what you mean by
batch queues but I assume it would be along the lines of submitting jobs
to a blast farm or similar.

- Mark

> -----Original Message-----
> From: Keith James [mailto:kdj@sanger.ac.uk] 
> Sent: Saturday, 25 May 2002 5:38 a.m.
> To: BioJava List
> Subject: [Biojava-l] Job launching system
> 
> 
> 
> Just recently I've been working on a system for loading our 
> batch queues in a trackable manner and I'm wondering whether 
> there is any interest in adding it as a biojava cvs module. 
> In some ways it's a bit like a simplified Ensembl pipeline 
> minus all the application-specific bits (e.g. program output 
> parsing) but with support for jobs being "owned" by more than 
> one project. The idea was to decouple running programs from 
> parsing output and storing the data.
> 
> All the resource management is of course delegated to a batch 
> system like LSF or PBS, although without a batch system it 
> can just run stuff on the local host. The DB persistence is a 
> bit naive at the moment (it might need some caching).
> 
> Features:
>  Job ownership
>  Job dependencies (both && / || children) and retries on 
> failure  Java native interface to LSF for submission/queue 
> monitoring  Jobs implement standard Java MutableTreeNode 
> interface (-> JTree GUIs)  Command line generation with 
> Velocity Template Engine  Plugin job selection policies  
> PostgreSQL and Oracle support  Logging with log4j  Email notifications
> 
> Anyway, let me know.
> 
> Keith
> 
> -- 
> 
> -= Keith James - kdj@sanger.ac.uk - 
> http://www.sanger.ac.uk/Users/kdj =- Pathogen Sequencing 
> Unit, Wellcome Trust Sanger Institute, Cambridge, UK 
> _______________________________________________
> Biojava-l mailing list  -  Biojava-l@biojava.org 
> http://biojava.org/mailman/listinfo/biojava-l
> 
=======================================================================
Attention: The information contained in this message and/or attachments
from AgResearch Limited is intended only for the persons or entities
to which it is addressed and may contain confidential and/or privileged
material. Any review, retransmission, dissemination or other use of, or
taking of any action in reliance upon, this information by persons or
entities other than the intended recipients is prohibited by AgResearch
Limited. If you have received this message in error, please notify the
sender immediately.
=======================================================================