[Bioperl-pipeline] web, restart

Juguang Xiao juguang at tll.org.sg
Fri Jun 27 17:07:56 EDT 2003


On Friday, June 27, 2003, at 03:47  PM, <aaron at tll.org.sg> wrote:
>
> As for the web pipeline... it certainly sounds like an interesting 
> option.
> Was working on web-based monitoring software earlier that went thru 
> three
> development revamps over 2 years. 1st version perl.cgi. 2nd pure java 
> (app)
> thru proprietary tcp-based protocol, and we had to finally settle on
> jsp/tomcat to avoid firewall/port problems, etc.

Sorry,  when did we have cgi version monitor?

> Our solution was based on a tiny server stub that maintains central 
> control
> of  the processes called a monitor. Then each web connection in will 
> query
> this monitor for current process state, etc. Back then we used shared 
> memory
> to decouple the actual processes from state monitoring. This can be 
> done
> through Perl IPC V5 calls too, though our implementation was C.
>
> Let me read thru the biopipe architecture to see how the processes are
> handled (forked/threaded), managed by PID/lockfiles, and I'll get back 
> to
> the list on how best to begin the design of the web monitor/launcher.

Aaron, The monitor system we plan to build up is only at job counting 
level. Querying the running pipeline database and then counting out how 
many analysis are there, how many jobs of each analysis is done or 
failed etc and a sort. And I do not think we are going to investigate 
at process level. Correct me, if I was wrong, other guys.


------------ATGCCGAGCTTNNNNCT--------------
Juguang Xiao
Temasek Life Sciences Laboratory, National University of Singapore
1 Research Link,  Singapore 117604
juguang at tll.org.sg



More information about the bioperl-pipeline mailing list