[Bioperl-l] parallel processing with perl

[Jean-Jack Riethoven]

On Fri, 16 Jul 2004, Peter Wilkinson wrote:

> fork() command. Be warned that process management is an art and you might 
> end up spend some time learning about multiple process management.
> >
> >portion of script follows ...
> >#!/usr/bin/perl
> >.............
> >...........
> >$var1=`mysql -h localhost -u xx -pyy filter < batchfile1.sql |tail -1`;
> >$var2=`mysql -h localhost -u xx -pyy filter < batchfile2.sql |tail -1`;
> >$var3=`mysql -h localhost -u xx -pyy filter < batchfile3.sql |tail -1`;
> >$var4=`mysql -h localhost -u xx -pyy filter < batchfile4.sql |tail -1`;

Try Proc::Simple or any other process management module (not BioPerl,
have a look on cpan) - they generally work very well unless you start/end
new processes at phenomenal rates.

We are using Proc::Simple for a lot of our strictly monitored parallel
processing.

With kind regards,

Drs. Jean-Jack M. Riethoven

EMBL Outstation - Hinxton           pow at ebi.ac.uk     ICQ#: 3433929
European Bioinformatics Institute   Phone: (+44) 1223 494635      
Wellcome Trust Genome Campus        Fax  : (+44) 1223 494468
Hinxton, Cambridge CB10 1SD         URL  : http://www.ebi.ac.uk/asd/
UNITED KINGDOM