Bioperl: Working pvm app in perl

[Mr P.A. Van Heusden]

  This message is in MIME format.  The first part should be readable text,
  while the remaining parts are likely unreadable without MIME-aware tools.
  Send mail to mime@docserver.cac.washington.edu for more info.

---559023410-851401618-936973118=:2002
Content-Type: TEXT/PLAIN; charset=US-ASCII

Hi

I didn't quite know who to send this to, but since this came up at the
BioPerl conference, I thought I'd announce it here.

As a number of people know, the common wisdom about pvm and perl has been
that pvm doesn't work in perl. Well, I've just managed to get a working
master/slave pvm add working using the Parallel::Pvm and pvm-3.4.1.

There was a minor bug in Parallel::Pvm, which I've attached a patch for.
Patch by going to the Parallel::Pvm directory and using the command

patch -p1 -N < patchfile

Attached to this message are two files:

master.pl is a server, which spawns a number of pvm tasks, and sends its 
TID to them so that they can communicate with it.

slave.pl is a client which is started by master.pl, and simply generates
pseudo-random numbers and sends them to the master.

To run these things, install the Parallel::Pvm module, look at the 'use
lib' lines in the scripts to see what to change them to, put the two
scripts in your path, and run master.pl.

The framework implemented in these scripts is a rather simplistic one
which doesn't deal with issues such as hosts dissapearing midway through a
job (which should be dealt with, particularly if you want to run under a
dynamic load balancing system - such as Condor-PVM).

But being able to write pvm jobs in perl is still quite cool, IMO.

Cheers,
Peter
--
Peter van Heusden : pvanheus@hgmp.mrc.ac.uk : PGP key available
'The demand to give up illusions about the existing state of affairs is the 
demand to give up a state of affairs which needs illusions.' - Karl Marx

---559023410-851401618-936973118=:2002
Content-Type: TEXT/PLAIN; charset=US-ASCII; name="master.pl"
Content-Transfer-Encoding: BASE64
Content-ID: <Pine.GSO.3.94.990910151838.2002C@rhenium>
Content-Description: master.pl

IyEvdXNyL2xvY2FsL2Jpbi9wZXJsDQoNCnVzZSBzdHJpY3Q7DQoNCnVzZSBs
aWIgcXcoL2hvbWUvcmFkb24vRVNUL3B2YW5oZXVzL3BlcmwvbGliL3NpdGVf
cGVybC81LjAwNSAvaG9tZS9yYWRvbi9FU1QvcHZhDQpuaGV1cy9wZXJsL2xp
Yi9zaXRlX3BlcmwvNS4wMDUvc3VuNC1zb2xhcmlzKTsNCnVzZSBQYXJhbGxl
bDo6UHZtOw0KDQpteSAkU0xBVkVfQ09VTlQgPSAyOw0KDQpteSAkQ0hJTERf
TUVTU0FHRSA9IDUwMDsNCm15ICRTRVJWRVJfTUVTU0FHRSA9IDUwMTsNCg0K
cHJpbnQgIkdldHRpbmcgbXkgdGlkXG4iOw0KbXkgJHNlcnZlcl90aWQgPSBQ
YXJhbGxlbDo6UHZtOjpteXRpZDsNCnByaW50ICJNeSB0aWQgaXM6ICRzZXJ2
ZXJfdGlkXG4iOw0KbXkgKCRuc2xhdmVzLCBAdGlkcykgPSBQYXJhbGxlbDo6
UHZtOjpzcGF3bignc2xhdmUucGwnLCRTTEFWRV9DT1VOVCk7DQoNCiMgbXkg
KCRpbmZvLEBjb25mKSA9IFBhcmFsbGVsOjpQdm06OmNvbmZpZygpIDsNCiMg
aWYgKCAkaW5mbyA9PSBQdm1PayApew0KIyAgIGZvcmVhY2ggbXkgJG5vZGUg
KEBjb25mKXsNCiMgICAgIHByaW50ICJob3N0IGlkID0gJG5vZGUtPnsnaGlf
dGlkJ31cbiI7DQojICAgICBwcmludCAiaG9zdCBuYW1lID0gJG5vZGUtPnsn
aGlfbmFtZSd9XG4iOw0KIyAgICAgcHJpbnQgImhvc3QgYXJjaGl0ZWN0dXJl
ID0gJG5vZGUtPnsnaGlfYXJjaCd9XG4iOw0KIyAgICAgcHJpbnQgImhvc3Qg
c3BlZWQgPSAkbm9kZS0+eydoaV9zcGVlZCd9XG4iOw0KIyAgIH0NCiMgfQ0K
IyANCg0KcHJpbnQgInNsYXZlcyBzcGF3bmVkOiAkbnNsYXZlc1xuIjsNCm15
ICRjb3VudCA9IDA7DQpmb3JlYWNoIG15ICR0aWQgKEB0aWRzKSB7DQogICRj
b3VudCsrOw0KICBpZiAoJHRpZCA8IDApIHsNCiAgICBwcmludCBTVERFUlIg
IkVycm9yIHNwYXduaW5nIHRhc2sgJGNvdW50OiAkdGlkXG4iOw0KICB9IGVs
c2Ugew0KICAgIHByaW50IHNwcmludGYoIlNlbmRpbmcgc3RhcnQgbWVzc2Fn
ZSB0byAlbHhcbiIsICR0aWQpOw0KICAgIFBhcmFsbGVsOjpQdm06OmluaXRz
ZW5kOw0KICAgIFBhcmFsbGVsOjpQdm06OnBhY2soJHNlcnZlcl90aWQsJ21h
c3Rlcl90aWQnKTsNCiAgICBQYXJhbGxlbDo6UHZtOjpzZW5kKCR0aWQsICRT
RVJWRVJfTUVTU0FHRSk7DQogIH0NCn0NCg0KcHJpbnQgIk9rLCByZWFkeSB0
byByb2xsIVxuIjsNCmlmICgkbnNsYXZlcyA+IDApIHsNCiAgJFNJR3tJTlR9
ID0gXCZzdG9wX2NoaWxkcmVuX2FuZF9leGl0Ow0KICBteSAkc3RvcCA9IDA7
DQogIG15ICRjb3VudCA9IDA7DQogIHdoaWxlICghJHN0b3AgJiYgJGNvdW50
IDwgMTApIHsNCiAgICBteSAkYnVmaWQ7DQogICAgaWYgKCgkYnVmaWQgPSBQ
YXJhbGxlbDo6UHZtOjpyZWN2KC0xLCAkQ0hJTERfTUVTU0FHRSkpID49IDAp
IHsNCiAgICAgIG15ICh1bmRlZiwgdW5kZWYsIHVuZGVmLCAkY2hpbGRfdGlk
KSA9IFBhcmFsbGVsOjpQdm06OmJ1ZmluZm8oJGJ1ZmlkKTsNCiAgICAgIG15
ICRyZXF1ZXN0ID0gUGFyYWxsZWw6OlB2bTo6dW5wYWNrKCk7DQogICAgICBp
ZiAoJHJlcXVlc3QgZXEgJ3N0b3AnKSB7DQoJJHN0b3AgPSAxOw0KCW5leHQ7
DQogICAgICB9IGVsc2lmICgkcmVxdWVzdCBlcSAncmVzdWx0Jykgew0KCSRj
b3VudCsrOw0KCW15ICRudW0gPSBQYXJhbGxlbDo6UHZtOjp1bnBhY2s7DQoJ
cHJpbnQgImNoaWxkICRjaGlsZF90aWQgc2VudCB1czogJG51bVxuIjsNCglQ
YXJhbGxlbDo6UHZtOjppbml0c2VuZDsNCglQYXJhbGxlbDo6UHZtOjpwYWNr
KCdkb19hbm90aGVyJyk7DQoJUGFyYWxsZWw6OlB2bTo6c2VuZCgkY2hpbGRf
dGlkLCAkU0VSVkVSX01FU1NBR0UpOw0KICAgICAgfSBlbHNlIHsNCglwcmlu
dCAiVW5rbm93biByZXF1ZXN0IGZyb20gY2hpbGQgJGNoaWxkX3RpZDogJHJl
cXVlc3RcbiI7DQogICAgICB9DQogICAgfSBlbHNlIHsNCiAgICAgIG15ICgk
aW5mbywgdW5kZWYsIHVuZGVmLCAkY2hpbGRfdGlkKSA9IFBhcmFsbGVsOjpQ
dm06OmJ1ZmluZm8oJGJ1ZmlkKTsNCiAgICAgIHByaW50ICJFcnJvciByZWNl
aXZpbmcgbWVzc2FnZSBmcm9tIGNoaWxkICgkY2hpbGRfdGlkKTogJGluZm8u
XG4iOw0KICAgICAgcHJpbnQgIkV4aXRpbmdcbiI7DQogICAgICAkc3RvcCA9
IDE7DQogICAgfQ0KICB9DQp9IGVsc2Ugew0KICBwcmludCBTVERFUlIgIk5v
IHRhc2tzIHNwYXduZWQhXG4iOw0KICBleGl0IDE7DQp9DQoNCkVORCB7DQog
cHJpbnQgIlRlbGxpbmcgY2hpbGRyZW4gdG8gc3RvcCFcbiI7DQogc3RvcF9j
aGlsZHJlbihAdGlkcyk7DQogUGFyYWxsZWw6OlB2bTo6ZXhpdDsNCiBleGl0
IDA7DQp9IA0KDQpzdWIgc3RvcF9jaGlsZHJlbiB7DQogIG15IEB0aWRzID0g
QF87DQoNCiAgZm9yZWFjaCBteSAkdGlkIChAdGlkcykgew0KICAgIFBhcmFs
bGVsOjpQdm06OmluaXRzZW5kOw0KICAgIFBhcmFsbGVsOjpQdm06OnBhY2so
J3N0b3AnKTsNCiAgICBQYXJhbGxlbDo6UHZtOjpzZW5kKCR0aWQsICRTRVJW
RVJfTUVTU0FHRSk7DQogIH0NCn0NCg0Kc3ViIHN0b3BfY2hpbGRyZW5fYW5k
X2V4aXQgew0KICBteSAkc2lnID0gc2hpZnQ7DQoNCiAgaWYgKCRzaWcgZXEg
J0lOVCcpIHsNCiAgICBzdG9wX2NoaWxkcmVuKEB0aWRzKTsNCiAgICBQYXJh
bGxlbDo6UHZtOjpleGl0Ow0KICAgIGV4aXQgMDsNCiAgfQ0KfQ0K
---559023410-851401618-936973118=:2002
Content-Type: TEXT/PLAIN; charset=US-ASCII; name="slave.pl"
Content-Transfer-Encoding: BASE64
Content-ID: <Pine.GSO.3.94.990910151838.2002D@rhenium>
Content-Description: slave.pl

IyEvdXNyL2xvY2FsL2Jpbi9wZXJsDQoNCnVzZSBzdHJpY3Q7DQoNCnVzZSBs
aWIgcXcoL2hvbWUvcmFkb24vRVNUL3B2YW5oZXVzL3BlcmwvbGliL3NpdGVf
cGVybC81LjAwNSAvaG9tZS9yYWRvbi9FU1QvcHZhbmhldXMvcGVybC9saWIv
c2l0ZV9wZXJsLzUuMDA1L3N1bjQtc29sYXJpcyk7DQp1c2UgUGFyYWxsZWw6
OlB2bTsNCg0KbXkgJENISUxEX01FU1NBR0UgPSA1MDA7DQpteSAkU0VSVkVS
X01FU1NBR0UgPSA1MDE7DQoNCm15ICRzbGF2ZV90aWQgPSBQYXJhbGxlbDo6
UHZtOjpteXRpZDsNClBhcmFsbGVsOjpQdm06OmNhdGNob3V0Ow0KDQpteSAk
YnVmaWQ7IG15ICRzZXJ2ZXJfdGlkID0gLTE7DQpwcmludCAiTXkgdGlkIGlz
OiAkc2xhdmVfdGlkLCByZWFkeSB0byByZWNlaXZlIG1lc3NhZ2VzXG4iOw0K
d2hpbGUgKCgkYnVmaWQgPSBQYXJhbGxlbDo6UHZtOjpyZWN2KC0xLCAkU0VS
VkVSX01FU1NBR0UpKSA+PSAwKSB7DQogIG15ICh1bmRlZiwgdW5kZWYsIHVu
ZGVmLCAkdGlkKSA9IFBhcmFsbGVsOjpQdm06OmJ1ZmluZm8oJGJ1ZmlkKTsN
CiAgbXkgJHJlcXVlc3QgPSBQYXJhbGxlbDo6UHZtOjp1bnBhY2s7DQogIGlm
ICgkcmVxdWVzdCBlcSAnbWFzdGVyX3RpZCcpIHsNCiAgICAkc2VydmVyX3Rp
ZCA9IFBhcmFsbGVsOjpQdm06OnVucGFjazsNCiAgICBteSAkbnVtID0gaW50
KHJhbmQoKSAqIDEwMDAwKTsNCiAgICBQYXJhbGxlbDo6UHZtOjppbml0c2Vu
ZDsNCiAgICBQYXJhbGxlbDo6UHZtOjpwYWNrKCdyZXN1bHQnKTsNCiAgICBQ
YXJhbGxlbDo6UHZtOjpwYWNrKCRudW0pOw0KICAgIFBhcmFsbGVsOjpQdm06
OnNlbmQoJHNlcnZlcl90aWQsICRDSElMRF9NRVNTQUdFKTsNCiAgfSBlbHNp
ZiAoJHJlcXVlc3QgZXEgJ2RvX2Fub3RoZXInKSB7DQogICAgc2xlZXAoMSk7
DQogICAgbXkgJG51bSA9IGludChyYW5kKCkgKiAxMDAwMCk7DQogICAgUGFy
YWxsZWw6OlB2bTo6aW5pdHNlbmQ7DQogICAgUGFyYWxsZWw6OlB2bTo6cGFj
aygncmVzdWx0Jyk7DQogICAgUGFyYWxsZWw6OlB2bTo6cGFjaygkbnVtKTsN
CiAgICBQYXJhbGxlbDo6UHZtOjpzZW5kKCRzZXJ2ZXJfdGlkLCAkQ0hJTERf
TUVTU0FHRSk7DQogIH0gZWxzaWYgKCRyZXF1ZXN0IGVxICdzdG9wJykgew0K
ICAgIFBhcmFsbGVsOjpQdm06OmV4aXQ7DQogICAgZXhpdCAwOw0KICB9IGVs
c2Ugew0KICAgIHByaW50ICJVbmtub3duIHJlcXVlc3QgJHJlcXVlc3QgcmVj
ZWl2ZWQgZnJvbSAkdGlkXG4iOw0KICB9DQp9DQppZiAoJGJ1ZmlkIDwgMCkg
ew0KICBteSAoJGluZm8sIHVuZGVmLCB1bmRlZiwgJHRpZCkgPSBQYXJhbGxl
bDo6UHZtOjpidWZpbmZvKCRidWZpZCk7DQogIHByaW50ICJFcnJvciByZWNl
aXZpbmcgbWVzc2FnZSBmcm9tIHBhcmVudCAoJHRpZCk6ICRpbmZvLlxuIjsN
CiAgcHJpbnQgIkV4aXRpbmdcbiI7DQogIGV4aXQgMTsNCn0NCg==
---559023410-851401618-936973118=:2002
Content-Type: TEXT/PLAIN; charset=US-ASCII; name=patch
Content-Transfer-Encoding: BASE64
Content-ID: <Pine.GSO.3.94.990910151838.2002E@rhenium>
Content-Description: patch to Parallel::Pvm

KioqIFBhcmFsbGVsLVB2bS0xLjEvUHZtLnhzCVR1ZSBPY3QgMTUgMDQ6MTU6
MzMgMTk5Ng0KLS0tIFBhcmFsbGVsLVB2bS0xLjEubmV3L1B2bS54cwlGcmkg
U2VwIDEwIDEzOjU5OjQ5IDE5OTkNCioqKioqKioqKioqKioqKg0KKioqIDcz
Miw3MzggKioqKg0KICAJU2FmZWZyZWUoIGFyZ3YgKTsgLyogbm8gaGFybSBk
b25lIGlmIGFyZ3YgaXMgTlVMTCAqLw0KICAgDQogIAlYUFVTSHMoc3ZfMm1v
cnRhbChuZXdTVml2KGluZm8pKSk7DQohIAlmb3IgKGk9MDtpPGluZm87aSsr
KXsNCiAgCSAgIFhQVVNIcyhzdl8ybW9ydGFsKG5ld1NWaXYodGlkc1tpXSkp
KTsNCiAgCX0NCiAgDQotLS0gNzMyLDczOCAtLS0tDQogIAlTYWZlZnJlZSgg
YXJndiApOyAvKiBubyBoYXJtIGRvbmUgaWYgYXJndiBpcyBOVUxMICovDQog
ICANCiAgCVhQVVNIcyhzdl8ybW9ydGFsKG5ld1NWaXYoaW5mbykpKTsNCiEg
CWZvciAoaT0wO2k8bnRhc2s7aSsrKXsNCiAgCSAgIFhQVVNIcyhzdl8ybW9y
dGFsKG5ld1NWaXYodGlkc1tpXSkpKTsNCiAgCX0NCiAgDQo=
---559023410-851401618-936973118=:2002--

=========== Bioperl Project Mailing List Message Footer =======
Project URL: http://bio.perl.org/
For info about how to (un)subscribe, where messages are archived, etc:
http://www.techfak.uni-bielefeld.de/bcd/Perl/Bio/vsns-bcd-perl.html
====================================================================