[BioRuby] Manage Torque/PBS from Ruby

Raoul Bonnal bonnal at ingm.org
Tue Sep 3 11:24:42 EDT 2013


Hi People,
I developed a library to interact remotely with a TORQUE/PBS cluster, http://www.adaptivecomputing.com/products/open-source/torque/. Francesco helped Me a lot,  debugging and contributing to the code base. You can create, configure and run jobs, they will be transferred to the cluster by the library. You can query the cluster monitoring all your jobs or just a specific one. You can also delete a job from the queue.
In addition I created a very simple sinatra application, bundled with the gem -just type torque_rm_rest- ,  which replies to html or json requests. I do not like very much the ".json" extension so the request header must be configured as Content-type: application/json

I like the idea to have a framework and a sort of web app to play with, I want to monitor my jobs/tasks from my mobile :)
The gem does not require to be installed on the master not, it is enough a machine in your local network with ssh keys shared, actually it works using ssh so also a vnp is fine g ^_^

Actually we need this software layer for our daily job, NGS analyses require complex workflows and need a resource management infrastructure/queue.

There is not yet an official gem, I'd like to have you feedbacks and fix some bug and maybe next week release it officially.

There are many things to do:
* improving the web app with fancy interfaces 
* introduce interactivity like run job from the web
* debugging the base framework and the rest interface
* extending the rest api ( actually I do not have a clear view of the "final" rest api so it could change )

oooo yesssss https://github.com/helios/torque_rm the link to the repo

any comment, feedback and contribute is more than welcome ;-)


Ciao.

--
Ra






More information about the BioRuby mailing list