Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for remote PBS #40

Open
rexissimus opened this issue Dec 5, 2012 · 3 comments
Open

Support for remote PBS #40

rexissimus opened this issue Dec 5, 2012 · 3 comments

Comments

@rexissimus
Copy link

I would like to add support for remote PBS. Are there any plans to do this? Do you have any pointers on where to begin?

@troelsfr
Copy link
Owner

troelsfr commented Dec 6, 2012

Adding support for remote PBS is probably possible, however, since I do not
know remote PBS, I have not planned support for this. Could you briefly
describe to me how it works? I guess it is a local commandline tool which
you can use to submit jobs on a remote PBS? If this is the case, one needs
to make a new queuing object - in the stable version this is somewhat
tedious, while it should be a matter of minutes in the unstable version. As
I suppose you want to use it with Vistrails, you will need to modify the
stable version.

Could you direct me to documentation homepage on how this tool works?

@rexissimus
Copy link
Author

Thanks, and sorry for the late reply. I had to learn PBS myself before I could answer, using this documentation:
http://www.adaptivecomputing.com/resources/docs/torque/4-0-2/help.htm.

I guess there is not such thing as "Remote PBS", what I want to achieve is to access PBS remotely over SSH using BatchQ. This article suggests it should be similar to LSF:
https://modelingguru.nasa.gov/docs/DOC-1040
If you already have LSF support maybe it is possible to just modify the calls?

What is the status of the unstable branch? If there are many improvements maybe it is better to use that branch and update the VisTrails code to work with it?

@troelsfr
Copy link
Owner

Actually, the main motivation for BatchQ is exactly to get remote access
to LSF and other submission systems. At the moment we only support LSF -
also in the version shipped with Vistrails.

However, this version is horribly slow, so if you want to do thousands of
jobs, you probably want to use the unstable trunk version.

It does not make sense to write a new package for Vistrails yet, since the
API changes a lot.

Maybe we should do a VC to discuss your needs?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants