job scheduling framework?

[Chris Curvey]

Has anyone seen a simple open source job-scheduling framework written
in Python? I don't really want to reinvent the wheel. All I need is
the ability to set up a series of atomic "jobs" as a "stream", then
have the system execute the jobs in the stream one-at-a-time until all
the jobs in the stream are complete or one of them reports an error.

(If it tied into a really simple grid-style computing farm, that would
be worth double points!)

-Chris

 

[Benji York]

Has anyone seen a simple open source job-scheduling framework written
in Python?

It sounds like BuildBot (http://buildbot.sf.net) might interest you.

It's not exactly meant to be a job control system, but it does have some
nice functionality. It might be interesting to extend it in the
direction you're talking about.

 

[Larry Bates]

Google turned up these links that might be of interest:

http://www.foretec.com/python/workshops/1998-11/demosession/hoegl/
http://www.webwareforpython.org/Webware/TaskKit/Docs/QuickStart.html
http://www.slac.stanford.edu/BFROOT/www/Computing/Distributed/Bookkeeping/SJM/SJMMain.htm

Larry Bates

 

[Fernando Perez]

Google turned up these links that might be of interest:

http://www.foretec.com/python/workshops/1998-11/demosession/hoegl/
http://www.webwareforpython.org/Webware/TaskKit/Docs/QuickStart.html
http://www.slac.stanford.edu/BFROOT/www/Computing/Distributed/Bookkeeping/SJM/SJMMain.htm

Larry Bates

In addition to Larry's links, this might also be of interest:

http://directory.fsf.org/science/visual/Pyslice.html

Not exactly the same, but I suspect it may be useful.

Cheers,

f