Alexander Staubo said:
I have an interest in distributed computing and so-called grid computing.
Has anyone here done, or know of, any grid processing with Ruby?
There is rq (ruby queue) by Ara. T. Howard:
http://raa.ruby-lang.org/project/rq/
rq is a tool used to build instant linux clusters
ruby queue (rq) is a tool used to create instant linux clusters by managing
sqlite databases as nfs mounted priority work queues. multiple instances of
rq running from multiples hosts can work from these queues to distribute
processing load to n nodes - bringing many dozens of otherwise powerful cpus
to their knees with a single blow. clearly this software should be kept out
of the hands of free radicals, seti enthusiasts, and j. safran.
the central concept of rq is that n nodes work in isolation to pull jobs
from an central nfs mounted priority work queue in a synchronized fashion.
the nodes have absolutely no knowledge of each other and all communication
if done via the queue meaning that, so long as the queue is available via
nfs and a single node is running jobs from it, the system will continue to
process jobs. there is no centralized process whatsoever - all nodes work to
take jobs from the queue and run them as fast as possible. this creates a
system which load balances automatically and is robust in face of node
failures.
