Parallelization with Python: which, where, how?

M

Mike M?ller

Can someone recommend a parallelization approach? Are there examples or
documentation? Has someone got experience with stability and efficiency?

I am successfully using pyro http://pyro.sourceforge.net for my
parallelization task (8 node Linux cluster, embarrassing parallel).
It comes with a good documentation and it is easy to use. It works on
clusters as well as on heterogeneous networks. You just need to start
a server on each cluster node (e.g. rsh node1 startserver.py). You
also need a name server running (maybe on your master node). Then a
client can just asks a server to calculate and gets some result back.
You can also send an object that calculates on the server and comes
back including the result.

There are some examples included in the documentation you can start
with and just change the parts that are specific to your application.

It is easy to understand and use and has been working well for me for
more than 2 years.

Mike
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

No members online now.

Forum statistics

Threads
473,744
Messages
2,569,484
Members
44,903
Latest member
orderPeak8CBDGummies

Latest Threads

Top