Using Pool of Processes

C

chirag75

I have to process no of files from a directory. each file can be
processed in parallel. I want to distribute processing between no of
children processes ( not threads ) what will be the best approach to do
this ? Can someone point an example where something like is being done
?
 
C

chirag75

One approach i am thinking is reading the files in an array first and
spawning no of procsses. each processes will process will procsses
specified files from the array.
 
T

Tad McClellan

I have to process no of files from a directory. each file can be
processed in parallel. I want to distribute processing between no of
children processes ( not threads ) what will be the best approach to do
this ? Can someone point an example where something like is being done
?


Googling for "preforking" finds an article written by Randal Schwartz
that implements a pool of processes.
 
T

Tad McClellan

thanks Tad.


For what?

I make a whole lot of followups each day, I cannot keep straight
what I said to who without something to jog my memory.

Please quote some context in followups like everybody else does.

Please begin to do this very very soon.

Thank you.
 
X

xhoster

I have to process no of files from a directory. each file can be
processed in parallel. I want to distribute processing between no of
children processes ( not threads ) what will be the best approach to do
this ? Can someone point an example where something like is being done
?

Parallel::ForkManager

Xho
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

Forum statistics

Threads
473,769
Messages
2,569,579
Members
45,053
Latest member
BrodieSola

Latest Threads

Top