Alternatives to LWP::Parallel

[Peter]

I'm in the process of writing a script that will take a whole bunch of
URL's and get their HTTP status. I was going to use
LWP:arallel::UserAgent to handle parallel HTTP requests. However, I
found that this module does not work with later version of libwww and
it looks like this module is no longer maintained.

So I started looking around at other methods/modules I could use.
There are certainly quite a few to choose from and some are quite
complex for my needs.

Some of the modules I looked at were:

IO::Lambda::HTTP (this looked the most robust/well maintained, but has
a learning curve to it)
POE::Component::Client::HTTP (as above)
AnyEvent::HTTP (this looked promising, but I couldn't get any results
with it)
HTTP::Client:arallel (doesn't appear to have any function to limit
number of connections)
HTTP::Async (a little buggy and didn't seem to produce expected
results).

One essential feature I need is the ability to throttle/limit the
number of simultaneous connections or number of connections/requests
per minute.

I'd appreciate any advice as to what method/module might be best for
me. The other governing factor is that I need it to run with
ActivePerl on Linux and Windows.

 

[J. Gleixner]

I'm in the process of writing a script that will take a whole bunch of
URL's and get their HTTP status. I was going to use
LWP:arallel::UserAgent to handle parallel HTTP requests. However, I
found that this module does not work with later version of libwww and
it looks like this module is no longer maintained.

So I started looking around at other methods/modules I could use.
There are certainly quite a few to choose from and some are quite
complex for my needs.

Some of the modules I looked at were:

Why not simply Parallel::ForkManager and LWP::UserAgent?

[...]

 

[Peter]

I'm in the process of writing a script that will take a whole bunch of
URL's and get their HTTP status.  I was going to use
LWP:arallel::UserAgent to handle parallel HTTP requests.  However, I
found that this module does not work with later version of libwww and
it looks like this module is no longer maintained.

So I started looking around at other methods/modules I could use.
There are certainly quite a few to choose from and some are quite
complex for my needs.

Some of the modules I looked at were:

Why not simply Parallel::ForkManager and LWP::UserAgent?

[...]

Ah, now that looks to be just what I need. I don't know how I managed
to miss that one. Thanks.