multi-threading

[Jason Quek]

Hi

I have a long list of URLs and I need to do HTTP requests for each of
these domains.

# -----------------------------------------------------------------
@urls = (
'http://www.yahoo.com',
'http://www.google.com',
'http://www.msn.com',
'http://www.altavista.com'
);

use LWP::UserAgent;
$ua = LWP::UserAgent->new;

foreach $url (@urls)
{
$req = HTTP::Request->new('GET', "$url");
$results = $ua->request($req)->as_string;

# then process $results
}
# -----------------------------------------------------------------

How do I multi-thread so that multiple URLs are http-requested at the
same time?

Any help would be appreciated.

Thank you



Jason Q.

 

[Iain Chalmers]

How do I multi-thread so that multiple URLs are http-requested at the
same time?

See LWP:arallel - its all done for you (and works _very_ well, thanks
Marc!)

http://search.cpan.org/~marclang/ParallelUserAgent-2.56/lib/LWP/Parallel.
pm

(watch the line wrapping on that)

big