different proxies and multiple requests in LWP::Parallel

Z

Zeke Koos

I've written the following script to verify a list of proxies in a
seperate file. It works fine except that I can't get LWP::parallel to
use different proxies for each request. As it is now when I call
$ua->wait(20), the last proxy in list is used for every request in the
queue. If anyone has a solution please help me out here.

thanks
Koos




#!/usr/bin/perl

use LWP::UserAgent;
use HTTP::Request;
use LWP::parallel::UserAgent;

open(IN, './proxies.txt') or die "Could not open filename:";
my @proxies = <IN>;
chomp @proxies;
close(IN);

print "Content-type: text/html\n\n";
print "Start test:<br />";


my $ua = LWP::parallel::UserAgent->new();
for (my $i = 0; $i < @proxies; $i++) {
tt("http://192.168.0.1/",$proxies[$i]);
};

my $entries = $ua->wait(20);
foreach (keys %$entries) {
my $res = $entries->{$_}->response;
print "Answer for '",$res->request->url, "' was \t", $res->code,":
",
$res->message,"\n<br />";
}

print "end";

sub tt {
my ($url,$proxy) = @_;
$ua->max_hosts(25);
$ua->agent('Mozilla/4.5');
$ua->proxy('http', 'http://'.$proxy);
my $req = HTTP::Request->new('GET', $url);
$ua->register ($req);
}
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

No members online now.

Forum statistics

Threads
473,767
Messages
2,569,570
Members
45,045
Latest member
DRCM

Latest Threads

Top