English parsing only for LWP::UserAgent

[el_roachmeister]

I only want to parse english html pages so I added this line:

my $ua = LWP::UserAgent->new;
$ua->default_header('Accept-Language' => "no, en");

But it still seems to be parsing all languages. Maybe this can not be
done with LWP ?

 

[nobull]

I only want to parse english html pages so I added this line:

my $ua = LWP::UserAgent->new;
$ua->default_header('Accept-Language' => "no, en");

If you only want English why do you list two languages?

But it still seems to be parsing all languages.

Many web servers have no idea what language their content is in and
will ingore Accept-Language in requests and not put Content-Language in
responses.

Maybe this can not be done with LWP ?

This has nothing to do with LWP as such.