Is LWP thread-safe?

[Agent2002]

Hi,
I enjoyed LWP so much that it can help me automating nearly all the
tasks a web browser can do. I also found that combining LWP with Perl's
new multi-thread model "ithread" can improve the efficiency of my web
scripts significantly, about ten or more times faster, perhaps.
For example, I've written a Perl script that can download the latest
news from CNN.com very quickly since it uses ten threads every instant
and it works very fine and has never got any problem. However, the
script I wrote recently using LWP and ithread together crashes every
time when it has accessed a URL using sufficient proxies. And I always
get the following error message:
Free to wrong pool 15306e48 not 272770.
I really have no idea whether it is caused by the LWP module. Could any
one tell me doubtlessly the LWP module is thread-safe or not? Thank you
very much.

 

[John Bokma]

Hi,
I enjoyed LWP so much that it can help me automating nearly all the
tasks a web browser can do. I also found that combining LWP with Perl's
new multi-thread model "ithread" can improve the efficiency of my web
scripts significantly, about ten or more times faster, perhaps.
For example, I've written a Perl script that can download the latest
news from CNN.com very quickly since it uses ten threads every instant
and it works very fine and has never got any problem. However, the
script I wrote recently using LWP and ithread together crashes every
time when it has accessed a URL using sufficient proxies. And I always
get the following error message:
Free to wrong pool 15306e48 not 272770.
I really have no idea whether it is caused by the LWP module. Could any
one tell me doubtlessly the LWP module is thread-safe or not? Thank you
very much.

Have you looked at the parallel useragent module? It doesn't use threads
(AFAIK), but does work in parallel (maybe less efficient)