Using a python web client behind a proxy (urllib and twisted.web)

M

Matthijs

I have been trying to make a script that will download several rss feeds
to my computer. The only problem I have is that I have to go through a
proxy.

First I tried using urllib (python 2.4, win32) but I found that the
http_proxy and no_proxy code were not implemented for win32. I have made
changes to urllib and urllib2 so that they use the proxy set in either
the windows registry or in an environment variable.

Question: How can I get this code added to the python distribution?

Then I found this script:
http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/277099

which uses twisted.web and does asynchronous requests, which is nice
when you want to download a lot of rss feeds. But again it doesn't
support a proxy, that I could find.

Question: Am i right that twisted.web.client does not support proxying?

Kind regards,
Matthijs

ps. I am just starting with Python
 
M

Mike Meyer

Matthijs said:
I have been trying to make a script that will download several rss
feeds to my computer. The only problem I have is that I have to go
through a proxy.

First I tried using urllib (python 2.4, win32) but I found that the
http_proxy and no_proxy code were not implemented for win32. I have
made changes to urllib and urllib2 so that they use the proxy set in
either the windows registry or in an environment variable.

Question: How can I get this code added to the python distribution?

submit a patch to <URL: http://sourceforge.net/tracker/?group_id=5470 >.

<mike
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

No members online now.

Forum statistics

Threads
473,755
Messages
2,569,536
Members
45,007
Latest member
obedient dusk

Latest Threads

Top