Looking for an http proxy server written in Python

[Chris Gray]

Is there such a beast? In particular, I'm looking for a
production-quality proxy server fully compliant with HTTP/1.1 written in
Python.

If there isn't, is there anything that comes close?

Thanks for any help you can throw my way,
Chris Gray

"Okey dokey.. free my mind. Right, no problem, free my mind, free my mind,
no problem, right... " -The Matrix

 

[Alan Kennedy]

[Chris Gray]

I'm looking for a
production-quality proxy server fully compliant with HTTP/1.1 written in
Python.

If there isn't, is there anything that comes close?

That depends on what you want the proxy to do.

Check the following page for a list of python http proxies.

http://xhaus.com/alan/python/proxies.html

If there's nothing there that catches your eye, then give a clearer
indication of what you need the proxy to do.

regards,

 

[Dave Brueck]

Is there such a beast? In particular, I'm looking for a
production-quality proxy server fully compliant with HTTP/1.1 written in
Python.

Forward or reverse proxy?

If there isn't, is there anything that comes close?

Alan Kennedy has this page:

http://xhaus.com/alan/python/proxies.html

See also:

http://groups.google.com/groups?th=9171610619278850

Which one to use really depends on what you need it for.

HTH,
Dave

 

[Chris Gray]

Thanks, Alan,

Your resource page is very helpful and your "Why" section explains exactly
why I'm interested in this. At first blush it looks like httpMonitor is
most in line with what I'm planning, namely, the ability to do arbitrary
processing on requests and responses.

The problem I've run across so far is transparency and performance. I've
written my own proxy server and experimented with WebDebug and found that
some things slow down considerably and other things don't seem to pass
through at all. I want, as much as possible, for the proxy to pass
requests and responses through in a way that makes no difference to the
client, but gives me a hook to hang selective logging, storage, and other
processing on.

That's why I specified production-quality and HTTP/1.1 compliance. If I
could just find a proxy server that forwarded requests and responses
seamlessly, I'd be happy.

Thanks again,
Chris

"Okey dokey.. free my mind. Right, no problem, free my mind, free my mind,
no problem, right... " -The Matrix

[Chris Gray]

I'm looking for a
production-quality proxy server fully compliant with HTTP/1.1 written in
Python.

If there isn't, is there anything that comes close?

That depends on what you want the proxy to do.

Check the following page for a list of python http proxies.

http://xhaus.com/alan/python/proxies.html

If there's nothing there that catches your eye, then give a clearer
indication of what you need the proxy to do.

regards,

 

[Paul Rubin]

Is there such a beast? In particular, I'm looking for a
production-quality proxy server fully compliant with HTTP/1.1 written in
Python.

I sometimes use Amit Patel's proxy3 for web surfing, but I don't know
if I'd call it production quality because it's so slow. I don't know
if anything can be done about that, because Python itself is pretty
slow. You may need to bite the bullet and use Squid or the Apache
proxy module or something like that. I've had reasonable success
hacking various html rewriting features into the Apache module when
such things were needed.

 

[John Abel]

You might want to have a look at Willow from www.digitallumber.com.

Regards

John

Thanks, Alan,

Your resource page is very helpful and your "Why" section explains exactly
why I'm interested in this. At first blush it looks like httpMonitor is
most in line with what I'm planning, namely, the ability to do arbitrary
processing on requests and responses.

The problem I've run across so far is transparency and performance. I've
written my own proxy server and experimented with WebDebug and found that
some things slow down considerably and other things don't seem to pass
through at all. I want, as much as possible, for the proxy to pass
requests and responses through in a way that makes no difference to the
client, but gives me a hook to hang selective logging, storage, and other
processing on.

That's why I specified production-quality and HTTP/1.1 compliance. If I
could just find a proxy server that forwarded requests and responses
seamlessly, I'd be happy.

Thanks again,
Chris

"Okey dokey.. free my mind. Right, no problem, free my mind, free my mind,
no problem, right... " -The Matrix

[Chris Gray]

I'm looking for a
production-quality proxy server fully compliant with HTTP/1.1 written in
Python.

If there isn't, is there anything that comes close?

That depends on what you want the proxy to do.

Check the following page for a list of python http proxies.

http://xhaus.com/alan/python/proxies.html

If there's nothing there that catches your eye, then give a clearer
indication of what you need the proxy to do.

regards,

 

[Chris Gray]

I sometimes use Amit Patel's proxy3 for web surfing, but I don't know
if I'd call it production quality because it's so slow. I don't know
if anything can be done about that, because Python itself is pretty
slow. You may need to bite the bullet and use Squid or the Apache
proxy module or something like that. I've had reasonable success
hacking various html rewriting features into the Apache module when
such things were needed.

I may have a look at Squid and mod_proxy (and Jigsaw to boot) at some
point. I'm not as worried about speed as I am about choking on requests
that can't be handled. I'm not trying to do the processing in real time;
that is, the results of the processing don't have to be available to the
client in real time.

Thanks for the feedback,
Chris

 

[Chris Gray]

You might want to have a look at Willow from www.digitallumber.com.

Regards

Thanks, I hadn't run across this before. Looks interesting.

Cheers,
Chris

 

[Alan Kennedy]

Your resource page is very helpful and your "Why" section explains
exactly why I'm interested in this. At first blush it looks like
httpMonitor is most in line with what I'm planning, namely, the
ability to do arbitrary processing on requests and responses.

I've tried to make the page a little more useful now, by adding
freshness dates, and a better overview of the features offered by the
various proxies.

http://www.xhaus.com/alan/python/proxies.html

That's why I specified production-quality and HTTP/1.1 compliance. If I
could just find a proxy server that forwarded requests and responses
seamlessly, I'd be happy.

FWIW, I mostly run a very simple proxy, derived from Suzuki Hisao's
Tiny proxy, to do protocol and resource logging, which I need when I'm
doing functional and load testing. I store the output in python
syntax, to be fed straight back into a python program. One of these
days I might clean it up a little and release it.

If you have any comments about the page, I'd be happy to hear them.

One of these days, I'm going to a full-on software review of the
proxies for a variety of different purposes. Content filtering and
blocking seems to be much in demand.

regards,