urllib2 meta-refresh

[Artificial Life]

urllib2 does not seem to be able to handle META-REFRESH in an html
document. I just get back the html to the page that is supposed to forward
me to the intended page. Any way around this?

 

[Dave Brueck]

urllib2 does not seem to be able to handle META-REFRESH in an html
document. I just get back the html to the page that is supposed to forward
me to the intended page.

Right - urllib2 is for working with protocols (like HTTP) to transfer data,
whereas META-REFRESH is an application (browser) level "instruction" *in* that
data. Compare this to a 302 HTTP response header (a simple redirect) - urllib2
can handle it because it is part of HTTP.

Any way around this?

Sure - META-REFRESH is an instruction to the browser, so have your code be the
browser: scan the HTML for the tag, extract the URL, and send that new URL off
to urllib2.

-Dave

 

[JanC]

Artificial Life schreef:

urllib2 does not seem to be able to handle META-REFRESH in an html
document. I just get back the html to the page that is supposed to
forward me to the intended page. Any way around this?

Have a look at the HTTPRefreshProcessor in ClientCookie:
<http://wwwsearch.sourceforge.net/ClientCookie/doc.html>

 

[John J. Lee]

Artificial Life schreef:


Have a look at the HTTPRefreshProcessor in ClientCookie:
<http://wwwsearch.sourceforge.net/ClientCookie/doc.html>

Be sure to read all the notes under "Notes about ClientCookie, urllib2
and cookielib" on this page:

http://wwwsearch.sourceforge.net/ClientCookie/


John