how to get 20000 html pages content quickly from one server?

[JuHui]

Hi
I want to get 200000 html pages content from one server, you know
urllib.urlopen need construct network connection, it will be very
slowly, how to speed up this function?
I try to using multi-thread, it speed up, but I want to quickly more,
any idea about it?
Thanks!

 

[Bruno Desthuilliers]

JuHui a écrit :

in fact, I want to do a script to get news on others site.

Then ask the webmasters of theses sites if they do have a ress feed...