search an entire website given the homepage URL

B

Bell, Kevin

I know I can use urllib2 to get at a website given urllib2.urlopen(url)
but I'm unsure how to then go through all pages that are linked to it,
but still in the domain. If I want to search through the entire python
website give the homepage, how would I go about it? I don't reinvent
the wheel if someones already written a module for parsing out the links
and drilling through them!

TIA
KEV
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

Forum statistics

Threads
473,769
Messages
2,569,582
Members
45,057
Latest member
KetoBeezACVGummies

Latest Threads

Top