Crawl a site

[Dave]

Is it possible to crawl a site using ASP & XML HTTP?

I know you can hit one link, but how can you go through each link in a
page and validate that it returns 200?

 

[Eric Gibson]

Is it possible to crawl a site using ASP & XML HTTP?

I know you can hit one link, but how can you go through each link in a
page and validate that it returns 200?

Using PerlScript and the Robot module.

http://search.cpan.org/~awrigley/WWW-Robot-0.023/lib/WWW/Robot.pm

Eric