Crawl a site

Discussion in 'ASP General' started by Dave, Jun 23, 2004.

  1. Dave

    Dave Guest

    Is it possible to crawl a site using ASP & XML HTTP?

    I know you can hit one link, but how can you go through each link in a
    page and validate that it returns 200?
     
    Dave, Jun 23, 2004
    #1
    1. Advertising

  2. Dave

    Eric Gibson Guest

    Eric Gibson, Jun 27, 2004
    #2
    1. Advertising

Want to reply to this thread or ask your own question?

It takes just 2 minutes to sign up (and it's free!). Just click the sign up button to choose a username and then you can ask your own questions on the forum.
Similar Threads
  1. John

    Can Google crawl .aspx pages?

    John, Jan 31, 2007, in forum: ASP .Net
    Replies:
    2
    Views:
    450
    bruce barker
    Jan 31, 2007
  2. JIM.H.
    Replies:
    9
    Views:
    428
    Alexey Smirnov
    Feb 10, 2009
  3. Justin
    Replies:
    1
    Views:
    322
    Stefan Behnel
    Aug 21, 2009
  4. Steve Mauldin
    Replies:
    0
    Views:
    138
    Steve Mauldin
    Feb 6, 2004
  5. Danny
    Replies:
    1
    Views:
    149
    Aaron Bertrand [MVP]
    May 27, 2004
Loading...

Share This Page