web crawl /robot

Discussion in 'ASP General' started by Marlo Brandon, Aug 3, 2004.

  1. Hiya ,
    I want to create /find an ASP robot that will look at all the pages on a
    site (my site that is), and return every word, along with the URL, so I can
    put them all in my database.
    OK maybe this is a site index.

    Please where can I turn?

    Thanks
     
    Marlo Brandon, Aug 3, 2004
    #1
    1. Advertising

Want to reply to this thread or ask your own question?

It takes just 2 minutes to sign up (and it's free!). Just click the sign up button to choose a username and then you can ask your own questions on the forum.
Similar Threads
  1. John

    Can Google crawl .aspx pages?

    John, Jan 31, 2007, in forum: ASP .Net
    Replies:
    2
    Views:
    458
    bruce barker
    Jan 31, 2007
  2. JIM.H.
    Replies:
    9
    Views:
    438
    Alexey Smirnov
    Feb 10, 2009
  3. Justin
    Replies:
    1
    Views:
    329
    Stefan Behnel
    Aug 21, 2009
  4. Steve Mauldin
    Replies:
    0
    Views:
    145
    Steve Mauldin
    Feb 6, 2004
  5. Danny
    Replies:
    1
    Views:
    159
    Aaron Bertrand [MVP]
    May 27, 2004
Loading...

Share This Page