Why crawler don't get to my aspx page unless the Work Process is started?

Discussion in 'ASP .Net' started by Nicolas, Jan 28, 2005.

  1. Nicolas

    Nicolas Guest

    I need HELP!!!!!
    The crawler (Google or other) don't index my web site unless the web site is
    currently visited
    If there is nobody visiting those .aspx page therefor activating the aspnet
    no crawler is going throught the site

    I play with the robots file the meta tag etc.
    Also played with the crawler class but no success

    Sub Application_BeginRequest(ByVal sender As Object, ByVal e As EventArgs)
    Try
    If Request.Browser.Crawler Then
    Response.Redirect("index.htm")
    End If
    Catch ex As Exception
    End Try
    End Sub

    The problem with the above it always goes to the same page therefor not very
    efficient

    I'm running W2003 with II6 and Framework 1.1 sp1

    Thanks for your help please
    http://www.novadata.com

    Nicolas
     
    Nicolas, Jan 28, 2005
    #1
    1. Advertisements

Want to reply to this thread or ask your own question?

It takes just 2 minutes to sign up (and it's free!). Just click the sign up button to choose a username and then you can ask your own questions on the forum.
Similar Threads
  1. Bennett Haselton
    Replies:
    5
    Views:
    786
    Bennett Haselton
    Aug 19, 2003
  2. Replies:
    0
    Views:
    350
  3. Mr. SweatyFinger

    why why why why why

    Mr. SweatyFinger, Nov 28, 2006, in forum: ASP .Net
    Replies:
    4
    Views:
    1,386
    Mark Rae
    Dec 21, 2006
  4. Mr. SweatyFinger
    Replies:
    2
    Views:
    2,853
    Smokey Grindel
    Dec 2, 2006
  5. jpock76
    Replies:
    0
    Views:
    785
    jpock76
    Aug 23, 2010
  6. Joe Van Dyk
    Replies:
    6
    Views:
    385
    Csaba Henk
    Apr 2, 2005
  7. Gábor SEBESTYÉN

    Unless unless

    Gábor SEBESTYÉN, Jun 17, 2005, in forum: Ruby
    Replies:
    3
    Views:
    348
    Gábor SEBESTYÉN
    Jun 17, 2005
  8. Zach Dennis

    unless statement... why oh why?

    Zach Dennis, Aug 18, 2005, in forum: Ruby
    Replies:
    6
    Views:
    216
    Hal Fulton
    Aug 19, 2005
Loading...