How can i save a page content from a http address? (just like a Search Engine Robot)

Discussion in 'ASP .Net' started by gonzal kamikadze, Apr 5, 2005.

  1. Hi



    I was just wondering if it is hard to write a small engine that will only
    read/index a page from the internet that will be accessible only thru
    http://...

    (You could say it's like a search engine robot...)



    Any examples?

    code in ASP or ASP.NET (vb)





    Regards

    Gonzalez
     
    gonzal kamikadze, Apr 5, 2005
    #1
    1. Advertising

  2. gonzal kamikadze

    Elton Wang Guest

    Hi gonzal,

    You can use HttpWebRequest to get content of a web page
    from internet.

    HTH

    Elton Wang



    >-----Original Message-----
    >Hi
    >
    >
    >
    >I was just wondering if it is hard to write a small

    engine that will only
    >read/index a page from the internet that will be

    accessible only thru
    >http://...
    >
    >(You could say it's like a search engine robot...)
    >
    >
    >
    >Any examples?
    >
    >code in ASP or ASP.NET (vb)
    >
    >
    >
    >
    >
    >Regards
    >
    >Gonzalez
    >
    >
    >.
    >
     
    Elton Wang, Apr 6, 2005
    #2
    1. Advertising

  3. gonzal kamikadze

    Joerg Jooss Guest

    gonzal kamikadze wrote:

    > Hi
    >
    >
    >
    > I was just wondering if it is hard to write a small engine that will
    > only read/index a page from the internet that will be accessible only
    > thru http://...
    >
    > (You could say it's like a search engine robot...)
    >
    >
    >
    > Any examples?
    >
    > code in ASP or ASP.NET (vb)


    The easiest way to do that in .NET is:

    string url = "http://host/path/to/page.html";
    WebClient wc = new WebClient(); // That is System.Net.WebClient
    byte[] data = wc.DownloadData(url);

    Cheers,
    --
    http://www.joergjooss.de
    mailto:
     
    Joerg Jooss, Apr 6, 2005
    #3
    1. Advertising

Want to reply to this thread or ask your own question?

It takes just 2 minutes to sign up (and it's free!). Just click the sign up button to choose a username and then you can ask your own questions on the forum.
Similar Threads
  1. Fred Newton

    Search Engine Indexing of Dynamic Content

    Fred Newton, Aug 7, 2004, in forum: ASP .Net
    Replies:
    1
    Views:
    459
    Fred Newton
    Aug 9, 2004
  2. mike
    Replies:
    2
    Views:
    952
  3. hazz
    Replies:
    6
    Views:
    50,019
    SkyUCHC
    Jun 9, 2010
  4. Replies:
    1
    Views:
    393
    Sybren Stuvel
    Apr 10, 2006
  5. Sasha
    Replies:
    3
    Views:
    621
    Sasha
    May 22, 2007
Loading...

Share This Page