Downloading a Dynamic Website.

[jay_kbvt]

Hi,

Is there any way to download the dynamic content from a website and
store it to the local database......?


Any help would be appreaciable..

Thanx in advnce.

Jaydeep.

 

[Oliver Wong]

Hi,

Is there any way to download the dynamic content from a website and
store it to the local database......?

Except for the "store it to a local DB" part, your webbrowser does this
all the time -- actually, if you consider the local cache to be a "local
database", then it does that last part too!

You probably want to be more specific with the "download" part. Let's
say a dynamic website emits different content depending on what the IP
address of the client is (http://www.whatismyip.com/ does this); what
behaviour do you expect from the downloaded content? It probably won't
respond to different IP addresses in the same way that the original site
does.

What if the website doesn't simply echo your IP back to you, but gives
you a MD5 hash of (your IP concatenated with the current time concatenated
with a secret password)? It'd be very difficult to get your downloaded
version to behave the same as the dynamic site without knowing that secret
password.

- Oliver

 

[jay_kbvt]

Thanx for reply.

I want some what functinality of an offline browser. But will it work
with a search engine...?
Like will it fetch the webpages from generated result ?


Thanx.

Jaydeep.

 

[Oliver Wong]

Thanx for reply.

I want some what functinality of an offline browser.

Most web browsers already have a feature like this.

But will it work
with a search engine...?

Well, you can probably search your local cache (and some browsers have a
feature for this too), but you can't search the web while offline.

Like will it fetch the webpages from generated result ?

If you search your cache, the pages it fetches will be from your cache.

- Oliver