encrypted or something web page

[Rod Speed]

Have a look at http://www.foxtel.com.au/TVGuide.aspx
Select a channel in the left hand box, say discovery, hit GO.

I want to import the data from the web page.

I used to be able to until they changed the format recently.

I now cant even see the program info with a view source.

There appears to be a block of encrypted stuff down the
bottom which is about the right size for the program data.

Anyone got any ideas about how to unencrypt it ?

 

[Neal]

Have a look at http://www.foxtel.com.au/TVGuide.aspx
Select a channel in the left hand box, say discovery, hit GO.

I want to import the data from the web page.

I used to be able to until they changed the format recently.

I now cant even see the program info with a view source.

There appears to be a block of encrypted stuff down the
bottom which is about the right size for the program data.

Anyone got any ideas about how to unencrypt it ?

All I get is a return to the main screen and "Session expired, please try
again"

Is http://www.foxtel.com.au/ your domain?

 

[John Phillips]

Have a look at http://www.foxtel.com.au/TVGuide.aspx
Select a channel in the left hand box, say discovery, hit GO.

I want to import the data from the web page.

Dunno if I followed your instructions correctly, but on Mozilla 1.7 it opens
a Flash type file which plays an ad for the Discovery channel. Runs in a
loop.

Is this what you mean?

 

[Rod Speed]

All I get is a return to the main screen and "Session expired, please try again"

Is http://www.foxtel.com.au/ your domain?

Nope, its one of the national PayTV operations.

That is the best of the TV guides for those channels,
particularly the detail like the episode title etc.

 

[Rod Speed]

Rod Speed wrote

Dunno if I followed your instructions correctly, but
on Mozilla 1.7 it opens a Flash type file which plays
an ad for the Discovery channel. Runs in a loop.

Is this what you mean?

Nope, you should get the day's TV guide for that channel.

Looks like its IE specific code since Neil cant see it either.

 

[W]

In news:[email protected], Rod Speed bitched and moaned:

Have a look at http://www.foxtel.com.au/TVGuide.aspx
Select a channel in the left hand box, say discovery, hit GO.

I want to import the data from the web page.

I used to be able to until they changed the format recently.

I now cant even see the program info with a view source.

There appears to be a block of encrypted stuff down the
bottom which is about the right size for the program data.

Anyone got any ideas about how to unencrypt it ?

Are you referring to the `gibberish` that appears in
<input type="hidden" name="__VIEWSTATE" .../>

 

[John Phillips]

Nope, you should get the day's TV guide for that channel.

Like this:- ?

6.00am The Aquanauts Travel & Adventure. Led by an expert team of deep-sea
divers, marine biologists and zoologists, explore the underwater world.
Travel to exotic locations to uncover the breathtaking landscapes and
unusual animals that live underwater. (PG)

 

[rf]

Have a look at http://www.foxtel.com.au/TVGuide.aspx
Select a channel in the left hand box, say discovery, hit GO.

I want to import the data from the web page.

I used to be able to until they changed the format recently.

I now cant even see the program info with a view source.

There appears to be a block of encrypted stuff down the
bottom which is about the right size for the program data.

Yep. There is a bunch of excrypted looking stiff inside a function call to a
javacript function cv.

Where does cv live?

Well, look just above that. There is a language="javascript" link to a
src="jscript.aspx". this would be an ASP server side routine.

If you try a view source on this link you will get "Cheating Not Good". Real
Funny

But wait, if you look there are some parameters to that link. Add the
parameters and we obtain an eval expression. Here is the first bit:
eval(unescape("%66%75%6E%63%74%

This no doubt creates the cv function.

The parameters are the interesting thing. You can bet that they are randomly
generated and encrypted for each access to the page. Then, in the call to
the ASP routine they would be descrypted and used to seed an individual cv
function, tailored to descript the data on that particular instance of the
page.

Looks like a quite good "content protection" thing. Well thought out. They
obviously don't want anybody hotlinking to their content and stealing it, as
is their right considering they hold the copyright to said material

Anyone got any ideas about how to unencrypt it ?

There are any number of ways. For a start copy/paste this into your address
bar: (watch the wrap)
javascript:alert(document.getElementById("tblCellTVGuideResults").innerHTML)

It'll show you the HTML contents of that table cell

 

[Rod Speed]

Like this:- ?

6.00am The Aquanauts Travel & Adventure. Led by an expert team of deep-sea
divers, marine biologists and zoologists, explore the underwater world.
Travel to exotic locations to uncover the breathtaking landscapes and
unusual animals that live underwater. (PG)

Yep.

The cycling logos are just one on each program item.

 

[John Phillips]

Yep.

I can cut & paste & e-mail it to you if you like.

 

[Rod Speed]

In news:[email protected], Rod Speed bitched and moaned:

Are you referring to the `gibberish` that appears in
<input type="hidden" name="__VIEWSTATE" .../>

Looks more likely to be the lower one,
<td id="tblCellTVGuideResults"
just because its bigger and that does have that TVGuideResults text in the header.

 

[Rod Speed]

Rod Speed wrote

I can cut & paste & e-mail it to you if you like.

I can see them fine in IE and can cut and paste them from there myself.

I want to import the web page contents into an access database.

I do that with softcom and austar and the FTA channels, and
used to be able to with foxtel too until the most recent format
change on that web site, when they added the 'digital' service.

 

[John Phillips]

I can see them fine in IE and can cut and paste them from there myself.

I want to import the web page contents into an access database.

Sorry, misunderstood you.

 

[Rod Speed]

Yep. There is a bunch of excrypted looking stiff
inside a function call to a javacript function cv.

Where does cv live?

Well, look just above that. There is a language="javascript" link
to a src="jscript.aspx". this would be an ASP server side routine.

If you try a view source on this link you will get "Cheating Not Good".
Real Funny

Yeah, someone with a sense of humor |-)

But wait, if you look there are some parameters to that link. Add the
parameters and we obtain an eval expression. Here is the first bit:
eval(unescape("%66%75%6E%63%74%

This no doubt creates the cv function.

The parameters are the interesting thing. You can bet that they are randomly
generated and encrypted for each access to the page. Then, in the call to
the ASP routine they would be descrypted and used to seed an individual cv
function, tailored to descript the data on that particular instance of the page.

Looks like a quite good "content protection" thing. Well thought out. They
obviously don't want anybody hotlinking to their content and stealing it, as
is their right considering they hold the copyright to said material

Oddly enough a more limited program guide in pdf format in the
business section. Much briefer items tho and not all channels either.

There are any number of ways. For a start copy/paste this into your address
bar: (watch the wrap)
javascript:alert(document.getElementById("tblCellTVGuideResults").innerHTML)

It'll show you the HTML contents of that table cell

Dont get anything useful when I do that.

I actually want to import the web pages into access.
I did that with the previous version of those web pages
using TransferText but anything that works would suit me fine.

 

[rf]

javascript:alert(document.getElementById("tblCellTVGuideResults").innerHTML)

Dont get anything useful when I do that.

Oh, you are right. I gave the alert output the merest of glances. Looks like
there is more than one level of encryption. They Really must not want you to
steal their stuff. Try


javascript:alert(document.getElementById("tblCellTVGuideResults").innerText)

I actually want to import the web pages into access.

Then you are in breach of copyright law. If you continue to steal their
material I would advise retaining a good soliciter. You'll need one if
Foxtel find out.

I did that with the previous version of those web pages
using TransferText but anything that works would suit me fine.

Foxtel obviously don't think that "anything that works" is fine

 

[Rod Speed]

Oh, you are right. I gave the alert output the merest of
glances. Looks like there is more than one level of encryption.
They Really must not want you to steal their stuff.

More likely they dont want other online TV Guide operations to do that.

Try
javascript:alert(document.getElementById("tblCellTVGuideResults").innerText)

Same result, nothing happens at all, the address bar contents stays
highlighted but nothing changes on the main body of the window.

Then you are in breach of copyright law.

Nope. Its no more 'stealing' than reading it off the web page in IE is.

If you continue to steal their material I would advise retaining
a good soliciter. You'll need one if Foxtel find out.

Nope, perfecty legal in this country.

Foxtel obviously don't think that "anything that works" is fine

Or they just want to prevent other online TV Guide
operations from getting the data from their web pages.

 

[rf]

Nope. Its no more 'stealing' than reading it off the web page in IE is.

Sorry, I read "import into access" as meaning you were then going to serve
the data up onto another web page. If not then OK, they will never know.

Do I recall discussing this with you a couple of years ago? That is,
scraping stuff off a web page into an access database?

In any case, regardless of what the alert gives you it should be a simple
matter to knock up a C# or C++ program to host the MSHTML control and point
it at the page. Then you have programatic access to the entire DOM.

 

[Toby A Inkster]

Have a look at http://www.foxtel.com.au/TVGuide.aspx
I want to import the data from the web page.
I used to be able to until they changed the format recently.

Google: XMLTV.

 

[Falkon]

javascript:alert(document.getElementById("tblCellTVGuideResults").innerHTML)


More likely they dont want other online TV Guide operations to do that.
javascript:alert(document.getElementById("tblCellTVGuideResults").innerText)

Same result, nothing happens at all, the address bar contents stays
highlighted but nothing changes on the main body of the window.

<snip>

I get the "html" output (ie the tvguide) but it is in a MS Window alert box.

I can't even copy and paste it.

 

[Randy Webb]

<snip>

I get the "html" output (ie the tvguide) but it is in a MS Window alert box.

I can't even copy and paste it.

javascript:window.clipboardData.setData('text',document.getElementById("tblCellTVGuideResults").innerText);void%200

In IE will copy it to the clipboard.