web robot

[dickymak]

Dear All

I need to found out all website with specific domain (like com.cn ,
org.hk) using java, but had no idea
how to do. could you pls give me some hints ?

tks in advance!

 

[Håkan Lane]

Dear All

I need to found out all website with specific domain (like com.cn ,
org.hk) using java, but had no idea
how to do. could you pls give me some hints ?

tks in advance!

I expect this to be probably impossible. Someone else may correct me if
I am wrong, but you would need to communicate with a DNS server
and query its database for all domains on a given top domain. I don't
know if there is an API for that.

Regards.

 

[Daniel Pitts]

I expect this to be probably impossible. Someone else may correct me if
I am wrong, but you would need to communicate with a DNS server
and query its database for all domains on a given top domain. I don't
know if there is an API for that.

Regards.

I would think a registrar might have that information as well. But, I
doubt there are any free API's for Java that will get that information.

Perhaps a better approach could be suggested if you have a specific goal
in mind. Maybe a web-crawler is what you really want.

 

[Tris Orendorff]

I would think a registrar might have that information as well. But, I
doubt there are any free API's for Java that will get that information.

Perhaps a better approach could be suggested if you have a specific goal
in mind. Maybe a web-crawler is what you really want.

A good web-crawler to learn from is: http://www.jeffheaton.com/javabot/javaspider.shtml

--
Tris Orendorff
[ Anyone naming their child should spend a few minutes checking rhyming slang and dodgy sounding
names. Brad and Angelina failed to do this when naming their kid Shiloh Pitt. At some point, someone at
school is going to spoonerise her name.
Craig Stark]

 

[Roedy Green]

I need to found out all website with specific domain (like com.cn ,
org.hk) using java, but had no idea
how to do. could you pls give me some hints ?

Such a list might be compiled by spidering the entire web. The info
is in the databases of various search engines. You might approach
them asking for a price quotation.