How to download Web Pages in Java?

[Bari Bai]

As the title, which class in Java could be used to download web pages from a
specific URL?

Any example code/usage would be greatly appreciated.

I can download the pages using FTP programs; but I want to download the web
pages in Java program since I need to process the dynamic information in the
files.

Thanks!

Jim

 

[Christophe Vanfleteren]

As the title, which class in Java could be used to download web pages from
a specific URL?

Any example code/usage would be greatly appreciated.

I can download the pages using FTP programs; but I want to download the
web pages in Java program since I need to process the dynamic information
in the files.

Thanks!

Jim

Check out http://jakarta.apache.org/commons/httpclient/.

 

[VisionSet]

As the title, which class in Java could be used to download web pages from a
specific URL?

Any example code/usage would be greatly appreciated.

I can download the pages using FTP programs; but I want to download the web
pages in Java program since I need to process the dynamic information in the
files.

StringBuffer getSource() throws IOException {
InputStream is;
URLConnection uc;
URL url = new URL("http://www.foo.bar");
uc = url.openConnection();
is = url.openStream();
BufferedReader in = new BufferedReader(new InputStreamReader(is));
StringBuffer source = new StringBuffer();
String line = null;
while((line = in.readLine()) != null) {
source.append(line);
}
return source;
}

Something like that, using java.net & java.io packages