Grabbing Text From a Website

K

Kyle Murphy

Let's say I wanted to make a program that traversed all 125 products on
this page:http://www.menshealth.com/eatthis/Best-Grocery-Foods/, grabbed
the text from each one, and compiled them into a list in a text file.

First off, is this even possible? If so, can you give me some links or
advice that would aid me in this grand project?

Thank you!
 
B

brabuhr

Let's say I wanted to make a program that traversed all 125 products on
this page:http://www.menshealth.com/eatthis/Best-Grocery-Foods/, grabbed
the text from each one, and compiled them into a list in a text file.

First off, is this even possible? If so, can you give me some links or
advice that would aid me in this grand project?

I have used: mechanize, scrubyt, and firewatir

http://www.rubyrailways.com/data-extraction-for-web-20-screen-scraping-in-rubyrails
http://muharem.wordpress.com/2007/09/04/scrape-the-web-with-ruby/
http://www.johnyerhot.com/2008/05/19/anatomy-of-a-ruby-web-scraper/
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

Forum statistics

Threads
473,769
Messages
2,569,581
Members
45,055
Latest member
SlimSparkKetoACVReview

Latest Threads

Top