How to download all mp3 files from this website?

Discussion in 'Ruby' started by Li Chen, Feb 1, 2009.

  1. Li Chen

    Li Chen Guest

    Li Chen, Feb 1, 2009
    #1
    1. Advertising

  2. Li Chen

    Phlip Guest

    Li Chen wrote:
    > Hi all,
    >
    > I want to download all the mp3 files from this website:
    > http://rss.sciam.com/sciam/60secsciencepodcast.
    >
    > But I cannot see the link to each mp3 file in the source file. I wonder
    > how I can find out each link for the mp3 in source file.


    A> What's the relation to the language Ruby here?

    B> If I had cool MP3s, I would munge their addresses to prevent casual scraping.

    Google "Streamripping" to get an idea for the silly arms race currently in
    progress...

    --
    Phlip
     
    Phlip, Feb 1, 2009
    #2
    1. Advertising

  3. Michael Guterl, Feb 1, 2009
    #3
  4. Li Chen

    Li Chen Guest

    Phlip wrote:
    > Li Chen wrote:
    >> Hi all,
    >>
    >> I want to download all the mp3 files from this website:
    >> http://rss.sciam.com/sciam/60secsciencepodcast.
    >>
    >> But I cannot see the link to each mp3 file in the source file. I wonder
    >> how I can find out each link for the mp3 in source file.

    >
    > A> What's the relation to the language Ruby here?


    #Use Ruby script to download a webpage ranging from 15274.html to
    15334.html
    # and here is an example
    #download a webpage based on an address

    require 'open-uri'
    require 'threadlimiter'

    #address='http://www.qenglish.com/samples/15334.html'
    #....
    #address='http://www.qenglish.com/samples/15274.html'

    addresses=[]
    address1='http://www.qenglish.com/samples/'
    address2=''
    address3='.html'


    # create the address
    (15274..15334) .to_a.each do |i|
    addresses<<(address1 + i.to_s+ address3)
    end

    #download the files
    addresses.threaded_collect(1)do |a_uri|
    open(a_uri) do |a_file|
    f_name=File.basename(a_uri)
    open(f_name,'wb') do|r_file|
    a_file.each_line do |a_line|
    r_file.write a_line
    end
    end
    end
    end

    --
    Posted via http://www.ruby-forum.com/.
     
    Li Chen, Feb 1, 2009
    #4
  5. Li Chen

    Li Chen Guest

    Michael Guterl wrote:
    > mp3scrape may work for your needs.
    >
    > http://codeforpeople.com/lib/ruby/mp3scrape/mp3scrape-0.0.1/
    >


    Hi Michael,

    Thank you very much.

    What is the right syntex for using mp3scrape? I can not load mp3scrape
    after I use gem install to install the gem.

    Li

    ############################
    C:\Users\Alex>irb
    irb(main):001:0> require 'mp3scrape'
    LoadError: no such file to load -- mp3scrape
    from
    c:/ruby/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:27:in
    `gem_original_require'
    from
    c:/ruby/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:27:in
    `require'
    from (irb):1
    --
    Posted via http://www.ruby-forum.com/.
     
    Li Chen, Feb 1, 2009
    #5
  6. Li Chen wrote:
    > Michael Guterl wrote:
    >> mp3scrape may work for your needs.
    >>
    >> http://codeforpeople.com/lib/ruby/mp3scrape/mp3scrape-0.0.1/
    >>

    >
    > Hi Michael,
    >
    > Thank you very much.
    >
    > What is the right syntex for using mp3scrape? I can not load mp3scrape
    > after I use gem install to install the gem.
    >
    > Li
    >
    > ############################
    > C:\Users\Alex>irb
    > irb(main):001:0> require 'mp3scrape'
    > LoadError: no such file to load -- mp3scrape
    > from
    > c:/ruby/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:27:in
    > `gem_original_require'
    > from
    > c:/ruby/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:27:in
    > `require'
    > from (irb):1


    try

    $ mp3scrape --help
     
    Reid Thompson, Feb 2, 2009
    #6
  7. Li Chen

    Li Chen Guest

    Reid Thompson wrote:

    > try
    >
    > $ mp3scrape --help



    Hi Reid,

    Here is what I get:

    C:\Users\Alex>mp3scrape --help
    gem install main

    C:\Users\Alex>irb
    irb(main):001:0> require 'mp3scrape'
    LoadError: no such file to load -- mp3scrape
    from
    c:/ruby/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:27:in
    `gem_original_require'
    from
    c:/ruby/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:27:in
    `require'
    from (irb):1
    irb(main):002:0>

    Li
    --
    Posted via http://www.ruby-forum.com/.
     
    Li Chen, Feb 2, 2009
    #7
  8. Li Chen wrote:
    > Reid Thompson wrote:
    >
    >> try
    >>
    >> $ mp3scrape --help

    >
    >
    > Hi Reid,
    >
    > Here is what I get:
    >
    > C:\Users\Alex>mp3scrape --help
    > gem install main
    >
    > C:\Users\Alex>irb
    > irb(main):001:0> require 'mp3scrape'
    > LoadError: no such file to load -- mp3scrape
    > from
    > c:/ruby/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:27:in
    > `gem_original_require'
    > from
    > c:/ruby/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:27:in
    > `require'
    > from (irb):1
    > irb(main):002:0>
    >
    > Li

    you need to run

    # gem install main

    then you will prob also need to run

    # gem install threadify


    then run

    $ mp3scrape --help
     
    Reid Thompson, Feb 2, 2009
    #8
  9. Li Chen

    Li Chen Guest

    Li Chen, Feb 2, 2009
    #9
  10. Li Chen wrote:
    > Reid Thompson wrote:
    >> you need to run
    >>
    >> # gem install main
    >>
    >> then you will prob also need to run
    >>
    >> # gem install threadify
    >>
    >>
    >> then run
    >>
    >> $ mp3scrape --help

    > Hi Reid,
    >
    > Thank you very much.
    >
    > I follow your suggestions and now I am able to download mp3 from
    > http://troubledsoulsunite.blogspot.com/.
    >
    > But I cannot download mp3 from
    > http://rss.sciam.com/sciam/60secsciencepodcast
    >
    > Li

    you might have more success at

    http://www.sciam.com/podcast/podcasts.cfm?type=60-second-science

    if you can get mp3scrape to follow the podcast urls....
     
    Reid Thompson, Feb 3, 2009
    #10
  11. Li Chen

    Li Chen Guest

    Li Chen, Feb 3, 2009
    #11
    1. Advertising

Want to reply to this thread or ask your own question?

It takes just 2 minutes to sign up (and it's free!). Just click the sign up button to choose a username and then you can ask your own questions on the forum.
Similar Threads
  1. Daniel Dyer
    Replies:
    6
    Views:
    19,945
    Knute Johnson
    Jan 22, 2006
  2. Asle Frantzen

    Mp3-player - how to play an mp3?

    Asle Frantzen, Jul 8, 2003, in forum: C++
    Replies:
    5
    Views:
    672
    Kelsey Bjarnason
    Jul 22, 2003
  3. Sunfire
    Replies:
    7
    Views:
    447
    Sunfire
    Nov 10, 2007
  4. nospam
    Replies:
    13
    Views:
    890
    André Gillibert
    Nov 18, 2007
  5. HY Tech
    Replies:
    0
    Views:
    624
    HY Tech
    Sep 7, 2003
Loading...

Share This Page