limiting download size with net::http

M

Matt Harrison

Hi list,

I got bored so I'm writing a little web spider in ruby. I've got several features
planned like content type limits etc, but I'm stuck with the size limit.

If I check against content_length from the headers of the response object, it's
already downloaded the body. How can I check and exclude based on the content_length
before the whole body is downloaded?

Thanks
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

No members online now.

Forum statistics

Threads
473,768
Messages
2,569,574
Members
45,051
Latest member
CarleyMcCr

Latest Threads

Top