Want some information....

[Arun Kumar]

Hi,
I want to know about authentication in ruby. Is it possible to scrap
html of those sites which require basic authentication.

eg. I want to scrap the profile html page of a user. But in order to get
to that page I need to enter the username and password. Now if I'm using
'net/http' to scrap the contents of the profile page, how can I
implement the same. Is it possible in ruby to scrap web pages for which
the user need to enter the username and password.

Please help

N. B. - providing link to any documentation which states this problem
will be really helpfull.


Regards
Arun

 

[Robert Klemme]

=A0 I want to know about authentication in ruby. Is it possible to scrap
html of those sites which require basic authentication.

I am not a native speaker but for all I know "want" is considered
impolite among English speaking people.

N. B. - providing link to any documentation which states this problem
will be really helpfull.

What did your research turn up? Did you check the standard library's
documentation in the well known place?

Regards

robert


--=20
remember.guy do |as, often| as.you_can - without end
http://blog.rubybestpractices.com/

 

[Arun Kumar]

I am not a native speaker but for all I know "want" is considered
impolite among English speaking people.


What did your research turn up? Did you check the standard library's
documentation in the well known place?

Regards

robert

Hi
Thanks for the quick reply. Sorry for the impolite statement.

require 'net/http'

Net::HTTP.start('www.example.com') {|http|
req = Net::HTTP::Get.new('/secret-page.html')
req.basic_auth 'account', 'password'
response = http.request(req)
print response.body
}

This is the phrase which I got from the ruby-doc site. I dont know
whether this is helpfull or not. That's why I asked such a doubt. Please
give me a general guidance for this issue.

Thanks

Arun Kumar

 

[Rick DeNatale]

Hi
=C2=A0Thanks for the quick reply. Sorry for the impolite statement.

=C2=A0require 'net/http'

=C2=A0 =C2=A0Net::HTTP.start('www.example.com') {|http|
=C2=A0 =C2=A0 =C2=A0req =3D Net::HTTP::Get.new('/secret-page.html')
=C2=A0 =C2=A0 =C2=A0req.basic_auth 'account', 'password'
=C2=A0 =C2=A0 =C2=A0response =3D http.request(req)
=C2=A0 =C2=A0 =C2=A0print response.body
=C2=A0 =C2=A0}

This is the phrase which I got from the ruby-doc site. I dont know
whether this is helpfull or not. That's why I asked such a doubt. Please
give me a general guidance for this issue.

Well did you try it?

If it didn't work, did you make the correct substitutions for
'account' and 'password' ?


--=20
Rick DeNatale

Blog: http://talklikeaduck.denhaven2.com/
Twitter: http://twitter.com/RickDeNatale
WWR: http://www.workingwithrails.com/person/9021-rick-denatale
LinkedIn: http://www.linkedin.com/in/rickdenatale

 

[Arun Kumar]

Well did you try it?

Hi,
Thanks for the reply.
Well, I didn't try it. I want to try it of course but before that I want
to know how such pages can be accessed. That's why I asked for some
guidance.

Arun