Web Scraping Proxy

Discussion in 'Perl Misc' started by Wes Groleau, Apr 20, 2011.

  1. Wes Groleau

    Wes Groleau Guest

    Is there a newsgroup or forum suitable for questions regarding wsp.pl
    (by Katcheff at AT&T)? A web search gives me dozens of places to
    download it and a general perl forum with a single unresolved question
    on the wsp.

    I _think_ I have the required libraries installed, and it isn't
    complaining about anything, but it takes one request and quits.

    And that request is failing because FireFox won't allow me
    to accept wsp's SSL certificate. (Which is presumably a FireFox
    issue, but I wish WSP would keep recording while I fight with FF.)

    --
    Wes Groleau

    It’s the Law!
    http://Ideas.Lang-Learn.us/WWW?itemid=93
     
    Wes Groleau, Apr 20, 2011
    #1
    1. Advertising

  2. Wes Groleau

    Wes Groleau Guest

    On 04-21-2011 16:56, Eli the Bearded wrote:
    > In comp.lang.perl.misc, Wes Groleau<> wrote:
    >> And that request is failing because FireFox won't allow me
    >> to accept wsp's SSL certificate. (Which is presumably a FireFox
    >> issue, but I wish WSP would keep recording while I fight with FF.)

    >
    > I've never used the program, but I see in the README file bug list:
    > Wsp.pl does not recover from aborted browser requests.
    > Do not press stop. Do not load another page until the
    > current page loads completely.
    >
    > So I think the problem is correctly described by you as a FireFox
    > issue, compounded by the aborted request bug. I have no problems
    > getting FireFox to accept various non-conformant certs. I do this
    > regularly when testing webpages.


    OK, I think you are suggesting that the delay of FF asking me what to do
    about the cert is being interpreted by WSP as an "aborted browser
    request" ? And then the reason I can't get FF to accept the cert is
    that the provider of the cert is no longer running?

    Sad, but understandable. Then your suggested workaround also makes
    sense. Thanks.

    Unfortunately, when I turned off the proxy and tried to go to the site
    directly, it demanded I use Internet Explorer only (hard to do on a Mac)
    and insisted (falsely) that my caps-lock was on.

    --
    Wes Groleau

    There are two types of people in the world …
    http://Ideas.Lang-Learn.us/barrett?itemid=1157
     
    Wes Groleau, Apr 22, 2011
    #2
    1. Advertising

Want to reply to this thread or ask your own question?

It takes just 2 minutes to sign up (and it's free!). Just click the sign up button to choose a username and then you can ask your own questions on the forum.
Similar Threads
  1. Selden McCabe

    Web Scraping Question

    Selden McCabe, Feb 21, 2004, in forum: ASP .Net
    Replies:
    1
    Views:
    360
    Chad Z. Hower aka Kudzu
    Feb 21, 2004
  2. Selden McCabe

    General Web Scraping Question

    Selden McCabe, Feb 22, 2004, in forum: ASP .Net
    Replies:
    2
    Views:
    411
    Joerg Jooss
    Feb 22, 2004
  3. Brent
    Replies:
    8
    Views:
    8,478
    Developer2010
    Oct 19, 2010
  4. David Jones

    Web Scraping/Site Scraping

    David Jones, Jul 11, 2004, in forum: Python
    Replies:
    4
    Views:
    530
    Andrew Bennetts
    Jul 13, 2004
  5. Abhishek Ghose

    Image scraping from behind a proxy

    Abhishek Ghose, Jun 4, 2008, in forum: Ruby
    Replies:
    1
    Views:
    124
    Abhishek Ghose
    Jun 4, 2008
Loading...

Share This Page