Connection Refused Problem
I'm trying to write a simple screen-scraper but I'm having trouble with a the url I'm using. I keep receiving a "Connection Refused" error whenever I try to bring the site up through screen-scraper (through a scraper or through a proxy session)
When I go to this url outside of s-s (IE or FF) it works fine, once I try anything in s-s I receive a "Connection Refused" error.
See log below. Anything I'm doing wrong?
Thanks!
LOG:
==========
Starting scraper.
Running scraping session: HelloWorld
Processing scripts before scraping session begins.
Scraping file: "FormSubmission"
FormSubmission: Preliminary URL: http://www.dcassessor.org
FormSubmission: Resolved URL: http://www.dcassessor.org
FormSubmission: Sending request.
FormSubmission: Redirecting to: http://dotccms.dotcomm.org:8080/infoglueDeliverLive/ViewPage.action?repo...
FormSubmission: [color=red]An error occurred while connecting to 'http://dotccms.dotcomm.org:8080/infoglueDeliverLive/ViewPage.action?repositoryName=dcassessor'. The message was Connection refused: connect.[/color]FormSubmission: Extracting data for pattern "null"
FormSubmission: The pattern did not find any matches.
FormSubmission: Warning! No matches were made by any of the extractor patterns associated with this scrapeable file.
Processing scripts after scraping session has ended.
Scraping session finished.
Connection Refused Problem
Hi,
As it turns out, this is caused by a bug in screen-scraper. Fortunately, there's a simple workaround. Rather than designating this as the URL for your scrapeable file:
http://www.dcassessor.org/
designate this:
http://dotccms.dotcomm.org:8080/infoglueDeliverLive/ViewPage.action?repositoryName=dcassessor
screen-scraper is improperly handling a case where a 302 redirect results in a request to a server listening on a different port from the original. We've already made the bug fix, and it will be included in our alpha release. Watch our blog for an announcement on the release of that ([url]http://blog.screen-scraper.com/[/url]).
Also, we have a policy to provide a discount on a Professional Edition license to anyone that brings to our attention a bug that we were previously unaware of. If you'd like to take advantage of that, please feel free to email me personally. My email address is my first name at screen-scraper.com.
Kind regards,
Todd Wilson