Directly-Observed Page <> Display Response in Browser?
It's finally dawned on me that my extractor is actually returning the right information - as it sees it.
The weirdness is that what it sees differs from what my browser sees when I aim it at the extractor's URL within seconds of the extract.
What my browser sees: http://tinyurl.com/n99oqgh
What ScreenScraper's extractor sees (same URL): http://tinyurl.com/pxxzwrm
Two of the data diffs are in "Avg Wind:" - direction and speed.
Could ScreenScraper's extractor be working out of a cache?
Something else?
It looks like that windspeed
It looks like that windspeed is displayed with some JavaScript. Since screen-scraper doesn't run any JavaScript, you see the default in there. You just need to find where the windspeed data is set in the JavaScript, and you should be able to scrape the relevant data from there.