Trouble Getting past a javascript check
I have been scraping this site for a long time but in one of the recent updates it now checks for and runs a couple javascripts before returning the pages as I'm use to seeing it. any idea if I'm just missing the new call that gives me the home data or is it something else? the url in question is
http://www.ksl.com/homes/search/
That JavaScript is hairy, and
That JavaScript is hairy, and maybe we could scrape it and run it, but I found a quick change to the request circumvents the checks:
Try it and let me know.
In cases like this, it's good to look for a link to share the page or an RSS feed that will let you get the data without running the JavaScript at all.