Sample Scraping Sessions

For some of our users, learning is best accomplished by observing a completed scraping session in action. In this session, we include samples of scrapes that we have written. If you prefer to take a step-by-step approach to watching the scraping session run, feel free to take advantage of the "session.breakpoint();" method, but simply creating a new script in the scraping session you have downloaded. Then insert the code "session.breakpoint();" When this method is called (you may wish to call it at several points during the scrape), the scrape will pause and display all of the session variables that are in scope.

We will do our best to provide our users with updated scrapes on a periodic basis. If you find that a scrape we have posted seems to have broken, please let us know and we'll try to update the scrape as soon as possible.

Note: In version 4.5 we create two folders within the screen-scraper directory--"input" and "output". If these folders are not in your install you will likely want to add them. Within our "input" folder, we place any files that we regularly use as input for websites (e.g., .csv files of zip codes). Many of the input files we use here at screen-scraper are available to use in our script repository here. We use the "output" folder as a landing spot for the CSV files created during our scrapes. Make sure that if you are running a scrape that creates a file within the output folder that you have created an output folder in your screen-scraper directory.