Scraping a Site Multiple Times Based on Search Terms

It's often the case in screen-scraping that you want to submit a form multiple times using different parameters each time. For example, you may be extracting locations from the "store locator" service on a site, and need to submit the form for a series of zip codes. In this tutorial we'll provide an example on how to go about that. We will continue on using the "Shopping Site" scraping session we generated in Tutorial 2.

If you haven't already gone through Tutorial 2, this tutorial will make more sense if you do so first.

If you decided not to go through Tutorial 2, or don't still have the scraping session and scripts you created in it, you can download and import them into screen-scraper by following these steps:

1. Download the zip file located here and unzip it. You should now have an "interpreted_java" directory and a "vbscript" directory.
2. If you're running Windows, and prefer to program in VBScript, import the "Shopping Site (Scraping Session).sss" scraping session located in the "vbscript" directory; otherwise, import the one located in the "interpreted_java" directory. Instructions on importing objects into screen-scraper can be found here.

Once you've got the scraping session imported into screen-scraper you're ready to roll. Click on the "Tutorial Details" link below to get going.