Clicking through options in drop-down menus

Some pages will only load the data you need after you pick out options in a drop-down, or several drop downs, from a search page. This tutorial will show you how to search through these options 

Selecting one option in a drop-down

To select all the options of a single drop-down on a new template:

1. With an empty Select command, click on the drop-down menu to select it.

2. Another select command should be generated automatically. If not, press the plus button and add it. Click on the first option in the drop-down.

3. Then, click on the second option in the drop-down to train ParseHub to select each result.

4. Press the plus button beside the Begin New Entry command that appears and add a Click command. If there is a search button for the options, see step 6. Otherwise, see step 5.

5. If there is no search button, and the results load in automatically, in the popup that appears, choose to Create a new template, and enter a name for it. Press the green button to add the command. This will cause ParseHub to perform the actions on the new template for each option in the drop-down. You can start selecting and extracting the data you need using this new template.

6. If there is a search button, make sure that your Click command Continues executing the current template. Press the green button to continue.

 

7. Press the plus button beside the begin new entry command, and add a third select command.

8. Click on the search button to select it with the new command.

9. Press the plus button beside the new select command, for the search button, and add a Click command.

10. In the popup that appears, choose to go to a new template, and enter a name for it. Press the green button to add the command. This will cause ParseHub to perform the actions on the new template, to scrape data for each search result from the list of options. You can start selecting and extracting the data you need using this new template.

Selecting multiple options in a drop-down

To select all of the options from multiple drop-downs:

1. Follow steps 1–4 for selecting a single drop-down.

2. Instead of going to a new template, make sure that your Click command Continues executing the current template. Press the green button to continue.

3. Press the plus button beside the Begin New Entry command, and add a new Select command.

4. Follow steps 1–3, for a single drop-down, again for the second drop-down menu. Follow steps 5–10 as needed to bring up the results.

This method can be repeated for as many drop-downs as are on the page. It makes sure that for each option of each option, the results will be brought up for you to scrape in a new template. This will, you will get all possible combinations of results.

Only selecting specific options in a drop-down

After selection each option of a dropdown, but before the Click command, you can add a Conditional command to filter out which options you want to select. Use the conditional expression $e.text.includes("option_you_want") to select one particular option. You can also include ||$e.text.include("extra_option") afterwards to include any number of extra options to select.

Read our page about ParseHub expressions to figure out how to make a more complicated expression to narrow down your results.

Have more questions? Submit request!

0 Comments

Article is closed for comments.