Interactive Websites
- Click on the "Next" button to scrape multiple pages (pagination)
- Navigating and scraping pages with no "Next" button (pagination)
- Search for one keyword using a search box
- Enter multiple keywords into a search box
- Clicking through options in drop-down menus
- Get data from behind a log-in
- Log-in to a site via a pop-up
- Google sheet as a list of keywords
- Enter a list of URLs to crawl
- Combining keywords from two lists (nested loops)
- Find and extract a specific value from a table
- EXAMPLE: Date Inputs
- Inputting various usernames and passwords (a list of different variables)
- Infinite Scroll
- Infinite scrolls for a large set of listings
- Click on a "Show More" button to reveal data
- How to scrape data from a table
- Filling out a form: filtering search results
- Scrape two eCommerce websites in one project
- Google sheet as a list of URLs to crawl
- Scrape data that appears in a pop-up
- Navigate to a different website or URL
- Navigate to a list of URLs (using an ID value in the URL)
- Scrape data from inside a tab
- Scrape data that appears on hover
- Enter value into text box
- Click on a link to scrape a new page
- Click on many links to scrape multiple pages
- Extract star ratings (get data behind icons & graphics)
- Scrape data from an interactive map