Interactive Websites
- Looping through pages that use AJAX clicks
- Extracting dynamic values
- Scraping all images from an image carousel
- Click on the "Next" button to scrape multiple pages (pagination)
- Navigating and scraping pages with no "Next" button (pagination)
- Search for one keyword using a search box
- Enter a list of keywords into a search box
- Clicking through options in drop-down menus
- Get data from behind a log-in
- Log-in to a site via a pop-up
- Google sheet as a list of keywords
- Enter a list of URLs to crawl
- Combining keywords from two lists (nested loops)
- Find and extract a specific value from a table
- Date Inputs
- Inputting various usernames and passwords (a list of different variables)
- Infinite Scroll (Alternate Method)
- Infinite Scroll
- Click on a "Load More" button to reveal data
- How to scrape data from a table
- Filling out a form: filtering search results
- Scrape two eCommerce websites in one project
- Google sheet as a list of URLs to crawl
- Scrape data that appears in a pop-up
- Navigate to a different website or URL
- Navigate to a list of URLs (using an ID value in the URL)
- Scrape data from inside a tab
- Scrape data that appears on hover
- Enter value into text box
- Click on a link to scrape a new page