Interactive Websites
- Joining two or more selections together into one cell/JSON object
- Extracting a value based on whether or not an element is on the page
- Looping through pages that use AJAX clicks
- Extracting dynamic values
- Scraping all images from an image carousel
- Click on the "Next" button to scrape multiple pages (pagination)
- Navigating and scraping pages with no "Next" button (pagination)
- Search for one keyword using a search box
- Enter a list of keywords into a search box
- Clicking through options in dropdown menus
- Get data from behind a log-in
- Log-in to a site via a pop-up
- Google sheet as a list of keywords to scrape
- Enter a list of URLs to crawl
- Combining keywords from two lists (nested loops)
- Find and extract a specific value from a table
- Date Inputs [Travel website Example]
- Inputting various usernames and passwords (a list of different variables)
- Infinite Scroll (Alternate Method)
- Infinite Scroll
- Click on a "Load More" button to reveal data
- How to scrape data from a table
- Filling out a form: filtering search results before scraping
- Scrape two eCommerce websites in one project [Amazon and eBay examples]
- Google sheet as a list of URLs to crawl
- Scrape data that appears in a pop-up
- Navigate to a different website or URL
- Navigate to a list of URLs (using an ID value in the URL)
- Scrape data from inside a tab
- Scrape data that appears on hover