> ## Documentation Index
> Fetch the complete documentation index at: https://docs.easyscraper.com/llms.txt
> Use this file to discover all available pages before exploring further.

# List Scraping

> Learn how to scrape lists of items from web pages

## Overview

List scraping allows you to extract multiple items from a web page, such as:

* Product listings from e-commerce sites
* Search results
* Article listings from blogs
* Directory entries
* Social media posts
* And much more

Easy Scraper automatically detects lists on the page and extracts data from each item.

## How to Scrape a List

<Steps>
  <Step title="Navigate to the page">
    Go to the webpage containing the list you want to scrape. Make sure the list is fully loaded before opening the extension.
  </Step>

  <Step title="Open Easy Scraper">
    Click the Easy Scraper icon in your browser toolbar. The extension will automatically detect lists on the page.
  </Step>

  <Step title="Review detected items">
    Easy Scraper will show you a preview of the detected items and fields. Each field represents a piece of data extracted from each item (e.g., title, price, link).
  </Step>

  <Step title="Configure fields">
    You can customize fields:

    * **Rename fields**: Click on the field name to edit it
    * **Highlight fields**: Click the search icon to highlight where the field data comes from
    * **Remove fields**: Click the delete icon next to any field you don't need
  </Step>

  <Step title="Configure pagination">
    If your list spans multiple pages or requires scrolling, configure the load more options (see [Pagination Options](#pagination-options) below).
  </Step>

  <Step title="Start scraping">
    Click "Start Scraping". Easy Scraper will extract all the data and display it in a table.
  </Step>

  <Step title="Export your data">
    Once scraping is complete, export your data:

    * **Download CSV**: Import into Excel or Google Sheets
    * **Download JSON**: Use in applications or scripts
    * **Copy**: Copy as tab-separated values to paste into spreadsheets
  </Step>
</Steps>

## Pagination Options

Easy Scraper supports four methods for handling pagination and loading more items:

### Option 1: None (No Additional Loading)

Use this when all items are already visible on the page. Easy Scraper will extract only the items currently displayed.

**Best for:**

* Single-page lists
* All items already loaded

### Option 2: Scroll down to load more items

Automatically scrolls to the bottom of the page to trigger loading of additional items. This works with infinite scroll implementations.

**Best for:**

* Infinite scroll pages (e.g., social media feeds)
* Pages that load more items as you scroll

**Configuration:**

* **Min wait time**: Minimum seconds to wait for new items to load (default: 1s)
* **Max wait time**: Maximum seconds to wait for new items to load (default: 3s)
* **Scroll delay**: Delay in milliseconds between scroll actions (helps with slow-loading pages)
* **Max items**: Limit the total number of items to scrape

<Tip>
  If items aren't loading, try increasing the max wait time or adding a scroll delay.
</Tip>

### Option 3: Click link to navigate to next page

Clicks a "Next Page" button to navigate to a different page URL.

**Best for:**

* Traditional pagination with numbered pages that change the URL
* "Next" links that navigate to a new page
* Pagination that dynamically replaces the current page content without URL changes

**Configuration:**

* **Next Page Button**: Click "Select" to choose the button/link to click
* **Min wait time**: Minimum seconds to wait for new items to load
* **Max wait time**: Maximum seconds to wait for new items to load
* **Auto-scroll**: Automatically scroll the page during scraping
* **Scroll delay**: Delay in milliseconds between scroll actions
* **Max items**: Limit the total number of items to scrape

<Steps>
  <Step title="Select the button">
    Click "Select" next to "Next Page Button" and then click the pagination button on the page.
  </Step>

  <Step title="Verify selection">
    Click "Verify" to ensure you've selected the correct button (it will be highlighted).
  </Step>

  <Step title="Configure wait times">
    Set appropriate wait times based on how long the page takes to load.
  </Step>
</Steps>

<Warning>
  Make sure the button you select actually navigates to a new page URL. If it loads more items on the same page, use Option 4 instead.
</Warning>

### Option 4: Click button to load more items on same page

Clicks a "Load More" or "Show More" button that adds additional items to the current page without navigating away.

**Best for:**

* "Load More" buttons that append items to the page
* "Show More" links that expand the list in-place

**Configuration:**

* **Load More Button**: Click "Select" to choose the button to click
* **Min wait time**: Minimum seconds to wait for new items to load
* **Max wait time**: Maximum seconds to wait for new items to load
* **Auto-scroll**: Automatically scroll the page during scraping
* **Scroll delay**: Delay in milliseconds between scroll actions
* **Max items**: Limit the total number of items to scrape

<Steps>
  <Step title="Select the button">
    Click "Select" next to "Load More Button" and then click the button that loads more items on the page.
  </Step>

  <Step title="Verify selection">
    Click "Verify" to ensure you've selected the correct button (it will be highlighted).
  </Step>

  <Step title="Configure wait times">
    Set appropriate wait times based on how long new items take to load after clicking.
  </Step>
</Steps>

<Tip>
  This option is ideal when clicking the button adds more items to the current page rather than navigating to a new URL. If the button navigates to a different page, use Option 3 instead.
</Tip>

## Field Types

Easy Scraper can extract three types of data from each field:

<Accordion title="Text Content">
  Extracts the visible text content of an element.

  **Examples:**

  * Product names
  * Prices
  * Descriptions
  * Headings

  **How it works:** The extension reads the text content from the selected HTML element.
</Accordion>

<Accordion title="Link URLs (href)">
  Extracts the URL from a link element.

  **Examples:**

  * Product page URLs
  * Article links
  * External references

  **How it works:** Extracts the `href` attribute from `<a>` (link) elements. Automatically converts relative URLs to absolute URLs.

  <Tip>
    These URLs can be used later with [Page Details Scraping](/details-scraping) to extract data from each linked page.
  </Tip>
</Accordion>

<Accordion title="Image URLs (src)">
  Extracts image URLs from image elements.

  **Examples:**

  * Product images
  * Thumbnails
  * Profile pictures
  * Icons

  **How it works:** Extracts the `src` attribute from `<img>` elements or background images from elements with CSS background-image properties.
</Accordion>

## Tips for Successful List Scraping

<AccordionGroup>
  <Accordion title="Let the page fully load">
    Before opening Easy Scraper, wait for the page to fully load. If content is still loading, the extension may not detect all items.
  </Accordion>

  <Accordion title="Start with a small test">
    When scraping large lists, start by setting a low "Max items" limit (e.g., 10-20 items) to test your configuration before running a full scrape.
  </Accordion>

  <Accordion title="Use appropriate wait times">
    * For fast websites: Use shorter wait times (1-2 seconds)
    * For slow websites: Increase wait times (3-5 seconds)
    * Add a scroll delay if items aren't loading properly
  </Accordion>

  <Accordion title="Watch for dynamic content">
    Some websites load content dynamically. If you're not getting all the data, try:

    * Increasing wait times
    * Adding a scroll delay
    * Manually scrolling before starting the scrape
  </Accordion>

  <Accordion title="Check your data quality">
    After scraping, review the data table to ensure:

    * All fields are populated correctly
    * URLs are complete (not broken)
    * No missing or duplicate items
  </Accordion>
</AccordionGroup>

## Common Issues and Solutions

<AccordionGroup>
  <Accordion title="No list detected">
    **Problem:** Easy Scraper says "No list detected" when you open it.

    **Solutions:**

    * Make sure the page has fully loaded
    * Check that the page actually contains a list of repeating items
    * Try refreshing the page and waiting a few seconds before opening the extension
    * Some pages use complex layouts that may not be automatically detected
  </Accordion>

  <Accordion title="Missing items">
    **Problem:** Not all items are being scraped.

    **Solutions:**

    * If using scroll mode, increase the max wait time
    * Add a scroll delay to give the page time to load
    * Try using "Click Next Page" instead of scroll if pagination buttons exist
    * Check if the website has rate limiting or anti-scraping measures
  </Accordion>

  <Accordion title="Duplicate items">
    **Problem:** The same items appear multiple times in the results.

    **Solutions:**

    * Check if the page has multiple identical lists
    * Try removing and re-adding fields
    * Refresh the page and start over
  </Accordion>

  <Accordion title="Empty or incorrect field data">
    **Problem:** Some fields are empty or contain wrong data.

    **Solutions:**

    * Use "Verify" to check that the field selector is correct
    * Remove the field and add it again by selecting the correct element
    * Make sure you're clicking the right element when adding fields
    * Some data may be loaded dynamically - try waiting longer before scraping
  </Accordion>

  <Accordion title="Scraping stops before all pages">
    **Problem:** Scraping stops before reaching the last page.

    **Solutions:**

    * Increase the max wait time for page loads
    * Check if the "Next Page" button selector is still valid on later pages
    * Some websites may block scraping after a certain number of requests
    * Try reducing the scraping speed by increasing wait times
  </Accordion>
</AccordionGroup>

## Next Steps

After scraping a list, you can:

1. **Export the data** for analysis or use in other applications
2. **Scrape details from each URL** using [Page Details Scraping](/details-scraping)
3. **Save your configuration** by creating a reusable scraper

<Card title="Learn Page Details Scraping" icon="arrow-right" href="/details-scraping">
  Take your scraped URLs and extract detailed information from each page
</Card>