Part 3: Pagination - Capture data from multiple pages

So far you have worked out how to scrape detail pages and how to extract data from the listing page. Now you are all set to continue scraping in order to capture data from multiple pages. 

 In this part, you will get to see how to add pagination by clicking on the "Next" button and extract from all available pages.

Pagination at Our listing page :

So, you need to go back to listing scraper and edit it by adding pagination functionality.

From the ProWebScraper Dashboard, you can go to your listing scraper “Flipkart Listings” and then you can click on the button  “ Go to selector” to get back to the Edit view of a scraper. 

Now you can click “Add column”, and then locate & click on Pagination Link (Next Page link) of the website.

To apply pagination, go to column settings => click on "Capture Next Page link's URL" to enable it, which will have a checkmark next to it when enabled.

After applying this setting, you will be able to see all the text of pagination convert into pagination links.

By applying this, the ProWebScraper algorithm will automatically scrape listing from all the pages.

After adding pagination functionality, you can click “Save” and then “Save & Run” to get the list from all the pages.

With the setup nearly completed, you will want to continue to Part 4: Chaining Two scrapers.