Deliver your data to Amazon S3

Now you can deliver scraped data directly to the Amazon S3 bucket.

To do this, follow these 2 steps:

1. Connect your Amazon s3 bucket with ProWebScraper
2. Enable scraper(s) to deliver data to Amazon S3 bucket

Step 1: Connect your amazon s3 bucket with ProWebScraper

To connect amazon s3:

1. Go to “Global cloud storage setting”
2. Select the tab “Amazon S3”
3. Enter the information below to connect to your Amazon S3 bucket
1. S3 Access Key
2. S3 Secret Key
3. Bucket
4. Path 
4. Enable the option “Allow Amazon S3 delivery"
5. Now click on “Save” to save all settings.

Step 2: Enable scraper to deliver data via email

This step allows you to enable Amazon s3 delivery for your scraper(s).

1. Go to the scraper for which you want to deliver data via email. In this case, we are going to TripAdvisor Review Scraper > Cloud storage 
2. Go to Application > Amazon S3
3. Enable the option “Allow Scraper to Email delivery”
4. Choose when to publish data to your Amazon s3 bucket
   • • automatic [when any job is finished]
     • manual

5. Choose the file format you want to deliver

   • • CSV

     • CSV zip 

     • JSON

     • JSON zip

How you can manage scraper globally

Let’s say, you wish to enable or disable Amazon s3 delivery for multiple scrapers without going through every scraper.

To do this, you can manage multiple scraper delivery by doing this:

1. Go to “Global cloud storage setting” > Amazon s3 
2. Click on “Manage scrapers for Amazon s3 delivery”
3. You will be redirected to a screen like the following below screenshot:

From this screen, you can perform the below actions for all your scrapers:

1. File format
2. Enable or disable delivery