Now you can deliver the scraped data directly to SFTP server
To do this, follow these 2 steps:
- Connect your SFTP server with ProWebScraper
- Enable the scraper(s) to deliver data to SFTP server
Step 1: Connect your SFTP server with ProWebScraper
To connect with the SFTP server,
- Go to “Global cloud storage setting”
- Select tab “SFTP”
- Enter the information to connect to your SFTP server
- Host
- Username
- Password
- Port
- Path
- Enable the option “Allow SFTP delivery"
- Now click on “Save” to save all settings.
Step 2: Enable scraper to deliver data via email
This step allows you to enable SFTP delivery for any of your scraper(s):
- Go to the scraper for which you want to deliver data via email. In this case, we are going to TripAdvisor Review Scraper > Cloud storage
- Go to Application > SFTP
- Enable the option “Allow Scraper to SFTP delivery”
- Choose when to deliver data to your SFTP server
- automatic [when any job is finished]
- manual
- Choose the file format you want to deliver
- CSV
- CSV zip
- JSON
- JSON zip
How you can manage scraper globally
Let’s say, you wish to enable or disable SFTP delivery for multiple scrapers without going through every scraper.
To can manage multiple scraper delivery:
- Go to “Global cloud storage setting” > SFTP
- Click on “Manage scrapers for SFTP delivery”
- You will be redirected to a screen like the following:
From this screen, you can perform the below actions for all your scrapers:
- File format
- Enable or disable delivery
Comments
0 comments
Please sign in to leave a comment.