post https://api.scrapingrobot.com/
Scrape web-pages using an alternative approach with POST API
This API will allow you to use the Scraping Robot service to retrieve web page content passing the task parameters in a POST-request body as a JSON object. To do this, you need to send a POST-request to the Scraping Robot server and transfer your token as a query-parameter and all the task-parameters as a JSON-object in a POST body.
The minimum - is only two required parameters:
- url
- module (the value depends on whether you need to use JS-rendering)
All other parameters are optional and are passed in the nested params-object.
The API has many configurable parameters, which allows you to flexibly control scraping, as well as receive the content of individual page elements, and not just the entire content (see optional parameters).
Simplest scraping example:
POST https://api.scrapingrobot.com/?token=<YOUR_SR_TOKEN>
# Request body:
{
"url":"https://scrapingrobot.com/about-us",
"module":"HtmlRequestScraper"
}