Data API
Coming soonScraper API
Send a URL, get the page back. No pool to run, no rotation to manage.
Interface
HTTPS API, one call per page
Rotation
Handled for you
Billing
Per 1,000 requests
What it is
The jobs the Scraper API is for
The Scraper API takes a URL and returns the page. Exit selection and retries happen on our side, and what comes back is the response body.
Scheduled crawls of catalogue and listing pages
Collection jobs too small to justify running a pool
Teams with nobody to look after rotation and retries
Not for
- Pages that answer with a challenge instead of content: that is the Unblocker API
- Work that must hold one address across requests: use ISP
Planned interface
The Scraper API, as planned
The catalogue carries this ladder for the day the Scraper API opens. Nothing here is on sale or can be ordered, the rates may change before launch, and a product that is not yet on sale is not offered or priced under the terms.
| Network | |
|---|---|
| Interface | HTTPS API, one call per page |
| Rotation | Handled for you |
| Billing | Per 1,000 requests |
bash
curl -G "https://API_HOST/scrape" \
-H "Authorization: Bearer API_KEY" \
--data-urlencode "url=https://example.com"https://example.com
Response (truncated)
<!doctype html><html lang="en"><head><title>Example Domain</title>...
| Requests per order | Planned rate /1,000 req |
|---|---|
| 1,000 requests+ | $2.00 |
| 5,000 requests+ | $1.70 |
| 25,000 requests+ | $1.45 |
| 100,000 requests+ | $1.20 |
| 500,000 requests+ | $0.95 |
| 2,000,000 requests+ | $0.70 |
Read the terms for what is and is not offered.
Compare
Scraper API or Unblocker API
Scraper API
- What comes back
- The response body of a plain fetch
- On a challenge
- Stops and reports the challenge
- Pick it when
- A plain fetch gets your pages
Unblocker API
- What comes back
- A page, after rotating and retrying
- On a challenge
- Keeps going until a page comes back
- Pick it when
- A plain fetch is refused
Today’s alternative
Until the Scraper API opens
Residential covers the same jobs today, with a proxy you drive yourself.
Residential
Rotating residential IPs, priced per gigabyte, no expiry.
from $1.65/GB · 1 GB free to start
Questions
Scraper API, answered
When will the Scraper API be available?
It is in the catalogue and marked coming soon. The planned rate ladder is on this page, captioned as not on sale. The day it opens, that ladder becomes the price list and the order route appears here.