ProxyCrawl Crawling
We have built the Crawling API on top of thousands of rotating proxies to let you crawl and scrape millions of web pages with ease. Use our highly scalable API to protect your web crawler against blocked requests, proxy failure, IP leaks, browser crashes, and CAPTCHAs! For more details, please read the API documentation. https://crawlbase.com/docs/crawling-api/
ProxyCrawl Crawling endpoints
| Method | Endpoint | Description |
|---|---|---|
| GET |
/ / |
Crawls and Scrapes the Web with a given URL. Example: GET / ?url=https://www.amazon.com |
| POST |
/ / |
Crawls and Scrapes the Web with a given URL. |
| GET |
/_copy / |
Crawls and Scrapes the Web with a given URL. Example: GET / ?url=https://www.amazon.com |
ProxyCrawl Crawling pricing
| Plan | Price | Rate limit | Quotas |
|---|---|---|---|
| BASIC | Free | 1 / second |
|
| PRO | Free | 20 / second |
|