Web Crawler
This API provides web crawling capabilities for extracting different types of content from websites. The API is designed to support three main types of crawling operations: Markdown content extraction LLM (Language Model) content extraction CSS content extraction Each crawling operation follows a similar pattern: Initial request to start the crawl Asynchronous processing with task ID Status…
1 subscribers
7 endpoints
The in-depth APIMemo review for this API hasn't been published yet —
the data below comes straight from the public marketplace listing.
Web Crawler endpoints
| Method | Endpoint | Description |
|---|---|---|
| markdown | ||
| GET |
getMarkdownCrawlResult /markdown/result/{task_id} |
Retrieves the result of a markdown crawl |
| POST |
startMarkdownCrawl /markdown/crawl |
Initiates a crawl to extract markdown content from a URL |
| llm | ||
| GET |
getLLMCrawlResult /llm/result/{task_id} |
Retrieves the result of an LLM crawl |
| POST |
startLLMCrawl /llm/crawl |
Initiates a crawl to extract and process content with a language model |
| css | ||
| GET |
getCSSCrawlResult /css/result/{task_id} |
Retrieves the result of a CSS crawl |
| POST |
startCSSCrawl /css/crawl |
Initiates a crawl to extract CSS styles and selectors from a URL |
| tasks | ||
| GET |
checkTaskStatus /tasks/{task_id}/status |
Checks the status of any crawl task |
Web Crawler pricing
| Plan | Price | Rate limit | Quotas |
|---|---|---|---|
| BASIC | $10 / month | — |
|
| PRO | $20 / month | — |
|
| ULTRA | $30 / month | — |
|
