Content Crawler
Extract clean, structured content from any public URL. This API retrieves article text, OpenGraph metadata, and can discover all links on a website. Output formats: HTML, Markdown, or plain text What you get: - Article title, content, author, and publication date - OpenGraph metadata for social sharing previews - Complete link maps for any website - oEmbed data from supported social platforms…
34 subscribers
9.4/10 popularity
4482 ms avg latency
70% success rate
3 endpoints
The in-depth APIMemo review for this API hasn't been published yet —
the data below comes straight from the public marketplace listing.
Content Crawler endpoints
| Method | Endpoint | Description |
|---|---|---|
| GET |
Content Scrapper /crawl |
Crawl endpoint accepts two arguments. - url - is required parameter to scrape content from the URL - type - Type of the content that will be returned: html, markdown or plain… |
| GET |
Craw links /crawl-links |
Crawl all links from the URL |
| GET |
Crawl Social Media Post /social |
Extract oEmbed data from social media URLs to easily embed content in your application. Returns standardized metadata including title, thumbnail image, author info, and embed HTML. |
Content Crawler pricing
| Plan | Price | Rate limit | Quotas |
|---|---|---|---|
| BASIC | Free | — |
|
| PRO | $10 / month | 100 / minute |
|
| ULTRA | $30 / month | — |
|
| MEGA | Free | 100 / second |
|
