Free trial: 3 of 3 test requests left. Get your own API key with 100 free credits. No credit card.
Crawl a small set of web pages synchronously.
Endpoint
/v1/web/crawl
Query
URLs to crawl. Repeat the `url` query parameter for multiple pages (max 5).
When true, scroll the page to load dynamically appended content (infinite scroll). Default false.
Wait for a CSS selector before extraction. Must be prefixed with "css:" (e.g. css:main). JavaScript wait conditions are not supported.
Most expensive proxy tier to use. The page is tried on `datacenter` first and moves up only if it is blocked, stopping at this tier. Default: every tier (`mobile`).
Most credits each URL may cost (1–25). Default 1. The batch shares one budget of this times the number of URLs; you're charged for what the pages use, at least 1 credit per URL.
const response = await fetch( "https://api.socialfetch.dev/v1/web/crawl?url=https://www.socialfetch.dev", { headers: { "x-api-key": "YOUR_API_KEY" } } ); const data = await response.json(); console.log(data);