Scrape or crawl a list of URLs in one batch, streamed
crawl4ai.web.extract.batchScrape up to 25 URLs in one call; results stream back as NDJSON, one line per URL as it finishes, then one summary line with the batch's total cost.
- Price
- $0.00375/successAt provider cost
- Success rate
- 99.3%Last 30 days · 4,334 calls
- Latency p50
- 13 sp95 52 s
- Last verified
- Oct 5, 2026Verified working
POSThttps://toolswitch.dev/v1/tools/crawl4ai.web.extract.batchPreviewTry onlineComing soonProvider docs ↗
- Uses platform quota
- Synchronous response
- Reads public data
Parameters
Crawl4AI takes up to 50; treg caps the list at 25 so the hold stays bounded. For more URLs, start a job.
This tool has no parameters. See provider docs ↗ Provider docs
Code samples
Replace $TOOLSWITCH_KEY with the key you created in the console.
Preview
curl -X POST 'https://toolswitch.dev/v1/tools/crawl4ai.web.extract.batch' \
-H "X-Toolswitch-Key: $TOOLSWITCH_KEY" \
-H "Content-Type: application/json" \
--data-raw '{"urls":["https://example.com"],"format":"md"}'import os
import json
import requests
response = requests.request(
"POST",
"https://toolswitch.dev/v1/tools/crawl4ai.web.extract.batch",
headers={"X-Toolswitch-Key": os.environ["TOOLSWITCH_KEY"]},
json=json.loads("{\"urls\":[\"https://example.com\"],\"format\":\"md\"}"),
)
response.raise_for_status()
print(response.text)const response = await fetch("https://toolswitch.dev/v1/tools/crawl4ai.web.extract.batch", {
method: "POST",
headers: {
"X-Toolswitch-Key": process.env.TOOLSWITCH_KEY ?? "",
"Content-Type": "application/json",
},
body: JSON.stringify(JSON.parse("{\"urls\":[\"https://example.com\"],\"format\":\"md\"}")),
});
if (!response.ok) throw new Error(`Request failed: ${response.status}`);
console.log(await response.text());This gateway API is in preview; its URL and authentication may change. The example parameters are sample data. Calls are billed at $0.00375/success, including the service fee.