Crawl a whole site as a background job
crawl4ai.web.crawlCrawls one site level by level from a start URL, inside the site, through include and exclude filters, cut at max_pages; runs only as a job. Poll it with crawl4ai.web.scrape.job.status and read the pages (url, level, title, status, links, markdown or html) with crawl4ai.web.scrape.job.results.
- Price
- $0.07515/successAu prix du fournisseur
- Success rate
- —Aucune donnée de taux de réussite pour le momentLast 30 days · 3 calls
- Latency p50
- ——
- Last verified
- 11 oct. 2026Verified working
POSThttps://toolswitch.dev/v1/tools/crawl4ai.web.crawlPreviewTry onlineBientôtProvider docs ↗
- Uses platform quota
- Asynchronous response
- Reads public data
Paramètres
Cet outil n’a pas de paramètres. Voir la doc du fournisseur ↗ Provider docs
Exemples de code
Remplacez $TOOLSWITCH_KEY par la clé créée dans la console.
Preview
curl -X POST 'https://toolswitch.dev/v1/tools/crawl4ai.web.crawl' \
-H "X-Toolswitch-Key: $TOOLSWITCH_KEY" \
-H "Content-Type: application/json" \
--data-raw '{"url":"https://example.com/","depth":1,"max_pages":3}'import os
import json
import requests
response = requests.request(
"POST",
"https://toolswitch.dev/v1/tools/crawl4ai.web.crawl",
headers={"X-Toolswitch-Key": os.environ["TOOLSWITCH_KEY"]},
json=json.loads("{\"url\":\"https://example.com/\",\"depth\":1,\"max_pages\":3}"),
)
response.raise_for_status()
print(response.text)const response = await fetch("https://toolswitch.dev/v1/tools/crawl4ai.web.crawl", {
method: "POST",
headers: {
"X-Toolswitch-Key": process.env.TOOLSWITCH_KEY ?? "",
"Content-Type": "application/json",
},
body: JSON.stringify(JSON.parse("{\"url\":\"https://example.com/\",\"depth\":1,\"max_pages\":3}")),
});
if (!response.ok) throw new Error(`Request failed: ${response.status}`);
console.log(await response.text());Cette API de passerelle est en préversion ; son URL et son authentification peuvent changer. Les paramètres de l’exemple sont des données fictives. Les appels sont facturés à $0.07515/success, frais de service inclus.