Crawl a whole site as a background job
crawl4ai.web.crawlCrawls one site level by level from a start URL, inside the site, through include and exclude filters, cut at max_pages; runs only as a job. Poll it with crawl4ai.web.scrape.job.status and read the pages (url, level, title, status, links, markdown or html) with crawl4ai.web.scrape.job.results.
- 价格
- $0.07515/success按供应商原价
- 成功率
- —暂无成功率数据近 30 天 · 3 次
- 延迟 p50
- ——
- 最后验证
- 2026年10月11日实测可用
POSThttps://toolswitch.dev/v1/tools/crawl4ai.web.crawl预览在线试用即将上线供应商文档 ↗
- 可用平台额度调用
- 异步返回
- 读取公开数据
参数
这个工具没有参数,详见供应商文档 ↗ 供应商文档
代码示例
将 $TOOLSWITCH_KEY 替换为你在控制台创建的密钥。
预览
curl -X POST 'https://toolswitch.dev/v1/tools/crawl4ai.web.crawl' \
-H "X-Toolswitch-Key: $TOOLSWITCH_KEY" \
-H "Content-Type: application/json" \
--data-raw '{"url":"https://example.com/","depth":1,"max_pages":3}'import os
import json
import requests
response = requests.request(
"POST",
"https://toolswitch.dev/v1/tools/crawl4ai.web.crawl",
headers={"X-Toolswitch-Key": os.environ["TOOLSWITCH_KEY"]},
json=json.loads("{\"url\":\"https://example.com/\",\"depth\":1,\"max_pages\":3}"),
)
response.raise_for_status()
print(response.text)const response = await fetch("https://toolswitch.dev/v1/tools/crawl4ai.web.crawl", {
method: "POST",
headers: {
"X-Toolswitch-Key": process.env.TOOLSWITCH_KEY ?? "",
"Content-Type": "application/json",
},
body: JSON.stringify(JSON.parse("{\"url\":\"https://example.com/\",\"depth\":1,\"max_pages\":3}")),
});
if (!response.ok) throw new Error(`Request failed: ${response.status}`);
console.log(await response.text());网关接口为预览版,地址与鉴权方式可能调整。 示例参数仅为样例数据。 调用按 $0.07515/success 计费,已含服务费。