Olostep网页与 SEO 数据SEO/AEO

Crawl a website

olostep.web.crawl

Start a bounded asynchronous website crawl and pay only for completed pages.

价格: $0.2/success按供应商原价
成功率: 100%近 30 天 · 20 次
延迟 p50: 493 毫秒p95 1.8 秒
最后验证: 2026年9月23日实测可用

POSThttps://toolswitch.dev/v1/tools/olostep.web.crawl预览

可用平台额度调用
异步返回
读取公开数据

参数

Webhooks, follow_robots_txt=false and structured parsers are deliberately excluded. Use olostep.web.crawl.results with formats=markdown or html to read completed content.

这个工具没有参数，详见供应商文档 ↗ 供应商文档

代码示例

将 $TOOLSWITCH_KEY 替换为你在控制台创建的密钥。

预览

curl -X POST 'https://toolswitch.dev/v1/tools/olostep.web.crawl' \
  -H "X-Toolswitch-Key: $TOOLSWITCH_KEY" \
  -H "Content-Type: application/json" \
  --data-raw '{"max_depth":0,"max_pages":1,"start_url":"https://example.com","follow_robots_txt":true}'

import os
import json
import requests

response = requests.request(
    "POST",
    "https://toolswitch.dev/v1/tools/olostep.web.crawl",
    headers={"X-Toolswitch-Key": os.environ["TOOLSWITCH_KEY"]},
    json=json.loads("{\"max_depth\":0,\"max_pages\":1,\"start_url\":\"https://example.com\",\"follow_robots_txt\":true}"),
)
response.raise_for_status()
print(response.text)

const response = await fetch("https://toolswitch.dev/v1/tools/olostep.web.crawl", {
  method: "POST",
  headers: {
    "X-Toolswitch-Key": process.env.TOOLSWITCH_KEY ?? "",
    "Content-Type": "application/json",
  },
  body: JSON.stringify(JSON.parse("{\"max_depth\":0,\"max_pages\":1,\"start_url\":\"https://example.com\",\"follow_robots_txt\":true}")),
});
if (!response.ok) throw new Error(`Request failed: ${response.status}`);
console.log(await response.text());

网关接口为预览版，地址与鉴权方式可能调整。示例参数仅为样例数据。调用按 $0.2/success 计费，已含服务费。