Crawl4AIWeb- und SEO-DatenSEO/AEO

List every URL of a site without crawling it

crawl4ai.web.map

A site's URLs from the sources that already know them: its sitemaps, the links on its home page and the newest Common Crawl indexes (mode full adds the Wayback Machine). One call, 1 to 3 seconds for most sites. Each row: url, sources, last_seen, depth.

Price: $0.00015/successZum Anbieterpreis
Success rate: 91,5 %Last 30 days · 3.974 calls
Latency p50: 14 sp95 49 s
Last verified: 11.10.2026Verified working

POSThttps://toolswitch.dev/v1/tools/crawl4ai.web.mapPreview

Try onlineDemnächstProvider docs ↗

Uses platform quota
Synchronous response
Reads public data

Parameter

Dieses Tool hat keine Parameter. Siehe Anbieterdokumentation ↗ Provider docs

Codebeispiele

Ersetze $TOOLSWITCH_KEY durch den in der Konsole erstellten Schlüssel.

Preview

curl -X POST 'https://toolswitch.dev/v1/tools/crawl4ai.web.map' \
  -H "X-Toolswitch-Key: $TOOLSWITCH_KEY" \
  -H "Content-Type: application/json" \
  --data-raw '{"domain":"docs.crawl4ai.com","max_urls":5}'

import os
import json
import requests

response = requests.request(
    "POST",
    "https://toolswitch.dev/v1/tools/crawl4ai.web.map",
    headers={"X-Toolswitch-Key": os.environ["TOOLSWITCH_KEY"]},
    json=json.loads("{\"domain\":\"docs.crawl4ai.com\",\"max_urls\":5}"),
)
response.raise_for_status()
print(response.text)

const response = await fetch("https://toolswitch.dev/v1/tools/crawl4ai.web.map", {
  method: "POST",
  headers: {
    "X-Toolswitch-Key": process.env.TOOLSWITCH_KEY ?? "",
    "Content-Type": "application/json",
  },
  body: JSON.stringify(JSON.parse("{\"domain\":\"docs.crawl4ai.com\",\"max_urls\":5}")),
});
if (!response.ok) throw new Error(`Request failed: ${response.status}`);
console.log(await response.text());

Diese Gateway-API ist eine Vorschauversion; URL und Authentifizierung können sich ändern. Die Beispielparameter sind Musterdaten. Aufrufe werden mit $0.00015/success einschließlich Servicegebühr abgerechnet.