Bright DataWeb- und SEO-DatenSEO/AEO

Scrape URLs into structured records in one call

brightdata.web.scrape.structured

Scrape one or more URLs into structured records and get them back in the same call

Price: $0.0015/resultZum Anbieterpreis
Success rate: 84,4 %Last 30 days · 38 calls
Latency p50: 60 sp95 61 s
Last verified: 28.07.2026Verified working

POSThttps://toolswitch.dev/v1/tools/brightdata.web.scrape.structured?format=json&dataset_id=gd_l1vikfch901nx3by4Preview

Try onlineDemnächstProvider docs ↗

Uses platform quota
Synchronous response
Reads public data

Parameter

the API reference documents the body as {input: [...]}, while the quickstarts post a bare array [{url: …}] to the same path — both appear in official docs, so treat the array as the payload and the wrapper as optional until verified. HARD 1-minute timeout: past that the call returns HTTP 202 with a snapshot_id and you must collect the rows from brightdata.web.scrape.job.results instead. Use trigger/progress/snapshot for anything beyond a few URLs

Parameter	Typ	Erforderlich	Beschreibung	Beispiel
Abfrageparameter
`format`	Zeichenkette	Optional	json (default) \| ndjson \| csv	`json`
`dataset_id`	Zeichenkette	Erforderlich	which managed scraper to run — it decides both the site and the output columns. List them with brightdata.account.datasets.list	`gd_l1vikfch901nx3by4`
`include_errors`	Boolean	Optional	adds a per-input error report to the output
`custom_output_fields`	Zeichenkette	Optional	pipe-separated field list to trim the response	`url\|about.updated_on`

Abfrageparameter
formatZeichenketteOptional
json (default) | ndjson | csv
Beispiel: json
dataset_idZeichenketteErforderlich
which managed scraper to run — it decides both the site and the output columns. List them with brightdata.account.datasets.list
Beispiel: gd_l1vikfch901nx3by4
include_errorsBooleanOptional
adds a per-input error report to the output
custom_output_fieldsZeichenketteOptional
pipe-separated field list to trim the response
Beispiel: url|about.updated_on

Codebeispiele

Ersetze $TOOLSWITCH_KEY durch den in der Konsole erstellten Schlüssel.

Preview

curl -X POST 'https://toolswitch.dev/v1/tools/brightdata.web.scrape.structured?format=json&dataset_id=gd_l1vikfch901nx3by4' \
  -H "X-Toolswitch-Key: $TOOLSWITCH_KEY" \
  -H "Content-Type: application/json" \
  --data-raw '[{"url":"https://www.instagram.com/instagram"}]'

import os
import json
import requests

response = requests.request(
    "POST",
    "https://toolswitch.dev/v1/tools/brightdata.web.scrape.structured?format=json&dataset_id=gd_l1vikfch901nx3by4",
    headers={"X-Toolswitch-Key": os.environ["TOOLSWITCH_KEY"]},
    json=json.loads("[{\"url\":\"https://www.instagram.com/instagram\"}]"),
)
response.raise_for_status()
print(response.text)

const response = await fetch("https://toolswitch.dev/v1/tools/brightdata.web.scrape.structured?format=json&dataset_id=gd_l1vikfch901nx3by4", {
  method: "POST",
  headers: {
    "X-Toolswitch-Key": process.env.TOOLSWITCH_KEY ?? "",
    "Content-Type": "application/json",
  },
  body: JSON.stringify(JSON.parse("[{\"url\":\"https://www.instagram.com/instagram\"}]")),
});
if (!response.ok) throw new Error(`Request failed: ${response.status}`);
console.log(await response.text());

Diese Gateway-API ist eine Vorschauversion; URL und Authentifizierung können sich ändern. Die Beispielparameter sind Musterdaten. Aufrufe werden mit $0.0015/result einschließlich Servicegebühr abgerechnet.