Bright DataDonnées web et SEOSEO/AEO

Start a batch scrape

brightdata.web.scrape.job.start

Start an asynchronous scraping job over a batch of URLs and get a snapshot id back

Price: $0.0015/resultAu prix du fournisseur
Success rate: 99,3 %Last 30 days · 631 calls
Latency p50: 394 msp95 1 s
Last verified: 28 juil. 2026Verified working

POSThttps://toolswitch.dev/v1/tools/brightdata.web.scrape.job.start?dataset_id=gd_l1vikfch901nx3by4Preview

Uses platform quota
Synchronous response
Reads public data

Paramètres

returns {snapshot_id: "s_…"} immediately; nothing is billed until records are delivered. Always set limit_per_input on a discovery run — a discover_new job with no cap decides for itself how many records to produce, and each one is billable

Paramètre	Type	Obligatoire	Description	Exemple
Paramètres de requête
`type`	chaîne	Facultatif	set to discover_new to run a discovery crawl instead of scraping the given URLs	`discover_new`
`format`	chaîne	Facultatif	json \| ndjson \| jsonl \| csv
`notify`	booléen	Facultatif	fire a webhook when the job finishes
`endpoint`	chaîne	Facultatif	webhook URL used when notify is set
`dataset_id`	chaîne	Obligatoire	which managed scraper to run	`gd_l1vikfch901nx3by4`
`auth_header`	chaîne	Facultatif	Authorization header value Bright Data should send to your webhook
`discover_by`	chaîne	Facultatif	with type=discover_new: keyword \| best_sellers_url \| category_url \| location
`include_errors`	booléen	Facultatif	include a per-input error report in the snapshot
`limit_per_input`	entier	Facultatif	cap records produced per input row — the main guard on discovery spend	`10`
`custom_output_fields`	chaîne	Facultatif	pipe-separated field list
`uncompressed_webhook`	booléen	Facultatif
`limit_multiple_results`	entier	Facultatif	cap total records across the whole job

Paramètres de requête
typechaîneFacultatif
set to discover_new to run a discovery crawl instead of scraping the given URLs
Exemple : discover_new
formatchaîneFacultatif
json | ndjson | jsonl | csv
notifybooléenFacultatif
fire a webhook when the job finishes
endpointchaîneFacultatif
webhook URL used when notify is set
dataset_idchaîneObligatoire
which managed scraper to run
Exemple : gd_l1vikfch901nx3by4
auth_headerchaîneFacultatif
Authorization header value Bright Data should send to your webhook
discover_bychaîneFacultatif
with type=discover_new: keyword | best_sellers_url | category_url | location
include_errorsbooléenFacultatif
include a per-input error report in the snapshot
limit_per_inputentierFacultatif
cap records produced per input row — the main guard on discovery spend
Exemple : 10
custom_output_fieldschaîneFacultatif
pipe-separated field list
uncompressed_webhookbooléenFacultatif
limit_multiple_resultsentierFacultatif
cap total records across the whole job

Exemples de code

Remplacez $TOOLSWITCH_KEY par la clé créée dans la console.

Preview

curl -X POST 'https://toolswitch.dev/v1/tools/brightdata.web.scrape.job.start?dataset_id=gd_l1vikfch901nx3by4' \
  -H "X-Toolswitch-Key: $TOOLSWITCH_KEY" \
  -H "Content-Type: application/json" \
  --data-raw '[{"url":"https://www.instagram.com/instagram"}]'

import os
import json
import requests

response = requests.request(
    "POST",
    "https://toolswitch.dev/v1/tools/brightdata.web.scrape.job.start?dataset_id=gd_l1vikfch901nx3by4",
    headers={"X-Toolswitch-Key": os.environ["TOOLSWITCH_KEY"]},
    json=json.loads("[{\"url\":\"https://www.instagram.com/instagram\"}]"),
)
response.raise_for_status()
print(response.text)

const response = await fetch("https://toolswitch.dev/v1/tools/brightdata.web.scrape.job.start?dataset_id=gd_l1vikfch901nx3by4", {
  method: "POST",
  headers: {
    "X-Toolswitch-Key": process.env.TOOLSWITCH_KEY ?? "",
    "Content-Type": "application/json",
  },
  body: JSON.stringify(JSON.parse("[{\"url\":\"https://www.instagram.com/instagram\"}]")),
});
if (!response.ok) throw new Error(`Request failed: ${response.status}`);
console.log(await response.text());

Cette API de passerelle est en préversion ; son URL et son authentification peuvent changer. Les paramètres de l’exemple sont des données fictives. Les appels sont facturés à $0.0015/result, frais de service inclus.