Start a batch scrape
brightdata.web.scrape.job.startStart an asynchronous scraping job over a batch of URLs and get a snapshot id back
- Price
- $0.0015/resultAl precio del proveedor
- Success rate
- 99,3 %Last 30 days · 631 calls
- Latency p50
- 394 msp95 1 s
- Last verified
- 28 jul 2026Verified working
POSThttps://toolswitch.dev/v1/tools/brightdata.web.scrape.job.start?dataset_id=gd_l1vikfch901nx3by4Preview- Uses platform quota
- Synchronous response
- Reads public data
Parámetros
returns {snapshot_id: "s_…"} immediately; nothing is billed until records are delivered. Always set limit_per_input on a discovery run — a discover_new job with no cap decides for itself how many records to produce, and each one is billable
| Parámetro | Tipo | Obligatorio | Descripción | Ejemplo |
|---|---|---|---|---|
| Parámetros de consulta | ||||
type | cadena | Opcional | set to discover_new to run a discovery crawl instead of scraping the given URLs | discover_new |
format | cadena | Opcional | json | ndjson | jsonl | csv | |
notify | booleano | Opcional | fire a webhook when the job finishes | |
endpoint | cadena | Opcional | webhook URL used when notify is set | |
dataset_id | cadena | Obligatorio | which managed scraper to run | gd_l1vikfch901nx3by4 |
auth_header | cadena | Opcional | Authorization header value Bright Data should send to your webhook | |
discover_by | cadena | Opcional | with type=discover_new: keyword | best_sellers_url | category_url | location | |
include_errors | booleano | Opcional | include a per-input error report in the snapshot | |
limit_per_input | entero | Opcional | cap records produced per input row — the main guard on discovery spend | 10 |
custom_output_fields | cadena | Opcional | pipe-separated field list | |
uncompressed_webhook | booleano | Opcional | ||
limit_multiple_results | entero | Opcional | cap total records across the whole job | |
- Parámetros de consulta
typecadenaOpcionalset to discover_new to run a discovery crawl instead of scraping the given URLs
Ejemplo:
discover_newformatcadenaOpcionaljson | ndjson | jsonl | csv
notifybooleanoOpcionalfire a webhook when the job finishes
endpointcadenaOpcionalwebhook URL used when notify is set
dataset_idcadenaObligatoriowhich managed scraper to run
Ejemplo:
gd_l1vikfch901nx3by4auth_headercadenaOpcionalAuthorization header value Bright Data should send to your webhook
discover_bycadenaOpcionalwith type=discover_new: keyword | best_sellers_url | category_url | location
include_errorsbooleanoOpcionalinclude a per-input error report in the snapshot
limit_per_inputenteroOpcionalcap records produced per input row — the main guard on discovery spend
Ejemplo:
10custom_output_fieldscadenaOpcionalpipe-separated field list
uncompressed_webhookbooleanoOpcionallimit_multiple_resultsenteroOpcionalcap total records across the whole job
Ejemplos de código
Sustituye $TOOLSWITCH_KEY por la clave que creaste en la consola.
curl -X POST 'https://toolswitch.dev/v1/tools/brightdata.web.scrape.job.start?dataset_id=gd_l1vikfch901nx3by4' \
-H "X-Toolswitch-Key: $TOOLSWITCH_KEY" \
-H "Content-Type: application/json" \
--data-raw '[{"url":"https://www.instagram.com/instagram"}]'import os
import json
import requests
response = requests.request(
"POST",
"https://toolswitch.dev/v1/tools/brightdata.web.scrape.job.start?dataset_id=gd_l1vikfch901nx3by4",
headers={"X-Toolswitch-Key": os.environ["TOOLSWITCH_KEY"]},
json=json.loads("[{\"url\":\"https://www.instagram.com/instagram\"}]"),
)
response.raise_for_status()
print(response.text)const response = await fetch("https://toolswitch.dev/v1/tools/brightdata.web.scrape.job.start?dataset_id=gd_l1vikfch901nx3by4", {
method: "POST",
headers: {
"X-Toolswitch-Key": process.env.TOOLSWITCH_KEY ?? "",
"Content-Type": "application/json",
},
body: JSON.stringify(JSON.parse("[{\"url\":\"https://www.instagram.com/instagram\"}]")),
});
if (!response.ok) throw new Error(`Request failed: ${response.status}`);
console.log(await response.text());La API de la pasarela está en versión preliminar; su URL y autenticación pueden cambiar. Los parámetros del ejemplo son datos de muestra. Las llamadas se facturan a $0.0015/result, incluida la tarifa de servicio.