Fetch Bulk
API functions for the Fetch Bulk resource.
Fetch Bulk
Functions for interacting with the fetch_bulk API resource. Each operation ships in four forms — sync / sync_detailed and their async counterparts.
Create Fetch Bulk
Bulk fetch URLs
Enqueues multiple URLs for HTTP fetching. Results delivered via webhook. Does not support options that require page rendering (cookies, wait_for_selector, etc.).
Limits: request bodies are guarded in a two-tier shape. A streamed body
with no Content-Length header is capped at 2 MB before your API key
is checked; a body that declares Content-Length is instead bounded
there by a 20 MB fail-safe (not the real limit — see below), since
that branch reads nothing until your key is verified. Once your key
is verified, a second check re-gates the body against your account's
own max_bulk_size (at this endpoint's per-item override budget),
which reaches 16.8 MB for the largest documented account. A
standard-plan account's effective ceiling is 2 MB; either tier's
overrun returns a 400 with error code request_too_large.
Parameters
body (CreateFetchBulkBody)
Call styles
sync_detailed(client=client, body=body) -> Response[Union[CreateFetchBulkResponse202, Error]]
sync(client=client, body=body) -> Optional[Union[CreateFetchBulkResponse202, Error]]
await asyncio_detailed(client=client, body=body) -> Response[Union[CreateFetchBulkResponse202, Error]]
await asyncio(client=client, body=body) -> Optional[Union[CreateFetchBulkResponse202, Error]]Get Fetch Bulk
Get fetch bulk job status
Returns the job envelope plus its per-URL items.
Downloading item content. Each completed item's content_url is a
pre-signed URL, minted fresh on every read of this endpoint and valid
for 600 seconds (10 minutes) — the same signing lifetime as the
image_url returned by GET /v1/bulk/\{id\}/screenshots. The underlying
objects are private, so an unsigned URL returns 401: download the
content inside that window, or re-poll this endpoint for a fresh
signature. Items that are not completed, and completed items with no
stored object, carry null or the unsigned stored URL instead.
Parameters
id (str)
Call styles
sync_detailed(id=id, client=client) -> Response[Union[Error, GetFetchBulkResponse200]]
sync(id=id, client=client) -> Optional[Union[Error, GetFetchBulkResponse200]]
await asyncio_detailed(id=id, client=client) -> Response[Union[Error, GetFetchBulkResponse200]]
await asyncio(id=id, client=client) -> Optional[Union[Error, GetFetchBulkResponse200]]