SDK ReferencePython SDK

Fetch Bulk

API functions for the Fetch Bulk resource.

Fetch Bulk

Functions for interacting with the fetch_bulk API resource. Each operation ships in four forms — sync / sync_detailed and their async counterparts.

Create Fetch Bulk

Bulk fetch URLs

Enqueues multiple URLs for HTTP fetching. Results delivered via webhook. Does not support options that require page rendering (cookies, wait_for_selector, etc.).

Limits: request bodies are guarded in a two-tier shape. A streamed body with no Content-Length header is capped at 2 MB before your API key is checked; a body that declares Content-Length is instead bounded there by a 20 MB fail-safe (not the real limit — see below), since that branch reads nothing until your key is verified. Once your key is verified, a second check re-gates the body against your account's own max_bulk_size (at this endpoint's per-item override budget), which reaches 16.8 MB for the largest documented account. A standard-plan account's effective ceiling is 2 MB; either tier's overrun returns a 400 with error code request_too_large.

Parameters

  • body (CreateFetchBulkBody)

Call styles

sync_detailed(client=client, body=body) -> Response[Union[CreateFetchBulkResponse202, Error]]
sync(client=client, body=body) -> Optional[Union[CreateFetchBulkResponse202, Error]]
await asyncio_detailed(client=client, body=body) -> Response[Union[CreateFetchBulkResponse202, Error]]
await asyncio(client=client, body=body) -> Optional[Union[CreateFetchBulkResponse202, Error]]

Get Fetch Bulk

Get fetch bulk job status

Returns the job envelope plus its per-URL items.

Downloading item content. Each completed item's content_url is a pre-signed URL, minted fresh on every read of this endpoint and valid for 600 seconds (10 minutes) — the same signing lifetime as the image_url returned by GET /v1/bulk/\{id\}/screenshots. The underlying objects are private, so an unsigned URL returns 401: download the content inside that window, or re-poll this endpoint for a fresh signature. Items that are not completed, and completed items with no stored object, carry null or the unsigned stored URL instead.

Parameters

  • id (str)

Call styles

sync_detailed(id=id, client=client) -> Response[Union[Error, GetFetchBulkResponse200]]
sync(id=id, client=client) -> Optional[Union[Error, GetFetchBulkResponse200]]
await asyncio_detailed(id=id, client=client) -> Response[Union[Error, GetFetchBulkResponse200]]
await asyncio(id=id, client=client) -> Optional[Union[Error, GetFetchBulkResponse200]]