Fetch

Usage: rapidcrawl fetch [options] [command]

Fetch URL content operations

Options:
  -h, --help        display help for command

Commands:
  bulk              Bulk fetch operations
  create [options]  Fetch URL content (POST)
  get [options]     Fetch URL content (GET via query params)
  help [command]    display help for command

Usage: rapidcrawl fetch bulk [options] [command]

Bulk fetch operations

Options:
  -h, --help        display help for command

Commands:
  create [options]  Create a bulk fetch job
  get <id>          Get a bulk fetch job
  help [command]    display help for command

Usage: rapidcrawl fetch bulk create [options]

Create a bulk fetch job

Options:
  --file <path>  Path to newline-delimited JSON file of URLs
  -h, --help     display help for command

Usage: rapidcrawl fetch bulk get [options] <id>

Get a bulk fetch job

Options:
  -h, --help  display help for command

Usage: rapidcrawl fetch create [options]

Fetch URL content (POST)

Options:
  --url <url>        URL to fetch
  --format <format>  Response format
  -h, --help         display help for command

Usage: rapidcrawl fetch get [options]

Fetch URL content (GET via query params)

Options:
  --url <url>        URL to fetch
  --format <format>  Response format
  -h, --help         display help for command