Scrape

Usage: rapidcrawl scrape [options] [command]

Scrape URL content

Options:
  -h, --help        display help for command

Commands:
  bulk              Bulk scrape operations
  create [options]  Create a scrape job
  get <id>          Get a scrape job by ID
  help [command]    display help for command

Usage: rapidcrawl scrape bulk [options] [command]

Bulk scrape operations

Options:
  -h, --help        display help for command

Commands:
  create [options]  Create a bulk scrape job
  get <id>          Get a bulk scrape job
  help [command]    display help for command

Usage: rapidcrawl scrape bulk create [options]

Create a bulk scrape job

Options:
  --file <path>  Path to newline-delimited JSON file of URLs
  -h, --help     display help for command

Usage: rapidcrawl scrape bulk get [options] <id>

Get a bulk scrape job

Options:
  -h, --help  display help for command

Usage: rapidcrawl scrape create [options]

Create a scrape job

Options:
  --url <url>            URL to scrape
  --format <format>      Output format: json or markdown
  --wait-for <selector>  CSS selector to wait for before capturing
  -h, --help             display help for command

Usage: rapidcrawl scrape get [options] <id>

Get a scrape job by ID

Options:
  -h, --help  display help for command