Skip to main content

Web Unlocker

Web Unlocker is the core OmniScrape product: a single API call that returns the content of any page, even ones protected by Cloudflare, DataDome, Akamai, PerimeterX, or AWS WAF. It handles proxies, browser fingerprints, JavaScript rendering, and challenge solving so you don't have to.

:::tip Free trial Every new account gets free credit to test Web Unlocker (and BaaS). Residential proxy is applied automatically — you don't need direct proxy credentials during the trial. :::

How it works

You send a URL to POST /v1/scrape. Behind the scenes we:

  1. Pick a residential IP (or the country you requested).
  2. Choose a mode — direct request or a real browser.
  3. Detect and solve any anti-bot challenge automatically.
  4. Render JavaScript if the page needs it.
  5. Return content in your chosen output format.

What makes it different

  • Pay for success. Failed unlocks aren't billed.
  • One contract. No managing proxy lists, browser farms, or solver services separately.
  • Format flexibility. Get HTML, Markdown, plain text, or structured JSON from the same call.

Minimal example

curl -X POST https://api.omniscrape.io/v1/scrape \
-H "X-API-Key: $OMNISCRAPE_KEY" \
-H "Content-Type: application/json" \
-d '{ "url": "https://protected.example.com", "mode": "auto" }'

Common patterns

GoalKey parameters
Bypass Cloudflaremode: js_rendering, enable_solver: true
Scrape a SPAmode: js_rendering, js_wait_selector
Extract fieldscss_selectors (or templates)
Geo-specific viewproxy: "residential:<cc>"
Logged-in crawlsession_id

Learn more