Web Unlocker
Web Unlocker is the core OmniScrape product: a single API call that returns the content of any page, even ones protected by Cloudflare, DataDome, Akamai, PerimeterX, or AWS WAF. It handles proxies, browser fingerprints, JavaScript rendering, and challenge solving so you don't have to.
:::tip Free trial Every new account gets free credit to test Web Unlocker (and BaaS). Residential proxy is applied automatically — you don't need direct proxy credentials during the trial. :::
How it works
You send a URL to POST /v1/scrape. Behind the scenes we:
- Pick a residential IP (or the country you requested).
- Choose a mode — direct request or a real browser.
- Detect and solve any anti-bot challenge automatically.
- Render JavaScript if the page needs it.
- Return content in your chosen output format.
What makes it different
- Pay for success. Failed unlocks aren't billed.
- One contract. No managing proxy lists, browser farms, or solver services separately.
- Format flexibility. Get HTML, Markdown, plain text, or structured JSON from the same call.
Minimal example
curl -X POST https://api.omniscrape.io/v1/scrape \
-H "X-API-Key: $OMNISCRAPE_KEY" \
-H "Content-Type: application/json" \
-d '{ "url": "https://protected.example.com", "mode": "auto" }'
Common patterns
| Goal | Key parameters |
|---|---|
| Bypass Cloudflare | mode: js_rendering, enable_solver: true |
| Scrape a SPA | mode: js_rendering, js_wait_selector |
| Extract fields | css_selectors (or templates) |
| Geo-specific view | proxy: "residential:<cc>" |
| Logged-in crawl | session_id |
Learn more
- Modes
- Output formats
- Errors
- Long-form tutorials in the Guides