What does web data cost for an AI agent?
FetchIndex compares the published prices of scraping APIs, proxies, browser infrastructure and search APIs, normalized to one comparable number, with every formula and gap shown. No affiliate links, no rankings for sale.
- 18 vendors tracked
- 158 price points, each with its formula
- 13 with full pricing verification, 5 partial
- last checked
Cheapest published price at a glance (budget up to $100/month)
| Use case | Lowest three published prices | Unit |
|---|---|---|
| Basic page fetch | ScrapingBee $0.099 Startup Scrapfly $0.10 Pro Zyte $0.10 $100/mo commitment - Tier 1 HTTP | per 1,000 |
| Protected / anti-bot page | Zyte $0.95 $100/mo commitment - Tier 5 HTTP Bright Data $1.50 Unlocker PAYG ScrapingBee $2.48 Startup | per 1,000 |
| SERP query (structured search results) | Crawl4AI $0.792 Cloud Builder Oxylabs $1.00 Starter - /Search Bright Data $1.50 SERP PAYG | per 1,000 |
| AI/agent search query | Jina Reader $0.50 $50 pack (s.jina.ai minimum) Browserbase $1.00 Parallel Fast Firecrawl $1.66 Standard | per 1,000 |
| Remote browser hour | Hyperbrowser $0.10 All plans Steel $0.10 Launch Browserbase $0.198 Startup (included hours) | per hour |
See the full comparison tables · Which tool should I pick?
Browse by category
Scraping & crawling APIs
Send a URL, get back HTML, markdown or JSON. These services handle proxies, retries and often JavaScript rendering for you.
14 vendors
Proxies & unblockers
Proxy networks and request-level unblocking products. You pay per GB, per IP or per successful request.
4 vendors
Browser infrastructure
Hosted headless browsers for agents that must click, log in or run JavaScript. Billing is usually per browser hour plus bandwidth.
7 vendors
Search & SERP APIs
Structured search results for agents, RAG grounding and SEO data, from classic SERP scrapers to neural and agent-first search.
10 vendors
Popular head-to-head comparisons
- Firecrawl vs Crawl4AI
- Firecrawl vs Jina Reader
- Firecrawl vs Scrapfly
- Firecrawl vs ZenRows
- ScraperAPI vs ScrapingBee
- Scrapfly vs ZenRows
- Zyte vs Scrapfly
- Bright Data vs Oxylabs
- Apify vs Bright Data
- Tavily vs Exa
For AI agents and developers
The same data is published as machine-readable files: /api/vendors.json, /api/pricing.csv, /api/cheapest.json (ranked answers to “cheapest tool for X”) and /llms.txt. See the schema and API page. Versioned, with an updated date.
Recent price changes
- · Baseline snapshot recorded for 18 vendors (26 source pages). Future runs diff against this.