OmniCrawl
Universal Web Crawler Framework
An all-in-one crawler framework built on Scrapling + curl_cffi + Playwright, with anti-anti-bot detection, browser fingerprint emulation, and smart retries — making data collection simple and efficient.
Quick start
Get running in 30 seconds
$ pip install omnicrawlIn China, use the Tsinghua mirror: pip install omnicrawl -i https://pypi.tuna.tsinghua.edu.cn/simple
Download
Get OmniCrawl
Users in China: Gitee mirror or package manager install is recommended for faster and more stable downloads.
Preview
Product Gallery
Click image to zoom in
Highlights
Features
Multi-engine support: switch between Scrapling, curl_cffi, and Playwright seamlessly
Anti-anti-bot: automatically bypasses Cloudflare, Akamai, and other WAFs
Browser fingerprint emulation: real browser behavior to reduce ban risk
Smart retries and proxy rotation
Async concurrent crawling
Detailed logging and monitoring
Pricing
Starter
- 1,000 API calls/month
- Basic anti-bot features
- Community support
- Single user
Pro
- 10,000 API calls/month
- Advanced anti-bot features
- Priority support
- 5 users
- API documentation
Enterprise
- Unlimited API calls
- Custom anti-bot strategies
- Dedicated technical support
- Unlimited users
- SLA guarantee
- Private deployment
Want every app in the store?See Meteor Pass →
Get started
Ready to start?
OmniCrawl is ready. Pick a plan that fits you and get started — or reach out first.