OmniCrawl
Universal Web Crawler Framework
An all-in-one crawler framework built on Scrapling + curl_cffi + Playwright, with anti-anti-bot detection, browser fingerprint emulation, and smart retries — making data collection simple and efficient.
Quick start
Get running in 30 seconds
$ pip install omnicrawl-coreIn China, use the Tsinghua mirror: pip install omnicrawl-core -i https://pypi.tuna.tsinghua.edu.cn/simple
Preview
Product Gallery
Click image to zoom in
Highlights
Features
Multi-engine support: switch between Scrapling, curl_cffi, and Playwright seamlessly
Anti-anti-bot: automatically bypasses Cloudflare, Akamai, and other WAFs
Browser fingerprint emulation: real browser behavior to reduce ban risk
Smart retries and proxy rotation
Pricing
Starter
- 1,000 API calls/month
- Basic anti-bot features
- Community support
- Single user
Pro
- 10,000 API calls/month
- Advanced anti-bot features
- Priority support
- 5 users
- API documentation
Enterprise
- Unlimited API calls
- Custom anti-bot strategies
- Dedicated technical support
- Unlimited users
- SLA guarantee
- Private deployment
Want every tool in the XIsland product line?
Get started
Ready to start?
OmniCrawl is ready. Pick a plan that fits you and get started — or reach out first.