A new benchmark study reveals that modern bot detection systems show highly inconsistent performance, with success rates ranging from 9% to 99% against advanced AI-powered browsing agents.
Key Points
- Researchers tested five detection systems: Proof of Human, Google reCAPTCHA v3, hCaptcha, Cloudflare Turnstile, and Cloudflare Bot Management.
- Adversaries included standard Chromium scripts, stealth-focused browsers like CloakBrowser, and AI agents such as Perplexity Comet, Grok, and Browser Use.
- Proof of Human achieved the highest detection rate at 99%, while Cloudflare Bot Management identified only 9.1% of automated sessions.
- Detection systems struggled to distinguish between traditional scripted bots and newer AI agents that can interpret visual webpage data to complete tasks.
- Performance varied significantly by tool, with some systems effectively blocking scripted browsers while failing to identify sophisticated AI-driven navigation.