Cloudflare will filter out web crawlers that serve AI companies

Cloudflare has announced plans to automatically block mixed-use web crawlers that index websites for search engines and act as AI agents and trainers at the same time. The company previously offered ...

Published: 2026-07-02