Cloudflare replaces blanket AI bot block with separate controls for search, training and agents

Cloudflare is giving all customers granular controls over AI bots, allowing site owners to manage Search, Training and Agent crawlers separately rather than blocking them all at once. The change replaces the previous blanket block option. Starting 15 September 2026, Training and Agent bots will be blocked by default on ad-supported pages.