Cloudflare now lets every customer, including free accounts, sort AI crawlers into Search, Agent, and Training and manage each one separately. Starting September 15, under Cloudflare's strictest-rule ...
There’s a report that blocking AI training bots with Cloudflare is also blocking legitimate Googlebot and Bingbot from indexing a website. Cloudflare recently announced that this would happen ...