Epizódjegyzetek
In July (2026), Cloudflare announced that it was going to categorise web crawlers (bots) in one of three ways: search, agent, or training.
If you want to opt out of training, you can block training bots - easy, right?
Not so...common crawlers such as Googlebot (critical for showing up in Google search) are classed as multi-purpose. They crawl for search purposes, but they also train AI models.
In this discussion, we explain Cloudflare's strange decision to hide settings within the 'security' section and how easily a brand could trap itself into obscurity if it chooses the incorrect…

