Agents usually guess a URL and curl it. Cloudflare's new web search via AI Gateway lets them search instead, only from crawlers that meet its Verified Bots rules and link to the source. https://apis.io/2026/10/20/cloudflare-gives-agents-web-search-through-ai-gateway-with-verified-crawlers-only/
1 repost3 likes