Cloudflare’s new policy pushes AI companies to pay for publishers’ content
TechCrunch
Read full post
Cloudflare will block mixed-use web crawlers by default from ad-hosting pages starting September 15, 2026, affecting AI companies' access to web content for training and agent services. This policy aims to protect publishers' content and requires AI firms to separate crawlers used for search from those for AI training.
