Cloudflare Debuts Markdown for Agents and Content Signals to Guide AI Crawlers

Cloudflare has introduced “Markdown for Agents,” a feature that lets AI crawlers request Markdown versions of web pages. The company pairs the feature with a proposed “Content Signals” mechanism that lets publishers declare whether their content may be used for AI training, search indexing or inference.

By Matt Foster