The Verge · Emma Roth ·

OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI across multiple crawlers

The new control will allow publishers to apply their AI training preferences across multiple crawlers.

Google Microsoft OpenAI Anthropic AI

In this story Anthropic Google Microsoft OpenAI

OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI across multiple crawlers

Lead Source

The Verge — OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI across multiple crawlers ↗

How this story grew

Coverage · 0 Discussion · 0

Oct 30Nov 1

More

Search Engine Roundtable: Search Engine Roundtable

Bing Blogs: Bing Blogs

OpenAI: OpenAI

IETF Datatracker: IETF Datatracker

PPC Land: PPC Land

Engadget: Engadget

Malay Mail: Malay Mail

SiliconANGLE: SiliconANGLE

Thurrott: Thurrott

Related stories

The Information: Google, OpenAI, and Anthropic plan to launch an AI safety standards body without government oversight in late 2026 or 2027, and are considering CEOs

Reuters: Anthropic and OpenAI have pushed for substantial control over what external AI evaluators can publish, out of concern that trade secrets could leak

Bloomberg Law: OpenAI says it has been working with Anthropic and Google for several weeks on AI safety, and it does not need an antitrust waiver to coordinate on safety

Axios: OpenAI, Anthropic, AWS, Microsoft, and 100+ companies warn there is "a limited window" to prepare for AI-enabled cyberattacks and call for "collective action"

Bloomberg: OpenAI says it plans to let third-party groups conduct technical safety evaluations of its AI models during the training, evaluation, and deployment phases

Discuss with AI

ChatGPT ↗ Claude ↗

← Back to TechSnif