Fortune · Emily Forlini ·

OpenAI quietly updates its evaluation metrics for GPT-6 Astra, making changes that appear to favor Astra and continuing to revise other metrics after launch

OpenAI has changed several evaluation benchmarks for its GPT-6 Astra model since first publishing a blog post announcement mid-afternoon on Sept. 3.

OpenAI Venture Capital

In this story GPT-6 Astra OpenAI

OpenAI quietly updates its evaluation metrics for GPT-6 Astra, making changes that appear to favor Astra and continuing to revise other metrics after launch

Lead Source

Fortune — OpenAI quietly updates its evaluation metrics for GPT-6 Astra, making changes that appear to favor Astra and continuing to revise other metrics after launch ↗

How this story grew

Coverage · 0 Discussion · 0

Sep 6Sep 8

More

The Decoder: The Decoder

The Kaitchup: The Kaitchup

Discussion

r/BetterOffline

@emilyforlini @akhenosiris @katiemiller @mark_k @emilyforlini @jeremyakahn @garymarcus

Related stories

9to5Mac: OpenAI rolls out GPT-6 Astra to Plus, Pro, Enterprise, and Business Standard and Premium users in ChatGPT Work and Codex and in the API

The Information: OpenAI's Astra model uses "recurrent depth", a technique that improves cost and performance but obscures the AI's reasoning, making it harder to monitor

xAI: SpaceXAI releases Grok 4.6, saying it matches GPT-5.6 Sol on the Artificial Analysis Intelligence Index, and prices it at $2/1M input and $6/1M output tokens

Wired: Meta adjusts employee review language around "AI-driven impact" and token usage, easing off on tokenmaxxing, while promoting the use of AI agent Hatch

Reuters: OpenAI cuts GPT-5.6 Sol's API and credit prices by over 20% for the next three months, to $4/1M input tokens and $20/1M output tokens

Discuss with AI

ChatGPT ↗ Claude ↗

← Back to TechSnif