Artificial Analysis Coding Agent Index: Fable 5.1 Leads with 70, GPT-6 Astra Scores 67
Artificial Analysis published a coding agent benchmark index comparing top models. Fable 5.1, running in Claude Code, leads the index with a score of 70, while GPT-6 Astra scored 67, roughly equal to Claude Opus 5, Fable 5, and Muse Spark 1.3. The index notes that various effort levels of the model occupy the Pareto frontier of token efficiency.
Coverage timeline
Techmeme
Artificial Analysis : Artificial Analysis Coding Agent Index: GPT-6 Astra scored 67, roughly equal to Claude Opus 5, Fable 5, and Muse Spark 1.3, but trailing leader Fable 5.1's 70 — Fable 5.1 in Claude Code leads the Index with a score of 70. … Various effort levels of the model occupy the Pareto frontier of token efficiency.
Related stories
Artificial Analysis: Gemini 4 Argon matches GPT-6 Astra on intelligence, cuts hallucination to 15%
Artificial Analysis reported that Google's Gemini 4 Argon (high) matches GPT-6 Astra (max) on its Intelligence Index, with a 15% hallucination rate versus 51% for Astra. The model also costs 60% of Astra's per-task price under discounted pricing.
1 reports · 1 sources
Artificial Analysis ranks Sonnet 5.5 (max) #2 in Intelligence Index, highest token use
Artificial Analysis' Intelligence Index places Sonnet 5.5 (max) above GPT-6 Astra (max) and behind only Opus 5.5 (max), with the highest token use among them. With max effort, Sonnet 5.5 gains 18 points over Sonnet 5, moving to #2 on the index.
Anthropic releases Opus 5.5, claims strongest model tested, 40% cheaper than Opus 5
Anthropic released Opus 5.5 on September 22, 2026, describing it as the strongest-performing model it has tested to date. The company says Opus 5.5 matches Fable 5.1 on most tasks while costing about 40% less to run than Opus 5, with pricing at $4 per million input tokens and $20 per million output tokens.
NeoCognition's ApprenticeBench: Fable 5.1 and GPT-6 Astra beat human testers in simulated accounting
NeoCognition released ApprenticeBench, a benchmark that places AI agents in a simulated construction company to perform real accounting tasks using Odoo. Fable 5.1 and GPT-6 Astra achieved pass rates of 72% and 68%, respectively, surpassing the best human tester's 51%. The benchmark highlights a 72% vs 36% performance gap between Fable 5.1 and Opus 5, despite similar scores on other benchmarks.
1 reports · 1 sources
News updates every hour. Subscribe in your RSS reader to get new stories automatically.
Subscribe