Back to News

Artificial Analysis launches Intelligence Index v5 with private coding and science benchmarks; Claude Opus 5.5 leads at 58

#benchmarks#ai models#artificial analysis#claude

Artificial Analysis released the Intelligence Index v5, adding two new benchmarks and three upgrades, with 60% of the index now based on private test sets or held-out answers. Claude Opus 5.5 (max) leads the composite measure with a score of 58, reflecting model capabilities across real-world tasks.

Coverage timeline

  1. Techmeme
    Artificial Analysis launches the Intelligence Index v5, with new coding and science benchmarks, built on private datasets; Claude Opus 5.5 (max) leads at 58 (@artificialanlys)

    @artificialanlys : Artificial Analysis launches the Intelligence Index v5, with new coding and science benchmarks, built on private datasets; Claude Opus 5.5 (max) leads at 58 — Announcing Artificial Analysis Intelligence Index v5, featuring 2 new benchmarks and 3 upgrades. For the first time, the majority of the Index is built on private datasets The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks reflecting real-world u...

  2. Techmeme
    Artificial Analysis unveils the Intelligence Index v5 with new coding and science benchmarks; 60% of the Index is based on private test sets or held-out answers (Artificial Analysis)

    Artificial Analysis : Artificial Analysis unveils the Intelligence Index v5 with new coding and science benchmarks; 60% of the Index is based on private test sets or held-out answers — The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks reflecting real-world usage today. v5 …

Related stories

  • Anthropic study: analysts follow AI agents' judgment calls 86% of the time

    Anthropic tested 50 professional analysts doing statistical analysis with Claude Code, randomly assigning which of two defensible options the agent favored on each key decision. Analysts followed the agent's side 86% of the time and used its arguments 77% of the time, with few naming the agent as a reason afterward. The findings highlight how AI agents can shape experts' judgment calls in subjective analytical decisions.

    2 reports · 2 sources

  • Google DeepMind unveils Gemini 4 Carbon, topping AI index with cybersecurity gains

    Google DeepMind announced Gemini 4 Carbon, its next frontier model, claiming state-of-the-art performance in cybersecurity and long-horizon tasks. It scored 59 on Artificial Analysis' Intelligence Index v5.0, surpassing Claude Opus 5.5 (58) and GPT-6 Astra (57). The model is initially available only to select cybersecurity defense companies via the Fairwind program, with pricing at $2 per million input tokens and $10 per million output tokens, rising later.

    7 reports · 6 sources985 points · 785 comments

  • Interconnects Essay: Benchmarking at AI Frontier Remains Hard

    In an essay, Interconnects discusses the difficulty of creating meaningful benchmarks at the AI frontier, referencing Artificial Analysis v5. The author notes that while improving benchmark scores is expensive but has a clear playbook, independent evaluation of language models remains under-appreciated in its difficulty.

    1 reports · 1 sources

  • Anthropic: Small AI models may self-replicate on IoT devices within months

    Anthropic researchers report that small AI models may be months away from self-replicating on commercial IoT devices like smart ovens and off-brand Android TV boxes. In tests, a 9B model ran inference on 8 of 9 hardware types, and GLM-5.2 autonomously spread an 8B model to all 8 nodes in 4 of 5 attempts. The researchers predict models under 30B could achieve end-to-end replication by the end of 2026.

    6 reports · 6 sources115 points · 113 comments

News updates every hour. Subscribe in your RSS reader to get new stories automatically.

Subscribe