Back to News

Artificial Analysis: Gemini 4 Argon matches GPT-6 Astra on intelligence, cuts hallucination to 15%

#gemini#gpt-6#hallucination#benchmark

Artificial Analysis reported that Google's Gemini 4 Argon (high) matches GPT-6 Astra (max) on its Intelligence Index, with a 15% hallucination rate versus 51% for Astra. The model also costs 60% of Astra's per-task price under discounted pricing.

Coverage timeline

  1. Techmeme
    Artificial Analysis says Gemini 4 Argon (high) matches GPT-6 Astra (max) on its Intelligence Index and has a 15% hallucination rate, compared with 51% for Astra (Artificial Analysis)

    Artificial Analysis : Artificial Analysis says Gemini 4 Argon (high) matches GPT-6 Astra (max) on its Intelligence Index and has a 15% hallucination rate, compared with 51% for Astra — Google's new Gemini 4 Argon equals GPT-6 Astra on the Artificial Analysis Intelligence Index at 60% of the Cost per Task with discounted prices

Related stories

  • SenseTime-led study: GPT-6-Astra scores near-perfect on benchmarks but fails real-robot tasks

    A research report by SenseTime, Daxia Robotics, Ropedia, NTU Singapore, and the University of Tokyo analyzes GPT-6-Astra's embodied intelligence across 12 simulation benchmarks and 8 real-robot platforms. The model achieves near-perfect scores on traditional benchmarks (e.g., 100% on LIBERO-Long++, 99.3% on LIBERO-Pro) but fails on real-robot tasks, such as taking over 4 hours and $55 to place a pen in a holder, and failing 11 insertion attempts. The report concludes GPT-6-Astra has largely crossed the embodied intelligence threshold but remains far from practical deployment.

    1 reports · 1 sources

  • Google DeepMind: Four Gemini 4 Argon agents beat Minecraft unaided in 27 hours

    Google DeepMind reported that four Gemini 4 Argon agents completed Minecraft without any human help in 27 hours and 14 minutes. The agents were placed in a randomly generated world with no assigned roles, strategies, or game-specific tools, and the run cost $1,620 at Argon's planned 2027 price.

    1 reports · 1 sources

  • Google launches Gemini 4 Argon frontier model with API rollout

    Google DeepMind has released Gemini 4 Argon, the first frontier model in the Gemini 4 series, claiming it outperforms rivals like GPT-6 Astra and Claude Opus 5.5 across benchmarks in coding, cybersecurity, science, finance, and law. The model is available globally via the Gemini API, to Google AI Pro subscribers in the Gemini app and AI Mode, and in Antigravity for Ultra users. Launch pricing is $2 per million input tokens and $10 per million output tokens, with a 50% discount until November 30, after which prices double on December 1.

    8 reports · 6 sources1459 points · 1038 comments

  • UniPat AI's PaperBenchX: GPT-6 Astra full reproduction rate only 13.98% on 93 tasks

    UniPat AI's PaperBenchX benchmark evaluated 10 model configurations on 93 real paper replication tasks, finding that the strongest model, GPT-6 Astra, achieved only a 13.98% full reproduction rate. This comes amid debate over AI math benchmarks, with 25 Fields Medalists including Tao and Deng Yu signing an open letter warning that treating math problem-solving as a benchmark is harmful to mathematics and the community.

    1 reports · 1 sources

News updates every hour. Subscribe in your RSS reader to get new stories automatically.

Subscribe