Back to News

Ai2 benchmark shows LLM novelty judgments vary with evaluation setup

#ai2#benchmark#llm evaluation#novelty

The Allen Institute for AI released a benchmark called Old Ideas, Novel Problems to test how reliably LLMs judge research-idea novelty. The findings show that small changes to the evaluation setup can produce very different verdicts on the same ideas.

Coverage timeline

  1. Ai2 (Allen Institute for AI)
    Can we trust LLMs to judge whether a research idea is novel?

    Old Ideas, Novel Problems tests how reliably LLMs judge the novelty of research ideas, finding that small changes to the evaluation setup can produce very different verdicts.

Related stories

  • Fudan, Tencent Hunyuan, Tsinghua Release ExplorationBench to Test AI Rule Discovery

    Fudan University, Tencent Hunyuan, and Tsinghua University released ExplorationBench, a benchmark measuring how AI systems discover rules in unfamiliar environments. It includes two altered 'alien worlds'—the programming language AlienCode and the logic proof system AlienLogic—where models must learn rules through trial and error. Results showed that without environment feedback, scores remained low (max 11.0%), while autonomous exploration led to high scores (up to 89.0%).

    2 reports · 1 sources

  • Essay Argues Against Using LLMs for Confidence Scoring

    An essay published on Hacker News argues that using large language models for confidence scoring is a flawed practice, offering a technically substantive critique. The piece contends that LLMs are not well-suited to provide reliable confidence estimates, challenging a common approach in AI systems.

    1 reports · 1 sources223 points · 102 comments

  • Essay Claims LLMs Do Not Reason, Ignites Debate

    An essay arguing that large language models do not actually reason has sparked widespread discussion on Hacker News. The piece challenges the perceived reasoning capabilities of LLMs, prompting a debate among researchers and practitioners about the nature of these models' outputs.

    1 reports · 1 sources75 points · 159 comments

  • UCSB and Microsoft Propose ScholarEvolve for AI Agents to Read Papers and Self-Modify Code

    Researchers from UC Santa Barbara and Microsoft introduced ScholarEvolve, a method that automates the research process of reading literature, implementing algorithms, and evaluating results to enable AI agents to evolve their harness code without modifying underlying model parameters. The approach addresses the limitation of prior coding-agent-based harness optimization, which relied on the agent's existing knowledge and observed failures, by allowing agents to draw on the latest academic findings. The paper and code are publicly available.

    2 reports · 1 sources

News updates every hour. Subscribe in your RSS reader to get new stories automatically.

Subscribe