Back to News

Essay Claims LLMs Do Not Reason, Ignites Debate

75 points · 159 comments#llm#reasoning#debate#hacker news

An essay arguing that large language models do not actually reason has sparked widespread discussion on Hacker News. The piece challenges the perceived reasoning capabilities of LLMs, prompting a debate among researchers and practitioners about the nature of these models' outputs.

Coverage timeline

  1. Hacker Newsleopoldj

Related stories

  • Ai2 benchmark shows LLM novelty judgments vary with evaluation setup

    The Allen Institute for AI released a benchmark called Old Ideas, Novel Problems to test how reliably LLMs judge research-idea novelty. The findings show that small changes to the evaluation setup can produce very different verdicts on the same ideas.

    1 reports · 1 sources
  • vLLM Tool-Call Accuracy Fix Discussed on Hacker News

    A Hacker News post highlights ongoing work to improve tool-call accuracy in vLLM, an open-source LLM serving engine. The discussion focuses on technical fixes for ensuring reliable tool invocation during inference, a key issue for production deployments.

    1 reports · 1 sources172 points · 73 comments
  • Essay Argues Against Using LLMs for Confidence Scoring

    An essay published on Hacker News argues that using large language models for confidence scoring is a flawed practice, offering a technically substantive critique. The piece contends that LLMs are not well-suited to provide reliable confidence estimates, challenging a common approach in AI systems.

    1 reports · 1 sources223 points · 102 comments
  • Goodfire Researcher Defends Claim LLMs Are Easier to Understand Amid Pushback

    MIT Technology Review interviewed Goodfire researcher Nick Cammarata, whose viral blog post argued that LLMs are easier to understand than previously thought. The interview comes amid pushback from other researchers who dispute his claims, though the article does not detail their specific objections.

    1 reports · 1 sources

News updates every hour. Subscribe in your RSS reader to get new stories automatically.

Subscribe