Back to News

Essay Argues Against Using LLMs for Confidence Scoring

116 points · 61 comments#llm#confidence-scoring#critique#ai-systems

An essay published on Hacker News argues that using large language models for confidence scoring is a flawed practice, offering a technically substantive critique. The piece contends that LLMs are not well-suited to provide reliable confidence estimates, challenging a common approach in AI systems.

Coverage timeline

  1. Hacker Newsjimauthors

Related stories

  • Essay Claims LLMs Do Not Reason, Ignites Debate

    An essay arguing that large language models do not actually reason has sparked widespread discussion on Hacker News. The piece challenges the perceived reasoning capabilities of LLMs, prompting a debate among researchers and practitioners about the nature of these models' outputs.

    1 reports · 1 sources75 points · 159 comments
  • Goodfire Researcher Defends Claim LLMs Are Easier to Understand Amid Pushback

    MIT Technology Review interviewed Goodfire researcher Nick Cammarata, whose viral blog post argued that LLMs are easier to understand than previously thought. The interview comes amid pushback from other researchers who dispute his claims, though the article does not detail their specific objections.

    1 reports · 1 sources

News updates every hour. Subscribe in your RSS reader to get new stories automatically.

Subscribe