Goodfire Researcher Defends Claim LLMs Are Easier to Understand Amid Pushback
MIT Technology Review interviewed Goodfire researcher Nick Cammarata, whose viral blog post argued that LLMs are easier to understand than previously thought. The interview comes amid pushback from other researchers who dispute his claims, though the article does not detail their specific objections.
Coverage timeline
Techmeme
Will Douglas Heaven / MIT Technology Review : An interview with Goodfire researcher Nick Cammarata, whose viral blog post claimed LLMs are easier to understand than thought, as other researchers push back — “I think I have good news about the nature of neural networks.” With those simple words of optimism, Nick Cammarata …

Related stories
Goodfire researcher argues neural networks are largely interpretable, most neurons understandable
Nick Cammarata of Goodfire published an essay arguing that neural networks are far more interpretable than previously believed, with most neurons in models up to trillions of parameters understandable. He attributes polysemanticity in early models to fixable issues rather than superposition, and suggests mechanistic interpretability may be solved soon.
3 reports · 3 sources
.png)
Essay Claims LLMs Do Not Reason, Ignites Debate
An essay arguing that large language models do not actually reason has sparked widespread discussion on Hacker News. The piece challenges the perceived reasoning capabilities of LLMs, prompting a debate among researchers and practitioners about the nature of these models' outputs.
1 reports · 1 sources75 points · 159 comments
Ex-DeepMind Scientist David Silver Discusses RL-Based 'Super Learner' Startup
In a Financial Times interview, former DeepMind scientist David Silver discussed his startup Ineffable, which is developing an AI 'super learner' using reinforcement learning as an alternative path to large language models. Silver, known for architecting AlphaGo, also expressed a moral obligation to advance the technology.
1 reports · 1 sources
Google DeepMind alumni launch startups exploring alternatives to LLMs
Bloomberg reports that a wave of Google DeepMind researchers have recently left to launch AI startups focused on alternatives to large language models. The report highlights a London breakfast attended by 15 current and former DeepMind employees where the topic was discussed.
1 reports · 1 sources
News updates every hour. Subscribe in your RSS reader to get new stories automatically.
Subscribe