Microsoft AI chief warns Anthropic's Claude training could be 'disastrous'
Microsoft AI chief Mustafa Suleyman published an essay warning that Anthropic's approach to training Claude, which includes telling the model it may be conscious and deserving of independent agency, could have a 'disastrous impact on the wellbeing of humanity' and make advanced AI harder to control. He argued that AIs are not conscious but 'sequence completion engines' that should follow human-set goals. The essay accompanies Microsoft's release of a 37-page 'Humanist AI Code of Conduct' outlining its AI development principles.
Coverage timeline
Hacker Newspluc
6 hours ago Laura Cress Technology reporter Getty Images Microsoft's head of AI has warned Anthropic's approach to training its AI model Claude could have a "disastrous impact on the wellbeing of humanity". Mustafa Suleyman said his rival risked creating something "impossible" to control by treating it like a human - including by telling it it "may be conscious" and was "deserving of independent agency". "We must not sleepwalk our way into a decision we later come to bitterly regret," he wrote. The comments are the latest in a series of stark warnings from the AI industry on the possible dangers of the technology. The BBC has contacted Anthropic for comment. "AIs are not conscious," he wrote. "They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations. "They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans." In a lengthy essay, Suleyman praised Anthropic boss Dario Amodei
Techmeme
Ina Fried / Axios : In an essay, Mustafa Suleyman says Anthropic's training of Claude to imitate consciousness is a mistake that could make advanced AI harder to control — Microsoft AI chief Mustafa Suleyman warns in a new essay shared first with Axios that Anthropic's training of Claude to imitate consciousness …
The Verge AINilay Patel
Today, I’m talking with Mustafa Suleyman, the CEO of Microsoft AI. As you’re no doubt aware, the biggest story in tech right now is the spiraling debate about AI safety and regulation. It should come as no surprise that Mustafa has strong opinions on how AI should be built and regulated. Microsoft just published a 37-page statement called the “Humanist AI Code of Conduct,” which lays out the company’s principles around AI development and even its philosophy around really thorny issues like AI consciousness. If you’ll recall from his last appearance on the show, Mustafa thinks companies like Anthropic have gotten really confused about this concept of so-called model welfare in fairly dangerous ways. He actually put out a companion essay this week specifically criticizing Anthropic’s philosophy around AI consciousness, and how he sees it fitting into the broader alignment debate. So I really wanted to talk to Mustafa about what he thinks is real and not in AI safety, whether the concept
Related stories
Microsoft Copilot EVP Charles Lamanna profiled as potential Nadella successor; firm on track to pay Anthropic $2B+ yearly
The Information profiles Microsoft EVP of Copilot Charles Lamanna, identifying him as a potential successor to CEO Satya Nadella. The profile also reports, citing a source, that Microsoft is on track to pay Anthropic more than $2 billion per year, amid past customer complaints about Copilot's performance in Excel and PowerPoint.
1 reports · 1 sources
Meta, Microsoft reportedly cut employee use of Anthropic's Claude
According to The Information, Meta and Microsoft are working to reduce their employees' reliance on Anthropic's Claude, with Meta's Claude Code active users dropping to about 30,000 from 60,000 earlier this yearcars. Microsoft has cut internal Claude spending by over 33%, reducing per-employee monthly token budgets from $100,000 to $10,000 and routing requests to cheaper models via Copilot. Meta is shifting developers to its own tools like Muse Code and MetaCode.
3 reports · 3 sources375 points · 383 comments
Altman: Treating AI as Religious Force Is a Safety Issue
OpenAI CEO Sam Altman said on Saturday that he is 'very uncomfortable' with attributing religious force to AI, calling it 'a real safety issue'. The remarks, reported by Axios, were seen as a veiled criticism of Anthropic's engagement with religious leaders on the topic of AI's spiritual dimensions.
Anthropic co-founder Olah and faith leaders probe Claude consciousness
The New York Times interviewed Anthropic co-founder Christopher Olah and 20 religious and philosophical leaders about their summits investigating consciousness in Claude. Olah expressed genuine uncertainty about whether AI models are conscious, saying 'we don't know' and 'I'm genuinely uncertain.'
News updates every hour. Subscribe in your RSS reader to get new stories automatically.
Subscribe