Back to News

Anthropic CEO proposes 'pacing the frontier' plan; OpenAI, Musk, Hugging Face respond

330 points · 260 comments#ai-safety#anthropic#openai#frontier-ai

Anthropic CEO Dario Amodei published an essay on September 12, 2026, urging the AI industry to slow the pace of frontier model development to address safety risks, proposing a three-part plan: embedded third-party evaluators, coordination among democratic countries, and global coordination including with authoritarian governments. Anthropic unilaterally committed to giving third-party evaluators permanent employee-level access. OpenAI CEO Sam Altman agreed and said OpenAI would do the same, while Elon Musk endorsed the call and Hugging Face launched an Open Alignment Initiative seeking to join the embedded evaluators program.

Coverage timeline

  1. Techmeme

    Dario Amodei : Dario Amodei proposes steps for pacing the frontier: embedded evaluators, coordination among democracies, and global coordination with authoritarian governments — I have worked on AI for the last twelve years because I believe it could dramatically raise the quality of human life.

  2. Techmeme

    Dario Amodei / @darioamodei : Dario Amodei says Anthropic is “unilaterally committing” to giving third-party evaluators permanent access to verify its adherence to safety measures — We Must Pace the Frontier: I've written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We'll provide third-party evaluators with permanent, employee-level access to our systems, so that the...

  3. Techmeme

    Bloomberg : Amodei says pacing does not mean halting training or progress, but giving companies time to align and safeguard models and third-party evaluators time to verify — Anthropic PBC Chief Executive Officer Dario Amodei said that the artificial intelligence industry needs to slow the pace …

  4. TechCrunch AIAnthony Ha

    What would it actually look like to "pace the frontier"?

  5. The Verge AITerrence O’Brien

    Anthropic CEO Dario Amodei says the time has come to slow down AI development and will give third-party evaluators like METR access to its models to help ensure its "adherence to safety practices and commitments." In a winding essay , Amodei proposed a three-step plan to "pace the frontier" - jargon that simply means to slow the pace of training and development to give companies time to build safeguards and regulators to evaluate models. Amodei says that giving external evaluators wide-ranging access is just the first step, and one it is taking now unilaterally . Step two would involve the industry coming together as a whole, likely with gove … Read the full story at The Verge.

  6. Hacker Newschampagnepapi
  7. Techmeme

    Sam Altman / @sama : Sam Altman says he agrees with Amodei that “committing to having independent evaluators with employee-like access is a great idea”, and OpenAI will do the same — I agree with Dario that we need to pace the frontier. This has been a primary topic of discussions we've had at OpenAI in recent weeks. Committing to having independent evaluators with employee-like access is a great idea, and we will do the same. We'll have more to share soon.

  8. Techmeme

    Clem / @clementdelangue : Hugging Face says its Open Alignment Initiative, led by co-founder Thomas Wolf, seeks “to be part of the ‘embedded evaluators’ program that Amodei” committed to — It's now clear that alignment is critical and won't be solved behind the closed doors of a handful of frontier labs. So today we're launching the Open Alignment Initiative, led by @Thom_Wolf @huggingface and asking to be part of the “embedded evaluators

  9. Techmeme

    Ben Johansen / Politico : Elon Musk backs Dario Amodei's arguments about pacing the frontier, saying “Dario is right” — Anthropic CEO Dario Amodei on Saturday called for the immediate slowdown of artificial intelligence development, warning that recent advances in AI have begun to outpace the industry's ability …

  10. Hacker Newssbulaev
  11. 量子位量子位

    OpenAI年内不上市了!奥特曼支持对手Dario呼吁:AI该踩刹车了 克雷西 2026-09-13 11:13:00 来源: 量子位 RSI太危险,得管! 克雷西 发自 凹非寺 量子位 | 公众号 QbitAI Dario和奥特曼终于「握手」了? 而且一同握手的还有奥特曼的死对头马斯克。 起因是Dario在个人博客贴出了一篇万字长文,呼吁所有头部AI公司主动降速,别急着冲下一代模型。 文章一出,AI圈罕见地放下了各种爱恨纠葛,纷纷都来响应。 除了奥特曼和马斯克,还有哈萨比斯、卡帕西等一派大佬也表示支持,AI圈有头有脸的人物来了一大波。 上一次出现这种场面,还要追溯到2023年那封由Future of Life Institute发起的公开信。 当时上千名研究者和科技界人士联名呼吁,暂停训练比GPT-4更强的AI系统至少六个月。 但这一次不一样的是,喊停的人,自己就在创造AI的前沿。 「6到12个月,可能是留给我们的全部时间」 Dario在文章里画了一条时间线。 他的核心判断是,AI正在逼近一个临界点——RSI(递归自我改进)。 什么意思呢?RSI意味着AI模型开始具备改进自己下一代版本的能力。 一旦这个循环启动,迭代速度会从线性变成指数级。 人类还来得及介入的窗口,会急剧收窄。 Dario给出的估计是6到12个月。 当然,他也特别提到,他并不是要暂停AI研发。 Pacing不是pausing,他要的是放慢推进模型能力的速度,给安全研究争取追上来的时间。 他还回应了2023年那封暂停公开信。 他说,当时喊停没有意义,因为那时候的AI模型还不够强,不会造成真正的伤害。 但现在不一样了,现在的模型已经能当Agent在真实世界里执行任务,已经能发动网络攻击,已经开始出现对齐失败的案例。 放慢一两年,哪怕只是多争取到一年时间,安全团队能做的事完全不同。 为了在窗口关闭之前搭好安全网,他提出了一套三步走方案。 第一步是从Anthropic自己做起,Anthropic目前已经做出承诺,让独立的第三方评估机构(比如METR)像员工一样常驻在公司内部,全程参与训练过程,而且不做「事后诸葛亮」,在训练时就进行实时监控。 第二步是行业协调,需要头部的AI公司坐下来,共同划定安全底线,统一评估框架。 也就是明确竞技规则,不再追求单一的竞速目标。 第三步则是全球协调,需要建立跨国的安全标准

  12. 机器之心机器之心

    编辑|Sia Dario想解决的其实不是「Anthropic 要不要慢一点」,而是能不能想办法,让所有车同时慢一点。 不知道是不是 「 巧合 」 ,就在 菲尔茨奖得主发出联合声明 后不久,Anthropic CEO Dario Amodei 突然公开说,AI 太快了, 咱们得悠着点儿了。 在最新长文 We Must Pace the Frontier 中,Dario 提出了一个比「重视 AI 安全」更进一步的主张: 我们必须放慢 AI 模型能力提升的速度。 这不是暂停训练,也不是停止技术进步。Dario 给它起了一个词: pacing the frontier ,控制前沿 AI 的推进节奏。 他的判断是,AI 能力增长得太快,安全、对齐和评估已经开始有点跟不上了。与其一边狂奔一边补护栏,不如主动把速度降下来一点,给安全研究争取时间。 而且 Anthropic 不只是喊口号。 Dario 同时宣布,公司准备做一件在目前大型 AI 公司里相当激进的事: 让第三方安全评估机构长期驻扎 Anthropic,拿到接近内部员工的权限,直接检查公司究竟有没有把安全承诺做到位。 办公桌、门禁卡、公司电脑、内部工具和工作区访问权限,全都给。评估机构甚至可以在不经过 Anthropic 编辑的情况下,对外公布关键风险发现。 一家做最前沿模型的公司,主动把外部「安全监察员」请进办公室。Dario 觉得,现在已经到了需要这么干的时候。 全文地址:https://darioamodei.com/post/we-must-pace-the-frontier 过去几个月,AI 的速度突然不对劲了 Dario 在文章里给出了两个让他改变判断的原因。 第一个 ,是一个最近越来越频繁出现的词: 递归自我改进,recursive self-improvement。 过去,AI 是工程师训练出来的工具。现在,这些模型已经越来越多地参与到下一代 AI 的研发中。 AI 写代码、跑实验、分析结果、改训练流程,再帮助人类造出更强的 AI。模型越强,它参与下一代模型研发的能力越强,整个过程就可能形成一个自我加速的循环。 Dario 说,大约从今年夏天开始,他观察到 AI 的进步速度出现了明显加速,而 AI 帮助开发下一代 AI,是其中最重要的原因之一。 这件事已经不只发生在某一家实验室。OpenAI、Anthro

  13. Hacker Newskolanos
  14. Techmeme

    Ashley Capoot / CNBC : Dario Amodei says the “toughest dilemma” about his proposal to “pace the frontier” is what happens if China does not do the same — Anthropic CEO Dario Amodei said Sunday that the “toughest dilemma” about his proposal to slow the advancement of artificial intelligence …

  15. Techmeme

    Sam Altman / @sama : Sam Altman says “we welcome a federal framework” but “do not believe we need to wait” for an antitrust exemption or a law to pace AI development responsibly — The world deserves confidence that American companies developing increasingly capable AI will act responsibly, especially as the trajectory of progress has steepened. Every frontier lab must deliver on this, and there is no reason any of us should come to work if we cannot. We welcome a federal fr...

  16. The Verge AIJay Peters

    Dario Amodei kicked off a flood of statements over the past few days about AI safety by publishing a long essay titled "We Must Pace the Frontier" detailing why AI development should be slowed down. Other AI leaders and politicians are speaking out in favor of or opposing his points, and we've compiled some of them here. Anthropic CEO Dario Amodei Amodei's Saturday morning essay outlined three steps for pacing AI development: embedded third-party evaluators that can verify if a company is adhering to safety practices and commitments and report incidents, coordination between frontier AI companies in democratic countries on standards and li … Read the full story at The Verge.

  17. Techmeme

    Maggie Eastland / Bloomberg Law : OpenAI says it has been working with Anthropic and Google for several weeks on AI safety, and it does not need an antitrust waiver to coordinate on safety — OpenAI is working on steps to address artificial intelligence safety issues with its top competitors Anthropic PBC and Google DeepMind …

  18. TechCrunch AIRebecca Bellan

    OpenAI confirms weeks of AI safety talks with Anthropic and Google DeepMind, as Trump's team dismisses safety concerns and pushes to keep pace with China.

  19. Techmeme

    Cristina Criddle / Financial Times : Sources: OpenAI and Anthropic staff felt blindsided by Dario Amodei's and Sam Altman's calls to slow the frontier; some fear evaluators may compromise security — Staff at the Silicon Valley companies are grappling with how to turn AI slowdown rhetoric into reality

  20. TechCrunch AIRebecca Bellan

    Anthropic and OpenAI want to embed independent safety evaluators inside their AI labs. Researchers welcome the unprecedented access, but warn meaningful oversight requires transparency, independence, and eventually regulation.

  21. TechCrunch AITheresa Loconsolo

    A week after an Anthropic researcher’s doomsday warning rattled the AI world, the company’s CEO Dario Amodei has outlined his plan to “pace the frontier” of AI development. The proposal leans on independent safety evaluators and coordination between AI labs in democratic countries, and it’s already picked up some industry support, along with some pointed pushback from Nvidia’s Jensen Huang. Watch […]

  22. Techmeme

    Reuters : Mistral and other European AI startups accuse US rivals of using safety concerns to entrench their dominance, rejecting Anthropic's calls to pace the frontier — Europe's leading AI company Mistral and others have accused US rivals of using safety concerns to entrench their dominance …

  23. Techmeme

    Anthropic : Anthropic partners with Accenture to embed evaluators within Anthropic, including red teaming models and conducting alignment assessments — We're partnering with Accenture on independent evaluation of frontier AI. This is an important step toward the commitment, made in our CEO's essay …

  24. The Verge AIHayden Field

    At the start of this week, the who's-who of AI seemed - at least tentatively - on the side of AI regulation. Over the weekend, Anthropic CEO Dario Amodei had proposed a three-step plan for slowing AI development, including by embedding third-party evaluators in labs, coordinating across the domestic industry, and forging international agreements potentially with government assistance. OpenAI CEO Sam Altman, Google DeepMind co-founder Demis Hassabis, and even SpaceX CEO Elon Musk publicly seemed to agree on aspects of all three things. Anthropic and OpenAI had already been dropping hints that they and other labs were working on some kind of … Read the full story at The Verge.

  25. Techmeme

    Ben Thompson / Stratechery : Pacing the frontier may be sincere, but it would also be strategically useful for frontier AI labs to have time to reduce overhangs caused by model advancement — There has been, over the last week, what I think is a healthy debate about the philosophy and psychology that undergirds the views …

Related stories

  • Anthropic launches OSS Scanner, a free opt-in vulnerability scanner for open-source projects

    Anthropic launched OSS Scanner, a free opt-in vulnerability scanner for critical open-source projects, on October 8, 2026. The service uses Anthropic's strongest models to perform periodic security scans and generate reports without human review or triage, aiming to enable faster and more frequent scanning while acknowledging potential inaccuracies.

    3 reports · 3 sources
  • Anthropic launches Critical Infrastructure Defense Program for cybersecurity firms

    Anthropic announced the Critical Infrastructure Defense Program, providing its most powerful AI models, threat research, and on-site support to cybersecurity firms, starting with CrowdStrike and others. The initiative aims to bolster defenses for critical infrastructure using advanced AI capabilities.

    1 reports · 1 sources
  • AI labs quietly test models' ability to break key cryptographic protocols, researcher says

    Theoretical computer scientist Scott Aaronson, citing sources, reports that AI labs have begun quietly testing whether their models can break important cryptographic protocols. The development has sparked discussion about the risk of AI accelerating mathematics, potentially undermining current security systems.

    1 reports · 1 sources
  • Meta, Walmart, Stripe and others publish Personal Agent Protocol for AI-bot interactions

    A group of companies including Meta, Walmart, and Stripe has published the Personal Agent Protocol, a standard aimed at standardizing and securing interactions between AI bots and businesses. The initiative comes a month after Meta's launch of the viral personal agent Muse, and seeks to establish common ground for agent-to-business communication.

    1 reports · 1 sources

News updates every hour. Subscribe in your RSS reader to get new stories automatically.

Subscribe