Back to News

Ai2 releases Olmo-core 3, open training stack for trillion-parameter MoE models

#ai2#olmo-core#mixture-of-experts#training-infrastructure

Ai2 has released Olmo-core 3, a redesigned, fully open training stack for efficiently scaling mixture-of-experts (MoE) models into the trillion-parameter range. The announcement was republished by the Hugging Face Blog.

Coverage timeline

  1. Hugging Face Blog
    Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs
  2. Ai2 (Allen Institute for AI)
    Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs

    Olmo-core 3 introduces a redesigned, fully open training stack for efficiently scaling mixture-of-experts models into the trillion-parameter range.