Ai2 releases Olmo-core 3, open training stack for trillion-parameter MoE models
Ai2 has released Olmo-core 3, a redesigned, fully open training stack for efficiently scaling mixture-of-experts (MoE) models into the trillion-parameter range. The announcement was republished by the Hugging Face Blog.
Coverage timeline
Hugging Face Blog
Ai2 (Allen Institute for AI)
Olmo-core 3 introduces a redesigned, fully open training stack for efficiently scaling mixture-of-experts models into the trillion-parameter range.

Related stories
Liquid AI Unveils LFM3 Open-Weight Model Family Across Modalities
Liquid AI announced LFM3, a new open-weight model family with 2B-class variants for text, vision, audio, omni, and decision tasks. The models are designed for fine-tuning and fast on-device inference across various devices.
1 reports · 1 sources171 points · 67 comments

Hugging Face Details 2.8T-Token Indic Pretraining with Open Data Pipeline
Hugging Face has published details of a large-scale Indic pretraining effort involving 2.8 trillion tokens, alongside an open data generation pipeline. The initiative aims to improve language model performance for Indian languages by providing transparent, reproducible data creation methods.
1 reports · 1 sources
Ai2 details GPU scheduler using time budgets and fair-share allocation
Ai2 published a blog post explaining its new GPU scheduler design, which uses time budgets, fair-share allocation, and time-slicing to prioritize high-impact research. The scheduler aims to shorten queue waits and keep GPUs busy. Hugging Face also posted on the same topic, highlighting impactful scheduling strategies for GPU clusters.
2 reports · 2 sources

Ai2 publishes byte-level LM technique in Nature, shows generalization beyond Olmo
The Allen Institute for AI (Ai2) has published in the journal Nature the technique behind its fully open byte-level language models, Bolmo. New checkpoints demonstrate that the approach generalizes beyond the Olmo model family to other model architectures.
1 reports · 1 sources

News updates every hour. Subscribe in your RSS reader to get new stories automatically.
Subscribe