Back to News

Microsoft unveils MAI-Base-2 MoE model with 2.8T total parameters

#microsoft#mixture-of-experts#large-language-model#efficiency

Microsoft AI announced MAI-Base-2, a mixture-of-experts model with 2.8 trillion total parameters and 80 billion active parameters. The company claims it achieves 4x-12x greater pretraining FLOPs-efficiency compared to DeepSeek-V4-Pro-Base. This follows the June announcement of MAI-Thinking-1, a reasoning model post-trained on MAI-Base-1.

Coverage timeline

  1. Techmeme
    Microsoft unveils MAI-Base-2, a MoE model with 2.8T total and 80B active parameters, claiming 4x-12x more pretraining FLOPs-efficiency than DeepSeek-V4-Pro-Base (Microsoft AI)

    Microsoft AI : Microsoft unveils MAI-Base-2, a MoE model with 2.8T total and 80B active parameters, claiming 4x-12x more pretraining FLOPs-efficiency than DeepSeek-V4-Pro-Base — In June, we announced MAI-Thinking-1, a general-purpose foundation model post-trained on top of MAI-Base-1 with strong reasoning performance.

Related stories

  • Tsinghua and Qujing Introduce KTransformers-FineTune for CPU-GPU MoE Fine-Tuning

    Tsinghua University's MADSys lab and Qujing Technology, with LlamaFactory, introduced KTransformers-FineTune (KT-FT), a CPU-GPU co-computation method for fine-tuning mixture-of-experts (MoE) models. It claims 2.5-21.2x throughput gains over traditional offloading by having the CPU compute expert weights directly instead of transferring them to the GPU. The approach includes a semantic-aware proactive layout engine and dynamic thread scheduling for routing skew, and is fully open-sourced.

    1 reports · 1 sources

  • Microsoft unveils Decision-1, a fast decision-scoring model trained on Qwen3.5-9B

    Microsoft announced Microsoft-Decision-1, a fast decision-scoring model trained on Qwen3.5-9B, positioning it as a new category distinct from text-generating LLMs. The company said it will soon rebase the model on MAI, OpenAI, and other models.

    1 reports · 1 sources

  • Microsoft launches MAI-Transcribe-2-Streaming and two new voice models

    Microsoft AI announced the launch of MAI-Transcribe-2-Streaming, a low-latency real-time transcription model, alongside two new voice models, MAI-Voice-2.1 and MAI-Voice-2.1-Flash. The models are positioned for accurate, fast, and low-cost audio understanding and generation, targeting conversational voice agents.

    1 reports · 1 sources

  • Microsoft unveils Maia 300 AI chip, claims 40% more tokens per megawatt

    Microsoft announced its third-generation in-house AI chip, the Maia 300, built on TSMC's N2P process node and designed as the primary AI inference system for its products and services. The company expects the chip to deliver 40% more tokens per megawatt compared to leading GPU-based systems, with production rollout starting in 2027. Maia 300 racks will hold 96 chips using about 167 kW, and Microsoft plans multi-gigawatt deployments starting next year.

    3 reports · 2 sources

News updates every hour. Subscribe in your RSS reader to get new stories automatically.

Subscribe