Microsoft unveils Maia 300 AI chip, claims 40% more tokens per megawatt
Microsoft announced its third-generation in-house AI chip, the Maia 300, built on TSMC's N2P process node and designed as the primary AI inference system for its products and services. The company expects the chip to deliver 40% more tokens per megawatt compared to leading GPU-based systems, with production rollout starting in 2027. Maia 300 racks will hold 96 chips using about 167 kW, and Microsoft plans multi-gigawatt deployments starting next year.
Coverage timeline
The Verge AITom Warren
Microsoft’s Maia 300 chip. | Image: Microsoft Microsoft is announcing its third-generation Maia in-house AI chip today, designed to be the "primary AI inference system" for Microsoft's products and services. Maia 300 not only improves the cost and efficiency of running AI workloads in the cloud, it's also more capable of handling the latest reasoning models and agentic tasks. Maia 300 will start being rolled out to production in 2027, and it has been designed with efficiency in mind. "We expect Maia 300 to deliver 40 percent more tokens per megawatt compared to leading GPU-based systems," says Scott Guthrie, executive vice president of Microsoft's cloud group. "And in a full 96-acceler … Read the full story at The Verge.
Techmeme
Tom Warren / The Verge : Microsoft unveils its third-gen in-house AI chip, the Maia 300, built on TSMC's N2P process node and aimed at serving as its “primary AI inference system” — The new Maia 300 chip will start rolling out to production AI workloads in 2027.
Reuters : Microsoft says Maia 300 racks will hold 96 chips and use ~167 kW of power and plans to roll out “multi-gigawatt deployments” of the chip starting next year — Microsoft (MSFT.O) announced the next generation of its custom AI chip on Monday and said it plans to deploy potentially …
