Prime Intellect launches Prime Inference serving platform for open models
Prime Intellect announced the launch of Prime Inference, a serving platform for frontier open-source models offering resilient serverless and reserved serving across multiple datacenters. The platform's production architecture includes prefill/decode optimization, NVFP4 KV compression, and NIXL transfer, as demonstrated in its GLM-5.3 deployment on GB200 NVL72.
Coverage timeline
Prime Intellect
We're launching Prime Inference: resilient serverless and reserved serving for frontier open-source models across multiple datacenters. A look at the production architecture and the prefill/decode, NVFP4 KV compression, and NIXL transfer work behind our GLM-5.3 deployment on GB200 NVL72.

Prime Intellect
We're launching Prime Inference: resilient serverless and reserved serving for frontier open-source models across multiple datacenters. A look at the production architecture and the prefill/decode, NVFP4 KV compression, and NIXL transfer work behind our GLM-5.3 deployment on GB200 NVL72.

Related stories
Ant Group and vLLM Community Open-Source Humming Kernel Library for Quantized Inference
Ant Group and the vLLM community have open-sourced Humming, a high-performance kernel library for quantized inference. It supports NVIDIA GPUs from Turing onward and CUDA-compatible devices like T-Head's Zhenwu 810E, with a unified architecture for diverse weight and activation formats. Humming reportedly outperforms existing implementations from vLLM Marlin, FlashInfer, and DeepGEMM on many workloads.
1 reports · 1 sources
Prime Intellect releases prime-rl v0.10.0 with IPO loss as default
Prime Intellect released prime-rl v0.10.0 and verifiers v0.4.0. The update introduces the new RL algorithm IPO as the default, designed for async RL stability, along with performance improvements and new model support.
1 reports · 1 sources

NVIDIA launches Nemotron 3.5 Super VL, 120B open model; vLLM adds Day 0 support
NVIDIA has launched Nemotron 3.5 Super VL, a 120B-parameter open model for enterprise agents, claiming it outperforms frontier models on specialized benchmarks. vLLM announced Day 0 support for the model, enabling multimodal agent workflows with image, document, and video understanding, OpenAI-compatible serving, and multi-token prediction.
2 reports · 2 sources
Prime Intellect launches Prime Sandboxes, Linux microVMs for agentic RL training
Prime Intellect announced Prime Sandboxes, fully capable Linux virtual machines built for agentic training, with pricing designed to support thousands of concurrent instances. The offering targets large-scale agentic reinforcement learning workloads.
2 reports · 1 sources

News updates every hour. Subscribe in your RSS reader to get new stories automatically.
Subscribe