Back to News

Prime Intellect launches Prime Inference serving platform for open models

#prime-intellect#inference#open-models#serving

Prime Intellect announced the launch of Prime Inference, a serving platform for frontier open-source models offering resilient serverless and reserved serving across multiple datacenters. The platform's production architecture includes prefill/decode optimization, NVFP4 KV compression, and NIXL transfer, as demonstrated in its GLM-5.3 deployment on GB200 NVL72.

Coverage timeline

  1. Prime Intellect

    We're launching Prime Inference: resilient serverless and reserved serving for frontier open-source models across multiple datacenters. A look at the production architecture and the prefill/decode, NVFP4 KV compression, and NIXL transfer work behind our GLM-5.3 deployment on GB200 NVL72.

  2. Prime Intellect

    We're launching Prime Inference: resilient serverless and reserved serving for frontier open-source models across multiple datacenters. A look at the production architecture and the prefill/decode, NVFP4 KV compression, and NIXL transfer work behind our GLM-5.3 deployment on GB200 NVL72.

Related stories

  • Ant Group and vLLM Community Open-Source Humming Kernel Library for Quantized Inference

    Ant Group and the vLLM community have open-sourced Humming, a high-performance kernel library for quantized inference. It supports NVIDIA GPUs from Turing onward and CUDA-compatible devices like T-Head's Zhenwu 810E, with a unified architecture for diverse weight and activation formats. Humming reportedly outperforms existing implementations from vLLM Marlin, FlashInfer, and DeepGEMM on many workloads.

    1 reports · 1 sources
  • Prime Intellect releases prime-rl v0.10.0 with IPO loss as default

    Prime Intellect released prime-rl v0.10.0 and verifiers v0.4.0. The update introduces the new RL algorithm IPO as the default, designed for async RL stability, along with performance improvements and new model support.

    1 reports · 1 sources
  • NVIDIA launches Nemotron 3.5 Super VL, 120B open model; vLLM adds Day 0 support

    NVIDIA has launched Nemotron 3.5 Super VL, a 120B-parameter open model for enterprise agents, claiming it outperforms frontier models on specialized benchmarks. vLLM announced Day 0 support for the model, enabling multimodal agent workflows with image, document, and video understanding, OpenAI-compatible serving, and multi-token prediction.

    2 reports · 2 sources
  • Prime Intellect launches Prime Sandboxes, Linux microVMs for agentic RL training

    Prime Intellect announced Prime Sandboxes, fully capable Linux virtual machines built for agentic training, with pricing designed to support thousands of concurrent instances. The offering targets large-scale agentic reinforcement learning workloads.

    2 reports · 1 sources

News updates every hour. Subscribe in your RSS reader to get new stories automatically.

Subscribe