Mercury 2.5 LLM reported at 770 tokens/s, benchmarked by Artificial Analysis

Related stories

• Inception launches Mercury 3, diffusion LLM claiming ~1,000 tokens/sec

  Inception has launched Mercury 3, a diffusion-based large language model that the company claims is comparable to Luna and Haiku models while being 4x to 8x faster, generating approximately 1,000 tokens per second. The announcement was reported by Techmeme and Hacker News on October 19-20, 2026.

  2 reports · 2 sources256 points · 92 comments3 weeks ago

• Qwen 3.8 Flash Next (125B) Runs on RTX 4090 at 100 Tokens/s

  A Hacker News post reports running Qwen 3.8 Flash Next, a 125B-parameter model, on consumer hardware (an RTX 4090) at 100 tokens per second. The post appears to be a hands-on engineering write-up, though details of the optimization techniques are not provided in the source.

  1 reports · 1 sources923 points · 421 commentslast month

• vLLM Optimizes Agentic Serving, Claims 130K Tokens/GPU-s and Cost Edge Over Opus 5

  A vLLM blog post details optimizations for agentic serving, including KV cache management, parallelism, scheduling, and P/D disaggregation. Benchmarked on SemiAnalysis AgentX, the optimizations achieve up to 130K tokens per GPU-second and a 14.6x-106x serving-cost advantage over Opus 5.

  1 reports · 1 sources2 months ago

• Average LLM Token Cost Drops to 97 Cents, Down From May High of $2.07

  A closely watched index of AI token prices fell to a fresh low this week, with the average cost per million tokens now at 97 cents. This continues a sharp months-long decline from a peak of $2.07 in late May, reflecting deflating prices in the AI sector.

  1 reports · 1 sources2 months ago