Average LLM Token Cost Drops to 97 Cents, Down From May High of $2.07
A closely watched index of AI token prices fell to a fresh low this week, with the average cost per million tokens now at 97 cents. This continues a sharp months-long decline from a peak of $2.07 in late May, reflecting deflating prices in the AI sector.
Coverage timeline
Techmeme
Alex Harring / CNBC : LLM Token Expenditure Index: average cost per million tokens has fallen to 97 cents, part of a sharp months-long decline since hitting a high of $2.07 on May 28 — A closely followed measure of artificial intelligence token prices touched fresh lows this week, the latest sign of deflating prices …
Related stories
Mercury 2.5 LLM reported at 770 tokens/s, benchmarked by Artificial Analysis
According to a report on Hacker News dated September 23, 2026, the Mercury 2.5 LLM achieves a speed of 770 tokens per second. The performance figures come from Artificial Analysis, which also maintains an Intelligence Index (v4.3.2) incorporating ten evaluations, though the specific benchmark scores for Mercury 2.5 are not detailed in the source.
1 reports · 1 sources150 points · 92 comments
Hugo Vergnes trains 3.8B LLM to 0.384 CORE for $998
Hugo Vergnes reports training a 3.8-billion-parameter language model to a 0.384 CORE benchmark score for $998. The post details the cost breakdown and the techniques used to achieve this efficiency.
1 reports · 1 sources118 points · 21 comments
Tiny LLM Hits 21,000 Tokens/s on $250 FPGA in Live Demo
A Hacker News post showcases a live demo of a tiny language model running at 21,000 tokens per second on a $250 FPGA. The demonstration highlights the potential for low-cost, high-speed inference on edge hardware.
1 reports · 1 sources79 points · 30 comments
LLM 0.32 released with reasoning traces, OpenAI Responses, content-addressable logs
Simon Willison released LLM 0.32, a major update to his command-line tool for interacting with large language models. The release adds support for visible reasoning traces, server-side provider tools, and a redesigned content-addressable SQLite log system that de-duplicates stored messages. It also introduces new default models and features enabled by the OpenAI Responses API, alongside an updated llm-anthropic plugin.
4 reports · 1 sources
News updates every hour. Subscribe in your RSS reader to get new stories automatically.
Subscribe