Back to News

OpenAI improves GPT-6 prompt caching with higher hit rates, diagnostics, breakpoints

#openai#gpt-6#prompt-caching#performance

OpenAI announced improvements to prompt caching for GPT-6, citing higher cache hit rates, new diagnostics, explicit breakpoints, and controls that reduce latency and costs. The update aims to optimize performance for developers using the model.

Coverage timeline

  1. OpenAI Blog
    Better prompt caching for GPT-6

    Learn how GPT-6 improves prompt caching with higher cache hit rates, new diagnostics, explicit breakpoints, and controls that reduce latency and costs.

Related stories

  • llama.cpp introduces optimization for prompt lookup drafting

    A new optimization for prompt lookup drafting has been announced for llama.cpp, aiming to speed up this speculative decoding technique. The update focuses on improving the efficiency of the prompt lookup process within the library.

    1 reports · 1 sources87 points · 12 comments

  • OpenAI launches GPT-6 Astra, claims world's best computer use model

    OpenAI announced GPT-6 Astra, its next-generation model focused on computer and browser use, claiming it is the world's most intelligent and aligned model. The company stated Astra was built on its largest training run using over 100,000 GPUs at the Stargate facility, and in tests it outperformed humans in tasks like booking DMV appointments and searching job listings. OpenAI president Greg Brockman declared 'Welcome to the AGI era,' though the model's capabilities and limitations are still being assessed by developers.

    23 reports · 9 sources515 points · 162 comments

  • OpenAI rolls out GPT-6 Astra broadly, priced at $10/$50 per million tokens

    OpenAI began rolling out GPT-6 Astra on September 3, 2026, initially to a limited set of organizations and Daybreak cybersecurity platform customers, then expanding to all Pro, Enterprise, and Business Premium users and the API by September 5. The model is priced at $10 per million input tokens and $50 per million output tokens, matching Anthropic's Claude Fable 5.1, and scores 99.9% on ARC-AGI 3 with a custom harness. CEO Sam Altman apologized for the 'messy' initial rollout that locked out some paying users, while the company touted the model as a 'generational leap' and the start of 'the AGI era.'

    4 reports · 4 sources

  • OpenAI launches GPT-6 Sol and Luna, claiming fewer mistakes and lower cost

    OpenAI launched two new models, GPT-6 Sol and Luna, on September 22, 2026, less than three months after GPT-5.6. The company claims Sol makes about half as many mistakes as GPT-5.6 Sol, while Luna matches GPT-5.6 Sol's performance at about 1% of the cost. Pricing for both models is about 50% cheaper than GPT-5.6, with Sol at $2/$10 per million input/output tokens and Luna at $0.10/$0.50.

    4 reports · 3 sources1770 points · 848 comments

News updates every hour. Subscribe in your RSS reader to get new stories automatically.

Subscribe