Back to News

Sleep framework proposed to help LLMs retain knowledge in continual learning

72 points · 4 comments#llm#continual-learning#catastrophic-forgetting#research

A research paper introduces the Sleep framework, a new method designed to help large language models retain knowledge during continual learning. The framework aims to address the challenge of catastrophic forgetting, where models lose previously learned information when trained on new tasks.

Coverage timeline

  1. Hacker Newsacossta
    Sleep framework: A new way for LLMs to retain knowledge in continual learningHN

Related stories

  • UCSB and Microsoft Propose ScholarEvolve for AI Agents to Read Papers and Self-Modify Code

    Researchers from UC Santa Barbara and Microsoft introduced ScholarEvolve, a method that automates the research process of reading literature, implementing algorithms, and evaluating results to enable AI agents to evolve their harness code without modifying underlying model parameters. The approach addresses the limitation of prior coding-agent-based harness optimization, which relied on the agent's existing knowledge and observed failures, by allowing agents to draw on the latest academic findings. The paper and code are publicly available.

    2 reports · 1 sources

  • Apple and Duke propose LensVLM, compressing long context into images with on-demand zoom

    Apple's foundation model team and Duke University introduced LensVLM, a method that compresses long context into images and lets the model zoom into relevant pages on demand. In seven text QA benchmarks, it achieved 68.9% average accuracy with 4.3x effective compression, close to the 72.4% of full-text reference. The work was accepted at NeurIPS 2026, and a public 9B demo is available.

    1 reports · 1 sources

  • Ai2 benchmark shows LLM novelty judgments vary with evaluation setup

    The Allen Institute for AI released a benchmark called Old Ideas, Novel Problems to test how reliably LLMs judge research-idea novelty. The findings show that small changes to the evaluation setup can produce very different verdicts on the same ideas.

    1 reports · 1 sources

  • NV-CoT: Multimodal LLMs Predict Continuous Coordinates for Visual Chain-of-Thought, NeurIPS 2026 Oral

    Researchers from NTU, USTC, NUS, and Microsoft propose NV-CoT (Numerical Visual Chain-of-Thought), a method that lets multimodal LLMs directly predict continuous numerical coordinates for region selection instead of generating bounding boxes as text tokens. The work, accepted as a NeurIPS 2026 Oral (top 0.4%), supports supervised fine-tuning and reinforcement learning, addressing mismatches between token-level training and spatial error.

    1 reports · 1 sources

News updates every hour. Subscribe in your RSS reader to get new stories automatically.

Subscribe