nowfound

AI · October 9, 2026

Long term Memory and 50M token window for LLM

Join the discussion on this paper page

Long term Memory and 50M token window for LLM launched on October 9, 2026 with 6 votes, #702 of 3,446 launches that month and more than 75% of that year's launches.

Visit huggingface.co ↗Alternativestop 20% of October 2026

What it does

A l a r g e l a n g u a g e m o d e l c a n o n l y u s e t h e t e x t t h a t f i t s i n i t s c o n t e x t w i n d o w , a n d i t r e c o m p u t e s i t s i n t e r n a l k e y - v a l u e ( K V ) s t a t e f o r a p r o m p t e v e r y t i m e t h e <!--[-1-- A large language model can only use the text that fits in its context window, and it recomputes its internal key-value (KV) state for a prompt every time the prompt is sent. We test a memory layer, the public package galahad-kv, that saves the KV state of each block of about 16,000 tokens to encrypted local NVMe disk and loads it back later, byte-exact, without recomputing it. We ran it on 50,000,000 tokens of real public text,…from huggingface.co

Does a similar job

all alternatives →
  • Yet another memory system for LLMs2025 · github.com · ▲165

    Built this for my LLM workflows - needed searchable, persistent memory that wouldn't blow up storage costs. I also wanted to use it locally for my research. It's a content-addressed storage system with block-level deduplication (saves 30-40% on typical codebases). I have integrated the CLI tool into most of my workflows in Zed, Claude Code, and Cursor, and I provide the prompt I'm currently using in the repo. The project is in C++ and the build system is rough around the edges but is tested on macOS and Ubuntu 24.04.

  • Llmspeed – feel how fast a local LLM runs before you buy the hardware6d ago · llmspeed.dev · ▲329

    Pick hardware and a model, and feel the real speed of a local LLM before you buy. Simulates tokens/sec and time-to-first-token from verified benchmarks for GPUs, Macs, and more.

  • A local-first memory store for LLM agents (SQLite)Dec 2025 · github.com · ▲48

    Local persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc. - CaviraOSS/LongMemory

  • Long context window for LLMs2024 · colab.research.google.com · ▲6
  • ZL
    Zep – Long-Term Memory Store for LLM Apps2023 · ▲7

    Zep is a long-term memory store designed for conversational AI applications built using modern LLMs. It handles the storage, summarization, embedding, indexing, and enrichment of chat histories, and offers developers a simple, low-latency API to this data. Chat history storage is an infrastructure challenge all developers and enterprises face as they look to move from prototypes to deploying conversational AI applications that provide rich and intimate experiences to users. Key features include long-term memory persistence, auto-summarization, vector search, auto-token counting, and Python…

  • LT
    LLM Token Visualizer – How big is 128k token input2025 · v0-llm-token-visualizer.vercel.app · ▲6

More ai this month

the category →
  • Spira Maxima▲578

    Video model that turns script into viral social media videos

    AI · 18d ago · spira.ai

  • Rill Browser▲540

    The browser where Claude Code and Codex work beside you

    AI · 18d ago · rill.love

  • Germany's new sovereign AI model Kolibri▲424

    Kolibri is Aleph Alpha

    AI · 20d ago · tej.as

  • Giving Opus 5.5 a simulated paint canvas▲392

    Paintings by AI models: programs run through a simulation of oil paint.

    AI · 21d ago · stillwet.art

  • PixVerse R2▲381

    A real-time world model you can explore and change

    AI · 30d ago · world.pixverse.video

  • Beam.win▲378

    Run AI agents on one Mac and use its windows on another

    AI · 4d ago · beam.win

Launched alongside, October 2026

the whole month →