Show notes
Send us Fan Mail In this episode, we break down GradMem, a new approach to memory in large language models: https://arxiv.org/pdf/2603.13875v1 Instead of relying on the transformer KV cache or repeatedly reprocessing documents (like in RAG), GradMem introduces a different idea—learn a compact memory representation at inference time. Using a few steps of gradient descent, the model “writes” important information from a context into a small set of memory tokens, allowing it to answer future ...

