git404hub

what is kveraser fr?

graph-com/kveraser — explained in plain English

Analysis updated 2026-05-18

4PythonAudience · researcherComplexity · 4/5Setup · hard

tl;dr

Research code for an ICML 2026 paper on KVEraser, a learned method for efficiently erasing localized context from a language model's KV cache.

vibe map

mindmap
  root((KVEraser))
    What it does
      Trains a KV cache eraser
      Evaluates against recompute baseline
      Accompanies ICML 2026 paper
    Tech stack
      Python
      PyTorch
      Weights and Biases
    Use cases
      Reproduce the KVEraser paper results
      Study localized context erasing
      Compare against exact recompute baseline
    Audience
      ML researchers
      LLM systems researchers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Reproduce the training and evaluation results from the KVEraser ICML 2026 paper.

VIBE 2

Compare a learned KV cache erasing method against an exact recompute baseline.

VIBE 3

Study techniques for efficiently forgetting or updating localized context in a language model.

VIBE 4

Use the training script as a starting point for related KV cache research on Qwen models.

what's the stack?

PythonPyTorchWeights and BiasesQwen3

how it stacks up fr

graph-com/kveraser1038lab/agnes-ai3eyedtiger/video2vrcemote
Stars444
LanguagePythonPythonPython
Setup difficultyhardeasyeasy
Complexity4/52/51/5
Audienceresearchervibe codervibe coder

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1h+

Requires a GPU, a conda Python 3.11 environment, and a Weights and Biases account for logging, the README gives commands only, no conceptual explanation.

in plain english

KVEraser is the code release accompanying a research paper titled "KVEraser: Learning to Steer KV Cache for Efficient Localized Context Erasing," which the README says was an oral presentation at the ICML 2026 MemFM workshop. Large language models often keep a running memory of everything they have read so far, called a KV cache, so they do not have to reprocess earlier text from scratch each time they generate a new word. The paper's title suggests KVEraser is a learned method for selectively removing, or erasing, specific parts of that memory efficiently, rather than having to recompute the whole cache when some context needs to be forgotten or replaced, though the README itself does not explain the method in plain language and points readers to the paper on arXiv for the technical details. The README is mostly a set of setup and command-line instructions rather than a walkthrough of how the tool works or why someone would use it. Setup involves creating a Python 3.11 environment with conda, activating it, and installing dependencies from a requirements file, then logging into Weights and Biases for experiment tracking. Training is run through a train.py script that in the example command targets the Qwen3-8B language model and saves checkpoints to a specified output directory while logging to a named Weights and Biases project. Two evaluation scripts are also included. One, evaluate_kveraser.py, runs the KVEraser method itself against a trained checkpoint on a specified model. The other, evaluate_recompute.py, runs what the README calls an exact recompute baseline, presumably a comparison method that recomputes context exactly rather than using the learned erasing approach, to serve as a point of comparison in the paper's experiments. Both examples in the README are configured to run on a single GPU. The repository includes a formal citation entry for the associated paper, authored by Mufei Li, Shikun Liu, Dongqi Fu, Haoyu Wang, Yinglong Xia, Hong Li, Hong Yan, and Pan Li, published as a 2026 arXiv preprint. No license file or license section is mentioned in the README.

prompts (copy fr)

prompt 1
Help me set up the conda environment and install requirements for KVEraser.
prompt 2
Explain what KV cache erasing means and how it differs from the exact recompute baseline in this repo.
prompt 3
Walk me through running the training script on a Qwen3-8B model with Weights and Biases logging.
prompt 4
Show me how evaluate_kveraser.py and evaluate_recompute.py differ in what they measure.

Frequently asked questions

what is kveraser fr?

Research code for an ICML 2026 paper on KVEraser, a learned method for efficiently erasing localized context from a language model's KV cache.

What language is kveraser written in?

Mainly Python. The stack also includes Python, PyTorch, Weights and Biases.

How hard is kveraser to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is kveraser for?

Mainly researcher.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.