git404hub

what is nvidia-vram-research fr?

lmganon16/nvidia-vram-research — explained in plain English

Analysis updated 2026-05-18

2PythonAudience · developerComplexity · 5/5Setup · hard

tl;dr

A research writeup documenting how to reclaim reserved VRAM on NVIDIA GPUs by tweaking driver settings, aimed at freeing memory for AI workloads at real crash risk.

vibe map

mindmap
  root((repo))
    What it does
      VRAM reservation research
      Driver tweaks not code
      Frees memory for AI
    Tech stack
      NVIDIA proprietary driver
      Linux kernel modules
      CUDA
    Use cases
      Free VRAM for llama.cpp
      Study driver internals
      Tune single specific GPU
    Audience
      Advanced Linux users
      AI hobbyists

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Free up reserved VRAM on an RTX 3060 to run larger CUDA or llama.cpp workloads.

VIBE 2

Study how NVIDIA's proprietary driver internally allocates and reserves framebuffer memory.

VIBE 3

Test driver registry settings that move memory reservations into system RAM instead of the GPU.

what's the stack?

LinuxNVIDIA driverCUDAKernel modules

how it stacks up fr

lmganon16/nvidia-vram-research0-bingwu-0/live-interpreter010zx00x1/faresnipe
Stars222
LanguagePythonPythonPython
Setup difficultyhardmoderateeasy
Complexity5/52/52/5
Audiencedevelopergeneralgeneral

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1day+

Only tested on one RTX 3060 configuration, changes can crash or hard-lock the system on other hardware.

in plain english

This repository documents an experiment in reclaiming video memory that NVIDIA's proprietary Linux driver normally reserves for itself and does not report as used. It is aimed at people who want more usable VRAM on their graphics card, mainly for AI workloads like running large language models with llama.cpp, and it is explicit about being risky: the README itself warns of possible hard locks, crashes, or a dead GPU, and says testing has only been done on an RTX 3060 with software rendered X11. The core finding is that a stock driver on a GeForce RTX 3060 reserved about 133 MiB of framebuffer memory that tools like nvidia-smi do not count as used. Through reverse engineering, the author broke that reservation down into several categories: memory that is genuinely required, memory that could be moved into regular system RAM instead of the graphics card, conservative safety margins for situations that might not occur, and old allowances inherited from earlier NVIDIA hardware. By adjusting driver settings step by step, the project brought the reservation down to about 30.5 MiB, recovering roughly 102.5 MiB, while keeping CUDA workloads and llama.cpp working correctly. Three techniques are offered, roughly in order of increasing risk. The lowest risk is disabling GSP firmware, which NVIDIA itself documents, and can free up to 300 MiB. A medium risk option offloads part of the reserved memory into system RAM using a driver registry setting, freeing about 50 MiB. The highest risk path involves directly patching the proprietary kernel module, which can free 50 MiB or more but has no automatic scripts yet and requires a lot of manual testing. The repository is really a research writeup rather than a ready-to-run tool. It documents step by step configuration changes, a table of tested stable settings for one specific GPU and driver version, and warns that "stable" only refers to the exact hardware, driver, and workload tested, not to any other setup. Applying these changes on a different GPU or driver build is explicitly said to carry risk with no guarantee of safety.

prompts (copy fr)

prompt 1
Explain what disabling GSP firmware does on an NVIDIA GPU and how much VRAM this repo says it frees.
prompt 2
Walk me through the RMInstLoc2 registry setting this repo uses and what risk it carries.
prompt 3
Summarize the optimization progression table in this repo from stock driver to 30.5 MiB reserved.

Frequently asked questions

what is nvidia-vram-research fr?

A research writeup documenting how to reclaim reserved VRAM on NVIDIA GPUs by tweaking driver settings, aimed at freeing memory for AI workloads at real crash risk.

What language is nvidia-vram-research written in?

Mainly Python. The stack also includes Linux, NVIDIA driver, CUDA.

How hard is nvidia-vram-research to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is nvidia-vram-research for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.