netflix/void-model — explained in plain English
Analysis updated 2026-07-23 · repo last pushed 2026-06-20
Remove a boom mic or unwanted object that drifted into a video frame.
Erase a person holding a product so the product appears to sit on a surface by itself.
Clean up footage where removing an object should cause realistic physics like items falling or settling.
Generate training data using Blender physics simulations to train custom video inpainting models.
| netflix/void-model | nvlabs/protomotions | tencent-hunyuan/hy-world-2.0 | |
|---|---|---|---|
| Stars | 1,944 | 1,945 | 1,911 |
| Language | Python | Python | Python |
| Last pushed | 2026-06-20 | 2026-07-04 | — |
| Maintenance | Maintained | Active | — |
| Setup difficulty | hard | hard | hard |
| Complexity | 4/5 | 5/5 | 5/5 |
| Audience | developer | researcher | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires a high-end GPU with 40GB+ VRAM for inference, though a Google Colab notebook is provided as the easiest way to try it.
Netflix's VOID project removes objects from videos and handles the physical consequences of their disappearance. If you erase a person holding a guitar, the tool doesn't just leave a floating guitar, it makes the guitar fall naturally to the ground. How it works: the pipeline first identifies what to remove and what parts of the scene were physically affected by that object. It uses a combination of segmentation models and a vision-language model to reason about interactions (like "if the person disappears, the cup they were holding will drop"). Then it generates the final video using a two-pass system: the first pass fills in the background where the object used to be, and an optional second pass smooths out flickering across frames for better temporal consistency. Who would use this: video editors, VFX artists, or content creators who need to remove unwanted elements from footage. A filmmaker might use it to erase a boom mic that drifted into frame, or a product demo team could remove a person holding an item so the item appears to sit on a surface on its own. The tool is especially suited for cases where removing an object should trigger realistic physics, things tipping over, falling, or settling into place. Notable choices: the project builds on an existing video-generation model (CogVideoX) and fine-tunes it specifically for this inpainting task. The training data is generated synthetically using Blender physics simulations and the Kubric framework, creating paired videos (with and without the object) plus masks. Rather than releasing the training datasets, the authors release the code to generate them, citing licensing constraints. Running inference requires a high-end GPU (40GB+ VRAM), and the easiest way to try it is through the provided Google Colab notebook.
A video editing tool from Netflix that removes objects from video footage and automatically generates realistic physical consequences, like making a held object fall to the ground when the person holding it is erased.
Mainly Python. The stack also includes Python, CogVideoX, Blender.
Maintained — commit in last 6 months (last push 2026-06-20).
No license information was provided in the explanation, so the terms of use are unknown.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly developer.
This repo across BitVibe Labs
double-check against the repo, no cap.