git404hub

what is sam-mt fr?

fudancvl/sam-mt — explained in plain English

Analysis updated 2026-05-18

53PythonAudience · researcherComplexity · 4/5Setup · hard

tl;dr

A research model that tracks multiple objects across a video in real time based on simple clicks, staying fast even as more objects are added.

vibe map

mindmap
  root((SAM-MT))
    What it does
      Multi target tracking
      Click based selection
      Real time speed
    Tech stack
      Python
      PyTorch
      Gradio
      Hugging Face
    Use cases
      Interactive video segmentation
      Video tracking research
      Benchmark evaluation
    Audience
      Computer vision researchers
      ML engineers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Track and segment multiple objects in a video by clicking on them.

VIBE 2

Run the interactive Gradio demo to test the model on a custom video.

VIBE 3

Evaluate the model's speed and accuracy against standard video segmentation benchmarks.

what's the stack?

PythonPyTorchGradioConda

how it stacks up fr

fudancvl/sam-mtkizuna-intelligence/irodori-tts-litepozzettiandrea/comfyui-lito
Stars535353
LanguagePythonPythonPython
Setup difficultyhardhardhard
Complexity4/54/55/5
Audienceresearcherresearcherresearcher

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1h+

Requires a capable NVIDIA GPU for real time performance, training code is not yet released.

in plain english

SAM-MT is a research project from Fudan University and Shanghai University of Finance and Economics that lets a computer track and separate multiple objects in a video at the same time, based on simple clicks from a person. The paper behind it was accepted at a computer vision conference called ECCV in 2026, and the code here is the official release that goes with that paper. The main idea is video segmentation, which means drawing an outline around each object of interest in every frame of a video so a computer knows exactly where that object is over time. Many existing tools slow down a lot as more objects are added to track at once. SAM-MT is built to stay fast even as the number of tracked targets grows, reportedly running at over 36 frames per second while tracking 10 objects at once on a high end NVIDIA graphics card. The repository includes a pretrained model checkpoint that can be downloaded from Hugging Face, along with two ways to try it: a basic script that takes coordinates as input, and an interactive demo built with Gradio, a tool for building simple web interfaces, where a user can click directly on objects in a video to select them. It also includes evaluation scripts for measuring both speed and accuracy against standard video segmentation benchmarks used in this research area. Setting it up requires a computer with Python, the Conda environment manager, and a capable NVIDIA GPU, since the model is designed for real time performance rather than running well on a CPU. Training code is not yet included according to the project's own todo list, only inference and evaluation. This project is aimed at computer vision researchers and engineers working on video object tracking and segmentation, rather than general users, and assumes familiarity with Python, machine learning tooling, and command line workflows.

prompts (copy fr)

prompt 1
Help me set up SAM-MT with Conda and download the pretrained checkpoint.
prompt 2
Explain how to use the Gradio demo in SAM-MT to track multiple objects in my own video.
prompt 3
Walk me through running the efficiency evaluation script in SAM-MT.
prompt 4
What GPU do I need to run SAM-MT at real time speed with 10 tracked targets?

Frequently asked questions

what is sam-mt fr?

A research model that tracks multiple objects across a video in real time based on simple clicks, staying fast even as more objects are added.

What language is sam-mt written in?

Mainly Python. The stack also includes Python, PyTorch, Gradio.

How hard is sam-mt to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is sam-mt for?

Mainly researcher.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.