cvlab-kaist/geometric-action-model — explained in plain English
Analysis updated 2026-07-18 · repo last pushed 2026-07-17
Test a robot arm on everyday tasks like opening drawers in a simulated kitchen.
Evaluate how well a robot follows spoken commands to move objects around.
Benchmark robot manipulation performance using the LIBERO and LIBERO-Plus test suites.
| cvlab-kaist/geometric-action-model | affaan-m/jarvis | 0xabcd01/cve-2026-41089 | |
|---|---|---|---|
| Stars | 158 | 158 | 157 |
| Language | Python | Python | Python |
| Last pushed | 2026-07-17 | — | — |
| Maintenance | Active | — | — |
| Setup difficulty | hard | hard | easy |
| Complexity | 5/5 | 5/5 | 3/5 |
| Audience | researcher | developer | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires multiple GPUs for training and familiarity with robotics benchmarks like LIBERO and CUDA-based environments.
GAM (Geometric Action Model) is a research project that helps robots learn to follow natural language instructions. Instead of training a robot from scratch, it takes a model that already understands 3D geometry and physical space, and adapts it into a single system that handles seeing, predicting, and deciding what to do next. The goal is to make robot training more efficient and accurate. At a high level, the system uses a pretrained "geometric foundation model" as its core engine. This means the model has already learned a general understanding of shapes and spatial relationships. The researchers then fine-tune this model so it can watch a scene, understand a verbal command like "pick up the red mug," predict what should happen next, and output the specific movements the robot arm needs to make. It packages all of this into one shared system rather than separate modules for perception, prediction, and action. This project is built for robotics researchers and engineers working on robotic manipulation tasks. A concrete use case would be a team testing how well a robot arm can perform everyday tasks in a simulated kitchen or workspace, such as opening a drawer or moving objects around based on spoken commands. The repository provides everything needed to run and evaluate this model on standard robotics benchmarks called LIBERO and LIBERO-Plus. What is notable about the project is its performance and efficiency. The released model achieves high success rates on standard benchmarks (97.6% on LIBERO) and processes its decisions quickly, taking under 7 milliseconds per decision. It is also built to scale across multiple graphics cards for training, reflecting a serious research-grade implementation rather than a simple prototype.
GAM helps robots learn to follow spoken instructions by adapting a 3D spatial model into one system that sees, predicts, and decides actions. It achieves high accuracy on standard robotics benchmarks.
Mainly Python. The stack also includes Python, PyTorch, CUDA.
Active — commit in last 30 days (last push 2026-07-17).
No license information is provided in the repository, so usage rights are unclear.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
double-check against the repo, no cap.