pku-sec-lab/jetson-pi-edge — explained in plain English
Analysis updated 2026-05-18
Run PI0 or PI0.5 vision-language-action models directly on a robot's onboard hardware in real time.
Serve robot control inference through a persistent local HTTP server for a control loop.
Reproduce or extend the research described in the accompanying Jetson-PI arXiv paper.
Integrate the same model runtime into another Python framework through the FlashRT provider.
| pku-sec-lab/jetson-pi-edge | adobe-creative/cs6-extended | amitrajput-dev/sonybridge | |
|---|---|---|---|
| Stars | 16 | 16 | 16 |
| Language | C++ | C++ | C++ |
| Setup difficulty | hard | moderate | moderate |
| Complexity | 5/5 | 2/5 | 3/5 |
| Audience | researcher | general | general |
Figures from each repo's GitHub metadata at analysis time.
Requires converting PI0 or PI0.5 model checkpoints into GGUF format and, ideally, NVIDIA Jetson or CUDA-capable hardware.
Jetson-PI-Edge is an inference engine that lets robots run vision-language-action AI models directly on their own onboard hardware, such as NVIDIA Jetson devices, rather than sending data to a distant server. Vision-language-action, or VLA, models are a type of AI that looks at camera images and a written instruction, then decides what physical action a robot should take next. The project comes from a research paper about making these models run fast enough, in real time, on low power hardware where every millisecond of delay affects how quickly a robot can react. The engine is built on top of llama.cpp, an existing project for running AI models efficiently, and adds support for a specific family of robotics models called PI0 and PI0.5. It can automatically detect which of these two model types it has been given, and includes several performance tricks aimed at speeding up robot control, such as reusing computation graphs between requests, keeping intermediate data on the graphics card instead of shuffling it back and forth, and running several steps of action generation together instead of one at a time. To use it, a robot control program connects to a small local web server that stays running continuously. That server accepts camera images and the robot's current physical state, runs one round of AI inference, and returns the action the robot should take next along with timing details, all without needing to reload the model for every single step. The project also supports being called directly from Python code, and can plug into another framework called FlashRT for running the same model without starting a separate server. Building the project uses CMake, with an option to enable CUDA support for NVIDIA hardware. Running it requires two prepared model files in the GGUF format, one for the main language and action model and one for the vision encoder, which the documentation explains how to obtain and convert from existing checkpoints. This is a research codebase paired with a published arXiv paper, aimed at people working on robotics and embedded AI who want to build or extend real-time robot control systems, and the README lists several other robot AI models the project plans to support in the future.
A llama.cpp-based inference engine that runs vision-language-action robot control models in real time on onboard edge hardware.
Mainly C++. The stack also includes C++, llama.cpp, CUDA.
No license information is given in the README.
Setup difficulty is rated hard, with roughly 1day+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
double-check against the repo, no cap.