myrobotproject/dtof-lidar-hm-ld1-gesture-recognition — explained in plain English
Analysis updated 2026-05-18
Add contactless hand-gesture control to a robot using a depth camera instead of a color camera.
Detect hand position and shape for a smart home device without needing good lighting.
Save hand landmark data to JSONL files for offline analysis or training other models.
Swap in a different hand landmark detection model by writing a small adapter class.
| myrobotproject/dtof-lidar-hm-ld1-gesture-recognition | 0-bingwu-0/live-interpreter | 0cm-labs/tokenizer-benchmark | |
|---|---|---|---|
| Stars | 2 | 2 | 2 |
| Language | Python | Python | Python |
| Setup difficulty | hard | moderate | moderate |
| Complexity | 4/5 | 2/5 | 2/5 |
| Audience | developer | general | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires the separate HM-LD1 camera SDK, a C++ build step, and a physical HM-LD1 DToF LiDAR camera.
This project builds a real time pipeline that turns depth data from a HM-LD1 DToF LiDAR camera into hand landmark detection, meaning it can track the position of a hand and its fingers using depth sensing instead of a normal color camera. It is aimed at things like contactless control for robots or smart home devices. The pipeline works in a fixed sequence: it reads small 40 by 30 depth frames from the camera, removes any depth values farther than a chosen distance (one meter by default), converts the remaining depth values into a false color image, upsamples that image to a larger 384 by 288 resolution, and then feeds it into a hand landmark detector. By default that detector is Google's MediaPipe HandLandmarker, which outputs 21 points describing the shape and position of a detected hand. Results can be viewed live with an on screen visualization or saved to a JSONL file for later use. The hand landmark detection step is kept separate from the rest of the code, so someone could swap in a different detection model by writing a small adapter class and registering it, without needing to touch the camera reading or image processing steps. Setup involves installing some system packages, running a provided script to create a Python virtual environment, downloading the MediaPipe model, and building a small C++ tool that streams frames from the camera using its official SDK, which must be obtained separately and placed next to this repository. The project has been tested on Ubuntu 22.04 and on WSL2, and includes instructions for attaching a USB camera to a WSL2 environment from Windows. Because MediaPipe was trained on ordinary color photos rather than depth based pseudocolor images, the README notes that detection quality depends on keeping the hand's depth image looking hand shaped, for example by avoiding background clutter and highly reflective or very dark surfaces. The project's own code is released under the MIT License, though the camera SDK and any third party models or packages it depends on keep their own separate licenses.
A real-time pipeline that detects hand landmarks from a DToF LiDAR camera's depth data for contactless control.
Mainly Python. The stack also includes Python, MediaPipe, OpenCV.
The project's own code is MIT licensed, free to use, modify, and distribute, but bundled third-party SDKs and models keep their own separate licenses.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly developer.
This repo across BitVibe Labs
double-check against the repo, no cap.