git404hub

what is gesto-engine fr?

jiaxiwangau-star/gesto-engine — explained in plain English

Analysis updated 2026-05-18

34HTMLAudience · developerComplexity · 2/5LicenseSetup · easy

tl;dr

A browser-based, front-end-only gesture recognition engine that learns custom hand and body gestures from a few recorded samples using MediaPipe and nearest-neighbor matching.

vibe map

mindmap
  root((gesto-engine))
    What it does
      Webcam gesture recognition
      Record and learn samples
      KNN classification
    Tech stack
      JavaScript
      MediaPipe
      Browser localStorage
    Use cases
      Custom gesture training
      Embeddable JS API
      Privacy first webcam app
    Audience
      Front-end developers
      Interactive art makers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Train the system to recognize custom hand gestures and trigger a chosen image or emoji reaction.

VIBE 2

Embed the gesture recognition engine into another web project using its JavaScript API.

VIBE 3

Build a fun, privacy-preserving webcam interaction feature that runs entirely client-side with no video upload.

VIBE 4

Export and back up trained gesture samples as a JSON file to reuse across sessions or devices.

what's the stack?

JavaScriptMediaPipeHTML

how it stacks up fr

jiaxiwangau-star/gesto-engineazidancorp/voxeltreemorphsmallnest/goal-workflow
Stars343434
LanguageHTMLHTMLHTML
Setup difficultyeasyeasyeasy
Complexity2/51/52/5
Audiencedevelopervibe coderdeveloper

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · easy time til it works · 5min

Requires a webcam and serving the page over https or localhost since browsers block camera access otherwise.

PolyForm Noncommercial: free to use, modify, and share for personal, educational, or research purposes with attribution, but commercial use requires a separate paid license from the author.

in plain english

Gesto Engine is a hand and body gesture recognition tool that runs entirely in a web browser, using a person's webcam. Instead of a developer hard coding rules for what each gesture looks like, the system works by recording a few short samples of a gesture and then using a nearest neighbor comparison, a simple form of machine learning, to recognize that same gesture later. Whatever gestures a person trains it on are the ones it learns to recognize, and each recognized gesture can be linked to a chosen image or emoji that pops up on screen. This engine was extracted from a separate project called gestomeme.com so it could be reused as its own standalone module. To use it, someone runs a small local web server, opens the page in a browser over https or on localhost, since browsers require a secure context for camera access, and allows camera permission. From there they pick or upload an image or emoji, name a gesture, and record a short sample of themselves performing it, repeating for multiple gestures, and recording a neutral pose as well so the system does not misfire when no gesture is being made. All of this training data is stored locally in the browser rather than sent anywhere. For developers, the project also exposes a small JavaScript API so the recognition engine can be embedded into another project, with functions to start the camera and recognition loop, record a new gesture sample, list current gestures, remove one, or export the training data as a backup file. Under the hood it uses MediaPipe, a widely used library from Google for detecting body and hand landmarks from video, to extract key points that are turned into a feature vector, which the nearest neighbor method then classifies. Privacy is a stated design goal: everything runs in the browser, camera video is never uploaded or stored, and the only saved data is the local training samples. The project uses the PolyForm Noncommercial license, which allows free personal, educational, and research use with attribution, but explicitly forbids commercial use, including resale or use inside a paid product, unless a separate commercial license is obtained from the author.

prompts (copy fr)

prompt 1
Show me how to embed this gesture engine into my own web page using the createEngine JavaScript API.
prompt 2
Walk me through recording a new custom gesture and linking it to an emoji using this project.
prompt 3
Explain how the MediaPipe landmarks and KNN classification work together in this engine.
prompt 4
What are the restrictions of the PolyForm Noncommercial license on using this project in a paid app?

Frequently asked questions

what is gesto-engine fr?

A browser-based, front-end-only gesture recognition engine that learns custom hand and body gestures from a few recorded samples using MediaPipe and nearest-neighbor matching.

What language is gesto-engine written in?

Mainly HTML. The stack also includes JavaScript, MediaPipe, HTML.

What license does gesto-engine use?

PolyForm Noncommercial: free to use, modify, and share for personal, educational, or research purposes with attribution, but commercial use requires a separate paid license from the author.

How hard is gesto-engine to set up?

Setup difficulty is rated easy, with roughly 5min to a first successful run.

Who is gesto-engine for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.