git404hub

what is vdotool fr?

dncolomer/vdotool — explained in plain English

Analysis updated 2026-05-18

6JavaScriptAudience · vibe coderLicense

tl;dr

A Hermes agent plugin that opens a live two-way video and audio link to your phone, so the AI can see, hear, and talk back in real time.

vibe map

mindmap
  root((vdotool))
    What it does
      Live video link
      Two-way audio
      Hermes plugin
    Tech stack
      JavaScript
      Python
      VDO.Ninja
    Use cases
      Workout coaching
      DIY help
      Live transcription
    Audience
      Vibe coders
      Hermes agent users

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Have the agent watch your exercise form live through your phone's camera.

VIBE 2

Get real-time help wiring a lamp or assembling furniture with the agent watching.

VIBE 3

Use it for live transcription or remote expert walkthroughs over video.

VIBE 4

Let the agent talk back to you through TTS while watching a task in progress.

what's the stack?

JavaScriptPythonVDO.NinjaWebRTC

how it stacks up fr

dncolomer/vdotoolarthurmoorgan/driftatom/etch-list-view
Stars666
LanguageJavaScriptJavaScriptJavaScript
Last pushed2020-04-28
MaintenanceDormant
Setup difficultymoderatemoderate
Complexity2/52/5
Audiencevibe codergeneraldeveloper

Figures from each repo's GitHub metadata at analysis time.

in plain english

vdotool is a live two-way session plugin for the Hermes AI agent that gives the agent access to a real time video and audio feed from a remote device, almost always your phone. Once installed and enabled, you can tell the agent things like watch my form while I work out or help me wire this lamp and the agent will be able to see through your phone's camera, hear you, and talk back, all without any additional setup on the phone beyond opening a link. The plugin works by creating a shared room using VDO.Ninja, an open source tool that establishes a direct browser to browser video connection, called WebRTC, over your local network. The repo includes two components: a thin Hermes plugin that manages the session lifecycle, and a minimally modified fork of VDO.Ninja that adds frame snapshots, text to speech playback, and microphone recording. When you start a session, the plugin auto launches a local server, spawns a headless browser to view the stream, generates a push link for your phone, and starts a background thread that continuously feeds video frames and speech back to the agent. Voice support is provider agnostic: the plugin uses whichever text to speech and speech to text tools are already configured in Hermes. If voice is not set up, the session still works using frames and text chat only. The plugin exposes seven tools to the agent, covering starting and ending sessions, fetching the latest video frame, speaking text aloud, and checking session health. A pre call hook injects a brief status update into every conversation turn so the agent stays oriented. The full README is longer than what was shown.

prompts (copy fr)

prompt 1
Install vdotool as a Hermes plugin and help me start my first session.
prompt 2
Explain how vdotool's headless viewer and background watcher work together.
prompt 3
What voice providers does vdotool support for text-to-speech and transcription?
prompt 4
Walk me through the seven tools vdotool exposes to the agent.

Frequently asked questions

what is vdotool fr?

A Hermes agent plugin that opens a live two-way video and audio link to your phone, so the AI can see, hear, and talk back in real time.

What language is vdotool written in?

Mainly JavaScript. The stack also includes JavaScript, Python, VDO.Ninja.

Who is vdotool for?

Mainly vibe coder.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.