git404hub

what is hermes-glasses fr?

prasanthsasikumar/hermes-glasses — explained in plain English

Analysis updated 2026-05-18

7SwiftAudience · developerComplexity · 4/5Setup · hard

tl;dr

An iPhone app that lets you talk hands free to an AI through Meta Ray-Ban glasses, with live transcription and camera based visual questions.

vibe map

mindmap
  root((Hermes Glasses))
    What it does
      Hands free AI chat
      Live transcription
      Camera vision questions
    Tech stack
      Swift
      SwiftUI
      Python bridge
      WebSocket
    Use cases
      Ask AI about surroundings
      Voice chat via glasses
      Agentic assistant with tools
    Audience
      Developers
      Smart glasses owners

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Talk hands free to an AI assistant through Meta Ray-Ban smart glasses with live transcription.

VIBE 2

Ask the AI to describe what you are looking at using the glasses' camera.

VIBE 3

Connect to a full agentic Hermes Agent on a Mac for tool use and memory across conversations.

what's the stack?

SwiftSwiftUIPythonWebSocket

how it stacks up fr

prasanthsasikumar/hermes-glassesakshaymaloo/filamentcrafcat7/peakmon
Stars777
LanguageSwiftSwiftSwift
Setup difficultyhardeasyeasy
Complexity4/52/53/5
Audiencedevelopergeneraldeveloper

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1h+

Requires iOS 17+, Xcode 16+, Meta Ray-Ban glasses, a Meta App ID and Client Token, and for bridge mode a Mac with Python and the Hermes Agent CLI.

No license information is provided in the README.

in plain english

Hermes Glasses is an iPhone app that lets you talk to an AI assistant through Meta Ray-Ban smart glasses, hands free. You can have a spoken conversation with live on-device transcription showing your words as you speak, and you can ask the assistant to describe what you are looking at, using the glasses' camera to take a photo and send it to the AI. The app supports two ways of connecting to an AI. In the simpler Direct mode, the phone talks straight to a provider you choose, such as Claude, OpenAI, Gemini, or a locally running Ollama model, using your own API key, with no extra server needed. In the more advanced Bridge mode, the phone instead connects over a WebSocket to a small Python program running on a Mac, which forwards your questions to a Hermes Agent, a separate tool-using AI system with memory across turns, and streams the spoken reply back to the glasses. On the phone side, the app uses Meta's Wearables Device Access Toolkit to register and connect to the glasses and capture photos, and Apple's built-in speech recognition to transcribe speech entirely on the device, so audio is not sent anywhere just to convert it to text. Replies are spoken back using text-to-speech, either on the phone or through the Mac bridge depending on which mode is active. A built-in test panel lets you check each part of the system, such as the bridge connection, photo capture, and voice queries, separately. To build and run this project you need an iPhone with iOS 17 or newer, Xcode 16 or newer, and a pair of Meta Ray-Ban glasses paired with the Meta AI app. You also need to register for a Meta App ID and Client Token through Meta's developer portal for the glasses to connect. Using Direct mode only requires an API key from your chosen AI provider, while Bridge mode additionally needs a Mac running Python 3.11 or newer with the Hermes Agent command line tool installed.

prompts (copy fr)

prompt 1
Explain the difference between Direct mode and Hermes bridge mode in this app.
prompt 2
Help me set up the Meta App ID and Client Token needed to connect my Ray-Ban glasses.
prompt 3
Walk me through how the WebSocket protocol between the iPhone app and the Mac bridge works.
prompt 4
Show me how to run the Python bridge script and connect it to a Hermes Agent.

Frequently asked questions

what is hermes-glasses fr?

An iPhone app that lets you talk hands free to an AI through Meta Ray-Ban glasses, with live transcription and camera based visual questions.

What language is hermes-glasses written in?

Mainly Swift. The stack also includes Swift, SwiftUI, Python.

What license does hermes-glasses use?

No license information is provided in the README.

How hard is hermes-glasses to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is hermes-glasses for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.