git404hub

what is benten fr?

ayusrjn/benten — explained in plain English

Analysis updated 2026-05-18

6PythonAudience · pm founderComplexity · 4/5Setup · moderate

tl;dr

Benten listens to calls between people and voice AI agents, then scores how well the conversation went, measuring response delays, audio quality, silence, and interruptions, and shows results in a live dashboard.

vibe map

mindmap
  root((repo))
    What it does
      Scores voice AI calls
      Analyzes real audio
      Real-time dashboard
    Metrics tracked
      Turn latency
      Speech quality
      Dead air
      Interruptions
    Integrations
      ElevenLabs
      Vapi AI
      Retell AI
    Tech stack
      React frontend
      Python backend
      Background workers
    Use cases
      Monitor call quality
      Flag bad calls
      Compare agents
    Audience
      PMs and founders
      Voice AI teams

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Monitor live voice AI calls and see a health score for every conversation in a dashboard.

VIBE 2

Pinpoint calls with long response delays or dead air so you can fix agent performance.

VIBE 3

Compare quality across agents on ElevenLabs, Vapi, or Retell to find the best provider.

VIBE 4

Drill into a single call to read the transcript, play back audio, and review turn-by-turn timing.

what's the stack?

PythonReactNISQARedisCelery

how it stacks up fr

ayusrjn/bentenaa2246740/ultimate-designaclark4life/home-depot-crawl
Stars666
LanguagePythonPythonPython
Last pushed2014-08-10
MaintenanceDormant
Setup difficultymoderateeasymoderate
Complexity4/52/52/5
Audiencepm foundervibe coderdeveloper

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · moderate time til it works · 30min

Requires an API key from at least one supported voice AI provider (ElevenLabs, Vapi, or Retell) plus local infrastructure for caching and background workers.

No license information is provided, so default copyright restrictions apply, you can view the code but usage rights are unclear.

in plain english

Benten is an audio evaluation and analytics platform built for Voice AI agents. When a customer calls a voice-based AI assistant, Benten listens in and measures how well the conversation went, covering things like response delays, audio quality, silent gaps, and moments where the caller talks over the agent. The goal is to help teams understand not just what the AI said, but how it sounded and felt to the person on the other end. Unlike standard text evaluation tools that only read transcripts, Benten analyzes the actual acoustic and conversational performance of voice calls. It tracks several specific metrics. Turn latency measures how quickly the agent responds after a person finishes speaking, in milliseconds. Speech quality gets scored on a 1 to 5 scale using a deep learning model called NISQA. Dead air percentage captures unintended silent pauses. User interruptions count how often the caller speaks over the agent. A combined health score from 0 to 100 brings all of these together into one overall quality rating. Benten connects directly to three Voice AI providers: ElevenLabs, Vapi AI, and Retell AI. You enter your API key, and Benten automatically discovers your existing agents and syncs their metadata. Once connected, it ingests call data through webhooks and begins running its audio analysis pipeline. That pipeline standardizes audio files, detects speech activity, separates the two speakers, scores speech quality, and calculates latency and silence metrics. Results push to the dashboard in real time. The platform includes a conversations table where you can see all calls with summary metrics, color-coded quality tags, and re-evaluation controls. A detail drawer lets you inspect individual calls turn by turn, with searchable transcripts and audio playback. There is also an agents dashboard that tracks health scores and flags bottleneck incidents for each voice bot. The system is built as a modular set of services: a React frontend, a Python backend API, background task workers, and supporting infrastructure for caching and messaging. You can start everything with a single script, or set up each component manually. The full README is longer than what was shown.

prompts (copy fr)

prompt 1
I want to evaluate voice AI call quality. I have API keys for Vapi and ElevenLabs. Help me connect them to Benten and start ingesting call audio for analysis.
prompt 2
Benten synced my Vapi agents. How do I read the health score, latency, dead-air, and interruption metrics on the dashboard so I know which calls need attention?
prompt 3
Help me run Benten locally using the single-script startup. Walk through what services start up and how to confirm the frontend and background workers are running correctly.
prompt 4
A specific call in Benten has a low health score. Show me how to open the detail drawer, read the turn-by-turn transcript, play the audio, and figure out whether the problem was latency or dead air.

Frequently asked questions

what is benten fr?

Benten listens to calls between people and voice AI agents, then scores how well the conversation went, measuring response delays, audio quality, silence, and interruptions, and shows results in a live dashboard.

What language is benten written in?

Mainly Python. The stack also includes Python, React, NISQA.

What license does benten use?

No license information is provided, so default copyright restrictions apply, you can view the code but usage rights are unclear.

How hard is benten to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is benten for?

Mainly pm founder.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.