git404hub

what is worldcupvoice fr?

zicojiao/worldcupvoice — explained in plain English

Analysis updated 2026-05-18

86PythonAudience · developerComplexity · 4/5LicenseSetup · hard

tl;dr

An AI system that watches a live sports video feed and generates real time spoken commentary, built around the World Cup but usable for any live stream.

vibe map

mindmap
  root((repo))
    What it does
      Live AI sports commentary
      Watches RTC video feed
    Tech stack
      Python backend
      Next.js frontend
      Agora RTC
    Pipeline
      Frame sampling
      Vision model
      Text to speech
    Use cases
      Add AI play by play
      Accessibility for blind fans
    Audience
      Developers
      Streaming hobbyists

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Add AI generated play by play commentary to a live sports stream alongside the human broadcast.

VIBE 2

Provide extra field level detail through AI commentary to make a live sports stream more accessible to blind and low vision viewers.

VIBE 3

Experiment with combining a vision model and text to speech to narrate any live video feed, not just sports.

what's the stack?

PythonNext.jsAgora RTCOpenAIElevenLabsFish Audio

how it stacks up fr

zicojiao/worldcupvoicethestageai/edge-lmvoidtherapist31/mecchachameleon-mecchabionix
Stars868686
LanguagePythonPythonPython
Setup difficultyhardmoderateeasy
Complexity4/53/52/5
Audiencedeveloperdevelopergeneral

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1h+

Requires Agora, OpenAI, and a TTS provider account plus API keys across both a frontend and backend environment.

Free to use, modify, and distribute, including commercially, as long as the copyright notice is kept, under the MIT license.

in plain english

WorldCupVoice is an AI system that adds live spoken commentary to a video stream, in real time, as the action happens. It watches the same live video feed that viewers see, using a real time communication service called Agora, and generates spoken commentary that plays back into the stream alongside the original broadcast. The World Cup is the showcase example the project is built around, but the same setup works for any live stream. One notable use case the project highlights is accessibility: AI commentary can describe field level detail, such as where the ball is or who is making a run, that human commentators sometimes skip, which can help blind and low vision viewers follow the action. The README is clear that this is meant to add to human commentary, not replace it. Under the hood, a live source such as OBS pushes video into Agora's system over RTMP, which distributes it to viewers and to an AI backend at the same time. The backend samples video frames, uses a vision model to understand what is happening, and turns that into spoken commentary using a text to speech service. Several TTS providers are supported, including OpenAI, ElevenLabs, and Fish Audio, and the project ships sample commentator voice profiles for English, French, and Chinese. Setting this up requires both a frontend web app, built with a JavaScript package manager, and a Python backend server, along with accounts and API keys for Agora and whichever text to speech provider is chosen. There are explicit controls, such as start and stop commands and a session time limit, meant to keep AI usage and cost under control. The project is open source under the MIT license, so it can be freely used and modified, but running it live requires setting up these external accounts yourself.

prompts (copy fr)

prompt 1
Help me set up WorldCupVoice's frontend and backend environment files with my Agora and OpenAI API keys.
prompt 2
Explain how WorldCupVoice's architecture moves a live video frame through the vision model to generated speech.
prompt 3
Show me how to create a custom ElevenLabs sportscaster voice for WorldCupVoice using its voice prompt.
prompt 4
Walk me through generating an Agora Media Gateway stream key so I can push a test stream to WorldCupVoice.

Frequently asked questions

what is worldcupvoice fr?

An AI system that watches a live sports video feed and generates real time spoken commentary, built around the World Cup but usable for any live stream.

What language is worldcupvoice written in?

Mainly Python. The stack also includes Python, Next.js, Agora RTC.

What license does worldcupvoice use?

Free to use, modify, and distribute, including commercially, as long as the copyright notice is kept, under the MIT license.

How hard is worldcupvoice to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is worldcupvoice for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.