git404hub

what is 2wild-coding-agent-latency-monitor fr?

tonyd2wild/2wild-coding-agent-latency-monitor — explained in plain English

Analysis updated 2026-05-18

19HTMLAudience · developerComplexity · 3/5LicenseSetup · moderate

tl;dr

A zero-dependency live dashboard that fires many parallel streaming requests at an AI model server and shows real-time speed and throughput metrics for each run.

vibe map

mindmap
  root((Latency Monitor))
    What it does
      Fires parallel agent runs
      Shows live speed metrics
      Real kill switch
      Saves run history
    Tech stack
      Python
      HTML
      OpenAI-compatible API
    Use cases
      Stress test local model server
      Compare model speeds
      Share benchmark results
    Audience
      Developers
      Researchers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Stress test a local model server with many simultaneous coding agent requests.

VIBE 2

Compare tokens-per-second and response speed across different models or hardware.

VIBE 3

Monitor real GPU usage, memory, and temperature during a benchmark run.

VIBE 4

Generate a shareable summary of benchmark results to post online.

what's the stack?

PythonHTMLSSHvLLM

how it stacks up fr

tonyd2wild/2wild-coding-agent-latency-monitorabduznik/portfolio-dumperadcbueno/flashcards
Stars191919
LanguageHTMLHTMLHTML
Setup difficultymoderateeasyeasy
Complexity3/52/51/5
Audiencedeveloperdevelopergeneral

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · moderate time til it works · 30min

Needs an OpenAI-compatible model server already running, plus optional passwordless SSH access for real GPU metrics.

Licensed under MIT, so anyone can use, modify, and redistribute it freely, including for commercial purposes, as long as the copyright notice is kept.

in plain english

Coding Agent Latency Monitor is a small dashboard for testing how fast an AI model server responds when many coding agent requests hit it at the same time. It works with any endpoint that speaks the OpenAI-compatible API, such as vLLM, SGLang, llama.cpp server, or TGI, and it needs nothing beyond Python itself to run. The tool fires a chosen number of parallel streaming requests, up to 32 at once, and shows live numbers for each one: time to first token, tokens per second, total end to end time, and token count. Because the requests are launched from the server side and multiplexed back through one connection, the tool avoids the browser's usual limit on how many connections it can hold open at once. There is also a real stop button and a kill all button that actually cut every open connection to the model server, so nothing keeps running in the background after you stop a test. Alongside the per-run numbers, a hardware strip shows metrics pulled from vLLM, and can optionally show real GPU usage, memory, and temperature over SSH if you set up a small config file listing your machines. When a run finishes or is stopped, the dashboard calculates peak and average throughput, per-stream highs and lows, total tokens, and average timing, then offers a one-click copy button so you can share those results elsewhere. Every finished run is also saved automatically to a local file, and a Past Runs tab lets you search and filter through your history with a chart for each run. Two extra modes exist for fun: a Matrix-style visual theme, and an experimental Art Mode where multiple agents each draw one slice of the same picture, which doubles as a rough way to compare how well different sized models can follow shared instructions. Setup involves copying an example config file, editing it to point at your model endpoint, and running a single Python script that starts a local web server. The project only talks to the endpoint you configure and does not send data anywhere else. It is licensed under MIT, so it can be freely used, modified, and shared.</content>

prompts (copy fr)

prompt 1
Explain how this tool multiplexes parallel requests over one connection.
prompt 2
Walk me through setting up presets.json and nodes.json for my own server.
prompt 3
How does the kill switch actually stop requests on the backend?
prompt 4
What does the Art Mode benchmark reveal about model quality?
prompt 5
Show me how run history is saved and searched in the Past Runs tab.

Frequently asked questions

what is 2wild-coding-agent-latency-monitor fr?

A zero-dependency live dashboard that fires many parallel streaming requests at an AI model server and shows real-time speed and throughput metrics for each run.

What language is 2wild-coding-agent-latency-monitor written in?

Mainly HTML. The stack also includes Python, HTML, SSH.

What license does 2wild-coding-agent-latency-monitor use?

Licensed under MIT, so anyone can use, modify, and redistribute it freely, including for commercial purposes, as long as the copyright notice is kept.

How hard is 2wild-coding-agent-latency-monitor to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is 2wild-coding-agent-latency-monitor for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.