git404hub

what is agent-span fr?

oxbshw/agent-span — explained in plain English

Analysis updated 2026-05-18

43RustAudience · developerComplexity · 4/5LicenseSetup · moderate

tl;dr

A self-hosted Rust gateway that gives AI agents one API, MCP server, and set of SDKs to read and search 52 websites like GitHub, YouTube, and Reddit, with automatic caching and failover.

vibe map

mindmap
  root((AgentSpan))
    What it does
      Unified web access for AI agents
      52 supported platforms
      Self-healing backends
    Interfaces
      REST API and SSE
      MCP server 91 tools
      9 language SDKs
      React dashboard
    Tech stack
      Rust async
      Docker
      Redis
      PostgreSQL
    Use cases
      Agent web reading
      Platform search
      Claude Code integration
    Audience
      AI agent builders
      Developers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Give an AI coding assistant like Claude Code or Cursor a single tool to read and search 52 websites.

VIBE 2

Run a self-hosted gateway so agents stop needing custom scrapers per platform.

VIBE 3

Cache and route web requests across platforms with automatic failover when a backend breaks.

VIBE 4

Build an agent integration in one of nine SDKs against a single consistent API.

what's the stack?

RustDockerRedisPostgreSQLReactTokio

how it stacks up fr

oxbshw/agent-spancvetkovicdamjan/neuriliumday-os/green-vita
Stars434343
LanguageRustRustRust
Setup difficultymoderatehardhard
Complexity4/54/54/5
Audiencedeveloperresearchergeneral

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · moderate time til it works · 30min

Zero-config for many channels, but several platforms require you to supply your own API key or login cookie.

Free to use, modify, and distribute for any purpose, including commercial, as long as you keep the copyright notice.

in plain english

AgentSpan is a gateway that gives AI agents one consistent way to read and search 52 different internet platforms, such as GitHub, YouTube, Reddit, Wikipedia, and Hacker News, instead of each agent needing its own scraper or integration for every site. It sits between the agent and the internet, offering a REST API, a live event stream, a native MCP server with 91 tools for assistants like Claude Code or Cursor, nine software development kits covering languages such as Python, JavaScript, Rust, and Go, a command line tool, and a React dashboard, all built on an async Rust core. The gateway caches results across three tiers so repeated requests are fast and cheap, and it monitors its own backends: if a connection to a platform starts failing, it automatically switches to a working alternative, reinstalls broken command line tools it depends on, and can alert someone if an outage continues. It also watches its own traffic to suggest things like adjusting how long results stay cached or trying a faster backend. The README is explicit about what AgentSpan does not do. It cannot click buttons, log into websites, or fill out forms the way a browser automation tool can, it is not trying to be a general purpose web crawler for arbitrary sites, and it is not offered as a hosted service, only as software you run yourself. To try it, you run a single command to start the gateway locally, then make simple web requests to read a page or search a specific platform, such as Hacker News. It can also be started with Docker, which brings up the API, a web interface, a Redis cache, a PostgreSQL database, and monitoring tools together. For use with AI coding assistants, a single command writes the correct configuration file automatically. The 52 supported platforms are split into ones that work with no setup and ones that require an API key or login cookie you provide yourself. The project is licensed under MIT.

prompts (copy fr)

prompt 1
Install AgentSpan's MCP server into Claude Code and list the tools it adds.
prompt 2
Start AgentSpan locally with cargo and read a page through its REST API.
prompt 3
Bring up AgentSpan with Docker Compose including Redis and PostgreSQL, and explain each service.
prompt 4
Show me how to search Hacker News through AgentSpan's API.
prompt 5
Compare AgentSpan's 52-channel gateway approach to writing my own scraper for each site.

Frequently asked questions

what is agent-span fr?

A self-hosted Rust gateway that gives AI agents one API, MCP server, and set of SDKs to read and search 52 websites like GitHub, YouTube, and Reddit, with automatic caching and failover.

What language is agent-span written in?

Mainly Rust. The stack also includes Rust, Docker, Redis.

What license does agent-span use?

Free to use, modify, and distribute for any purpose, including commercial, as long as you keep the copyright notice.

How hard is agent-span to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is agent-span for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.