code-yeongyu/web-fetch — explained in plain English
Analysis updated 2026-07-28 · repo last pushed 2026-06-12
Fetch a long API documentation page and search it for specific endpoint parameters without loading the whole page into context.
Convert a web page to markdown or plain text for easier reading or processing.
Use as a standalone command-line tool to quickly download and save web content locally.
| code-yeongyu/web-fetch | 1038lab/agnes-ai | 3eyedtiger/video2vrcemote | |
|---|---|---|---|
| Stars | 4 | 4 | 4 |
| Language | Python | Python | Python |
| Last pushed | 2026-06-12 | — | — |
| Maintenance | Maintained | — | — |
| Setup difficulty | easy | easy | easy |
| Complexity | 2/5 | 2/5 | 1/5 |
| Audience | developer | vibe coder | vibe coder |
Figures from each repo's GitHub metadata at analysis time.
Standalone Python script with no external dependencies, just run it directly with Python installed.
AI coding assistants like Claude Code can read web pages for you, but they typically load the entire page contents directly into their working memory. That wastes context on irrelevant material and makes it harder for the assistant to find the specific data you actually need. web-fetch solves this by downloading a web page to a temporary file and handing the assistant a file path instead. The assistant can then run quick search commands to extract only the exact lines or data points it needs, keeping the conversation lean and focused. The tool runs as a single Python script with no external dependencies. You give it a URL, it fetches the page, optionally converts HTML into cleaner markdown or plain text, and saves the results to a temporary folder. It prints out the file paths so an agent can pipe them into standard search tools. It includes basic handling for sites protected by Cloudflare and can automatically retry with a more realistic browser identity, but it is deliberately limited: no JavaScript rendering, no authentication, no caching, and a 5 MB cap on response size. This is built for people working with terminal-based AI agents like Claude Code, OpenCode, or pi. A practical example: you ask your agent to look at a long API documentation page and find the specific parameters for one endpoint. Instead of pasting the entire page into context, the agent uses this skill to save the page to a file, searches that file for the relevant section, and reads only those lines into context. It also works as a standalone command-line script for anyone who just wants to fetch and convert web pages to markdown. The project's core philosophy is intentional simplicity. It handles one straightforward task, fetching public web content into a file, and explicitly avoids features like multi-provider fallback chains or JavaScript rendering. The author argues that if you need complex browser automation or provider routing, those belong in a different tool entirely. This keeps the script lightweight, easy to install, and reliable across macOS, Linux, and Windows.
A lightweight Python script that fetches web pages and saves them to temporary files, so AI coding assistants can search specific content instead of loading entire pages into context.
Mainly Python. The stack also includes Python.
Maintained — commit in last 6 months (last push 2026-06-12).
No license information provided, so usage terms are unclear.
Setup difficulty is rated easy, with roughly 5min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
double-check against the repo, no cap.