git404hub

what is rupixel fr?

ruvnet/rupixel — explained in plain English

Analysis updated 2026-05-18

31RustAudience · developerComplexity · 3/5Setup · moderate

tl;dr

A search tool that finds documents by meaning, not just exact words. It searches both text and screenshots of pages, so it can find information locked inside images, scans, tables, or charts.

vibe map

mindmap
  root((repo))
    What it does
      Searches documents by meaning
      Searches page screenshots
      Real-time video search
    Tech stack
      Rust
      CLIP model
      MiniLM model
      Qwen3-VL model
    Use cases
      Finding scanned documents
      Searching tables and charts
      Live screen captioning
    Audience
      Developers
    Setup
      npx rupixel command
      API key in browser

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Search through scanned documents or images that regular text search cannot read.

VIBE 2

Find specific information inside tables and charts by searching what they look like.

VIBE 3

Run a live video search in your browser that captions your screen activity as it happens.

VIBE 4

Test semantic search accuracy on Wikipedia pages using everyday questions.

what's the stack?

RustCLIPMiniLMQwen3-VL

how it stacks up fr

ruvnet/rupixeltreygoff24/papercutszunelyat/udiomusic
Stars313131
LanguageRustRustRust
Setup difficultymoderatehard
Complexity3/51/5
Audiencedeveloperdevelopergeneral

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · moderate time til it works · 30min

Running the browser-based video search demo requires providing an API key for the AI vision models, either directly in the browser or via a proxy server.

in plain english

rupixel is a search tool that finds documents based on what you mean, not just the exact words you type. It works in two ways. First, it can search the text of your documents, the classic approach. Second, it can search by how a page looks, taking a screenshot of each page and searching the pictures. This second method matters when text is locked inside a scan, an image, a table, or a chart that ordinary text search cannot read. The project includes a real-time video search demo that runs entirely in your browser. It samples a live feed from your camera or screen a few times per second, skips frames that barely changed, and turns the rest into searchable representations using a model called CLIP. It can even generate live captions for each keyframe using a vision model called Qwen3-VL, narrating what happens on screen word by word. Your API key stays in your browser tab and is cleared when you close it, or you can run a proxy server so the key never reaches the browser at all. To explain the core idea without jargon: each document gets turned into a long list of numbers that captures what it is about. Documents with similar meanings get similar numbers. When you ask a question, it gets turned into numbers the same way, and the system finds the documents whose numbers are closest. A small model called MiniLM handles text, while CLIP handles both pictures and text in the same number space, which lets you type words and get back images. The creators tested it on 8 real Wikipedia pages using 8 questions phrased in everyday words that avoid reusing the page's vocabulary. Both text and visual search got the right page every time on the Rust side, though the browser version got 7 out of 8. The authors are honest that these test pages are easy, and the real value of visual search shows up on harder material like scanned paper, tables, and charts, which is the next thing they plan to build. The project is early-stage work in progress, but everything described actually runs with no placeholder code. You can try a command-line helper with npx rupixel, which explains the project and runs the benchmark harness. The full README is longer than what was shown.

prompts (copy fr)

prompt 1
I want to build a document search tool that finds information inside scanned images and charts, not just plain text. How can I use rupixel's visual search approach to do this?
prompt 2
Help me set up the rupixel real-time browser video search demo so it captures my screen and generates live captions using the Qwen3-VL model.
prompt 3
I need to run the rupixel benchmark test on my own set of Wikipedia pages to see how well text and visual search perform. How do I do that with npx rupixel?
prompt 4
Explain how to set up a proxy server for rupixel so my API key stays safe and never reaches the browser tab during video search.

Frequently asked questions

what is rupixel fr?

A search tool that finds documents by meaning, not just exact words. It searches both text and screenshots of pages, so it can find information locked inside images, scans, tables, or charts.

What language is rupixel written in?

Mainly Rust. The stack also includes Rust, CLIP, MiniLM.

How hard is rupixel to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is rupixel for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.