suyashpradhan/rag-decision-diagnoser — explained in plain English
Analysis updated 2026-05-18
Decide whether a new AI feature needs RAG, long context, fine tuning, or a hybrid setup.
Walk through a questionnaire and see the exact decision tree path behind the recommendation.
Compare rough cost tradeoffs between architecture options before committing to one.
| suyashpradhan/rag-decision-diagnoser | 00kaku/gallery-slider-block | 3rd-eden/ircb.io | |
|---|---|---|---|
| Stars | 0 | — | — |
| Language | JavaScript | JavaScript | JavaScript |
| Last pushed | — | 2021-05-19 | 2016-11-16 |
| Maintenance | — | Dormant | Dormant |
| Setup difficulty | easy | easy | easy |
| Complexity | 2/5 | 2/5 | 2/5 |
| Audience | developer | general | developer |
Figures from each repo's GitHub metadata at analysis time.
This project is a single page web app that helps someone decide which approach to use when building an AI system that needs outside information: retrieval augmented generation (RAG), long context, fine tuning, or a mix of these called hybrid. It runs entirely in the browser, with no backend server, no calls to any AI model or API, no environment variables, and no database. Every answer it gives comes from a fixed decision tree written in code, so the same inputs always produce the same verdict. The tool walks a user through a set of questions and then shows a recommendation along with the exact path through the decision tree that led to it, so the reasoning is visible rather than hidden. It also scores how confident it is in that answer, since different signals in the questionnaire can either agree with each other or point in different directions. The decision tree follows a set order of preferences. Long context is favored for a small, single document that needs deep analysis. A hybrid approach is chosen when both the system's knowledge and its behavior need fixing. Retrieval is used when the answer must cite sources, and it escalates to hybrid if the underlying problem is also behavioral. Fine tuning is reserved for behavior problems that are stable over time. The tool also handles cases where retrieval can be skipped entirely, such as a tiny and stable set of facts that fits in a single prompt. A cost comparison feature is included, but the project is upfront that its cost numbers are demonstration assumptions from a product brief, not real vendor pricing or guaranteed benchmark results. The comments in the code point to several published research papers that back up the general shape of these tradeoffs, covering topics like retrieval versus long context, how language models handle long inputs, fine tuning versus retrieval, and faithfulness in RAG citations. Five ready made example scenarios are built in, such as a customer support bot, a brand voice email writer, a legal contract analyzer, a medical assistant needing current research, and an internal company question and answer tool, each resolving to one of the four architecture choices. It can be run locally with npm or deployed with no extra configuration on Vercel.
A browser only tool that recommends whether to use RAG, long context, fine tuning, or hybrid, using a fixed decision tree.
Mainly JavaScript. The stack also includes TypeScript, Next.js, React.
Setup difficulty is rated easy, with roughly 5min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
double-check against the repo, no cap.