git404hub

what is 8hr-marathon fr?

d-hackmt/8hr-marathon — explained in plain English

Analysis updated 2026-05-18

106Jupyter NotebookAudience · developerComplexity · 4/5Setup · hard

tl;dr

An enterprise question answering system that retrieves relevant documents, filters out noise, and generates safe answers using multiple AI services.

vibe map

mindmap
  root((Enterprise Agentic RAG))
    What it does
      Retrieval augmented answers
      Filters noisy documents
      Guardrail safety checks
    Pipeline
      Planner node
      Retriever plus reranker
      Responder node
    Tech stack
      LangGraph
      Qdrant
      Portkey gateway
      Gemini embeddings
    Use cases
      Enterprise document QA
      RAG architecture reference
    Audience
      Backend developers
      AI engineers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Build an internal chatbot that answers questions from a company's own documents.

VIBE 2

Study a reference architecture for retrieval augmented generation with guardrails and reranking.

VIBE 3

Evaluate RAG answer quality using the included RAGAS based evaluation suite.

VIBE 4

Learn how to route LLM calls through a gateway with automatic key fallback.

what's the stack?

LangGraphPortkeyQdrantGeminiGroqFastAPIStreamlit

how it stacks up fr

d-hackmt/8hr-marathonkrishnaik06/complete-machine-learning-2023physx-omni/physx-omni
Stars10611988
LanguageJupyter NotebookJupyter NotebookJupyter Notebook
Last pushed2023-09-16
MaintenanceDormant
Setup difficultyhardeasyhard
Complexity4/51/55/5
Audiencedevelopergeneralresearcher

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1h+

Requires API keys for Groq, Portkey, Qdrant, Logfire, LangSmith, and Gemini before it will run.

in plain english

This repository, titled Enterprise Agentic RAG, is a system that answers questions by first retrieving relevant information from a set of documents and then generating an answer with a language model, an approach commonly called RAG. It is aimed at enterprise style document question answering and is built to tell apart genuinely relevant technical content from irrelevant or noisy documents before answering. The system checks incoming questions with a safety layer called NeMo Guardrails before doing anything else, blocking off topic requests, jailbreak attempts, and prompt injection. A planner then decides whether a question is simple conversation or something that needs document retrieval. Technical questions go through a retriever that searches a Qdrant vector database, then a local reranker called FlashRank narrows the results down before a final responder generates the answer, with LangGraph keeping track of conversation memory across the whole flow. Language model calls are routed through a gateway called Portkey, which can automatically fall back to a backup key if the primary one fails, and the underlying model used is Llama 3.3 70B served through Groq. Document embeddings for search come from Google's Gemini embedding model. Document parsing for PDF, HTML, TXT, DOCX, and PPTX files happens entirely on the user's own machine, with no external service needed. The project also includes tracing through Pydantic Logfire and LangSmith, and an evaluation suite built on RAGAS with six metrics plus a Streamlit app to view results. To run it, you create a Python virtual environment, install the pinned dependencies, and fill in a .env file with API keys for Groq, Portkey, Qdrant, Logfire, LangSmith, and Gemini. After running an ingestion command that parses and indexes the sample documents, you start a FastAPI backend and a separate Streamlit chat interface in two terminals. An optional evaluation app can be run against the live backend afterward. The README includes eleven separate documentation guides covering the system's architecture, environment variables, and known gotchas in detail.

prompts (copy fr)

prompt 1
Explain how the Planner, Retriever, and Responder nodes work together in this LangGraph pipeline.
prompt 2
Help me set up the .env file and API keys needed to run this Enterprise Agentic RAG system.
prompt 3
Walk me through running the FastAPI backend and Streamlit UI for this project.
prompt 4
Summarize what NeMo Guardrails blocks before a question reaches the retrieval step.
prompt 5
What does the RAGAS evaluation suite in this project measure and how do I run it?

Frequently asked questions

what is 8hr-marathon fr?

An enterprise question answering system that retrieves relevant documents, filters out noise, and generates safe answers using multiple AI services.

What language is 8hr-marathon written in?

Mainly Jupyter Notebook. The stack also includes LangGraph, Portkey, Qdrant.

How hard is 8hr-marathon to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is 8hr-marathon for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.