git404hub

what is serge fr?

serge-chat/serge — explained in plain English

Analysis updated 2026-06-26

★ 5,732SvelteAudience · developerComplexity · 3/5LicenseSetup · moderate

tl;dr

Serge is a self-hosted chat app that lets you run AI language models entirely on your own machine with a single Docker command, no API keys or cloud accounts required, with all data stored locally.

vibe map

mindmap
  root((repo))
    What it does
      Local AI chat
      No data sent out
      No API key needed
      Browser-based UI
    Tech stack
      SvelteKit frontend
      FastAPI backend
      LangChain
      Redis sessions
      llama.cpp engine
    Setup
      Docker required
      Single start command
      Windows via WSL2
    Limits
      RAM must fit model
      Crashes if too little memory

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Run a private AI chat assistant on your laptop without sending any messages to third-party servers

VIBE 2

Prototype a local LLM-powered tool without needing an OpenAI API key or monthly bill

VIBE 3

Test different open-source language models side by side in a familiar chat interface

VIBE 4

Set up a self-hosted AI assistant on a home server for your household or small team

what's the stack?

SvelteSvelteKitFastAPIPythonLangChainRedisDockerllama.cpp

how it stacks up fr

serge-chat/sergedbgate/dbgatefireship-io/fireship.io
Stars5,7326,9763,763
LanguageSvelteSvelteSvelte
Setup difficultymoderateeasymoderate
Complexity3/53/53/5
Audiencedeveloperdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · moderate time til it works · 30min

Requires Docker and enough free RAM to load your chosen model, the app will crash if the model exceeds available memory.

Free to use, modify, and distribute under both the MIT and Apache 2.0 licenses, two of the most permissive open-source licenses available.

in plain english

Serge is a self-hosted chat application that lets you run AI language models on your own computer without sending any data to external services and without needing an API key or paid account. It wraps a tool called llama.cpp, which can run large language models locally on consumer hardware. The interface is a web page you open in your browser. You type messages and the AI responds, similar to other chat tools, but everything stays on your machine. Chat history and settings are stored locally using a small database. The project is packaged as a Docker container, meaning you start it with a single command and it handles all the setup automatically. Once running, you visit a local address in your browser to begin chatting. On the technical side, the frontend is built with SvelteKit, the backend API uses FastAPI and LangChain, and Redis handles storing chat sessions. These are the components that run inside the container, so you do not need to install any of them yourself. The main practical requirement is having enough free memory on your computer to load the model you choose. Models vary in size, and the application will crash if your machine runs out of RAM while loading one. The project notes this as an important caveat to be aware of before getting started. Windows users can run Serge using Docker Desktop with WSL2 enabled. The project is open-source under MIT and Apache 2.0 licenses. A Discord community exists for help and discussion. Contributing is welcome by opening issues or pull requests on GitHub.

prompts (copy fr)

prompt 1
Using the Serge codebase, help me add a system prompt field to the chat UI so I can set a custom persona for the AI before starting a conversation.
prompt 2
Show me how Serge's FastAPI backend passes messages to llama.cpp and how I can add a streaming endpoint that sends tokens to the browser one at a time as they are generated.
prompt 3
I want to add a model download manager to Serge's SvelteKit frontend that lists available models from a remote index and shows download progress. Help me build that component.
prompt 4
Help me extend Serge to support multiple named conversation threads that persist between page refreshes, storing them in the existing Redis session store.

Frequently asked questions

what is serge fr?

Serge is a self-hosted chat app that lets you run AI language models entirely on your own machine with a single Docker command, no API keys or cloud accounts required, with all data stored locally.

What language is serge written in?

Mainly Svelte. The stack also includes Svelte, SvelteKit, FastAPI.

What license does serge use?

Free to use, modify, and distribute under both the MIT and Apache 2.0 licenses, two of the most permissive open-source licenses available.

How hard is serge to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is serge for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.

similar repos, if this ain't it