git404hub

what is docker-litellm fr?

hwdsl2/docker-litellm — explained in plain English

Analysis updated 2026-07-17 · repo last pushed 2026-07-09

9ShellAudience · pm founderComplexity · 3/5ActiveSetup · moderate

tl;dr

A self-hosted proxy that unifies access to 100+ AI models through one OpenAI-compatible API, with automatic setup, virtual keys for team spending limits, and secure defaults using Docker.

vibe map

mindmap
  root((repo))
    What it does
      Unified AI gateway
      100-plus model support
      OpenAI-compatible API
    Tech stack
      Docker containers
      Shell scripts
      LiteLLM proxy
    Key features
      Auto-generated master key
      Virtual keys with limits
      Persistent config storage
    Use cases
      Avoid vendor lock-in
      Manage developer access
      Run local models
    Setup
      Docker deployment
      Provide API keys
      Add HTTPS for internet

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Switch between AI providers without changing your app code to find the best cost-to-quality ratio.

VIBE 2

Create restricted virtual keys for team members or external developers with spending limits and model access controls.

VIBE 3

Run local AI models on your own computer and interact with them using standard OpenAI-compatible tools.

VIBE 4

Centralize all your AI API keys behind one private gateway so apps only need one endpoint.

what's the stack?

ShellDockerLiteLLM

how it stacks up fr

hwdsl2/docker-litellmdockur/proxmox-backupjssroberto/antigravity-2-fedora-installer
Stars91011
LanguageShellShellShell
Last pushed2026-07-09
MaintenanceActive
Setup difficultymoderatemoderateeasy
Complexity3/53/52/5
Audiencepm founderops devopsgeneral

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · moderate time til it works · 30min

Requires Docker installed and at least one AI provider API key, HTTPS setup is recommended if exposing beyond localhost.

in plain english

This project gives you a single, private gateway for interacting with over 100 different AI models. Instead of juggling separate accounts, API keys, and software tools for OpenAI, Anthropic, Google Gemini, and others, you connect your apps to one place. It makes all these different providers look and act like OpenAI, so any software already built for OpenAI can seamlessly use any model you choose. Under the hood, it runs as a self-hosted proxy. When you first start it, the software automatically generates a secure master key and sets up a configuration file. You simply provide the API keys for the AI services you want to use, and the proxy handles routing your requests to the right provider. It also includes tools to create "virtual keys," which are temporary or restricted passes you can give to team members with specific spending limits or model access. The system saves all your settings and data securely, so nothing is lost when you restart your server. A startup founder building an AI-powered app could use this to avoid locking into a single AI provider, easily switching between models to find the best balance of cost and quality. A product manager might use the virtual key feature to hand out access to external developers, tracking exactly how much money each developer spends. It is also a great fit for a hobbyist running local models on their own computer, allowing them to interact with those local models using the same standard tools they would use for paid cloud services. Notably, the project is designed to be simple and secure by default, requiring no manual configuration to get started. It relies on Docker, a tool that packages software into isolated units, making the gateway easy to deploy on any machine. For those exposing their gateway to the public internet, the documentation strongly recommends adding an encrypted HTTPS layer for safety.

prompts (copy fr)

prompt 1
Set up docker-litellm as a local proxy for OpenAI, Anthropic, and Google Gemini so I can send requests to all three using the same OpenAI-style API endpoint.
prompt 2
Create virtual keys with spending limits for three different developers using docker-litellm, where each developer can only access specific AI models.
prompt 3
Configure docker-litellm to route my local Ollama model alongside paid cloud models like GPT-4, so my app can call them all through one unified API.
prompt 4
Help me add HTTPS encryption to my docker-litellm gateway so it's safe to expose on the public internet.
prompt 5
Show me how to start docker-litellm with no manual config, auto-generate a master key, and connect my first AI provider API key.

Frequently asked questions

what is docker-litellm fr?

A self-hosted proxy that unifies access to 100+ AI models through one OpenAI-compatible API, with automatic setup, virtual keys for team spending limits, and secure defaults using Docker.

What language is docker-litellm written in?

Mainly Shell. The stack also includes Shell, Docker, LiteLLM.

Is docker-litellm actively maintained?

Active — commit in last 30 days (last push 2026-07-09).

How hard is docker-litellm to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is docker-litellm for?

Mainly pm founder.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.