git404hub

what is openmodel fr?

wundercorp/openmodel — explained in plain English

Analysis updated 2026-05-18

16TypeScriptAudience · developerComplexity · 4/5Setup · moderate

tl;dr

A command line tool and dashboard for running AI models on your own computer or in the cloud, with built in usage tracking.

vibe map

mindmap
  root((openmodel))
    What it does
      Run AI models locally
      Connect to cloud models
      Track token usage
    Tech stack
      TypeScript
      llama.cpp and Ollama
      AWS Lambda
    Use cases
      Private model hosting
      OpenAI compatible API
      Usage dashboards
    Audience
      Developers
      Self hosters
    Deployment
      AWS Terraform
      Cloudflare option
      Docker and Kubernetes

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Run open source AI models locally without sending data to a third party cloud service.

VIBE 2

Build an app that talks to local or cloud models through one OpenAI compatible API.

VIBE 3

Track token usage and cost across different models and providers from one dashboard.

VIBE 4

Deploy a private hosted model gateway on your own AWS or Cloudflare account.

what's the stack?

TypeScriptNode.jsAWS LambdaCloudflare WorkersDockerKubernetes

how it stacks up fr

wundercorp/openmodelachrefelouafi/basicproceduralbuildingacoyfellow/tuiport
Stars161616
LanguageTypeScriptTypeScriptTypeScript
Setup difficultymoderatemoderatemoderate
Complexity4/53/54/5
Audiencedeveloperdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · moderate time til it works · 30min

Local model use needs the CLI plus a runtime like llama.cpp or Ollama, cloud deployment needs an AWS or Cloudflare account.

in plain english

OpenModel is a tool that lets you run AI language models on your own computer or connect to them in the cloud, while keeping track of how many tokens you are using. It is distributed as an npm package called @wundercorp/openmodel, and it comes with a dashboard, a marketing website, and a separate cloud API you can deploy if you want. At its core, the command line tool lets you pull models from places like Hugging Face, direct download links, or Ollama, then run them locally using either the llama.cpp or Ollama engines. Once a model is running, you can serve it through a local server that mimics OpenAI's and Ollama's APIs, so other apps that expect those formats can talk to it without changes. The server also exposes endpoints for checking health, listing models, installing new ones, and viewing usage metrics like token counts, latency, and recent requests, all without needing to log in. The project uses a concept called gateways to translate different model sources, such as Hugging Face files or Ollama tags, into one consistent format the runtimes understand. This means one gateway can supply models to several runtimes, and people can write and add their own gateway packages if they need a source that is not built in. For login, the command line tool uses device based OAuth authentication, and the website uses a separate authorization code flow with tokens stored in session storage. The dashboard's visual components come from a separately published design system package called baseui, so the styling is not bundled directly into this repository. Deployment is built around AWS by default, using Route 53, S3, CloudFront, API Gateway, Lambda, and DynamoDB, with an optional path to deploy on Cloudflare instead. There are also Docker Compose and Kubernetes configurations for running things locally or in a self-managed cluster. The project includes shell scripts for running tests, building, publishing new versions to npm, and deploying the whole system in one step.

prompts (copy fr)

prompt 1
Walk me through installing @wundercorp/openmodel and running my first local model with om pull and om run.
prompt 2
Help me write a gateway package for OpenModel that connects to a custom model source.
prompt 3
Show me how to point an app that expects the OpenAI API at my local OpenModel server.
prompt 4
Explain how OpenModel's device login and PKCE authentication flows work together.
prompt 5
Help me set up the Terraform based AWS deployment for OpenModel's cloud API.

Frequently asked questions

what is openmodel fr?

A command line tool and dashboard for running AI models on your own computer or in the cloud, with built in usage tracking.

What language is openmodel written in?

Mainly TypeScript. The stack also includes TypeScript, Node.js, AWS Lambda.

How hard is openmodel to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is openmodel for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.