git404hub

what is tess-server fr?

trinity-cloud/tess-server — explained in plain English

Analysis updated 2026-07-24

6TypeScriptAudience · developerComplexity · 3/5Setup · moderate

tl;dr

Runs very large AI models entirely on your Mac with no cloud or per-token costs. It provides a local API matching OpenAI's format so existing apps connect without modification.

vibe map

mindmap
  root((repo))
    What it does
      Runs huge AI models locally
      Matches OpenAI API format
      Faster than standard engines
    Tech stack
      TypeScript
      npm package
      Apple Silicon
    Use cases
      Private AI inference
      Replace OpenAI API calls
      Run 300B parameter models
    Privacy
      No cloud calls
      No telemetry or logging
      Runs only on local machine
    Audience
      AI researchers
      Privacy-focused developers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Run large AI models privately on your Mac with no cloud dependency.

VIBE 2

Replace OpenAI API calls with a local server for existing applications.

VIBE 3

Benchmark local AI model performance against standard inference engines.

VIBE 4

Run models with very long context windows up to 512K tokens.

what's the stack?

TypeScriptnpmApple Silicon

how it stacks up fr

trinity-cloud/tess-serveratomicstrata/atomicmemoryazerdsq131/mcpm
Stars666
LanguageTypeScriptTypeScriptTypeScript
Setup difficultymoderatemoderateeasy
Complexity3/54/52/5
Audiencedeveloperdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · moderate time til it works · 30min

Requires an Apple Silicon Mac and separately obtaining large model files under their respective licenses.

The explanation does not mention the license, license terms are unknown.

in plain english

Tess Server is a tool that turns a Mac with Apple Silicon into a machine for running large AI models entirely on your own computer. It focuses on models in the 300-billion-parameter range, which are large enough that running them locally has traditionally been impractical. The software provides a local API that matches the OpenAI format, so existing applications can connect to it without modification. Nothing leaves your machine: no cloud calls, no per-token costs, no telemetry, no automatic updates. Installation is a single npm package with no external dependencies. You do not need Homebrew, Python, or a separate engine. After installing, you run a doctor command to check your setup, then start the server. The software finds model files on your internal and attached storage, verifies them against known profiles, and serves them with preconfigured settings. You bring your own model files, which you obtain separately under their respective licenses. The project reports performance benchmarks against stock llama.cpp, a widely used local inference engine, on an M4 Max with 128 gigabytes of unified memory. One model decodes at 29.47 tokens per second versus 7.56 for stock, a 3.90x speedup. Another model runs at 97.66 tokens per second. The README also publishes results where stock is faster, with the stated reasoning that a benchmark reporting only wins is an advertisement. All raw data is available in JSON and CSV files. Two of the six supported model profiles do not load in stock llama.cpp at all, because the architecture support exists only in the Tess Server engine. The software also supports very long context windows, up to 196,608 tokens for one model and qualified to 256K or 512K for others. Four profiles ship with speculative decoding turned on by default, where a faster draft model proposes tokens that the main model then verifies for correctness. Privacy is a design principle, not just a claim. The server binds only to the local machine, never to your network. There is no logging of prompts or generated text, and model files are checksum-verified before launch. The software does not request administrator privileges or change system settings. It is described as an inference server, not a security boundary, and the README advises only loading models you trust. The full README is longer than what was shown.

prompts (copy fr)

prompt 1
I have a Mac with Apple Silicon and want to run a 300-billion-parameter AI model locally. How do I install and start Tess Server, and what model files do I need?
prompt 2
I want to switch my existing app from the OpenAI API to Tess Server running on my Mac. What URL and API format does the server expose locally?
prompt 3
Help me compare Tess Server's performance to stock llama.cpp. How do I read the included JSON and CSV benchmark files to see where Tess is faster or slower?
prompt 4
Which of the six supported model profiles have speculative decoding enabled by default, and how does that affect my token generation speed on an M4 Max?

Frequently asked questions

what is tess-server fr?

Runs very large AI models entirely on your Mac with no cloud or per-token costs. It provides a local API matching OpenAI's format so existing apps connect without modification.

What language is tess-server written in?

Mainly TypeScript. The stack also includes TypeScript, npm, Apple Silicon.

What license does tess-server use?

The explanation does not mention the license, license terms are unknown.

How hard is tess-server to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is tess-server for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.