git404hub

what is laguna-mlx fr?

pipenetwork/laguna-mlx — explained in plain English

Analysis updated 2026-05-18

2PythonAudience · developerComplexity · 4/5LicenseSetup · hard

tl;dr

Runs the Laguna 118B AI coding model on Apple Silicon Macs using Apple's MLX framework. Only about 8B parameters are active at once thanks to a Mixture of Experts design, and you can serve it locally with an OpenAI-compatible API.

vibe map

mindmap
  root((repo))
    What it does
      Runs Laguna on Macs
      Long context up to 1M
      OpenAI-compatible server
    Tech stack
      Python
      Apple MLX framework
      Mixture of Experts model
    Use cases
      Agentic coding locally
      Long-document processing
      Local API server
    Model sizes
      2-bit at 35 GB
      4-bit at 62 GB default
      Full precision at 219 GB
    Hardware needs
      96 GB unified memory minimum
      Apple Silicon Mac
    Audience
      AI tinkerers
      Mac power users

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Run a powerful AI coding assistant locally on your Mac without sending data to the cloud.

VIBE 2

Process very long documents up to one million words in a single request.

VIBE 3

Serve a local API that works with tools expecting OpenAI-compatible requests.

VIBE 4

Experiment with different compressed model sizes to balance speed and memory usage.

what's the stack?

PythonApple MLXMixture of Experts

how it stacks up fr

pipenetwork/laguna-mlx0-bingwu-0/live-interpreter010zx00x1/faresnipe
Stars222
LanguagePythonPythonPython
Setup difficultyhardmoderateeasy
Complexity4/52/52/5
Audiencedevelopergeneralgeneral

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 30min

Requires a Mac with at least 96 GB of unified memory and a 62 GB model download for the balanced 4-bit version.

Code is free to use for any purpose under Apache 2.0, but the AI model weights follow a separate license with their own terms.

in plain english

This repository adapts a large AI model called Laguna, made by a company called Poolside, to run on Apple Silicon Mac computers. The original Laguna model is designed for agentic coding tasks and can work with very long passages of text, up to one million words or tokens at once. The project provides the necessary code to run this model using Apple's MLX framework, which is built for Apple chips. A single Python file contains the model definition, and you register it once before running prebuilt versions of the model that are hosted online. The model uses a design called Mixture of Experts, where it has 256 separate specialist components but only activates about 10 of them for any given piece of text. This keeps the active computing load small, around 8 billion parameters, even though the total model is much larger at 118 billion. The architecture mixes two types of attention across its 48 layers, with some layers looking at the full text and others using a sliding window that focuses on nearby words. It also includes a shared expert that processes every token, plus specific mathematical techniques for handling position and gating. To use it, you install the MLX library and register the model file. The project offers several sizes, from a 2-bit compressed version at 35 gigabytes up to a full precision version at 219 gigabytes. The 4-bit version at 62 gigabytes is listed as the balanced default, and you need a Mac with at least 96 gigabytes of unified memory to run it comfortably. You can generate text from the command line, use a Python script, or run a local server that accepts requests compatible with OpenAI's format. The repository includes scripts to download the original weights, convert them into the different compressed sizes, and upload them. The 2-bit version uses a mixed precision approach because pure 2-bit compression produces incoherent output. By keeping key parts at 4-bit and only compressing the specialist components to 2-bit, the result stays coherent while staying compact. Tests verify the model structure against the original without requiring the full weight download. The code is under an Apache 2.0 license, while the model weights follow a separate license inherited from the original model.

prompts (copy fr)

prompt 1
How do I install and register the Laguna MLX model on my Apple Silicon Mac so I can start generating text from the command line?
prompt 2
Show me how to start the local OpenAI-compatible server for the Laguna model and send a chat completion request to it using Python.
prompt 3
Help me pick the right Laguna model size for my Mac, and check whether I have enough unified memory to run the 4-bit version.
prompt 4
Walk me through the steps to download the original weights, convert them to a 2-bit or 4-bit compressed version, and verify the model structure.

Frequently asked questions

what is laguna-mlx fr?

Runs the Laguna 118B AI coding model on Apple Silicon Macs using Apple's MLX framework. Only about 8B parameters are active at once thanks to a Mixture of Experts design, and you can serve it locally with an OpenAI-compatible API.

What language is laguna-mlx written in?

Mainly Python. The stack also includes Python, Apple MLX, Mixture of Experts.

What license does laguna-mlx use?

Code is free to use for any purpose under Apache 2.0, but the AI model weights follow a separate license with their own terms.

How hard is laguna-mlx to set up?

Setup difficulty is rated hard, with roughly 30min to a first successful run.

Who is laguna-mlx for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.