git404hub

what is fractale fr?

fractale-lm/fractale — explained in plain English

Analysis updated 2026-05-18

5PythonAudience · researcherComplexity · 4/5LicenseSetup · moderate

tl;dr

A usage toolkit for language models that remember long documents through 8 self-written compact memory notes instead of a growing prompt.

vibe map

mindmap
  root((Fractale))
    What it does
      Reads page by page
      Writes 8 memory notes
      Thinks through memory
    Tech stack
      Python
      PyTorch
      Fast weights
    Use cases
      Long document analysis
      Memory research
      Compare with and without memory
    Audience
      Researchers
      ML developers
      AI builders

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Feed a long document into a Fractale model and inspect its compact 8-note memory

VIBE 2

Compare a model's predictions with its memory turned on versus turned off

VIBE 3

Save and restore a model's memory state to continue a session later

VIBE 4

Swap the memory bank from one document into a session about a different document

what's the stack?

PythonPyTorch

how it stacks up fr

fractale-lm/fractale1ncendium/aibusteraaronmayeux/ha-hurricane-tracker
Stars555
LanguagePythonPythonPython
Setup difficultymoderatemoderateeasy
Complexity4/53/52/5
Audienceresearcherops devopsgeneral

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · moderate time til it works · 1h+

Requires Python, PyTorch, and downloading the pretrained model weights separately.

Use freely for any purpose, including commercial use, as long as you keep the copyright notice.

in plain english

Fractale is a usage kit for a type of language model that remembers what it reads in an unusual way. Instead of keeping the entire document in a growing prompt like a typical chatbot does, a Fractale model reads a long document one page at a time and is only allowed to keep 8 sticky notes about what it has seen. After each page it writes one note in its own internal shorthand, and once all 8 notes are full, the oldest one gets removed to make room. The model never goes back and rereads earlier pages. Instead, those notes plug directly into the model's own internal workings, so the model thinks through its memory rather than reading it back as text. This repository provides the tools to actually use a Fractale model: loading it, feeding it text, generating continuations, and treating its memory as something you can save to a file, restore later, reset, or swap between different documents. Because the model carries this compact memory state between calls instead of a growing prompt, using it works differently from a normal large language model, and this kit handles that loop for you. The included model is a 386 million parameter base model that has only been pretrained, so it does not have chat abilities and should not be expected to quote text word for word. Its memory captures the general gist, tone, and structure of what it read rather than an exact copy. The repository includes runnable demo scripts that compare what the model predicts with its memory turned on versus turned off, plus a demo that swaps memory banks between two different documents to see how predictions change. The project requires Python and is installed by cloning the repository and running pip install. It is released under the MIT license, and the underlying training code and research live in a separate companion repository.

prompts (copy fr)

prompt 1
Help me install the Fractale usage kit and load the pretrained 350M model
prompt 2
Explain how Fractale's 8-note memory bank replaces a growing prompt
prompt 3
Show me how to save, reset, and reload a Fractale memory bank in Python
prompt 4
Walk me through comparing with-memory and amnesic continuations using BankSession
prompt 5
Explain what fast weights are and how Fractale uses them for memory

Frequently asked questions

what is fractale fr?

A usage toolkit for language models that remember long documents through 8 self-written compact memory notes instead of a growing prompt.

What language is fractale written in?

Mainly Python. The stack also includes Python, PyTorch.

What license does fractale use?

Use freely for any purpose, including commercial use, as long as you keep the copyright notice.

How hard is fractale to set up?

Setup difficulty is rated moderate, with roughly 1h+ to a first successful run.

Who is fractale for?

Mainly researcher.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.