git404hub

what is diffusion-bench fr?

end2end-diffusion/diffusion-bench — explained in plain English

Analysis updated 2026-05-18

14PythonAudience · researcherComplexity · 4/5Setup · hard

tl;dr

A research toolkit with a single consistent interface for training and evaluating diffusion transformer image-generation models on ImageNet class generation and text-to-image tasks.

vibe map

mindmap
  root((diffusion-bench))
    Tasks
      ImageNet generation
      Text-to-image generation
    Training pipeline
      Stage 1 RAE tokenizer
      Stage 2 diffusion model
      30 plus encoders
    Evaluation
      FID and IS scores
      GenEval benchmark
      DPGBench benchmark
    Architecture
      Diffusion transformers
      VAE representation
      Transport methods
    Community
      Open contributions
      AutoResearch branch
      Config-file driven

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Train a diffusion transformer on ImageNet generation using the two-stage RAE tokenizer and diffusion model pipeline.

VIBE 2

Evaluate an existing text-to-image checkpoint on GenEval and DPGBench without rewriting evaluation scripts.

VIBE 3

Swap a configuration file to compare over 30 different representation encoders under identical training conditions.

what's the stack?

PythonPyTorchdiffusion transformersVAE

how it stacks up fr

end2end-diffusion/diffusion-bench0c33/agentic-aiadennng/stock_strategy_lab
Stars141414
LanguagePythonPythonPython
Setup difficultyhardhardhard
Complexity4/54/54/5
Audienceresearcherdeveloperresearcher

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1day+

Requires a CUDA-capable GPU and downloading model checkpoints, two-stage training adds setup complexity.

License not specified in the explanation.

in plain english

DiffusionBench is a research toolkit for training and testing AI image-generation models, specifically a category of models called diffusion transformers. The name comes from the field's terminology: these models generate images by starting from noise and gradually refining it, and the transformer part refers to a particular architectural style borrowed from language models. If you have ever seen tools like Stable Diffusion or FLUX generate an image from a text prompt, those are the kinds of models this repository is built to study. The codebase provides a single, consistent interface for running experiments across two broad tasks. The first is ImageNet generation, where the model learns to produce images belonging to specific categories (dogs, chairs, etc.) given a class label. The second is text-to-image generation, where the model takes a written description and produces a matching image. Having both tasks in one place means researchers can swap a configuration file and run the same training or evaluation code on either task without rewriting anything. Training happens in two stages. The first stage trains a component called an RAE tokenizer, which compresses images into a compact representation that the main model can work with more efficiently. The second stage trains the actual diffusion model on top of that representation, or on alternative representations like VAE. The repository supports over 30 different representation encoders and a range of transport and prediction methods, giving researchers many combinations to compare. Evaluation is also built in. During training, quality metrics are computed automatically. For standalone testing of a released checkpoint, a separate set of configuration files handles the setup so researchers do not need to manually wire the weights to the evaluation scripts. The metrics used vary by task: FID and IS scores for ImageNet, and benchmarks like GenEval and DPGBench for text-to-image. The project is designed to be extended and welcomes outside contributions. It notes compatibility with coding agents and with an AutoResearch workflow on a separate branch, suggesting the authors intend it as a shared platform for the research community rather than a finished product.

prompts (copy fr)

prompt 1
I want to use diffusion-bench to train a diffusion transformer on ImageNet. Walk me through the Stage 1 RAE tokenizer training config and then the Stage 2 diffusion model training config.
prompt 2
Show me how to evaluate a released diffusion transformer checkpoint on GenEval and DPGBench using diffusion-bench's standalone evaluation setup.
prompt 3
I want to add a new representation encoder to diffusion-bench. Where do I register it so it becomes selectable via config file like the existing options?

Frequently asked questions

what is diffusion-bench fr?

A research toolkit with a single consistent interface for training and evaluating diffusion transformer image-generation models on ImageNet class generation and text-to-image tasks.

What language is diffusion-bench written in?

Mainly Python. The stack also includes Python, PyTorch, diffusion transformers.

What license does diffusion-bench use?

License not specified in the explanation.

How hard is diffusion-bench to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is diffusion-bench for?

Mainly researcher.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.