git404hub

what is instruct-pix2pix fr?

timothybrooks/instruct-pix2pix — explained in plain English

Analysis updated 2026-06-24

6,882PythonAudience · researcherComplexity · 4/5Setup · hard

tl;dr

An AI image editor from UC Berkeley that applies plain-English instructions to photos, say 'add snow' or 'turn him into a cyborg' and it edits the image using Stable Diffusion.

vibe map

mindmap
  root((repo))
    Model
      Stable Diffusion base
      Fine-tuned editing
      Text instructions
    Interfaces
      Command line
      Gradio web app
      Parameter tuning
    Training data
      454k examples
      GPT-3 captions
      Prompt-to-Prompt pairs
    Requirements
      GPU 18GB RAM
      Python setup
    Research
      UC Berkeley paper
      CLIP filtering

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Edit photos with plain-English commands like 'make it look vintage' or 'add a sunset' without manual masking.

VIBE 2

Run an interactive browser-based image editor using the included Gradio web app.

VIBE 3

Download the 454,000-example training dataset of paired before-and-after edits to fine-tune your own model.

what's the stack?

PythonPyTorchStable DiffusionGradio

how it stacks up fr

timothybrooks/instruct-pix2pixmahmoud/boltonshhyo/archery
Stars6,8826,8856,886
LanguagePythonPythonPython
Setup difficultyhardeasymoderate
Complexity4/51/54/5
Audienceresearcherdeveloperops devops

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1h+

Requires a GPU with more than 18 GB of VRAM, there is no CPU or low-VRAM fallback.

in plain english

InstructPix2Pix is a research project from UC Berkeley that lets you edit images by describing the change you want in plain English. You provide an input image and a text instruction like "turn him into a cyborg" or "add snow," and the model produces a new version of the image with that edit applied. It was published as an academic paper and this repository contains the code to run it and the data used to train it. The model is built on top of Stable Diffusion, a popular open-source image generation model. Fine-tuning Stable Diffusion on paired image examples, before and after an edit, taught the model to follow editing instructions while preserving the content of the original image that should remain unchanged. Running the model requires a GPU with more than 18 gigabytes of memory. You can edit a single image from the command line by passing in the image file and your instruction as text. There is also an interactive web application powered by Gradio that lets you upload images and type instructions in a browser interface. Parameters like the number of diffusion steps and guidance strength can be adjusted to tune the quality and faithfulness of the result. The training dataset consists of around 454,000 examples, each containing an original image, an editing instruction, and the edited result. The dataset was built in two stages: first, GPT-3 was fine-tuned to generate captions and matching edit instructions, and then Stable Diffusion combined with a technique called Prompt-to-Prompt converted those paired text captions into paired images. Two versions of the dataset are available for download: a full random-sample version and a higher-quality filtered version selected using CLIP scoring.

prompts (copy fr)

prompt 1
Run instruct-pix2pix on a portrait photo to add a fantasy forest background, what command do I use?
prompt 2
Set up the Gradio web interface for instruct-pix2pix so I can upload images and type editing instructions in a browser.
prompt 3
How do I tune the guidance strength and diffusion steps in instruct-pix2pix to make edits more or less faithful to the original?
prompt 4
Download the filtered high-quality instruct-pix2pix dataset and show me the format of each training example.

Frequently asked questions

what is instruct-pix2pix fr?

An AI image editor from UC Berkeley that applies plain-English instructions to photos, say 'add snow' or 'turn him into a cyborg' and it edits the image using Stable Diffusion.

What language is instruct-pix2pix written in?

Mainly Python. The stack also includes Python, PyTorch, Stable Diffusion.

How hard is instruct-pix2pix to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is instruct-pix2pix for?

Mainly researcher.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.