facok/comfyui-krea2-controlnet — explained in plain English
Analysis updated 2026-05-18
Guide Krea2 AI image generation using a depth map so output matches a reference layout
Generate images that follow a specific pose using a pose control image
Combine this plugin with existing ComfyUI preprocessor nodes for depth, canny, or pose extraction
Build a controlled image generation workflow in ComfyUI for consistent compositions
| facok/comfyui-krea2-controlnet | redbyte1337/credspy | suz-tsinghua/smp | |
|---|---|---|---|
| Stars | 132 | 132 | 133 |
| Language | Python | Python | Python |
| Setup difficulty | hard | easy | hard |
| Complexity | 4/5 | 1/5 | 5/5 |
| Audience | developer | ops devops | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires ComfyUI, a compatible Krea2 Control LoRA file, and a GPU capable of running image generation models.
This project is a plugin for ComfyUI, a visual tool people use to build AI image generation workflows by connecting boxes together on a canvas. It adds support for guiding a specific AI image model called Krea2 using extra control images, such as a depth map or a pose sketch, so the generated picture follows the shape or layout of a reference image rather than being generated freely. The plugin adds three connectable pieces, called nodes, to ComfyUI. One loads a small add-on file, known as a LoRA, that teaches the base Krea2 model how to pay attention to a control image. A second node takes a control image, such as one showing depth information or an outline of a pose, and converts it into a format the AI model can understand internally. The third node attaches that converted control image to the model so it actually influences the final generated picture. Using it follows a straightforward order: first prepare or generate a control image using either regular ComfyUI tools or a separate set of preprocessing tools built for this purpose, then encode that image with this plugin, load the special add-on file, attach the encoded control image, and finally send everything to the image generation step as usual. The README notes that skipping the final attachment step causes generation to fail outright rather than quietly producing an incorrect result, which is meant to prevent silent mistakes. The plugin includes a few small settings for handling different types of control images correctly, such as converting a color image to grayscale or flipping its values, since different types of control images, like depth maps versus pose sketches, are prepared slightly differently. The author credits an existing open-source reference project for documenting how this technique works, along with a separate publicly available add-on file that provides depth-based image control specifically.
A ComfyUI plugin that lets the Krea2 AI image model follow a control image, like a depth map or pose sketch, during generation.
Mainly Python. The stack also includes Python, ComfyUI, PyTorch.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly developer.
This repo across BitVibe Labs
double-check against the repo, no cap.