git404hub

what is comfyui-diffusiongemmapromptbuilder fr?

exportanything/comfyui-diffusiongemmapromptbuilder — explained in plain English

Analysis updated 2026-05-18

41PythonAudience · developerComplexity · 5/5LicenseSetup · hard

tl;dr

A set of ComfyUI nodes that use the DiffusionGemma AI model to write structured prompts for LTX video generation workflows, including character motion transfer.

vibe map

mindmap
  root((DiffusionGemma Prompt Builder))
    What it does
      AI prompt writing
      Context combination
      LTX prompt output
    Tech stack
      ComfyUI
      Python
      Transformers
    Use cases
      Character motion transfer
      Video prompt generation
      LTX workflow integration
    Audience
      ComfyUI power users
      AI video creators

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

what do people make with this?

VIBE 1

Automatically generate structured video prompts from text, an image, and a video using DiffusionGemma.

VIBE 2

Build a character motion transfer video workflow combining a reference image and a motion video.

VIBE 3

Feed AI-written positive and negative prompts directly into an LTX video generation pipeline.

VIBE 4

Verify a compressed NVFP4 model format is working correctly before running a full generation.

what's the stack?

PythonComfyUIPyTorchTransformers

how it stacks up fr

exportanything/comfyui-diffusiongemmapromptbuilderaimer-zero/redforge-aiarthuryangx/nano-notebooklm
Stars414141
LanguagePythonPythonPython
Setup difficultyhardmoderatemoderate
Complexity5/54/52/5
Audiencedeveloperdeveloperresearcher

Figures from each repo's GitHub metadata at analysis time.

how do i run it?

Difficulty · hard time til it works · 1h+

Requires a CUDA GPU, an existing ComfyUI install, and several large model files downloaded separately from Hugging Face.

in plain english

This project is a set of five custom nodes for ComfyUI, a visual, node-based tool for building AI image and video generation workflows. Rather than generating images or video itself, it uses an AI model called DiffusionGemma purely as a smart prompt writer, taking in text, an image, and a video as context, and producing a carefully constructed prompt for a separate video generation model called LTX to actually use. The five nodes work together in a chain: one loads the DiffusionGemma model itself, one combines your text description with an optional reference image and video into a single context object, one stores your target settings like video profile, duration, and aspect ratio, one asks DiffusionGemma to generate the final structured prompt based on all of that, and one splits that result apart into the individual pieces an LTX video workflow needs, such as the positive prompt, negative prompt, and resolution. The project ships a full example workflow for character motion transfer, where a reference image defines who appears in the video and a separate source video defines the motion, pose, and camera movement to apply. Using it requires downloading several large model files separately from Hugging Face, including the DiffusionGemma prompt model, the LTX diffusion model, supporting LoRA files, video and audio decoders, and a text encoder, each placed into a specific ComfyUI models folder. Setting this up requires a ComfyUI installation with a CUDA-capable GPU and several other community node packs installed through ComfyUI's manager. The project includes a verification script to confirm the specialized compressed model format it relies on is working correctly before attempting a real generation. It is released under the MIT license.

prompts (copy fr)

prompt 1
Walk me through downloading and placing all the model files this workflow needs into ComfyUI.
prompt 2
Explain how the DiffusionGemma Context Hub node combines text, image, and video inputs.
prompt 3
Help me wire up the DiffusionGemma nodes into a custom LTX video workflow.
prompt 4
Show me how to run the proof gate script to check the NVFP4 backend before generating.

Frequently asked questions

what is comfyui-diffusiongemmapromptbuilder fr?

A set of ComfyUI nodes that use the DiffusionGemma AI model to write structured prompts for LTX video generation workflows, including character motion transfer.

What language is comfyui-diffusiongemmapromptbuilder written in?

Mainly Python. The stack also includes Python, ComfyUI, PyTorch.

How hard is comfyui-diffusiongemmapromptbuilder to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is comfyui-diffusiongemmapromptbuilder for?

Mainly developer.

peek the repo → explain another one

This repo across BitVibe Labs

double-check against the repo, no cap.