Flux.2-dev-Fun-Controlnet-Union

Model Card

Model features

• This ControlNet is added on 4 double blocks.
• It supports multiple control conditions—including Canny, HED, Depth, Pose, MLSD, Scribble and Gray can be used like a standard ControlNet.
• Inpainting mode is also supported.
• You can adjust controlnet_conditioning_scale for stronger control and better detail preservation. For better stability, we highly recommend using a detailed prompt. The optimal range for controlnet_conditioning_scale is from 0.65 to 0.80.
• Although Flux.2‑dev supports certain image‑editing capabilities, its generation speed slows down when handling multiple images, and it sometimes produces similarity issues or fails to follow the control images. Compared with edit‑based methods, using ControlNet adheres more reliably to control instructions and makes it easier to apply multiple types of control.

Results

Inference

Go to VideoX-Fun repository for more details.

Please git clone VideoX-Fun and mkdirs.

# clone code
git clone https://github.com/aigc-apps/VideoX-Fun.git

# enter VideoX-Fun's dir
cd VideoX-Fun

# download weights
mkdir models/Diffusion_Transformer
mkdir models/Personalized_Model

Then download weights to models/Diffusion_Transformer and models/Personalized_Model.

📦 models/
├── 📂 Diffusion_Transformer/
│   └── 📂 FLUX.2-dev/
├── 📂 Personalized_Model/
│   ├── 📦 FLUX.2-dev-Fun-Controlnet-Union-2602.safetensors
│   └── 📦 FLUX.2-dev-Fun-Controlnet-Union.safetensors

Then run the file examples/flux2_fun/predict_t2i_control.py.