HandFixer一键手部修复

Introduction

This project addresses the issue of numerous hand defects in AI-generated portrait images by using a workflow based on FLUX/FLUX-Fill to correct hand deformities. It is effective for both real-life and anime images, including those generated by DiT/SDXL/Midjourney. It supports diffusers, gradio, ComfyUI, and more

本项目针对AI生成人像图片存在大量手部缺陷的问题，使用了一种基于FLUX/FLUX-Fill修复手部畸形的工作流，对真人图像和动漫图像均有效，包括由DiT/SDXL/Midjourney生成的图片；支持diffusers、gradio、ComfyUI等

Results

• realistic images 真实感图片

• anime images 动漫图片

TODO

• Hand Pose/Depth Controlnet: use structure/anatomy conditions to reinforce genreation
• ComfyUI workflow

Quick Start

pip3 install requirements.txt

python3 diffusers_pipeline.py \
    --pretrained_model_name_or_path='black-forest-labs/FLUX.1-dev' \
    --input_dir 'assets/examples' \
    --output_dir 'outputs'

ComfyUI Workflow

1. "Download HandFixer to ComfyUI/custom_nodes/ and install the requirements." 下载HandFixer到ComfyUI/custom_nodes/并安装requirements

put HandFixer to ComfyUI/custom_nodes/
pip install -r requirements.txt

2. Ensure that the model components have been downloaded. 确保模型组件已经下载

3. drag workflow to ComfyUI. 将workflow拖动到comfyUI

Streamlit UI

models will be downloaded from huggingface automatically

streamlit run app_streamlit.py

Gradio

python3 app_gradio.py

Limitations

• The FLUX-dev model is not a custom inpainting model and may occasionally have boundary artifacts; FLUX-Fill is a dedicated inpainting model with better boundary handling, but the performance on generation decreases