W2GenAI/LucidFlux

Model

30

stars

17

commits

4

linked in READMEs

May 26, 2026

updated

computer-vision
diffusion
flux
image-restoration
image-to-image
Browse cluster: Diffusion Model Image Generation and Editing β†’

README

🎨 LucidFlux:
Caption-Free Universal Image Restoration with a Large-Scale Diffusion Transformer

🌍 Website | πŸ“„ Paper | πŸ’» Code | 🧩 Models


abs_image

News & Updates


Let us know if this works!

πŸ‘₯ Authors

Song Fei1*, Tian Ye1*‑, Lei Zhu1,2†

1The Hong Kong University of Science and Technology (Guangzhou)
2The Hong Kong University of Science and Technology

*Equal Contribution, ‑Project Leader, †Corresponding Author


🌟 What is LucidFlux?

LucidFlux is a framework designed to perform high-fidelity image restoration across a wide range of degradations without requiring textual captions. By combining a Flux-based DiT backbone with Light-weight Condition Module and SigLIP semantic alignment, LucidFlux enables caption-free guidance while preserving structural and semantic consistency, achieving superior restoration quality.

πŸ“Š Performance Benchmarks

πŸ“ˆ Quantitative Results

BenchmarkMetricResShiftStableSRSinSRSeeSRDreamClearSUPIRLucidFlux
(Ours)
RealSRCLIP-IQA+ ↑0.50050.44080.54160.67310.53310.56400.7074
Q-Align ↑3.10452.50873.36153.60733.00443.46823.7555
MUSIQ ↑49.5039.9857.9567.5749.4855.6870.20
MANIQA ↑0.29760.23560.37530.50870.30920.34260.5437
NIMA ↑4.70264.36394.82824.89574.49484.64015.1072
CLIP-IQA ↑0.52830.35210.66010.69930.53900.48570.6783
NIQE ↓9.06746.87336.46825.45945.28735.28194.2893
RealLQ250CLIP-IQA+ ↑0.55290.58040.60540.70340.68100.65320.7406
Q-Align ↑3.63183.55863.74514.14234.06404.13474.3935
MUSIQ ↑59.5057.2565.4570.3867.0865.8173.01
MANIQA ↑0.33970.29370.42300.48950.44000.38260.5589
NIMA ↑5.06245.05385.23975.31465.22005.08065.4836
CLIP-IQA ↑0.61290.51600.71660.70630.69500.57670.7122
NIQE ↓6.63264.62365.44254.43833.87003.65913.6742


πŸ” Comparison with Open-Source Methods

LQSinSRSeeSRSUPIRDreamClearOurs
Show more examples

πŸ’Ό Comparison with Commercial Models

LQHYPIRTopazSeeDream 4.0Gemini-NanoBananaGPT-4oOurs
Show more examples

πŸ—οΈ Model Architecture

LucidFlux Framework Overview
Caption-Free Universal Image Restoration with a Large-Scale Diffusion Transformer

Our unified framework consists of four critical components in the training workflow:

πŸ”€ Scaling Up Real-world High-Quality Data for Universal Image Restoration

🎨 Two Parallel Light-weight Condition Module Branches for Low-Quality Image Conditioning

🎯 Timestep and Layer-Adaptive Condition Injection

πŸ”„ Semantic Priors from Siglip for Caption-Free Semantic Alignment

πŸš€ Quick Start

πŸ”§ Installation

# Clone the repository
git clone https://github.com/W2GenAI-Lab/LucidFlux.git
cd LucidFlux

# Create conda environment
conda create -n lucidflux python=3.9
conda activate lucidflux

# Install dependencies
pip install -r requirements.txt

Inference

Prepare models in 2 steps, then run a single command.

  1. Login to Hugging Face (required for gated FLUX.1-dev). Skip if already logged-in.
python -m tools.hf_login --token "$HF_TOKEN"
  1. Download required weights to fixed paths and export env vars
# FLUX.1-dev (flow+ae), SwinIR prior, T5, CLIP, SigLIP and LucidFlux checkpoint to ./weights
python -m tools.download_weights --dest weights

# Exports FLUX_DEV_FLOW/FLUX_DEV_AE to your shell
source weights/env.sh

Run inference (uses fixed relative paths):

bash inference.sh

You can also obtain results of LucidFlux on RealSR and RealLQ250 from Hugging Face: LucidFlux.

πŸͺͺ License

The provided code and pre-trained weights are licensed under the FLUX.1 [dev].

πŸ™ Acknowledgments

  • This code is based on FLUX. Some code are brought from DreamClear, x-flux. We thank the authors for their awesome work.

  • πŸ›οΈ Thanks to our affiliated institutions for their support.

  • 🀝 Special thanks to the open-source community for inspiration.


πŸ“¬ Contact

For any questions or inquiries, please reach out to us:

  • Song Fei: sfei285@connect.hkust-gz.edu.cn
  • Tian Ye: tye610@connect.hkust-gz.edu.cn

πŸ§‘β€πŸ€β€πŸ§‘ WeChat Group

η‚Ήε‡»ε±•εΌ€δΊŒη»΄η οΌˆWeChat Group QR CodeοΌ‰

WeChat Group QR

Contributors

Xsong123

15 commits

nielsr

2 commits

W2GenAI/LucidFlux

Model

30

stars

17

commits

4

linked in READMEs

May 26, 2026

updated

computer-vision
diffusion
flux
image-restoration
image-to-image
Browse cluster: Diffusion Model Image Generation and Editing β†’

README

🎨 LucidFlux:
Caption-Free Universal Image Restoration with a Large-Scale Diffusion Transformer

🌍 Website | πŸ“„ Paper | πŸ’» Code | 🧩 Models


abs_image

News & Updates


Let us know if this works!

πŸ‘₯ Authors

Song Fei1*, Tian Ye1*‑, Lei Zhu1,2†

1The Hong Kong University of Science and Technology (Guangzhou)
2The Hong Kong University of Science and Technology

*Equal Contribution, ‑Project Leader, †Corresponding Author


🌟 What is LucidFlux?

LucidFlux is a framework designed to perform high-fidelity image restoration across a wide range of degradations without requiring textual captions. By combining a Flux-based DiT backbone with Light-weight Condition Module and SigLIP semantic alignment, LucidFlux enables caption-free guidance while preserving structural and semantic consistency, achieving superior restoration quality.

πŸ“Š Performance Benchmarks

πŸ“ˆ Quantitative Results

BenchmarkMetricResShiftStableSRSinSRSeeSRDreamClearSUPIRLucidFlux
(Ours)
RealSRCLIP-IQA+ ↑0.50050.44080.54160.67310.53310.56400.7074
Q-Align ↑3.10452.50873.36153.60733.00443.46823.7555
MUSIQ ↑49.5039.9857.9567.5749.4855.6870.20
MANIQA ↑0.29760.23560.37530.50870.30920.34260.5437
NIMA ↑4.70264.36394.82824.89574.49484.64015.1072
CLIP-IQA ↑0.52830.35210.66010.69930.53900.48570.6783
NIQE ↓9.06746.87336.46825.45945.28735.28194.2893
RealLQ250CLIP-IQA+ ↑0.55290.58040.60540.70340.68100.65320.7406
Q-Align ↑3.63183.55863.74514.14234.06404.13474.3935
MUSIQ ↑59.5057.2565.4570.3867.0865.8173.01
MANIQA ↑0.33970.29370.42300.48950.44000.38260.5589
NIMA ↑5.06245.05385.23975.31465.22005.08065.4836
CLIP-IQA ↑0.61290.51600.71660.70630.69500.57670.7122
NIQE ↓6.63264.62365.44254.43833.87003.65913.6742


πŸ” Comparison with Open-Source Methods

LQSinSRSeeSRSUPIRDreamClearOurs
Show more examples

πŸ’Ό Comparison with Commercial Models

LQHYPIRTopazSeeDream 4.0Gemini-NanoBananaGPT-4oOurs
Show more examples

πŸ—οΈ Model Architecture

LucidFlux Framework Overview
Caption-Free Universal Image Restoration with a Large-Scale Diffusion Transformer

Our unified framework consists of four critical components in the training workflow:

πŸ”€ Scaling Up Real-world High-Quality Data for Universal Image Restoration

🎨 Two Parallel Light-weight Condition Module Branches for Low-Quality Image Conditioning

🎯 Timestep and Layer-Adaptive Condition Injection

πŸ”„ Semantic Priors from Siglip for Caption-Free Semantic Alignment

πŸš€ Quick Start

πŸ”§ Installation

# Clone the repository
git clone https://github.com/W2GenAI-Lab/LucidFlux.git
cd LucidFlux

# Create conda environment
conda create -n lucidflux python=3.9
conda activate lucidflux

# Install dependencies
pip install -r requirements.txt

Inference

Prepare models in 2 steps, then run a single command.

  1. Login to Hugging Face (required for gated FLUX.1-dev). Skip if already logged-in.
python -m tools.hf_login --token "$HF_TOKEN"
  1. Download required weights to fixed paths and export env vars
# FLUX.1-dev (flow+ae), SwinIR prior, T5, CLIP, SigLIP and LucidFlux checkpoint to ./weights
python -m tools.download_weights --dest weights

# Exports FLUX_DEV_FLOW/FLUX_DEV_AE to your shell
source weights/env.sh

Run inference (uses fixed relative paths):

bash inference.sh

You can also obtain results of LucidFlux on RealSR and RealLQ250 from Hugging Face: LucidFlux.

πŸͺͺ License

The provided code and pre-trained weights are licensed under the FLUX.1 [dev].

πŸ™ Acknowledgments

  • This code is based on FLUX. Some code are brought from DreamClear, x-flux. We thank the authors for their awesome work.

  • πŸ›οΈ Thanks to our affiliated institutions for their support.

  • 🀝 Special thanks to the open-source community for inspiration.


πŸ“¬ Contact

For any questions or inquiries, please reach out to us:

  • Song Fei: sfei285@connect.hkust-gz.edu.cn
  • Tian Ye: tye610@connect.hkust-gz.edu.cn

πŸ§‘β€πŸ€β€πŸ§‘ WeChat Group

η‚Ήε‡»ε±•εΌ€δΊŒη»΄η οΌˆWeChat Group QR CodeοΌ‰

WeChat Group QR

Contributors

Xsong123

15 commits

nielsr

2 commits