qianx77/Face_Restoration_Ref

some works about face restoration

32

1 commits

updated Apr 3, 2025

See the code

README

Paper and Code

Inspired by sczhou Awesome-Face-Restoration and TaoWangzj Awesome-Face-Restoration.

Recommend

Several popular methods that perform well in my own test data.

Year
Pub
Abbreviation
Recommend
2021CVPRGFPGAN v1.4⭐️⭐️⭐️⭐️⭐️
2022NeurIPSCodeFormer⭐️⭐️⭐️⭐️⭐️
2021CVPRGPEN⭐️⭐️⭐️

Blind Face Restoration (Image)

Geometric Prior

Year
Pub
Title
Links
Arch
Abbreviation
2018CVPRFSRNet: End-to-End Learning Face Super-Resolution with Facial Priors[paper][code]CNNFSRNet
2021TPAMIFace Restoration via Plug-and-Play 3D Facial Priors[paper][code]CNN-
2021CVPRProgressive Semantic-Aware Style Transformation for Blind Face Restoration[paper][code]GANPSFRGAN
2023TNNLSMulti-prior learning via neural architecture search for blind face restoration[paper][code]CNNMFPSNet
2022CVPRBlind Face Restoration via Integrating Face Shape and Generative Priors[paper][code]GANSGPN

Reference Prior

Year
Pub
Title
Links
Arch
Abbreviation
2018ECCVLearning Warped Guidance for Blind Face Restoration[paper][code]CNNGFRNet
2020ECCVBlind Face Restoration via Deep Multi-scale Component Dictionaries[paper][code]CNNDFDNet
2020CVPREnhanced Blind Face Restoration with Multi-Exemplar Images
and Adaptive Spatial Feature Fusion
[paper][code]CNNASFFNet
2022TPAMILearning Dual Memory Dictionaries for Blind Face Restoration[paper][code]CNNDMDNet
2022ACMMyStyle: A Personalized Generative Prior[paper][code]GANMyStyle
2023arXivPersonalized Restoration via Dual-Pivot Tuning[paper][code]DiffusionDual-Pivot Tuning
2024arXivInstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attention[paper][code]DiffusionInstantRestore
2024CVPRPFStorer: Personalized Face Restoration and Super-Resolution[paper][code]DiffusionPFStorer
2024arXivRestorerID: Towards Tuning-Free Face Restoration with ID Preservation[paper][code]DiffusionRestorerID
2024arXivOvercoming False Illusions in Real-World Face Restoration with Multi-Modal GuidedDiffusion Model[paper][code]DiffusionMGFR
2024arXivCopy or Not? Reference-Based Face Image Restoration with Fine Details[paper][code]DiffusionRefineFIR
2024SensorsPDGrad: Guiding Diffusion Model for Reference-Based Blind Face Restoration with Pivot Direction Gradient Guidance[paper][code]DiffusionPDGrad
2024CVPRRestoration by Generation with Constrained Priors[paper][code]Diffusiongen2res
2024WACVENTED: Enhanced Neural Texture Extraction and Distribution for Reference-based Blind Face Restoration[paper][code]DiffusionENTED
2025AAAIFaceMe: Robust Blind Face Restoration with Personal Identification[paper][code]DiffusionFaceMe

Generative Prior (good)

Year
Pub
Title
Links
Arch
Abbreviation
2020MMHiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment[paper][code]GANHiFaceGAN
2020CVPRImage Processing Using Multi-Code GAN Prior[paper][code]GANmGANprior
2021CVPRTowards Real-World Blind Face Restoration with Generative Facial Prior[paper][code]GANGFPGAN
2021CVPRGAN Prior Embedded Network for Blind Face Restoration in the Wild[paper][code]GANGPEN
2022CVPRBlind Face Restoration via Integrating Face Shape and Generative Priors[paper][code]GANSGPN
2022CVPRGCFSR: a Generative and Controllable Face Super Resolution Method Without Facial and GAN Priors[paper][code]GANGCFSR
2022AAAIPanini-Net: GAN Prior Based Degradation-Aware Feature Interpolation for Face Restoration[paper][code]GANPanini-Net
2022ArxivFaceFormer: Scale-aware Blind Face Restoration with Transformers[paper][code]ViTFaceFormer
2022ArxivBlind Face Restoration: Benchmark Datasets and a Baseline Model[paper][code]ViTSTUNet
2023CVPRTFRGAN: Leveraging Text Information for Blind Face Restoration with Extreme Degradation[paper][code]GANTFRGAN
2023TCSVTDEAR-GAN: Degradation-Aware Face Restoration With GAN Prior[paper][code]GANDEAR-GAN
2023ACMMMExploring Correlations in Degraded Spatial Identity Features for Blind Face Restoration[paper][code]GANMemGAN
2023FSPDegradation Learning and Skip-Transformer for Blind Face Restoration[paper][code]GAN-
2023ACMMMExploring Correlations in Degraded Spatial Identity Features for Blind Face Restoration[paper][code]GAN-
2024AAAIBlind Face Restoration under Extreme Conditions: Leveraging 3D-2D Prior Fusion for Superior Structural and Texture Recovery[paper][code]GANFREx

Vector Quantized Codebook Prior (good)

Year
Pub
Title
Links
Arch
Abbreviation
2022CVPRRestoreFormer: High-Quality Blind Face Restoration
from Undegraded Key-Value Pairs
[paper][code]ViTRestoreFormer
2022NeurIPSTowards Robust Blind Face Restoration with Codebook Lookup Transformer[paper][code]ViTCodeFormer
2022ECCVVQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder[paper][code]CNNVQFR
2023TPAMIRestoreFormer++: Towards Real-World Blind Face Restoration from Undegraded Key-Value Pairs[paper][code]ViTRestoreFormer++
2022CVPRRethinking Deep Face Restoration[paper][code]GAN-
2024ICLRDual Associated Encoder for Face Restoration[paper][code]ViTDAEFR

Diffusion Prior

Year
Pub
Title
Links
Arch
Abbreviation
2022ArxivDifface: Blind Face Restoration with Diffused Error Contraction[paper][code]DiffusionDifFace
2023CVPRDR2: Diffusion-based Robust Degradation Remover for Blind Face Restoration[paper][code]DiffusionDR2
2023WACVAT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models[paper][code]DiffusionAT-DDPM
2023ACMMMDiffBFR: Bootstrapping Diffusion Model for Blind Face Restoration[paper][code]DiffusionDiffBFR
2023NeurIPSPGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidance[paper][code]DiffusionPGDiff
2024TCSVTTowards Real-World Blind Face Restoration with Generative Diffusion Prior[paper][code]DiffusionBFRffusion
2024WACVDiffuse and Restore: A Region-Adaptive Diffusion Model for Identity-Preserving Blind Face Restoration[paper][code]Diffusion-
2024ECCVDiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior[paper][code]DiffusionDiffBIR
2024NeurIPSOne-Step Effective Diffusion Network for Real-World Image Super-Resolution[paper][code]DiffusionOSEDiff
2024ArxivOSDFace: One-Step Diffusion Model for Face Restoration[paper][code]DiffusionOSDFace

Others

Year
Pub
Title
Links
Arch
Abbreviation
2023ICCVTowards Authentic Face Restoration with Iterative Diffusion Models and Beyond[paper][code]DiffusionIDM
2024CVPRWaveFace: Authentic Face Restoration with Efficient Frequency Recovery[paper][code]DiffusionWaveFace
2024ArxivCLR-Face: Conditional Latent Refinement for Blind Face Restoration Using Score-Based Diffusion Models[paper][code]DiffusionCLR-Face
2024WACVDiffuse and Restore: A Region-Adaptive Diffusion Model for Identity-Preserving Blind Face Restoration[paper][code]DiffusionDiffuse and Restore
2024arXivAuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion Prior[paper][code]DiffusionAuthFace
2025ArxivInfoBFR: Real-World Blind Face Restoration via Information Bottleneck[paper][code]DiffusionInfoBFR
2025WACVTowards Unsupervised Blind Face Restoration using Diffusion Prior[paper][code]DiffusionDT-BFR

Blind Face Restoration (Video)

Year
Pub
Title
Links
Arch
Abbreviation
2023ArxivFLAIR: A Conditional Diffusion Framework with Applications to Face Video Restoration[paper][code]DiffusionFLAIR
2024IJCAIBeyond Alignment: Blind Video Face Restoration via Parsing-Guided Temporal-Coherent Transformer[paper][code]ViTPGTFormer
2024ECCVKEEP: Kalman-Inspired Feature Propagation for Video Face Super-Resolution[paper][code]ViTKEEP
2024TIPFIR2FVR: Analysis and Benchmarking of Extending Blind Face Image Restoration to Video[paper][code]GeneralFIR2FVR
2024ACMLUniversal Video Face Restoration Method Based on Vision-Language Model[paper][code]Diffusion-
2024ACM MMBlind Face Video Restoration with Temporal Consistent Generative Prior and Degradation-Aware Prompt[paper][code]DiffusionStableBFVR
2025CVPREfficient Video Face Enhancement with Enhanced Spatial-Temporal Consistency[paper][code]ViTBFVR-STC
2025ArXivKEEP: Kalman-Inspired Feature Propagation for Video Face Super-Resolution[paper][code]DiffusionSVFR

Datasets

Image Face Dataset

DatasetResolutionDescription
FFHQ1024 x 10247,0000 high-quality face images (usually used for training)
CelebA-HQ1024 x 10243,0000 high-quality face images (usually used for evaluation)
CelebAMask-HQ512 x 5123,0000 face images with 19 facial classes
CelebRef-HQ512 x 512high-quality face images with multiple same-identity references
EFHQ512 x 512Multi-purpose ExtremePose-Face-HQ dataset

Video Face Dataset

DatasetDescription
TalkingHead-1KH500k video clips, of which about 80k are greater than 512x512 resolution
VFHQ16,000 high-fidelity clips of diverse interview scenarios
CelebV-HQ35,666 video clips involving 15,653 identities and 83 manually labeled facial attributes

Contributors

qianx77

1 commits

qianx77/Face_Restoration_Ref

some works about face restoration

32

1 commits

updated Apr 3, 2025

See the code

README

Paper and Code

Inspired by sczhou Awesome-Face-Restoration and TaoWangzj Awesome-Face-Restoration.

Recommend

Several popular methods that perform well in my own test data.

Year
Pub
Abbreviation
Recommend
2021CVPRGFPGAN v1.4⭐️⭐️⭐️⭐️⭐️
2022NeurIPSCodeFormer⭐️⭐️⭐️⭐️⭐️
2021CVPRGPEN⭐️⭐️⭐️

Blind Face Restoration (Image)

Geometric Prior

Year
Pub
Title
Links
Arch
Abbreviation
2018CVPRFSRNet: End-to-End Learning Face Super-Resolution with Facial Priors[paper][code]CNNFSRNet
2021TPAMIFace Restoration via Plug-and-Play 3D Facial Priors[paper][code]CNN-
2021CVPRProgressive Semantic-Aware Style Transformation for Blind Face Restoration[paper][code]GANPSFRGAN
2023TNNLSMulti-prior learning via neural architecture search for blind face restoration[paper][code]CNNMFPSNet
2022CVPRBlind Face Restoration via Integrating Face Shape and Generative Priors[paper][code]GANSGPN

Reference Prior

Year
Pub
Title
Links
Arch
Abbreviation
2018ECCVLearning Warped Guidance for Blind Face Restoration[paper][code]CNNGFRNet
2020ECCVBlind Face Restoration via Deep Multi-scale Component Dictionaries[paper][code]CNNDFDNet
2020CVPREnhanced Blind Face Restoration with Multi-Exemplar Images
and Adaptive Spatial Feature Fusion
[paper][code]CNNASFFNet
2022TPAMILearning Dual Memory Dictionaries for Blind Face Restoration[paper][code]CNNDMDNet
2022ACMMyStyle: A Personalized Generative Prior[paper][code]GANMyStyle
2023arXivPersonalized Restoration via Dual-Pivot Tuning[paper][code]DiffusionDual-Pivot Tuning
2024arXivInstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attention[paper][code]DiffusionInstantRestore
2024CVPRPFStorer: Personalized Face Restoration and Super-Resolution[paper][code]DiffusionPFStorer
2024arXivRestorerID: Towards Tuning-Free Face Restoration with ID Preservation[paper][code]DiffusionRestorerID
2024arXivOvercoming False Illusions in Real-World Face Restoration with Multi-Modal GuidedDiffusion Model[paper][code]DiffusionMGFR
2024arXivCopy or Not? Reference-Based Face Image Restoration with Fine Details[paper][code]DiffusionRefineFIR
2024SensorsPDGrad: Guiding Diffusion Model for Reference-Based Blind Face Restoration with Pivot Direction Gradient Guidance[paper][code]DiffusionPDGrad
2024CVPRRestoration by Generation with Constrained Priors[paper][code]Diffusiongen2res
2024WACVENTED: Enhanced Neural Texture Extraction and Distribution for Reference-based Blind Face Restoration[paper][code]DiffusionENTED
2025AAAIFaceMe: Robust Blind Face Restoration with Personal Identification[paper][code]DiffusionFaceMe

Generative Prior (good)

Year
Pub
Title
Links
Arch
Abbreviation
2020MMHiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment[paper][code]GANHiFaceGAN
2020CVPRImage Processing Using Multi-Code GAN Prior[paper][code]GANmGANprior
2021CVPRTowards Real-World Blind Face Restoration with Generative Facial Prior[paper][code]GANGFPGAN
2021CVPRGAN Prior Embedded Network for Blind Face Restoration in the Wild[paper][code]GANGPEN
2022CVPRBlind Face Restoration via Integrating Face Shape and Generative Priors[paper][code]GANSGPN
2022CVPRGCFSR: a Generative and Controllable Face Super Resolution Method Without Facial and GAN Priors[paper][code]GANGCFSR
2022AAAIPanini-Net: GAN Prior Based Degradation-Aware Feature Interpolation for Face Restoration[paper][code]GANPanini-Net
2022ArxivFaceFormer: Scale-aware Blind Face Restoration with Transformers[paper][code]ViTFaceFormer
2022ArxivBlind Face Restoration: Benchmark Datasets and a Baseline Model[paper][code]ViTSTUNet
2023CVPRTFRGAN: Leveraging Text Information for Blind Face Restoration with Extreme Degradation[paper][code]GANTFRGAN
2023TCSVTDEAR-GAN: Degradation-Aware Face Restoration With GAN Prior[paper][code]GANDEAR-GAN
2023ACMMMExploring Correlations in Degraded Spatial Identity Features for Blind Face Restoration[paper][code]GANMemGAN
2023FSPDegradation Learning and Skip-Transformer for Blind Face Restoration[paper][code]GAN-
2023ACMMMExploring Correlations in Degraded Spatial Identity Features for Blind Face Restoration[paper][code]GAN-
2024AAAIBlind Face Restoration under Extreme Conditions: Leveraging 3D-2D Prior Fusion for Superior Structural and Texture Recovery[paper][code]GANFREx

Vector Quantized Codebook Prior (good)

Year
Pub
Title
Links
Arch
Abbreviation
2022CVPRRestoreFormer: High-Quality Blind Face Restoration
from Undegraded Key-Value Pairs
[paper][code]ViTRestoreFormer
2022NeurIPSTowards Robust Blind Face Restoration with Codebook Lookup Transformer[paper][code]ViTCodeFormer
2022ECCVVQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder[paper][code]CNNVQFR
2023TPAMIRestoreFormer++: Towards Real-World Blind Face Restoration from Undegraded Key-Value Pairs[paper][code]ViTRestoreFormer++
2022CVPRRethinking Deep Face Restoration[paper][code]GAN-
2024ICLRDual Associated Encoder for Face Restoration[paper][code]ViTDAEFR

Diffusion Prior

Year
Pub
Title
Links
Arch
Abbreviation
2022ArxivDifface: Blind Face Restoration with Diffused Error Contraction[paper][code]DiffusionDifFace
2023CVPRDR2: Diffusion-based Robust Degradation Remover for Blind Face Restoration[paper][code]DiffusionDR2
2023WACVAT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models[paper][code]DiffusionAT-DDPM
2023ACMMMDiffBFR: Bootstrapping Diffusion Model for Blind Face Restoration[paper][code]DiffusionDiffBFR
2023NeurIPSPGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidance[paper][code]DiffusionPGDiff
2024TCSVTTowards Real-World Blind Face Restoration with Generative Diffusion Prior[paper][code]DiffusionBFRffusion
2024WACVDiffuse and Restore: A Region-Adaptive Diffusion Model for Identity-Preserving Blind Face Restoration[paper][code]Diffusion-
2024ECCVDiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior[paper][code]DiffusionDiffBIR
2024NeurIPSOne-Step Effective Diffusion Network for Real-World Image Super-Resolution[paper][code]DiffusionOSEDiff
2024ArxivOSDFace: One-Step Diffusion Model for Face Restoration[paper][code]DiffusionOSDFace

Others

Year
Pub
Title
Links
Arch
Abbreviation
2023ICCVTowards Authentic Face Restoration with Iterative Diffusion Models and Beyond[paper][code]DiffusionIDM
2024CVPRWaveFace: Authentic Face Restoration with Efficient Frequency Recovery[paper][code]DiffusionWaveFace
2024ArxivCLR-Face: Conditional Latent Refinement for Blind Face Restoration Using Score-Based Diffusion Models[paper][code]DiffusionCLR-Face
2024WACVDiffuse and Restore: A Region-Adaptive Diffusion Model for Identity-Preserving Blind Face Restoration[paper][code]DiffusionDiffuse and Restore
2024arXivAuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion Prior[paper][code]DiffusionAuthFace
2025ArxivInfoBFR: Real-World Blind Face Restoration via Information Bottleneck[paper][code]DiffusionInfoBFR
2025WACVTowards Unsupervised Blind Face Restoration using Diffusion Prior[paper][code]DiffusionDT-BFR

Blind Face Restoration (Video)

Year
Pub
Title
Links
Arch
Abbreviation
2023ArxivFLAIR: A Conditional Diffusion Framework with Applications to Face Video Restoration[paper][code]DiffusionFLAIR
2024IJCAIBeyond Alignment: Blind Video Face Restoration via Parsing-Guided Temporal-Coherent Transformer[paper][code]ViTPGTFormer
2024ECCVKEEP: Kalman-Inspired Feature Propagation for Video Face Super-Resolution[paper][code]ViTKEEP
2024TIPFIR2FVR: Analysis and Benchmarking of Extending Blind Face Image Restoration to Video[paper][code]GeneralFIR2FVR
2024ACMLUniversal Video Face Restoration Method Based on Vision-Language Model[paper][code]Diffusion-
2024ACM MMBlind Face Video Restoration with Temporal Consistent Generative Prior and Degradation-Aware Prompt[paper][code]DiffusionStableBFVR
2025CVPREfficient Video Face Enhancement with Enhanced Spatial-Temporal Consistency[paper][code]ViTBFVR-STC
2025ArXivKEEP: Kalman-Inspired Feature Propagation for Video Face Super-Resolution[paper][code]DiffusionSVFR

Datasets

Image Face Dataset

DatasetResolutionDescription
FFHQ1024 x 10247,0000 high-quality face images (usually used for training)
CelebA-HQ1024 x 10243,0000 high-quality face images (usually used for evaluation)
CelebAMask-HQ512 x 5123,0000 face images with 19 facial classes
CelebRef-HQ512 x 512high-quality face images with multiple same-identity references
EFHQ512 x 512Multi-purpose ExtremePose-Face-HQ dataset

Video Face Dataset

DatasetDescription
TalkingHead-1KH500k video clips, of which about 80k are greater than 512x512 resolution
VFHQ16,000 high-fidelity clips of diverse interview scenarios
CelebV-HQ35,666 video clips involving 15,653 identities and 83 manually labeled facial attributes

Contributors

qianx77

1 commits