📖 Face Generation and Editing with StyleGAN: A Survey

Survey link: https://arxiv.org/abs/2212.09102

@article{melnik2024face,
  title={Face Generation and Editing with StyleGAN: A Survey},
  author={Melnik, Andrew and Miasayedzenkau, Maksim and Makaravets, Dzianis and Pirshtuk, Dzianis and Akbulut, Eren and Holzmann, Dennis and Renusch, Tarek and Reichert, Gustav and Ritter, Helge},
  journal={IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year={2024},
  publisher={IEEE}
}

---

Papers

Click to see Figures

• 2023, 2022, 2021, 2020, 2019, 2018, 2017, 2016

2023

📄 FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention
_{[Paper] [Project] [Github] CVPR
^{Guangxuan Xiao, Tianwei Yin, William T. Freeman, Frédo Durand, Song Han}}

📄 Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold
_{[Paper] [Project] [Github] SIGGRAPH
^{Xingang Pan, Ayush Tewari, Thomas Leimkühler,Lingjie Liu, Abhimitra Meka, Christian Theobalt}}

📄 Collaborative Diffusion for Multi-Modal Face Generation and Editing
_{[Paper] [Project] [Github] CVPR
^{Ziqi Huang, Kelvin C.K. Chan, Yuming Jiang, Ziwei Liu}}

📄 Towards Real-time Text-driven Image Manipulation with Unconditional Diffusion Models
_{[Paper] arxiv
^{Nikita Starodubcev, Dmitry Baranchuk, Valentin Khrulkov, Artem Babenko}}

📄 DR2: Diffusion-based Robust Degradation Remover for Blind Face Restoration
_{[Paper] arxiv
^{Zhixin Wang, Xiaoyun Zhang, Ziying Zhang, Huangjie Zheng, Mingyuan Zhou, Ya Zhang, Yanfeng Wang}}

📄LinkGAN: Linking GAN Latents to Pixels for Controllable Image Synthesis
_{[Paper] [Project] [Github] arxiv ^{Jiapeng Zhu, Ceyuan Yang, Yujun Shen, Zifan Shi, Deli Zhao, Qifeng Chen}}

📄 FastSwap: A Lightweight One-Stage Framework for Real-Time Face Swapping
_{[Paper] [Project] [Github] WACV
^{Sahng-Min Yoo, Tae-Min Choi, Jae-Woo Choi, Jong-Hwan Kim}}

📄 SLI-pSp: Injecting Multi-Scale Spatial Layout in pSp
_{[Paper] WACV
^{Aradhya Neeraj Mathur, Anish Madan, Ojaswa Sharma}}

2022

📄 Face Generation and Editing with StyleGAN: A Survey
[Paper] arxiv
_{^{Andrew Melnik, Maksim Miasayedzenkau, Dzianis Makarovets, Dzianis Pirshtuk, Eren Akbulut, Dennis Holzmann, Tarek Renusch, Gustav Reichert, Helge Ritter}}

📄 3D Cartoon Face Generation with Controllable Expressions from a Single GAN Image
[Paper] arxiv
_{^{Hao Wang, Guosheng Lin, Steven C. H. Hoi, Chunyan Miao}}

📄 Faces: AI Blitz XIII Solutions
[Paper] [Github] arxiv
_{^{Andrew Melnik, Eren Akbulut, Jannik Sheikh, Kira Loos, Michael Buettner, Tobias Lenze}}

📄 SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
_{[Paper] [Project] [Github] CVPR
^{Ziqi Huang, Kelvin C.K. Chan, Yuming Jiang, Ziwei Liu}}

📄 MyStyle: A Personalized Generative Prior
[Paper] [Github] [Video] arxiv
_{^{Yotam Nitzan, Kfir Aberman, Qiurui He, Orly Liba, Michal Yarom, Yossi Gandelsman, Inbar Mosseri, Yael Pritch, Daniel Cohen-or}}

📄 Third Time's the Charm? Image and Video Editing with StyleGAN3
[Paper] [Github] arxiv
_{^{Yuval Alaluf, Or Patashnik, Zongze Wu, Asif Zamir, Eli Shechtman, Dani Lischinski, Daniel Cohen-Or}}

📄 E2Style: Improve the Efficiency and Effectiveness of StyleGAN Inversion
[Paper] [Github] IEEE Transactions on Image Processing
_{^{Tianyi Wei, Dongdong Chen, Wenbo Zhou, Jing Liao, Weiming Zhang, Lu Yuan, Gang Hua, Nenghai Yu}}

📄 Unsupervised face frontalization using disentangled representation-learning CycleGAN
[Paper] Computer Vision and Image Understanding
_{^{Yanfei Liu Junhua Chen}}

2021

📄 HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editing
[Paper] [Github] [Video] CVPR
_{^{Yuval Alaluf, Omer Tov, Ron Mokady, Rinon Gal, Amit H. Bermano}}

📄 Fine-Tuning StyleGAN2 For Cartoon Face Generation
[Paper] arxiv
_{^{Jihye Back}}

📄 Pivotal Tuning for Latent-based Editing of Real Images
[Paper] [Github] ACM
_{^{Daniel Roich, Ron Mokady, Amit H. Bermano, Daniel Cohen-Or}}

📄 Transforming the Latent Space of StyleGAN for Real Face Editing
[Paper] [Github] arxiv
_{^{Heyi Li, Jinlong Liu, Xinyu Zhang, Yunzhi Bai, Huayan Wang, Klaus Mueller}}

📄 One Shot Face Swapping on Megapixels
[Paper] [Github] CVPR
_{^{Yuhao Zhu, Qi Li, Jian Wang, Chengzhong Xu, Zhenan Sun}}

📄 ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinement
[Paper] [Github] [Video] ICCV
_{^{Yuval Alaluf, Or Patashnik, Daniel Cohen-Or}}

📄 Designing an Encoder for StyleGAN Image Manipulation
[Paper] [Github] [Video] arxiv
_{^{Omer Tov, Yuval Alaluf, Yotam Nitzan, Or Patashnik, Daniel Cohen-Or}}

📄 StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery
[Paper] [Github] [Video] IEEE/CVF
_{^{Or Patashnik, Zongze Wu, Eli Shechtman, Daniel Cohen-Or, Dani Lischinski}}

📄 StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generators
[Paper] [Github] CoRR
_{^{Rinon Gal, Or Patashnik, Haggai Maron, Gal Chechik, Daniel Cohen-Or}}

📄 Alias-Free Generative Adversarial Networks
[Paper] [Github] [Video] NeurIPS
_{^{Tero Karras, Miika Aittala, Samuli Laine, Erik Härkönen, Janne Hellsten, Jaakko Lehtinen, Timo Aila}}

📄 Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinement
[Paper] [Video] IEEE/CVF
_{^{Huiwen Luo, Koki Nagano, Han-Wei Kung, Mclean Goldwhite, Qingguo Xu, Zejian Wang, Lingyu Wei, Liwen Hu, Hao Li}}

📄 Learning Transferable Visual Models From Natural Language Supervision
[Paper] [Github] PMLR
_{^{Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, Ilya Sutskever}}

📄 StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation
[Paper] [Github] [Video] ACM
_{^{Wonjong Jang, Gwangjin Ju, Yucheol Jung, Jiaolong Yang, Xin Tong, Seungyong Lee}}

📄 Towards Real-World Blind Face Restoration with Generative Facial Prior
[Paper] [Github] IEEE/CVF
_{^{Xintao Wang, Yu Li, Honglun Zhang, Ying Shan}}

📄 Positional Encoding as Spatial Inductive Bias in GANs
[Paper] IEEE/CVF 2021
_{^{Rui Xu, Xintao Wang, Kai Chen, Bolei Zhou, Chen Change Loy}}

📄 Designing an Encoder for StyleGAN Image Manipulation
[Paper] [Github] ACM
_{^{Omer Tov, Yuval Alaluf, Yotam Nitzan, Or Patashnik, Daniel Cohen-Or}}

📄 BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generation
[Paper] [Github] Advances in Neural Information Processing Systems
_{^{Mingcong Liu, Qiang Li, Zekui Qin, Guoxin Zhang, Pengfei Wan, Wen Zheng}}

📄 StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation
[Paper] [Github] [Video] CVPR
_{^{Zongze Wu, Dani Lischinski, Eli Shechtman}}

2020

📄 Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation
[Paper] [Github] [Video] CVPR
_{^{Elad Richardson, Yuval Alaluf, Or Patashnik, Yotam Nitzan, Yaniv Azar, Stav Shapiro, Daniel Cohen-Or}}

📄 Training Generative Adversarial Networks with Limited Data
[Paper] [Github] arxiv
_{^{Tero Karras, Miika Aittala, Janne Hellsten, Samuli Laine, Jaakko Lehtinen, Timo Aila}}

📄 The Creation and Detection of Deepfakes: A Survey
[Paper] CSUR
_{^{Yisroel Mirsky, Wenke Lee}}

📄 StyleRig: Rigging StyleGAN for 3D Control over Portrait Images
[Paper] IEEE/CVF
_{^{Ayush Tewari, Mohamed Elgharib, Gaurav Bharaj, Florian Bernard, Hans-Peter Seidel, Patrick Pérez, Michael Zollhöfer, Christian Theobalt}}

📄 Media Forensics and DeepFakes: an overview
[Paper] IEEE Journal of Selected Topics in Signal Processing
_{^{Luisa Verdoliva}}

📄 Neural Head Reenactment with Latent Pose Descriptors
[Paper] [Github] CVPR
_{^{Egor Burkov, Igor Pasechnik, Artur Grigorev, Victor Lempitsky}}

📄 GAN Compression: Efficient Architectures for Interactive Conditional GANs
[Paper] [Github] [Video] CVPR
_{^{Muyang Li, Ji Lin, Yaoyao Ding, Zhijian Liu, Jun-Yan Zhu, Song Han}}

📄 StyleGAN2 Distillation for Feed-forward Image Manipulation
[Paper] [Github] Springer
_{^{Yuri Viazovetskyi, Vladimir Ivashkin, Evgeny Kashin}}

📄 Collaborative Learning for Faster StyleGAN Embedding
[Paper] [Github] arxiv
_{^{Shanyan Guan, Ying Tai, Bingbing Ni, Feida Zhu, Feiyue Huang, Xiaokang Yang}}

📄 In-Domain GAN Inversion for Real Image Editing
[Paper] [Github] arxiv
_{^{Jiapeng Zhu, Yujun Shen, Deli Zhao, Bolei Zhou}}

📄 Interpreting the Latent Space of GANs for Semantic Face Editing
[Paper] CVPR
_{^{Yujun Shen, Jinjin Gu, Xiaoou Tang, Bolei Zhou}}

📄 GANSpace: Discovering Interpretable GAN Controls
[Paper] [Github] Advances in Neural Information Processing Systems
_{^{Erik Härkönen, Aaron Hertzmann, Jaakko Lehtinen, Sylvain Paris}}

📄 Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domains
[Paper] arxiv
_{^{Justin N. M. Pinkney, Doron Adler}}

📄 Advancing High Fidelity Identity Swapping for Forgery Detection
[Paper] CVPR
_{^{Lingzhi Li, Jianmin Bao, Hao Yang, Dong Chen, Fang Wen}}

2019

📄 Analyzing and Improving the Image Quality of StyleGAN
[Paper] [Github] [Video] IEEE/CVF
_{^{Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, Timo Aila}}

📄 Unconstrained Facial Expression Transfer using Style-based Generator
[Paper] arxiv
_{^{Chao Yang, Ser-Nam Lim}}

📄 Image2StyleGAN++: How to Edit the Embedded Images?
[Paper] [Video] IEEE/CVF
_{^{Rameen Abdal, Yipeng Qin, Peter Wonka}}

📄 Deep Learning for Deepfakes Creation and Detection: A Survey
[Paper] arxiv
_{^{Thanh Thi Nguyen, Quoc Viet Hung Nguyen, Dung Tien Nguyen, Duc Thanh Nguyen, Thien Huynh-The, Saeid Nahavandi, Thanh Tam Nguyen, Quoc-Viet Pham, Cuong M. Nguyen}}

📄 Mining Audio, Text and Visual Information for Talking Face Generation
[Paper] ICDM
_{^{L. Yu, J. Yu, and Q. Ling}}

📄 FReeNet: Multi-Identity Face Reenactment
[Paper] arxiv
_{^{Jiangning Zhang, Xianfang Zeng, Mengmeng Wang, Yusu Pan, Liang Liu, Yong Liu, Yu Ding, Changjie Fan}}

2018

📄 A Style-Based Generator Architecture for Generative Adversarial Networks
[Paper] [Github] [Video] IEEE/CVF
_{^{Tero Karras, Samuli Laine, Timo Aila}}

📄 Video-to-Video Synthesis
[Paper] [Github] [Video] NeurIPS
_{^{Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu, Guilin Liu, Andrew Tao, Jan Kautz, Bryan Catanzaro}}

📄 End-to-End Speech-Driven Facial Animation with Temporal GANs
[Paper] BMVC
_{^{Konstantinos Vougioukas, Stavros Petridis, Maja Pantic}}

📄 Talking Face Generation by Conditional Recurrent Adversarial Network
[Paper] [Github] arxiv
_{^{Yang Song, Jingwen Zhu, Dawei Li, Xiaolong Wang, Hairong Qi}}

📄 Unsupervised Depth Estimation, 3D Face Rotation and Replacement
[Paper] [Github] NeurIPS
_{^{Tero Karras, Samuli Laine, Timo Aila}}

📄 ArcFace: Additive Angular Margin Loss for Deep Face Recognition
[Paper] [Github] IEEE/CVF
_{^{Jiankang Deng, Jia Guo, Jing Yang, Niannan Xue, Irene Kotsia, Stefanos Zafeiriou}}

📄 The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
[Paper] [Github] CVPR
_{^{Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shechtman, Oliver Wang}}

📄 Photorealistic Monocular Gaze Redirection Using Machine Learning
[Paper] IEEE
_{^{D. Kononenko, Y. Ganin, D. Sungatullina, and V. Lempitsky}}

2017

📄 The Perception-Distortion Tradeoff
[Paper] IEEE/CVPR
_{^{Yochai Blau, Tomer Michaeli}}

📄 Progressive Growing of GANs for Improved Quality, Stability, and Variation
[Paper] [Github] ICLR
_{^{Tero Karras, Timo Aila, Samuli Laine, Jaakko Lehtinen}}

📄 MoCoGAN: Decomposing Motion and Content for Video Generation
[Paper] [Github] IEEE/CVF
_{^{Sergey Tulyakov, Ming-Yu Liu, Xiaodong Yang, Jan Kautz}}

📄 GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
[Paper] [Github] Advances in neural information processing systems
_{^{Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, Sepp Hochreiter}}

📄 Representation Learning by Rotating Your Faces
[Paper] IEEE Transactions on Pattern Analysis and Machine Intelligence
_{^{Luan Tran, Xi Yin, Xiaoming Liu}}

📄 On Convergence and Stability of GANs
[Paper] [Github] arxiv
_{^{Naveen Kodali, Jacob Abernethy, James Hays, Zsolt Kira}}

📄 Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization
[Paper] [Github] ICCV
_{^{Xun Huang, Serge Belongie}}

📄 Precise Recovery of Latent Vectors from Generative Adversarial Networks
[Paper] arxiv
_{^{Zachary C. Lipton, Subarna Tripathi}}

📄 Automated face swapping and its detection
[Paper] ICSIP
_{^{Y. Zhang, L. Zheng, and V. L. L. Thing}}

📄 Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
[Paper] [Github] CoRR
_{^{Jun-Yan Zhu, Taesung Park, Phillip Isola, Alexei A. Efros}}

2016

📄 Perceptual Losses for Real-Time Style Transfer and Super-Resolution
[Paper] Springer
_{^{Justin Johnson, Alexandre Alahi, Li Fei-Fei}}

📄 Face2Face: Real-time Face Capture and Reenactment of RGB Videos
[Paper] IEEE conference on computer vision and pattern recognition
_{^{Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt, Matthias Nießner}}