Gan Pei * . Jiangning Zhang * . Menghan Hu . Zhenyu Zhang . Chengjie Wang . Yunsheng Wu.
Guangtao Zhai . Jian Yang . Chunhua Shen . Dacheng Tao
This work focuses on the aspect of facial manipulation in Deepfake, encompassing Face Swapping, Face Reenactment, Talking Face Generation, Face Attribute Editing and Forgery Detection. We believe this will be the most comprehensive survey to date on facial manipulation and detection technologies. Please stay tuned!😉😉😉
✨You are welcome to provide us your work with a topic related to deepfake generation or detection!!!
If you discover any missing work or have any suggestions, please feel free to submit a pull request or contact us. We will promptly add the missing papers to this repository.
[1] A comprehensive survey for visual Deepfake, including Deepfake generation/detection.
[2] It also contains several related domains, including Heas Swapping, Face Super-resolution, Face Reconstruction, Face Inpainting, Body Animation, Portrait Style Transfer, Makeup Transfer and Adversarial Sample Detection.
[3] We list detailed results for the most representative works.
This work presents a detailed survey on generation and detection tasks about face-related generation, including Face Swapping, Face Reenactment, Talking Face Generation, and Face Attribute Editing. In addition, we also introduce several related fields such as Head Swap, Face Super-resolution, Face Reconstruction, Face Inpainting, etc., and select some of them to expand.
Year | Venue | Paper Title | Code |
---|---|---|---|
2024 | arXiv | Towards Real-world Video Face Restoration: A New Benchmark | Code |
2024 | arXiv | Efficient Diffusion Model for Image Restoration by Residual Shifting | Code |
2024 | arXiv | PFStorer: Personalized Face Restoration and Super-Resolution | - |
2024 | arXiv | DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior | Code |
2024 | AAAI | ResDiff: Combining CNN and Diffusion Model for Image Super-Resolution | Code |
2024 | AAAI | Low-Light Face Super-resolution via Illumination, Structure, and Texture Associated Representation | Code |
2024 | AAAI | SkipDiff: Adaptive Skip Diffusion Model for High-Fidelity Perceptual Image Super-resolution | - |
2024 | WACV | Arbitrary-Resolution and Arbitrary-Scale Face Super-Resolution With Implicit Representation Networks | - |
2024 | ICASSP | Adaptive Super Resolution for One-Shot Talking-Head Generation | Code |
2023 | CVPR | Spatial-Frequency Mutual Learning for Face Super-Resolution | Code |
2023 | TIP | CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolution | Code |
2023 | TIP | Semi-Cycled Generative Adversarial Networks for Real-World Face Super-Resolution | Code |
2023 | TMM | An Efficient Latent Style Guided Transformer-CNN Framework for Face Super-Resolution | Code |
2023 | TMM | Exploiting Multi-Scale Parallel Self-Attention and Local Variation via Dual-Branch Transformer-CNN Structure for Face Super-Resolution | - |
2023 | NN | Self-attention learning network for face super-resolution | - |
2023 | PR | A Composite Network Model for Face Super-Resolution with Multi-Order Head Attention Facial Priors | - |
2022 | CVPR | GCFSR: A Generative and Controllable Face Super Resolution Method Without Facial and GAN Priors | Code |
2022 | ECCV | From Face to Natural Image: Learning Real Degradation for Blind Image Super-Resolution | Code |
2022 | TCSVT | Propagating Facial Prior Knowledge for Multitask Learning in Face Super-Resolution | Code |
2022 | NN | Multi-level landmark-guided deep network for face super-resolution | Code |
Year | Venue | Paper Title | Code |
---|---|---|---|
2024 | arXiv | ToonAging: Face Re-Aging upon Artistic Portrait Style Transfer | - |
2024 | arXiv | CtlGAN: Few-shot Artistic Portraits Generation with Contrastive Transfer Learning | - |
2024 | Displays | HiStyle: Reinventing historic portraits via 3D generative model | - |
2024 | ICASSP | A Framework for Portrait Stylization with Skin-Tone Awareness and Nudity Identification | - |
2024 | ICASSP | Learning Discriminative Style Representations for Unsupervised and Few-Shot Artistic Portrait Drawing Generation | Code |
2024 | TMM | Towards High-Quality Photorealistic Image Style Transfer | - |
2024 | TMM | FaceRefiner: High-Fidelity Facial Texture Refinement with Differentiable Rendering-based Style Transfer | - |
2024 | CVPR | Deformable One-shot Face Stylization via DINO Semantic Guidancen | Code |
2024 | AAAI | MagiCapture: High-Resolution Multi-Concept Portrait Customization | - |
2024 | AAAI | ArtBank: Artistic Style Transfer with Pre-trained Diffusion Model and Implicit Style Prompt Bank | Code |
2024 | TNNLS | Few-Shot Face Stylization via GAN Prior Distillation | - |
2023 | arXiv | PP-GAN : Style Transfer from Korean Portraits to ID Photos Using Landmark Extractor with GAN | - |
2023 | TNNLS | Unpaired Artistic Portrait Style Transfer via Asymmetric Double-Stream GAN | - |
2023 | CVPR | Inversion-Based Style Transfer With Diffusion Models | Code |
2023 | ICCV | General Image-to-Image Translation with One-Shot Image Guidance | Code |
2023 | ACM TOG | A Unified Arbitrary Style Transfer Framework via Adaptive Contrastive Learning | Code |
2023 | Neurocomputing | Caster: Cartoon style transfer via dynamic cartoon style casting | - |
2023 | IJCV | Learning Portrait Drawing with Unsupervised Parts | - |
2022 | CVPR | Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer | Code |
2022 | ACM TOG | VToonify: Controllable High-Resolution Portrait Video Style Transfer | Code |
2022 | ACM TOG | DCT-net: domain-calibrated translation for portrait stylization | Code |
2022 | ACM TOG | SofGAN: A Portrait Image Generator with Dynamic Styling | - |
Year | Venue | Paper Title | Code |
---|---|---|---|
2024 | arXiv | Large Motion Model for Unified Multi-Modal Motion Generation | Code |
2024 | arXiv | Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance | Code |
2024 | arXiv | Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance | Code |
2024 | AAAI | PTUS: Photo-Realistic Talking Upper-Body Synthesis via 3D-Aware Motion Decomposition Warping | Code |
2024 | CVPR | Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion | Code |
2024 | CVPR | DISCO: Disentangled Control for Realistic Human Dance Generation | Code |
2024 | CVPR | MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model | Code |
2024 | CVPR | GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians | Code |
2023 | arXiv | TADA! Text to Animatable Digital Avatars | Code |
2023 | WACV | Physically Plausible Animation of Human Upper Body From a Single Image | - |
2023 | ICCV | Towards Multi-Layered 3D Garments Animation | Code |
2023 | ICCV | Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation | Code |
2023 | CVPR | Learning anchor transformations for 3d garment animation | - |
2022 | IJCAI | Text/Speech-Driven Full-Body Animation | Code |
2022 | SIGGRAPH | Capturing and Animation of Body and Clothing from Monocular Video | - |
2022 | NeurIPS | CageNeRF: Cage-based Neural Radiance Field for Generalized 3D Deformation and Animation | Code |
Year | Venue | Paper Title | Code |
---|---|---|---|
2024 | arXiv | Gorgeous: Create Your Desired Character Facial Makeup from Any Ideas | Code |
2024 | arXiv | Toward Tiny and High-quality Facial Makeup with Data Amplify Learning | Code |
2024 | arXiv | Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Model | - |
2024 | CVPR | Makeup Prior Models for 3D Facial Makeup Estimation and Applications | Code |
2024 | ESWA | ISFB-GAN: Interpretable semantic face beautification with generative adversarial network | - |
2024 | TVCG | MuNeRF: Robust Makeup Transfer in Neural Radiance Fields | - |
2024 | ICASSP | Skin tone disentanglement in 2D makeup transfer with graph neural networks | - |
2024 | WACV | LipAT: Beyond Style Transfer for Controllable Neural Simulation of Lipstick Using Cosmetic Attributes | - |
2023 | arXiv | SARA: Controllable Makeup Transfer with Spatial Alignment and Region-Adaptive Normalization | - |
2023 | TNNLS | SSAT++: A Semantic-Aware and Versatile Makeup Transfer Network With Local Color Consistency Constraint | Code |
2023 | CVPR | BeautyREC: Robust, Efficient, and Component-Specific Makeup Transfer | Code |
2023 | TCSVT | Hybrid Transformers with Attention-guided Spatial Embeddings for Makeup Transfer and Removal | - |
2022 | ICCV | EleGANt: Exquisite and Locally Editable GAN for Makeup Transfer | Code |
2022 | AAAI | SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removal | Code |
2022 | Knowledge-Based Systems | TSEV-GAN: Generative Adversarial Networks with Target-aware Style Encoding and Verification for facial makeup transfer | - |
2022 | Knowledge-Based Systems | CUMTGAN: An instance-level controllable U-Net GAN for facial makeup transfer | - |
2021 | CVPR | Lipstick ain’t enough: beyond color matching for in-the-wild makeup | Code |
2021 | T-PAMI | Psgan++: Robust detail-preserving makeup transfer and removal | Code |
2020 | CVPR | PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfer | Code |
2019 | CVPR | Beautyglow : On-demand makeup transfer framework with reversible generative network | Code |
2019 | ICCV | Ladn: Local adversarial disentangling network for facial makeup and de-makeup | Code |
2018 | ACM MM | BeautyGAN: Instance-level Facial Makeup Transfer with Deep Generative Adversarial Network | Code |
2018 | CVPR | Pairedcyclegan: Asymmetric style transfer for applying and removing makeup | - |
2017 | AAAI | Examples-rules guided deep neural network for makeup recommendation | - |
If you find our survey and repository useful for your research project, please consider citing our paper:
@article{pei2024deepfake,
title={Deepfake Generation and Detection: A Benchmark and Survey},
author={Pei, Gan and Zhang, Jiangning and Hu, Menghan and Zhang, Zhenyu and Wang, Chengjie and Wu, Yunsheng and Zhai, Guangtao and Yang, Jian and Shen, Chunhua and Tao, Dacheng},
journal={arXiv preprint arXiv:2403.17881},
year={2024}
}
51265904018@stu.ecnu.edu.cn
186368@zju.edu.cn