AOT: Appearance Optimal Transport Based Identity Swapping for Forgery Detection
Open accessAbstract
Recent studies have shown that the performance of forgery detection can be improved with diverse and challenging Deepfakes datasets. However, due to the lack of Deepfakes datasets with large variance in appearance, which can be hardly produced by recent identity swapping methods, the detection algorithm may fail in this situation. In this work, we provide a new identity swapping algorithm with large differences in appearance for face forgery detection. The appearance gaps mainly arise from the large discrepancies in illuminations and skin colors that widely exist in real-world scenarios. However, due to the difficulties of modeling the complex appearance mapping, it is challenging to transfer fine-grained appearances adaptively while preserving identity traits. This paper formulates appearance mapping as an optimal transport problem and proposes an Appearance Optimal Transport model (AOT) to formulate it in both latent and pixel space. Specifically, a relighting generator is designed to simulate the optimal transport plan. It is solved via minimizing the Wasserstein distance of the learned features in the latent space, enabling better performance and less computation than conventional optimization. To further refine the solution of the optimal transport plan, we develop a segmentation game to minimize the Wasserstein distance in the pixel space. A discriminator is introduced to distinguish the fake parts from a mix of real and fake image patches. Extensive experiments reveal that the superiority of our method when compared with state-of-the-art methods and the ability of our generated data to improve the performance of face forgery detection.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The optimization target of AOT is minimizing the Wasserstein distance of learned features in latent space, enabling better performance and less computation than conventional optimization.
“The optimization target is minimizing the Wasserstein distance of the learned features in the latent space, which enables better performance and less computation than conventional optimization.”
From Countering Malicious DeepFakes: Survey, Battleground, and Horizon (2022) · cites this paper as Zhu et al. 2020
A relighting module is designed to simulate the optimal transport plan.
“In particular, a relighting module is designed to simulate the optimal transport plan.”
From Countering Malicious DeepFakes: Survey, Battleground, and Horizon (2022) · cites this paper as Zhu et al. 2020
The AOT model formulates appearance mapping in both latent and spatial space.
“They have proposed an AOT model to formulate it in both latent and spatial space.”
From Countering Malicious DeepFakes: Survey, Battleground, and Horizon (2022) · cites this paper as Zhu et al. 2020
Appearance optimal transport (AOT) has formulated appearance mapping as an optimal transport problem.
“Appearance optimal transport (AOT) (Zhu et al. 2020) has formulated appearance mapping as an optimal transport problem.”
From Countering Malicious DeepFakes: Survey, Battleground, and Horizon (2022) · cites this paper as Zhu et al. 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · see citing works
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892 · see citing works
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380 · see citing works
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,268 · see citing works
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570 · see citing works
CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features
Yun, S., Han, D., Chun, S., Oh, S. J., Yoo, Y., & Choe, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00612 · Cited by 5,400 · see citing works
Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076 · see citing works
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. R. (1999) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/311535.311556 · Cited by 4,695 · see citing works
Temporal Segment Networks: Towards Good Practices for Deep Action Recognition
Wang, L., Xiong, Y., Wang, Z., Qiao, Y., Lin, D., Tang, X., & Gool, L. V. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_2 · Cited by 4,164 · see citing works
Holistically-Nested Edge Detection
Xie, S., & Tu, Z. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.164 · Cited by 3,401 · see citing works
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314 · see citing works
Reinhard, E., Adhikhmin, M., Gooch, B., & Shirley, P. S. (2001) · IEEE Computer Graphics and Applications · doi:10.1109/38.946629 · Cited by 2,949 · see citing works
Sinkhorn Distances: Lightspeed Computation of Optimal TransportPreprint
Cuturi, M. (2013) · Cited by 2,385 · see citing works
Rich Models for Steganalysis of Digital Images
Fridrich, J., & Kodovsky, J. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190402 · Cited by 2,144 · see citing works
Pérez, P., Gangnet, M., & Blake, A. (2003) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1201775.882269 · Cited by 2,041 · see citing works
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872 · see citing works
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747 · see citing works
Exposing Deep Fakes Using Inconsistent Head Poses
Yang, X., Li, Y., & Lyu, S. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683164 · Cited by 1,196 · see citing works
Optimal Transport for Domain Adaptation
Courty, N., Flamary, R., Tuia, D., & Rakotomamonjy, A. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2615921 · Cited by 1,027 · see citing works
FaceWarehouse: A 3D Facial Expression Database for Visual Computing
Cao, C., Weng, Y., Zhou, S., Tong, Y., & Zhou, K. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.249 · Cited by 1,023 · see citing works
Computational Optimal Transport
Gabriel Peyré, A., & Cuturi, M. (2019) · now publishers, Inc. eBooks · doi:10.1561/9781680835519 · Cited by 909 · see citing works
A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838 · see citing works
Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Matern, F., Riess, C., & Stamminger, M. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00020 · Cited by 824 · see citing works
Exposing DeepFake Videos By Detecting Face Warping Artifacts
Li, Y., & Lyu, S. (2018) · arXiv · doi:10.48550/arxiv.1811.00656 · Cited by 785 · see citing works
Luan, F., Paris, S., Shechtman, E., & Bala, K. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.740 · Cited by 729 · see citing works
FSGAN: Subject Agnostic Face Swapping and Reenactment
Nirkin, Y., Keller, Y., & Hassner, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00728 · Cited by 706 · see citing works
Two-Stream Neural Networks for Tampered Face Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.229 · Cited by 700 · see citing works
DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
Jiang, L., Li, R., Wu, W., Qian, C., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00296 · Cited by 599 · see citing works
Self-citationMulti-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549 · see citing works
Fast Face-Swap Using Convolutional Neural Networks
Korshunova, I., Shi, W., Dambre, J., & Theis, L. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.397 · Cited by 501 · see citing works
Talking Face Generation by Adversarially Disentangled Audio-Visual Representation
Zhou, H., Liu, Y., Liu, Z., Luo, P., & Wang, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019299 · Cited by 416 · see citing works
A Closed-Form Solution to Photorealistic Image Stylization
Li, Y., Liu, M.-Y., Li, X., Yang, M., & Kautz, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01219-9_28 · Cited by 410 · see citing works
Photorealistic Style Transfer via Wavelet Transforms
Yoo, J., Uh, Y., Chun, S., Kang, B., & Ha, J.-W. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00913 · Cited by 401 · see citing works
Face Alignment in Full Pose Range: A 3D Total Solution
Zhu, X., Liu, X., Lei, Z., & Li, S. Z. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2778152 · Cited by 391 · see citing works
A U-Net Based Discriminator for Generative Adversarial Networks
Schönfeld, E., Schiele, B., & Khoreva, A. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00823 · Cited by 353 · see citing works
Cozzolino, D., Poggi, G., & Verdoliva, L. (2017) · Proceedings of the 5th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3082031.3083247 · Cited by 349 · see citing works
MEAD: A Large-Scale Audio-Visual Dataset for Emotional Talking-Face Generation
Wang, K., Wu, Q., Song, L., Yang, Z., Wu, W., Qian, C., He, R., Qiao, Y., & Loy, C. C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58589-1_42 · Cited by 344 · see citing works
Self-citationDistinguishing computer graphics from natural images using convolution neural networks
Rahmouni, N., Nozick, V., Yamagishi, J., & Echizen, I. (2017) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs.2017.8267647 · Cited by 335 · see citing works
N-dimensional probability density function transfer and its application to color transfer
Pitié, F., Kokaram, A. C., & Dahyot, R. (2005) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2005.166 · Cited by 334 · see citing works
On Face Segmentation, Face Swapping, and Face Perception
Nirkin, Y., Masi, I., Tuan, A. T., Hassner, T., & Medioni, G. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00024 · Cited by 302 · see citing works
Tsai, Y., Shen, X., Lin, Z., Sunkavalli, K., Lu, X., & Yang, M. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.299 · Cited by 263 · see citing works
On the Translocation of Masses
Kantorovitch, L. (1958) · Management Science · doi:10.1287/mnsc.5.1.1 · Cited by 242 · see citing works
FaceShifter: Towards High Fidelity And Occlusion Aware Face Swapping
Li, L., Bao, J., Yang, H., Chen, D., & Wen, F. (2019) · arXiv · doi:10.48550/arxiv.1912.13457 · Cited by 236 · see citing works
Style transfer for headshot portraits
Shih, Y., Paris, S., Barnes, C., Freeman, W. T., & Durand, F. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601137 · Cited by 220 · see citing works
DoveNet: Deep Image Harmonization via Domain Verification
Cong, W., Zhang, J., Niu, L., Liu, L., Ling, Z., Li, W., & Zhang, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00842 · Cited by 210 · see citing works
Regularized Discrete Optimal Transport
Ferradans, S., Papadakis, N., Gabriel Peyré, A., & Aujol, J. (2014) · SIAM Journal on Imaging Sciences · doi:10.1137/130929886 · Cited by 195 · see citing works
Dale, K. M., Sunkavalli, K., Johnson, M. K., Vlasic, D., Matusik, W., & Pfister, H. (2011) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/2024156.2024164 · Cited by 176 · see citing works
Re-weighted Adversarial Adaptation Network for Unsupervised Domain Adaptation
Chen, Q., Liu, Y., Wang, Z., Wassell, I. J., & Chetty, K. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00832 · Cited by 148 · see citing works
Learning a Discriminative Model for the Perception of Realism in Composite Images
Zhu, J.-Y., Krähenbühl, P., Shechtman, E., & Efros, A. A. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.449 · Cited by 136 · see citing works
A geometric view of optimal transportation and generative model
Lei, N., Su, K., Cui, L., Yau, S., & Gu, X. D. (2018) · Computer Aided Geometric Design · doi:10.1016/j.cagd.2018.10.005 · Cited by 121 · see citing works
Disentangled Representation Learning for 3D Face Shape
Jiang, Z., Wu, Q., Chen, K., & Zhang, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01223 · Cited by 107 · see citing works
Self-citationDeepFaceLab: A simple, flexible and extensible face swapping framework.
Perov, I., Gao, D., Chervoniy, N., Liu, K., Marangonda, S., Umé, C., Dpfks, Facenheim, C. S., Rp, L., Jiang, J., et al. (2020) · Cited by 106 · see citing works
Transport-based single frame super resolution of very low resolution face images
Kolouri, S., & Rohde, G. K. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299121 · Cited by 93 · see citing works
Celeb-DF: A New Dataset for DeepFake ForensicsPreprint
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2019) · arXiv (Cornell University) · Cited by 91 · see citing works
Deferred Neural Rendering: Image Synthesis using Neural TexturesPreprint
Thies, J., Zollhöfer, M., & Nießner, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.12356 · Cited by 90 · see citing works
FSNet: An Identity-Aware Generative Model for Image-Based Face Swapping
Natsume, R., Yatagawa, T., & Morishima, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20876-9_8 · Cited by 82 · see citing works
Wasserstein GAN With Quadratic Transport Cost
Liu, H., Gu, X. D., & Samaras, D. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00493 · Cited by 80 · see citing works
Ultrafast Photorealistic Style Transfer via Neural Architecture Search
An, J., Xiong, H., Huan, J., & Luo, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6614 · Cited by 75 · see citing works
Adaptive color transfer with relaxed optimal transport
Rabin, J., Ferradans, S., & Papadakis, N. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025983 · Cited by 74 · see citing works
Error-Tolerant Image Compositing
Tao, M. W., Johnson, M. K., & Paris, S. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_3 · Cited by 67 · see citing works
Face Swapping under Large Pose Variations: A 3D Model Based Approach
Lin, Y., Wang, S., Lin, Q., & Tang, F. (2012) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2012.26 · Cited by 66 · see citing works
Arbitrary Talking Face Generation via Attentional Audio-Visual Coherence Learning
Zhu, H., Huang, H., Li, Y., Zheng, A., & He, R. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/327 · Cited by 61 · see citing works
Self-citationPortrait lighting transfer using a mass transport approach
Shu, Z., Hadap, S., Shechtman, E., Sunkavalli, K., Paris, S., & Samaras, D. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3126847 · Cited by 52 · see citing works
Optimal Transportation for Example-Guided Color Transfer
Frigo, O., Sabater, N., Demoulin, V., & Pierre Hellier, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16811-1_43 · Cited by 42 · see citing works
3D-model-based face replacement in video
Cheng, Y.-T., Tzeng, V., Liang, Y., Wang, C., Chen, B., Chuang, Y., & Ouhyoung, M. (2009) · ACM SIGGRAPH Posters · doi:10.1145/1599301.1599330 · Cited by 37 · see citing works
AE-OT: A NEW GENERATIVE MODEL BASED ON EXTENDED SEMI-DISCRETE OPTIMAL TRANSPORT
An, D., Guo, Y., Lei, N., Luo, Z., Yau, S., & Gu, X. D. (2020) · International Conference on Learning Representations · Cited by 29 · see citing works
Flagged first, then by citations
1 of the 67 references couldn’t be matched to a known paper.
Research works printed but not linked: 6
- [4][4] Martin Arjovsky, Soumith Chintala, and Léon Bottou. Wasserstein gan. arXiv preprint arXiv:1701.07875 , 2017. - · arXiv
- [22][22] Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial nets. In Advances in Neural Information Processing Systems , pages 2672-2680, 2014. -
- [23][23] Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron C Courville. Improved training of wasserstein gans. In Advances in Neural Information Processing Systems , pages 5767-5777, 2017. -
- [27][27] Leonid V Kantorovich. On the translocation of masses. In Dokl. Akad. Nauk. USSR , volume 37, pages 199-201, 1942. -
- [40][40] Gaspard Monge. Mémoire sur la théorie des déblais et de remblais. histoire de l'académie royale des sciences de paris, avec les mémoires de mathématique et de physique pour la même année. Histoire de l'Académie Royale des Sciences de Paris , pages 666-704, 1781. -
- [61][61] Yi-Hsuan Tsai, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Xin Lu, and Ming-Hsuan Yang. Deep image harmonization. In Conference on Computer Vision and Pattern Recognition , pages 3789-3797, 2017. -
Cited by
Sorted by citations
Generalizing Face Forgery Detection with High-frequency Features
Luo, Y., Zhang, Y., Yan, J., & Liu, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01605 · Cited by 609 · see citing works
Countering Malicious DeepFakes: Survey, Battleground, and Horizon
Juefei-Xu, F., Wang, R., Huang, Y., Guo, Q., Ma, L., & Liu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01606-8 · Cited by 191 · see citing works
“Appearance optimal transport (AOT) (Zhu et al., 2020) has formulated appearance mapping as an optimal transport problem.”
BackgroundHifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swapping
Wang, Y., Chen, X., Zhu, J., Chu, W., Tai, Y., Wang, C., Li, J., Wu, Y., Huang, F., & Ji, R. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/157 · Cited by 138 · see citing works
Dual Defense: Adversarial, Traceable, and Invisible Robust Watermarking Against Face Swapping
Zhang, Y., Ye, D., Xie, C., Tang, L., Liao, X., Liu, Z., Chen, C., & Deng, J. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3383648 · Cited by 52 · see citing works
Motion Magnified 3-D Residual-in-Dense Network for DeepFake Detection
Mehra, A., Agarwal, A., Mayank Vatsa, A., & Singh, R. (2022) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2022.3201887 · Cited by 46 · see citing works
Heterogeneous Face Recognition via Face Synthesis With Identity-Attribute Disentanglement
Yang, Z., Liang, J., Fu, C., Luo, M., & Zhang, X. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3160595 · Cited by 31 · see citing works
Self-citationInverting Generative Adversarial Renderer for Face Reconstruction
Piao, J., Sun, K., Wang, Q., Lin, K.-Y., & Li, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01536 · Cited by 26 · see citing works
Liu, D., Chen, T., Peng, C., Wang, N., Hu, R., & Gao, X. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3516561 · Cited by 22 · see citing works
Jin, X., Wu, N., Jiang, Q., Kou, Y., Duan, H., Wang, P., & Yao, S. (2024) · Forensic Science International Digital Investigation · doi:10.1016/j.fsidi.2024.301747 · Cited by 17 · see citing works
Multi-level feature disentanglement network for cross-dataset face forgery detection
Fu, Z., Chen, X., Liu, D., Qu, X., Dong, J., Zhang, X., & Ji, S. (2023) · Image and Vision Computing · doi:10.1016/j.imavis.2023.104686 · Cited by 12 · see citing works
Coherent adversarial deepfake video generation
Liu, H., Zhou, W., Chen, D., Fang, H., Bian, H., Liu, K., Zhang, W., & Yu, N. (2022) · Signal Processing · doi:10.1016/j.sigpro.2022.108790 · Cited by 11 · see citing works
FlowFace: Semantic Flow-Guided Shape-Aware Face Swapping
Zeng, H., Zhang, W., Fan, C., Lv, T., Wang, S., Zhang, Z., Ma, B., Li, L., Ding, Y., & Yu, X. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i3.25444 · Cited by 9 · see citing works
PR-RL: Portrait Relighting Via Deep Reinforcement Learning
Zhang, X., Song, Y., Li, Z., & Jiang, J. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3096009 · Cited by 9 · see citing works
Deepfake Videos Generation and Detection: A Comprehensive Survey
Gupta, A., & Pandey, D. (2024) · IEEE International Conference on Computing, Power and Communication Technologies (IC2PCT) · doi:10.1109/ic2pct60090.2024.10486232 · Cited by 5 · see citing works
Face Identity and Expression Consistency for Game Character Face Swapping
Zeng, H., Zhang, W., Chen, K., Zhang, Z., Li, L., & Ding, Y. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103806 · Cited by 4 · see citing works
Paste You Into Game: Towards Expression and Identity Consistency Face Swapping
Zeng, H., Zhang, W., Chen, K., Zhang, Z., Li, L., & Ding, Y. (2022) · IEEE Conference on Games (CoG) · doi:10.1109/cog51982.2022.9893693 · Cited by 3 · see citing works
Manipulated Faces Detection with Adaptive Filter
Peng, C., Sun, T., Mi, Z., & Yao, L. (2022) · Security and Communication Networks · doi:10.1155/2022/8609661 · Cited by 2 · see citing works
Semantics‐guided generative diffusion model with a 3DMM model condition for face swapping
Liu, X., Liu, Y., Zheng, Y., Yang, T., Zhang, J., Wang, V., & Fang, H. (2023) · Computer Graphics Forum · doi:10.1111/cgf.14949 · Cited by 2 · see citing works
Lian, Z., & Wang, L. (2023) · Software Practice and Experience · doi:10.1002/spe.3245 · Cited by 2 · see citing works
An efficient Video Forgery Detection using Two-Layer Hybridized Deep CNN classifier
Ugale, M., & Midhunchakkaravarthy, J. (2024) · ICST Transactions on Scalable Information Systems · doi:10.4108/eetsis.5969 · Cited by 2 · see citing works
- Authors
- Zhu, H., Fu, C., Wu, Q., Wu, W., Qian, C., & He, R.
- Affiliations
- Anhui University (CN)
- University of Chinese Academy of Sciences (CN)
- Sensetime (China) (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2011.02674
- OpenAlex
- W3096572584
- Cited by
- 20
- References
- 67
- Citations by year
- 2024: 5 · 2023: 4 · 2022: 7 · 2021: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Youth Innovation Promotion Association of the Chinese Academy of Sciences (Y201929)
- Youth Innovation Promotion Association
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- face forgery detection, deepfakes, optimal transport, Wasserstein distance, appearance transfer, synthetic training data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
