CoChat

Digital and Physical Face Attacks: Reviewing and One Step Further

Open access
Kong, Chenqi, Wang, Shiqi, Li, Haoliang · 2023 · APSIPA Transactions on Signal and Information Processing
Cited by 43

The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.

Abstract

With the rapid progress over the past five years, face authentication has become the most pervasive biometric recognition method. Thanks to the high-accuracy recognition performance and user-friendly usage, automatic face recognition (AFR) has exploded into a plethora of practical applications over device unlocking, checking-in, and financial payment. In spite of the tremendous success of face authentication, a variety of face presentation attacks (FPA), such as print attacks, replay attacks, and 3D mask attacks, have raised pressing mistrust concerns. Even worse, as attack techniques are getting more and more powerful and smart, FPA is becoming increasingly realistic and advanced. Besides physical face attacks, face videos/images are vulnerable to a wide variety of digital attack techniques launched by malicious hackers, causing potential menace to the public at large. Due to the unrestricted access to enormous digital face images/videos and disclosed easy-to-use face manipulation tools circulating on the internet, non-expert attackers without any prior professional skills are able to readily create sophisticated fake faces, leading to numerous dangerous applications such as financial fraud, impersonation, and identity theft. Nowadays, face information has become the dominant biometric trait of a person and unique non-verbal but powerful FaceID. How to safeguard personal face information against both physical and digital attacks is of great importance. This survey aims to build the integrity of face forensics by providing thorough analyses of existing literature and highlighting the issues requiring further attention. In this paper, we first comprehensively survey both physical and digital face attack types and datasets. Then, we review the latest and most advanced progress on existing counter-attack methodologies and highlight their current limits. Moreover, we outline possible future research directions for existing and upcoming challenges in the face forensics community. Finally, the necessity of joint physical and digital face attack detection has been discussed, which has never been studied in previous surveys.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1561/116.00000069

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 22 references

Research works printed but not linked: 87

  1. Abdi, 2010, Principal component analysis, Wiley Interdisciplinary Reviews: Computational Statistics, 2, 433, 10.1002/wics.101 · DOI · Paper page
  2. Ahonen, 2006, Face description with local binary patterns: Application to face recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 28, 2037, 10.1109/TPAMI.2006.244 · DOI · Paper page
  3. Boulkenafet, 2016, Face antispoofing using speeded-up robust features and fisher vector encoding, IEEE Signal Processing Letters, 24, 141
  4. Cai, 2020, DRL-fas: a novel framework based on deep reinforcement learning for face anti-spoofing, IEEE Transactions on Information Forensics and Security, 16, 937, 10.1109/TIFS.2020.3026553 · DOI
  5. Cai, 2022, Learning Meta Pattern for Face Anti-Spoofing, 10.1109/TIFS.2022.3158551 · DOI
  6. Chan, 2017, Face liveness detection using a flash against 2D spoofing attack, IEEE Transactions on Information Forensics and Security, 13, 521, 10.1109/TIFS.2017.2758748 · DOI
  7. Chen, 2021, Camera invariant feature learning for generalized face anti-spoofing, IEEE Transactions on Information Forensics and Security, 16, 2477, 10.1109/TIFS.2021.3055018 · DOI
  8. Chen, 2019, Face swapping: realistic image synthesis based on facial landmarks alignment, Mathematical Problems in Engineering, 2019
  9. Chen, 2019, Attention-based two-stream convolutional networks for face spoofing detection, IEEE Transactions on Information Forensics and Security, 15, 578, 10.1109/TIFS.2019.2922241 · DOI · Paper page
  10. Chen, 2019, Echoface: Acoustic sensor-based media attack detection for face authentication, IEEE Internet of Things Journal, 7, 2152, 10.1109/JIOT.2019.2959203 · doi:10.1109/jiot.2019.2959203
  11. Deb, 2020, Look locally infer globally: A generalizable face anti-spoofing approach, IEEE Transactions on Information Forensics and Security, 16, 1143, 10.1109/TIFS.2020.3029879 · DOI
  12. Deb, 2021, Unified detection of digital and physical face attacks
  13. Di Martino, 2020, Rethinking Shape From Shading for Spoofing Detection, IEEE Transactions on Image Processing, 30, 1086, 10.1109/TIP.2020.3042082 · DOI
  14. Dolhansky, 2019, The deepfake detection challenge (dfdc) preview dataset
  15. Dufour, 2019, Contributing data to deepfake detection research, Google AI Blog, 1
  16. Ebihara, 2021, Efficient Face Spoofing Detection with Flash, IEEE Transactions on Biometrics, Behavior, and Identity Science, 3, 535, 10.1109/TBIOM.2021.3076816 · DOI
  17. Feng, 2016, Integration of image quality and motion cues for face anti-spoofing: A neural network approach, Journal of Visual Communication and Image Representation, 38, 451, 10.1016/j.jvcir.2016.03.019 · DOI · Paper page
  18. Frith, 2009, Role of facial expressions in social interactions, Philosophical Transactions of the Royal Society B: Biological Sciences, 364, 3453, 10.1098/rstb.2009.0142 · DOI · Paper page
  19. George, 2020, Learning one class representations for face presentation attack detection using multi-channel convolutional neural networks, IEEE Transactions on Information Forensics and Security, 16, 361, 10.1109/TIFS.2020.3013214 · DOI
  20. Guo, 2021, Meaningful adversarial stickers for face recognition in physical world
  21. He, 2019, Attgan: Facial attribute editing by only changing what you want, IEEE Transactions on Image Processing, 28, 5464, 10.1109/TIP.2019.2916751 · DOI · Paper page
  22. Heo, 2021, Deepfake detection scheme based on vision transformer and distillation
  23. Heusch, 2020, Deep models and shortwave infrared information to detect face presentation attacks, IEEE Transactions on Biometrics, Behavior, and Identity Science, 2, 399, 10.1109/TBIOM.2020.3010312 · DOI
  24. Hu, 2022, FInfer: Frame Inference-based Deepfake Detection for High-Visual-Quality Videos, 1
  25. Hu, 2021, Detecting compressed deepfake videos in social networks using frame-temporality two-stream convolu-tional network, IEEE Transactions on Circuits and Systems for Video Technology, 32, 1089, 10.1109/TCSVT.2021.3074259 · DOI · Paper page
  26. Jia, 2020, A survey on 3D mask presentation attack detection and countermeasures, Pattern recognition, 98, 107032, 10.1016/j.patcog.2019.107032 · DOI
  27. Jia, 2021, Unified unsupervised and semi-supervised domain adaptation network for cross-scenario face anti-spoofing, Pattern Recognition, 115, 107888, 10.1016/j.patcog.2021.107888 · DOI
  28. Jiang, 2020, Face anti-spoofing with generated near-infrared images, Multimedia Tools and Applications, 79, 21299, 10.1007/s11042-020-08952-0 · DOI
  29. Juefei-Xu, 2022, Countering malicious deepfakes: Survey, battleground, and horizon, 1
  30. Khalid, 2021, FakeAVCeleb: a novel audio-video multimodal deepfake dataset
  31. Khammari, 2019, Robust face anti-spoofing using CNN with LBP and WLD, IET Image Processing, 13, 1880, 10.1049/iet-ipr.2018.5560 · DOI
  32. Kingma, 2019, An introduction to variational autoencoders, Foundations and Trends® in Machine Learning, 12, 307, 10.1561/2200000056 · DOI · Paper page
  33. Kingma, 2013, Auto-encoding variational bayes
  34. Kong, 2022, Beyond the Pixel World: A Novel Acoustic-based Face Anti-Spoofing System for Smart-phones, 10.1109/TIFS.2022.3202115 · DOI
  35. Korshunov, 2018, Deepfakes: a new threat to face recognition? assessment and detection
  36. Korshunov, 2022, Improving generalization of deepfake detection with data farming and few-shot learning, 10.1109/TBIOM.2022.3143404 · DOI · Paper page
  37. Kotwal, 2019, Multispectral deep em-beddings as a countermeasure to custom silicone mask presentation attacks, IEEE Transactions on Biometrics, Behavior, and Identity Science, 1, 238, 10.1109/TBIOM.2019.2939421 · DOI
  38. Li, 2022, Seeing is living? rethinking the security of facial liveness verification in the deepfake era
  39. Li, 2020, Identification of deep network generated images using disparities in color components, Signal Processing, 174, 107616, 10.1016/j.sigpro.2020.107616 · DOI · Paper page
  40. Li, 2018, Unsupervised domain adaptation for face anti-spoofing, IEEE Transactions on Information Forensics and Security, 13, 1794, 10.1109/TIFS.2018.2801312 · DOI · Paper page
  41. Li, 2019, Replayed video attack detection based on motion blur analysis, IEEE Transactions on Information Forensics and Security, 14, 2246, 10.1109/TIFS.2019.2895212 · DOI
  42. Li, 2020, 3D face mask presentation attack detection based on intrinsic image analysis, Iet Biometrics, 9, 100, 10.1049/iet-bmt.2019.0155 · DOI
  43. Li, 2022, One-Class Knowledge Distillation for Face Presentation Attack Detection, 10.1109/TIFS.2022.3178240 · DOI
  44. Liu, 2021, Face AntiSpoofing via Adversarial Cross-Modality Translation, IEEE Transactions on Information Forensics and Security, 16, 2759, 10.1109/TIFS.2021.3065495 · DOI
  45. Liu, 2022, Contrastive context-aware learning for 3d high-fidelity mask face presentation attack detection, IEEE Transactions on Information Forensics and Security, 17, 2497, 10.1109/TIFS.2022.3188149 · DOI
  46. Liu, 2021, Data Fusion based Two-stage Cascade Framework for Multi-Modality Face Anti-Spoofing
  47. Lu, 2021, Live speech portraits: real-time photorealistic talking-head animation, ACM Transactions on Graphics (TOG), 40, 1, 10.1145/3478513.3480484 · DOI · Paper page
  48. Miao, 2022, Hierarchical Frequency-Assisted Interactive Networks for Face Manipulation Detection, 10.1109/TIFS.2022.3198275 · DOI · Paper page
  49. Mirsky, 2021, The creation and detection of deepfakes: A survey, ACM Computing Surveys (CSUR), 54, 1, 10.1145/3425780 · DOI · Paper page
  50. Nguyen, 2019, Deep learning for deepfakes creation and detection, arXiv preprint, 1, 2
  51. Nirkin, 2021, DeepFake detection based on discrepancies between faces and their context
  52. Patel, 2016, Secure face unlock: Spoof detection on smartphones, IEEE Transactions on Information Forensics and Security, 11, 2268, 10.1109/TIFS.2016.2578288 · DOI · Paper page
  53. Quan, 2021, Progressive transfer learning for face anti-spoofing, IEEE Transactions on Image Processing, 30, 3946, 10.1109/TIP.2021.3066912 · DOI
  54. Raheem, 2019, Insight on face liveness detection: A systematic literature review, International Journal of Electrical & Computer Engineering (2088-8708), 9
  55. Rehman, 2020, Enhancing deep discriminative feature maps via perturbation for face presentation attack detection, Image and Vision Computing, 94, 103858, 10.1016/j.imavis.2019.103858 · DOI
  56. Russakovsky, 2015, Imagenet large scale visual recognition challenge, International Journal of Computer Vision, 115, 211, 10.1007/s11263-015-0816-y · DOI · Paper page
  57. Sabir, 2019, Recurrent convolutional strategies for face manipulation detection in videos, Interfaces (GUI), 3, 80
  58. El-Din, 2020, Deep convolutional neural networks for face and iris presentation attack detection: Survey and case study, IET Biometrics, 9, 179, 10.1049/iet-bmt.2020.0004 · DOI
  59. Seo, 2019, Face liveness detection using thermal face-CNN with external knowledge, Symmetry, 11, 360, 10.3390/sym11030360 · DOI
  60. Shang, 2021, PRRNet: PixelRegion relation network for face forgery detection, Pattern Recognition, 116, 107950, 10.1016/j.patcog.2021.107950 · DOI
  61. Shao, 2018, Joint discriminative learning of deep dynamic textures for 3D mask face anti-spoofing, IEEE Transactions on Information Forensics and Security, 14, 923, 10.1109/TIFS.2018.2868230 · DOI · Paper page
  62. Sharifi, 2019, Score-Level-based Face Anti-Spoofing System Using Handcrafted and Deep Learned Characteristics, International Journal of Image, Graphics and Signal Processing, 10, 15, 10.5815/ijigsp.2019.02.02 · DOI
  63. Simonyan, 2014, Very deep convolutional networks for large-scale image recognition
  64. Souza, 2018, How far did we get in face spoofing detection?, Engineering Applications of Artificial Intelligence, 72, 368, 10.1016/j.engappai.2018.04.013 · DOI
  65. Sun, 2020, Face spoofing detection based on local ternary label supervision in fully convolutional networks, IEEE Transactions on Information Forensics and Security, 15, 3181, 10.1109/TIFS.2020.2985530 · DOI · Paper page
  66. Suwajanakorn, 2017, Synthesizing obama: learning lip sync from audio, ACM Transactions on Graphics (ToG), 36, 1, 10.1145/3072959.3073640 · DOI · Paper page
  67. Tang, 2018, Face flashing: a secure liveness detection protocol based on light reflections, 10.14722/ndss.2018.23176 · DOI
  68. Thies, 2019, Deferred neural rendering: Image synthesis using neural textures, ACM Transactions on Graphics (TOG), 38, 1, 10.1145/3306346.3323035 · DOI · Paper page
  69. Tolosana, 2020, Deepfakes and beyond: A survey of face manipulation and fake detection, Information Fusion, 64, 131, 10.1016/j.inffus.2020.06.014 · DOI · Paper page
  70. Van den Oord, 2016, Conditional image generation with pixelcnn decoders, Advances in Neural Information Processing Systems, 29
  71. Wang, 2020, Unsupervised adversarial domain adaptation for cross-domain face presentation attack detection, IEEE Transactions on Information Forensics and Security, 16, 56, 10.1109/TIFS.2020.3002390 · DOI · Paper page
  72. Wang, 2022, LiSiam: Localization Invariance Siamese Network for Deepfake Detection, IEEE Transactions on Information Forensics and Security, 17, 2425, 10.1109/TIFS.2022.3186803 · DOI
  73. Wang, 2019, Fakespotter: A simple yet robust baseline for spotting ai-synthesized fake faces
  74. Wen, 2015, Face spoof detection with image distortion analysis, IEEE Transactions on Information Forensics and Security, 10, 746, 10.1109/TIFS.2015.2400395 · DOI · Paper page
  75. Wu, 2020, Single-shot face anti-spoofing for dual pixel camera, IEEE Transactions on Information Forensics and Security, 16, 1440, 10.1109/TIFS.2020.3035879 · DOI
  76. Yang, 2020, Preventing deepfake attacks on speaker authentication by dynamic lip movement analysis, IEEE Transactions on Information Forensics and Security, 16, 1841, 10.1109/TIFS.2020.3045937 · DOI
  77. Yang, 2014, Learn convolutional neural network for face anti-spoofing
  78. Yin, 2021, Adv-makeup: A new imperceptible and transferable attack on face recognition, 10.24963/ijcai.2021/173 · DOI
  79. Yu, 2022, Improving Generalization by Commonality Learning in Face Forgery Detection, IEEE Transactions on Information Forensics and Security, 17, 547, 10.1109/TIFS.2022.3146781 · DOI
  80. Yu, 2022, Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cues
  81. Yu, 2021, Revisiting pixel-wise supervision for face anti-spoofing, 10.1109/TBIOM.2021.3065526 · DOI
  82. Yu, 2021, Transrppg: Remote photoplethys-mography transformer for 3d mask face presentation attack detection, IEEE Signal Processing Letters, 28, 1290, 10.1109/LSP.2021.3089908 · DOI
  83. Yu, 2021, Deep learning for face anti-spoofing: A survey
  84. Yu, 2020, NAS-FAS: Staticdynamic central difference network search for face anti-spoofing, IEEE Transactions on Pattern Analysis and Machine Intelligence, 43, 3005, 10.1109/TPAMI.2020.3036338 · DOI · Paper page
  85. Zhang, 2020, Adversarial examples for replay attacks against CNN-based face recognition with anti-spoofing capability, Computer Vision and Image Understanding, 197, 102988, 10.1016/j.cviu.2020.102988 · DOI
  86. Zhou, 2021, Robust Human Face Authentication Leveraging Acoustic Sensing on Smart-phones, 1
  87. Zhu, 2017, Toward multimodal image-to-image translation, Advances in Neural Information Processing Systems, 30

Cited by

See all 43

Metadata

Authors
Kong, C., Wang, S., & Li, H.
Venue
APSIPA Transactions on Signal and Information Processing
Publisher
Emerald
Published
2023-12-06
Volume
12
Issue
1
Pages
1-51
ISSN
2048-7703 (ISSN-L)
OpenAlex
W4366396176
Cited by
43
References
22
FWCI
5.29
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Digital and Physical Face Attacks: Reviewing and One Step Further. https://app.cochat.ai/papers/10.1561/116.00000069
The paper
Kong, C., Wang, S., & Li, H. (2023). Digital and Physical Face Attacks: Reviewing and One Step Further. APSIPA Transactions on Signal and Information Processing. https://doi.org/10.1561/116.00000069

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.