Psychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations
Open accessThe DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Abstract
In recent years, increasing deployment of face recognition technology in security-critical settings, such as border control or law enforcement, has led to considerable interest in the vulnerability of face recognition systems to attacks utilising legitimate documents, which are issued on the basis of digitally manipulated face images. As automated manipulation and attack detection remains a challenging task, conventional processes with human inspectors performing identity verification remain indispensable. These circumstances merit a closer investigation of human capabilities in detecting manipulated face images, as previous work in this field is sparse and often concentrated only on specific scenarios and biometric characteristics. This work introduces a web-based, remote visual discrimination experiment on the basis of principles adopted from the field of psychophysics and subsequently discusses interdisciplinary opportunities with the aim of examining human proficiency in detecting different types of digitally manipulated face images, specifically face swapping, morphing, and retouching. In addition to analysing appropriate performance measures, a possible metric of detectability is explored. Experimental data of 306 probands indicate that detection performance is widely distributed across the population and detection of certain types of face image manipulations is much more challenging than others.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Overall, deepfake detection does not seem to vary based on gender, education, income, or profession [7, 32, 37].”
From Human Performance in Deepfake Detection: A Systematic Review (2025) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Type of stimuli (video versus audio) and the technique used for deepfake generation (e.g., face swapping, lip-syncing, and level of morphing) demonstrated mixed results [7, 20, 22, 28, 30, 42].”
From Human Performance in Deepfake Detection: A Systematic Review (2025) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Type of stimuli (video versus audio) and the technique used for deepfake generation (e.g., face swapping, lip-syncing, and level of morphing) demonstrated mixed results [7, 20, 22, 28, 30, 42].”
From Human Performance in Deepfake Detection: A Systematic Review (2025) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Furthermore, Nichols et al. found that participants were more likely to make false-negative errors (i.e., saying a photo is fake, when it is real) for lower-quality morphs. The inverse was true for higher-quality morphs -participants were more likely to make false-positive errors (i.e., saying a photo is real, when it is fake).”
From Human Performance in Deepfake Detection: A Systematic Review (2025) · cites this paper as [7]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Almost all video/image stimuli used face swapping or lip-sync technique, except for three studies that used morphing techniques [6, 7, 18].”
From Human Performance in Deepfake Detection: A Systematic Review (2025) · cites this paper as [7]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ArcFace: Additive Angular Margin Loss for Deep Face Recognition
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00482 · Cited by 7,781
Sensory Evaluation of Food: Principles and Practices
Lawless, H. T., & Heymann, H. (2010) · Food Science Text Series · doi:10.1007/978-1-4419-6488-5 · Cited by 4,815
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Calculation of signal detection theory measures
Stanislaw, H., & Todorov, N. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03207704 · Cited by 2,673
Overview of the Face Recognition Grand Challenge
Phillips, P. J., Flynn, P. J., Scruggs, T., Bowyer, K. W., Chang, J., Hoffman, K., Marques, J., Min, J., & Worek, W. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.268 · Cited by 2,438
The FERET database and evaluation procedure for face-recognition algorithms
Phillips, P. J., Wechsler, H., Huang, J., & Rauss, P. J. (1998) · Image and Vision Computing · doi:10.1016/s0262-8856(97)00070-x · Cited by 2,431
The psychometric function: I. Fitting, sampling, and goodness of fit
Wichmann, F. A., & Hill, N. J. (2001) · Perception & Psychophysics · doi:10.3758/bf03194544 · Cited by 2,358
First Impressions: Making Up Your Mind After a 100-Ms Exposure to a Face
Willis, J., & Todorov, A. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01750.x · Cited by 2,300
J., J., & Fechner, G. T. (1889) · The American Journal of Psychology · doi:10.2307/1411906 · Cited by 1,429
Macmillan, N. A., & Creelman, C. D. (2004) · doi:10.4324/9781410611147 · Cited by 1,269
Research works printed but not linked: 18
- Bledsoe, 1966, The Model Method in Facial Recognition, 15, 2
- Green, 1966, Signal Detection Theory Psychophysics
- Richter, 2019, Faceapp Craze Reaches New Heights
- 2021, Leading Entertainment APP Titles in the Apple App Store in Spain
- 2020, Germany Bans Digital Doppelganger Passport Photos
- Wolberg, 1990, Digital Image Warping, 10662
- Kravets, 2017, Driver’s License Facial Recognition Tech Leads to 4,000 New York Arrests
- Boyd, 2021, CBP’s Facial Biometrics Program has Caught 26 Alleged Imposters
- Costello, 2018, New Facial Recognition Tech Catches First Impostor at DC Airport
- 2016, Information Technology—Biometric Presentation Attack Detection—Part 1: Framework
- 2020, Facial Recognition Statistics in Airports
- Xie, 2018, Council Post: The Future of Biometric Facial Recognition
- 2021, A Harmonized, Modular Reference System for all European Automated Border Crossing Points
- Ennis, 2012, Proper task instructions and the two-out-of-five-test, IFPress, 15, 3
- 2016, (EU) General Data Protection Regulation
- 2017, Information Technology—Biometric Presentation Attack Detection—Part 3: Testing and Reporting
- 2021, Fotorus—Camera & Photo Editor
- 2021, Instabeauty—Makeup Camera
Cited by
Deepfakes as a threat to a speaker and facial recognition: An overview of tools and attack vectors
Firc, A., Malinka, K., & Hanáček, P. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e15090 · Cited by 80
Human Performance in Deepfake Detection: A Systematic Review
Somoray, K., Miller, D. J., & Holmes, M. (2025) · Human Behavior and Emerging Technologies · doi:10.1155/hbe2/1833228 · Cited by 19
Challenges for automated face recognition systems
Busch, C. (2024) · Nature Reviews Electrical Engineering · doi:10.1038/s44287-024-00094-x · Cited by 12
Self-citationOverview of Research Progress of Digital Image Processing Technology
Huang, Y. (2022) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2386/1/012034 · Cited by 11
Crowd-Powered Face Manipulation Detection: Fusing Human Examiner Decisions
Rathgeb, C., Nichols, R., Ibsen, M., Drozdowski, P., & Busch, C. (2022) · Proceedings - International Conference on Image Processing · doi:10.1109/icip46576.2022.9897841 · Cited by 10
Self-citation
Metadata
- Authors
- Nichols, R., Rathgeb, C., Drozdowski, P., & Busch, C.
- Affiliations
- Darmstadt University of Applied Sciences (DE)
- Venue
- IEEE Access
- Published
- 2022
- Volume
- 10
- Pages
- 31359-31376
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4226373926
- Cited by
- 16
- References
- 65
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 2 · 2023: 4 · 2022: 2
- FWCI
- 1.06
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- German Federal Ministry of Education and Research
- Hessian State Ministry for Higher Education, Research and the Arts within their joint support of the National Research Center for Applied Cybersecurity ATHENE
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Keywords
- face swapping, face morphing, retouching, identity verification, biometric attacks, face recognition security, psychophysics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Psychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations. https://app.cochat.ai/papers/10.1109/access.2022.3160596
- The paper
- Nichols, R., Rathgeb, C., Drozdowski, P., & Busch, C. (2022). Psychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations. IEEE Access. https://doi.org/10.1109/access.2022.3160596
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.