CoChat

Psychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations

Open access
Nichols, Robert, Rathgeb, Christian, Drozdowski, Pawel, Busch, Christoph · 2022 · IEEE Access

The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.

Abstract

In recent years, increasing deployment of face recognition technology in security-critical settings, such as border control or law enforcement, has led to considerable interest in the vulnerability of face recognition systems to attacks utilising legitimate documents, which are issued on the basis of digitally manipulated face images. As automated manipulation and attack detection remains a challenging task, conventional processes with human inspectors performing identity verification remain indispensable. These circumstances merit a closer investigation of human capabilities in detecting manipulated face images, as previous work in this field is sparse and often concentrated only on specific scenarios and biometric characteristics. This work introduces a web-based, remote visual discrimination experiment on the basis of principles adopted from the field of psychophysics and subsequently discusses interdisciplinary opportunities with the aim of examining human proficiency in detecting different types of digitally manipulated face images, specifically face swapping, morphing, and retouching. In addition to analysing appropriate performance measures, a possible metric of detectability is explored. Experimental data of 306 probands indicate that detection performance is widely distributed across the population and detection of certain types of face image manipulations is much more challenging than others.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/access.2022.3160596

Cites

70 of 70 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

5 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 70 references

Research works printed but not linked: 18

  1. Bledsoe, 1966, The Model Method in Facial Recognition, 15, 2
  2. Green, 1966, Signal Detection Theory Psychophysics
  3. Richter, 2019, Faceapp Craze Reaches New Heights
  4. 2021, Leading Entertainment APP Titles in the Apple App Store in Spain
  5. 2020, Germany Bans Digital Doppelganger Passport Photos
  6. Wolberg, 1990, Digital Image Warping, 10662
  7. Kravets, 2017, Driver’s License Facial Recognition Tech Leads to 4,000 New York Arrests
  8. Boyd, 2021, CBP’s Facial Biometrics Program has Caught 26 Alleged Imposters
  9. Costello, 2018, New Facial Recognition Tech Catches First Impostor at DC Airport
  10. 2016, Information Technology—Biometric Presentation Attack Detection—Part 1: Framework
  11. 2020, Facial Recognition Statistics in Airports
  12. Xie, 2018, Council Post: The Future of Biometric Facial Recognition
  13. 2021, A Harmonized, Modular Reference System for all European Automated Border Crossing Points
  14. Ennis, 2012, Proper task instructions and the two-out-of-five-test, IFPress, 15, 3
  15. 2016, (EU) General Data Protection Regulation
  16. 2017, Information Technology—Biometric Presentation Attack Detection—Part 3: Testing and Reporting
  17. 2021, Fotorus—Camera & Photo Editor
  18. 2021, Instabeauty—Makeup Camera

Cited by

See all 24

Metadata

Authors
Nichols, R., Rathgeb, C., Drozdowski, P., & Busch, C.
Affiliations
Darmstadt University of Applied Sciences (DE)
Venue
IEEE Access
Published
2022
Volume
10
Pages
31359-31376
ISSN
2169-3536 (ISSN-L)
OpenAlex
W4226373926
Cited by
16
References
65
Citations by year
2026: 3 · 2025: 5 · 2024: 2 · 2023: 4 · 2022: 2
FWCI
1.06
Type
journal article
Language
en
Open access
Locations
  • IEEE Access (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • arXiv (Cornell University)
Funders
  • German Federal Ministry of Education and Research
  • Hessian State Ministry for Higher Education, Research and the Arts within their joint support of the National Research Center for Applied Cybersecurity ATHENE
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
Keywords
face swapping, face morphing, retouching, identity verification, biometric attacks, face recognition security, psychophysics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Psychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations. https://app.cochat.ai/papers/10.1109/access.2022.3160596
The paper
Nichols, R., Rathgeb, C., Drozdowski, P., & Busch, C. (2022). Psychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations. IEEE Access. https://doi.org/10.1109/access.2022.3160596

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.