CoChat

Psychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations

Open access
Nichols, Robert, Rathgeb, Christian, Drozdowski, Pawel, Busch, Christoph · 2022 · IEEE Access

The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.

Abstract

In recent years, increasing deployment of face recognition technology in security-critical settings, such as border control or law enforcement, has led to considerable interest in the vulnerability of face recognition systems to attacks utilising legitimate documents, which are issued on the basis of digitally manipulated face images. As automated manipulation and attack detection remains a challenging task, conventional processes with human inspectors performing identity verification remain indispensable. These circumstances merit a closer investigation of human capabilities in detecting manipulated face images, as previous work in this field is sparse and often concentrated only on specific scenarios and biometric characteristics. This work introduces a web-based, remote visual discrimination experiment on the basis of principles adopted from the field of psychophysics and subsequently discusses interdisciplinary opportunities with the aim of examining human proficiency in detecting different types of digitally manipulated face images, specifically face swapping, morphing, and retouching. In addition to analysing appropriate performance measures, a possible metric of detectability is explored. Experimental data of 306 probands indicate that detection performance is widely distributed across the population and detection of certain types of face image manipulations is much more challenging than others.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/access.2022.3160596

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

5 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 71 references

Research works printed but not linked: 12

  1. [1] W. W. Bledsoe, The Model Method in Facial Recognition , vol. 15. Palo Alto, CA, USA: Panoramic Research, 1966, p. 2. -
  2. [8] D. M. Green and J. A. Swets, Signal Detection Theory Psychophysics . New York, NY, USA: Wiley, 1966. -
  3. [19] F. Richter. (Jul. 2019). Faceapp Craze Reaches New Heights . [Online]. Available: https://www.statista.com/chart/18769/estimated-worldwidefaceapp-downloads-by-platform/ -
  4. [20] Airnow. (Jul. 2021) Leading Entertainment APP Titles in the Apple App Store in Spain . [Online]. Available: https://www.statista. com/statistics/699448/leading-iphone-entertainment-apps-in-spain-bydownloads/ -
  5. [26] G. Wolberg, Digital Image Warping , vol. 10662. Los Alamitos, CA, USA: IEEE Computer Society Press, 1990. -
  6. [34] A. Boyd. (Apr. 2021). CBP's Facial Biometrics Program has Caught 26 Alleged Imposters . [Online]. Available: https://www.defenseone.com/technology/2018/11/cbps-facial-biometricsprogram-has-caught-26-alleged-imposters/152993/ -
  7. [36] Information Technology Biometric Presentation Attack Detection Part 1: Framework , Standard ISO/IEC 30107-1, International Standards Organization, 2016. -
  8. [39] FastPass. (Aug. 2021). A Harmonized, Modular Reference System for all European Automated Border Crossing Points . [Online]. Available: https://www.fastpass-project.eu/ -
  9. [64] J. M. Ennis, B. Rousseau, and D. M. Ennis, ''Proper task instructions and the two-out-of- ve-test,'' IFPress , vol. 15, no. 4, pp. 3 4, 2012. -
  10. [69] Information Technology Biometric Presentation Attack Detection Part 3: Testing and Reporting , Standard ISO/IEC 30107-3, International Standards Organization, 2017. -
  11. [78] Fotoable. (2021). Fotorus Camera & Photo Editor . [Online]. Available: https://apps.apple.com/us/app/fotorus-camera-photo-editor/id457517348 -
  12. [79] Fotoable. (2021). Instabeauty Makeup Camera . [Online]. Available: https://apps.apple.com/us/app/instabeauty-makeup-camera/id599534650 -

Cited by

Metadata

Authors
Nichols, R., Rathgeb, C., Drozdowski, P., & Busch, C.
Affiliations
Darmstadt University of Applied Sciences (DE)
Venue
IEEE Access
Published
2022
Volume
10
Pages
31359-31376
ISSN
2169-3536 (ISSN-L)
OpenAlex
W4226373926
Cited by
16
References
65
Citations by year
2026: 3 · 2025: 5 · 2024: 2 · 2023: 4 · 2022: 2
FWCI
1.06
Type
journal article
Language
en
Open access
Locations
  • IEEE Access (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • arXiv (Cornell University)
Funders
  • German Federal Ministry of Education and Research
  • Hessian State Ministry for Higher Education, Research and the Arts within their joint support of the National Research Center for Applied Cybersecurity ATHENE
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
Keywords
face swapping, face morphing, retouching, identity verification, biometric attacks, face recognition security, psychophysics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.