Reverse engineering the face space: Discovering the critical features for face identification
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
How do we identify people? What are the critical facial features that define an identity and determine whether two faces belong to the same person or different people? To answer these questions, we applied the face space framework, according to which faces are represented as points in a multidimensional feature space, such that face space distances are correlated with perceptual similarities between faces. In particular, we developed a novel method that allowed us to reveal the critical dimensions (i.e., critical features) of the face space. To that end, we constructed a concrete face space, which included 20 facial features of natural face images, and asked human observers to evaluate feature values (e.g., how thick are the lips). Next, we systematically and quantitatively changed facial features, and measured the perceptual effects of these manipulations. We found that critical features were those for which participants have high perceptual sensitivity (PS) for detecting differences across identities (e.g., which of two faces has thicker lips). Furthermore, these high PS features vary minimally across different views of the same identity, suggesting high PS features support face recognition across different images of the same face. The methods described here set an infrastructure for discovering the critical features of other face categories not studied here (e.g., Asians, familiar) as well as other aspects of face processing, such as attractiveness or trait inferences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lowd, D., & Meek, C. (2005) · Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining · doi:10.1145/1081870.1081950 · Cited by 755
Yovel, G., & Kanwisher, N. (2004) · Neuron · doi:10.1016/j.neuron.2004.11.018 · Cited by 450
Self-citation
Cited by
Feature instructions improve face-matching accuracy
Megreya, A. M., & Bindemann, M. (2018) · PLOS ONE · doi:10.1371/journal.pone.0193455 · Cited by 36
Kaur, S., Kumar, P., & Kumaraguru, P. (2020) · Journal of Electronic Imaging · doi:10.1117/1.jei.29.3.033013 · Cited by 35
Forensic Facial Comparison: Current Status, Limitations, and Future Directions
Bacci, N., Davimes, J. G., Steyn, M., & Briers, N. (2021) · Biology · doi:10.3390/biology10121269 · Cited by 26
Steps towards a cognitive theory of unfamiliar face matching
Bindemann, M., & Burton, A. M. (2021) · Forensic Face Matching · doi:10.1093/oso/9780198837749.003.0003 · Cited by 13
Fysh, M. C., & Bindemann, M. (2023) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218221104476 · Cited by 8
Assessing the effect of facial disguises on forensic facial comparison by morphological analysis
Bacci, N., Briers, N., & Steyn, M. (2021) · Journal of Forensic Sciences · doi:10.1111/1556-4029.14722 · Cited by 4
Metadata
- Authors
- Abudarham, N., & Yovel, G.
- Venue
- Journal of Vision
- Published
- 2016-02-26
- Volume
- 16
- Issue
- 3
- Pages
- 40
- ISSN
- 1534-7362 (ISSN-L)
- OpenAlex
- W1971988784
- Cited by
- 75
- References
- 2
- FWCI
- 2.94
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.