The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Accuracy Comparison Across Face Recognition Algorithms: Where Are We on Measuring Race Bias?
Open accessAbstract
Previous generations of face recognition algorithms differ in accuracy for images of different races (race bias). Here, we present the possible underlying factors (data-driven and scenario modeling) and methodological considerations for assessing race bias in algorithms. We discuss data-driven factors (e.g., image quality, image population statistics, and algorithm architecture), and scenario modeling factors that consider the role of the "user" of the algorithm (e.g., threshold decisions and demographic constraints). To illustrate how these issues apply, we present data from four face recognition algorithms (a previous-generation algorithm and three deep convolutional neural networks, DCNNs) for East Asian and Caucasian faces. First, dataset difficulty affected both overall recognition accuracy and race bias, such that race bias increased with item difficulty. Second, for all four algorithms, the degree of bias varied depending on the identification decision threshold. To achieve equal false accept rates (FARs), East Asian faces required higher identification thresholds than Caucasian faces, for all algorithms. Third, demographic constraints on the formulation of the distributions used in the test, impacted estimates of algorithm accuracy. We conclude that race bias needs to be measured for individual applications and we provide a checklist for measuring this bias in face recognition algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Face Recognition Performance: Role of Demographic Information
Klare, B. F., Burge, M. J., Klontz, J. C., Vorder Bruegge, R. W., & Jain, A. K. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2214212 · Cited by 516 · cited 4×
“Given that humans show an other-race effect for face recognition, it is not surprising that previous research has investigated the effects of race on the accuracy of face recognition algorithms [14], [15], [16], [17], [18], [19], [20], [21].”
BackgroundResultInfluentialFace recognition accuracy of forensic examiners, superrecognizers, and face recognition algorithms
Phillips, P. J., Yates, A. N., Hu, Y., Hahn, C. A., Noyes, E., Jackson, K., Cavazos, J. G., Jeckeln, G., Ranjan, R., Sankaranarayanan, S., et al. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1721355115 · Cited by 461 · cited 2×
“Most recently, A2017b was found to be comparable in accuracy to that of forensic facial examiners [39].”
BackgroundResultSelf-citation
Cited by
Face recognition vendor test part 3: demographic effects
Grother, P., Ngan, M., & Hanaoka, K. (2019) · doi:10.6028/nist.ir.8280 · Cited by 323
Responsible AI in Africa: Challenges and Opportunities
(2023) · Social and Cultural Studies of Robots and AI · doi:10.1007/978-3-031-08215-3 · Cited by 82
Responsible AI in Africa—Challenges and Opportunities
Okolo, C. T., Aruleba, K., & Obaido, G. (2023) · Social and Cultural Studies of Robots and AI · doi:10.1007/978-3-031-08215-3_3 · Cited by 79
Validated assessment tools for screen media use: a systematic review.
Perez, O., Garza, T., Hindera, O., Beltran, A., Musaad, S. M., Dibbs, T., Singh, A., Chug, S., Sisson, A., Kumar Vadathya, A., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0283714 · Cited by 44
Using infrared to improve face recognition of individuals with highly pigmented skin
Muthua, A. G., Theart, R. P., & Booysen, M. J. (2023) · iScience · doi:10.1016/j.isci.2023.107039 · Cited by 5
Metadata
- Authors
- Cavazos, J. G., Phillips, P. J., Castillo, C. D., & O'Toole, A. J.
- Venue
- IEEE Transactions on Biometrics, Behavior, and Identity Science
- Published
- 2021-01
- Volume
- 3
- Issue
- 1
- Pages
- 101-111
- ISSN
- 2637-6407 (ISSN-L)
- OpenAlex
- W2995383516
- Cited by
- 214
- References
- 4
- FWCI
- 11.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Accuracy Comparison Across Face Recognition Algorithms: Where Are We on Measuring Race Bias? https://app.cochat.ai/papers/10.1109/tbiom.2020.3027269
- The paper
- Cavazos, J. G., Phillips, P. J., Castillo, C. D., & O'Toole, A. J. (2021). Accuracy Comparison Across Face Recognition Algorithms: Where Are We on Measuring Race Bias? IEEE Transactions on Biometrics, Behavior, and Identity Science. https://doi.org/10.1109/tbiom.2020.3027269
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.