Investigating Bias in Facial Analysis Systems: A Systematic Review
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Recent studies have demonstrated that most commercial facial analysis systems are biased against certain categories of race, ethnicity, culture, age and gender. The bias can be traced in some cases to the algorithms used and in other cases to insufficient training of algorithms, while in still other cases bias can be traced to insufficient databases. To date, no comprehensive literature review exists which systematically investigates bias and discrimination in the currently available facial analysis software. To address the gap, this study conducts a systematic literature review (SLR) in which the context of facial analysis system bias is investigated in detail. The review, involving 24 studies, additionally aims to identify (a) facial analysis databases that were created to alleviate bias, (b) the full range of bias in facial analysis software and (c) algorithms and techniques implemented to mitigate bias in facial analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
Guo, Y., Zhang, L., Hu, Y., He, X., & Gao, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_6 · Cited by 2,122
Bulat, A., & Tzimiropoulos, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.116 · Cited by 1,464
Raji, I. D., & Buolamwini, J. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314244 · Cited by 651
Face Recognition Performance: Role of Demographic Information
Klare, B. F., Burge, M. J., Klontz, J. C., Vorder Bruegge, R. W., & Jain, A. K. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2214212 · Cited by 516 · cited 3×
“In addition, to confirming the bias and low accuracy in classifying females other algorithmic audit reported low classification accuracy for children and young populations in general [39], [29], [30].”
BackgroundGender bias in sentiment analysis
Thelwall, M. (2018) · Online Information Review · doi:10.1108/oir-05-2017-0139 · Cited by 78
Taati, B., Zhao, S., Ashraf, A. B., Asgarian, A., Browne, M. E., Prkachin, K. M., Mihailidis, A., & Hadjistavropoulos, T. (2019) · IEEE Access · doi:10.1109/access.2019.2900022 · Cited by 70 · cited 5×
“role in sparking interest in gender and ethnicity classification but also motivated the research community to investigate bias and discrimination in facial analysis algorithms and systems in other domains, for instance, detecting bias against older adults in clinical settings [6] and bias against children in stateof-t…”
BackgroundMethodInfluentialAge and gender bias in pedestrian detection algorithms
Brandao, M. (2019) · arXiv · doi:10.48550/arxiv.1906.10490 · Cited by 32 · cited 2×
“In addition, to confirming the bias and low accuracy in classifying females other algorithmic audit reported low classification accuracy for children and young populations in general [39], [29], [30].”
Background
Cited by
Algorithmic bias: review, synthesis, and future research directions
Kordzadeh, N., & Ghasemaghaei, M. (2022) · European Journal of Information Systems · doi:10.1080/0960085x.2021.1927212 · Cited by 770
“First, their focuses are either too broad, such as data science ethics (Saltz & Dewar, 2019) and algorithmic accountability (Wieringa, 2020), or too narrow, including AI for employee management (Robert et al., 2020) and facial analysis systems (Khalil et al., 2020).”
InfluentialEthical framework for Artificial Intelligence and Digital technologies
Ashok, M., Madan, R., Joha, A., & Sivarajah, U. (2022) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2021.102433 · Cited by 469
Black-Box Access is Insufficient for Rigorous AI Audits
Casper, S., Ezell, C., Siegmann, C., Kolt, N., Curtis, T. L., Bucknall, B., Haupt, A., Wei, K., Scheurer, J., Hobbhahn, M., et al. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3659037 · Cited by 86
Survey on Machine Learning Biases and Mitigation Techniques
Siddique, S., Haque, M. A., George, R., Gupta, K. D., Gupta, D., & Faruk, M. J. H. (2023) · Digital · doi:10.3390/digital4010001 · Cited by 78
RAISE: Robotics & AI to improve STEM and social skills for elementary school students
Hughes, C. E., Dieker, L. A., Glavey, E. M., Hines, R. A., Wilkins, I., Ingraham, K., Bukaty, C. A., Ali, K., Shah, S., Murphy, J., et al. (2022) · Frontiers in Virtual Reality · doi:10.3389/frvir.2022.968312 · Cited by 47
Metadata
- Authors
- Khalil, A., Ahmed, S. G., Khattak, A. M., & Al-Qirim, N.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 130751-130761
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3038923964
- Cited by
- 80
- References
- 7
- FWCI
- 1.68
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Investigating Bias in Facial Analysis Systems: A Systematic Review. https://app.cochat.ai/papers/10.1109/access.2020.3006051
- The paper
- Khalil, A., Ahmed, S. G., Khattak, A. M., & Al-Qirim, N. (2020). Investigating Bias in Facial Analysis Systems: A Systematic Review. IEEE Access. https://doi.org/10.1109/access.2020.3006051
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.