A systematic review of socio-technical gender bias in AI algorithms
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Purpose: Gender bias in artificial intelligence (AI) should be solved as a priority before AI algorithms become ubiquitous, perpetuating and accentuating the bias. While the problem has been identified as an established research and policy agenda, a cohesive review of existing research specifically addressing gender bias from a socio-technical viewpoint is lacking. Thus, the purpose of this study is to determine the social causes and consequences of, and proposed solutions to, gender bias in AI algorithms. Design/methodology/approach: A comprehensive systematic review followed established protocols to ensure accurate and verifiable identification of suitable articles. The process revealed 177 articles in the socio-technical framework, with 64 articles selected for in-depth analysis. Findings: Most previous research has focused on technical rather than social causes, consequences and solutions to AI bias. From a social perspective, gender bias in AI algorithms can be attributed equally to algorithmic design and training datasets. Social consequences are wide-ranging, with amplification of existing bias the most common at 28%. Social solutions were concentrated on algorithmic design, specifically improving diversity in AI development teams (30%), increasing awareness (23%), human-in-the-loop (23%) and integrating ethics into the design process (21%). Originality/value: This systematic review is the first of its kind to focus on gender bias in AI algorithms from a social perspective within a socio-technical framework. Identification of key causes and consequences of bias and the breakdown of potential solutions provides direction for future research and policy within the growing field of AI ethics. Peer review: The peer review history for this article is available at https://publons.com/publon/10.1108/OIR-08-2021-0452
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fereday, J., & Muir-Cochrane, E. (2006) · International Journal of Qualitative Methods · doi:10.1177/160940690600500107 · Cited by 11,829
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · cited 1×
“There have been many studies dedicated to fairness, accountability, transparency and auditing of AI algorithms to mitigate bias (UNESCO, 2020; Jobin et al ., 2019; Thelwall, 2018).”
BackgroundHow the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196
Artificial Intelligence and Management: The Automation–Augmentation Paradox
Raisch, S., & Krakowski, S. (2021) · Academy of Management Review · doi:10.5465/amr.2018.0072 · Cited by 2,755
Fairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631
A systematic review of systematic review process research in software engineering
Kitchenham, B., & Brereton, P. (2013) · Information and Software Technology · doi:10.1016/j.infsof.2013.07.010 · Cited by 1,094
Bias in data‐driven artificial intelligence systems—An introductory survey
Ntoutsi, E., Fafalios, P., Gadiraju, U., Iosifidis, V., Nejdl, W., Vidal, M., Ruggieri, S., Turini, F., Papadopoulos, S., Krasanakis, E., et al. (2020) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1356 · Cited by 1,043
Accountable Artificial Intelligence: Holding Algorithms to Account
Busuioc, M. (2021) · Public Administration Review · doi:10.1111/puar.13293 · Cited by 652
Society-in-the-loop: programming the algorithmic social contract
Rahwan, I. (2018) · Ethics and Information Technology · doi:10.1007/s10676-017-9430-8 · Cited by 553
Veale, M., & Binns, R. (2017) · Big Data & Society · doi:10.1177/2053951717743530 · Cited by 512
Cited by
Ruiz-Rojas, L. I., Salvador-Ullauri, L., & Acosta-Vargas, P. (2024) · Sustainability · doi:10.3390/su16135367 · Cited by 263
“Combining these tools with established strategies such as problem-based learning and online discussions aligns with the findings of a work that emphasizes the importance of active learning for more profound understanding [35].”
InfluentialRETRACTED: Debiasing misinformation: how do people diagnose health recommendations from AI?
Shin, D., Jitkajornwanich, K., Lim, J. S., & Spyridou, A. (2024) · Online Information Review · doi:10.1108/oir-04-2023-0167 · Cited by 32
RetractedAdapting peer review for the future: Digital disruptions and trust in peer review
Calamur, H., & Ghosh, R. (2024) · Learned Publishing · doi:10.1002/leap.1594 · Cited by 16
Hutson, J., Fulcher, B., & Ratican, J. (2024) · IJERI: International Journal of Educational Research and Innovation · doi:10.46661/ijeri.11038 · Cited by 12
“For example, gender bias has been a particular focus in AI and machine learning (ML), with scholars emphasizing the need to integrate diversity and gender theory into AI system development to mitigate such biases (Hall & Ellis, 2023; Kordzadeh & Ghasemaghaei, 2022; Leavy, 2018).”
Imagining the Far East: Exploring Perceived Biases in AI-Generated Images of East Asian Women
Lan, X., An, J., Guo, Y., Chiyou, T., Cai, X., & Zhang, J. (2025) · Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706599.3719678 · Cited by 8
Metadata
- Authors
- Hall, P., & Ellis, D.
- Venue
- Online Information Review
- Publisher
- Emerald
- Published
- 2023-03-14
- Volume
- 47
- Issue
- 7
- Pages
- 1264-1279
- ISSN
- 1468-4527 (ISSN-L)
- OpenAlex
- W4327611086
- Cited by
- 94
- References
- 21
- FWCI
- 5.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A systematic review of socio-technical gender bias in AI algorithms. https://app.cochat.ai/papers/10.1108/oir-08-2021-0452
- The paper
- Hall, P., & Ellis, D. (2023). A systematic review of socio-technical gender bias in AI algorithms. Online Information Review. https://doi.org/10.1108/oir-08-2021-0452
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.