Bias in algorithms of AI systems developed for COVID-19: A scoping review
Open accessThe DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
To analyze which ethically relevant biases have been identified by academic literature in artificial intelligence (AI) algorithms developed either for patient risk prediction and triage, or for contact tracing to deal with the COVID-19 pandemic. Additionally, to specifically investigate whether the role of social determinants of health (SDOH) have been considered in these AI developments or not. We conducted a scoping review of the literature, which covered publications from March 2020 to April 2021. Studies mentioning biases on AI algorithms developed for contact tracing and medical triage or risk prediction regarding COVID-19 were included. From 1054 identified articles, 20 studies were finally included. We propose a typology of biases identified in the literature based on bias, limitations and other ethical issues in both areas of analysis. Results on health disparities and SDOH were classified into five categories: racial disparities, biased data, socio-economic disparities, unequal accessibility and workforce, and information communication. SDOH needs to be considered in the clinical context, where they still seem underestimated. Epidemiological conditions depend on geographic location, so the use of local data in studies to develop international solutions may increase some biases. Gender bias was not specifically addressed in the articles included. The main biases are related to data collection and management. Ethical problems related to privacy, consent, and lack of regulation have been identified in contact tracing while some bias-related health inequalities have been highlighted. There is a need for further research focusing on SDOH and these specific AI apps.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“However, recent studies have raised concerns about biases within these algorithms that could lead to health disparities, and potentially harm [14–16].”
From Bias in artificial intelligence algorithms and recommendations for mitigation (2023) · cites this paper as [15]
In the citing paper
“AI models developed for COVID-19 patient risk prediction, triage, and contact tracing have shown feature selection bias through inadequate representation or consideration of social determinants of health (SDOH), such as race, socio-economic status, and access to technology. The underrepresentation of these factors has led to biased outcomes, particularly those most vulnerable or marginalized95.”
From Bias recognition and mitigation strategies in artificial intelligence healthcare applications (2025) · cites this paper as [95]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · cited 1×
“This scoping review followed the recommended five-step framework for scoping reviews (Arksey and O ’ Malley 2005; Munn et al. 2018; Pham et al. 2014; Tricco et al. 2016).”
MethodMunn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0611-x · Cited by 11,385
Cochrane Database of Systematic Reviews
(2011) · Progress in Neurology and Psychiatry · doi:10.1002/pnp.208 · Cited by 4,667
A scoping review of scoping reviews: advancing the approach and enhancing the consistency
Pham, M. T., Rajić, A., Greig, J. D., Sargeant, J. M., Papadopoulos, A., & McEwen, S. A. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1123 · Cited by 3,078
Wynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070 · cited 7×
“2020), and one from The Netherlands (Wynants et al. 2020), Spain (Sáez et al.”
BackgroundInfluentialFeasibility of controlling COVID-19 outbreaks by isolation of cases and contacts
Hellewell, J., Abbott, S., Gimma, A., Bosse, N. I., Jarvis, C. I., Russell, T. W., Munday, J. D., Kucharski, A. J., Edmunds, W. J., Sun, F., et al. (2020) · The Lancet Global Health · doi:10.1016/s2214-109x(20)30074-7 · Cited by 2,550 · cited 1×
“DCT becomes less effective when dealing with asymptomatic individuals, since symptom checkers and apps rely on pulse, temperature, and sleeping patterns (Hellewell et al. 2020, cited in Mbunge 2020).”
BackgroundA scoping review on the conduct and reporting of scoping reviews
Tricco, A. C., Lillie, E., Zarin, W., O’Brien, K., Colquhoun, H., Kastner, M., Levac, D., Ng, C., Sharpe, J. P., Wilson, K., et al. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0116-4 · Cited by 2,250
Explainability for artificial intelligence in healthcare: a multidisciplinary perspective
the Precise4Q consortium, Amann, J., Blasimme, A., Vayena, E., Frey, D., & Madai, V. I. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01332-6 · Cited by 2,203 · cited 1×
“By algorithmic biases in AI, we refer to systematic errors in a computer system, with a consequent deviation from the expected prediction behavior of an AI tool (Amann et al. 2020).”
MethodAmazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *
Dastin, J. (2022) · Ethics of Data and Analytics · doi:10.1201/9781003278290-44 · Cited by 1,165
Research works printed but not linked: 1
- Buolamwini, J., and T. Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. Proceedings of Machine Learning Research 81:1–15.
Cited by
Bias in artificial intelligence algorithms and recommendations for mitigation
Nazer, L. H., Zatarah, R., Waldrip, S., Ke, J. X. C., Moukheiber, M., Khanna, A. K., Hicklen, R. S., Moukheiber, L., Moukheiber, D., Ma, H., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000278 · Cited by 621
Bias recognition and mitigation strategies in artificial intelligence healthcare applications
Hasanzadeh, F., Josephson, C. B., Waters, G., Adedinsewo, D., Azizi, Z., & White, J. A. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01503-7 · Cited by 320
“The underrepresentation of these factors has led to biased outcomes, particularly those most vulnerable or marginalized 95 . https://doi.org/10.1038/s41746-025-01503-7 Review article npj Digital Medicine| (2025) 8:154”
InfluentialA Scoping Review of Reporting Gaps in FDA-Approved AI Medical Devices
Muralidharan, V., Adewale, B. A., Huang, C. J., Nta, M. T., Ademiju, P. O., Pathmarajah, P., Hang, M. K., Adesanya, O., Abdullateef, R. O., Babatunde, A. O., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01270-x · Cited by 201
Schukow, C., Smith, S. C., Landgrebe, E., Parasuraman, S., Folaranmi, O. O., Paner, G. P., & Amin, M. B. (2024) · Advances in Anatomic Pathology · doi:10.1097/pap.0000000000000406 · Cited by 84
“37 Last, but not the least, it is apparent that AI natural language processing – generated medical references must be made transparent and clear to readers whenever they are used.”
BackgroundKhera, R., Asnani, A. H., Krive, J., Addison, D., Zhu, H., Vasbinder, A. L., Fleming, M. R., Arnaout, R., Razavi, P., & Okwuosa, T. M. (2025) · Circulation Genomic and Precision Medicine · doi:10.1161/hcg.0000000000000097 · Cited by 90
“109 These incidents highlight the vulnerable nature of AI systems and the need for oversight.”
Metadata
- Authors
- Delgado, J., de Manuel, A., Parra, I., Moyano, C., Rueda, J., Guersenzvaig, A., Ausin, T., Cruz, M., Casacuberta, D., & Puyol, A.
- Affiliations
- Universidad de Granada (ES)
- Elisava Barcelona School of Design and Engineering (ES)
- Universitat Autònoma de Barcelona (ES)
- Corresponding author
- Casacuberta, David
- Venue
- Journal of Bioethical Inquiry
- Published
- 2022-07-20
- Volume
- 19
- Issue
- 3
- Pages
- 407-419
- ISSN
- 1176-7529 (ISSN-L)
- 1872-4353
- PMC
- PMC9463236
- OpenAlex
- W4286210149
- Cited by
- 70
- References
- 50
- Citations by year
- 2026: 7 · 2025: 25 · 2024: 20 · 2023: 17 · 2022: 1
- FWCI
- 2.99
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Journal of Bioethical Inquiry (publishedVersion, cc-by)
- Research Square (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Dipòsit Digital de Documents de la UAB (Universitat Autònoma de Barcelona) (submittedVersion, cc-by)
- RISalud Institutional Health Repository of Andalucía (submittedVersion, cc-by)
- Institutional Repository of the University of Granada (University of Granada) (submittedVersion, cc-by)
- Institutional Repository of the University of Granada (University of Granada) (submittedVersion, cc-by-nc-nd)
- DIGITAL.CSIC (Spanish National Research Council (CSIC)) (submittedVersion, cc-by)
- RIUVic (UVic-UCC) (submittedVersion, other-oa)
- Funders
- Fundación BBVA
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Information Systems › COVID-19 Digital Contact Tracing
- Keywords
- algorithmic bias, AI ethics, COVID-19 pandemic, contact tracing, triage, risk prediction, social determinants of health, health disparities, racial disparities, socioeconomic disparities, data bias, privacy, consent, AI regulation
- MeSH terms
- COVID-19, Artificial Intelligence, Humans, Bias, Contact Tracing, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Bias in algorithms of AI systems developed for COVID-19: A scoping review. https://app.cochat.ai/papers/10.1007/s11673-022-10200-z
- The paper
- Delgado, J., de Manuel, A., Parra, I., Moyano, C., Rueda, J., Guersenzvaig, A., Ausin, T., Cruz, M., Casacuberta, D., & Puyol, A. (2022). Bias in algorithms of AI systems developed for COVID-19: A scoping review. Journal of Bioethical Inquiry. https://doi.org/10.1007/s11673-022-10200-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
