Tackling bias in AI health datasets through the STANDING Together initiative
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Additionally, without real-world evaluation, AI models’ bias could remain undetected, which could inadvertently contribute to disparities in health outcomes.8–10”
From Randomised controlled trials evaluating artificial intelligence in clinical practice: a scoping review (2024) · cites this paper as [9]
In the citing paper
“To address this, the STANDING TOGETHER project was initiated to develop standards that ensure datasets for training and testing AI systems are diverse, inclusive, and promote AI generalizability [57].”
From Bias in artificial intelligence algorithms and recommendations for mitigation (2023) · cites this paper as [57]
In the citing paper
“The STANdards for data Diversity, INclusivity and Generalisability (STANDING) Together initiative has developed standards for data diversity, inclusivity, and generalisability.36”
From PROBAST+AI: an updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence methods (2025) · cites this paper as [36]
In the citing paper
“While initiatives like Open Science Practices and STANDING34,54 aspire to improve the diversity of data resources available for healthcare AI, vulnerable groups may remain under-represented given a relative abundance of resources from Western, Educated, Industrialized, Rich, and Democratic (WEIRD) populations.”
From Bias recognition and mitigation strategies in artificial intelligence healthcare applications (2025) · cites this paper as [54]
In the citing paper
“The STANDING Together initiative (standards for data diversity, inclusivity, and generalizability), launched in September 2022, aims to develop recommendations for the composition (who is represented) and reporting (how they are represented) of datasets underpinning medical AI systems18.”
From Bias in AI-based models for medical applications: challenges and mitigation strategies (2023) · cites this paper as [18]
Citations
Cites
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469
Seyyed-Kalantari, L., Zhang, H., McDermott, M. B. A., Chen, I. Y., & Ghassemi, M. (2021) · Nature Medicine · doi:10.1038/s41591-021-01595-0 · Cited by 928
Self-citationKhan, S. M., Liu, X., Nath, S., Korot, E., Faes, L., Wagner, S. K., Keane, P. A., Sebire, N. J., Burton, M. J., & Denniston, A. K. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30240-5 · Cited by 334
Self-citationEthical limitations of algorithmic fairness solutions in health care machine learning
McCradden, M. D., Joshi, S., Mazwi, M., & Anderson, J. A. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30065-0 · Cited by 291
Self-citationCharacteristics of publicly available skin cancer image datasets: a systematic review
Wen, D., Khan, S. M., Ji Xu, A., Ibrahim, H., Smith, L., Caballero, J., Zepeda, L., de Blas Perez, C., Denniston, A. K., Liu, X., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00252-1 · Cited by 243
Self-citationHealthsheet: Development of a Transparency Artifact for Health Datasets
Rostamzadeh, N., Mincu, D., Roy, S., Smart, A., Wilcox, L. G., Pushkarna, M., Schrouff, J., Amironesei, R., Moorosi, N., & Heller, K. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533239 · Cited by 106
Self-citation
Research works printed but not linked: 3
- FDA Center for Devices & Radiological Health. https://go.nature.com/3AG0McN (2021).
- Schwartz, R. et al. National Institute of Standards and Technology; https://go.nature.com/3Q6rjpj (2022).
- Medicines and Healthcare products Regulatory Agency. https://go.nature.com/3RsijvS (2021).
Cited by
Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., van Smeden, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-078378 · Cited by 4,718
“Alongside methodological advancements, considerations of fairness, 62 wider acceptance of open science practices, 63 and public and patient involvement in research and implementation of research, 64 65 an update to the TRIPOD 2015 statement is needed to capture these developments and the…”
BackgroundSelf-citationMoons, K. G. M., Damen, J. A. A., Kaul, T., Hooft, L., Andaur Navarro, C., Dhiman, P., Beam, A. L., Van Calster, B., Celi, L. A., Denaxas, S., et al. (2025) · BMJ · doi:10.1136/bmj-2024-082505 · Cited by 1,069
“36 This means that data sources should include information from individuals representing a diversity of characteristics, such as age, sex or gender, and race or ethnicity, as well as individuals with different health conditions or comorbidities and potentially from different geographical locations…”
Self-citationEvaluation of clinical prediction models (part 1): from development to external validation
Collins, G. S., Dhiman, P., Ma, J., Schlussel, M. M., Archer, L., Van Calster, B., Harrell, F. E., Martin, G. P., Moons, K. G. M., van Smeden, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-074819 · Cited by 798
Lekadir, K., Frangi, A. F., Porras, A. R., Glocker, B., Cintas, C., Langlotz, C. P., Weicken, E., Asselbergs, F. W., Prior, F., Collins, G. S., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081554 · Cited by 957
Bias in artificial intelligence algorithms and recommendations for mitigation
Nazer, L. H., Zatarah, R., Waldrip, S., Ke, J. X. C., Moukheiber, M., Khanna, A. K., Hicklen, R. S., Moukheiber, L., Moukheiber, D., Ma, H., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000278 · Cited by 621
Metadata
- Authors
- Ganapathi, S., Palmer, J., Alderman, J. E., Calvert, M., Espinoza, C., Gath, J., Ghassemi, M., Heller, K., Mckay, F., Karthikesalingam, A., Kuku, S., Mackintosh, M., Manohar, S., Mateen, B. A., Matin, R., McCradden, M., Oakden-Rayner, L., Ordish, J., Pearson, R., Pfohl, S. R., Rostamzadeh, N., Sapey, E., Sebire, N., Sounderajah, V., Summers, C., Treanor, D., Denniston, A. K., & Liu, X.
- Affiliations
- University of Birmingham (GB)
- University Hospitals Birmingham NHS Foundation Trust (GB)
- NIHR Surgical Reconstruction and Microbiology Research Centre (GB)
- Massachusetts Institute of Technology (US)
- Google (United States) (US)
- University of Oxford (GB)
- Google (United Kingdom) (GB)
- University College London (GB)
- Genomics England (GB)
- Health Data Research UK (GB)
- Oxford University Hospitals NHS Trust (GB)
- University of Toronto (CA)
- Medicines and Healthcare products Regulatory Agency (GB)
- Great Ormond Street Hospital (GB)
- Imperial College London (GB)
- University of Cambridge (GB)
- Linköping University (SE)
- Corresponding author
- Liu, Xiaoxuan
- ORCID
- Ganapathi, Shaswath
- Palmer, Jo
- Alderman, Joseph E.
- Calvert, Melanie
- Gath, Jacqui
- Ghassemi, Marzyeh
- Heller, Katherine
- Mckay, Francis
- Karthikesalingam, Alan
- Kuku, Stephanie
- Mackintosh, Maxine
- Manohar, Sinduja
- Mateen, Bilal A.
- Matin, Rubeta
- McCradden, Melissa
- Oakden-Rayner, Lauren
- Ordish, Johan
- Pearson, Russell
- Rostamzadeh, Negar
- Sapey, Elizabeth
- Sebire, Neil
- Sounderajah, Viknesh
- Summers, Charlotte
- Treanor, Darren
- Denniston, Alastair K.
- Liu, Xiaoxuan
- Venue
- Nature Medicine
- Published
- 2022-09-26
- Volume
- 28
- Issue
- 11
- Pages
- 2232-2233
- ISSN
- 1078-8956 (ISSN-L)
- 1546-170X
- OpenAlex
- W4297243326
- Cited by
- 82
- References
- 8
- Citations by year
- 2026: 11 · 2025: 24 · 2024: 31 · 2023: 15 · 2022: 1
- FWCI
- 20.59
- Type
- journal article
- Language
- en
- Open access
- Licence
- other-oa
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Medicine (publishedVersion)
- PubMed (publishedVersion)
- University of Birmingham Research Portal (University of Birmingham) (publishedVersion, other-oa)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Funders
- DH | National Institute for Health Research (AI_HI200014)
- NIHR, The Health Foundation and The NHS AI Lab
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- algorithmic bias, health data, artificial intelligence, breast pathology, diagnostic imaging, demographic prediction, confounding, health equity
- MeSH terms
- Artificial Intelligence, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Tackling bias in AI health datasets through the STANDING Together initiative. https://app.cochat.ai/papers/10.1038/s41591-022-01987-w
- The paper
- Ganapathi, S., Palmer, J., Alderman, J. E., Calvert, M., Espinoza, C., Gath, J., Ghassemi, M., Heller, K., Mckay, F., Karthikesalingam, A., Kuku, S., Mackintosh, M., Manohar, S., Mateen, B. A., Matin, R., McCradden, M., Oakden-Rayner, L., Ordish, J., Pearson, R., . . . Liu, X. (2022). Tackling bias in AI health datasets through the STANDING Together initiative. Nature Medicine. https://doi.org/10.1038/s41591-022-01987-w
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.