The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Generative models improve fairness of medical classifiers under distribution shifts
Open accessPublished version of a preprint
Abstract
Domain generalization is a ubiquitous challenge for machine learning in healthcare. Model performance in real-world conditions might be lower than expected because of discrepancies between the data encountered during deployment and development. Underrepresentation of some groups or conditions during model development is a common cause of this phenomenon. This challenge is often not readily addressed by targeted data acquisition and ‘labeling’ by expert clinicians, which can be prohibitively expensive or practically impossible because of the rarity of conditions or the available clinical expertise. We hypothesize that advances in generative artificial intelligence can help mitigate this unmet need in a steerable fashion, enriching our training dataset with synthetic examples that address shortfalls of underrepresented conditions or subgroups. We show that diffusion models can automatically learn realistic augmentations from data in a label-efficient manner. We demonstrate that learned augmentations make models more robust and statistically fair in-distribution and out of distribution. To evaluate the generality of our approach, we studied three distinct medical imaging contexts of varying difficulty: (1) histopathology, (2) chest X-ray and (3) dermatology images. Complementing real samples with synthetic ones improved the robustness of models in all three medical tasks and increased fairness by improving the accuracy of clinical diagnosis within underrepresented groups, especially out of distribution.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures











Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLM-based oncological tools exhibit racial and gender biases that could widen, rather than narrow, existing cancer care disparities”
From A generative AI multi-agent framework with integrated XAI governance for cancer diagnostics: from multi-omics interpretation to lifestyle risk stratification (2026) · cites this paper as Ktena et al., 2024
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Generative models have shown promise in partially mitigating these disparities by generating synthetic data for underrepresented subgroups, improving classifier fairness under distribution shift”
From A generative AI multi-agent framework with integrated XAI governance for cancer diagnostics: from multi-omics interpretation to lifestyle risk stratification (2026) · cites this paper as Ktena et al., 2024
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“lifestyle data from epidemiological studies systematically overrepresents high-income Western populations (Ktena et al., 2024; Marchesi et al., 2025).”
From A generative AI multi-agent framework with integrated XAI governance for cancer diagnostics: from multi-omics interpretation to lifestyle risk stratification (2026) · cites this paper as Ktena et al., 2024
Experimental — accuracy not yet measuredIn the citing paper
“Generative AI models, such as large language models or vision-language models capable of synthesizing images, additionally allow for tailored data augmentation by creating new examples that meet a set of targeted criteria.71, 72, 73”
From Bias in artificial intelligence for medical imaging: fundamentals, detection, avoidance, mitigation, challenges, ethics, and prospects (2024) · cites this paper as [73]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 2×
“, 2017) and ImageNet21K (Deng et al., 2009) for pretraining to explore how much different pretraining datasets impact final results.”
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Abdi, H., & Williams, L. J. (2010) · WIREs Computational Statistics · doi:10.1002/wics.101 · Cited by 11,104
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712 · cited 5×
“19,20,43 for the generation and the upsampler (only the radiology and dermatology datasets required higher-resolution images).”
InfluentialWang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., & Summers, R. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.369 · Cited by 4,616
A generalization of sampling without replacement from a finite universe
Horvitz, D. G., & Thompson, D. J. (1952) · Journal of the American Statistical Association · doi:10.1080/01621459.1952.10483446 · Cited by 4,293 · cited 1×
“…examples of chest X-rays from the CheXpert dataset, we evaluated on a held-out CheXpert test set (containing 13,332 images), which we considered in-distribution, and the test set of ChestX-ray14 (containing 17,723 images), which we considered OOD because of demographic and acquisition shifts.”
(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
A theory of learning from different domains
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010) · Machine Learning · doi:10.1007/s10994-009-5152-4 · Cited by 3,515 · cited 1×
“Previous work on OOD generalization 65–67 pointed out that several factors can affect the performance of a model on samples from domains beyond the training data.”
Research works printed but not linked: 14
- Irvin, J. et al. Proc. AAAI Conference on Artificial Intelligence (AAAI, 2019).
- Wang, X. et al. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2017).
- Cheng, V., Suriyakumar, V. M., Dullerud, N., Joshi, S. & Ghassemi, M. Proc. 2021 ACM Conference on Fairness, Accountability, and Transparency (Association for Computing Machinery, 2021).
- Tomasev, N., McKee, K. R., Kay, J. & Mohamed, S. Proc. 2021 AAAI/ACM Conference on AI, Ethics, and Society (Association for Computing Machinery, 2021).
- Goodfellow, I. et al. Generative adversarial nets. In Advances in Neural Information Processing Systems (eds. Ghahramani, Z. et al.) 2672–2680 (2014).
- Rashid, H., Tanveer, M. A. & Khan, H. A. Proc. 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (IEEE, 2019).
- Gowal, S. et al. Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE, 2020).
- Bissoto, A., Valle, E. & Avila, S. Proc. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (IEEE, 2021).
- Somepalli, G., Singla, V., Goldblum, M., Geiping, J., & Goldstein, T. Proc. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2023).
- Sun, C., Shrivastava, A., Singh, S. & Gupta, A. Proc. 2017 IEEE International Conference on Computer Vision (ICCV) (IEEE, 2017).
- Deng, J. et al. Proc. 2009 IEEE Conference on Computer Vision and Pattern Recognition (IEEE, 2009).
- Cubuk, E. D., Zoph, B., Shlens, J. & Le, Q. V. Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops (CVPRW) (IEEE, 2020).
- Lin, T.-Y., Goyal, P., Girshick, R., He, K. & Dollár, P. Proc. IEEE International Conference on Computer Vision (ICCV) (IEEE, 2017).
- Bommasani, R., Creel, K., Kumar, A., Jurafsky, D. & Liang, P. Picking on the same person: does algorithmic monoculture lead to outcome homogenization? In Proc. Advances in Neural Information Processing Systems (eds. Koyejo, S. et al.) 3663–3678 (Curran Associates, Inc., 2022)
Cited by
Ibrahim, M., Khalil, Y. A., Amirrajab, S., Sun, C., Breeuwer, M. M., Pluim, J. P. W., Elen, B., Ertaylan, G., & Dumontier, M. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109834 · Cited by 220
Wang, J., Wang, K., Yu, Y., Lu, Y., Xiao, W., Sun, Z., Liu, F., Zou, Z., Gao, Y., Yang, L., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-03359-y · Cited by 231
“…AI can synthesize high-quality chest X-ray images 5–7 , morphologically preserving three-dimensional (3D) images of the brain 8 and two-dimensional (2D) images of histopathology 9,10 and dermatology 10,11 , and consequently enhancing medical image understanding and improving downstream analysis.”
Koçak, B., Ponsiglione, A., Stanzione, A., Bluethgen, C., Santinha, J., Ugga, L., Huisman, M., Klontzas, M. E., Cannella, R., & Cuocolo, R. (2024) · Diagnostic and Interventional Radiology · doi:10.4274/dir.2024.242854 · Cited by 168
“68 71-73 An overview of bias avoidance strategies at the data processing phase is presented in Figure 10.”
Generative AI for Medical Imaging: extending the MONAI FrameworkPreprint
Pinaya, W. H. L., Graham, M. S., Kerfoot, E., Tudosiu, P.-D., Dafflon, J., Fernández, V., Sanchez, P., Wolleb, J., da Costa, P. F., Patel, A., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.15208 · Cited by 211
“Furthermore, machine learning models trained to perform a downstream task using datasets that also include synthetic data have achieved similar, or even superior performance, compared to models trained with only real data [2,12,48,30].”
ResultA vision–language foundation model for the generation of realistic chest X-ray images
Bluethgen, C., Chambon, P., Delbrouck, J.-B., van der Sluijs, R., Połacin, M., Zambrano Chaves, J. M., Abraham, T. M., Purohit, S., Langlotz, C. P., & Chaudhari, A. S. (2024) · Nature Biomedical Engineering · doi:10.1038/s41551-024-01246-y · Cited by 108
Metadata
- Authors
- Ktena, I., Wiles, O., Albuquerque, I., Rebuffi, S.-A., Tanno, R., Roy, A. G., Azizi, S., Belgrave, D., Kohli, P., Cemgil, T., Karthikesalingam, A., & Gowal, S.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Google (United Kingdom) (GB)
- GlaxoSmithKline (United Kingdom) (GB)
- Corresponding author
- Wiles, Olivia
- ORCID
- Venue
- Nature Medicine
- Published
- 2024-04
- Volume
- 30
- Issue
- 4
- Pages
- 1166-1173
- ISSN
- 1078-8956 (ISSN-L)
- 1546-170X
- PMC
- PMC11031395
- OpenAlex
- W4394683903
- Cited by
- 165
- References
- 73
- Citations by year
- 2026: 58 · 2025: 78 · 2024: 28
- FWCI
- 15.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor, 9 d)
- Locations
- Nature Medicine (publishedVersion, cc-by)
- Research Square (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › COVID-19 diagnosis using AI
- Keywords
- generative models, diffusion models, domain generalization, distribution shift, algorithmic fairness, synthetic data augmentation, underrepresented groups, medical image classification, histopathology, chest radiography, dermatological images, model robustness, label efficiency
- MeSH terms
- Machine Learning, Artificial Intelligence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Generative models improve fairness of medical classifiers under distribution shifts. https://app.cochat.ai/papers/10.1038/s41591-024-02838-6
- The paper
- Ktena, I., Wiles, O., Albuquerque, I., Rebuffi, S.-A., Tanno, R., Roy, A. G., Azizi, S., Belgrave, D., Kohli, P., Cemgil, T., Karthikesalingam, A., & Gowal, S. (2024). Generative models improve fairness of medical classifiers under distribution shifts. Nature Medicine. https://doi.org/10.1038/s41591-024-02838-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.