The DOI matches its Crossref record; 19 of the 21 references it cites were found in a registry or an index.
Do no harm: a roadmap for responsible machine learning for health care
Abstract
Interest in machine-learning applications within medicine has been growing, but few studies have progressed to deployment in patient care. We present a framework, context and ultimately guidelines for accelerating the translation of machine-learning-based interventions in health care. To be successful, translation will require a team of engaged stakeholders and a systematic process from beginning (problem formulation) to end (widespread deployment).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Development of AI prediction algorithms consists of several stages, each of which may contribute to bias [18,19].”
From Bias in artificial intelligence algorithms and recommendations for mitigation (2023) · cites this paper as [19]
In the citing paper
“Medical imaging data from radiology and pathology enable deep learning models to learn diagnostic and prognostic patterns from pixel-level representations [6,29].”
In the citing paper
“Transparent reporting of dataset composition and evaluation across diverse populations supports accountability and appropriate use in different healthcare settings [29].”
In the citing paper
“The rapid integration of artificial intelligence (AI) into emergency department workflows has outpaced clinician training, vendor evaluation infrastructure, and specialty-wide governance.”
From Artificial Intelligence Readiness in Emergency Medicine: Expert Consensus Opinion for Preparing the Workforce (2026) · cites this paper as [24]
In the citing paper
“yet most lack the foundational skills to critically evaluate or safely oversee these products.”
From Artificial Intelligence Readiness in Emergency Medicine: Expert Consensus Opinion for Preparing the Workforce (2026) · cites this paper as [24]
21 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523
(2016) · Cited by 2,334
The practical implementation of artificial intelligence technologies in medicine
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019) · Nature Medicine · doi:10.1038/s41591-018-0307-0 · Cited by 2,246
Deep Reinforcement Learning That Matters
Henderson, P., Islam, R., Bachman, P., Pineau, J., Precup, D., & Meger, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11694 · Cited by 1,685
Race, socioeconomic status, and health: Complexities, ongoing challenges, and research opportunities
Williams, D. R., Mohammed, S. A., Leavell, J., & Collins, C. (2010) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2009.05339.x · Cited by 1,458
The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting
Hemming, K., Haines, T. P., Chilton, P. J., Girling, A. J., & Lilford, R. J. (2015) · BMJ · doi:10.1136/bmj.h391 · Cited by 1,410
CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning
Rajpurkar, P., Irvin, J., Zhu, K., Yang, B., Mehta, H., Duan, T., Ding, D. Y., Bagul, A., Langlotz, C. P., Shpanskaya, K. S., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.05225 · Cited by 1,219
Measuring Diagnoses: ICD Code Accuracy
O'Malley, K. J., Cook, K. F., Price, M. D., Wildes, K. R., Hurdle, J. F., & Ashton, C. M. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00444.x · Cited by 1,116
A targeted real-time early warning score (TREWScore) for septic shock.
Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3719 · Cited by 598
Self-citationCan AI Help Reduce Disparities in General Medical and Mental Health Care?
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.167 · Cited by 401
Self-citation
Research works printed but not linked: 3
- Saria, S. & Subbaswamy, A. Tutorial: safe and reliable machine learning. Preprint at https://arxiv.org/abs/1904.07204 (2019). · arXiv
- Schulam, P. & Saria, S. Reliable decision support using counterfactual models. in Advances in Neural Information Processing Systems 1697–1708 (NeurIPS, 2017).
- Schulam, P. & Saria, S. Can you trust this prediction? Auditing pointwise reliability after learning. in The 22nd International Conference on Artificial Intelligence and Statistics 1022–1031 (PMLR, 2019).
Cited by
Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Artificial intelligence in healthcare: transforming the practice of medicine
Bajwa, J., Munir, U., Nori, A., & Williams, B. (2021) · Future Healthcare Journal · doi:10.7861/fhj.2021-0095 · Cited by 1,856
Liu, X., Cruz Rivera, S., Moher, D., Calvert, M. J., Denniston, A. K., The SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, Chan, A.-W., Darzi, A., Holmes, C., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1034-x · Cited by 1,421
Cruz Rivera, S., Liu, X., Chan, A.-W., Denniston, A. K., Calvert, M. J., The SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, Darzi, A., Holmes, C., Yau, C., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1037-7 · Cited by 933
“Poor clarity on the human–AI interface may lead to a lack of a standard approach and may carry ethical implications, particularly in the event of harm 43,44 .”
Metadata
- Authors
- Wiens, J., Saria, S., Sendak, M., Ghassemi, M., Liu, V. X., Doshi-Velez, F., Jung, K., Heller, K., Kale, D., Saeed, M., Ossorio, P. N., Thadaney-Israni, S., & Goldenberg, A.
- Affiliations
- University of Michigan (US)
- Johns Hopkins University (US)
- Duke University (US)
- University of Toronto (CA)
- Kaiser Permanente (US)
- Stanford University (US)
- Google (United States) (US)
- University of Southern California (US)
- University of Wisconsin–Madison (US)
- Canadian Institute for Advanced Research (CA)
- Corresponding author
- Wiens, Jenna
- Goldenberg, Anna
- ORCID
- Venue
- Nature Medicine
- Published
- 2019-08-19
- Volume
- 25
- Issue
- 9
- Pages
- 1337-1340
- ISSN
- 1078-8956 (ISSN-L)
- 1546-170X
- OpenAlex
- W2969881216
- Semantic Scholar
- b0f8a829450e782fe879d9d48a188d611b6dd74d
- Cited by
- 1,266
- References
- 21
- Citations by year
- 2026: 397 · 2025: 214 · 2024: 164 · 2023: 149 · 2022: 136 · 2021: 110 · 2020: 87 · 2019: 9
- FWCI
- 27.19
- Type
- journal article
- Language
- en
- Update notices
- correction (2019-09-19)
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Johns Hopkins University
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- responsible machine learning, health care, clinical translation, machine learning deployment, stakeholder engagement, problem formulation, moral norms
- MeSH terms
- Clinical Decision-Making, Machine Learning, Delivery of Health Care, Humans
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Do no harm: a roadmap for responsible machine learning for health care. https://app.cochat.ai/papers/10.1038/s41591-019-0548-6
- The paper
- Wiens, J., Saria, S., Sendak, M., Ghassemi, M., Liu, V. X., Doshi-Velez, F., Jung, K., Heller, K., Kale, D., Saeed, M., Ossorio, P. N., Thadaney-Israni, S., & Goldenberg, A. (2019). Do no harm: a roadmap for responsible machine learning for health care. Nature Medicine. https://doi.org/10.1038/s41591-019-0548-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.