It is time to learn from patients like mine
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Clinicians are often faced with situations where published treatment guidelines do not provide a clear recommendation. In such situations, evidence generated from similar patients’ data captured in electronic health records (EHRs) can aid decision making. However, challenges in generating and making such evidence available have prevented its on-demand use to inform patient care. We propose that a specialty consultation service staffed by a team of medical and informatics experts can rapidly summarize ‘what happened to patients like mine’ using data from the EHR and other health data sources. By emulating a familiar physician workflow, and keeping experts in the loop, such a service can translate physician inquiries about situations with evidence gaps into actionable reports. The demand for and benefits gained from such a consult service will naturally vary by practice type and data robustness. However, we cannot afford to miss the opportunity to use the patient data captured every day via EHR systems to close the evidence gap between available clinical guidelines and realities of clinical practice. We have begun offering such a service to physicians at our academic medical center and believe that such a service should be core offering by clinical informatics professional throughout the country. Only if we launch such efforts broadly can we systematically study the utility of learning from the record of routine clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652
Implementing Machine Learning in Health Care — Addressing Ethical Challenges
Char, D. S., Shah, N. H., & Magnus, D. (2018) · New England Journal of Medicine · doi:10.1056/nejmp1714229 · Cited by 1,857
Self-citationMachine Learning and Prediction in Medicine — Beyond the Peak of Inflated Expectations
Chen, J. H., & Asch, S. M. (2017) · New England Journal of Medicine · doi:10.1056/nejmp1702071 · Cited by 1,171
Clinical decision support in the era of artificial intelligence
Shortliffe, E. H., & Sepúlveda, M. J. (2018) · JAMA · doi:10.1001/jama.2018.17163 · Cited by 920
Krumholz, H. M. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0053 · Cited by 589
What This Computer Needs Is a Physician: Humanism and Artificial Intelligence
Verghese, A., Shah, N. H., & Harrington, R. A. (2018) · JAMA · doi:10.1001/jama.2017.19198 · Cited by 468
Self-citationStewart, W. F., Shah, N. R., Selna, M. J., Paulus, R. A., & Walker, J. M. (2007) · Health Affairs · doi:10.1377/hlthaff.26.2.w181 · Cited by 111
Self-citationPerforming an Informatics Consult: Methods and Challenges
Schuler, A., Callahan, A., Jung, K., & Shah, N. H. (2018) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2017.12.023 · Cited by 37
Self-citation
Cited by
Toward expert-level medical question answering with large language models
Singhal, K., Tu, T., Gottweis, J., Sayres, R., Wulczyn, E., Amin, M., Hou, L., Clark, K., Pfohl, S. R., Cole-Lewis, H., et al. (2025) · Nature Medicine · doi:10.1038/s41591-024-03423-7 · Cited by 1,734
“In a pilot study, we answer real-world medical questions submitted by specialist physicians to a consultation service during routine care delivery 28,29 .”
Self-citationTime to reality check the promises of machine learning-powered precision medicine.
Wilkinson, J., Arnold, K. F., Murray, E. J., van Smeden, M., Carr, K., Sippy, R., de Kamps, M., Beam, A., Konigorski, S., Lippert, C., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30200-4 · Cited by 233
Answering real-world clinical questions using large language model based systems
Low, Y. S., Jackson, M. L., Hyde, R. J., Brown, R. E., Sanghavi, N. M., Baldwin, J. D., Pike, C. W., Muralidharan, J., Hui, G., Alexander, N., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.00541 · Cited by 68
“Such evidence gaps between trials and real-world settings motivate the need for timely and relevant real world evidence (RWE) to guide care and treatment decisions 6,7 .”
BackgroundSelf-citationLow, Y. S., Jackson, M. L., Hyde, R. J., Brown, R. E., Sanghavi, N. M., Baldwin, J. D., Pike, C. W., Muralidharan, J., Hui, G., Alexander, N., et al. (2025) · DIGITAL HEALTH · doi:10.1177/20552076251348850 · Cited by 51
“7,8 Second, even when studies exist, they can have con fl icting fi ndings arising from heterogeneous patient populations, study designs of variable quality, or nonstandard endpoints.”
Using Aggregate Patient Data at the Bedside via an On-Demand Consultation Service
Callahan, A., Gombar, S., Cahan, E. M., Jung, K., Steinberg, E., Polony, V., Morse, K., Tibshirani, R., Hastie, T., Harrington, R., et al. (2021) · NEJM Catalyst · doi:10.1056/cat.21.0224 · Cited by 24
Self-citation
Metadata
- Authors
- Gombar, S., Callahan, A., Califf, R., Harrington, R., & Shah, N. H.
- Venue
- npj Digital Medicine
- Published
- 2019-03-19
- Volume
- 2
- Issue
- 1
- Pages
- 16-16
- ISSN
- 2398-6352 (ISSN-L)
- OpenAlex
- W2924820166
- Cited by
- 49
- References
- 8
- FWCI
- 7.68
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: It is time to learn from patients like mine. https://app.cochat.ai/papers/10.1038/s41746-019-0091-3
- The paper
- Gombar, S., Callahan, A., Califf, R., Harrington, R., & Shah, N. H. (2019). It is time to learn from patients like mine. npj Digital Medicine. https://doi.org/10.1038/s41746-019-0091-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.