The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Guidelines for reinforcement learning in healthcare
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“An RL approach for decisions making in patient treatment was introduced in [317] to realize safe and risk-conscious healthcare practice.”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [317]
Citations
Cites
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652
Komorowski, M., Celi, L. A., Badawi, O., Gordon, A. C., & Faisal, A. A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0213-5 · Cited by 1,290
Self-citationEligibility Traces for Off-Policy Policy Evaluation
Precup, D., Sutton, R. S., & Singh, S. P. (2000) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 439
Learning Representations for Counterfactual Inference
Johansson, F. D., Shalit, U., & Sontag, D. (2016) · arXiv · doi:10.48550/arxiv.1605.03661 · Cited by 396
Self-citationChakraborty, B., & Moodie, E. E. M. (2013) · Statistics for Biology and Health · doi:10.1007/978-1-4614-7428-9 · Cited by 335
Proceedings of the Seventeenth International Conference on Machine Learning (ICML-2000)
Pat Langley, B., Francisco, S., Ub, C., & -Hannover, T. S. (2000) · Cited by 248
Evaluating Reinforcement Learning Algorithms in Observational Health SettingsPreprint
Gottesman, O., Johansson, F., Meier, J., Dent, J., Lee, D., Srinivasan, S., Zhang, L., Ding, Y., Wihl, D., Peng, X., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12298 · Cited by 140
Self-citationAdaptive treatment of epilepsy via batch-mode reinforcement learning
Guez, A., Vincent, R. D., Avoli, M., & Pineau, J. (2008) · Cited by 76
Septic shock resuscitation in the first hour
Simpson, N., Lamontagne, F., & Shankar‐Hari, M. (2017) · Current Opinion in Critical Care · doi:10.1097/mcc.0000000000000460 · Cited by 16
Research works printed but not linked: 2
- Parbhoo, S., Bogojeska, J., Zazzi, M., Roth, V. & Doshi-Velez, F. AMIA Summits on Translational Science Proceedings 2017, 239 (2017).
- Doshi-Velez, F. & Kim, B. Towards a rigorous science of interpretable machine learning. Preprint at https://arxiv.org/abs/1702.08608 (2017). · arXiv
Cited by
Artificial intelligence for mental health and mental illnesses: an overview
Graham, S., Depp, C., Lee, E. E., Nebeker, C., Tu, X., Kim, H.-C., & Jeste, D. V. (2019) · Current Psychiatry Reports · doi:10.1007/s11920-019-1094-0 · Cited by 970
Artificial intelligence-enhanced electrocardiography in cardiovascular disease management
Siontis, K. C., Noseworthy, P. A., Attia, Z. I., & Friedman, P. A. (2021) · Nature Reviews Cardiology · doi:10.1038/s41569-020-00503-2 · Cited by 914
Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems
Levine, S., Kumar, A., Tucker, G., & Fu, J. (2020) · arXiv · doi:10.48550/arxiv.2005.01643 · Cited by 824
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“An RL approach for decisions making in patient treatment was introduced in [317] to realize safe and risk-conscious healthcare practice.”
MethodReinforcement Learning in Healthcare: A Survey
Yu, C., Liu, J., Nemati, S., & Yin, G. (2023) · ACM Computing Surveys · doi:10.1145/3477600 · Cited by 628
Metadata
- Authors
- Gottesman, O., Johansson, F., Komorowski, M., Faisal, A., Sontag, D., Doshi-Velez, F., & Celi, L. A.
- Affiliations
- Harvard University (US)
- Massachusetts Institute of Technology (US)
- Harvard–MIT Division of Health Sciences and Technology (US)
- Imperial College London (GB)
- Beth Israel Deaconess Medical Center (US)
- Corresponding author
- Celi, Leo Anthony
- Venue
- Nature Medicine
- Published
- 2019-01
- Volume
- 25
- Issue
- 1
- Pages
- 16-18
- ISSN
- 1078-8956 (ISSN-L)
- 1546-170X
- OpenAlex
- W2904730732
- Cited by
- 395
- References
- 10
- Citations by year
- 2026: 71 · 2025: 40 · 2024: 47 · 2023: 56 · 2022: 53 · 2021: 65 · 2020: 42 · 2019: 19
- FWCI
- 17.87
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Medicine (publishedVersion)
- PubMed (publishedVersion)
- Chalmers Research (Chalmers University of Technology) (submittedVersion)
- Spiral (Imperial College London) (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (1675244)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- reinforcement learning, healthcare decision-making, patient treatment, observational cohort, machine learning in medicine
- MeSH terms
- Clinical Decision-Making, Deep Learning, Delivery of Health Care, Humans, Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Guidelines for reinforcement learning in healthcare. https://app.cochat.ai/papers/10.1038/s41591-018-0310-5
- The paper
- Gottesman, O., Johansson, F., Komorowski, M., Faisal, A., Sontag, D., Doshi-Velez, F., & Celi, L. A. (2019). Guidelines for reinforcement learning in healthcare. Nature Medicine. https://doi.org/10.1038/s41591-018-0310-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.