The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Reinforcement learning design for cancer clinical trials
Open accessAbstract
We develop reinforcement learning trials for discovering individualized treatment regimens for life‐threatening diseases such as cancer. A temporal‐difference learning method called Q‐learning is utilized that involves learning an optimal policy from a single training set of finite longitudinal patient trajectories. Approximating the Q‐function with time‐indexed parameters can be achieved by using support vector regression or extremely randomized trees. Within this framework, we demonstrate that the procedure can extract optimal strategies directly from clinical data without relying on the identification of any accurate mathematical models, unlike approaches based on adaptive design. We show that reinforcement learning has tremendous potential in clinical research because it can select actions that improve outcomes by taking into account delayed effects even when the relationship between actions and outcomes is not fully known. To support our claims, the methodology's practical utility is illustrated in a simulation analysis. In the immediate future, we will apply this general strategy to studying and identifying new treatments for advanced metastatic stage IIIB/IV non‐small cell lung cancer, which usually includes multiple lines of chemotherapy treatment. Moreover, there is significant potential of the proposed methodology for developing personalized treatment strategies in other cancers, in cystic fibrosis, and in other life‐threatening diseases. Copyright © 2009 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,387
Geurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Solutions of Ill-Posed Problems.
Bell, J. B., Tikhonov, A. N., & Arsenin, V. Y. (1978) · Mathematics of Computation · doi:10.2307/2006360 · Cited by 8,101
Cited by
Interactive machine learning for health informatics: when do we need the human-in-the-loop?
Holzinger, A. (2016) · Brain Informatics · doi:10.1007/s40708-016-0042-6 · Cited by 906
Reinforcement Learning in Healthcare: A Survey
Yu, C., Liu, J., Nemati, S., & Yin, G. (2023) · ACM Computing Surveys · doi:10.1145/3477600 · Cited by 628
Q-Learning: Theory and Applications
Clifton, J., & Laber, E. (2020) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041220 · Cited by 492
A Robust Method for Estimating Optimal Treatment Regimes
Zhang, B., Tsiatis, A. A., Laber, E. B., & Davidian, M. (2012) · Biometrics · doi:10.1111/j.1541-0420.2012.01763.x · Cited by 422
Kosorok, M. R., & Laber, E. B. (2019) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-030718-105251 · Cited by 370
Self-citationReinforcement learning for intelligent healthcare applications: A survey
Coronato, A., Naeem, M., De Pietro, G., & Paragliola, G. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101964 · Cited by 320
Tutorial in biostatistics: data‐driven subgroup identification and analysis in clinical trials
Lipkovich, I., Dmitrienko, A., & B., R. (2017) · Statistics in Medicine · doi:10.1002/sim.7064 · Cited by 291
New Statistical Learning Methods for Estimating Optimal Dynamic Treatment Regimes
Zhao, Y.-Q., Zeng, D., Laber, E. B., & Kosorok, M. R. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2014.937488 · Cited by 267
Self-citationA Gentle Introduction to Reinforcement Learning and its Application in Different Fields
Naeem, M., Rizvi, S. T. H., & Coronato, A. (2020) · IEEE Access · doi:10.1109/access.2020.3038605 · Cited by 257
Yom-Tov, E., Feraru, G., Kozdoba, M., Mannor, S., Tennenholtz, M., & Hochberg, I. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7994 · Cited by 205
A contemporary review of machine learning in otolaryngology–head and neck surgery
Crowson, M. G., Ranisau, J., Eskander, A., Babier, A., Xu, B., Kahmke, R. R., Chen, J. M., & Chan, T. C. Y. (2020) · The Laryngoscope · doi:10.1002/lary.27850 · Cited by 127
APRIL: Active Preference Learning-Based Reinforcement Learning
Akrour, R., Schoenauer, M., & Sebag, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33486-3_8 · Cited by 95
Goel, I., Bhaskar, Y., Kumar, N., Singh, S., Amanullah, M., Dhar, R., & Karmakar, S. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1550407 · Cited by 31
Learning Cost-Effective Treatment Regimes using Markov Decision Processes
Lakkaraju, H., & Rudin, C. (2016) · arXiv · doi:10.48550/arxiv.1610.06972 · Cited by 12
Metadata
- Authors
- Zhao, Y., Kosorok, M. R., & Zeng, D.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2009-09-11
- Volume
- 28
- Issue
- 26
- Pages
- 3294-3315
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2156682402
- Cited by
- 271
- References
- 86
- FWCI
- 7.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.