The DOI matches its Crossref record; 185 of the 185 references it cites were found in a registry or an index.
Reinforcement Learning in Healthcare: A Survey
Open accessAbstract
As a subfield of machine learning, reinforcement learning (RL) aims at optimizing decision making by using interaction samples of an agent with its environment and the potentially delayed feedbacks. In contrast to traditional supervised learning that typically relies on one-shot, exhaustive, and supervised reward signals, RL tackles sequential decision-making problems with sampled, evaluative, and delayed feedbacks simultaneously. Such a distinctive feature makes RL techniques a suitable candidate for developing powerful solutions in various healthcare domains, where diagnosing decisions or treatment regimes are usually characterized by a prolonged period with delayed feedbacks. By first briefly examining theoretical foundations and key methods in RL research, this survey provides an extensive overview of RL applications in a variety of healthcare domains, ranging from dynamic treatment regimes in chronic diseases and critical care, automated medical diagnosis, and many other control or scheduling problems that have infiltrated every aspect of the healthcare system. In addition, we discuss the challenges and open issues in the current research and highlight some potential solutions and directions for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Surviving Sepsis Campaign: International Guidelines for Management of Severe Sepsis and Septic Shock
Dellinger, R. P., Levy, M. M., Rhodes, A., Annane, D., Gerlach, H., Opal, S. M., Sevransky, J. E., Sprung, C. L., Douglas, I. S., Jaeschke, R., et al. (2013) · Critical Care Medicine · doi:10.1097/ccm.0b013e31827e83af · Cited by 9,694
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Surviving Sepsis Campaign: International guidelines for management of sepsis and septic shock: 2016.
Rhodes, A., Evans, L. E., Alhazzani, W., Levy, M. M., Antonelli, M., Ferrer, R., Kumar, A., Sevransky, J. E., Sprung, C. L., Nunnally, M. E., et al. (2017) · Intensive Care Medicine · doi:10.1007/s00134-017-4683-6 · Cited by 6,621
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312
Artificial intelligence in healthcare: past, present and future
Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H., & Wang, Y. (2017) · Stroke and Vascular Neurology · doi:10.1136/svn-2017-000101 · Cited by 4,837
Can the pharmaceutical industry reduce attrition rates?
Kola, I., & Landis, J. (2004) · Nature Reviews Drug Discovery · doi:10.1038/nrd1470 · Cited by 4,167
Surviving Sepsis Campaign: International guidelines for management of sepsis and septic shock: 2016.
Rhodes, A., Evans, L. E., Alhazzani, W., Levy, M. M., Antonelli, M., Ferrer, R., Kumar, A., Sevransky, J. E., Sprung, C. L., Nunnally, M. E., et al. (2017) · Critical Care Medicine · doi:10.1097/ccm.0000000000002255 · Cited by 3,652
Improving chronic illness care: translating evidence into action
Wagner, E. H., Austin, B. T., Davis, C., Hindmarsh, M., Schaefer, J., & Bonomi, A. (2001) · Health Affairs · doi:10.1377/hlthaff.20.6.64 · Cited by 3,446
A survey of deep neural network architectures and their applications
Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., & Alsaadi, F. E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.038 · Cited by 3,239
A Survey of Monte Carlo Tree Search Methods
Browne, C. B., Powley, E., Whitehouse, D., Lucas, S. M., Cowling, P. I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., & Colton, S. (2012) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2012.2186810 · Cited by 2,970
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Opportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
The practical implementation of artificial intelligence technologies in medicine
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019) · Nature Medicine · doi:10.1038/s41591-018-0307-0 · Cited by 2,246
A Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235
Deep Learning for Health Informatics
Ravì, D., Wong, C., Deligianni, F., Berthelot, M., Andreu-Perez, J., Lo, B., & Yang, G.-Z. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2636665 · Cited by 2,000
Quantitative estimation of insulin sensitivity.
Bergman, R. N., Ider, Y. Z., Bowden, C. R., & Cobelli, C. (1979) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.1979.236.6.e667 · Cited by 1,874 · cited 1×
“applied model-based VI method [123] and AC method [124] to reduce the fluctuation of the blood glucose in both fasting and post-meal scenarios, drawing on the Bergman’s minimal insulin-glucose kinetics model [125] and the Hovorka model [126] to simulate a patient.”
Method(2000) · doi:10.2460/ajvr.67.2.323 · Cited by 1,621
Transfer Learning for Reinforcement Learning Domains: A Survey
Taylor, M. E., & Stone, P. (2009) · doi:10.5555/1577069.1755839 · Cited by 1,488
On-line Q-learning Using Connectionist Systems
Rummery, G. A. (1994) · Cited by 1,477
Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification
Salamon, J., & Bello, J. P. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2657381 · Cited by 1,364
Molecular de-novo design through deep reinforcement learning
Olivecrona, M., Blaschke, T., Engkvist, O., & Chen, H. (2017) · Journal of Cheminformatics · doi:10.1186/s13321-017-0235-x · Cited by 1,324
Komorowski, M., Celi, L. A., Badawi, O., Gordon, A. C., & Faisal, A. A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0213-5 · Cited by 1,290
Nonlinear model predictive control of glucose concentration in subjects with type 1 diabetes
Hovorka, R., Canonico, V., Chassin, L. J., Haueter, U., Massi-Benedetti, M., Federici, M. O., Pieber, T. R., Schaller, H. C., Schaupp, L., Vering, T., et al. (2004) · Physiological Measurement · doi:10.1088/0967-3334/25/4/010 · Cited by 1,274
Deep reinforcement learning for de novo drug design
Popova, M., Isayev, O., & Tropsha, A. (2018) · Science Advances · doi:10.1126/sciadv.aap7885 · Cited by 1,182
(2015) · Journal of Machine Learning Research · Cited by 1,119
Sequenced treatment alternatives to relieve depression (STAR*D): Rationale and design
Rush, A. J., Fava, M., Wisniewski, S. R., Lavori, P. W., Trivedi, M. H., Sackeim, H. A., Thase, M. E., Nierenberg, A. A., Quitkin, F. M., Kashner, T. M., et al. (2004) · Controlled Clinical Trials · doi:10.1016/s0197-2456(03)00112-0 · Cited by 1,076
Keefe, R. S. E. (2007) · Archives of General Psychiatry · doi:10.1001/archpsyc.64.6.633 · Cited by 1,065
A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients
Grondman, I., Busoniu, L., Lopes, G. A. D., & Babuska, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2218595 · Cited by 1,042
Optimal Dynamic Treatment Regimes
Murphy, S. A. (2003) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00389 · Cited by 1,007
Interactive machine learning for health informatics: when do we need the human-in-the-loop?
Holzinger, A. (2016) · Brain Informatics · doi:10.1007/s40708-016-0042-6 · Cited by 906
Learning to Diagnose with LSTM Recurrent Neural Networks
Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2015) · arXiv · doi:10.48550/arxiv.1511.03677 · Cited by 879
A Survey on Policy Search for Robotics
Deisenroth, M. P. (2011) · Foundations and Trends in Robotics · doi:10.1561/2300000021 · Cited by 798
Applications of deep learning and reinforcement learning to biological data
Mahmud, M., Kaiser, M. S., Hussain, A., & Vassanelli, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2790388 · Cited by 765
Deep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762
Riedmiller, M. (2005) · Lecture Notes in Computer Science · doi:10.1007/11564096_32 · Cited by 757
Peters, J., & Schaal, S. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.11.026 · Cited by 738
Unobtrusive Sensing and Wearable Devices for Health Informatics
Zheng, Y.-L., Ding, X.-R., Poon, C. C. Y., Lo, B. P. L., Zhang, H., Zhou, X.-L., Yang, G.-Z., Zhao, N., & Zhang, Y.-T. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2014.2309951 · Cited by 722
Reinforcement Learning: State-of-the-Art
(2012) · Adaptation, Learning, and Optimization · doi:10.1007/978-3-642-27645-3 · Cited by 691
A Survey on Ambient Intelligence in Healthcare
Acampora, G., Cook, D. J., Rashidi, P., & Vasilakos, A. V. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2013.2262913 · Cited by 630
Medical Imaging 2015: Computer-Aided Diagnosis
Hadjiiski, L. M., & Tourassi, G. D. (2015) · SPIE eBooks · Cited by 601
Dilsizian, S. E., & Siegel, E. L. (2014) · Current Cardiology Reports · doi:10.1007/s11886-013-0441-8 · Cited by 579
Proceedings of the International Joint Conference on Neural Networks (IJCNN) 2005
(2005) · Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005. · doi:10.1109/ijcnn.2005.1556327 · Cited by 553
Big Data Application in Biomedical Research and Health Care: A Literature Review
Luo, J., Wu, M., Gopukumar, D., & Zhao, Y. (2016) · Biomedical Informatics Insights · doi:10.4137/bii.s31559 · Cited by 522
Machine Learning and Decision Support in Critical Care
Johnson, A. E. W., Ghassemi, M. M., Nemati, S., Niehaus, K. E., Clifton, D., & Clifford, G. D. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2501978 · Cited by 432
Self-citationGuidelines for reinforcement learning in healthcare
Gottesman, O., Johansson, F., Komorowski, M., Faisal, A., Sontag, D., Doshi-Velez, F., & Celi, L. A. (2019) · Nature Medicine · doi:10.1038/s41591-018-0310-5 · Cited by 395
Efficient Solution Algorithms for Factored MDPs
Guestrin, C., Koller, D., Parr, R., & Venkataraman, S. (2003) · Cited by 384
ACUTE RESPIRATORY DISTRESS SYNDROME
Conner, B. D., & Bernard, G. R. (2000) · Clinics in Chest Medicine · doi:10.1016/s0272-5231(05)70167-2 · Cited by 382
Multiobjective Reinforcement Learning: A Comprehensive Overview
Liu, C., Xu, X., & Hu, D. (2015) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2014.2358639 · Cited by 361
Robust Markov Decision Processes
Wiesemann, W., Kuhn, D., & Rustem, B. (2013) · Mathematics of Operations Research · doi:10.1287/moor.1120.0566 · Cited by 312
Multi-Scale Deep Reinforcement Learning for Real-Time 3D-Landmark Detection in CT Scans
Ghesu, F.-C., Georgescu, B., Zheng, Y., Grbic, S., Maier, A., Hornegger, J., & Comaniciu, D. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2782687 · Cited by 310
Precision Medicine—Personalized, Problematic, and Promising
Larry Jameson, J., & Longo, D. L. (2015) · Obstetrical & Gynecological Survey · doi:10.1097/01.ogx.0000472121.21647.38 · Cited by 277
Clinical Control of Diabetes by the Artificial Pancreas
Albisser, A. M., Leibel, B. S., Ewart, T. G., Davidovac, Z., Botz, C. K., Zingg, W., Schipper, H., & Gander, R. (1974) · Diabetes · doi:10.2337/diab.23.5.397 · Cited by 272
Reinforcement learning design for cancer clinical trials
Zhao, Y., Kosorok, M. R., & Zeng, D. (2009) · Statistics in Medicine · doi:10.1002/sim.3720 · Cited by 271
Kernel-Based Reinforcement Learning
Ormoneit, D., & Sen, Ś. (2002) · Machine Learning · doi:10.1023/a:1017928328829 · Cited by 255
Deep reinforcement learning for automated radiation adaptation in lung cancer
Tseng, H., Luo, Y., Cui, S., Chien, J., Ten Haken, R. K., & Naqa, I. E. (2017) · Medical Physics · doi:10.1002/mp.12625 · Cited by 235
Dynamic Multidrug Therapies for HIV: Optimal and STI Control Approaches
M. Adams, B., 1. Center for Research in Scientific Computation, N. C. S. U., T. Banks, H., Kwon, H.-D., T. Tran, H., & 2. Center for Research in Scientific Computation, N. C. S. U. (2004) · Mathematical Biosciences and Engineering · doi:10.3934/mbe.2004.1.223 · Cited by 228
Robust non-rigid registration through agent-based action learning
Krebs, J., Mansi, T., Delingette, H., Zhang, L., Ghesu, F. C., Miao, S., Maier, A. K., Ayache, N., Liao, R., & Kamen, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66182-7_40 · Cited by 225
Supervised Reinforcement Learning with Recurrent Neural Network for Dynamic Treatment Recommendation
Wang, L., Zhang, W., He, X., & Zha, H. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219961 · Cited by 223
Reinforcement Learning Strategies for Clinical Trials in Nonsmall Cell Lung Cancer
Zhao, Y., Zeng, D., Socinski, M. A., & Kosorok, M. R. (2011) · Biometrics · doi:10.1111/j.1541-0420.2011.01572.x · Cited by 208
Yom-Tov, E., Feraru, G., Kozdoba, M., Mannor, S., Tennenholtz, M., & Hochberg, I. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7994 · Cited by 205 · cited 2×
“AmI in healthcare domains. For example, RL has been used to adapt the intervention strategies of smart phones in order to recommend regular physical activity to people who suffer from diabetes type 2 [302], [303], or who have experienced a cardiac event and been in cardiac rehab [351], [352], [353]. It has been also b…”
MethodInforming sequential clinical decision-making through reinforcement learning: an empirical study
Shortreed, S. M., Laber, E., Lizotte, D. J., Stroup, T. S., Pineau, J., & Murphy, S. A. (2011) · Machine Learning · doi:10.1007/s10994-010-5229-0 · Cited by 196
Optimal medication dosing from suboptimal clinical examples: a deep reinforcement learning approach
Nemati, S., Ghassemi, M. M., & Clifford, G. D. (2016) · 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7591355 · Cited by 195
Self-citationTask-oriented Dialogue System for Automatic Diagnosis
Wei, Z., Liu, Q., Peng, B., Tou, H., Chen, T., Huang, X., Wong, K.-F., & Dai, X. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2033 · Cited by 193
Reinforcement Learning in Continuous State and Action Spaces
van Hasselt, H. (2012) · Adaptation, Learning, and Optimization · doi:10.1007/978-3-642-27645-3_7 · Cited by 191
Evaluating reinforcement learning agents for anatomical landmark detection
Alansary, A., Oktay, O., Li, Y., Folgoc, L. L., Hou, B., Vaillant, G., Kamnitsas, K., Vlontzos, A., Glocker, B., Kainz, B., et al. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.02.007 · Cited by 185
Critical care - where have we been and where are we going?
Vincent, J.-L. (2013) · Critical Care · doi:10.1186/cc11500 · Cited by 174
Inference for non-regular parameters in optimal dynamic treatment regimes
Chakraborty, B., Murphy, S., & Strecher, V. (2010) · Statistical Methods in Medical Research · doi:10.1177/0962280209105013 · Cited by 169
Dynamic treatment regimes: Technical challenges and applications
Laber, E. B., Lizotte, D. J., Qian, M., Pelham, W. E., & Murphy, S. A. (2014) · Electronic Journal of Statistics · doi:10.1214/14-ejs920 · Cited by 162
Reinforcement learning based resource allocation in business process management
Huang, Z., van der Aalst, W. M. P., Lü, X., & Duan, H. (2010) · Data & Knowledge Engineering · doi:10.1016/j.datak.2010.09.002 · Cited by 162
An Artificial Agent for Anatomical Landmark Detection in Medical Images
Ghesu, F. C., Georgescu, B., Mansi, T., Neumann, D., Joachim Hornegger, A., & Comaniciu, D. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46726-9_27 · Cited by 161
Modeling Medical Treatment Using Markov Decision Processes
Schaefer, A. J., Bailey, M. D., Shechter, S. M., & Roberts, M. S. (2005) · International Series in Operations Research & Management Science · doi:10.1007/1-4020-8066-2_23 · Cited by 155
Safe Exploration in Markov Decision Processes
Moldovan, T. M., & Abbeel, P. (2012) · arXiv · doi:10.48550/arxiv.1205.4810 · Cited by 152
Goldberg, Y., & Kosorok, M. R. (2012) · The Annals of Statistics · doi:10.1214/12-aos968 · Cited by 146
Thananjeyan, B., Garg, A., Krishnan, S., Chen, C., Miller, L., & Goldberg, K. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989275 · Cited by 144
Reinforcement learning-based control of drug dosing for cancer chemotherapy treatment
Padmanabhan, R., Meskin, N., & Haddad, W. M. (2017) · Mathematical Biosciences · doi:10.1016/j.mbs.2017.08.004 · Cited by 133
Preference-based reinforcement learning: a formal framework and a policy iteration algorithm
Fürnkranz, J., Hüllermeier, E., Cheng, W., & Park, S.-H. (2012) · Machine Learning · doi:10.1007/s10994-012-5313-8 · Cited by 130
The use of reinforcement learning algorithms to meet the challenges of an artificial pancreas
Bothe, M. K., Dickens, L., Reichel, K., Tellmann, A., Ellger, B., Westphal, M., & Faisal, A. A. (2013) · Expert Review of Medical Devices · doi:10.1586/17434440.2013.827515 · Cited by 129
State of the art review: the data revolution in critical care
Ghassemi, M., Celi, L. A., & Stone, D. J. (2015) · Critical Care · doi:10.1186/s13054-015-0801-4 · Cited by 128
Interpretable policies for reinforcement learning by genetic programming
Hein, D. M., Udluft, S., & Runkler, T. A. (2018) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2018.09.007 · Cited by 125
Estimating Dynamic Treatment Regimes in Mobile Health Using V-Learning
Luckett, D. J., Laber, E. B., Kahkoska, A. R., Maahs, D. M., Mayer‐Davis, E. J., & Kosorok, M. R. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2018.1537919 · Cited by 124
Deep Reinforcement Learning for Dynamic Treatment Regimes on Medical Registry Data
Liu, Y., Logan, B. R., Liu, N., Xu, Z., Tang, J., & Wang, Y. (2017) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi.2017.45 · Cited by 119
A survey of inverse reinforcement learning techniques
Shao, Z., & Joo, E. M. (2012) · International Journal of Intelligent Computing and Cybernetics · doi:10.1108/17563781211255862 · Cited by 115
Adaptive Treatment Strategies in Chronic Disease
Lavori, P. W., & Dawson, R. (2008) · Annual Review of Medicine · doi:10.1146/annurev.med.59.062606.122232 · Cited by 113
Clinical data based optimal STI strategies for HIV: a reinforcement learning approach
Ernst, D., Stan, G.-B. V., Gonçalves, J. M., & Wehenkel, L. A. (2006) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2006.377527 · Cited by 111
Closed-loop control of anesthesia and mean arterial pressure using reinforcement learning
Padmanabhan, R., Meskin, N., & Haddad, W. M. (2015) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2015.05.013 · Cited by 109
Deep Reinforcement Learning for Active Breast Lesion Detection from DCE-MRI
Maicas, G., Carneiro, G., Bradley, A. P., Nascimento, J. C., & Reid, I. D. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66179-7_76 · Cited by 109
Approximate dynamic programming for capacity allocation in the service industry
Schütz, H.-J., & Kolisch, R. (2011) · European Journal of Operational Research · doi:10.1016/j.ejor.2011.09.007 · Cited by 101
TREATING EPILEPSY VIA ADAPTIVE NEUROSTIMULATION: A REINFORCEMENT LEARNING APPROACH
Pineau, J., Guez, A., VINCENT, R., Panuccio, G., & Avoli, M. (2009) · International Journal of Neural Systems · doi:10.1142/s0129065709001987 · Cited by 97
APRIL: Active Preference Learning-Based Reinforcement Learning
Akrour, R., Schoenauer, M., & Sebag, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33486-3_8 · Cited by 95
EX2: Exploration with Exemplar Models for Deep Reinforcement Learning
Fu, J., Co-Reyes, J. D., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.01260 · Cited by 95
A survey of preference-based reinforcement learning methods
WirthChristian, AkrourRiad, NeumannGerhard, & FürnkranzJohannes (2017) · Journal of Machine Learning Research · doi:10.5555/3122009.3208017 · Cited by 94
Multimodal image registration with deep context reinforcement learning
Ma, K., Wang, J., Singh, V., Tamersoy, B., Chang, Y.-J., Wimmer, A., & Chen, T. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66182-7_28 · Cited by 87
Penalized Q-learning for dynamic treatment regimens
Song, R., Wang, W., Zeng, D., & Kosorok, M. R. (2014) · Statistica Sinica · doi:10.5705/ss.2012.364 · Cited by 87
Simulation-based optimization of radiotherapy: Agent-based modeling and reinforcement learning
Jalalimanesh, A., Haghighi, S. S., Ahmadi, A., & Soltani, M. (2016) · Mathematics and Computers in Simulation · doi:10.1016/j.matcom.2016.05.008 · Cited by 87
Istepanian, R., Philip, N., & Martini, M. (2009) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2009.090517 · Cited by 78
Schneider, G. (2013) · Wiley eBooks · doi:10.1002/9783527677016 · Cited by 75
Set‐valued dynamic treatment regimes for competing outcomes
Laber, E. B., Lizotte, D. J., & Ferguson, B. T. (2014) · Biometrics · doi:10.1111/biom.12132 · Cited by 74
Individualization of pharmacological anemia management using reinforcement learning
Gawęda, A. E., Muezzinoglu, M. K., Aronoff, G. R., Jacobs, A. A., Żurada, J. M., & Brier, M. E. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.06.020 · Cited by 72
Deep Reinforcement Learning for Surgical Gesture Segmentation and Classification
Liu, D., & Jiang, T. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00937-3_29 · Cited by 72
Interactive model building for Q-learning
Laber, E. B., Linn, K. A., & Stefanski, L. A. (2014) · Biometrika · doi:10.1093/biomet/asu043 · Cited by 71
Forman, E. M., Kerrigan, S. G., Butryn, M. L., Juarascio, A. S., Manasse, S. M., Ontañón, S., Dallal, D. H., Crochiere, R. J., & Moskow, D. M. (2018) · Journal of Behavioral Medicine · doi:10.1007/s10865-018-9964-1 · Cited by 71
Medical Question Answering for Clinical Decision Support
Goodwin, T. R., & Harabagiu, S. M. (2016) · doi:10.1145/2983323.2983819 · Cited by 70
Machine learning in critical care: state-of-the-art and a sepsis case study
Vellido, A., Ribas, V. J., Morales, C., Ruiz-Sanmartín, A., & Ruiz‐Rodríguez, J. C. (2018) · BioMedical Engineering OnLine · doi:10.1186/s12938-018-0569-2 · Cited by 67
Yu, C., Liu, J., & Zhào, H. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0763-6 · Cited by 66
Self-citationJagodnik, K. M., Thomas, P. S., van den Bogert, A. J., Branicky, M. S., & Kirsch, R. F. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2700395 · Cited by 64
Combining Kernel and Model Based Learning for HIV Therapy Selection
Parbhoo, S., Bogojeska, J., Zazzi, M., Röth, V., & Doshi‐Velez, F. (2017) · PubMed Central · doi:10.5451/unibas-ep59234 · Cited by 64
A data-driven approach to optimized medication dosing: a focus on heparin
Ghassemi, M. M., Richter, S. E., Eche, I. M., Chen, T. W., Danziger, J., & Celi, L. A. (2014) · Intensive Care Medicine · doi:10.1007/s00134-014-3406-5 · Cited by 63
Wörgötter, F., & Porr, B. (2008) · Scholarpedia · doi:10.4249/scholarpedia.1448 · Cited by 62
Causal Analysis in the Health Sciences
Greenland, S. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473924 · Cited by 61 · cited 1×
“The abundant literature in causal explanation and inference can be introduced to provide a more powerful causal reasoning tool to the learning algorithm [13, 73, 120].”
BackgroundMartín‐Guerrero, J. D., Gomez, F. J., Soria‐Olivas, E., Schmidhuber, J., Martí, M. C., & Jiménez-Torres, N. V. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.02.041 · Cited by 60
Tree-based reinforcement learning for estimating optimal dynamic treatment regimes
Tao, Y., Wang, L., & Almirall, D. (2018) · The Annals of Applied Statistics · doi:10.1214/18-aoas1137 · Cited by 59
Interactive Q -Learning for Quantiles
Linn, K. A., Laber, E. B., & Stefanski, L. A. (2016) · Journal of the American Statistical Association · doi:10.1080/01621459.2016.1155993 · Cited by 56
Automatic View Planning with Multi-scale Deep Reinforcement Learning Agents
Alansary, A., Folgoc, L. L., Vaillant, G., Oktay, O., Li, Y., Bai, W., Passerat‐Palmbach, J., Guerrero, R., Kamnitsas, K., Hou, B., et al. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00928-1_32 · Cited by 55
Individualized sepsis treatment using reinforcement learning
Saria, S. (2018) · Nature Medicine · doi:10.1038/s41591-018-0253-x · Cited by 52
Constructing evidence-based treatment strategies using methods from computer science
Pineau, J., Bellemare, M. G., Rush, A. J., Ghizaru, A., & Murphy, S. A. (2007) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2007.01.005 · Cited by 49
Application of reinforcement learning for segmentation of transrectal ultrasound images
Sahba, F., Tizhoosh, H. R., & Salama, M. M. A. (2008) · BMC Medical Imaging · doi:10.1186/1471-2342-8-8 · Cited by 47
Deep Inverse Reinforcement Learning for Sepsis Treatment
Yu, C., Ren, G., & Liu, J. (2019) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi.2019.8904645 · Cited by 46
Self-citationBaek, D., Hwang, M., Kim, H., & Kwon, D. (2018) · International Conference on Ubiquitous Robots (UR) · doi:10.1109/urai.2018.8441801 · Cited by 45
Krakow, E. F., Hemmer, M., Wang, T., Logan, B. R., Arora, M., Spellman, S. R., Couriel, D. R., Alousi, A. M., Pidala, J., Last, M. S., et al. (2017) · American Journal of Epidemiology · doi:10.1093/aje/kwx027 · Cited by 44
Cross-Layer Ultrasound Video Streaming Over Mobile WiMAX and HSUPA Networks
Alinejad, A., Philip, N. Y., & Istepanian, R. S. H. (2011) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2011.2154384 · Cited by 43
Application of Opposition-Based Reinforcement Learning in Image Segmentation
Sahba, F., Tizhoosh, H. R., & Salama, M. M. M. A. (2007) · IEEE Symposium on Computational Intelligence in Image and Signal Processing (CIISP) · doi:10.1109/ciisp.2007.369176 · Cited by 43
Incorporating Patient Preferences into Estimation of Optimal Individualized Treatment Rules
Butler, E. L., Laber, E. B., Thomas, S., & Kosorok, M. R. (2017) · Biometrics · doi:10.1111/biom.12743 · Cited by 43
A New Tensioning Method using Deep Reinforcement Learning for Surgical Pattern Cutting
Nguyen, T. T., Nguyen, N. D., Bello, F., & Nahavandi, S. (2019) · IEEE International Conference on Industrial Technology (ICIT) · doi:10.1109/icit.2019.8755235 · Cited by 43
Towards intelligent robust detection of anatomical structures in incomplete volumetric data
Ghesu, F. C., Georgescu, B., Grbić, S., Maier, A., Joachim Hornegger, A., & Comaniciu, D. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.06.007 · Cited by 42
Hester, T., & Stone, P. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_4 · Cited by 41
Ngo, P. D., Wei, S. H., Holubová, A., Mužík, J., & Godtliebsen, F. (2018) · Computational and Mathematical Methods in Medicine · doi:10.1155/2018/4091497 · Cited by 41
A causal probabilistic network for optimal treatment of bacterial infections
Leibovici, L., Fishman, M., Schønheyder, H. C., Riekehr, C., Kristensen, B., Shraga, I., & Andreassen, S. (2000) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.868905 · Cited by 40
A Deep Deterministic Policy Gradient Approach to Medication Dosing and Surveillance in the ICU
Lin, R., Stanley, M. D., Ghassemi, M. M., & Nemati, S. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8513203 · Cited by 40
Self-citationYu, C., Ren, G., & Dong, Y. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-1120-5 · Cited by 40
Self-citationBusa‐Fekete, R., Szörényi, B., Weng, P., Cheng, W., & Hüllermeier, E. (2014) · Machine Learning · doi:10.1007/s10994-014-5458-8 · Cited by 39
Preference-Based Policy Iteration: Leveraging Preference Learning for Reinforcement Learning
Cheng, W., Fürnkranz, J., Hüllermeier, E., & Park, S.-H. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23780-5_30 · Cited by 39
Personalized tuning of a reinforcement learning control algorithm for glucose regulation
Daskalaki, E., Diem, P., & Mougiakakou, S. G. (2013) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6610293 · Cited by 37
Deep Reinforcement Learning for Vessel Centerline Tracing in Multi-modality 3D Volumes
Zhang, P., Wang, F., & Zheng, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00937-3_86 · Cited by 37
Moore, B. L., Doufas, A. G., & Pyeatt, L. D. (2010) · Anesthesia & Analgesia · doi:10.1213/ane.0b013e31820334a7 · Cited by 36
Multi-objective optimization of radiotherapy: distributed Q-learning and agent-based simulation
Jalalimanesh, A., Haghighi, S. S., Ahmadi, A., Hejazian, H., & Soltani, M. (2017) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/0952813x.2017.1292319 · Cited by 32
Reinforcement learning in computer vision
Bernstein, A., & Burnaev, E. V. (2018) · International Conference on Machine Vision · doi:10.1117/12.2309945 · Cited by 32
A new tensioning method using deep reinforcement learning for surgical pattern cutting
Nguyen, T. T., Nguyen, N. D., Bello, F., & Nahavandi, S. (2024) · Figshare · Cited by 32
Lowery, C., & Faisal, A. A. (2013) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2013.6696208 · Cited by 31
Model Predictive Control with Reinforcement Learning for Drug Delivery in Renal Anemia Management
Gawęda, A. E., Muezzinoglu, M. K., Jacobs, A. A., Aronoff, G. R., & Brier, M. E. (2006) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2006.260685 · Cited by 31
Chen, J., Lau, H. Y. K., Xu, W., & Ren, H. (2016) · International Conference on Advanced Computational Intelligence (ICACI) · doi:10.1109/icaci.2016.7449855 · Cited by 30
An Optimal Policy for Patient Laboratory Tests in Intensive Care Units
Cheng, L.-F., Prasad, N., & Engelhardt, B. E. (2018) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789813279827_0029 · Cited by 28
Incorporating causal factors into reinforcement learning for dynamic treatment regimes in HIV
Yu, C., Dong, Y., Liu, J., & Ren, G. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0755-6 · Cited by 28
Self-citationAdaptive control of epileptiform excitability in an in vitro model of limbic seizures
Panuccio, G., Guez, A., Vincent, R., Avoli, M., & Pineau, J. (2013) · Experimental Neurology · doi:10.1016/j.expneurol.2013.01.002 · Cited by 27
Drug scheduling of cancer chemotherapy based on natural actor-critic approach
Ahn, I., & Park, J. (2011) · Biosystems · doi:10.1016/j.biosystems.2011.07.005 · Cited by 27
Moore, B. L., Quasny, T. M., & Doufas, A. G. (2010) · Anesthesia & Analgesia · doi:10.1213/ane.0b013e318202cb7c · Cited by 27
DECAF: Deep Case-based Policy Inference for knowledge transfer in Reinforcement Learning
Glatt, R., da Silva, F. L., Bianchi, R. A. C., & Costa, A. H. R. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113420 · Cited by 27
Reinforcement-learning optimal control for type-1 diabetes
Ngo, P. D., Wei, S. H., Holubová, A., Mužík, J., & Godtliebsen, F. (2018) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi.2018.8333436 · Cited by 26
Maes, F., Fonteneau, R., Wehenkel, L. A., et al. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33492-4_6 · Cited by 24
Solving Relational and First-Order Logical Markov Decision Processes: A Survey
van Otterlo, M. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_8 · Cited by 24
Ertefaie, A., Shortreed, S. M., & Chakraborty, B. (2016) · Statistics in Medicine · doi:10.1002/sim.6859 · Cited by 24
Hengst, B. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_9 · Cited by 24
Group-Driven Reinforcement Learning for Personalized mHealth Intervention
Zhu, F., Guo, J. Y., Xu, Z., Liao, P., Liu, Y., & Huang, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00928-1_67 · Cited by 22
Comparison of some control strategies for three-compartment PK/PD models
Hu, C., Lovejoy, W. S., & Shafer, S. L. (1994) · Journal of Pharmacokinetics and Biopharmaceutics · doi:10.1007/bf02353793 · Cited by 19
Sample Complexity Bounds of Exploration
Li, L. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_6 · Cited by 18
Generating Explanations Based on Markov Decision Processes
Elizalde, F., Sucar, L. E., Noguez, J., & Reyes, A. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-05258-3_5 · Cited by 18
Statistical Reinforcement Learning
Chakraborty, B., & Moodie, E. E. M. (2013) · Statistics in the health sciences · doi:10.1007/978-1-4614-7428-9_3 · Cited by 17
Artificial Intelligence in XPRIZE DeepQ Tricorder
Chang, E. Y., Wu, M.-H., Tang, K.-F., Kao, H.-C., & Chou, C. (2017) · International Workshop on Multimedia for Personal Health and Health Care (MMHealth) · doi:10.1145/3132635.3132637 · Cited by 17
Inverse Reinforcement Learning via Function Approximation for Clinical Motion Analysis
Li, K., Rath, M., & Burdick, J. W. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460563 · Cited by 16
Reinforcement learning approach to individualization of chronic pharmacotherapy
Gaweda, A. E., Muezzinoglu, M. K., Aronoff, G. R., Jacobs, A. A., Żurada, J. M., & Brier, M. E. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2005.1556455 · Cited by 15
Kamio, T., Van, T., & Masamune, K. (2017) · International Journal of Medical Research & Health Sciences · Cited by 15
Robust Actor-Critic Contextual Bandit for Mobile Health (mHealth) Interventions
Zhu, F., Guo, J. Y., Li, R., & Huang, J. (2018) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3233547.3233554 · Cited by 15
Borera, E. C., Moore, B. L., Doufas, A. G., & Pyeatt, L. D. (2011) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2011.15 · Cited by 14
Reinforcement learning based control of tumor growth with chemotherapy
Hassani, A., & Sistani, M. B. N. (2010) · International Conference on System Science and Engineering · doi:10.1109/icsse.2010.5551776 · Cited by 13
Incorporating Prior Knowledge into Q-Learning for Drug Delivery Individualization
Gaweda, A. E., Muezzinoglu, M. K., Aronoff, G. R., Jacobs, A. A., Żurada, J. M., & Brier, M. E. (2006) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2005.40 · Cited by 11
Optimizing drug therapy with Reinforcement Learning: The case of Anemia Management
Malof, J. M., & Gawęda, A. E. (2011) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2011.6033485 · Cited by 10
Daskalaki, E., Scarnato, L., Diem, P., & Mougiakakou, S. G. (2010) · UKACC International Conference on Control · doi:10.1049/ic.2010.0287 · Cited by 10
Glucose level control using Temporal Difference methods
Noori, A., Sadrnia, M. A., & Sistani, M. B. N. (2017) · Iranian Conference on Electrical Engineering · doi:10.1109/iraniancee.2017.7985166 · Cited by 10
Robust and Efficient Transfer Learning with Hidden Parameter Markov Decision Processes
Killian, T. W., Konidaris, G., & Doshi‐Velez, F. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11065 · Cited by 8
Reinforcement learning in models of adaptive medical treatment strategies
Vincent, R. (2014) · doi:10.82308/11943 · Cited by 8
A Reinforcement Learning Design for HIV Clinical Trials
Parbhoo, S. (2014) · University of the Witwatersrand, Johannesburg Institutional Repository on DSpace (University of the Witwatersrand, Johannesburg) · Cited by 7
Accelerating Drugs Discovery with Deep Reinforcement Learning: An Early Approach
Serrano, A., Imbernón, B., Pérez‐Sánchez, H., Cecilia, J. M., Bueno-Crespo, A., & Abellán, J. L. (2018) · International Conference on Parallel Processing Workshops (ICPPW) · doi:10.1145/3229710.3229731 · Cited by 7
Budgeted Learning for Developing Personalized Treatment
Deng, K., Greiner, R., & Murphy, S. A. (2014) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2014.8 · Cited by 6
Nonlinear Adaptively Learned Optimization for Object Localization in 3D Medical Images
Etcheverry, M., Georgescu, B., Odry, B. L., Re, T. J., Kaushik, S., Geiger, B., Nadar, M. S., Grbić, S., & Comaniciu, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00889-5_29 · Cited by 4
Focus on ventilation and airway management in the ICU
JONG, A. D., Citerio, G., & Jaber, S. (2017) · Intensive Care Medicine · doi:10.1007/s00134-017-4982-y · Cited by 3
Adaptive treatment of anemia on hemodialysis patients: A reinforcement learning approach
Escandell-Montero, P., Martínez-Martínez, J. M., Martín‐Guerrero, J. D., Soria‐Olivas, E., Vila‐Francés, J., & Magdalena‐Benedito, R. (2011) · IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2011.5949442 · Cited by 2
Cited by
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Interpretable machine learning: Fundamental principles and 10 grand challenges
Rudin, C., Chen, C., Chen, Z., Huang, H., Semenova, L., & Zhong, C. (2022) · Statistics Surveys · doi:10.1214/21-ss133 · Cited by 958
Transfer Learning in Deep Reinforcement Learning: A Survey
Zhu, Z., Lin, K., Jain, A. K., & Zhou, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3292075 · Cited by 861
Exploration in deep reinforcement learning: A survey
Ladosz, P., Weng, L., Kim, M., & Oh, H. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.003 · Cited by 525
Remote patient monitoring using artificial intelligence: Current state, applications, and challenges
Shaik, T., Tao, X., Higgins, N., Li, L., Gururajan, R., Zhou, X., & Acharya, U. R. (2023) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1485 · Cited by 515
Metadata
- Authors
- Yu, C., Liu, J., Nemati, S., & Yin, G.
- Venue
- ACM Computing Surveys
- Published
- 2021-11-23
- Volume
- 55
- Issue
- 1
- Pages
- 1-36
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3216656735
- Cited by
- 628
- References
- 185
- FWCI
- 33.26
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.