The DOI matches its Crossref record; 149 of the 162 references it cites were found in a registry or an index.
Reinforcement Learning: A Survey
Open accessAbstract
This paper surveys the field of reinforcement learning from a computer-science perspective. It is written to be accessible to researchers familiar with machine learning. Both the historical basis of the field and a broad selection of current work are summarized. Reinforcement learning is the problem faced by an agent that learns behavior through trial-and-error interactions with a dynamic environment. The work described here has a resemblance to work in psychology, but differs considerably in the details and in the use of the word ``reinforcement.'' The paper discusses central issues of reinforcement learning, including trading off exploration and exploitation, establishing the foundations of the field via Markov decision theory, learning from delayed reinforcement, constructing empirical models to accelerate learning, making use of generalization and hierarchy, and coping with hidden state. It concludes with a survey of some implemented systems and an assessment of the practical utility of current methods for reinforcement learning.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most of the existing methods are CNN-based classification baselines trained for deep fake detection [6, 11, 22, 25].”
From On Improving Cross-dataset Generalization of Deepfake Detectors (2022) · cites this paper as [11]
In the citing paper
“In reinforcement learning, positive feedback from a certain action results in a positive reward. Based on this positive reward, the parameters of the policy model are adjusted to increase the probability of selecting this action in the corresponding state. Conversely, if it is negative feedback, the parameters of the model will be adjusted to decrease the probability of selecting this action. The”
From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [19]
In the citing paper
“The loop of 'primitive action - feedback - update procedural memory - improved action' described in the bicycle riding example is similar to reinforcement learning in AI [19, 21, 22].”
From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [19]
Citations
Cites
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,178
Adaptation in Natural and Artificial Systems
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,340
Genetic Algorithms in Search, Optimization and Machine Learning
Goldberg, D. E., & Robson, D. (1988) · Cited by 18,391
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
(1995) · Cited by 10,558
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting
Cleveland, W. S., & Devlin, S. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478639 · Cited by 5,893
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,674
Flagged first, then by citations
13 of the 162 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Items 601–700 of 1,028
Methods for enabling real-time analysis in digital twins: A literature review
Eshaghi, M. S., Anitescu, C., & Rabczuk, T. (2024) · Computers & Structures · doi:10.1016/j.compstruc.2024.107342 · Cited by 120
Ant Colony System-Based Algorithm for Constrained Load Flow Problem
Vlachogiannis, J. G., Hatziargyriou, N. D., & Lee, K. Y. (2005) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2005.851969 · Cited by 106
Safe Exploration Algorithms for Reinforcement Learning Controllers
Mannucci, T., Kampen, E.-J. V., de Visser, C. C., & Chu, Q. P. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2654539 · Cited by 112
Optimizing the lifetime of wireless sensor networks via reinforcement-learning-based routing
Guo, W., Yan, C., & Lu, T. (2019) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147719833541 · Cited by 104
RLScheduler: An Automated HPC Batch Job Scheduler Using Reinforcement Learning
Zhang, D., Dai, D., He, Y., Bao, F. S., & Xie, B. (2020) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41405.2020.00035 · Cited by 116
Zhang, X. (2020) · Springer eBooks · doi:10.1007/978-981-15-2770-8_6 · Cited by 118
Machine Learning Advances in Microbiology: A Review of Methods and Applications
Jiang, Y., Luo, J., Huang, D., Liu, Y., & Li, D.-D. (2022) · Frontiers in Microbiology · doi:10.3389/fmicb.2022.925454 · Cited by 120
Jia, M., Yao, Y., & Liu, Y. (2025) · Industrial & Engineering Chemistry Research · doi:10.1021/acs.iecr.5c00283 · Cited by 105
High Confidence Policy Improvement
Thomas, P. S., Theocharous, G., & Ghavamzadeh, M. (2015) · International Conference on Machine Learning · Cited by 103
A TAN based hybrid model for android malware detection
Surendran, R., Thomas, T., & Emmanuel, S. (2020) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2020.102483 · Cited by 108
A deep reinforcement learning approach to mountain railway alignment optimization
Gao, T., Li, Z., Gao, Y., Schonfeld, P. M., Feng, X., Wang, Q., & He, Q. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12694 · Cited by 103
Policy Learning with Constraints in Model-free Reinforcement Learning: A Survey
Liu, Y., Halev, A., & Liu, X. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/614 · Cited by 102
Analysis and improvement of policy gradient estimation
Zhao, T., Hachiya, H., Niu, G., & Sugiyama, M. (2011) · Neural Networks · doi:10.1016/j.neunet.2011.09.005 · Cited by 102
Machine learning for international freight transportation management: A comprehensive review
Barua, L., Zou, B., & Zhou, Y. (2020) · Research in Transportation Business & Management · doi:10.1016/j.rtbm.2020.100453 · Cited by 102
Dynamic pricing and fleet management for electric autonomous mobility on demand systems
Turan, B., Pedarsani, R., & Alizadeh, M. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.102829 · Cited by 108
Deep Learning for Zero-day Malware Detection and Classification: A Survey
Deldar, F., & Abadi, M. (2023) · ACM Computing Surveys · doi:10.1145/3605775 · Cited by 126
Advanced Deep Learning Models for 6G: Overview, Opportunities, and Challenges
Jiao, L., Shao, Y., Sun, L., Liu, F., Yang, S., Ma, W., Li, L., Liu, X., Hou, B., Zhang, X., et al. (2024) · IEEE Access · doi:10.1109/access.2024.3418900 · Cited by 122
Navarro, D., Newell, B. R., & Schulze, C. (2016) · Cognitive Psychology · doi:10.1016/j.cogpsych.2016.01.001 · Cited by 106
An Improved Dyna-Q Algorithm for Mobile Robot Path Planning in Unknown Dynamic Environment
Pei, M., An, H., Liu, B., & Wang, C. (2021) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2021.3096935 · Cited by 104
Machine intelligence in metamaterials design: a review
Cerniauskas, G., Sadia, H., & Alam, P. (2024) · Oxford Open Materials Science · doi:10.1093/oxfmat/itae001 · Cited by 117
Collective Intelligence and Braess' Paradox
Tumer, K., & Wolpert, D. H. (2000) · Cited by 102
Part-Based Feature Synthesis for Human Detection
Bar-Hillel, A., Levi, D., Krupka, E., & Goldberg, C. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15561-1_10 · Cited by 101
Iterative Learning Procedure With Reinforcement for High-Accuracy Force Tracking in Robotized Tasks
Roveda, L., Pallucca, G., Pedrocchi, N., Braghin, F., & Tosatti, L. M. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2748236 · Cited by 100
Data integration and predictive modeling methods for multi-omics datasets
Kim, M., & Tagkopoulos, I. (2017) · Molecular Omics · doi:10.1039/c7mo00051k · Cited by 106
Toward End-to-End Control for UAV Autonomous Landing via Deep Reinforcement Learning
Polvara, R., Patacchiola, M., Sharma, S. K., Wan, J., Manning, A. J., Sutton, R., & Cangelosi, A. (2018) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas.2018.8453449 · Cited by 100
Formal Specification for Deep Neural Networks
Seshia, S. A., Desai, A., Dreossi, T., Fremont, D. J., Ghosh, S., Kim, E., Shivakumar, S., Vazquez-Chanlatte, M., & Yue, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01090-4_2 · Cited by 100
Intelligent User Association for Symbiotic Radio Networks Using Deep Reinforcement Learning
Zhang, Q., Liang, Y., & Poor, H. V. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2984758 · Cited by 103
Robust chaos in neural networks
Potapov, A., & Ali, M. (2000) · Physics Letters A · doi:10.1016/s0375-9601(00)00726-x · Cited by 100
Applications of the self-organising map to reinforcement learning
Smith, A. J. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00083-7 · Cited by 102
Learning hierarchical task networks by observation
Nejati, N., Pat Langley, B., & Könik, T. (2006) · International Conference on Machine Learning · doi:10.1145/1143844.1143928 · Cited by 100
A Geometric Approach to Multi-Criterion Reinforcement LearningPreprint
Mannor, S., & Shimkin, N. (2004) · Cited by 100
Self-Configurable Cyber-Physical Intrusion Detection for Smart Homes Using Reinforcement Learning
Heartfield, R., Loukas, G., Bezemskij, A., & Panaousis, E. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3042049 · Cited by 100
Dong, J., Chen, S., Li, Y., Du, R., Steinfeld, A. M., & Labi, S. (2021) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2021.103192 · Cited by 119
Dynamic Scheduling and Path Planning of Automated Guided Vehicles in Automatic Container Terminal
Yue, L., & Fan, H. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105950 · Cited by 99
VeriFi: Towards Verifiable Federated Unlearning
Gao, X., Ma, X., Wang, J., Sun, Y., Li, B., Ji, S., Cheng, P., & Chen, J. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3382321 · Cited by 125
Ant Colony-Based Reinforcement Learning Algorithm for Routing in Wireless Sensor Networks
GhasemAghaei, R., Rahman, M. A., Gueaieb, W., & Saddik, A. E. (2007) · Conference proceedings - IEEE Instrumentation/Measurement Technology Conference · doi:10.1109/imtc.2007.379173 · Cited by 99
MAGMA: A Multiagent Architecture for Metaheuristics
Milano, M., & Roli, A. (2004) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2003.818432 · Cited by 99
Ant Colony Optimization and Stochastic Gradient Descent
Meuleau, N., & Dorigo, M. (2002) · Artificial Life · doi:10.1162/106454602320184202 · Cited by 98
Colombo, M., & Piccinini, G. (2023) · doi:10.1017/9781009183734 · Cited by 106
A Bi-Level Control for Energy Efficiency Improvement of a Hybrid Tracked Vehicle
Liu, T., & Hu, X. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2797322 · Cited by 98
Hierarchical Routing for Vehicular Ad Hoc Networks via Reinforcement Learning
Li, F., Song, X., Chen, H., Li, X., & Wang, Y. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2887282 · Cited by 98
Personalized Robo-Advising: Enhancing Investment Through Client Interaction
Capponi, A., Ólafsson, S., & Zariphopoulou, T. (2021) · Management Science · doi:10.1287/mnsc.2021.4014 · Cited by 101
Demand-Driven Deep Reinforcement Learning for Scalable Fog and Service Placement
Sami, H., Mourad, A., Otrok, H., & Bentahar, J. (2021) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2021.3075988 · Cited by 98
The augmented radiologist: artificial intelligence in the practice of radiology
Sorantin, E., Grasser, M. G., Hemmelmayr, A., Tschauner, S., Hržić, F., Weiss, V., Lacekova, J., & Holzinger, A. (2021) · Pediatric Radiology · doi:10.1007/s00247-021-05177-7 · Cited by 102
Astronomical big data processing using machine learning: A comprehensive review
Sen, S., Agarwal, S., Chakraborty, P., & Singh, K. P. (2022) · Experimental Astronomy · doi:10.1007/s10686-021-09827-4 · Cited by 109
Huang, J., Huang, S., Moghaddam, S. K., Lu, Y., Wang, G., Yan, Y., & Shi, X. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3431095 · Cited by 107
Model-based average reward reinforcement learning
Tadepalli, P. V., & Ok, D. (1998) · Artificial Intelligence · doi:10.1016/s0004-3702(98)00002-2 · Cited by 100
Das, T. K., Savachkin, A. A., & Zhu, Y. (2008) · IIE Transactions · doi:10.1080/07408170802165856 · Cited by 97
Modelling urban-scale occupant behaviour, mobility, and energy in buildings: A survey
Salim, F. D., Dong, B., Ouf, M. M., Wang, Q., Pigliautile, I., Kang, X., Hong, T., Wu, W., Liu, Y., Rumi, S. K., et al. (2020) · Building and Environment · doi:10.1016/j.buildenv.2020.106964 · Cited by 104
Context-Aware Taxi Dispatching at City-Scale Using Deep Reinforcement Learning
Liu, Z., Li, J., & Wu, K. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3030252 · Cited by 99
Intersection-Based V2X Routing via Reinforcement Learning in Vehicular Ad Hoc Networks
Luo, L., Li, S., Yu, H., & Sun, G. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3053958 · Cited by 97
Intelligent Adaptive Curiosity: a source of Self-Development
Oudeyer, P. (2004) · CogPrints (University of Southampton) · Cited by 97
Controlled animation of video sprites
Schödl, A., & Essa, I. A. (2002) · ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA) · doi:10.1145/545261.545281 · Cited by 96
A theoretical account of cognitive effects in delay discounting
Kurth-Nelson, Z. L., Bickel, W. K., & Redish, A. D. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08058.x · Cited by 101
Visualizing Convolutional Networks for MRI-Based Diagnosis of Alzheimer’s Disease
Rieke, J., Eitel, F., Weygandt, M., Haynes, J., & Ritter, K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-02628-8_3 · Cited by 95
Iglesias, A., Martínez, P., Aler, R., & Fernández, F. (2009) · Applied Intelligence · doi:10.1007/s10489-008-0115-1 · Cited by 96
Learning in quantum control: High-dimensional global optimization for noisy quantum dynamics
Palittapongarnpim, P., Wittek, P., Zahedinejad, E., Vedaie, S. S., & Sanders, B. C. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.087 · Cited by 95
Assessment of terrestrial water balance using remote sensing data in South America
Moreira, A. A., Ruhoff, A., Roberti, D. R., Souza, V. D. A., da Rocha, H. R., & de Paiva, R. C. D. (2019) · Journal of Hydrology · doi:10.1016/j.jhydrol.2019.05.021 · Cited by 96
Application placement in Fog computing with AI approach: Taxonomy and a state of the art survey
Nayeri, Z. M., Ghafarian, T., & Javadi, B. (2021) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2021.103078 · Cited by 96
Humans perceive warmth and competence in artificial intelligence
McKee, K. R., Bai, X., & Fiske, S. T. (2023) · iScience · doi:10.1016/j.isci.2023.107256 · Cited by 120
Continuous-Time Q-Learning for Infinite-Horizon Discounted Cost Linear Quadratic Regulator Problems
Muthukumar, P., Modares, H., Lewis, F. L., & Aurangzeb, M. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2322116 · Cited by 97
The influence of depression symptoms on exploratory decision-making
Blanco, N. J., Otto, A. R., Maddox, W. T., Beevers, C. G., & Love, B. C. (2013) · Cognition · doi:10.1016/j.cognition.2013.08.018 · Cited by 102
Butz, M. V., Goldberg, D. E., & Lanzi, P. L. (2005) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.850265 · Cited by 96
Multiagent reinforcement learning using function approximation
Abul, O., Polat, F., & Alhajj, R. (2000) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/5326.897075 · Cited by 96
RL-Glue: Language-Independent Software for Reinforcement-Learning Experiments
Tanner, B. K., & White, A. (2009) · Cited by 95
Partially Observable Markov Decision Process Approximations for Adaptive Sensing
Chong, E. K. P., Kreucher, C., & Hero, A. O. (2009) · Discrete Event Dynamic Systems · doi:10.1007/s10626-009-0071-x · Cited by 95
Multiparameter optimisation of a magneto-optical trap using deep learning
Tranter, A. D., Slatyer, H. J., Hush, M., Leung, A. C., Everett, J. L., Paul, K., Vernaz-Gris, P., Lam, P. K., Buchler, B. C., & Campbell, G. (2018) · Nature Communications · doi:10.1038/s41467-018-06847-1 · Cited by 103
A robot made of robots: Emergent transport and control of a smarticle ensemble
Savoie, W., Berrueta, T. A., Jackson, Z., Pervan, A., Warkentin, R., Li, S., Murphey, T. D., Wiesenfeld, K. A., & Goldman, D. I. (2019) · Science Robotics · doi:10.1126/scirobotics.aax4316 · Cited by 102
Carbonates before skeletons: A database approach
Cantine, M. D., Knoll, A. H., & Bergmann, K. (2019) · Earth-Science Reviews · doi:10.1016/j.earscirev.2019.103065 · Cited by 98
No-Pain No-Gain: DRL Assisted Optimization in Energy-Constrained CR-NOMA Networks
Ding, Z., Schober, R., & Poor, H. V. (2021) · IEEE Transactions on Communications · doi:10.1109/tcomm.2021.3087624 · Cited by 95
Digital twin in power system research and development: Principle, scope, and challenges
Yassin, M. A. M., Shrestha, A., & Rabie, S. (2023) · Energy Reviews · doi:10.1016/j.enrev.2023.100039 · Cited by 110
Puente-Castro, A., Rivero, D., Pedrosa, E., Pereira, A., Lau, N., & Fernández-Blanco, E. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121240 · Cited by 107
Entanglement-based quantum information technology: a tutorial
Zhang, Z., You, C., Magaña‐Loaiza, O. S., Fickler, R., León‐Montiel, R. D. J., Torres, J. P., Humble, T. S., Liu, S., Xia, Y., & Zhuang, Q. (2024) · Advances in Optics and Photonics · doi:10.1364/aop.497143 · Cited by 106
Lu, S., Wang, Y., Kong, M., Wang, W., Tan, W., & Song, Y. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108487 · Cited by 95
De novo generation of multi-target compounds using deep generative chemistry
Munson, B. P., Chen, M., Bogosian, A., Kreisberg, J. F., Licon, K., Abagyan, R. A., Kuenzi, B. M., & Ideker, T. (2024) · Nature Communications · doi:10.1038/s41467-024-47120-y · Cited by 109
A reinforcement learning approach to dynamic resource allocation
Vengerov, D. (2006) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2006.06.019 · Cited by 95
Sensor Scheduling for Energy-Efficient Target Tracking in Sensor Networks
Atia, G., Veeravalli, V. V., & Fuemmeler, J. A. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2160055 · Cited by 94
A Survey on Energy Trading in the Smart Grid: Taxonomy, Research Challenges and Solutions
Aggarwal, S., Kumar, N., Tanwar, S., & Alazab, M. (2021) · IEEE Access · doi:10.1109/access.2021.3104354 · Cited by 95
Intelligent Reflecting Surface Configurations for Smart Radio Using Deep Reinforcement Learning
Wang, W., & Zhang, W. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3180787 · Cited by 94
A tutorial-based survey on feature selection: Recent advancements on feature selection
Moslemi, A. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107136 · Cited by 96
Review of machine learning in robotic grasping control in space application
Jahanshahi, H., & Zhu, Z. H. (2024) · Acta Astronautica · doi:10.1016/j.actaastro.2024.04.012 · Cited by 94
A comprehensive review of robot intelligent grasping based on tactile perception
Li, T., Yan, Y., Yu, C., An, J., Wang, Y., & Chen, G. (2024) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2024.102792 · Cited by 98
A comparison of Nash equilibria analysis and agent-based modelling for power markets
Krause, T., Beck, E. V., Cherkaoui, R., Germond, A., Andersson, G., & Ernst, D. (2006) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2006.03.002 · Cited by 94
Mobilized ad-hoc networks: a reinforcement learning approach
Chang, Y.-H., Ho, T., & Kaelbling, L. P. (2004) · International Conference on Autonomic Computing · doi:10.1109/icac.2004.1301369 · Cited by 94
Self-citationLearning to Drive a Real Car in 20 Minutes
Riedmiller, M., Montemerlo, M., & Dahlkamp, H. (2007) · Frontiers in Convergence of Bioscience and Information Technologies · doi:10.1109/fbit.2007.37 · Cited by 93
Machine learning in sustainable ship design and operation: A review
Huang, L., Peña, B., Liu, Y., & Anderlini, E. (2022) · Ocean Engineering · doi:10.1016/j.oceaneng.2022.112907 · Cited by 101
Elsisi, M., Amer, M., Dababat, A., & Su, C. (2023) · Energy · doi:10.1016/j.energy.2023.128256 · Cited by 99
Ibrahim, S., Mostafa, M., Jnadi, A., Salloum, H., & Osinenko, P. (2024) · IEEE Access · doi:10.1109/access.2024.3504735 · Cited by 129
Evolving Soccer Keepaway Players Through Task Decomposition
Whiteson, S., Kohl, N., Miikkulainen, R. P., & Stone, P. (2005) · Machine Learning · doi:10.1007/s10994-005-0460-9 · Cited by 93
Integrating relevance feedback techniques for image retrieval using reinforcement learning
Yin, P.-Y., Bhanu, B., Chang, K.-C., & Dong, A. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.201 · Cited by 93
A Hybrid Multiagent Framework With Q-Learning for Power Grid Systems Restoration
Ye, D., Zhang, M., & Sutanto, D. (2011) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2011.2157180 · Cited by 93
Nikolaidis, S., Lasota, P. A., Ramakrishnan, R., & Shah, J. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364915609673 · Cited by 93
Synergism of Firefly Algorithm and Q-Learning for Robot Arm Path Planning
Sadhu, A. K., Konar, A., Bhattacharjee, T., & Das, S. (2018) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2018.03.014 · Cited by 93
ALOHA and Q-Learning based medium access control for Wireless Sensor Networks
Chu, Y., Mitchell, P., & Grace, D. (2012) · International Symposium on Wireless Communication Systems · doi:10.1109/iswcs.2012.6328420 · Cited by 92
Reinforcement learning control of a single‐link flexible robotic manipulator
Ouyang, Y., He, W., & Li, X. (2017) · IET Control Theory and Applications · doi:10.1049/iet-cta.2016.1540 · Cited by 92
Artificial Intelligence for Retrosynthesis Prediction
Jiang, Y., Yu, Y., Kong, M. C., Mei, Y., Yuan, L., Huang, Z., Kuang, K., Wang, Z., Yao, H., Zou, J., et al. (2022) · Engineering · doi:10.1016/j.eng.2022.04.021 · Cited by 105
Sarker, I. H. (2023) · Security and Privacy · doi:10.1002/spy2.295 · Cited by 110
A reinforcement learning approach for process parameter optimization in additive manufacturing
Dharmadhikari, S., Menon, N., & Basak, A. (2023) · Additive manufacturing · doi:10.1016/j.addma.2023.103556 · Cited by 96
Exploring the Advantages of Quantum Generative Adversarial Networks in Generative Chemistry
Kao, P.-Y., Yang, Y.-C., Chiang, W.-Y., Hsiao, J.-Y., Cao, Y., Aliper, A., Ren, F., Aspuru‐Guzik, A., Zhavoronkov, A. A., Hsieh, M.-H., et al. (2023) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c00562 · Cited by 109
Theory and application of reward shaping in reinforcement learning
DEJONG, G. F., & Laud, A. (2004) · Cited by 92
Metadata
- Authors
- Kaelbling, L. P., Littman, M. L., & Moore, A. W.
- Affiliations
- Brown University (US)
- Carnegie Mellon University (US)
- Venue
- Journal of Artificial Intelligence Research
- Publisher
- AI Access Foundation
- Published
- 1996-05-01
- Volume
- 4
- Pages
- 237-285
- ISSN
- 1076-9757 (ISSN-L)
- OpenAlex
- W2107726111
- Cited by
- 8,972
- References
- 162
- Citations by year
- 2026: 367 · 2025: 703 · 2024: 626 · 2023: 597 · 2022: 498 · 2021: 549 · 2020: 583 · 2019: 416 · 2018: 351 · 2017: 266 · 2016: 201 · 2015: 218 · 2014: 233 · 2013: 272 · 2012: 225
- FWCI
- 94.14
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Journal of Artificial Intelligence Research (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (9453383, 9312395)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- reinforcement learning, Markov decision theory, exploration-exploitation balance, delayed reinforcement, empirical model, generalization, hierarchical learning, hidden states, learning from interaction, agent-environment interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
