Cited by 8,972Reinforcement Learning in RoboticsAdvanced Bandit Algorithms ResearchMachine Learning and Algorithms

The DOI matches its Crossref record; 149 of the 162 references it cites were found in a registry or an index.

Reinforcement Learning: A Survey

Open access

Kaelbling, L. P., Littman, M. L., Moore, A. W.·1996·Journal of Artificial Intelligence Research

Open this paper in CoChat — free account

Abstract

This paper surveys the field of reinforcement learning from a computer-science perspective. It is written to be accessible to researchers familiar with machine learning. Both the historical basis of the field and a broad selection of current work are summarized. Reinforcement learning is the problem faced by an agent that learns behavior through trial-and-error interactions with a dynamic environment. The work described here has a resemblance to work in psychology, but differs considerably in the details and in the use of the word ``reinforcement.'' The paper discusses central issues of reinforcement learning, including trading off exploration and exploitation, establishing the foundations of the field via Markov decision theory, learning from delayed reinforcement, constructing empirical models to accelerate learning, making use of generalization and hierarchy, and coping with hidden state. It concludes with a survey of some implemented systems and an assessment of the practical utility of current methods for reinforcement learning.

Integrity signals

Registry

Crossref · 10.1613/jair.301

Cites

149 of 149 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,178
Adaptation in Natural and Artificial Systems
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,340
Genetic Algorithms in Search, Optimization and Machine Learning
Goldberg, D. E., & Robson, D. (1988) · Cited by 18,391
Dynamic Programming
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Untitled work
(1995) · Cited by 10,558
Q-learning
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting
Cleveland, W. S., & Devlin, S. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478639 · Cited by 5,893
Learning from Delayed Rewards
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,674

Flagged first, then by citations

Show all 162 references

13 of the 162 references couldn’t be matched to a known paper.

Sorted by citations

Items 901–1,000 of 1,028

A reinforcement learning approach for waterflooding optimization in petroleum reservoirs
Hourfar, F., Bidgoly, H. J., Moshiri, B., Salahshoor, K., & Elkamel, A. (2018) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2018.09.019 · Cited by 72
Should I take over? Does system knowledge help drivers in making take-over decisions while driving a partially automated car?
Boelhouwer, A., van den Beukel, A. P., van der Voort, M. C., & Martens, M. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.11.016 · Cited by 74
Detecting Troll Behavior via Inverse Reinforcement Learning: A Case Study of Russian Trolls in the 2016 US Election
Luceri, L., Giordano, S., & Ferrara, E. (2020) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v14i1.7311 · Cited by 72
Smart Train Operation Algorithms Based on Expert Knowledge and Reinforcement Learning
Zhou, K., Song, S., Xue, A., You, K., & Wu, H. (2020) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2020.3000073 · Cited by 72
Comparative Analysis of A3C and PPO Algorithms in Reinforcement Learning: A Survey on General Environments
del Río, A., Jiménez, D., & Serrano, J. (2024) · IEEE Access · doi:10.1109/access.2024.3472473 · Cited by 82
Integration of large language models and federated learning
Chen, C., Feng, X., Li, Y., Lyu, L., Zhou, J., Zheng, X., & Yin, J. (2024) · Patterns · doi:10.1016/j.patter.2024.101098 · Cited by 140
Least-Squares Methods in Reinforcement Learning for Control
Lagoudakis, M. G., Parr, R., & Littman, M. L. (2002) · Lecture notes in computer science · doi:10.1007/3-540-46014-4_23 · Cited by 72
Self-citation
Application of reinforcement learning to medium access control for wireless sensor networks
Chu, Y., Koşunalp, S., Mitchell, P., Grace, D., & Clarke, T. (2015) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2015.08.004 · Cited by 72
Multiobjective Reinforcement Learning for Traffic Signal Control Using Vehicular Ad Hoc Network
Houli, D., Li, Z., & Zhang, Y. (2010) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/2010/724035 · Cited by 80
On decentralized self-adaptation
Weyns, D., Malek, S., & Andersson, J. (2010) · International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS) · doi:10.1145/1808984.1808994 · Cited by 72
Error-driven learning in visual categorization and object recognition: A common-elements model.
Soto, F. A., & Wasserman, E. A. (2010) · Psychological Review · doi:10.1037/a0018695 · Cited by 72
Information-theoretic approach to interactive learning
Still, S. (2009) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/85/28005 · Cited by 72
How to Discount Deep Reinforcement Learning: Towards New Dynamic StrategiesPreprint
François-Lavet, V., Raphael Fonteneau, D., & Ernst, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.02011 · Cited by 72
Multi-Agent Reinforcement Learning for Connected and Automated Vehicles Control: Recent Advancements and Future Prospects
Hua, M., Qi, X., Chen, D., Jiang, K., Liu, Z. E., Sun, H., Zhou, Q., & Xu, H. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3574280 · Cited by 88
“RL, typically formalized as a Markov Decision Process (MDP), provides a framework for sequential decision-making under uncertainty [34].”
A survey on QoS mechanisms in WSN for computational intelligence based routing protocols
Kaur, T., & Kumar, D. (2019) · Wireless Networks · doi:10.1007/s11276-019-01978-9 · Cited by 71
A learnheuristic approach for the team orienteering problem with aerial drone motion constraints
Bayliss, C., Juan, A. A., Currie, C. S. M., & Panadero, J. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106280 · Cited by 73
Data-Based Optimal Consensus Control for Multiagent Systems With Policy Gradient Reinforcement Learning
Yang, X., Zhang, H., & Wang, Z. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3054685 · Cited by 71
COVID-19 Prediction Applying Supervised Machine Learning Algorithms with Comparative Analysis Using WEKA
Villavicencio, C. N., Macrohon, J. J. E., Inbaraj, X. A., Jeng, J.-H., & Hsieh, J. (2021) · Algorithms · doi:10.3390/a14070201 · Cited by 71
Combining Decision Making and Trajectory Planning for Lane Changing Using Deep Reinforcement Learning
Li, S., Wei, C. T., & Wang, Y. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3148085 · Cited by 71
Single-Domain Generalized Predictor for Neural Architecture Search System
Ma, L., Kang, H., Yu, G., Li, Q., & He, Q. (2024) · IEEE Transactions on Computers · doi:10.1109/tc.2024.3365949 · Cited by 75
Distributed and Centralized Hybrid CSMA/CA-TDMA Schemes for Single-Hop Wireless Networks
Shrestha, B., Hossain, E., & Choi, K. W. (2014) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2014.2327102 · Cited by 71
Kernel-Based Approximate Dynamic Programming for Real-Time Online Learning Control: An Experimental Study
Xu, X., Lian, C., Zuo, L., & He, H. (2013) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2013.2246866 · Cited by 71
Models of coalition or alliance formation
Mesterton‐Gibbons, M., Gavrilets, S., Gravner, J., & Akçay, E. (2011) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2010.12.031 · Cited by 73
Computational models of reinforcement learning: the role of dopamine as a reward signal
Samson, R. D., Frank, M. J., & Fellous, J. (2010) · Cognitive Neurodynamics · doi:10.1007/s11571-010-9109-x · Cited by 75
Algorithmic analysis of qualitative and quantitative termination problems for affine probabilistic programs
Chatterjee, K., Fu, H., Novotný, P., & Hasheminezhad, R. (2016) · ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL) · doi:10.1145/2837614.2837639 · Cited by 71
Path planning of multi-agent systems in unknown environment with neural kernel smoothing and reinforcement learning
Cruz, D. L., & Yu, W. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.08.108 · Cited by 72
Classification of amyotrophic lateral sclerosis disease based on convolutional neural network and reinforcement sample learning algorithm
Şengür, A., Akbulut, Y., Guo, Y., & Bajaj, V. (2017) · Health Information Science and Systems · doi:10.1007/s13755-017-0029-6 · Cited by 74
A Survey of Collectives
Tumer, K., & Wolpert, D. H. (2004) · Springer eBooks · doi:10.1007/978-1-4419-8909-3_1 · Cited by 72
Apprenticeship learning and reinforcement learning with application to robotic control
Abbeel, P. (2008) · ProQuest Demo Repository · Cited by 71
Authentic Boundary Proximal Policy Optimization
Cheng, Y., Huang, L., & Wang, X. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3051456 · Cited by 75
Linear Quadratic Control Using Model-Free Reinforcement Learning
Yaghmaie, F. A., Gustafsson, F., & Lennart Ljung, A. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2022.3145632 · Cited by 71
Generative AI and process systems engineering: The next frontier
Decardi‐Nelson, B., Alshehri, A. S., Ajagekar, A., & You, F. (2024) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2024.108723 · Cited by 90
Deep Reinforcement Learning: A Chronological Overview and Methods
Terven, J. R. (2025) · AI · doi:10.3390/ai6030046 · Cited by 98
A market-based approach to recommender systems
Wei, Y. Z., Moreau, L., & Jennings, N. R. (2005) · ACM Transactions on Information Systems · doi:10.1145/1080343.1080344 · Cited by 70
Reinforcement Learning Based MAC Protocol (UW-ALOHA-Q) for Underwater Acoustic Sensor Networks
Park, S. H., Mitchell, P., & Grace, D. (2019) · IEEE Access · doi:10.1109/access.2019.2953801 · Cited by 70
Shuffling a Stacked Deck: The Case for Partially Randomized Ranking of Search Engine ResultsPreprint
Pandey, S., Roy, S., Olston, C., Cho, J. J., & Chakrabarti, S. (2005) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0503011 · Cited by 70
Aggressive Resource Provisioning for Ensuring QoS in Virtualized Environments
Liu, J., Zhang, Y., Zhou, Y., Zhang, D., & Liu, H. (2014) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2014.2353045 · Cited by 69
Context-Aware Intelligence in Resource-Constrained IoT Nodes: Opportunities and Challenges
Chatterjee, B., Cao, N., Raychowdhury, A., & Sen, S. (2019) · IEEE Design and Test · doi:10.1109/mdat.2019.2899334 · Cited by 67
A deep reinforcement learning for user association and power control in heterogeneous networks
Ding, H., Zhao, F., Tian, J., Li, D., & Zhang, H. (2020) · Ad Hoc Networks · doi:10.1016/j.adhoc.2019.102069 · Cited by 69
Self-Adaptive Traffic Control Model With Behavior Trees and Reinforcement Learning for AGV in Industry 4.0
Hu, H., Jia, X., Liu, K., & Sun, B. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3059676 · Cited by 73
Applications of Machine Learning in Networking: A Survey of Current Issues and Future Challenges
Ridwan, M. A., Radzi, N. A. M., Abdullah, F., & Jalil, Y. E. (2021) · IEEE Access · doi:10.1109/access.2021.3069210 · Cited by 76
Autonomous Security Analysis and Penetration Testing
Chowdhary, A., Huang, D., Mahendran, J. S., Romo, D., Deng, Y., & Sabur, A. (2020) · International Conference on Mobility, Sensing and Networking (MSN) · doi:10.1109/msn50589.2020.00086 · Cited by 69
Classifying resilience approaches for protecting smart grids against cyber threats
Syrmakesis, A. D., Alcaraz, C., & Hatziargyriou, N. D. (2022) · International Journal of Information Security · doi:10.1007/s10207-022-00594-7 · Cited by 76
Artificial Intelligence Techniques for Enhancing the Performance of Controllers in Power Converter-Based Systems—An Overview
Gao, Y., Wang, S., Dragičević, T., Wheeler, P. W., & Zanchetta, P. (2023) · IEEE Open Journal of Industry Applications · doi:10.1109/ojia.2023.3338534 · Cited by 69
Sequential anomaly detection based on temporal-difference learning: Principles, models and case studies
Xu, X. (2009) · Applied Soft Computing · doi:10.1016/j.asoc.2009.10.003 · Cited by 69
Multi-Agent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC)
El-Tantawy, S., & Abdulhai, B. (2012) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2012.6338707 · Cited by 69
Sequential cost-sensitive decision making with reinforcement learning
Pednault, E., Abe, N., & Zadrozny, B. (2002) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/775047.775086 · Cited by 69
Lexicographic ranking supermartingales: an efficient approach to termination of probabilistic programs
Agrawal, S., Chatterjee, K., & Novotný, P. (2017) · Proceedings of the ACM on Programming Languages · doi:10.1145/3158122 · Cited by 69
Agent-based evacuation modeling with multiple exits using NeuroEvolution of Augmenting Topologies
Yüksel, M. E. (2017) · Advanced Engineering Informatics · doi:10.1016/j.aei.2017.11.003 · Cited by 69
Application and Construction of Deep Learning Networks in Medical Imaging
Torres-Velázquez, M., Chen, W., Li, X., & McMillan, A. B. (2020) · IEEE Transactions on Radiation and Plasma Medical Sciences · doi:10.1109/trpms.2020.3030611 · Cited by 74
Strongly Improved Stability and Faster Convergence of Temporal Sequence Learning by Using Input Correlations Only
Porr, B., & Wörgötter, F. (2006) · Neural Computation · doi:10.1162/neco.2006.18.6.1380 · Cited by 68
Explorations in efficient reinforcement learning
Wiering, M. (1999) · UvA-DARE (University of Amsterdam) · Cited by 70
Autonomic and Distributed Joint Routing and Power Control for Delay-Sensitive Applications in Multi-Hop Wireless Networks
Lin, Z., & van der Schaar, M. (2011) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2010.111910.091238 · Cited by 68
Q-learning based collaborative cache allocation in mobile edge computing
Chien, W.-C., Weng, H.-Y., & Lai, C.-F. (2020) · Future generations computer systems · doi:10.1016/j.future.2019.08.032 · Cited by 60
A review of optimal control methods for energy storage systems - energy trading, energy balancing and electric vehicles
Machlev, R., Zargari, N., Chowdhury, N. R., Belikov, J., & Levron, Y. (2020) · Journal of Energy Storage · doi:10.1016/j.est.2020.101787 · Cited by 67
Adaptive and extendable control of unmanned surface vehicle formations using distributed deep reinforcement learning
Wang, S., Ma, F., Yan, X., Wu, P., & Liu, Y. (2021) · Applied Ocean Research · doi:10.1016/j.apor.2021.102590 · Cited by 68
UAV swarm path planning with reinforcement learning for field prospecting
Puente-Castro, A., Rivero, D., Pazos, A., & Fernández-Blanco, E. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03254-4 · Cited by 75
Machine Learning for Industry 4.0: A Systematic Review Using Deep Learning-Based Topic Modelling
Mazzei, D., & Ramjattan, R. (2022) · Sensors · doi:10.3390/s22228641 · Cited by 81
Reinforcement Learning Control for a 2-DOF Helicopter With State Constraints: Theory and Experiments
Zhao, Z., He, W., Mu, C., Zou, T., Hong, K., & Li, H. (2022) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2022.3215738 · Cited by 68
Deep generative model for drug design from protein target sequence
Chen, Y., Wang, Z., Wang, L., Wang, J., Li, P., Cao, D., Zeng, X., Ye, X., & Sakurai, T. (2023) · Journal of Cheminformatics · doi:10.1186/s13321-023-00702-2 · Cited by 74
Intrusion Detection Based on Federated Learning: A Systematic Review
Hernández-Ramos, J. L., Καρόπουλος, Γ., Chatzoglou, E., Kouliaridis, V., Campos, E. M., González-Vidal, A., & Kambourakis, G. (2025) · ACM Computing Surveys · doi:10.1145/3731596 · Cited by 117
A comprehensive review of nature inspired routing algorithms for fixed telecommunication networks
Wedde, H. F., & Farooq, M. (2006) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2006.02.005 · Cited by 67
Importance sampling for reinforcement learning with multiple objectives
Shelton, C. R., & Poggio, T. (2001) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 68
Evaluation of a hierarchical reinforcement learning spoken dialogue system
Cuayáhuitl, H., Renals, S. J., Lemon, O., & Shimodaira, H. (2009) · Computer Speech & Language · doi:10.1016/j.csl.2009.07.001 · Cited by 68
Learning and adaptation of an intelligent mobile robot navigator operating in unstructured environment based on a novel online Fuzzy–Genetic system
Hagras, H., Callaghan, V., & Colley, M. (2003) · Fuzzy Sets and Systems · doi:10.1016/s0165-0114(03)00116-7 · Cited by 68
Exploration from Demonstration for Interactive Reinforcement Learning
Subramanian, K. A., Isbell, C. L., & Thomaz, A. L. (2016) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/2936924.2936990 · Cited by 68
Dynamics of crop coefficients for citrus orchards of central India using water balance and eddy covariance flux partition techniques
Peddinti, S. R., & Kambhammettu, B. P. (2018) · Agricultural Water Management · doi:10.1016/j.agwat.2018.08.027 · Cited by 68
Deterministic policy gradient adaptive dynamic programming for model-free optimal control
Zhang, Y., Zhao, B., & Liu, D. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.032 · Cited by 68
Nearest neighbours reveal fast and slow components of motor learning
Kollmorgen, S., Hahnloser, R. H. R., & Mante, V. (2020) · Nature · doi:10.1038/s41586-019-1892-x · Cited by 66
Precomputing avatar behavior from human motion data
Lee, J., & Lee, K. H. (2005) · Graphical Models · doi:10.1016/j.gmod.2005.03.004 · Cited by 68
A Survey on Temporal Knowledge Graph: Representation Learning and Applications
Cai, L., Mao, X., Zhou, Y., Long, Z., Wu, C., & Lan, M. (2024) · arXiv · doi:10.48550/arxiv.2403.04782 · Cited by 68
Heterogeneous trading strategies with adaptive fuzzy Actor–Critic reinforcement learning: A behavioral approach
Bekiros, S. D. (2010) · Journal of Economic Dynamics and Control · doi:10.1016/j.jedc.2010.01.015 · Cited by 66
From Reinforcement Learning to Deep Reinforcement Learning: An Overview
Agostinelli, F., Hocquet, G., Singh, S., & Baldi, P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99492-5_13 · Cited by 73
Decentralized Deep Learning for Multi-Access Edge Computing: A Survey on Communication Efficiency and Trustworthiness
Sun, Y., Ochiai, H., & Esaki, H. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3133819 · Cited by 77
Online computation offloading with double reinforcement learning algorithm in mobile edge computing
Liao, L., Lai, Y., Yang, F., & Zeng, W. (2022) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2022.09.006 · Cited by 67
Myoelectric Control Systems for Upper Limb Wearable Robotic Exoskeletons and Exosuits—A Systematic Review
Fu, J., Choudhury, R., Hosseini, S. M., Simpson, R., & Park, J. (2022) · Sensors · doi:10.3390/s22218134 · Cited by 68
Morphological computation and decentralized learning in a swarm of sterically interacting robots
Zion, M. Y. B., Fersula, J., Bredèche, N., & Dauchot, O. (2023) · Science Robotics · doi:10.1126/scirobotics.abo6140 · Cited by 73
AI-enhanced biomedical micro/nanorobots in microfluidics
Dong, H., Lin, J., Tao, Y., Yuan, J. Y., Sun, L., Li, W. J., & Sun, H. (2024) · Lab on a Chip · doi:10.1039/d3lc00909b · Cited by 71
Data Science and Model Predictive Control:
Morato, M. M., & Felix, M. S. (2024) · Journal of Process Control · doi:10.1016/j.jprocont.2024.103327 · Cited by 67
Machine Learning Applications in Road Pavement Management: A Review, Challenges and Future Directions
Tamagusko, T., Correia, M. G., & Ferreira, A. (2024) · Infrastructures · doi:10.3390/infrastructures9120213 · Cited by 87
Recurrent Interactions between the Input and Output of a Songbird Cortico-Basal Ganglia Pathway Are Implicated in Vocal Sequence Variability
Hamaguchi, K., & MOONEY, R. D. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.1666-12.2012 · Cited by 67
A survey of recent results on continuous-time Markov decision processes
Guo, X., Hernández–Lerma, O., Prieto-Rumeau, T., Cao, X., Zhang, J., Hu, Q., Lewis, M. E., & Vélez, R. (2006) · Top · doi:10.1007/bf02837562 · Cited by 67
Transferring knowledge as heuristics in reinforcement learning: A case-based approach
Bianchi, R. A. C., Junior, L. A. C., Santos, P. E., Matsuura, J. P., & de Mántaras, R. L. (2015) · Artificial Intelligence · doi:10.1016/j.artint.2015.05.008 · Cited by 68
Multi-agent reinforcement learning: weighting and partitioning
Sun, R., & Peterson, T. S. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00024-6 · Cited by 67
Cournot versus Walras in dynamic oligopolies with memory
Alós‐Ferrer, C. (2003) · International Journal of Industrial Organization · doi:10.1016/j.ijindorg.2003.07.001 · Cited by 67
Reinforcement learning based spectrum-aware routing in multi-hop cognitive radio networks
Xia, B., Wahab, M. H., Yang, Y., Fan, Z., & Sooriyabandara, M. (2009) · 2009 4th International Conference on Cognitive Radio Oriented Wireless Networks and Communications · doi:10.1109/crowncom.2009.5189189 · Cited by 66
Finding New Facts; Thinking New Thoughts
Schulz, L. (2012) · Advances in child development and behavior · doi:10.1016/b978-0-12-397919-3.00010-1 · Cited by 70
A deep reinforcement learning approach for real-time sensor-driven decision making and predictive analytics
Skordilis, E., & Moghaddass, R. (2020) · Computers & Industrial Engineering · doi:10.1016/j.cie.2020.106600 · Cited by 71
PlotThread: Creating Expressive Storyline Visualizations using Reinforcement Learning
Tang, T., Li, R.-Z., Wu, X., Liu, S., Knittel, J., Koch, S., Ertl, T., Yu, L., Ren, P., & Wu, Y. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3030467 · Cited by 66
Artificial intelligence in real-time diagnostics and prognostics of composite materials and its uncertainties—a review
Elenchezhian, M. R. P., Vadlamudi, V., Raihan, R., Reifsnider, K., & Reifsnider, E. S. (2021) · Smart Materials and Structures · doi:10.1088/1361-665x/ac099f · Cited by 74
Optimal planning of a rooftop PV system using GIS-based reinforcement learning
Jung, S., Jeoung, J., Kang, H., & Hong, T. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.117239 · Cited by 64
Dynamic Scheduling Method for Job-Shop Manufacturing Systems by Deep Reinforcement Learning with Proximal Policy Optimization
Zhang, M., Lü, Y., Hu, Y., Amaitik, N., & Xu, Y. (2022) · Sustainability · doi:10.3390/su14095177 · Cited by 66
Intelligent multi-agent reinforcement learning model for resources allocation in cloud computing
Belgacem, A., Mahmoudi, S., & Kihl, M. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2022.03.016 · Cited by 66
AAtt-CNN: Automatic Attention-Based Convolutional Neural Networks for Hyperspectral Image Classification
Paoletti, M. E., Moreno‐Álvarez, S., Xue, Y., Haut, J. M., & Plaza, A. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3272639 · Cited by 66
Emotion and Reinforcement: Affective Facial Expressions Facilitate Robot Learning
Broekens, J. (2007) · Springer eBooks · doi:10.1007/978-3-540-72348-6_6 · Cited by 66
Real-Time Interactive Reinforcement Learning for Robots
Thomaz, A. L., Hoffman, G., & Breazeal, C. (2005) · Cited by 66
The role of preparedness in ambulance dispatching
Lee, S. (2010) · Journal of the Operational Research Society · doi:10.1057/jors.2010.145 · Cited by 66
A new reinforcement learning vehicle control architecture for vision-based road following
Oh, S., Lee, J., & Choi, D.-H. (2000) · IEEE Transactions on Vehicular Technology · doi:10.1109/25.845116 · Cited by 66
Generalized Prioritized Sweeping
André, D., Friedman, N., & Parr, R. (1997) · Cited by 66
Q-Probabilistic Routing in Wireless Sensor Networks
Arroyo-Valles, R., Alaiz-Rodriguez, R., Guerrero-Curieses, A., & Cid-Sueiro, J. (2007) · 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information · doi:10.1109/issnip.2007.4496810 · Cited by 65

Authors: Kaelbling, L. P., Littman, M. L., & Moore, A. W.
Affiliations: Brown University (US)
Carnegie Mellon University (US)
ORCID: Kaelbling, L. P.
Littman, M. L.
Moore, A. W.
Venue: Journal of Artificial Intelligence Research
Publisher: AI Access Foundation
Published: 1996-05-01
Volume: 4
Pages: 237-285
ISSN: 1076-9757 (ISSN-L)
DOI: 10.1613/jair.301
OpenAlex: W2107726111
Cited by: 8,972
References: 162
Citations by year: 2026: 367 · 2025: 703 · 2024: 626 · 2023: 597 · 2022: 498 · 2021: 549 · 2020: 583 · 2019: 416 · 2018: 351 · 2017: 266 · 2016: 201 · 2015: 218 · 2014: 233 · 2013: 272 · 2012: 225
FWCI: 94.14
Type: journal article
Language: en
Open access: diamond
doi.org
Licence: cc-by
Locations: Journal of Artificial Intelligence Research (publishedVersion, cc-by)
arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Funders: National Science Foundation (9453383, 9312395)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
Keywords: reinforcement learning, Markov decision theory, exploration-exploitation balance, delayed reinforcement, empirical model, generalization, hierarchical learning, hidden states, learning from interaction, agent-environment interaction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Reinforcement Learning: A Survey

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks