The DOI matches its Crossref record; 115 of the 115 references it cites were found in a registry or an index.
Q-Learning Algorithms: A Comprehensive Classification and Applications
Open accessAbstract
Q-learning is arguably one of the most applied representative reinforcement learning approaches and one of the off-policy strategies. Since the emergence of Q-learning, many studies have described its uses in reinforcement learning and artificial intelligence problems. However, there is an information gap as to how these powerful algorithms can be leveraged and incorporated into general artificial intelligence workflow. Early Q-learning algorithms were unsatisfactory in several aspects and covered a narrow range of applications. It has also been observed that sometimes, this rather powerful algorithm learns unrealistically and overestimates the action values hence abating the overall performance. Recently with the general advances of machine learning, more variants of Q-learning like Deep Q-learning which combines basic Q learning with deep neural networks have been discovered and applied extensively. In this paper, we thoroughly explain how Q-learning evolved by unraveling the mathematical complexities behind it as well its flow from reinforcement learning family of algorithms. Improved variants are fully described, and we categorize Q-learning algorithms into single-agent and multi-agent approaches. Finally, we thoroughly investigate up-to-date research trends and key applications that leverage Q-learning algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Puterman, M. L. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316887 · Cited by 6,024
(1999) · Cited by 5,147
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733
A Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
A Survey on Multi-Task Learning
Zhang, Y., & Yang, Q. (2017) · arXiv · doi:10.48550/arxiv.1707.08114 · Cited by 2,910
A Survey on Multi-Task Learning
Zhang, Y., & Yang, Q. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3070203 · Cited by 2,878
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Baxter, L. A. (1995) · Technometrics · doi:10.1080/00401706.1995.10484354 · Cited by 2,415
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618
Target-driven visual navigation in indoor scenes using deep reinforcement learning
Zhu, Y., Mottaghi, R., Kolve, E., Lim, J. J., Gupta, A., Fei-Fei, L., & Farhadi, A. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989381 · Cited by 1,533
Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition
Dietterich, T. G. (2000) · Journal of Artificial Intelligence Research · doi:10.1613/jair.639 · Cited by 1,435
Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates
Gu, S., Holly, E., Lillicrap, T., & Levine, S. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989385 · Cited by 1,424
Learning to Communicate with Deep Multi-Agent Reinforcement Learning
Foerster, J. N., Assael, Y. M., de Freitas, N., & Whiteson, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06676 · Cited by 1,217
(2015) · Journal of Machine Learning Research · Cited by 1,119
Generalization in Reinforcement Learning: Successful Examples Using Sparse Coarse Coding
Sutton, R. S. (1995) · Cited by 1,072
Deep reinforcement learning from human preferences
Christiano, P., Leike, J., Brown, T. B., Martic, M., Legg, S., & Amodei, D. (2017) · arXiv · doi:10.48550/arxiv.1706.03741 · Cited by 1,058
Recent Advances in Hierarchical Reinforcement Learning
Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1022140919877 · Cited by 1,024
Machine learning in wireless sensor networks: Algorithms, strategies, and applications
Alsheikh, M. A., Lin, S., Niyato, D., & Tan, H.-P. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2320099 · Cited by 965
Nash Q-Learning for General-Sum Stochastic Games
Hu, J., Wellman, M. P., & Boutilier, C. (2003) · Cited by 923
Optimal and Autonomous Control Using Reinforcement Learning: A Survey
Kiumarsi, B., Vamvoudakis, K. G., Modares, H., & Lewis, F. L. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2773458 · Cited by 891
Deep Q-learning From Demonstrations
Hester, T., Vecerik, M., Pietquin, O., Lanctot, M., Schaul, T., Piot, B., Horgan, D., Quan, J., Sendonaris, A., Osband, I., et al. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11757 · Cited by 889
van Hasselt, H. P. (2010) · Centrum Wiskunde & Informatica (CWI), the national research institute for mathematics and computer science in the Netherlands · Cited by 839
Online learning control by association and reinforcement
Si, J., & Wang, Y.-T. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914523 · Cited by 773
Ant-Q: A Reinforcement Learning approach to the traveling salesman problem
Gambardella, L. M., & Dorigo, M. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50039-6 · Cited by 605
Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model
Shi, X., Gao, Z., Lausen, L., Wang, H., Yeung, D., Wong, W. K., & Woo, W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.03458 · Cited by 596
Control of a Quadrotor With Reinforcement Learning
Hwangbo, J., Sa, I., Siegwart, R., & Hutter, M. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2720851 · Cited by 543
Robust adversarial reinforcement learning
Pinto, L., Davidson, J., Sukthankar, R., & Gupta, A. (2017) · arXiv · doi:10.48550/arxiv.1703.02702 · Cited by 507
Information theoretic MPC for model-based reinforcement learning
Williams, G., Wagener, N., Goldfain, B., Drews, P., Rehg, J. M., Boots, B., & Theodorou, E. A. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989202 · Cited by 460
Asynchronous stochastic approximation and Q-learning
Tsitsiklis, J. N. (1994) · Machine Learning · doi:10.1007/bf00993306 · Cited by 453
Kennedy, J. (2006) · Handbook of Nature-Inspired and Innovative Computing · doi:10.1007/0-387-27705-6_6 · Cited by 432
White, C. C., & White, D. J. (1989) · European Journal of Operational Research · doi:10.1016/0377-2217(89)90348-2 · Cited by 415
Value-function reinforcement learning in Markov games
Littman, M. L. (2001) · Cognitive Systems Research · doi:10.1016/s1389-0417(01)00015-8 · Cited by 397
Stabilising Experience Replay for Deep Multi-Agent Reinforcement Learning
Foerster, J., Nardelli, N., Farquhar, G., Afouras, T., Torr, P. H. S., Kohli, P., & Whiteson, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.08887 · Cited by 397
Exact and approximate algorithms for partially observable markov decision processes
Kaelbling, L. P., & Cassandra, A. R. (1998) · Cited by 366
Dearden, R., Friedman, N., & Russell, S. (1998) · Cited by 363
A Bayesian Framework for Reinforcement Learning
Strens, M. J. A. (2000) · International Conference on Machine Learning · Cited by 358
Information dropout: learning optimal representations through noisy computation
Achille, A., & Soatto, S. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2784440 · Cited by 356
Reinforcement Learning: A Tutorial Survey and Recent Advances
Gosavi, A. (2009) · INFORMS Journal on Computing · doi:10.1287/ijoc.1080.0305 · Cited by 326
Even-Dar, E., & Mansour, Y. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44581-1_39 · Cited by 314
A reinforcement learning approach to parameter estimation in dynamic job shop scheduling
Shahrabi, J., Adibi, M. A., & Mahootchi, M. (2017) · Computers & Industrial Engineering · doi:10.1016/j.cie.2017.05.026 · Cited by 313
Multi-Scale Deep Reinforcement Learning for Real-Time 3D-Landmark Detection in CT Scans
Ghesu, F.-C., Georgescu, B., Zheng, Y., Grbic, S., Maier, A., Hornegger, J., & Comaniciu, D. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2782687 · Cited by 310
Successor Features for Transfer in Reinforcement Learning
Barreto, A. D. M. S., Dabney, W., Munos, R., Hunt, J. J., Schaul, T., Silver, D., & van Hasselt, H. P. (2016) · arXiv (Cornell University) · doi:10.13140/rg.2.2.35439.18085 · Cited by 305
Device Placement Optimization with Reinforcement Learning
Mirhoseini, A., Pham, H., Le, Q. V., Steiner, B., Larsen, R., Zhou, Y., Kumar, N., Norouzi, M., Bengio, S., & Dean, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04972 · Cited by 299
Directional routing and scheduling for green vehicular delay tolerant networks
Zeng, Y., Xiang, K., Li, D., & Vasilakos, A. V. (2013) · Wireless Networks · doi:10.1007/s11276-012-0457-9 · Cited by 298
Technical Update: Least-Squares Temporal Difference Learning
Boyan, J. A. (2002) · Machine Learning · doi:10.1023/a:1017936530646 · Cited by 294
Incremental multi-step Q-learning
Peng, J., & Williams, R. J. (1996) · Machine Learning · doi:10.1007/bf00114731 · Cited by 286
Deep Q-learning from Demonstrations
Hester, T., Vecerík, M., Pietquin, O., Lanctot, M., Schaul, T., Piot, B., Horgan, D., Quan, J., Sendonaris, A., Dulac-Arnold, G., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.03732 · Cited by 270
Multi-agent Reinforcement Learning in Sequential Social Dilemmas
Leibo, J. Z., Zambaldi, V., Lanctot, M., Marecki, J., & Graepel, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.03037 · Cited by 263
Transfer in Reinforcement Learning: A Framework and a Survey
Lazaric, A. (2012) · Adaptation, Learning, and Optimization · doi:10.1007/978-3-642-27645-3_5 · Cited by 256
Input generalization in delayed reinforcement learning: an algorithm and performance comparisons
Chapman, D., & Kaelbling, L. P. (1991) · Cited by 245
Reinforcement learning and optimal adaptive control: An overview and implementation examples
Khan, S. G., Herrmann, G., Lewis, F. L., Pipe, T., & Melhuish, C. (2012) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2012.03.004 · Cited by 234
Bayesian Reinforcement Learning: A Survey
Ghavamzadeh, M., Mannor, S., Pineau, J., & Tamar, A. (2015) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000049 · Cited by 234
A Generalization Error for Q-Learning.
Murphy, S. A. (2005) · PubMed · Cited by 216
Convergence and No-Regret in Multiagent Learning
Bowling, M. (2004) · doi:10.7939/r3zs2kf41 · Cited by 207
On the Properties of the Softmax Function with Application in Game Theory and Reinforcement Learning
Gao, B., & Pavel, L. (2017) · arXiv · doi:10.48550/arxiv.1704.00805 · Cited by 207
Emotion in reinforcement learning agents and robots: a survey
Moerland, T. M., Broekens, J., & Jonker, C. M. (2018) · Machine Learning · doi:10.1007/s10994-017-5666-0 · Cited by 205
Towards Vision-Based Deep Reinforcement Learning for Robotic Motion Control
Zhang, F., Leitner, J., Milford, M. J., Upcroft, B., & Corke, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.03791 · Cited by 198
(2017) · IEEE Control Systems · doi:10.1109/mcs.2016.2621461 · Cited by 192
Multi-agent Reinforcement Learning in Sequential Social DilemmasPreprint
Leibo, J. Z., Zambaldi, V., Lanctot, M., Marecki, J., & Graepel, T. (2017) · arXiv (Cornell University) · doi:10.5555/3091125.3091194 · Cited by 178
A study of some properties of Ant-Q
Dorigo, M., & Gambardella, L. M. (1996) · Lecture Notes in Computer Science · doi:10.1007/3-540-61723-x_1029 · Cited by 176
Hybrid Reward Architecture for Reinforcement Learning
van Seijen, H., Fatemi, M., Romoff, J., Laroche, R., Barnes, T., & Tsang, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04208 · Cited by 176
Mocanu, E., Nguyen, P. H., Kling, W. L., & Gibescu, M. (2016) · Energy and Buildings · doi:10.1016/j.enbuild.2016.01.030 · Cited by 171
Energy-Efficient Scheduling for Real-Time Systems Based on Deep Q-Learning Model
Zhang, Q., Lin, M., Yang, L. T., Chen, Z., & Li, P. (2019) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2017.2743704 · Cited by 166
Recurrent Attentional Reinforcement Learning for Multi-Label Image Recognition
Chen, T., Wang, Z., Li, G., & Lin, L. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12281 · Cited by 166
Data-Driven Flotation Industrial Process Operational Optimal Control Based on Reinforcement Learning
Jiang, Y., Fan, J., Chai, T., Li, J., & Lewis, F. L. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2761852 · Cited by 163
Incremental Multi-Step Q-Learning
Peng, J., & Williams, R. J. (1994) · Elsevier eBooks · doi:10.1016/b978-1-55860-335-6.50035-0 · Cited by 131
Motor Learning and Control for Practitioners
Coker, C. A. (2017) · Routledge eBooks · doi:10.4324/9781315185613 · Cited by 125
Madani, K. M., & Hooshyar, M. (2014) · Journal of Hydrology · doi:10.1016/j.jhydrol.2014.07.061 · Cited by 110
Modular Q-learning based multi-agent cooperation for robot soccer
Park, K.-H., Kim, Y., & Kim, J.-H. (2001) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(01)00114-2 · Cited by 110
Self-citationA Hierarchical Model for Device Placement
Mirhoseini, A., Goldie, A., Pham, H., Steiner, B., Le, Q. V., & Dean, J. (2018) · International Conference on Learning Representations · Cited by 108
Application of reinforcement learning to routing in distributed wireless networks: a review
Al-Rawi, H. A. A., Ng, M. A., & Yau, K. A. (2013) · Artificial Intelligence Review · doi:10.1007/s10462-012-9383-6 · Cited by 107
Hierarchical and Interpretable Skill Acquisition in Multi-task Reinforcement LearningPreprint
Shu, T., Xiong, C., & Socher, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.07294 · Cited by 106
Yu, T., Zhou, B., Chan, K. W., Chen, L., & Yang, B. F. (2011) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2010.2102372 · Cited by 105
Reward Shaping in Episodic Reinforcement Learning
Grześ, M. (2017) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/czhk5726 · Cited by 104
Multi-Agent Learning with Policy Prediction
Zhang, C., & Lesser, V. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7639 · Cited by 102
Ant Colony-Based Reinforcement Learning Algorithm for Routing in Wireless Sensor Networks
GhasemAghaei, R., Rahman, M. A., Gueaieb, W., & Saddik, A. E. (2007) · Conference proceedings - IEEE Instrumentation/Measurement Technology Conference · doi:10.1109/imtc.2007.379173 · Cited by 99
Potential-based difference rewards for multiagent reinforcement learning
Devlin, S., Yliniemi, L., Kudenko⋆, D., & Tumer, K. (2014) · doi:10.5555/2615731.2615761 · Cited by 87
Hybrid Control for Robot Navigation - A Hierarchical Q-Learning Algorithm
Chen, C., Li, H., & Dong, D. (2008) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2008.921541 · Cited by 79
On multiagent Q-learning in a semi-competitive domain
Sandholm, T., & Crites, R. H. (1996) · Lecture notes in computer science · doi:10.1007/3-540-60923-7_28 · Cited by 76
Reinforcement Learning with a Corrupted Reward Channel
Everitt, T., Krakovna, V., Orseau, L., & Legg, S. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/656 · Cited by 74
Emergence of social norms through collective learning in networked agent societies
Yu, C., Zhang, M., Ren, F., & Luo, X. (2013) · doi:10.5555/2484920.2484997 · Cited by 66
Sparse multi-task reinforcement learning
Calandriello, D., Lazaric, A., & Restelli, M. (2015) · Intelligenza Artificiale · doi:10.3233/ia-150080 · Cited by 63
Motor Learning and Control for Practitioners
Coker, C. A. (2016) · Routledge eBooks · doi:10.4324/9781003542988 · Cited by 60
Ant Colony Optimization Incorporated With Fuzzy Q-Learning for Reinforcement Fuzzy Control
Juang, C., & Lu, C.-M. (2009) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2009.2014539 · Cited by 58
A neural model of hierarchical reinforcement learning
Rasmussen, D., Voelker, A., & Eliasmith, C. (2017) · PLoS ONE · doi:10.1371/journal.pone.0180234 · Cited by 58
Chu, X., & Ye, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.00336 · Cited by 56
Inverse Reinforcement Learning in Swarm SystemsPreprint
Šošić, A., KhudaBukhsh, W. R., Zoubir, A. M., & Koeppl, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.05450 · Cited by 52
Q-Learning for Adaptive Traffic Signal Control Based on Delay Minimization Strategy
Lu, S., Ximin, L., & Shiqiang, D. (2008) · IEEE International Conference on Networking, Sensing and Control (ICNSC) · doi:10.1109/icnsc.2008.4525304 · Cited by 43
Leveraging Human Knowledge in Tabular Reinforcement Learning: A Study of Human Subjects
Rosenfeld, A., Cohen, M., Taylor, M. E., & Kraus, S. (2017) · The Knowledge Engineering Review · doi:10.1017/s0269888918000206 · Cited by 42
A Modular Q-Learning Architecture for Manipulator Task Decomposition
Tham, C., & Prager, R. W. (1994) · Elsevier eBooks · doi:10.1016/b978-1-55860-335-6.50045-3 · Cited by 40
Autonomous Quadrotor Landing using Deep Reinforcement LearningPreprint
Polvara, R., Patacchiola, M., Sharma, S. K., Wan, J., Manning, A. J., Sutton, R., & Cangelosi, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.03339 · Cited by 40
Swarm reinforcement learning algorithms based on Sarsa method
Iima, H., & Kuroe, Y. (2008) · SICE Annual Conference (SICE) · doi:10.1109/sice.2008.4654998 · Cited by 34
Inverse Reinforcement Learning in Swarm Systems
Šošić, A., KhudaBukhsh, W. R., Zoubir, A. M., & Koeppl, H. (2017) · TUbilio (Technical University of Darmstadt) · doi:10.5555/3091125.3091320 · Cited by 31
Reinforcement Learning and Function Approximation.
Irodova, M., & Sloan, R. H. (2005) · Cited by 29
OFFER: Off-Environment Reinforcement Learning
Ciosek, K., & Whiteson, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10810 · Cited by 28
Resource Abstraction for Reinforcement Learning in Multiagent Congestion Problems
Malialis, K., Devlin, S., & Kudenko⋆, D. (2016) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.5555/2936924.2937000 · Cited by 26
Concurrent Meta Reinforcement LearningPreprint
Parisotto, E., Ghosh, S., Yalamanchi, S., Chinnaobireddy, V., Wu, Y., & Salakhutdinov, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.02710 · Cited by 24
Hybrid MDP based integrated hierarchical Q-learning
Chen, C., Dong, D., Li, H., & Tarn, T. (2011) · Science China Information Sciences · doi:10.1007/s11432-011-4332-6 · Cited by 21
Potential based reward shaping for hierarchical reinforcement learning
Gao, Y., & Toni, F. (2015) · Spiral (Imperial College London) · Cited by 21
Information Theory, Memory, Prediction, and Timing in Associative Learning
Wilkes, J., & Gallistel, C. R. (2017) · Wiley eBooks · doi:10.1002/9781119159193.ch35 · Cited by 20
Efficient Reinforcement Learning with Hierarchies of Machines by Leveraging Internal Transitions
Bai, A., & Russell, S. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/196 · Cited by 19
Exponential moving average Q-learning algorithm
Awheda, M. D., & Schwartz, H. M. (2013) · IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning · doi:10.1109/adprl.2013.6614986 · Cited by 18
Multi-Task Deep Learning for User Intention Understanding in Speech Interaction Systems
Ning, Y., Jia, J., Wu, Z., Li, R., An, Y., Wang, Y., & Meng, H. M. L. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10493 · Cited by 18
Compatible Reward Inverse Reinforcement Learning
Metelli, A. M., Pirotta, M., & Restelli, M. (2017) · LillOA (Université de Lille (University Of Lille)) · Cited by 18
Building load management clusters using reinforcement learning
Ahmed, S., & Bouffard, F. (2017) · IEEE Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON) · doi:10.1109/iemcon.2017.8117147 · Cited by 16
P-MARL: Prediction-Based Multi-Agent Reinforcement Learning for Non-Stationary Environments
Marinescu, A., Dusparić, I., Taylor, A., et al. (2015) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/2772879.2773492 · Cited by 9
Solving the Gale-Shapley Problem by Ant-Q learning
Kim, H. J., & Chung, T. (2011) · The KIPS Transactions PartB · doi:10.3745/kipstb.2011.18b.3.165 · Cited by 2
Cited by
IoB: Internet-of-batteries for electric Vehicles–Architectures, opportunities, and challenges
Li, H., Bin Kaleem, M., Liu, Z., Wu, Y., Liu, W., & Huang, Z. (2023) · Green Energy and Intelligent Transportation · doi:10.1016/j.geits.2023.100128 · Cited by 95
Metadata
- Authors
- Jang, B., Kim, M., Harerimana, G., & Kim, J. W.
- Venue
- IEEE Access
- Published
- 2019
- Volume
- 7
- Pages
- 133653-133667
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2973184394
- Cited by
- 635
- References
- 115
- FWCI
- 15.89
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.