Human-level control through deep reinforcement learning
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
The theory of reinforcement learning provides a normative account, deeply rooted in psychological and neuroscientific perspectives on animal behaviour, of how agents may optimize their control of an environment. To use reinforcement learning successfully in situations approaching real-world complexity, however, agents are confronted with a difficult task: they must derive efficient representations of the environment from high-dimensional sensory inputs, and use these to generalize past experience to new situations. Remarkably, humans and other animals seem to solve this problem through a harmonious combination of reinforcement learning and hierarchical sensory processing systems, the former evidenced by a wealth of neural data revealing notable parallels between the phasic signals emitted by dopaminergic neurons and temporal difference reinforcement learning algorithms. While reinforcement learning agents have achieved some successes in a variety of domains, their applicability has previously been limited to domains in which useful features can be handcrafted, or to domains with fully observed, low-dimensional state spaces. Here we use recent advances in training deep neural networks to develop a novel artificial agent, termed a deep Q-network, that can learn successful policies directly from high-dimensional sensory inputs using end-to-end reinforcement learning. We tested this agent on the challenging domain of classic Atari 2600 games. We demonstrate that the deep Q-networ…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In previous studies, the agents are assumed to act based on simple and heuristic policy functions, and learned in isolated and restricted environments [1][2][3][4][5][6].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [1]
In the citing paper
“This technique was developed in 2013 with Google Deep Mind [55].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [55]
In the citing paper
“Whereas previous reinforcement-learning algorithms often rely only on task-specific learning signals9,10, Dreamer rests predominantly on the unsupervised objective of its world model.”
From Mastering diverse control tasks through world models (2025) · cites this paper as [9]
In the citing paper
“Traditional RL such as AlphaGo Zero and the DQN series (Silver et al., 2017; Mnih et al., 2015; Yue et al., 2023) can continuously improve the performance of a policy in environments like Go and Atari games without an explicit upper bound .”
From Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model? (2025) · cites this paper as Mnih et al., 2015
In the citing paper
“Unlike previous reinforcement learning algorithms that often rely only on task-specific learning signals 7,8 , Dreamer rests predominantly on the unsupervised objective of its world model.”
From Mastering Diverse Domains through World Models (2023) · cites this paper as [7]
24 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“We use one particularly successful architecture, the deep convolutional network 17 , which uses hierarchical layers of tiled convolutional filters tomimictheeffectsofreceptivefields—inspiredbyHubelandWiesel’s seminalworkonfeedforwardprocessinginearlyvisualcortex 18 —thereby…”
Method(2008) · Journal of Machine Learning Research · Cited by 33,051
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
(2010) · International Conference on Machine Learning · Cited by 13,995
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“…4,5 , the former evidenced by a wealth of neural data revealingnotableparallelsbetweenthephasicsignalsemittedbydopa-minergicneuronsandtemporaldifferencereinforcementlearning algorithms 3 .”
BackgroundLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 2×
“Notably, recent advances in deep neural networks 9–11 , in which several layers of nodes areused to buildup progressivelymore abstractrepresentations of the data, have made it possible for artificial neural networks to learn concepts such as object categories directly from raw sensory data.”
BackgroundWatkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Cited by
Items 601–700 of 1,418
Deep Reinforcement Learning for Vehicular Edge Computing: An Intelligent Offloading System
Ning, Z., Dong, P., Wang, X., Rodrigues, J. J. P. C., & Xia, F. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3317572 · Cited by 292
A Survey of End-to-End Driving: Architectures and Training Methods
Tampuu, A., Matiisen, T., Semikin, M., Fishman, D., & Muhammad, N. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3043505 · Cited by 291
Two-Timescale Voltage Control in Distribution Grids Using Deep Reinforcement Learning
Yang, Q., Wang, G., Sadeghi, A., Giannakis, G. B., & Sun, J. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2951769 · Cited by 291
“Toward this objective, the popular stochastic gradient descent (SGD) method is employed to update θ ‘on the fly’ [18].”
InfluentialExploring Large Language Model‐Based Intelligent Agents: Definitions, Methods, and Prospects
Cheng, Y., Zhang, C., Zhang, Z., Meng, X., Hong, S., Li, W., Wang, Z., Wang, Z., Yin, F., Zhao, J., et al. (2026) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70111 · Cited by 341
Tactics of Adversarial Attack on Deep Reinforcement Learning Agents
Lin, Y.-C., Hong, Z.-W., Liao, Y.-H., Shih, M.-L., Liu, M.-Y., & Sun, M. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/525 · Cited by 290
Deep reinforcement learning meets graph neural networks: Exploring a routing optimization use case
Almasan, P., Suárez-Varela, J., Rusek, K., Barlet-Ros, P., & Cabellos-Aparicio, A. (2022) · Computer Communications · doi:10.1016/j.comcom.2022.09.029 · Cited by 290
Online Incremental Machine Learning Platform for Big Data-Driven Smart Traffic Management
Nallaperuma, D., Nawaratne, R., Bandaragoda, T., Adikari, A., Nguyen, S., Kempitiya, T., De Silva, D., Alahakoon, D., & Pothuhera, D. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2924883 · Cited by 290
“In the proposed DRL algorithm, we apply Q-learning in which DNN is used to represent the Q function [39].”
MethodInfluentialApplication of Artificial Intelligence in Automation of Supply Chain Management
(2019) · Journal of Strategic Innovation and Sustainability · doi:10.33423/jsis.v14i3.2105 · Cited by 290
Intelligent Computing: The Latest Advances, Challenges, and Future
Zhu, S., Yu, T., Xu, T., Chen, H., Dustdar, S., Gigan, S., Gunduz, D., Hossain, E., Jin, Y., Lin, F., et al. (2023) · Intelligent Computing · doi:10.34133/icomputing.0006 · Cited by 290
Robust Multi-Agent Reinforcement Learning via Minimax Deep Deterministic Policy Gradient
Li, S., Wu, Y., Cui, X., Dong, H., Fang, F., & Russell, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014213 · Cited by 290
Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches
Meng, F., Chen, P., Wu, L., & Cheng, J. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3001736 · Cited by 288
Machine learning for wireless communications in the Internet of Things: A comprehensive survey
Jagannath, J., Polosky, N., Jagannath, A., Restuccia, F., & Melodia, T. (2019) · Ad Hoc Networks · doi:10.1016/j.adhoc.2019.101913 · Cited by 288
Reinforcement Learning through Asynchronous Advantage Actor-Critic on a GPUPreprint
Babaeizadeh, M., Frosio, I., Tyree, S., Clemons, J., & Kautz, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.06256 · Cited by 403
Grounded Language Learning in a Simulated 3D World
Hermann, K. M., Hill, F., Green, S., Wang, F., Faulkner, R., Soyer, H., Szepesvári, D., Czarnecki, W. M., Jaderberg, M., Teplyashin, D., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.06551 · Cited by 132
Self-citationHe, Y., Zhang, Z., Yu, F. R., Zhao, N., Yin, H., Leung, V. C. M., & Zhang, Y. (2017) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2751641 · Cited by 288
Artificial intelligence in surgery
Varghese, C., Harrison, E. M., O’Grady, G., & Topol, E. J. (2024) · Nature Medicine · doi:10.1038/s41591-024-02970-3 · Cited by 287
Motion Planning Networks: Bridging the Gap Between Learning-Based and Classical Motion Planners
Qureshi, A. H., Miao, Y., Simeonov, A., & Yip, M. C. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3006716 · Cited by 287
Zebrafish Behavior: Opportunities and Challenges
Orger, M. B., & de Polavieja, G. G. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071714-033857 · Cited by 287
Qiu, X., Liu, L., Chen, W., Hong, Z., & Zheng, Z. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2924015 · Cited by 287
Lyapunov-based Safe Policy Optimization for Continuous ControlPreprint
Chow, Y., Nachum, O., Faust, A., Duéñez‐Guzmán, E. A., & Ghavamzadeh, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.10031 · Cited by 335
“WIE710bE2U6DmS59AfRzqK2Kek/ view?usp=sharing 1. Introduction The field of reinforcement learning (RL) has witnessed tremendous success in many high-dimensional control problems, including video games (Mnih et al., 2015), board games (Silver et al., 2016), robot locomotion (Lillicrap et al., *Equal contribution 1DeepMin…”
BackgroundMachine Learning in Chemical Engineering: A Perspective
Schweidtmann, A. M., Esche, E., Fischer, A., Kloft, M., Repke, J., Sager, S., & Mitsos, A. (2021) · Chemie Ingenieur Technik · doi:10.1002/cite.202100083 · Cited by 286
Autonomous navigation of stratospheric balloons using reinforcement learning
Bellemare, M. G., Candido, S., Castro, P. S., Gong, J., Machado, M. C., Moitra, S., Ponda, S. S., & Wang, Z. (2020) · Nature · doi:10.1038/s41586-020-2939-8 · Cited by 286
Self-citationA Survey of Deep Reinforcement Learning in Video Games
Shao, K., Tang, Z., Zhu, Y., Li, N., & Zhao, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.10944 · Cited by 141
“Deep Q-network (DQN) [14] is the most famous DRL”
BackgroundMethodInfluentialLearning Attentional Communication for Multi-Agent Cooperation
Jiang, J., & Lu, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07733 · Cited by 285
Language Understanding for Text-based Games using Deep Reinforcement Learning
Narasimhan, K., Kulkarni, T., & Barzilay, R. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1001 · Cited by 285
CIRL: Controllable Imitative Reinforcement Learning for Vision-Based Self-driving
Liang, X., Wang, T., Yang, L., & Xing, E. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_36 · Cited by 285
Ganesh, A. H., & Xu, B. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.111833 · Cited by 285
Deep Reinforcement Learning for Mobile 5G and Beyond: Fundamentals, Applications, and Challenges
Xiong, Z., Zhang, Y., Niyato, D., Deng, R., Wang, P., & Wang, L.-C. (2019) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2019.2903655 · Cited by 285
Deep learning methods in transportation domain: a review
Nguyen, H., Kieu, L., Wen, T., & Cai, C. (2018) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2018.0064 · Cited by 285
Mastering Complex Control in MOBA Games with Deep Reinforcement Learning
Ye, D., Liu, Z., Sun, M., Shi, B., Zhao, P., Wu, H., Yu, H., Yang, S., Wu, X., Guo, Q., et al. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6144 · Cited by 284
DeepComfort: Energy-Efficient Thermal Comfort Control in Buildings Via Reinforcement Learning
Gao, G., Li, J., & Wen, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2992117 · Cited by 283
Zhang, X., Peng, M., Yan, S., & Sun, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2962715 · Cited by 282
“Similar to [27], mean-square error is adopted as the loss function, i.”
MethodDeep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks
Liang, L., Ye, H., Yu, G., & Li, G. Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2957798 · Cited by 282
“They can also be combined with the latest advances in deep learning to bring the performance to a new level, such as deep Q-learning that has achieved remarkable performance in human-level video game play [42].”
BackgroundMethodLopez-Perez, D., De Domenico, A., Piovesan, N., Xinli, G., Bao, H., Qitao, S., & Debbah, M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3142532 · Cited by 282
Actor-Critic Deep Reinforcement Learning for Solving Job Shop Scheduling Problems
Liu, C.-L., Chang, C.-C., & Tseng, C.-J. (2020) · IEEE Access · doi:10.1109/access.2020.2987820 · Cited by 281
DLFuzz: differential fuzzing testing of deep learning systems
Guo, J., Jiang, Y., Zhao, Y., Chen, Q., & Sun, J. (2018) · Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3236024.3264835 · Cited by 281
“nd even reconstruction of brain circuits [5]. These encouraging accomplishments inspired wide deployments of DL systems in safety-critical domains, such as autonomous driving [1], drones and robotics [11] and malware detection [20], and it is in great demand to test and improve the robustness of DL systems. For DL tes…”
MethodVisualizing the Hidden Activity of Artificial Neural Networks
Rauber, P. E., Fadel, S. G., Falcao, A. X., & Telea, A. C. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2598838 · Cited by 280
Actor-Attention-Critic for Multi-Agent Reinforcement Learning
Iqbal, S., & Sha, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.02912 · Cited by 280
The Future of Human-AI Collaboration: A Taxonomy of Design Knowledge for Hybrid Intelligence Systems
Dellermann, D., Calma, A., Lipusch, N., Weber, T., Weigel, S., & Ebel, P. (2019) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2019.034 · Cited by 279
One-shot Learning with Memory-Augmented Neural Networks
Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06065 · Cited by 278
Self-citationImitation from Observation: Learning to Imitate Behaviors from Raw Video via Context Translation
Liu, Y., Gupta, A., Abbeel, P., & Levine, S. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8462901 · Cited by 278
Augmenting Image Classifiers Using Data Augmentation Generative Adversarial Networks
Antoniou, A., Storkey, A., & Edwards, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01424-7_58 · Cited by 278
“They have been demonstrated in variety of domains [12] spanning from image classification [25, 17, 16, 18, 21], machine translation [44], natural language processing [12], speech recognition [19], and synthesis [42], learning from human play [6] and reinforcement learning [27, 35, 10, 40, 13] among others.”
BackgroundDeep neural networks in psychiatry
Durstewitz, D., Koppe, G., & Meyer-Lindenberg, A. (2019) · Molecular Psychiatry · doi:10.1038/s41380-019-0365-9 · Cited by 278
“These include areas like visual object, pattern, and scene recognition [5–7], natural language processing [8, 9], video game playing [10], to cognitively challenging board games like Go [11] or goal-directed planning tasks [12].”
BackgroundDeep reinforcement learning with successor features for navigation across similar environments
Zhang, J., Springenberg, J. T., Boedecker, J., & Burgard, W. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206049 · Cited by 278
“This idea was arguably popularized by the Deep Q-networks (DQN) [5] approach followed by a large body of work deriving extended variants (e.”
MethodDu, J., Yu, F. R., Lu, G., Wang, J., Jiang, J., & Chu, X. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3003449 · Cited by 278
“Compared with value based algorithms such as Q-learning, DQN [37], SARAS [38], etc., where optimization relies on value functions and the optimal policies is obtained only when all the states are traversed, leading to high complexity when the state and action space is large.”
MethodInfluentialEmergent Multi-Agent Communication in the Deep Learning EraPreprint
Lazaridou, A., & Baroni, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02419 · Cited by 324
“Learning generally takes place through reinforcement learning, a set of techniques to train systems in scenarios in which the main teaching signal is reward for succeeding or failing at a task, possibly requiring multiple actions in a potentially changing environment ([38, 39, 40]).”
BackgroundEPOpt: Learning Robust Neural Network Policies Using Model Ensembles
Rajeswaran, A., Ghotra, S., Ravindran, B., & Levine, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.01283 · Cited by 120
Predicting the efficiency of prime editing guide RNAs in human cells
Kim, H. K., Yu, G., Park, J., Min, S., Lee, S., Yoon, S., & Kim, H. H. (2021) · Nature Biotechnology · doi:10.1038/s41587-020-0677-y · Cited by 276
Deep Learning for Mortgage Risk
Sadhwani, A., Giesecke, K., & Sirignano, J. A. (2018) · Journal of Financial Econometrics · doi:10.1093/jjfinec/nbaa025 · Cited by 304
Reinforcement Learning in Large Discrete Action Spaces.Preprint
Dulac-Arnold, G., Evans, R., Sunehag, P., & Coppin, B. (2015) · arXiv (Cornell University) · Cited by 292
Real-Time Energy Management of a Microgrid Using Deep Reinforcement Learning
Ji, Y., Wang, J., Xu, J., Fang, X., & Zhang, H. (2019) · Energies · doi:10.3390/en12122291 · Cited by 275
Energy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning
Hu, Y., Li, W., Xu, K., Zahid, T., Qin, F., & Li, C. (2018) · Applied Sciences · doi:10.3390/app8020187 · Cited by 275
Intelligent Offloading in Multi-Access Edge Computing: A State-of-the-Art Review and Framework
Cao, B., Zhang, L., Li, Y., Feng, D., & Cao, W. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1800608 · Cited by 275
Hierarchical motor control in mammals and machines
Merel, J., Botvinick, M., & Wayne, G. (2019) · Nature Communications · doi:10.1038/s41467-019-13239-6 · Cited by 274
Opportunities and challenges for quantum-assisted machine learning in near-term quantum computers
Perdomo-Ortiz, A., Benedetti, M., Realpe-Gómez, J., & Biswas, R. (2018) · Quantum Science and Technology · doi:10.1088/2058-9565/aab859 · Cited by 274
“[7] Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex”
BackgroundDeep reinforcement learning: a survey
Wang, H.-N., Liu, N., Zhang, Y.-Y., Feng, D.-W., Huang, F., Li, D.-S., & Zhang, Y.-M. (2020) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1900533 · Cited by 274
Label-Free Supervision of Neural Networks with Physics and Domain Knowledge
Stewart, R., & Ermon, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10934 · Cited by 274
Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning
Wang, J., Hu, J., Min, G., Zhan, W., Zomaya, A. Y., & Georgalas, N. (2022) · IEEE Transactions on Computers · doi:10.1109/tc.2021.3131040 · Cited by 274
“A typical valued-based method is deep Q-learning [19], which approximates the optimal value function by DNN (i.e., deep Q-network).”
MethodA Survey on Transfer Learning for Multiagent Reinforcement Learning Systems
Silva, F. L. D., & Costa, A. H. R. (2019) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11396 · Cited by 273
Skin Cancer Classification using Deep Learning and Transfer Learning
Hosny, K. M., Kassem, M. A., & Foaud, M. M. (2018) · 2018 9th Cairo International Biomedical Engineering Conference (CIBEC) · doi:10.1109/cibec.2018.8641762 · Cited by 273
“Recently, researchers around the world successfully utilized deep learning in visual task [10,11] and object recognition [12].”
BackgroundAguilar, J., Zhang, T., Qian, F., Kingsbury, M., McInroe, B., Mazouchova, N., Li, C., Maladen, R., Gong, C., Travers, M., et al. (2016) · Reports on Progress in Physics · doi:10.1088/0034-4885/79/11/110001 · Cited by 273
Machine learning-based coronary artery disease diagnosis: A comprehensive review
Alizadehsani, R., Abdar, M., Roshanzamir, M., Khosravi, A., Kebria, P. M., Khozeimeh, F., Nahavandi, S., Sarrafzadegan, N., & Acharya, U. R. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.103346 · Cited by 273
Toward an Automated Auction Framework for Wireless Federated Learning Services Market
Jiao, Y., Wang, P., Niyato, D., Lin, B., & Kim, D. I. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.2994639 · Cited by 273
Benchmarking Multi-Agent Deep Reinforcement Learning Algorithms in Cooperative TasksPreprint
Papoudakis, G., Christianos, F., Schäfer, L., & Albrecht, S. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07869 · Cited by 379
“The joint state-action value function is trained using the standard DQN algorithm [23, 38].”
MethodSmartly Handling Renewable Energy Instability in Supporting A Cloud Datacenter
Gao, J., Wang, H., & Shen, H. (2020) · 2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps47924.2020.00084 · Cited by 272
Sensorimotor processing in the rodent barrel cortex
Petersen, C. C. H. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0200-y · Cited by 271
Qu, X., Yu, Y., Zhou, M., Lin, C.-T., & Wang, X. (2020) · Applied Energy · doi:10.1016/j.apenergy.2019.114030 · Cited by 271
Deep Reinforcement Learning and the Deadly Triad
van Hasselt, H. P., Doron, Y., Strub, F., Hessel, M., Sonnerat, N., & Modayil, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02648 · Cited by 101
InfoGAIL: Interpretable Imitation Learning from Visual DemonstrationsPreprint
Li, Y., Song, J., & Ermon, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.08840 · Cited by 378
Exponential expressivity in deep neural networks through transient chaos
Poole, B., Lahiri, S., Raghu, M., Sohl‐Dickstein, J., & Ganguli, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05340 · Cited by 270
diffGrad: An Optimization Method for Convolutional Neural Networks
Dubey, S. R., Chakraborty, S., Roy, S. K., Mukherjee, S., Singh, S. K., & Chaudhuri, B. B. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2955777 · Cited by 270
“…generally outperform the traditional hand-designed approaches to solve research problems in Computer Vision [2], [3], [4], [5], Image Processing [6], [7], Signal Processing [8], [9], Robotics [10], Natural Language Processing [11], [12], and many other diverse areas of Artificial Intelligence.”
BackgroundA Boundary Tilting Persepective on the Phenomenon of Adversarial Examples
Tanay, T., & Griffin, L. D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.07690 · Cited by 121
Deep reinforcement learning and its neuroscientific implications
Botvinick, M., Wang, J. X., Dabney, W., Miller, K. J., & Kurth-Nelson, Z. (2020) · Neuron · doi:10.1016/j.neuron.2020.06.014 · Cited by 269
“Typical, deep RL systems use a deep neural network to compute a non-linear mapping from perceptual inputs to action-values (e.g., Mnih et al., 2015) or action-probabilities (e.g., Silver et al., 2016)), as well as reinforcement learning signals that update the weights in this network, often via…”
Li, Y., Wang, R., & Yang, Z. (2022) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2021.3105529 · Cited by 269
UAV Path Planning Using Optimization Approaches: A Survey
Ait Saadi, A., Soukane, A., Meraihi, Y., Benmessaoud Gabis, A., Mirjalili, S., & Ramdane-Cherif, A. (2022) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-022-09742-7 · Cited by 269
Qi, Q., Wang, J., Ma, Z., Sun, H., Cao, Y., Zhang, L., & Liao, J. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2894437 · Cited by 269
Reinforcement learning in artificial and biological systems
Neftci, E. O., & Averbeck, B. B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0025-4 · Cited by 268
Off-Policy Deep Reinforcement Learning without Exploration
Fujimoto, S., Meger, D., & Precup, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02900 · Cited by 268
“Critics and value functions follow the standard practice (Mnih et al., 2015) in which the Bellman update differs for terminal transitions.”
BackgroundMethodInfluentialIntelligent multi-zone residential HVAC control strategy based on deep reinforcement learning
Du, Y., Zandi, H., Kotevska, O., Kurte, K., Munk, J., Amasyali, K., Mckee, E., & Li, F. (2021) · Applied Energy · doi:10.1016/j.apenergy.2020.116117 · Cited by 268
Conti, E., Madhavan, V., Such, F. P., Lehman, J., Stanley, K. O., & Clune, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.06560 · Cited by 108
“Although deep RL algorithms have performed amazing feats in recent years (Mnih et al., 2015; 2016; Schulman et al., 2015), they have mostly done so despite relying on simple, undirected (aka dithering) exploration strategies, in which an agent hopes to explore new areas of its environment by taking…”
BackgroundMethodA foundation model for the Earth system
Bodnar, C., Bruinsma, W. P., Lucic, A., Stanley, M., Allen, A., Brandstetter, J., Garvan, P., Riechert, M., Weyn, J. A., Dong, H., et al. (2025) · Nature · doi:10.1038/s41586-025-09005-y · Cited by 267
“Finally, to enable training at very large numbers of roll-out steps without compromising memory or training speed, we use an in-memory replay buffer, inspired by deep reinforcement learning 55,56 (see Fig.”
Deep Learning: The Good, the Bad, and the Ugly
Serre, T. (2019) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091718-014951 · Cited by 267
Trial without Error: Towards Safe Reinforcement Learning via Human Intervention
Saunders, W., Sastry, G., Stuhlmüller, A., & Evans, O. (2018) · International Joint Conference on Autonomous Agents and Multiagent Systems · doi:10.65109/mzmg4429 · Cited by 157
Unifying Count-Based Exploration and Intrinsic Motivation
Bellemare, M. G., Srinivasan, S., Ostrovski, G., Schaul, T., Saxton, D., & Munos, R. (2016) · arXiv · doi:10.48550/arxiv.1606.01868 · Cited by 264
Self-citationLearning how to explain neural networks: PatternNet and PatternAttribution
Kindermans, P.-J., Schütt, K. T., Alber, M., Müller, K. R., Erhan, D., Kim, B., & Dähne, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.05598 · Cited by 264
“Deep learning [1, 2] has had a huge impact on a wide variety of applications [3, 4, 5, 6].”
BackgroundRecent advances in deep learning based dialogue systems: a systematic survey
Ni, J., Young, T., Pandelea, V., Xue, F., & Cambria, E. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10248-8 · Cited by 264
Deep Learning for Diabetes: A Systematic Review
Zhu, T., Li, K., Herrero, P., & Georgiou, P. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3040225 · Cited by 264
“The network is trained by interacting with the environment consistently [48].”
BackgroundCollision avoidance for an unmanned surface vehicle using deep reinforcement learning
Woo, J., & Kim, N. (2020) · Ocean Engineering · doi:10.1016/j.oceaneng.2020.107001 · Cited by 264
Zeng, Y., Xu, X., Jin, S., & Zhang, R. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3056573 · Cited by 264
Qiu, C., Yao, H., Yu, F. R., Xu, F., & Zhao, C. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2907682 · Cited by 276
“There are two innovations to make DQL more efficient and more robust [44]: 1) Experience replay.”
BackgroundData-efficient Deep Reinforcement Learning for Dexterous Manipulation
Popov, I., Heess, N., Lillicrap, T., Hafner, R., Barth-Maron, G., Vecerík, M., Lampe, T., Tassa, Y., Erez, T., & Riedmiller, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.03073 · Cited by 105
Self-citationMulti-agent Reinforcement Learning in Sequential Social Dilemmas
Leibo, J. Z., Zambaldi, V., Lanctot, M., Marecki, J., & Graepel, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.03037 · Cited by 263
Artificial intelligence and echocardiography
Alsharqi, M., Woodward, W. J., Mumith, J. A., Markham, D. C., Upton, R., & Leeson, P. (2018) · Echo Research & Practice · doi:10.1530/erp-18-0056 · Cited by 262
A deep reinforcement learning based framework for power-efficient resource allocation in cloud RANs
Xu, Z., Wang, Y., Tang, J., Wang, J., & Gursoy, M. C. (2017) · 2017 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2017.7997286 · Cited by 262
Qian, T., Shao, C., Wang, X., & Shahidehpour, M. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2942593 · Cited by 262
“Thus, the target network whose weights are fixed and only slowly updated to the primary Q-networks values is adopted to stabilize the training [23].”
BackgroundDeep Reinforcement Learning: An Overview
Mousavi, S. S., Schukat, M., & Howley, E. (2018) · Lecture Notes in Networks and Systems · doi:10.1007/978-3-319-56991-8_32 · Cited by 261
Learning Multiagent Communication with Backpropagation
Sukhbaatar, S., Szlam, A. D., & Fergus, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07736 · Cited by 261
Yang, Q., Liu, Y., Cheng, Y., Kang, Y., Chen, T., & Yu, H. (2019) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s00960ed2v01y201910aim043 · Cited by 261
Li, Y., Gu, W., Yuan, M., & Tang, Y. (2022) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2021.102283 · Cited by 261
Deep reinforcement learning in computer vision: a comprehensive survey
Le, N., Rathour, V. S., Yamazaki, K., Luu, K., & Savvides, M. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10061-9 · Cited by 261
Metadata
- Authors
- Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S., & Hassabis, D.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Corresponding author
- Kavukcuoglu, Koray
- Hassabis, Demis
- ORCID
- Venue
- Nature
- Published
- 2015-02-25
- Volume
- 518
- Issue
- 7540
- Pages
- 529-533
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2145339207
- Semantic Scholar
- 340f48901f72278f6bf78a04ee5b01df208cc508
- Cited by
- 30,357
- References
- 37
- Citations by year
- 2026: 2851 · 2025: 3619 · 2024: 3335 · 2023: 3592 · 2022: 3367 · 2021: 3971 · 2020: 3466 · 2019: 2907 · 2018: 1776 · 2017: 912 · 2016: 416 · 2015: 132
- FWCI
- 1057.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- DeepMind
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep Q-network, deep reinforcement learning, game-playing agents, end-to-end learning, deep neural network, temporal difference learning, dopaminergic neurons, human-level performance, DeepMind, AlphaGo, AlphaZero
- MeSH terms
- Algorithms, Artificial Intelligence, Humans, Models, Psychological, Reinforcement, Psychology, Reward, Neural Networks, Computer, Video Games
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.