Human-level control through deep reinforcement learning
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
The theory of reinforcement learning provides a normative account, deeply rooted in psychological and neuroscientific perspectives on animal behaviour, of how agents may optimize their control of an environment. To use reinforcement learning successfully in situations approaching real-world complexity, however, agents are confronted with a difficult task: they must derive efficient representations of the environment from high-dimensional sensory inputs, and use these to generalize past experience to new situations. Remarkably, humans and other animals seem to solve this problem through a harmonious combination of reinforcement learning and hierarchical sensory processing systems, the former evidenced by a wealth of neural data revealing notable parallels between the phasic signals emitted by dopaminergic neurons and temporal difference reinforcement learning algorithms. While reinforcement learning agents have achieved some successes in a variety of domains, their applicability has previously been limited to domains in which useful features can be handcrafted, or to domains with fully observed, low-dimensional state spaces. Here we use recent advances in training deep neural networks to develop a novel artificial agent, termed a deep Q-network, that can learn successful policies directly from high-dimensional sensory inputs using end-to-end reinforcement learning. We tested this agent on the challenging domain of classic Atari 2600 games. We demonstrate that the deep Q-networ…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In previous studies, the agents are assumed to act based on simple and heuristic policy functions, and learned in isolated and restricted environments [1][2][3][4][5][6].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [1]
In the citing paper
“This technique was developed in 2013 with Google Deep Mind [55].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [55]
In the citing paper
“Whereas previous reinforcement-learning algorithms often rely only on task-specific learning signals9,10, Dreamer rests predominantly on the unsupervised objective of its world model.”
From Mastering diverse control tasks through world models (2025) · cites this paper as [9]
In the citing paper
“Traditional RL such as AlphaGo Zero and the DQN series (Silver et al., 2017; Mnih et al., 2015; Yue et al., 2023) can continuously improve the performance of a policy in environments like Go and Atari games without an explicit upper bound .”
From Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model? (2025) · cites this paper as Mnih et al., 2015
In the citing paper
“Unlike previous reinforcement learning algorithms that often rely only on task-specific learning signals 7,8 , Dreamer rests predominantly on the unsupervised objective of its world model.”
From Mastering Diverse Domains through World Models (2023) · cites this paper as [7]
24 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“We use one particularly successful architecture, the deep convolutional network 17 , which uses hierarchical layers of tiled convolutional filters tomimictheeffectsofreceptivefields—inspiredbyHubelandWiesel’s seminalworkonfeedforwardprocessinginearlyvisualcortex 18 —thereby…”
Method(2008) · Journal of Machine Learning Research · Cited by 33,051
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
(2010) · International Conference on Machine Learning · Cited by 13,995
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“…4,5 , the former evidenced by a wealth of neural data revealingnotableparallelsbetweenthephasicsignalsemittedbydopa-minergicneuronsandtemporaldifferencereinforcementlearning algorithms 3 .”
BackgroundLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 2×
“Notably, recent advances in deep neural networks 9–11 , in which several layers of nodes areused to buildup progressivelymore abstractrepresentations of the data, have made it possible for artificial neural networks to learn concepts such as object categories directly from raw sensory data.”
BackgroundWatkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Cited by
Items 201–300 of 1,418
Deep learning in medical image registration: a review
Fu, Y., Lei, Y., Wang, T., Curran, W. J., Liu, T., & Yang, X. (2020) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ab843e · Cited by 661
Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks
Nasir, Y. S., & Guo, D. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933973 · Cited by 660
“In addition, by using the limited local CSI and some realistic practical constraints, our deep Q-learning approach usually outperforms the generic WMMSE and FP algorithms which requires the full CSI which is an inapplicable condition.”
BackgroundMethodInfluentialEmergence of Locomotion Behaviours in Rich Environments
Heess, N., TB, D., Sriram, S., Lemmon, J., Merel, J., Wayne, G., Tassa, Y., Erez, T., Wang, Z., Eslami, S. M. A., et al. (2017) · arXiv · doi:10.48550/arxiv.1707.02286 · Cited by 657
Self-citationAntonopoulos, I., Robu, V., Couraud, B., Kirli, D., Norbu, S., Kiprakis, A., Flynn, D., Elizondo-Gonzalez, S., & Wattam, S. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.109899 · Cited by 656
“There is also the combination of deep learning used in conjunction with RL leading to deep reinforcement learning [105].”
Reinforcement learning algorithms: A brief survey
Shakya, A. K., Pillai, G., & Chakrabarty, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120495 · Cited by 656
A Survey of Deep Learning: Platforms, Applications and Emerging Research Trends
Hatcher, W. G., & Yu, W. (2018) · IEEE Access · doi:10.1109/access.2018.2830661 · Cited by 654
“[93] implemented a DQN to play 49 different Atari 2600 videogames, observing four frames as environment data, extracting the game score as reward, with controller and button combinations encoded as actions.”
MethodA review on deep learning in medical image analysis
Suganyadevi, S., Seethalakshmi, V., & Balasamy, K. (2022) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-021-00218-1 · Cited by 653
On-Line Building Energy Optimization Using Deep Reinforcement Learning
Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., & Slootweg, J. G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834219 · Cited by 649
A Survey on quantum computing technology
Gyongyosi, L., & Imre, S. (2019) · Computer Science Review · doi:10.1016/j.cosrev.2018.11.002 · Cited by 646
Challenges of real-world reinforcement learning: definitions, benchmarks and analysis
Dulac-Arnold, G., Levine, N., Mankowitz, D. J., Li, J., Paduraru, C., Gowal, S., & Hester, T. (2021) · Machine Learning · doi:10.1007/s10994-021-05961-4 · Cited by 645
Decentralized non-communicating multiagent collision avoidance with deep reinforcement learning
Chen, Y. F., Liu, M., Everett, M., & How, J. P. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989037 · Cited by 645
Navigating cognition: Spatial codes for human thinking
Bellmund, J. L. S., Gärdenfors, P., Moser, E. I., & Doeller, C. F. (2018) · Science · doi:10.1126/science.aat6766 · Cited by 643
“Replay-inspired simulation of experience has also been used to integrate reinforcement learning and deep neural networks in artificial intelligence (134).”
BackgroundA Comprehensive Overview and Comparative Analysis on Deep Learning Models
Perumal, T., Mustapha, N., Mohamed, R., & Shiri, F. M. (2024) · Journal on artificial intelligence · doi:10.32604/jai.2024.054314 · Cited by 672
“Other common models in deep reinforcement learning include Double DQN [ 91 ], Dueling DQN [ 92 ], and Monte Carlo tree search (MCTS) [ 93 ].”
BackgroundSurvey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehicles
Aradi, S. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3024655 · Cited by 639
Q-Learning Algorithms: A Comprehensive Classification and Applications
Jang, B., Kim, M., Harerimana, G., & Kim, J. W. (2019) · IEEE Access · doi:10.1109/access.2019.2941229 · Cited by 635
Deep Learning based Recommender System: A Survey and New Perspectives
Zhang, S., Yao, L., Sun, A., & Tay, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.07435 · Cited by 635
“Perspectives • 1:5 incepted in Computer Vision and Natural Language Processing domains. However, it has also been an emerging trend in deep recommender system research. DeepReinforcementLearning(DRL)[106]. Reinforcementlearningoperatesonatrial-and-errorparadigm. „e whole framework mainly consists of the following comp…”
BackgroundA programmable diffractive deep neural network based on a digital-coding metasurface array
Liu, C., Ma, Q., Luo, Z. J., Hong, Q. R., Xiao, Q., Zhang, H. C., Miao, L., Yu, W. M., Cheng, Q., Li, L., et al. (2022) · Nature Electronics · doi:10.1038/s41928-022-00719-9 · Cited by 633
“T he development of artificial intelligence (AI) is focused on two main technical areas: computer-based machine learning methods such as deep learning 1 , extreme learning 2 and reinforcement learning 3 , and integrated circuits and optical chips for specific functions 4–7 .”
BackgroundLiu, C. H., Chen, Z., Tang, J., Xu, J., & Piao, C. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2864373 · Cited by 633
“To address the above issues, we propose to leverage emerging deep reinforcement learning (DRL) [4], which has been”
BackgroundMethodDRN: A Deep Reinforcement Learning Framework for News Recommendation
Zheng, G., Zhang, F., Zheng, Z., Xiang, Y., Yuan, N. J., Xie, X., & Li, Z. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3185994 · Cited by 630
Reinforcement Learning in Healthcare: A Survey
Yu, C., Liu, J., Nemati, S., & Yin, G. (2023) · ACM Computing Surveys · doi:10.1145/3477600 · Cited by 628
“games, robotics control, financial and business management, autonomous driving, natural language processing, computer vision, biological data analysis, and art creation, just to name a few [10], [11], [12], [13], [14].”
BackgroundUnity: A General Platform for Intelligent Agents
Juliani, A., Berges, V.-P., Teng, E., Cohen, A., Harper, J., Elion, C., Goy, C., Gao, Y., Henry, H., Mattar, M., et al. (2018) · arXiv · doi:10.48550/arxiv.1809.02627 · Cited by 626
Phan, H., Andreotti, F., Cooray, N., Chen, O. Y., & De Vos, M. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2896659 · Cited by 623
Deep reinforcement learning for cyber security
Nguyen, T. T., & Reddi, V. J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3121870 · Cited by 620
“Typical methods • DQN [28] • Double DQN [45] • Dueling Q-network [46] • Prioritized Replay DQN [63] • TRPO [60] • PPO [61] • Deep Deterministic Policy Gradient (DDPG) [64] • Distributed Distributional DDPG (D4PG) [65] • A3C [48] • Unsupervised Reinforcement and Auxiliary Learning (UNREAL) [66]”
BackgroundMethodInfluentialCAD2RL: Real Single-Image Flight Without a Single Real Image
Sadeghi, F., & Levine, S. (2017) · Robotics: Science and Systems XIII · doi:10.15607/rss.2017.xiii.034 · Cited by 618
Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperation
Zhang, T., McCarthy, Z., Jow, O., Lee, D., Chen, X., Goldberg, K., & Abbeel, P. (2017) · arXiv · doi:10.48550/arxiv.1710.04615 · Cited by 618
Chen, C., Liu, Y., Kreiss, S., & Alahi, A. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8794134 · Cited by 615
Proximal Policy Optimization in StarCraft
Liu, Y. (2025) · doi:10.12794/metadc1505267 · Cited by 615
Distributional Reinforcement Learning With Quantile Regression
Dabney, W., Rowland, M., Bellemare, M., & Munos, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11791 · Cited by 612
Self-citationEnd-to-End Autonomous Driving: Challenges and Frontiers
Chen, L., Wu, P., Chitta, K., Jaeger, B., Geiger, A., & Li, H. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3435937 · Cited by 610
“The success of deep Q networks (DQN) [74] in achieving human-level control on the Atari benchmark [75] has popularized deep RL. DQN trains a neural network called the critic (or Q network), which takes as input the current state and an action, and predicts the discounted return of that action.”
BackgroundDeep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperation
Zhang, T., McCarthy, Z., Jow, O., Lee, D., Chen, X., Goldberg, K., & Abbeel, P. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461249 · Cited by 609
A Tour of Reinforcement Learning: The View from Continuous Control
Recht, B. (2019) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-053018-023825 · Cited by 609
Traffic signal timing via deep reinforcement learning
Li, L., Lv, Y., & Wang, F.-Y. (2016) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2016.7508798 · Cited by 609
Learning Synergies Between Pushing and Grasping with Self-Supervised Deep Reinforcement Learning
Zeng, A., Song, S., Welker, S., Lee, J., Rodriguez, A., & Funkhouser, T. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593986 · Cited by 606
A Deep Reinforcement Learning Network for Traffic Light Cycle Control
Liang, X., Du, X., Wang, G., & Han, Z. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2890726 · Cited by 604
“With the rapid development of deep learning [11], deep neural networks have been employed to deal with the large number of states, which constitutes a deep reinforcement learning model [12].”
MethodAn Introductory Review of Deep Learning for Prediction Models With Big Data
Emmert-Streib, F., Yang, Z., Feng, H., Tripathi, S., & Dehmer, M. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00004 · Cited by 604
Darko, A., Chan, A. P. C., Adabre, M. A., Edwards, D. J., Hosseini, M. R., & Ameyaw, E. E. (2020) · Automation in Construction · doi:10.1016/j.autcon.2020.103081 · Cited by 603
A Learning-Based Incentive Mechanism for Federated Learning
Zhan, Y., Li, P., Qu, Z., Zeng, D., & Guo, S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2967772 · Cited by 602
“Since the action space of the parameter server agent is continuous, there are infinite {state, action} pairs so that they cannot be stored in a tabular form and solve the problem by Q-learning [38], [39].”
BackgroundIntelligent Edge Computing for IoT-Based Energy Management in Smart Cities
Liu, Y., Yang, C., Jiang, L., Xie, S., & Zhang, Y. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800254 · Cited by 595
“In order to train the DNN, we use the same training method as [15].”
MethodApplications of machine learning to diagnosis and treatment of neurodegenerative diseases
Myszczynska, M. A., Ojamies, P. N., Lacoste, A. M. B., Neil, D., Saffari, A., Mead, R., Hautbergue, G. M., Holbrook, J. D., & Ferraiuolo, L. (2020) · Nature Reviews Neurology · doi:10.1038/s41582-020-0377-8 · Cited by 595
Dense reinforcement learning for safety validation of autonomous vehicles
Feng, S., Sun, H., Yan, X., Zhu, H., Zou, Z., Shen, S., & Liu, H. X. (2023) · Nature · doi:10.1038/s41586-023-05732-2 · Cited by 587
Wainberg, M., Merico, D., Delong, A., & Frey, B. J. (2018) · Nature Biotechnology · doi:10.1038/nbt.4233 · Cited by 585
Artificial Intelligence in Advanced Manufacturing: Current Status and Future Outlook
Arinez, J. F., Chang, Q., Gao, R. X., Xu, C., & Zhang, J. (2020) · Journal of Manufacturing Science and Engineering · doi:10.1115/1.4047855 · Cited by 584
“WiththerapidadvancementofRLinrecentyears,agreatdealofnovelalgorithmshaveemerged,includingthedeep Q-network(DQN)[55],whichisabletosolvelarge-scaleRLprob-lemsbyintegratingdeepneuralnetworks(DNN).”
Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems
Tang, M., & Wong, V. W. S. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3036871 · Cited by 584
Towards Explainable Artificial Intelligence
Samek, W., & Müller, K.-R. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_1 · Cited by 580
Learning to reinforcement learn
Wang, J. X., Kurth-Nelson, Z., Tirumala, D., Soyer, H., Leibo, J. Z., Munos, R., Blundell, C., Kumaran, D., & Botvinick, M. (2016) · arXiv · doi:10.48550/arxiv.1611.05763 · Cited by 579
“The resulting deep RL methods are attaining human-and often superhuman-level performance in an expanding list of domains (Jaderberg et al., 2016; Mnih et al., 2015; Silver et al., 2016).”
BackgroundMethodSelf-citationDynamic scheduling for flexible job shop with new job insertions by deep reinforcement learning
Luo, S. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106208 · Cited by 579
Demystifying Parallel and Distributed Deep Learning: An In-depth Concurrency Analysis
Ben-Nun, T., & Hoefler, T. (2020) · ACM Computing Surveys · doi:10.1145/3320060 · Cited by 577
“Summary of Notations Name Definition D Data probability distribution S Training dataset w ∈ H Model parameters. w (t )i denotes parameter i at SGD iteration t fw (z ) Model function (learned predictor) h (z ) Ground-truth label (in Supervised Learning) (w, z ) Per-sample loss function ∇ (w, z ) Gradient of u (д, w, t…”
MethodInfluentialUnsupervised Machine Learning for Networking: Techniques, Applications and Research Challenges
Usama, M., Qadir, J., Raza, A., Arif, H., Yau, K.-L. A., Elkhatib, Y., Hussain, A., & Al-Fuqaha, A. (2019) · IEEE Access · doi:10.1109/access.2019.2916648 · Cited by 575
Rabault, J., Kuchta, M., Jensen, A., Réglade, U., & Cerardi, N. (2019) · Journal of Fluid Mechanics · doi:10.1017/jfm.2019.62 · Cited by 575
Mathematics for Machine Learning
Deisenroth, M. P., Faisal, A. A., & Ong, C. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108679930 · Cited by 573
Liu, Y., Yu, H., Xie, S., & Zhang, Y. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2935450 · Cited by 570
He, Y., Zhao, N., & Yin, H. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2760281 · Cited by 569
Distributed Distributional Deterministic Policy Gradients
Barth-Maron, G., Hoffman, M. W., Budden, D., Dabney, W., Horgan, D., TB, D., Muldal, A., Heess, N., & Lillicrap, T. (2018) · arXiv · doi:10.48550/arxiv.1804.08617 · Cited by 567
Deep learning enabled inverse design in nanophotonics
So, S., Badloe, T., Noh, J., Rho, J., & Bravo‐Abad, J. (2020) · Nanophotonics · doi:10.1515/nanoph-2019-0474 · Cited by 564
Edge Computing with Artificial Intelligence: A Machine Learning Perspective
Hua, H., Li, Y., Wang, T., Dong, N., Li, W., & Cao, J. (2023) · ACM Computing Surveys · doi:10.1145/3555802 · Cited by 563
Learning-Based Computation Offloading for IoT Devices With Energy Harvesting
Min, M., Xiao, L., Chen, Y., Cheng, P., Wu, D., & Zhuang, W. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2890685 · Cited by 560
Spectrum Sharing in Vehicular Networks Based on Multi-Agent Reinforcement Learning
Liang, L., Ye, H., & Li, G. Y. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933962 · Cited by 559
“A fingerprint-based method has been exploited to address nonstationary issues of independent Q-learning for multi-agent RL problems when combined with DQN with experience replay.”
BackgroundMethodInfluentialDream to Control: Learning Behaviors by Latent Imagination
Hafner, D., Lillicrap, T., Ba, J., & Norouzi, M. (2019) · arXiv · doi:10.48550/arxiv.1912.01603 · Cited by 558
“For Atari, we show the final performance of SimPLe (Kaiser et al., 2019), DQN (Mnih et al., 2015) and Rainbow (Hessel et al., 2018) reported by Castro et al. (2018), and for DeepMind Lab that of IMPALA (Espeholt et al., 2018) as a guideline.”
MethodAn explainable deep machine vision framework for plant stress phenotyping
Ghosal, S., Blystone, D., Singh, A. K., Ganapathysubramanian, B., Singh, A., & Sarkar, S. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1716999115 · Cited by 553
Benchmarking Batch Deep Reinforcement Learning Algorithms
Fujimoto, S., Conti, E., Ghavamzadeh, M., & Pineau, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.01708 · Cited by 143
No-Report Paradigms: Extracting the True Neural Correlates of Consciousness
Tsuchiya, N., Wilke, M., Frässle, S., & Lamme, V. A. F. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.10.002 · Cited by 551
Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Review
Cui, Y., Chen, R., Chu, W., Chen, L., Tian, D., Li, Y., & Cao, D. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3023541 · Cited by 550
Fink, O., Wang, Q., Svensén, M., Dersin, P., Lee, W.-J., & Ducoffe, M. (2020) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.103678 · Cited by 549
“Deep reinforcement learning (Mnih et al., 2015) provides potential to adjust to new problems quickly by utilizing experience and knowledge gained from solving old problems.”
BackgroundTask representations in neural networks trained to perform many cognitive tasks
Yang, G. R., Joglekar, M. R., Song, H. F., Newsome, W. T., & Wang, X.-J. (2019) · Nature Neuroscience · doi:10.1038/s41593-018-0310-2 · Cited by 549
Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning
Wan, Z., Li, H., He, H., & Prokhorov, D. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2879572 · Cited by 548
Proceedings of the Genetic and Evolutionary Computation Conference
(2022) · doi:10.1145/3512290 · Cited by 546
Noisy Networks for Exploration
Fortunato, M., Azar, M. G., Piot, B., Menick, J., Osband, I., Graves, A., Mnih, V., Munos, R., Hassabis, D., Pietquin, O., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.10295 · Cited by 543
Self-citationControl of a Quadrotor With Reinforcement Learning
Hwangbo, J., Sa, I., Siegwart, R., & Hutter, M. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2720851 · Cited by 543
Neural network models and deep learning
Kriegeskorte, N., & Golan, T. (2019) · Current Biology · doi:10.1016/j.cub.2019.02.034 · Cited by 543
“Deep neural networks can also be trained by reinforcement (deep reinforcement learning), which has led to impressive performance at playing games and robotic control (Mnih et al., 2015).”
BackgroundDeep learning, reinforcement learning, and world models
Matsuo, Y., LeCun, Y., Sahani, M., Precup, D., Silver, D., Sugiyama, M., Uchibe, E., & Morimoto, J. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.03.037 · Cited by 543
Self-citationViZDoom: A Doom-based AI research platform for visual reinforcement learning
Kempka, M., Wydmuch, M., Runc, G., Toczek, J., & Jaskowski, W. (2016) · 2016 IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2016.7860433 · Cited by 541
40 years of cognitive architectures: core cognitive abilities and practical applications
Kotseruba, I., & Tsotsos, J. K. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-018-9646-y · Cited by 539
Model-Ensemble Trust-Region Policy Optimization
Kurutach, T., Clavera, I., Duan, Y., Tamar, A., & Abbeel, P. (2018) · arXiv · doi:10.48550/arxiv.1802.10592 · Cited by 537
Cognitive computational neuroscience
Kriegeskorte, N., & Douglas, P. K. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0210-5 · Cited by 535
Human-like autonomous car-following model with deep reinforcement learning
Zhu, M., Wang, X., & Wang, Y. (2018) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.10.024 · Cited by 533
Huang, X., Kroening, D., Ruan, W., Sharp, J., Sun, Y., Thamo, E., Wu, M., & Yi, X. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100270 · Cited by 532
From System 1 to System 2: A Survey of Reasoning Large Language Models
Zhang, D., Li, Z., Zhang, M.-L., Zhang, J., Liu, Z., Yao, Y., Xu, H., Zheng, J., Chen, X., Zhang, Y., et al. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3637037 · Cited by 616
The Impact of Artificial Intelligence on the Labor Market
Webb, M. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3482150 · Cited by 531
Experience Replay for Continual Learning
Rolnick, D., Ahuja, A., Schwarz, J., Lillicrap, T. P., & Wayne, G. (2018) · arXiv · doi:10.48550/arxiv.1811.11682 · Cited by 529
“Rehearsing old data via experience replay buffers is a common technique in RL, but such methods have largely been driven by the goal of data-efficient learning on single tasks [7, 16, 20].”
MethodLu, Y., Xu, X., & Wang, L. (2020) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.06.010 · Cited by 528
Exploration by Random Network Distillation
Burda, Y., Edwards, H., Storkey, A., & Klimov, O. (2018) · arXiv · doi:10.48550/arxiv.1810.12894 · Cited by 527
Exploration in deep reinforcement learning: A survey
Ladosz, P., Weng, L., Kim, M., & Oh, H. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.003 · Cited by 525
“impressive performance in Atari games [2], Mujoco simulator [3], controllers tuning [4], autonomous landing [5], self-driving cars [6] and healthcare [7].”
BackgroundDeep reinforcement learning in a handful of trials using probabilistic dynamics models
Chua, K., Calandra, R., McAllister, R., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1805.12114 · Cited by 525
“However, current model-free reinforcement learning algorithms are quite expensive to train, which often limits their application to simulated domains [1], [2], [3], with a few exceptions [4], [5].”
BackgroundSuch, F. P., Madhavan, V., Conti, E., Lehman, J., Stanley, K. O., & Clune, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.06567 · Cited by 525
Mocanu, D. C., Mocanu, E., Stone, P., Nguyen, P. H., Gibescu, M., & Liotta, A. (2018) · Nature Communications · doi:10.1038/s41467-018-04316-3 · Cited by 524
Model-based Reinforcement Learning: A Survey
M. Moerland, T., Broekens, J., Plaat, A., & M. Jonker, C. (2023) · Foundations and Trends in Machine Learning · doi:10.1561/2200000086 · Cited by 524
Practical Block-Wise Neural Network Architecture Generation
Zhong, Z., Yan, J., Wu, W., Shao, J., & Liu, C.-L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00257 · Cited by 522
Task Agnostic Meta-Learning for Few-Shot Learning
Jamal, M. A., & Qi, G.-J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01199 · Cited by 519
“A reinforcement learning task T i is defined as Markov Decision Process that consists of a state space S , an action spaceA, the reward functionR, and state-transition probabilities qi(xt+1|xt, at) where at is the action at time step t [26, 27].”
BackgroundA Realization-Theoretic Foundation for Fault Diagnosis, with Diagnosability Equivalence Predictions
Bronstein, M. M., Bruna, J., Cohen, T., & Veličković, P. (2021) · arXiv (Cornell University) · doi:10.4230/oasics.dx.2026.1 · Cited by 519
Artificial intelligence applications in supply chain management
Pournader, M., Ghaderi, H., Hassanzadegan, A., & Fahimnia, B. (2021) · International Journal of Production Economics · doi:10.1016/j.ijpe.2021.108250 · Cited by 519
A gentle introduction to deep learning in medical image processing
Maier, A., Syben, C., Lasser, T., & Riess, C. (2019) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2018.12.003 · Cited by 515
Baird, A., & Maruping, L. M. (2021) · MIS Quarterly · doi:10.25300/misq/2021/15882 · Cited by 512
A critical review on computer vision and artificial intelligence in food industry
Kakani, V., Nguyen, V. H., Kumar, B. P., Kim, H., & Pasupuleti, V. R. (2020) · Journal of Agriculture and Food Research · doi:10.1016/j.jafr.2020.100033 · Cited by 511
Wang, L., Wang, K., Pan, C., Xu, W., Aslam, N., & Hanzo, L. (2021) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.3027695 · Cited by 510
“During the process of interacting with the environment, the agent aims for selecting the beneficial policy that maximizes the accumulated reward Rt = ∑T i=t γ i−tri , where γ ∈ (0, 1) is the discount factor and T is the number of TSs. Additionally, as a beneficial combination of DNN and RL, the philosophy of DQN [29]…”
BackgroundMethodInfluentialRobust adversarial reinforcement learning
Pinto, L., Davidson, J., Sukthankar, R., & Gupta, A. (2017) · arXiv · doi:10.48550/arxiv.1703.02702 · Cited by 507
The Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities
Floridi, L. (2023) · doi:10.1093/oso/9780198883098.001.0001 · Cited by 507
Deep neural networks for bot detection
Kudugunta, S., & Ferrara, E. (2018) · Information Sciences · doi:10.1016/j.ins.2018.08.019 · Cited by 506
Lesort, T., Lomonaco, V., Stoian, A., Maltoni, D., Filliat, D., & Díaz-Rodríguez, N. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.004 · Cited by 506
Reinforcement Learning based Recommender Systems: A Survey
Afsar, M. M., Crump, T., & Far, B. (2023) · ACM Computing Surveys · doi:10.1145/3543846 · Cited by 502
A Review of Deep Learning Models for Time Series Prediction
Han, Z., Zhao, J., Leung, H., Ma, K. F., & Wang, W. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2923982 · Cited by 501
Metadata
- Authors
- Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S., & Hassabis, D.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Corresponding author
- Kavukcuoglu, Koray
- Hassabis, Demis
- ORCID
- Venue
- Nature
- Published
- 2015-02-25
- Volume
- 518
- Issue
- 7540
- Pages
- 529-533
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2145339207
- Semantic Scholar
- 340f48901f72278f6bf78a04ee5b01df208cc508
- Cited by
- 30,357
- References
- 37
- Citations by year
- 2026: 2851 · 2025: 3619 · 2024: 3335 · 2023: 3592 · 2022: 3367 · 2021: 3971 · 2020: 3466 · 2019: 2907 · 2018: 1776 · 2017: 912 · 2016: 416 · 2015: 132
- FWCI
- 1057.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- DeepMind
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep Q-network, deep reinforcement learning, game-playing agents, end-to-end learning, deep neural network, temporal difference learning, dopaminergic neurons, human-level performance, DeepMind, AlphaGo, AlphaZero
- MeSH terms
- Algorithms, Artificial Intelligence, Humans, Models, Psychological, Reinforcement, Psychology, Reward, Neural Networks, Computer, Video Games
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.