Human-level control through deep reinforcement learning
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
The theory of reinforcement learning provides a normative account, deeply rooted in psychological and neuroscientific perspectives on animal behaviour, of how agents may optimize their control of an environment. To use reinforcement learning successfully in situations approaching real-world complexity, however, agents are confronted with a difficult task: they must derive efficient representations of the environment from high-dimensional sensory inputs, and use these to generalize past experience to new situations. Remarkably, humans and other animals seem to solve this problem through a harmonious combination of reinforcement learning and hierarchical sensory processing systems, the former evidenced by a wealth of neural data revealing notable parallels between the phasic signals emitted by dopaminergic neurons and temporal difference reinforcement learning algorithms. While reinforcement learning agents have achieved some successes in a variety of domains, their applicability has previously been limited to domains in which useful features can be handcrafted, or to domains with fully observed, low-dimensional state spaces. Here we use recent advances in training deep neural networks to develop a novel artificial agent, termed a deep Q-network, that can learn successful policies directly from high-dimensional sensory inputs using end-to-end reinforcement learning. We tested this agent on the challenging domain of classic Atari 2600 games. We demonstrate that the deep Q-networ…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In previous studies, the agents are assumed to act based on simple and heuristic policy functions, and learned in isolated and restricted environments [1][2][3][4][5][6].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [1]
In the citing paper
“This technique was developed in 2013 with Google Deep Mind [55].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [55]
In the citing paper
“Whereas previous reinforcement-learning algorithms often rely only on task-specific learning signals9,10, Dreamer rests predominantly on the unsupervised objective of its world model.”
From Mastering diverse control tasks through world models (2025) · cites this paper as [9]
In the citing paper
“Traditional RL such as AlphaGo Zero and the DQN series (Silver et al., 2017; Mnih et al., 2015; Yue et al., 2023) can continuously improve the performance of a policy in environments like Go and Atari games without an explicit upper bound .”
From Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model? (2025) · cites this paper as Mnih et al., 2015
In the citing paper
“Unlike previous reinforcement learning algorithms that often rely only on task-specific learning signals 7,8 , Dreamer rests predominantly on the unsupervised objective of its world model.”
From Mastering Diverse Domains through World Models (2023) · cites this paper as [7]
24 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“We use one particularly successful architecture, the deep convolutional network 17 , which uses hierarchical layers of tiled convolutional filters tomimictheeffectsofreceptivefields—inspiredbyHubelandWiesel’s seminalworkonfeedforwardprocessinginearlyvisualcortex 18 —thereby…”
Method(2008) · Journal of Machine Learning Research · Cited by 33,051
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
(2010) · International Conference on Machine Learning · Cited by 13,995
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“…4,5 , the former evidenced by a wealth of neural data revealingnotableparallelsbetweenthephasicsignalsemittedbydopa-minergicneuronsandtemporaldifferencereinforcementlearning algorithms 3 .”
BackgroundLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 2×
“Notably, recent advances in deep neural networks 9–11 , in which several layers of nodes areused to buildup progressivelymore abstractrepresentations of the data, have made it possible for artificial neural networks to learn concepts such as object categories directly from raw sensory data.”
BackgroundWatkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Cited by
Items 301–400 of 1,418
Sowmya, R., Premkumar, M., & Jangir, P. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107532 · Cited by 500
Xu, Z., & Saleh, J. H. (2021) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2021.107530 · Cited by 500
Cognitive Mapping and Planning for Visual Navigation
Gupta, S., Davidson, J., Levine, S., Sukthankar, R., & Malik, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.769 · Cited by 500
Deep reinforcement learning based mobile robot navigation: A review
Zhu, K., & Zhang, T. (2021) · Tsinghua Science and Technology · doi:10.26599/tst.2021.9010012 · Cited by 499
Towards Better Analysis of Deep Convolutional Neural Networks
Liu, M., Shi, J., Li, Z., Li, C., Zhu, J., & Liu, S. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2598831 · Cited by 498
VAMPnets for deep learning of molecular kinetics
Mardt, A., Pasquali, L., Wu, H., & Noé, F. (2018) · Nature Communications · doi:10.1038/s41467-017-02388-1 · Cited by 497
“Deep learning has been very successful in a broad range of data analysis and learning problems [49–51].”
BackgroundInterpretable deep learning: interpretation, interpretability, trustworthiness, and beyond
Li, X., Xiong, H., Li, X., Wu, X., Zhang, X., Liu, J., Bian, J., & Dou, D. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01756-8 · Cited by 497
“Deep learning methods have recently enabled RL to decision-making problems that were previously intractable, such as playing games [117, 151, 168] and training robots [10, 99, 100].”
BackgroundTassa, Y., Doron, Y., Muldal, A., Erez, T., Li, Y., Casas, D. D. L., Budden, D., Abdolmaleki, A., Merel, J., Lefrancq, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1801.00690 · Cited by 497
Self-citationQ-Learning: Theory and Applications
Clifton, J., & Laber, E. (2020) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041220 · Cited by 492
A genetic programming approach to designing convolutional neural network architectures
Suganuma, M., Shirakawa, S., & Nagao, T. (2017) · Proceedings of the Genetic and Evolutionary Computation Conference · doi:10.1145/3071178.3071229 · Cited by 491
The Geometry of Abstraction in the Hippocampus and Prefrontal Cortex
Bernardi, S., Benna, M. K., Rigotti, M., Munuera, J., Fusi, S., & Salzman, C. D. (2020) · Cell · doi:10.1016/j.cell.2020.09.031 · Cited by 489
Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks
Wang, J., Jiang, C., Zhang, H., Ren, Y., Chen, K.-C., & Hanzo, L. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2965856 · Cited by 486
Tamar, A., Wu, Y., Thomas, G., Levine, S., & Abbeel, P. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/700 · Cited by 484
Label-Consistent Backdoor Attacks
Turner, A., Tsipras, D., & Mądry, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.02771 · Cited by 38
“1 Introduction Despite the impressive progress of deep learning on challenging benchmarks (Krizhevsky et al., 2012; Graves et al., 2013; Sutskever et al., 2014; Mnih et al., 2015; Silver et al., 2016; He et al., 2016), real-world deployment of such systems remains challenging due to security and reliability concerns.”
BackgroundA review of cooperative multi-agent deep reinforcement learning
Oroojlooy, A., & Hajinezhad, D. (2023) · Applied Intelligence · doi:10.1007/s10489-022-04105-y · Cited by 482
Vlachas, P. R., Pathak, J., Hunt, B. R., Sapsis, T. P., Girvan, M., Ott, E., & Koumoutsakos, P. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.02.016 · Cited by 480
“Some of these advances have been materialized by deploying ML algorithms on dynamic environments such as video games (Ha & Schmidhuber, 2018; Schrittwieser et al., 2019) and simplified physical systems (AI gym) (Brockman et al., 2016; Mnih et al., 2015; Silver et al., 2016).”
BackgroundPesapane, F., Volonté, C., Codari, M., & Sardanelli, F. (2018) · Insights into Imaging · doi:10.1007/s13244-018-0645-y · Cited by 479
Leveraging Demonstrations for Deep Reinforcement Learning on Robotics Problems with Sparse Rewards
Vecerik, M., Hester, T., Scholz, J., Wang, F., Pietquin, O., Piot, B., Heess, N., Rothörl, T., Lampe, T., & Riedmiller, M. (2017) · arXiv · doi:10.48550/arxiv.1707.08817 · Cited by 478
Self-citationDeep Reinforcement Learning for Building HVAC Control
Wei, T., Wang, Y., & Zhu, Q. (2017) · Proceedings of the 54th Annual Design Automation Conference 2017 · doi:10.1145/3061639.3062224 · Cited by 478
Yao, L., Chu, Z., Li, S., Li, Y., Gao, J., & Zhang, A. (2021) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3444944 · Cited by 478
Deep Multi-User Reinforcement Learning for Distributed Dynamic Spectrum Access
Naparstek, O., & Cohen, K. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2879433 · Cited by 477
A Review of Deep Reinforcement Learning for Smart Building Energy Management
Yu, L., Qin, S., Zhang, M., Shen, C., Jiang, T., & Guan, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3078462 · Cited by 476
Brain-inspired replay for continual learning with artificial neural networks
van de Ven, G. M., Siegelmann, H. T., & Tolias, A. S. (2020) · Nature Communications · doi:10.1038/s41467-020-17866-2 · Cited by 474
VIME: Variational Information Maximizing Exploration
Houthooft, R., Chen, X., Duan, Y., Schulman, J., Turck, F. D., & Abbeel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.09674 · Cited by 472
“Examples include acting randomly using (cid:15) -greedy or Boltzmann exploration [7], and utilizing Gaussian noise on the controls in policy gradient methods [8].”
BackgroundMethodPressLight: Learning Max Pressure Control to Coordinate Traffic Signals in Arterial Network
Wei, H., Chen, C., Zheng, G., Wu, K., Gayah, V. V., Xu, K. M., & Li, Z. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330949 · Cited by 472
Deep Reinforcement Learning for Smart Home Energy Management
Yu, L., Xie, W., Xie, D., Zou, Y., Zhang, D., Sun, Z., Zhang, L., Zhang, Y., & Jiang, T. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2957289 · Cited by 471
Machine learning based solutions for security of Internet of Things (IoT): A survey
Tahsien, S. M., Karimipour, H., & Spachos, P. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102630 · Cited by 470
“RL allows the machine to learn from interactions with its environment (like humans do) by performing actions to maximize the total feedback [135], [136].”
BackgroundModel-Based Reinforcement Learning for Atari
Kaiser, L., Babaeizadeh, M., Milos, P., Osinski, B., Campbell, R. H., Czechowski, K., Erhan, D., Finn, C., Kozakowski, P., Levine, S., et al. (2019) · arXiv · doi:10.48550/arxiv.1903.00374 · Cited by 467
“…deep models then enabled RL algorithms to learn to play Atari games directly from images of the game screen, using variants of the DQN algorithm (Mnih et al., 2013; 2015; Hessel et al., 2018) and actor-critic algorithms (Mnih et al., 2016; Schulman et al., 2017; Babaeizadeh et al., 2017b; Wu et…”
MethodZhu, M., Wang, Y., Pu, Z., Hu, J., Wang, X., & Ke, R. (2020) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2020.102662 · Cited by 465
VAMPnets for deep learning of molecular kinetics
Mardt, A., Pasquali, L., Wu, H., & Noé, F. (2018) · RePEc: Research Papers in Economics · doi:10.17169/refubium-964 · Cited by 465
Reinforcement learning for control: Performance, stability, and deep approximators
Buşoniu, L., de Bruin, T., Tolić, D., Kober, J., & Palunko, I. (2018) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2018.09.005 · Cited by 463
“1996; Riedmiller, 2005), with deep networks becoming very popular recently (Mnih et al., 2015).”
BackgroundMethodInfluentialHierarchical Reinforcement Learning: A Comprehensive Survey
Pateria, S., Subagdja, B., Tan, A.-H., & Quek, C. (2022) · ACM Computing Surveys · doi:10.1145/3453160 · Cited by 461
Zhao, N., Liang, Y.-C., Niyato, D., Pei, Y., Wu, M., & Jiang, Y. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2933417 · Cited by 461
Artificial intelligence powers digital medicine
Fogel, A. L., & Kvedar, J. C. (2018) · npj Digital Medicine · doi:10.1038/s41746-017-0012-2 · Cited by 456
The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systems
Dellermann, D., Calma, A., Lipusch, N., Weber, T., Weigel, S., & Ebel, P. (2021) · arXiv · doi:10.48550/arxiv.2105.03354 · Cited by 456
Big data and artificial intelligence modeling for drug discovery
Zhu, H. (2020) · Annual Review of Pharmacology and Toxicology · doi:10.1146/annurev-pharmtox-010919-023324 · Cited by 455
“This approach has become well known, as it has dominated all image recognition challenges since 2012, and it is now the base of image/ speech recognition, video analysis, language understanding, and other relevant applications (131).”
BackgroundDeep Neural Networks as Scientific Models
Cichy, R. M., & Kaiser, D. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.01.009 · Cited by 454
Variational Quantum Circuits for Deep Reinforcement Learning
Chen, S. Y.-C., Yang, C.-H. H., Qi, J., Chen, P.-Y., Ma, X., & Goan, H.-S. (2020) · IEEE Access · doi:10.1109/access.2020.3010470 · Cited by 452
Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
Wang, J., Zhao, L., Liu, J., & Kato, N. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2019.2902661 · Cited by 451
Artificial intelligence in recommender systems
Zhang, Q., Lu, J., & Jin, Y. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-020-00212-w · Cited by 450
“Recently, the combination of deep neural networks and reinforcement learning becomes popular with two well-known and successful works: deep Q-network [58] and AlphaGo [59].”
BackgroundA General Safety Framework for Learning-Based Control in Uncertain Robotic Systems
Fisac, J. F., Akametalu, A. K., Zeilinger, M. N., Kaynama, S., Gillula, J., & Tomlin, C. J. (2019) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2018.2876389 · Cited by 450
Active Object Localization with Deep Reinforcement Learning
Caicedo, J. C., & Lazebnik, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.286 · Cited by 447
Reinforcement learning and episodic memory in humans and animals: an integrative framework
Gershman, S. J., & Daw, N. D. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033625 · Cited by 446
Deep Learning in Mining Biological Data
Mahmud, M., Kaiser, M. S., McGinnity, T. M., & Hussain, A. (2021) · Cognitive Computation · doi:10.1007/s12559-020-09773-x · Cited by 446
Silver, D., Singh, S., Precup, D., & Sutton, R. S. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103535 · Cited by 445
“…encompassing openings, endgames, piece mobility, king safety and so forth [48,44] Reinforcement learning agents that maximise score in Atari 2600 [30] have learned a range of abilities, including aspects of object recognition, localisation, navigation, and motor control demanded by each…”
BackgroundSelf-citationDas, A., Kottur, S., Gupta, K., Singh, A., Yadav, D., Moura, J. M. F., Parikh, D., & Batra, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.121 · Cited by 445
“tion [55], object detection [27] – to ‘high-level’ AI tasks such as learning to play Atari video games [35] and Go [47], answering reading comprehension questions by understanding short stories [15, 57], and even answering questions about images [4, 32, 41] and videos [49, 50]!”
BackgroundDeep Reinforcement Learning from Self-Play in Imperfect-Information Games
Heinrich, J., & Silver, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.01121 · Cited by 125
“Several stable algorithms have previously been proposed for deep reinforcement learning, notably the DQN algorithm (Mnih et al., 2015).”
MethodSelf-citationA Theoretical Analysis of Deep Q-LearningPreprint
Fan, J., Wang, Z., Xie, Y., & Yang, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00137 · Cited by 546
“For example, deep Q-network (DQN) (Mnih et al., 2015) and asynchronous advantage actor-critic (A3C) (Mnih et al., 2016) demonstrate superhuman performance in various applications and become standard algorithms for artificial intelligence.”
BackgroundMethodInfluentialDeep Progressive Reinforcement Learning for Skeleton-Based Action Recognition
Tang, Y., Tian, Y., Lu, J., Li, P., & Zhou, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00558 · Cited by 444
SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence
Fang, W., Chen, Y., Ding, J., Yu, Z., Masquelier, T., Chen, D., Huang, L., Zhou, H., Li, G., & Tian, Y. (2023) · Science Advances · doi:10.1126/sciadv.adi1480 · Cited by 444
A distributional code for value in dopamine-based reinforcement learning
Dabney, W., Kurth-Nelson, Z., Uchida, N., Starkweather, C. K., Hassabis, D., Munos, R., & Botvinick, M. (2020) · Nature · doi:10.1038/s41586-019-1924-6 · Cited by 443
Self-citationWang, C., Wang, J., Shen, Y., & Zhang, X. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2890773 · Cited by 443
Deep Learning for Change Detection in Remote Sensing Images: Comprehensive Review and Meta-Analysis
Khelifi, L., & Mignotte, M. (2020) · IEEE Access · doi:10.1109/access.2020.3008036 · Cited by 441
A comprehensive review of digital twin — part 1: modeling and twinning enabling technologies
Thelen, A., Zhang, X., Fink, O., Lu, Y., Ghosh, S., Youn, B. D., Todd, M. D., Mahadevan, S., Hu, C., & Hu, Z. (2022) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-022-03425-4 · Cited by 441
Experience-driven Networking: A Deep Reinforcement Learning based Approach
Xu, Z., Tang, J., Meng, J., Zhang, W., Wang, Y., Liu, C. H., & Yang, D. (2018) · IEEE INFOCOM 2018 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2018.8485853 · Cited by 439
Generalized cross entropy loss for training deep neural networks with noisy labelsPreprint
Zhang, Z., & Sabuncu, M. R. (2018) · arXiv (Cornell University) · Cited by 1,017
On the Sample Complexity of the Linear Quadratic Regulator
Dean, S., Mania, H., Matni, N., Recht, B., & Tu, S. (2020) · Foundations of Computational Mathematics · doi:10.1007/s10208-019-09426-y · Cited by 436
Semisupervised Deep Reinforcement Learning in Support of IoT and Smart City Services
Mohammadi, M., Al-Fuqaha, A., Guizani, M., & Oh, J.-S. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2712560 · Cited by 435
Deep learning for cardiovascular medicine: a practical primer
Krittanawong, C., Johnson, K. W., Rosenson, R. S., Wang, Z., Aydar, M., Baber, U., Min, J. K., Tang, W. H. W., Halperin, J. L., & Narayan, S. M. (2019) · European Heart Journal · doi:10.1093/eurheartj/ehz056 · Cited by 435
Deep Exploration via Bootstrapped DQN
Osband, I., Blundell, C., Pritzel, A., & Roy, B. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.04621 · Cited by 434
Deep-Reinforcement-Learning-Based Autonomous Voltage Control for Power Grid Operations
Duan, J., Shi, D., Diao, R., Li, H., Wang, Z., Zhang, B., Bian, D., & Yi, Z. (2020) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2019.2941134 · Cited by 434
“The classic DQN method is a value-based DRL formulation [7].”
MethodScalable trust-region method for deep reinforcement learning using Kronecker-factored approximation
Wu, Y., Mansimov, E., Liao, S., Grosse, R., & Ba, J. L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.05144 · Cited by 432
Deep Learning Based Attack Detection for Cyber-Physical System Cybersecurity: A Survey
Zhang, J., Pan, L., Han, Q.-L., Chen, C., Wen, S., & Xiang, Y. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2021.1004261 · Cited by 432
Wu, J., He, H., Peng, J., Li, Y., & Li, Z. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.03.104 · Cited by 431
The hippocampal sharp wave-ripple in memory retrieval for immediate use and consolidation
Joo, H. R., & Frank, L. M. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0077-1 · Cited by 430
Multi-Hop RIS-Empowered Terahertz Communications: A DRL-Based Hybrid Beamforming Design
Huang, C., Yang, Z., Alexandropoulos, G. C., Xiong, K., Wei, L., Yuen, C., Zhang, Z., & Debbah, M. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3071836 · Cited by 430
A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach
Lu, R., Hong, S. H., & Zhang, X. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.03.072 · Cited by 430
Constrained EV Charging Scheduling Based on Safe Deep Reinforcement Learning
Li, H., Wan, Z., & He, H. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2955437 · Cited by 428
Simple Black-box Adversarial Attacks
Guo, C., Gardner, J. R., You, Y., Wilson, A. G., & Weinberger, K. Q. (2019) · arXiv · doi:10.48550/arxiv.1905.07121 · Cited by 427
“For instance, speech recognition systems are trained to maximize the probability of the correct transcription (Amodei et al., 2016), and policy networks (Mnih et al., 2015) are trained to maximize some reward function over the set of actions conditioned on the current environment.”
BackgroundReinforcement Learning Based Routing in Networks: Review and Classification of Approaches
Mammeri, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2913776 · Cited by 427
The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches
Alom, M. Z., Taha, T. M., Yakopcic, C., Westberg, S. K. E., Sidike, P., Nasrin, M. S., Essen, B. C. V., Awwal, A. A. S., & Asari, V. K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.01164 · Cited by 426
“However, the history of the modern DRL revolution began recently from Google Deep Mind in 2013 with Atari games with DRL.”
MethodProcedural Content Generation via Machine Learning (PCGML)
Summerville, A., Snodgrass, S., Guzdial, M., Holmgard, C., Hoover, A. K., Isaksen, A., Nealen, A., & Togelius, J. (2018) · IEEE Transactions on Games · doi:10.1109/tg.2018.2846639 · Cited by 425
Human Digital Twin in the context of Industry 5.0
Wang, B., Zhou, H., Li, X., Yang, G., Zheng, P., Song, C., Yuan, Y., Wuest, T., Yang, H., & Wang, L. (2024) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2023.102626 · Cited by 424
An Actor-Critic Algorithm for Sequence Prediction
Bahdanau, D., Brakel, P., Xu, K., Goyal, A., Lowe, R., Pineau, J., Courville, A., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1607.07086 · Cited by 423
“While RL methods with non-linear function approximators are not new (Tesauro, 1994; Miller et al., 1995), they have recently surged in popularity, giving rise to the field of ‘deep RL’ (Mnih et al., 2015).”
BackgroundMethodSynthetic Data for Deep Learning
Nikolenko, S. I. (2021) · Springer Optimization and Its Applications · doi:10.1007/978-3-030-75178-4 · Cited by 423
“vironments of 2D arcade games, usually classical Atari games [47, 414].”
BackgroundTheories of Error Back-Propagation in the Brain
Whittington, J. C. R., & Bogacz, R. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.12.005 · Cited by 420
Applications of reinforcement learning in energy systems
Perera, A. T. D., & Kamalaruban, P. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110618 · Cited by 420
Arming the public with artificial intelligence to counter social bots
Yang, K., Varol, O., Davis, C. A., Ferrara, E., Flammini, A., & Menczer, F. (2019) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.115 · Cited by 419
“…sequence-to-sequence models for automatic conversations (Li et al., 2015, 2016), deep reinforcement learning for controlling account behaviors (Mnih et al., 2015; He et al., 2016; Serban et al., 2017), and generative adversarial networks for creating fake profile images and content (Goodfellow…”
BackgroundAction-Conditional Video Prediction using Deep Networks in Atari Games
Oh, J., Guo, X., Lee, H., Lewis, R. L., & Singh, S. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.08750 · Cited by 419
Artificial intelligence in radiation oncology
Huynh, E., Hosny, A., Guthier, C., Bitterman, D. S., Petit, S. F., Haas-Kogan, D. A., Kann, B., Aerts, H. J. W. L., & Mak, R. H. (2020) · Nature Reviews Clinical Oncology · doi:10.1038/s41571-020-0417-8 · Cited by 419
“…treatment-planning algorithms to generate a high-quality plan, information regarding the complex decision-making process needs to be included in the underlying model, similar to the approach used in the development of AI algorithms that are able to play Atari games 80 or the board game Go 81 .”
MethodDeep reinforcement learning for page-wise recommendations
Zhao, X., Xia, L., Zhang, L., Ding, Z., Yin, D., & Tang, J. (2018) · Proceedings of the 12th ACM Conference on Recommender Systems · doi:10.1145/3240323.3240374 · Cited by 418
Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networks
Santos, C. F. G. D., & Papa, J. P. (2022) · ACM Computing Surveys · doi:10.1145/3510413 · Cited by 557
“Using an agent trained by the Q-Learning technique [35], it can find out the CNN that can achieve the best result according to some rules.”
MethodChen, X., Qu, G., Tang, Y., Low, S., & Li, N. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3154718 · Cited by 415
Adaptive Power System Emergency Control Using Deep Reinforcement Learning
Huang, Q., Huang, R., Hao, W., Tan, J., Fan, R., & Huang, Z. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2933191 · Cited by 415
Artificial intelligence: foundations of computational agents
(2010) · Choice Reviews Online · doi:10.5860/choice.48-2130 · Cited by 415
Pfeiffer, M., Schaeuble, M., Nieto, J., Siegwart, R., & Cadena, C. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989182 · Cited by 413
A Survey on Vision--Language--Action Models for Embodied AI
Ma, Y., Song, Z., Zhuang, Y., Hao, J., & King, I. (2026) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3650584 · Cited by 484
Artificial intelligence and internet of things in small and medium-sized enterprises: A survey
Hansen, E. B., & Bøgh, S. (2021) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.08.009 · Cited by 407
Photonic Perceptron Based on a Kerr Microcomb for High‐Speed, Scalable, Optical Neural Networks
Xu, X., Tan, M., Corcoran, B., Wu, J., Nguyen, T. G., Boes, A., Chu, S. T., Little, B. E., Morandotti, R., Mitchell, A., et al. (2020) · Laser & Photonics Reviews · doi:10.1002/lpor.202000070 · Cited by 407
“When trained on enough data, ANNs can outperform humans and other computational algorithms [1-5] in tasks ranging from image recognition and language translation to risk evaluation and, interestingly, sophisticated board games [6].”
MethodXia, K., Sacco, C., Kirkpatrick, M., Saidy, C., Nguyen, L., Kircaliali, A., & Harik, R. (2021) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.06.012 · Cited by 406
An algorithmic perspective on imitation learning
Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · Foundations and Trends in Robotics · doi:10.1561/2300000053 · Cited by 405
“For instance, in learning to play Atari games [Mnih et al., 2015] or play Go [Silver et al.”
BackgroundMethodRLBench: The Robot Learning Benchmark & Learning Environment
James, S., Ma, Z., Arrojo, D. R., & Davison, A. J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2974707 · Cited by 405
She, C., Sun, C., Gu, Z., Li, Y., Yang, C., Poor, H. V., & Vucetic, B. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3053601 · Cited by 405
On a Formal Model of Safe and Scalable Self-driving Cars
Shalev‐Shwartz, S., Shammah, S., & Shashua, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.06374 · Cited by 405
Koch, C. P., Boscain, U., Calarco, T., Dirr, G., Filipp, S., Glaser, S. J., Kosloff, R., Montangero, S., Schulte-Herbrüggen, T., Sugny, D., et al. (2022) · EPJ Quantum Technology · doi:10.1140/epjqt/s40507-022-00138-x · Cited by 405
Learning to Poke by Poking: Experiential Learning of Intuitive Physics
Agrawal, P., Nair, A., Abbeel, P., Malik, J., & Levine, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.07419 · Cited by 120
Multi-Agent Reinforcement Learning: A Review of Challenges and Applications
Canese, L., Cardarilli, G. C., Di Nunzio, L., Fazzolari, R., Giardino, D., Re, M., & Spanò, S. (2021) · Applied Sciences · doi:10.3390/app11114948 · Cited by 403
Wang, X., Wang, C., Li, X., Leung, V. C. M., & Taleb, T. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2986803 · Cited by 402
Deep learning in bioinformatics: Introduction, application, and perspective in the big data era
Li, Y., Huang, C., Ding, L., Li, Z., Pan, Y., & Gao, X. (2019) · Methods · doi:10.1016/j.ymeth.2019.04.008 · Cited by 401
Large-Scale Study of Curiosity-Driven Learning
Burda, Y., Edwards, H., Pathak, D., Storkey, A., Darrell, T., & Efros, A. A. (2018) · arXiv · doi:10.48550/arxiv.1808.04355 · Cited by 401
“Most of the success in RL has been achieved when this reward function is dense and well-shaped, e.g., a running “score” in a video game [21].”
Background
Metadata
- Authors
- Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S., & Hassabis, D.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Corresponding author
- Kavukcuoglu, Koray
- Hassabis, Demis
- ORCID
- Venue
- Nature
- Published
- 2015-02-25
- Volume
- 518
- Issue
- 7540
- Pages
- 529-533
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2145339207
- Semantic Scholar
- 340f48901f72278f6bf78a04ee5b01df208cc508
- Cited by
- 30,357
- References
- 37
- Citations by year
- 2026: 2851 · 2025: 3619 · 2024: 3335 · 2023: 3592 · 2022: 3367 · 2021: 3971 · 2020: 3466 · 2019: 2907 · 2018: 1776 · 2017: 912 · 2016: 416 · 2015: 132
- FWCI
- 1057.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- DeepMind
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep Q-network, deep reinforcement learning, game-playing agents, end-to-end learning, deep neural network, temporal difference learning, dopaminergic neurons, human-level performance, DeepMind, AlphaGo, AlphaZero
- MeSH terms
- Algorithms, Artificial Intelligence, Humans, Models, Psychological, Reinforcement, Psychology, Reward, Neural Networks, Computer, Video Games
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.