Human-level control through deep reinforcement learning
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
The theory of reinforcement learning provides a normative account, deeply rooted in psychological and neuroscientific perspectives on animal behaviour, of how agents may optimize their control of an environment. To use reinforcement learning successfully in situations approaching real-world complexity, however, agents are confronted with a difficult task: they must derive efficient representations of the environment from high-dimensional sensory inputs, and use these to generalize past experience to new situations. Remarkably, humans and other animals seem to solve this problem through a harmonious combination of reinforcement learning and hierarchical sensory processing systems, the former evidenced by a wealth of neural data revealing notable parallels between the phasic signals emitted by dopaminergic neurons and temporal difference reinforcement learning algorithms. While reinforcement learning agents have achieved some successes in a variety of domains, their applicability has previously been limited to domains in which useful features can be handcrafted, or to domains with fully observed, low-dimensional state spaces. Here we use recent advances in training deep neural networks to develop a novel artificial agent, termed a deep Q-network, that can learn successful policies directly from high-dimensional sensory inputs using end-to-end reinforcement learning. We tested this agent on the challenging domain of classic Atari 2600 games. We demonstrate that the deep Q-networ…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In previous studies, the agents are assumed to act based on simple and heuristic policy functions, and learned in isolated and restricted environments [1][2][3][4][5][6].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [1]
In the citing paper
“This technique was developed in 2013 with Google Deep Mind [55].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [55]
In the citing paper
“Whereas previous reinforcement-learning algorithms often rely only on task-specific learning signals9,10, Dreamer rests predominantly on the unsupervised objective of its world model.”
From Mastering diverse control tasks through world models (2025) · cites this paper as [9]
In the citing paper
“Traditional RL such as AlphaGo Zero and the DQN series (Silver et al., 2017; Mnih et al., 2015; Yue et al., 2023) can continuously improve the performance of a policy in environments like Go and Atari games without an explicit upper bound .”
From Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model? (2025) · cites this paper as Mnih et al., 2015
In the citing paper
“Unlike previous reinforcement learning algorithms that often rely only on task-specific learning signals 7,8 , Dreamer rests predominantly on the unsupervised objective of its world model.”
From Mastering Diverse Domains through World Models (2023) · cites this paper as [7]
24 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“We use one particularly successful architecture, the deep convolutional network 17 , which uses hierarchical layers of tiled convolutional filters tomimictheeffectsofreceptivefields—inspiredbyHubelandWiesel’s seminalworkonfeedforwardprocessinginearlyvisualcortex 18 —thereby…”
Method(2008) · Journal of Machine Learning Research · Cited by 33,051
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
(2010) · International Conference on Machine Learning · Cited by 13,995
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“…4,5 , the former evidenced by a wealth of neural data revealingnotableparallelsbetweenthephasicsignalsemittedbydopa-minergicneuronsandtemporaldifferencereinforcementlearning algorithms 3 .”
BackgroundLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 2×
“Notably, recent advances in deep neural networks 9–11 , in which several layers of nodes areused to buildup progressivelymore abstractrepresentations of the data, have made it possible for artificial neural networks to learn concepts such as object categories directly from raw sensory data.”
BackgroundWatkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Cited by
Items 701–800 of 1,418
Deep Reinforcement Learning-Based Automatic Exploration for Navigation in Unknown Environment
Li, H., Zhang, Q., & Zhao, D. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2927869 · Cited by 261
Huang, L., Feng, X., Zhang, C., Qian, L., & Wu, Y. (2019) · Digital Communications and Networks · doi:10.1016/j.dcan.2018.10.003 · Cited by 261
Reinforcement and Imitation Learning for Diverse Visuomotor Skills
Zhu, Y., Wang, Z., Merel, J., Rusu, A., Erez, T., Cabi, S., Tunyasuvunakool, S., Kramár, J., Hadsell, R., de Freitas, N., et al. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.009 · Cited by 260
Self-citationAhmed, A. A., Sayed, S., Abdoulhalik, A., Moutari, S., & Oyedele, L. (2024) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2024.140715 · Cited by 260
AI-based fog and edge computing: A systematic review, taxonomy and future directions
Iftikhar, S., Gill, S. S., Song, C., Xu, M., Aslanpour, M. S., Toosi, A. N., Du, J., Wu, H., Ghosh, S., Chowdhury, D., et al. (2023) · Internet of Things · doi:10.1016/j.iot.2022.100674 · Cited by 260
“Another work used Deep Q Network (DQN) for making optimal actions on how main tasks will be offloaded and how many processed locally [245].”
MethodChen, P., Pei, J., Lu, W., & Li, M. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.05.006 · Cited by 260
Deep learning for edge computing applications: A State-of-the-Art survey
Wang, F., Zhang, M., Wang, X., Ma, X., & Liu, J. (2020) · IEEE Access · doi:10.1109/access.2020.2982411 · Cited by 259
“The DRL has been successfully applied in many fields, such as computer gaming [7], chess gaming [8] and rate adaptation [50].”
BackgroundMethodGoebel, R., Chander, A., Holzinger, K., Lecue, F., Akata, Z., Stumpf, S., Kieseberg, P., & Holzinger, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-99740-7_21 · Cited by 259
Maximum a Posteriori Policy Optimisation
Abdolmaleki, A., Springenberg, J. T., Tassa, Y., Munos, R., Heess, N., & Riedmiller, M. (2018) · arXiv · doi:10.48550/arxiv.1806.06920 · Cited by 259
“Recent experiments (Mnih et al., 2015; Jader-berg et al., 2016; Heess et al., 2017) successfully combined these algorithms with powerful deep neural-network approximators while benefiting from the increase of compute capacity.”
BackgroundMethodSelf-citationMachine learning in cybersecurity: a comprehensive survey
Dasgupta, D., Akhtar, Z., & Sen, S. (2022) · The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology · doi:10.1177/1548512920951275 · Cited by 259
Li, Y., Wang, R., Li, Y., Zhang, M., & Long, C. (2023) · Applied Energy · doi:10.1016/j.apenergy.2022.120291 · Cited by 259
Artificial intelligence in drug design
Zhong, F., Xing, J., Li, X., Liu, X., Fu, Z., Xiong, Z., Lu, D., Wu, X., Zhao, J., Tan, X., et al. (2018) · Science China Life Sciences · doi:10.1007/s11427-018-9342-2 · Cited by 259
Federated Learning for UAVs-Enabled Wireless Networks: Use Cases, Challenges, and Open Problems
Brik, B., Ksentini, A., & Bouaziz, M. (2020) · IEEE Access · doi:10.1109/access.2020.2981430 · Cited by 258
Anti-Jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach
Liu, X., Xu, Y., Jia, L., Wu, Q., & Anpalagan, A. (2018) · IEEE Communications Letters · doi:10.1109/lcomm.2018.2815018 · Cited by 258
Variational Information Maximisation for Intrinsically Motivated Reinforcement Learning
Mohamed, S., & Rezende, D. J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.08731 · Cited by 258
Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scans
Eftekhar, A., Sax, A., Malik, J., & Zamir, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01061 · Cited by 258
Brandi, S., Piscitelli, M. S., Martellacci, M., & Capozzoli, A. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.110225 · Cited by 258
Agile Autonomous Driving using End-to-End Deep Imitation Learning
Pan, Y., Cheng, C.-A., Saigol, K., Lee, K., Yan, X., Theodorou, E., & Boots, B. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.056 · Cited by 257
Deep Learning for Video Game Playing
Justesen, N., Bontrager, P., Togelius, J., & Risi, S. (2020) · IEEE Transactions on Games · doi:10.1109/tg.2019.2896986 · Cited by 257
Big Data in Earth system science and progress towards a digital twin
Li, X., Feng, M., Ran, Y., Su, Y., Liu, F., Huang, C., Shen, H., Xiao, Q., Su, J., Yuan, S., et al. (2023) · Nature Reviews Earth & Environment · doi:10.1038/s43017-023-00409-w · Cited by 257
A Gentle Introduction to Reinforcement Learning and its Application in Different Fields
Naeem, M., Rizvi, S. T. H., & Coronato, A. (2020) · IEEE Access · doi:10.1109/access.2020.3038605 · Cited by 257
QTune: a query-aware database tuning system with deep reinforcement learning
Li, G., Zhou, X., Li, S., & Gao, B. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3352063.3352129 · Cited by 257
Deep reinforcement learning for power system: An overview
(2019) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2019.00920 · Cited by 256
Reconciling deep learning with symbolic artificial intelligence: representing objects and relations
Garnelo, M., & Shanahan, M. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.12.010 · Cited by 255
“Its notable successes include commercially important applications, such as image captioning (e.g. [3,4]) and machine translation (e.g. [5 ]), and it has been fruitfully combined with reinforcement learning in the context of robotics [6], video games [7], and the game of Go [8].”
BackgroundMahboob, S., & Liu, L. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3347145 · Cited by 255
Deep Learning Approaches to Grasp Synthesis: A Review
Newbury, R., Gu, M., Chumbley, L., Mousavian, A., Eppner, C., Leitner, J., Bohg, J., Morales, A., Asfour, T., Kragic, D., et al. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3280597 · Cited by 255
A review of motion planning algorithms for intelligent robots
Zhou, C., Huang, B., & Fränti, P. (2022) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-021-01867-z · Cited by 255
“AbreakthroughwasmadewhenGoogleDeepMind introduced nature DQN (Mnih et al., 2013, 2015), in which reply buffer is to reuse old data to improve the efficiency.”
BackgroundZhao, T., & Eskenazi, M. (2016) · Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/w16-3601 · Cited by 255
“The deep Q-Network (DQN) introduced by Mnih (2015) uses a deep neural network (DNN) to parametrize the Q-value function Q ( s, a ; θ ) and achieves human-level performance in playing many Atari games.”
MethodCombining self-supervised learning and imitation for vision-based rope manipulation
Nair, A., Chen, D., Agrawal, P., Isola, P., Abbeel, P., Malik, J., & Levine, S. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989247 · Cited by 255
“Impressive results have been obtained on playing Atari games [10], a large suite of robotic tasks in simulation [11], [12], [13], [14], [15], [16] and real world robotic manipulation tasks involving rigid objects in controlled settings [17], [18].”
BackgroundDynamic multi-objective scheduling for flexible job shop by deep reinforcement learning
Luo, S., Zhang, L., & Fan, Y. (2021) · Computers & Industrial Engineering · doi:10.1016/j.cie.2021.107489 · Cited by 255
Classic Meets Modern: a Pragmatic Learning-Based Congestion Control for the Internet
Abbasloo, S., Yen, C.-Y., & Chao, H. J. (2020) · Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication · doi:10.1145/3387514.3405892 · Cited by 255
Du, H., Zhang, R., Liu, Y., Wang, J., Lin, Y., Li, Z., Niyato, D., Kang, J., Xiong, Z., Cui, S., et al. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3400011 · Cited by 254
A novel DDPG method with prioritized experience replay
Hou, Y., Liu, L., Wei, Q., Xu, X., & Chen, C. (2017) · 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC) · doi:10.1109/smc.2017.8122622 · Cited by 254
Yang, Q., Zhang, Y., Dai, W., & Pan, S. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781139061773 · Cited by 254
Computational mechanisms of curiosity and goal-directed exploration
Schwartenbeck, P., Passecker, J., Hauser, T. U., FitzGerald, T. H., Kronbichler, M., & Friston, K. J. (2019) · eLife · doi:10.7554/elife.41703 · Cited by 254
“This is motivated by a characteristic failure of ‘deep reinforcement learning’ models in tasks that require goal-directed exploratory behaviour, such as the Atari game Montezuma’s revenge ( Burda et al., 2018b ; Mnih et al., 2015 ).”
BackgroundWang, J., Hu, J., Min, G., Zhan, W., Ni, Q., & Georgalas, N. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1800971 · Cited by 254
“One typical value-based method is deep Q-Learning [12].”
MethodA Survey on Deep Reinforcement Learning Algorithms for Robotic Manipulation
Han, D., Mulyana, B., Stankovic, V., & Cheng, S. (2023) · Sensors · doi:10.3390/s23073762 · Cited by 253
“Deep deterministic policy gradient (DDPG) [26] is a reinforcement learning technique that combines both deep Q-learning (DQN) [27] and deterministic policy gradients (DPG) [28].”
BackgroundA Review on Recent Advances in Vision-based Defect Recognition towards Industrial Intelligence
Gao, Y., Li, X., Wang, X. V., Wang, L., & Gao, L. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2021.05.008 · Cited by 253
Gandhi, D., Pinto, L., & Gupta, A. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206247 · Cited by 253
Machine learning for quantum matter
Carrasquilla, J. (2020) · Advances in Physics X · doi:10.1080/23746149.2020.1797528 · Cited by 311
Data-Efficient Reinforcement Learning with Self-Predictive Representations
Schwarzer, M., Anand, A., Goel, R., Hjelm, R. D., Courville, A. C., & Bachman, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05929 · Cited by 46
“A prominent method for solving Atari, Deep Q Networks (Mnih et al., 2015), trains a neural network Q θ to approximate the agent’s current Q-function (policy evaluation) while updating the agent’s policy greedily with respect to this Q-function (policy improvement).”
BackgroundMethodInfluentialLearning how to Active Learn: A Deep Reinforcement Learning Approach
Fang, M., Li, Y., & Cohn, T. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1063 · Cited by 252
“We use a deep Q-learning approach (Mnih et al., 2015), which formalises the policy using function Qπ(s, a)→ Rwhich determines the utility of taking a from state s according to a policy π.”
BackgroundMethodInfluentialGradient-Based Attribution Methods
Ancona, M., Ceolini, E., Öztireli, C., & Gross, M. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_9 · Cited by 252
“Machine Learning has demonstrated huge potential in solving a variety of problems, mostly thanks to numerous ground-breaking results with Deep Neural Networks (DNNs) [12, 14, 17, 29, 36].”
BackgroundApplications of Multi-Agent Reinforcement Learning in Future Internet: A Comprehensive Survey
Li, T., Zhu, K., Luong, N. C., Niyato, D., Wu, Q., Zhang, Y., & Chen, B. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3160697 · Cited by 251
Zhao, Y., Qi, X., Ma, Y., Li, Z., Malekian, R., & Sotelo, M. A. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2989352 · Cited by 251
Optimal VNF Placement via Deep Reinforcement Learning in SDN/NFV-Enabled Networks
Pei, J., Hong, P., Pan, M., Liu, J., & Zhou, J. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2959181 · Cited by 251
“Today, Deep Reinforcement Learning (DRL) has made significant breakthroughs and impacted various domains like control theory and strategic game playing [15], [16], which is expected to enlighten the solution to our VNF placement problem as well.”
BackgroundSafe Exploration in Continuous Action Spaces
Dalal, G., Dvijotham, K., Vecerík, M., Hester, T., Păduraru, C., & Tassa, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.08757 · Cited by 250
Chen, X., Li, B., Proietti, R., Lu, H., Zhu, Z., & Yoo, S. J. B. (2019) · Journal of Lightwave Technology · doi:10.1109/jlt.2019.2923615 · Cited by 250
“In the meantime, recent advances in deep reinforcement learning (DRL) have demonstrated beyond human-level performance in handling large-scale online control tasks [16], [17].”
BackgroundReinforced model predictive control (RL-MPC) for building energy management
Arroyo, J., Manna, C., Spiessens, F., & Helsen, L. (2022) · Applied Energy · doi:10.1016/j.apenergy.2021.118346 · Cited by 249
A Review of Physics-Informed Machine Learning in Fluid Mechanics
Sharma, P., Chung, W. T., Akoush, B., & Ihme, M. (2023) · Energies · doi:10.3390/en16052343 · Cited by 248
Autonomous algorithmic collusion: Q‐learning under sequential pricing
Klein, T. (2021) · The RAND Journal of Economics · doi:10.1111/1756-2171.12383 · Cited by 248
Action Branching Architectures for Deep Reinforcement Learning
Tavakoli, A., Pardo, F., & Kormushev, P. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11798 · Cited by 248
Dealing with Non-Stationarity in Multi-Agent Deep Reinforcement LearningPreprint
Papoudakis, G., Christianos, F., Rahman, A., & Albrecht, S. V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.04737 · Cited by 307
“Thus, deep networks have been used (Mnih et al. , 2015) to address this issue.”
BackgroundMethodInfluentialYodaNN: An Architecture for Ultralow Power Binary-Weight CNN Acceleration
Andri, R., Cavigelli, L., Rossi, D., & Benini, L. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2682138 · Cited by 247
“On the other hand, sourcing out all CNN computation from IoT end-nodes to data servers is extremely challenging and power consuming, due to the large communication bandwidth required to transmit the data streams.”
BackgroundMastering Atari with Discrete World Models
Hafner, D., Lillicrap, T., Norouzi, M., & Ba, J. (2020) · arXiv · doi:10.48550/arxiv.2010.02193 · Cited by 247
“The well-established Atari benchmark (Bellemare et al., 2013) historically required model-free algorithms to achieve human-level performance, such as DQN (Mnih et al., 2015), A3C (Mnih et al., 2016), or Rainbow (Hessel et al., 2018).”
MethodInfluentialRay: A Distributed Framework for Emerging AI Applications
Moritz, P., Nishihara, R., Wang, S. F., Tumanov, A., Liaw, R., Liang, E., Elibol, M., Yang, Z., Paul, W., Jordan, M. I., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.05889 · Cited by 247
Concise deep reinforcement learning obstacle avoidance for underactuated unmanned marine vessels
Cheng, Y., & Zhang, W. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.06.066 · Cited by 247
Deep reinforcement learning-based controller for path following of an unmanned surface vehicle
Woo, J., Yu, C., & Kim, N. (2019) · Ocean Engineering · doi:10.1016/j.oceaneng.2019.04.099 · Cited by 246
Artificial intelligence for aging and longevity research: Recent advances and perspectives
Zhavoronkov, A., Mamoshina, P., Vanhaelen, Q., Scheibye-Knudsen, M., Moskalev, A., & Aliper, A. (2019) · Ageing Research Reviews · doi:10.1016/j.arr.2018.11.003 · Cited by 246
“, 2015) and RL in video games (Mnih et al., 2015) is rapidly propagating into aging research.”
Review of Deep Reinforcement Learning for Robot Manipulation
Nguyen, H., & La, H. (2019) · 2019 Third IEEE International Conference on Robotic Computing (IRC) · doi:10.1109/irc.2019.00120 · Cited by 246
Reinforcement learning in urban network traffic signal control: A systematic literature review
Noaeen, M., Naik, A., Goodman, L., Crebo, J., Abrar, T., Abad, Z. S. H., Bazzan, A. L. C., & Far, B. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116830 · Cited by 246
Modality specific U-Net variants for biomedical image segmentation: a survey
Punn, N. S., & Agarwal, S. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10152-1 · Cited by 246
Ale, L., Zhang, N., Fang, X., Chen, X., Wu, S., & Li, L. (2021) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2021.3066619 · Cited by 246
Artificial Intelligence in Pathology
Chang, H. Y., Jung, C. K., Woo, J. I., Lee, S., Cho, J., Kim, S. W., & Kwak, T.-Y. (2019) · Journal of Pathology and Translational Medicine · doi:10.4132/jptm.2018.12.16 · Cited by 246
“In 2015, Google DeepMind published a paper about an AI that could learn a human-level control of several Atari 2600 games by trial and error, 9 which inspired the AI research community with the idea of deep reinforcement learning.”
BackgroundDeep learning and radiomics in precision medicine
Parekh, V. S., & Jacobs, M. A. (2019) · Expert Review of Precision Medicine and Drug Development · doi:10.1080/23808993.2019.1585805 · Cited by 246
Control of synaptic plasticity in deep cortical networks
Roelfsema, P. R., & Holtmaat, A. (2018) · Nature Reviews Neuroscience · doi:10.1038/nrn.2018.6 · Cited by 246
Ju, Y., Chen, Y., Cao, Z., Liu, L., Pei, Q., Xiao, M., Ota, K., Dong, M., & Leung, V. C. M. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3242997 · Cited by 245
Rodrigues, T. K., Suto, K., Nishiyama, H., Liu, J., & Kato, N. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2943405 · Cited by 245
Averaged-DQN: Variance Reduction and Stabilization for Deep Reinforcement Learning
Anschel, O., Baram, N., & Shimkin, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01929 · Cited by 147
Incremental Learning Through Deep Adaptation
Rosenfeld, A., & Tsotsos, J. K. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2884462 · Cited by 244
Recurrent neural networks as versatile tools of neuroscience research
Barak, O. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.06.003 · Cited by 244
MINOS: Multimodal Indoor Simulator for Navigation in Complex Environments
Savva, M., Chang, A. X., Dosovitskiy, A., Funkhouser, T. A., & Koltun, V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.03931 · Cited by 127
Global Convergence of Policy Gradient Methods for the Linear Quadratic Regulator
Fazel, M., Ge, R., Kakade, S. M., & Mesbahi, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05039 · Cited by 243
A Survey on Imitation Learning Techniques for End-to-End Autonomous Vehicles
Le Mero, L., Yi, D., Dianati, M., & Mouzakitis, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3144867 · Cited by 243
Artificial intelligence in reproductive medicine
Wang, R., Pan, W., Jin, L., Li, Y., Geng, Y., Gao, C., Chen, G., Wang, H., Ma, D., & Liao, S. (2019) · Reproduction · doi:10.1530/rep-18-0523 · Cited by 243
Deep Variation-Structured Reinforcement Learning for Visual Relationship and Attribute Detection
Liang, X., Lee, L., & Xing, E. P. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.469 · Cited by 243
Cambricon: an instruction set architecture for neural networks
Liu, S., Du, Z., Tao, J., Han, D., Luo, T., Xie, Y., Chen, Y., & Chen, T. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001179 · Cited by 243
Control of Memory, Active Perception, and Action in Minecraft
Oh, J., Chockalingam, V., Singh, S. P., & Lee, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.09128 · Cited by 157
Liu, B., Wang, L., & Liu, M. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2931179 · Cited by 242
“To make the robot learn to navigate, we adopt a reinforcement learning perspective, which is built on recent success of deep RL algorithms for solving challenging control tasks [12]–[15].”
MethodLearning by Playing - Solving Sparse Reward Tasks from Scratch
Riedmiller, M., Hafner, R., Lampe, T., Neunert, M., Degrave, J., Van de Wiele, T., Mnih, V., Heess, N., & Springenberg, J. T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.10567 · Cited by 242
Self-citationData-driven science and engineering : machine learning, dynamical systems, and control
Brunton, S. L., & Kutz, J. N. (2019) · doi:10.1017/978-1-009-08951-7 · Cited by 242
A scheduling scheme in the cloud computing environment using deep Q-learning
Tong, Z., Chen, H., Deng, X., Li, K., & Li, K. (2020) · Information Sciences · doi:10.1016/j.ins.2019.10.035 · Cited by 242
Ye, Y., Qiu, D., Wu, X., Strbac, G., & Ward, J. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.2976771 · Cited by 242
Generalization guides human exploration in vast decision spaces
Wu, C. M., Schulz, E., Speekenbrink, M., Nelson, J. D., & Meder, B. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0467-4 · Cited by 242
Glavic, M., Fonteneau, R., & Ernst, D. (2017) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2017.08.1217 · Cited by 241
Analysing Mathematical Reasoning Abilities of Neural Models
Saxton, D., Grefenstette, E., Hill, F., & Kohli, P. (2019) · arXiv · doi:10.48550/arxiv.1904.01557 · Cited by 241
Peng, P., Wen, Y., Yang, Y., Yuan, Q., Tang, Z., Long, H., & Wang, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10069 · Cited by 241
“As the flourishes of deep reinforcement learning (DRL) [5, 17, 6], researchers start to shed light on tackling multiagent problems [18–22] with the enhanced learning capabilities.”
BackgroundInfluentialBao: Making Learned Query Optimization Practical
Marcus, R., Negi, P., Mao, H., Tatbul, N., Alizadeh, M., & Kraska, T. (2021) · Proceedings of the 2021 International Conference on Management of Data · doi:10.1145/3448016.3452838 · Cited by 241
Deep Learning Algorithms for Cybersecurity Applications: A Technological and Status Review
Dixit, P., & Silakari, S. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2020.100317 · Cited by 241
Zhao, X., Wang, L., Zhou, Y., Pan, B., Wang, R., Wang, L., & Yan, X. (2022) · Energy Conversion and Management · doi:10.1016/j.enconman.2022.116179 · Cited by 241
Research on Adaptive Job Shop Scheduling Problems Based on Dueling Double DQN
Han, B.-A., & Yang, J.-J. (2020) · IEEE Access · doi:10.1109/access.2020.3029868 · Cited by 241
“DRL [58], [59] is a new algorithm which combines deep learning with RL and realizes the end-to-end learning from perception to action.”
BackgroundHu, H., Jia, X., He, Q., Fu, S., & Liu, K. (2020) · Computers & Industrial Engineering · doi:10.1016/j.cie.2020.106749 · Cited by 241
A Deep Q-Network for the Beer Game: Deep Reinforcement Learning for Inventory Optimization
Oroojlooyjadid, A., Nazari, M., Snyder, L. V., & Takáč, M. (2022) · Manufacturing & Service Operations Management · doi:10.1287/msom.2020.0939 · Cited by 240
Toward Intelligent Vehicular Networks: A Machine Learning Framework
Liang, L., Ye, H., & Li, G. Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2872122 · Cited by 240
Consumer engagement via interactive artificial intelligence and mixed reality
Sung, E. (., Bae, S., Han, D.-I. D., & Kwon, O. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2021.102382 · Cited by 240
GAN-Powered Deep Distributional Reinforcement Learning for Resource Management in Network Slicing
Hua, Y., Li, R., Zhao, Z., Chen, X., & Zhang, H. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2959185 · Cited by 240
Deep Deterministic Policy Gradient for Urban Traffic Light ControlPreprint
Casas, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.09035 · Cited by 282
Learning to Optimize Join Queries With Deep Reinforcement Learning
Krishnan, S., Yang, Z., Goldberg, K., Hellerstein, J. M., & Stoica, I. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.03196 · Cited by 83
Reinforcement Learning Based EV Charging Management Systems–A Review
Abdullah, H. M., Gastli, A., & Ben-Brahim, L. (2021) · IEEE Access · doi:10.1109/access.2021.3064354 · Cited by 239
Seid, A. M., Boateng, G. O., Anokye, S., Kwantwi, T., Sun, G., & Liu, G. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3063188 · Cited by 239
Metadata
- Authors
- Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S., & Hassabis, D.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Corresponding author
- Kavukcuoglu, Koray
- Hassabis, Demis
- ORCID
- Venue
- Nature
- Published
- 2015-02-25
- Volume
- 518
- Issue
- 7540
- Pages
- 529-533
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2145339207
- Semantic Scholar
- 340f48901f72278f6bf78a04ee5b01df208cc508
- Cited by
- 30,357
- References
- 37
- Citations by year
- 2026: 2851 · 2025: 3619 · 2024: 3335 · 2023: 3592 · 2022: 3367 · 2021: 3971 · 2020: 3466 · 2019: 2907 · 2018: 1776 · 2017: 912 · 2016: 416 · 2015: 132
- FWCI
- 1057.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- DeepMind
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep Q-network, deep reinforcement learning, game-playing agents, end-to-end learning, deep neural network, temporal difference learning, dopaminergic neurons, human-level performance, DeepMind, AlphaGo, AlphaZero
- MeSH terms
- Algorithms, Artificial Intelligence, Humans, Models, Psychological, Reinforcement, Psychology, Reward, Neural Networks, Computer, Video Games
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.