Human-level control through deep reinforcement learning
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
The theory of reinforcement learning provides a normative account, deeply rooted in psychological and neuroscientific perspectives on animal behaviour, of how agents may optimize their control of an environment. To use reinforcement learning successfully in situations approaching real-world complexity, however, agents are confronted with a difficult task: they must derive efficient representations of the environment from high-dimensional sensory inputs, and use these to generalize past experience to new situations. Remarkably, humans and other animals seem to solve this problem through a harmonious combination of reinforcement learning and hierarchical sensory processing systems, the former evidenced by a wealth of neural data revealing notable parallels between the phasic signals emitted by dopaminergic neurons and temporal difference reinforcement learning algorithms. While reinforcement learning agents have achieved some successes in a variety of domains, their applicability has previously been limited to domains in which useful features can be handcrafted, or to domains with fully observed, low-dimensional state spaces. Here we use recent advances in training deep neural networks to develop a novel artificial agent, termed a deep Q-network, that can learn successful policies directly from high-dimensional sensory inputs using end-to-end reinforcement learning. We tested this agent on the challenging domain of classic Atari 2600 games. We demonstrate that the deep Q-networ…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In previous studies, the agents are assumed to act based on simple and heuristic policy functions, and learned in isolated and restricted environments [1][2][3][4][5][6].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [1]
In the citing paper
“This technique was developed in 2013 with Google Deep Mind [55].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [55]
In the citing paper
“Whereas previous reinforcement-learning algorithms often rely only on task-specific learning signals9,10, Dreamer rests predominantly on the unsupervised objective of its world model.”
From Mastering diverse control tasks through world models (2025) · cites this paper as [9]
In the citing paper
“Traditional RL such as AlphaGo Zero and the DQN series (Silver et al., 2017; Mnih et al., 2015; Yue et al., 2023) can continuously improve the performance of a policy in environments like Go and Atari games without an explicit upper bound .”
From Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model? (2025) · cites this paper as Mnih et al., 2015
In the citing paper
“Unlike previous reinforcement learning algorithms that often rely only on task-specific learning signals 7,8 , Dreamer rests predominantly on the unsupervised objective of its world model.”
From Mastering Diverse Domains through World Models (2023) · cites this paper as [7]
24 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“We use one particularly successful architecture, the deep convolutional network 17 , which uses hierarchical layers of tiled convolutional filters tomimictheeffectsofreceptivefields—inspiredbyHubelandWiesel’s seminalworkonfeedforwardprocessinginearlyvisualcortex 18 —thereby…”
Method(2008) · Journal of Machine Learning Research · Cited by 33,051
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
(2010) · International Conference on Machine Learning · Cited by 13,995
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“…4,5 , the former evidenced by a wealth of neural data revealingnotableparallelsbetweenthephasicsignalsemittedbydopa-minergicneuronsandtemporaldifferencereinforcementlearning algorithms 3 .”
BackgroundLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 2×
“Notably, recent advances in deep neural networks 9–11 , in which several layers of nodes areused to buildup progressivelymore abstractrepresentations of the data, have made it possible for artificial neural networks to learn concepts such as object categories directly from raw sensory data.”
BackgroundWatkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Cited by
Items 901–1,000 of 1,418
An Autonomous Path Planning Model for Unmanned Ships Based on Deep Reinforcement Learning
Guo, S., Zhang, X., Zheng, Y., & Du, Y. (2020) · Sensors · doi:10.3390/s20020426 · Cited by 215
Reinforcement learning for iot security: A comprehensive survey
Uprety, A., & Rawat, D. B. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3040957 · Cited by 214
“The authors proposed DQN based scheme to suggest the SU to take one of the two possible actions.”
Influential(2019) · arXiv (Cornell University) · Cited by 214
Flexible multitask computation in recurrent networks utilizes shared dynamical motifs
Driscoll, L. N., Shenoy, K., & Sussillo, D. (2024) · Nature Neuroscience · doi:10.1038/s41593-024-01668-6 · Cited by 214
“Memory period inputs result in a plane of marginally stable fixed points that maintain the position of the state after stimulus period 1.”
Yan, Y., Chow, A. H. F., Ho, C. P., Kuo, Y.-H., Wu, Q., & Ying, C. (2022) · Transportation Research Part E: Logistics and Transportation Review · doi:10.1016/j.tre.2022.102712 · Cited by 214
Artificial intelligence in ultrasound
Shen, Y.-T., Chen, L., Yue, W.-W., & Xu, H.-X. (2021) · European Journal of Radiology · doi:10.1016/j.ejrad.2021.109717 · Cited by 214
Gunduz, D., de Kerret, P., Sidiropoulos, N. D., Gesbert, D., Murthy, C. R., & van der Schaar, M. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933969 · Cited by 214
“Such framework leads to the so-called reinforcement learning approaches [57] that have been very successfully used in a large number of problems, in particular in combination with deep learning [58].”
BackgroundDeep Reinforcement Learning Method for Demand Response Management of Interruptible Load
Wang, B., Li, Y., Ming, W., & Wang, S. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.2967430 · Cited by 214
“DRL has shown successful performance in playing Atari [17] and Go games [18] in recent years and its success in AlphaGo demonstrates that DRL has become one of the most fascinating research areas in machine learning.”
BackgroundCURL: Contrastive Unsupervised Representations for Reinforcement Learning
Srinivas, A., Laskin, M., & Abbeel, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.04136 · Cited by 213
Automated Speed and Lane Change Decision Making using Deep Reinforcement Learning
Hoel, C.-J., Wolff, K., & Laine, L. (2018) · 2018 21st International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569568 · Cited by 213
“For further details on the DQN algorithm, see [13].”
BackgroundMethodInfluentialLearning to predict the cosmological structure formation
He, S., Li, Y., Feng, Y., Ho, S., Ravanbakhsh, S., Chen, W., & Póczos, B. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1821458116 · Cited by 213
A Survey of Machine Learning for Computer Architecture and Systems
Wu, N., & Xie, Y. (2023) · ACM Computing Surveys · doi:10.1145/3494523 · Cited by 213
“Learning Value-based Q-learning [214] DQN [167]”
Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learning
Lutter, M., Ritter, C., & Peters, J. (2019) · TUbilio (Technical University of Darmstadt) · doi:10.26083/tuprints-00020557 · Cited by 212
Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Images
Watter, M., Springenberg, J. T., Boedecker, J., & Riedmiller, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.07365 · Cited by 212
“[23], who learn deep non-linear Q-functions and Levine et al.”
BackgroundSelf-citationChen, Z., & Wang, X. (2020) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-020-01801-6 · Cited by 212
Memory-based control with recurrent neural networks
Heess, N., Hunt, J. J., Lillicrap, T. P., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1512.04455 · Cited by 211
Self-citationDistort-and-Recover: Color Enhancement Using Deep Reinforcement Learning
Park, J., Lee, J.-Y., Yoo, D., & Kweon, I. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00621 · Cited by 211
DeepWiVe: Deep-Learning-Aided Wireless Video Transmission
Tung, T.-Y., & Gunduz, D. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3191354 · Cited by 211
Prediction of the sequence-specific cleavage activity of Cas9 variants
Kim, N., Kim, H. K., Lee, S., Seo, J. H., Choi, J. W., Park, J., Min, S., Yoon, S., Cho, S.-R., & Kim, H. H. (2020) · Nature Biotechnology · doi:10.1038/s41587-020-0537-9 · Cited by 198
End-to-End Race Driving with Deep Reinforcement Learning
Jaritz, M., de Charette, R., Toromanoff, M., Perot, E., & Nashashibi, F. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460934 · Cited by 210
Causality for Machine Learning
Schölkopf, B. (2022) · Probabilistic and Causal Inference · doi:10.1145/3501714.3501755 · Cited by 209
Neural Approaches to Conversational AI
Gao, J., Galley, M., & Li, L. (2019) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000074 · Cited by 209
Deep Residual Learning in Spiking Neural Networks
Fang, W., Yu, Z., Chen, Y., Huang, T., Masquelier, T., & Tian, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.04159 · Cited by 209
TextWorld: A Learning Environment for Text-Based Games
Côté, M.-A., Kádár, Á., Yuan, X., Kybartas, B., Barnes, T., Fine, E., Moore, J., Hausknecht, M., El Asri, L., Adada, M., et al. (2019) · Communications in Computer and Information Science · doi:10.1007/978-3-030-24337-1_3 · Cited by 209
Transferring End-to-End Visuomotor Control from Simulation to Real World for a Multi-Stage Task
James, S., Davison, A. J., & Johns, E. (2017) · arXiv · doi:10.48550/arxiv.1707.02267 · Cited by 208
Duan, Y., Andrychowicz, M., Stadie, B. C., Ho, J., Schneider, J., Sutskever, I., Abbeel, P., & Zaremba, W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07326 · Cited by 208
“Reinforcement learning has had many successes, including Backgammon [57], helicopter control [39], Atari [35], Go [52], continuous control in simulation [51, 21, 32] and on real robots [40, 30].”
BackgroundEnd-to-End Model-Free Reinforcement Learning for Urban Driving Using Implicit Affordances
Toromanoff, M., Wirbel, E., & Moutarde, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00718 · Cited by 208
Dupoux, E. (2018) · Cognition · doi:10.1016/j.cognition.2017.11.008 · Cited by 208
“…been hitting the headlines with impressive achievements at matching or even beating humans in complex cognitive tasks (playing go or video games: Mnih et al., 2015; Silver et al., 2016; processing speech and natural language: Amodei et al., 2015a; Ferrucci, 2012; recognizing objects and faces:…”
MetricGAN+: An Improved Version of MetricGAN for Speech Enhancement
Fu, S.-W., Yu, C., Hsieh, T.-A., Plantinga, P., Ravanelli, M., Lu, X., & Tsao, Y. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-599 · Cited by 207
Skin Lesion Analyser: An Efficient Seven-Way Multi-class Skin Cancer Classification Using MobileNet
Chaturvedi, S. S., Gupta, K., & Prasad, P. S. (2021) · Advances in Intelligent Systems and Computing · doi:10.1007/978-981-15-3383-9_15 · Cited by 207
A deep-network solution towards model-less obstacle avoidance
Tai, L., Li, S., & Liu, M. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759428 · Cited by 207
“[14] successfully utilized CNN with Q-learning for human-level control.”
MethodFirst-Spike-Based Visual Categorization Using Reward-Modulated STDP
Mozafari, M., Kheradpisheh, S. R., Masquelier, T., Nowzari-Dalini, A., & Ganjtabesh, M. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2826721 · Cited by 207
Wu, J., Huang, Z., Hu, Z., & Lv, C. (2023) · Engineering · doi:10.1016/j.eng.2022.05.017 · Cited by 205
Artificial intelligence in digital twins—A systematic literature review
Kreuzer, T., Papapetrou, P., & Zdravkovic, J. (2024) · Data & Knowledge Engineering · doi:10.1016/j.datak.2024.102304 · Cited by 206
Multi-Agent Deep Reinforcement Learning for Multi-Robot Applications: A Survey
Orr, J., & Dutta, A. (2023) · Sensors · doi:10.3390/s23073625 · Cited by 206
Go-Explore: a New Approach for Hard-Exploration Problems
Ecoffet, A., Huizinga, J., Lehman, J., Stanley, K. O., & Clune, J. (2019) · arXiv · doi:10.48550/arxiv.1901.10995 · Cited by 205
“Comparing sample complexity for RL algorithms trained on Atari games can be tricky due to the common usage of frame skipping [31, 66], wherein a policy only sees and acts every nth (here, 4) frame, and that action is repeated for intervening frames to save the computation of running the policy.”
BackgroundMethodInfluentialQTRAN: Learning to Factorize with Transformation for Cooperative Multi-Agent Reinforcement Learning
Son, K., Kim, D., Kang, W. J., Hostallero, D. E., & Yi, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.05408 · Cited by 205
“where ydqn(r, τ ′;θ−) = r + γQjt(τ ′, ū′;θ−), ū′ = [arg maxui Qi(τ ′ i , ui;θ )]i=1, and θ − are the periodically copied parameters from θ, as in DQN (Mnih et al., 2015).”
BackgroundMethodInfluentialRecent advances in reinforcement learning in finance
Hambly, B., Xu, R., & Yang, H. (2023) · Mathematical Finance · doi:10.1111/mafi.12382 · Cited by 205
Machine Learning for Large-Scale Optimization in 6G Wireless Networks
Shi, Y., Lian, L., Shi, Y., Wang, Z., Zhou, Y., Fu, L., Bai, L., Zhang, J., & Zhang, W. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3300664 · Cited by 205
Convolutional Neural Network Pruning with Structural Redundancy Reduction
Wang, Z., Li, C., & Wang, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01467 · Cited by 205
Fast Sequences of Non-spatial State Representations in Humans
Kurth-Nelson, Z., Economides, M., Dolan, R. J., & Dayan, P. (2016) · Neuron · doi:10.1016/j.neuron.2016.05.028 · Cited by 205
“First, in the context of learning, they may be part of a mechanism for consolidating or maintaining knowledge, particularly in cortex (Káli and Dayan, 2004; Louie and Wilson, 2001; Mnih et al., 2015; Siapas and Wilson, 1998).”
Deep problems with neural network models of human vision
Bowers, J. S., Malhotra, G., Dujmović, M., Llera Montero, M., Tsvetkov, C., Biscione, V., Puebla, G., Adolfi, F., Hummel, J. E., Heaton, R. F., et al. (2023) · Behavioral and Brain Sciences · doi:10.1017/s0140525x22002813 · Cited by 204
Soft Actor-Critic for Discrete Action Settings
Christodoulou, P. (2019) · arXiv · doi:10.48550/arxiv.1910.07207 · Cited by 204
Human–Autonomy Teaming: Definitions, Debates, and Directions
Lyons, J. B., Sycara, K., Lewis, M., & Capiola, A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.589585 · Cited by 204
Valadarsky, A., Schapira, M., Shahaf, D., & Tamar, A. (2017) · Proceedings of the 16th ACM Workshop on Hot Topics in Networks · doi:10.1145/3152434.3152441 · Cited by 204
“Following the recent successes of deep neural networks (DNNs) [28, 38, 41]), we evaluate 3 different DNN architectures.”
MethodGotta Learn Fast: A New Benchmark for Generalization in RL
Nichol, A., Pfau, V., Hesse, C., Klimov, O., & Schulman, J. (2018) · arXiv · doi:10.48550/arxiv.1804.03720 · Cited by 204
Gijsbrechts, J., Boute, R. N., Van Mieghem, J. A., & Zhang, D. J. (2022) · Manufacturing & Service Operations Management · doi:10.1287/msom.2021.1064 · Cited by 203
Deep Reinforcement Learning for Smart Grid Operations: Algorithms, Applications, and Prospects
Li, Y., Yu, C., Shahidehpour, M., Yang, T., Zeng, Z., & Chai, T. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3303358 · Cited by 203
“In conclusion, DQN absorbs the advantages of both DL and RL techniques, which are critical for SG application [38], [39], [40].”
Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis
Ben‐Nun, T., & Hoefler, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09941 · Cited by 203
“Summary of Notations Name Definition D Data probability distribution S Training dataset w ∈ H Model parameters. w (t )i denotes parameter i at SGD iteration t fw (z ) Model function (learned predictor) h (z ) Ground-truth label (in Supervised Learning) (w, z ) Per-sample loss function ∇ (w, z ) Gradient of u (д, w, t…”
MethodInfluentialGregor, K., Rezende, D. J., & Wierstra, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07507 · Cited by 202
“These problems are related to those in deep reinforcement learning (Mnih et al., 2015), where in order to make Q learning work well with function approximation, one needs to store a large number of experiences in memory and replay them.”
BackgroundSelf-citationOptimal control with learned local models: Application to dexterous manipulation
Kumar, V., Todorov, E., & Levine, S. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487156 · Cited by 202
“The idea of learning policies without having models still dominates RL, and forms the basis of the most remarkable success stories, both old [5] and new [6].”
BackgroundEvaluation in artificial intelligence: from task-oriented to ability-oriented measurement
Hernández-Orallo, J. (2017) · Artificial Intelligence Review · doi:10.1007/s10462-016-9505-7 · Cited by 202
Software Engineering Challenges of Deep Learning
Arpteg, A., Brinne, B., Crnkovic-Friis, L., & Bosch, J. (2018) · 2018 44th Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa.2018.00018 · Cited by 201
Li, X., Fang, J., Cheng, W., Duan, H., Chen, Z., & Li, H. (2018) · IEEE Access · doi:10.1109/access.2018.2831240 · Cited by 192
Salvato, E., Fenu, G., Medvet, E., & Pellegrino, F. A. (2021) · IEEE Access · doi:10.1109/access.2021.3126658 · Cited by 200
“We categorise the different TL approaches based on: • the kind of information passed through u , weights of an image processing net, state-control input pairs, policy parameters or even the policy itself); • the transfer timing of u ( k ) exch , either continuous (C-TL) or one shot (1-TL), the latter generally occurri…”
MethodInfluentialDiffusion-Based Reinforcement Learning for Edge-Enabled AI-Generated Content Services
Du, H., Li, Z., Niyato, D., Kang, J., Xiong, Z., Huang, H., & Mao, S. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3356178 · Cited by 200
An artificial agent for robust image registration
Liao, R., Miao, S., De Tournemire, P., Grbic, S., Kamen, A., Mansi, T., & Comaniciu, D. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11230 · Cited by 199
“While RL has been widely studied in game theory, control, operations research, robotics, etc., it is only with the recent breakthroughs in DRL, which combine RL with DNN, that it could be applied to more complex problems, reaching human-level performances (e.g. Atari game (Mnih et al. 2015) and Go (Silver et al. 2016)…”
BackgroundMethodInfluentialdm_control: Software and tasks for continuous control
Tunyasuvunakool, S., Muldal, A., Doron, Y., Liu, S., Bohez, S., Merel, J., Erez, T., Lillicrap, T., Heess, N., & Tassa, Y. (2020) · Software Impacts · doi:10.1016/j.simpa.2020.100022 · Cited by 199
Thinking Fast and Slow with Deep Learning and Tree Search
Anthony, T., Tian, Z., & Barber, D. (2017) · arXiv · doi:10.48550/arxiv.1705.08439 · Cited by 198
“For example DQN [4] can be seen as a special case of ExIt where the expert performs a single-sample single-step lookahead.”
BackgroundBridging the Gap Between Value and Policy Based Reinforcement Learning
Nachum, O., Norouzi, M., Xu, K., & Schuurmans, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.08892 · Cited by 198
Ahmad, S., Shakeel, I., Mehfuz, S., & Ahmad, J. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100568 · Cited by 197
Deep multiagent reinforcement learning: challenges and directions
Wong, A., Bäck, T., Kononova, A. V., & Plaat, A. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10299-x · Cited by 197
“2020) that achieved state-of-the-art performance in Atari, Go, chess and Shogi.”
BackgroundInfluentialLi, Y., Zhuang, Y., Hu, X., Gao, Z., Hu, J., Chen, L., He, Z., Pei, L., Chen, K., Wang, M., et al. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3019199 · Cited by 197
Leveraging Procedural Generation to Benchmark Reinforcement Learning
Cobbe, K., Hesse, C., Hilton, J., & Schulman, J. (2019) · arXiv · doi:10.48550/arxiv.1912.01588 · Cited by 196
Cheng, M., Li, J., & Nazarian, S. (2018) · 2018 23rd Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2018.8297294 · Cited by 196
Artificial Communication? The Production of Contingency by Algorithms
Esposito, E. (2017) · Zeitschrift für Soziologie · doi:10.1515/zfsoz-2017-1014 · Cited by 196
Multi-Task Deep Reinforcement Learning with PopArt
Hessel, M., Soyer, H., Espeholt, L., Czarnecki, W., Schmitt, S., & Van Hasselt, H. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013796 · Cited by 196
Lin, Y., Wang, M., Zhou, X., Ding, G., & Mao, S. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.2973376 · Cited by 196
“Experiments show that DQN exhibits a competitive level comparable to that of human players when solving complex problems such as the Atari 2600 game [25].”
BackgroundOptimal medication dosing from suboptimal clinical examples: a deep reinforcement learning approach
Nemati, S., Ghassemi, M. M., & Clifford, G. D. (2016) · 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7591355 · Cited by 195
“In spite of the great success of deep reinforcement learning in other fields [6], application of this technique to clinical problems has been limited, since large clinical datasets with granular temporal data are often scarce.”
BackgroundMethodInfluentialFlow: A Modular Learning Framework for Mixed Autonomy Traffic
Wu, C., Kreidieh, A. R., Parvate, K., Vinitsky, E., & Bayen, A. M. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3087314 · Cited by 193
Deep reinforcement learning for six degree-of-freedom planetary landing
Gaudet, B., Linares, R., & Furfaro, R. (2020) · Advances in Space Research · doi:10.1016/j.asr.2019.12.030 · Cited by 193
Exploration in Deep Reinforcement Learning: From Single-Agent to Multiagent Domain
Hao, J., Yang, T., Tang, H., Bai, C., Liu, J., Meng, Z., Liu, P., & Wang, Z. (2021) · arXiv · doi:10.48550/arxiv.2109.06668 · Cited by 192
“…Uncertainty Bellman Equation [64] (1-step) DQN [21] 200M (57 games) 776%(mean), 95%(median) Uncertainty Bellman Equation [64] (n-step) DQN [21] 200M (57 games) 440%(mean), 126%(median) A3C + [99] A3C[40] 200M (57 games) 273%(mean), 81%(median) Noisy-Net [133] DQN [21] 200M (55 games)…”
MethodInfluentialSurvey of deep learning for autonomous surface vehicles in marine environments
Qiao, Y., Yin, J., Wang, W., Duarte, F., Yang, J., & Ratti, C. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3235911 · Cited by 192
“DL methods can automatically learn high-level features to react appropriately in complex environments with many constraints [26].”
Sample Efficient Actor-Critic with Experience Replay
Wang, Z., Bapst, V., Heess, N., Mnih, V., Munos, R., Kavukcuoglu, K., & de Freitas, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01224 · Cited by 192
Self-citationAn expectancy value theory (EVT) based instrument for measuring student perceptions of generative AI
Chan, C. K. Y., & Zhou, W. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00284-4 · Cited by 192
“The increasing integration of AI into various industries highlights the growing importance for the future generation to understand and harness its potential and challenges to drive future innovation (Mnih et al., 2015).”
The successor representation: Its computational logic and neural substrates
Gershman, S. J. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0151-18.2018 · Cited by 191
End-to-End Learning of Driving Models with Surround-View Cameras and Route Planners
Hecker, S., Dai, D., & Van Gool, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_27 · Cited by 191
Neuromorphic Computing Based on Wavelength-Division Multiplexing
Xu, X., Han, W., Tan, M., Sun, Y., Li, Y., Wu, J., Morandotti, R., Mitchell, A., Xu, K., & Moss, D. J. (2023) · IEEE Journal of Selected Topics in Quantum Electronics · doi:10.1109/jstqe.2022.3203159 · Cited by 191
“cess in a wide range of applications ranging from image recognition to sophisticated board games [1], [2], [3], [4], [5], [6], [7], [8], [9], [10], due to their capability for learning to be able”
BackgroundQuantum agents in the Gym: a variational quantum algorithm for deep Q-learning
Skolik, A., Jerbi, S., & Dunjko, V. (2022) · Quantum · doi:10.22331/q-2022-05-24-720 · Cited by 191
Virtual screening of inorganic materials synthesis parameters with deep learning
Kim, E., Huang, K., Jegelka, S., & Olivetti, E. (2017) · npj Computational Materials · doi:10.1038/s41524-017-0055-6 · Cited by 190
BoTorch: A Framework for Efficient Monte-Carlo Bayesian Optimization
Balandat, M., Karrer, B., Jiang, D., Daulton, S., Letham, B., Wilson, A. G., & Bakshy, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.06403 · Cited by 190
Mastering diverse control tasks through world models
Hafner, D., Pasukonis, J., Ba, J., & Lillicrap, T. (2025) · Nature · doi:10.1038/s41586-025-08744-2 · Cited by 189
Differentiable MPC for End-to-end Planning and Control
Amos, B., Rodriguez, I. D. J., Sacks, J., Boots, B., & Kolter, J. Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.13400 · Cited by 189
“Farquhar et al. [2017] extends model-free approaches, such as DQN [Mnih et al., 2015] and A3C [Mnih et al., 2016], by planning with a tree-structured neural network to predict the cost-to-go.”
MethodExploration in Deep Reinforcement Learning: From Single-Agent to Multiagent Domain
Hao, J., Yang, T., Tang, H., Bai, C., Liu, J., Meng, Z., Liu, P., & Wang, Z. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3236361 · Cited by 189
“1) Value-Based Methods: Deep Q -network (DQN) [25] is the most representative algorithm in DRL that derived from Q -learning.”
MethodMulti-Modal 3D Object Detection in Autonomous Driving: A Survey
Wang, Y., Mao, Q., Zhu, H., Deng, J., Zhang, Y., Ji, J., Li, H., & Zhang, Y. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01784-z · Cited by 189
Yao, S., Zhao, Y., Zhang, A., Su, L., & Abdelzaher, T. (2017) · Proceedings of the 15th ACM Conference on Embedded Network Sensor Systems · doi:10.1145/3131672.3131675 · Cited by 188
“With the aid of deep neural networks, reinforcement leaning has achieved great success on Atari games [33], Go chess [43], and multichannel access [50].”
MethodLi, C. (2019) · Reinforcement Learning for Cyber-Physical Systems · doi:10.1201/9781351006620-6 · Cited by 188
Reward Machines: Exploiting Reward Function Structure in Reinforcement Learning
Toro Icarte, R., Klassen, T. Q., Valenzano, R., & McIlraith, S. A. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12440 · Cited by 188
The Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2012) · arXiv · doi:10.48550/arxiv.1207.4708 · Cited by 187
Self-citationRobust Deep Reinforcement Learning with Adversarial Attacks
Pattanaik, A., Tang, Z., Liu, S., Bommannan, G., & Chowdhary, G. (2018) · International Joint Conference on Autonomous Agents and Multiagent Systems · doi:10.65109/rnct3583 · Cited by 187
Whale counting in satellite and aerial images with deep learning
Guirado, E., Tabik, S., Rivas, M. L., Alcaraz-Segura, D., & Herrera, F. (2019) · Scientific Reports · doi:10.1038/s41598-019-50795-9 · Cited by 187
“Several studies show that the performance of CNNs can be equal or even better than humans when the quality of the images is good, for instance, for skin cancer detection 54 , mastering the game of Go 55 , or generalizing past experiences to new situations 56 .”
BackgroundChen, X., Wu, C., Chen, T., Zhang, H., Liu, Z., Zhang, Y., & Bennis, M. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2963667 · Cited by 187
Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning
Naderializadeh, N., Sydir, J. J., Simsek, M., & Nikopour, H. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3051163 · Cited by 187
“We consider the following two different types of agents with the (hyper)parameters in Table 1b : • Double Deep-Q Network (DQN) [11], [41]: We consider a double DQN agent, which is a value-based model-free deep RL method.”
BackgroundMethodArtificial-intelligence-driven scanning probe microscopy
Krull, A., Hirsch, P., Rother, C., Schiffrin, A., & Krull, C. (2020) · Communications Physics · doi:10.1038/s42005-020-0317-3 · Cited by 187
“We modi fi ed the double DQN algorithm to suit the requirements of DeepSPM as follows.”
BackgroundMethodInfluentialEkstrom, A. D., Huffman, D. J., & Starrett, M. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00531.2017 · Cited by 186
Deep neural networks in computational neuroscience
Kietzmann, T. C., McClure, P., & Kriegeskorte, N. (2019) · Oxford Research Encyclopedia of Neuroscience · doi:10.1093/acrefore/9780190264086.013.46 · Cited by 186
Actor-Mimic: Deep Multitask and Transfer Reinforcement Learning
Parisotto, E., Ba, J. L., & Salakhutdinov, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06342 · Cited by 186
“Because the state space in the ALE is too large to tractably store a tabular representation of the Q-function, the Deep Q-Network (DQN) approach uses a deep function approximator to represent the state-action value function (Mnih et al., 2015).”
BackgroundMethodInfluentialRen, J., Wang, H., Hou, T., Zheng, S., & Tang, C. (2019) · IEEE Access · doi:10.1109/access.2019.2919736 · Cited by 185
UAV navigation in high dynamic environments: A deep reinforcement learning approach
GUO, T., JIANG, N., LI, B., ZHU, X., WANG, Y., & DU, W. (2021) · Chinese Journal of Aeronautics · doi:10.1016/j.cja.2020.05.011 · Cited by 185
Explainable AI and Reinforcement Learning—A Systematic Review of Current Approaches and Trends
Wells, L., & Bednarz, T. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.550030 · Cited by 185
Metadata
- Authors
- Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S., & Hassabis, D.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Corresponding author
- Kavukcuoglu, Koray
- Hassabis, Demis
- ORCID
- Venue
- Nature
- Published
- 2015-02-25
- Volume
- 518
- Issue
- 7540
- Pages
- 529-533
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2145339207
- Semantic Scholar
- 340f48901f72278f6bf78a04ee5b01df208cc508
- Cited by
- 30,357
- References
- 37
- Citations by year
- 2026: 2851 · 2025: 3619 · 2024: 3335 · 2023: 3592 · 2022: 3367 · 2021: 3971 · 2020: 3466 · 2019: 2907 · 2018: 1776 · 2017: 912 · 2016: 416 · 2015: 132
- FWCI
- 1057.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- DeepMind
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep Q-network, deep reinforcement learning, game-playing agents, end-to-end learning, deep neural network, temporal difference learning, dopaminergic neurons, human-level performance, DeepMind, AlphaGo, AlphaZero
- MeSH terms
- Algorithms, Artificial Intelligence, Humans, Models, Psychological, Reinforcement, Psychology, Reward, Neural Networks, Computer, Video Games
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.