PreprintCited by 9,471Reinforcement Learning in RoboticsArtificial Intelligence in GamesArtificial Intelligence Applications

The DOI matches its DataCite record; 31 of the 31 references it cites were found in a registry or an index.

Playing Atari with Deep Reinforcement Learning

Open access

Mnih, Volodymyr, Kavukcuoglu, Koray, Silver, David, Graves, Alex, Antonoglou, Ioannis, Wierstra, Daan, Riedmiller, Martin·2013·arXiv

DOI 10.48550/arxiv.1312.5602arXiv 1312.5602

Open this paper in CoChat — free account Open PDF

Abstract

We present the first deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is a convolutional neural network, trained with a variant of Q-learning, whose input is raw pixels and whose output is a value function estimating future rewards. We apply our method to seven Atari 2600 games from the Arcade Learning Environment, with no adjustment of the architecture or learning algorithm. We find that it outperforms all previous approaches on six of the games and surpasses a human expert on three of them.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1312.5602

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
Untitled work
(2010) · International Conference on Machine Learning · Cited by 13,995
Q-learning
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Self-citation
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL · doi:10.5555/303568.303704 · Cited by 4,646
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
The Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3912 · Cited by 2,161
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Self-citation

Show all 29 references

Sorted by citations

Items 101–200 of 1,061

Learning deep control policies for autonomous aerial vehicles with MPC-guided policy search
Zhang, T., Kahn, G., Levine, S., & Abbeel, P. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487175 · Cited by 452
“More recently, deep neural network policies have been used for tasks ranging from robotic control [22], [23] to video game playing [27].”
Method
Deep reinforcement learning for page-wise recommendations
Zhao, X., Xia, L., Zhang, L., Ding, Z., Yin, D., & Tang, J. (2018) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3240323.3240374 · Cited by 447
Applications of reinforcement learning in energy systems
Perera, A. T. D., & Kamalaruban, P. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110618 · Cited by 457
Multi-Hop Knowledge Graph Reasoning with Reward Shaping
Lin, X., Socher, R., & Xiong, C. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1362 · Cited by 428
A digital twin to train deep reinforcement learning agent for smart manufacturing plants: Environment, interfaces and intelligence
Xia, K., Sacco, C., Kirkpatrick, M. B., Saidy, C., Nguyen, L., Kircaliali, A., & Harik, R. (2020) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.06.012 · Cited by 444
Single and multi-agent deep reinforcement learning for AI-enabled wireless networks: A tutorial
Feriani, A., & Hossain, E. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3063822 · Cited by 410
A Review of the Application of Machine Learning and Data Mining Approaches in Continuum Materials Mechanics
Bock, F. E., Aydin, R. C., Cyron, C. J., Huber, N. W., Kalidindi, S. R., & Klusemann, B. (2019) · Frontiers in Materials · doi:10.3389/fmats.2019.00110 · Cited by 433
Autonomous experimentation systems for materials development: A community perspective
Stach, E. A., DeCost, B., Kusne, A. G., Hattrick-Simpers, J. R., Brown, K. A., Reyes, K. G., Schrier, J., Billinge, S. J. L., Buonassisi, T., Foster, I. T., et al. (2021) · Matter · doi:10.1016/j.matt.2021.06.036 · Cited by 456
Deep Learning for Intelligent Transportation Systems: A Survey of Emerging Trends
Veres, M., & Moussa, M. A. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2929020 · Cited by 416
Top-K Off-Policy Correction for a REINFORCE Recommender System
Chen, M., Beutel, A., Covington, P., Jain, S. C., Belletti, F., & Ed, H. (2019) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3289600.3290999 · Cited by 430
Gradient based sample selection for online continual learningPreprint
Aljundi, R., Lin, M., Goujaud, B., & Bengio, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.08671 · Cited by 397
Recommendations with Negative Feedback via Pairwise Deep Reinforcement Learning
Zhao, X., Zhang, L., Ding, Z., Xia, L., Tang, J., & Yin, D. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219886 · Cited by 407
Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learning
Henderson, P., Hu, J., Romoff, J., Brunskill, E., Jurafsky, D., & Pineau, J. (2020) · arXiv · doi:10.48550/arxiv.2002.05651 · Cited by 393
“We populate the leaderboard for two common RL benchmarking environments, PongNoFrameskip-v4 and BreakNoFrameskip-v4 (Bellemare et al., 2013; Brockman et al., 2016; Mnih et al., 2013), and four baseline algorithms, PPO (Schulman et al., 2017), A2C (Mnih et al., 2016), A2C with V-Traces (Espeholt et al., 2018; Dalton et…”
MethodInfluential
Hybrid-augmented intelligence: collaboration and cognition
Zheng, N., Liu, Z., Ren, P., Ma, Y., Chen, S., Yu, S., Xue, J., Chen, B., & Wang, F. (2017) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700053 · Cited by 421
Massively Parallel Methods for Deep Reinforcement LearningPreprint
Nair, A., Srinivasan, P., Blackwell, S., Alcicek, C., Fearon, R., De Maria, A., Panneershelvam, V., Suleyman, M., Beattie, C., Petersen, S., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.04296 · Cited by 390
Self-citation
Machine learning: Overview of the recent progresses and implications for the process systems engineering field
Lee, J. H., Shin, J., & Realff, M. J. (2017) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2017.10.008 · Cited by 405
Navigating Occluded Intersections with Autonomous Vehicles Using Deep Reinforcement Learning
Isele, D., Rahimi, R., Cosgun, A., Subramanian, K., & Fujimura, K. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461233 · Cited by 379
Conversational Recommender System
Sun, Y., & Zhang, Y. (2018) · The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval · doi:10.1145/3209978.3210002 · Cited by 378
Artificial intelligence and machine learning as business tools: A framework for diagnosing value destruction potential
Canhoto, A. I., & Clear, F. (2019) · Business Horizons · doi:10.1016/j.bushor.2019.11.003 · Cited by 446
Outracing champion Gran Turismo drivers with deep reinforcement learning
Wurman, P. R., Barrett, S., Kawamoto, K., MacGlashan, J., Subramanian, K., Walsh, T. J., Capobianco, R., Devlić, A., Eckert, F., Fuchs, F., et al. (2022) · Nature · doi:10.1038/s41586-021-04357-7 · Cited by 423
Viewpoint: Human-in-the-loop Artificial Intelligence
Zanzotto, F. M. (2019) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11345 · Cited by 380
Breast cancer detection using deep learning: Datasets, methods, and challenges ahead
Din, N. M. U., Dar, R. A., Rasool, M., & Assad, A. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106073 · Cited by 385
Compute Trends Across Three Eras of Machine Learning
Sevilla, J., Heim, L., Ho, A., Besiroglu, T., Hobbhahn, M., & Villalobos, P. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891914 · Cited by 363
Selective Experience Replay for Lifelong Learning
Isele, D., & Cosgun, A. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11595 · Cited by 47
A review on reinforcement learning algorithms and applications in supply chain management
Rolf, B., Jackson, I., Müller, M., Lang, S., Reggelin, T., & Ivanov, D. (2022) · International Journal of Production Research · doi:10.1080/00207543.2022.2140221 · Cited by 416
Rule-interposing deep reinforcement learning based energy management strategy for power-split hybrid electric vehicle
Lian, R., Peng, J., Wu, Y., Tan, H., & Zhang, H. (2020) · Energy · doi:10.1016/j.energy.2020.117297 · Cited by 364
Application of deep reinforcement learning to intrusion detection for supervised problems
Lopez-Martin, M., Carro, B., & Sanchez-Esguevillas, A. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112963 · Cited by 360
Traffic light control using deep policy‐gradient and value‐function‐based reinforcement learning
Mousavi, S. S., Schukat, M., & Howley, E. (2017) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2017.0153 · Cited by 370
Multi-UAV-Enabled Load-Balance Mobile-Edge Computing for IoT Networks
Yang, L., Yao, H., Wang, J., Jiang, C., Benslimane, A., & Liu, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2971645 · Cited by 353
On Tiny Episodic Memories in Continual LearningPreprint
Chaudhry, A., Rohrbach, M., Elhoseiny, M., Ajanthan, T., Dokania, P. K., Torr, P. H. S., & Ranzato, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.10486 · Cited by 506
Smart Manufacturing Scheduling With Edge Computing Using Multiclass Deep Q Network
Lin, C., Deng, D., Chih, Y.-L., & Chiu, H.-T. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2908210 · Cited by 352
Whole building energy model for HVAC optimal control: A practical framework based on deep reinforcement learning
Zhang, Z., Chong, A., Pan, Y., Zhang, C., & Lam, K. P. (2019) · Energy and Buildings · doi:10.1016/j.enbuild.2019.07.029 · Cited by 343
Blockchain-Enabled Data Collection and Sharing for Industrial IoT With Deep Reinforcement Learning
Liu, C. H., Lin, Q., & Wen, S. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2890203 · Cited by 348
Advances and challenges in conversational recommender systems: A survey
Gao, C., Lei, W., He, X., de Rijke, M., & Chua, T. (2021) · AI Open · doi:10.1016/j.aiopen.2021.06.002 · Cited by 390
3D UAV Trajectory Design and Frequency Band Allocation for Energy-Efficient and Fair Communication: A Deep Reinforcement Learning Approach
Ding, R., Gao, F., & Shen, X. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3016024 · Cited by 333
Learning to schedule job-shop problems: representation and policy learning using graph neural network and reinforcement learning
Park, J., Chun, J., Kim, S. H., Kim, Y., & Park, J. (2021) · International Journal of Production Research · doi:10.1080/00207543.2020.1870013 · Cited by 340
An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning
Zhang, J., Liu, Y., Zhou, K., Li, G., Xiao, Z., Cheng, B., Xing, J., Wang, Y., Cheng, T., Liu, L., et al. (2019) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3299869.3300085 · Cited by 363
Explainability in deep reinforcement learning
Heuillet, A., Couthouis, F., & Díaz-Rodríguez, N. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106685 · Cited by 374
Application of deep learning to cybersecurity: A survey
Mahdavifar, S., & Ghorbani, A. A. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.02.056 · Cited by 356
Towards Real-Time Path Planning through Deep Reinforcement Learning for a UAV in Dynamic Environments
Yan, C., Xiang, X., & Wang, C. (2019) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-019-01073-3 · Cited by 335
Quantifying Generalization in Reinforcement Learning
Cobbe, K., Klimov, O., Hesse, C., Kim, T., & Schulman, J. (2018) · arXiv · doi:10.48550/arxiv.1812.02341
Artificial Intelligence Techniques for Stability Analysis and Control in Smart Grids: Methodologies, Applications, Challenges and Future Directions
Shi, Z., Yao, W., Li, Z., Zeng, L., Zhao, Y., Zhang, R., Tang, Y., & Wen, J. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115733 · Cited by 327
Interpretable End-to-End Urban Autonomous Driving With Latent Deep Reinforcement Learning
Chen, J., Li, S. E., & Tomizuka, M. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3046646 · Cited by 353
Deep reinforcement learning for high precision assembly tasks
Inoue, T., Magistris, G. D., Munawar, A., Yokoya, T., & Tachibana, R. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202244 · Cited by 326
PassGAN: A Deep Learning Approach for Password Guessing
Hitaj, B., Gasti, P., Ateniese, G., & Pérez‐Cruz, F. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21568-2_11 · Cited by 374
Randomised controlled trial of WISENSE, a real-time quality improving system for monitoring blind spots during esophagogastroduodenoscopy
Wu, L., Zhang, J., Zhou, W., An, P., Shen, L., Liu, J., Jiang, X., Huang, X., Mu, G., Wan, X., et al. (2019) · Gut · doi:10.1136/gutjnl-2018-317366 · Cited by 327
Model-free Deep Reinforcement Learning for Urban Autonomous Driving
Chen, J., Yuan, B., & Tomizuka, M. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917306 · Cited by 332
A survey of deep meta-learning
Huisman, M., van Rijn, J. N., & Plaat, A. (2021) · Data Archiving and Networked Services (DANS) · doi:10.1007/s10462-021-10004-4#rightslink · Cited by 316
Learning modular neural network policies for multi-task and multi-robot transfer
Devin, C., Gupta, A., Darrell, T., Abbeel, P., & Levine, S. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989250 · Cited by 324
Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges
Matsubara, Y., Levorato, M., & Restuccia, F. (2022) · ACM Computing Surveys · doi:10.1145/3527155 · Cited by 357
Unsupervised Domain Adaptation of Object Detectors: A Survey
Oza, P., Sindagi, V. A., VS, V., & Patel, V. M. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3217046 · Cited by 313
Deep Learning Empowered Task Offloading for Mobile Edge Computing in Urban Informatics
Zhang, K., Zhu, Y., Leng, S., He, Y., Maharjan, S., & Zhang, Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2903191 · Cited by 309
A Hierarchical Framework of Cloud Resource Allocation and Power Management Using Deep Reinforcement Learning
Liu, N., Li, Z., Xu, J., Xu, Z., Lin, S., Qiu, Q., Tang, J., & Wang, Y. (2017) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.123 · Cited by 315
Self-Supervised Deep Reinforcement Learning with Generalized Computation Graphs for Robot Navigation
Kahn, G., Villaflor, A., Ding, B., Abbeel, P., & Levine, S. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460655 · Cited by 308
Advances in Adversarial Attacks and Defenses in Computer Vision: A Survey
Akhtar, N., Mian, A. S., Kardan, N., & Shah, M. (2021) · IEEE Access · doi:10.1109/access.2021.3127960 · Cited by 355
Deep Reinforcement Learning Based Volt-VAR Optimization in Smart Distribution Systems
Zhang, Y., Wang, X., Wang, J., & Zhang, Y. Y. C. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.3010130 · Cited by 306
First Steps Towards an Intelligent Laser Welding Architecture Using Deep Neural Networks and Reinforcement Learning
Günther, J., Pilarski, P. M., Helfrich, G., Shen, H., & Diepold, K. J. (2014) · Procedia Technology · doi:10.1016/j.protcy.2014.09.007 · Cited by 302
Distributed Energy-Efficient Multi-UAV Navigation for Long-Term Communication Coverage by Deep Reinforcement Learning
Liu, C. H., Ma, X., Gao, X., & Tang, J. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2908171 · Cited by 305
Inductive biases for deep learning of higher-level cognition
Goyal, A., & Bengio, Y. (2022) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2021.0068 · Cited by 300
FP-BNN: Binarized neural network on FPGA
Liang, S., Yin, S., Liu, L., Luk, W. W., & Wei, S. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.09.046 · Cited by 307
DMRO: A Deep Meta Reinforcement Learning-Based Task Offloading Framework for Edge-Cloud Computing
Qu, G., Wu, H., Li, R., & Jiao, P. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3087258 · Cited by 303
Exponential expressivity in deep neural networks through transient chaosPreprint
Poole, B., Lahiri, S., Raghu, M., Sohl‐Dickstein, J., & Ganguli, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05340 · Cited by 367
Deep Reinforcement Learning for Strategic Bidding in Electricity Markets
Ye, Y., Qiu, D., Sun, M., Papadaskalopoulos, D. A., & Štrbac, G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2936142 · Cited by 310
Deep reinforcement learning meets graph neural networks: Exploring a routing optimization use case
Almasan, P., Suárez‐Varela, J., Rusek, K., Barlet‐Ros, P., & Cabellos‐Aparicio, A. (2022) · Computer Communications · doi:10.1016/j.comcom.2022.09.029 · Cited by 352
Review on deep learning applications in frequency analysis and control of modern power system
Zhang, Y., Shi, X., Zhang, H., Cao, Y., & Terzija, V. V. (2021) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2021.107744 · Cited by 304
Intelligent Computing: The Latest Advances, Challenges, and Future
Zhu, S., Yu, T., Xu, T., Chen, H., Dustdar, S., Gigan, S., Gündüz, D., Hossain, E., Jin, Y., Lin, F., et al. (2023) · Intelligent Computing · doi:10.34133/icomputing.0006 · Cited by 334
Maximum Entropy Deep Inverse Reinforcement LearningPreprint
Wulfmeier, M., Ondrúška, P., & Posner, I. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.04888 · Cited by 481
Machine Learning in Chemical Engineering: A Perspective
Schweidtmann, A. M., Esche, E., Fischer, A., Kloft, M., Repke, J., Säger, S., & Mitsos, A. (2021) · Chemie Ingenieur Technik · doi:10.1002/cite.202100083 · Cited by 324
Advanced planning for autonomous vehicles using reinforcement learning and deep inverse reinforcement learning
You, C., Lǚ, J., Filev, D., & Tsiotras, P. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.01.003 · Cited by 300
Machine learning for wireless communications in the Internet of Things: A comprehensive survey
Jagannath, J., Polosky, N., Jagannath, A., Restuccia, F., & Melodia, T. (2019) · Ad Hoc Networks · doi:10.1016/j.adhoc.2019.101913 · Cited by 294
A review of reinforcement learning based energy management systems for electrified powertrains: Progress, challenge, and potential solution
Ganesh, A. H., & Xu, B. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.111833 · Cited by 295
Multi-Objective Workflow Scheduling With Deep-Q-Network-Based Multi-Agent Reinforcement Learning
Wang, Y., Liu, H., Zheng, W., Xia, Y., Li, Y., Chen, P., Guo, K., & Xie, H. L. (2019) · IEEE Access · doi:10.1109/access.2019.2902846 · Cited by 297
Deep reinforcement learning in production systems: a systematic literature review
Panzer, M., & Bender, B. (2021) · International Journal of Production Research · doi:10.1080/00207543.2021.1973138 · Cited by 317
Google Research Football: A Novel Reinforcement Learning Environment
Kurach, K., Raichuk, A., Stańczyk, P., Zając, M., Bachem, O., Espeholt, L., Riquelme, C., Vincent, D., Michalski, M., Bousquet, O., et al. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5878 · Cited by 102
Practical Black-Box Attacks against Deep Learning Systems using Adversarial Examples.Preprint
Papernot, N., McDaniel, P. D., Goodfellow, I., Jha, S., Celik, Z. B., & Swami, A. (2016) · arXiv (Cornell University) · Cited by 304
Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination
Mismar, F. B., Evans, B. L., & Alkhateeb, A. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2961332 · Cited by 285
AuTO
Chen, L., Lingys, J., Chen, K., & Liu, F. (2018) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/3230543.3230551 · Cited by 289
Double Deep $Q$ -Learning-Based Distributed Operation of Battery Energy Storage System Considering Uncertainties
Bui, Y.-H., Hussain, A., & Kim, H. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2924025 · Cited by 283
Exposure
Hu, Y., He, H., Xu, C., Wang, B., & Lin, S. C.-F. (2018) · ACM Transactions on Graphics · doi:10.1145/3181974 · Cited by 328
Deep reinforcement learning: a survey
Wang, H.-N., Liu, N., Zhang, Y., Feng, D., Huang, F., Li, D., & Zhang, Y. (2020) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1900533 · Cited by 297
Key challenges in automation of earth-moving machines
Dadhich, S., Bodin, U., & Andersson, U. (2016) · Automation in Construction · doi:10.1016/j.autcon.2016.05.009 · Cited by 277
A novel DDPG method with prioritized experience replay
Hou, Y., Liu, L., Wei, Q., Xu, X., & Chen, C. (2017) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2017.8122622 · Cited by 277
A review on deep reinforcement learning for fluid mechanics
Garnier, P., Viquerat, J., Rabault, J., Larcher, A., Kuhnle, A., & Hachem, E. (2021) · Computers & Fluids · doi:10.1016/j.compfluid.2021.104973 · Cited by 311
Toward an Automated Auction Framework for Wireless Federated Learning Services Market
Jiao, Y., Wang, P., Niyato, D. T., Lin, B., & Kim, D. I. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.2994639 · Cited by 275
Transforming Cooling Optimization for Green Data Center via Deep Reinforcement Learning
Li, Y., Wen, Y., Tao, D., & Guan, K. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2927410 · Cited by 302
Study on deep reinforcement learning techniques for building energy consumption forecasting
Liu, T., Tan, Z., Xu, C., Chen, H., & Li, Z. (2019) · Energy and Buildings · doi:10.1016/j.enbuild.2019.109675 · Cited by 285
Jointly dampening traffic oscillations and improving energy consumption with electric, connected and automated vehicles: A reinforcement learning based approach
Qu, X., Yu, Y., Zhou, M., Lin, C., & Wang, X. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.114030 · Cited by 282
A survey on multi-agent deep reinforcement learning: from the perspective of challenges and applications
Du, W., & Ding, S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09938-y · Cited by 295
Combustion machine learning: Principles, progress and prospects
Ihme, M., Chung, W. T., & Mishra, A. (2022) · Progress in Energy and Combustion Science · doi:10.1016/j.pecs.2022.101010 · Cited by 300
Deep Learning for Video Game Playing
Justesen, N., Bontrager, P., Togelius, J., & Risi, S. (2019) · IEEE Transactions on Games · doi:10.1109/tg.2019.2896986 · Cited by 304
Deep reinforcement learning and its neuroscientific implications
Botvinick, M., Wang, J. X., Dabney, W., Miller, K. J., & Kurth-Nelson, Z. (2020) · Neuron · doi:10.1016/j.neuron.2020.06.014 · Cited by 269
Review of Deep Reinforcement Learning for Robot Manipulation
Nguyen, V., & La, H. M. (2019) · IEEE International Conference on Robotic Computing (IRC) · doi:10.1109/irc.2019.00120 · Cited by 292
Machines augmenting entrepreneurs: Opportunities (and threats) at the Nexus of artificial intelligence and entrepreneurship
Shepherd, D. A., & Majchrzak, A. (2022) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2022.106227 · Cited by 329
Evaluation of Deep Learning Models for Multi-Step Ahead Time Series Prediction
Chandra, R., Goyal, S., & Gupta, R. (2021) · IEEE Access · doi:10.1109/access.2021.3085085 · Cited by 290
Deep Multi-Agent Reinforcement Learning for Highway On-Ramp Merging in Mixed Traffic
Chen, D., Hajidavalloo, M. R., Li, Z., Chen, K., Wang, Y., Jiang, L., & Wang, Y. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3285442 · Cited by 290
Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels
Kostrikov, I., Yarats, D., & Fergus, R. (2020) · arXiv · doi:10.48550/arxiv.2004.13649 · Cited by 267
Deep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Tree Search Planning
Guo, X., Singh, S. P., Lee, H., Lewis, R. L., & Wang, X. (2014) · Cited by 271
Graph neural network and reinforcement learning for multi‐agent cooperative control of connected autonomous vehicles
Chen, S., Dong, J., Ha, P. Y. J., Li, Y., & Labi, S. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12702 · Cited by 265
Action Branching Architectures for Deep Reinforcement Learning
Tavakoli, A., Pardo, F., & Kormushev, P. S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11798 · Cited by 279
Real-time data-driven dynamic scheduling for flexible job shop with insufficient transportation resources using hybrid deep Q network
Li, Y., Gu, W., Yuan, M., & Tang, Y. (2021) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2021.102283 · Cited by 262

Authors: Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M.
Affiliations: Google DeepMind (United Kingdom) (GB)
ORCID: Silver, David
Riedmiller, Martin
Venue: arXiv
Publisher: arXiv
Published: 2013
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.1312.5602
arXiv: 1312.5602
OpenAlex: W1757796397
Cited by: 9,471
References: 29
Citations by year: 2026: 36 · 2025: 492 · 2024: 1117 · 2023: 1254 · 2022: 1198 · 2021: 1612 · 2020: 1412 · 2019: 1103 · 2018: 674 · 2017: 328 · 2016: 133 · 2015: 84 · 2014: 26
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
UCL Discovery (University College London) (submittedVersion)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
Keywords: deep reinforcement learning, Atari 2600, convolutional neural networks, Q-learning, value function estimation, game-playing agents, Arcade Learning Environment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Playing Atari with Deep Reinforcement Learning

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks