The DOI matches its DataCite record; 31 of the 31 references it cites were found in a registry or an index.
Playing Atari with Deep Reinforcement Learning
Open accessAbstract
We present the first deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is a convolutional neural network, trained with a variant of Q-learning, whose input is raw pixels and whose output is a value function estimating future rewards. We apply our method to seven Atari 2600 games from the Arcade Learning Environment, with no adjustment of the architecture or learning algorithm. We find that it outperforms all previous approaches on six of the games and surpasses a human expert on three of them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“To enhance training stability, we employed Double Q-learning [32] and experience replay [8].”
From Deep reinforcement learning for multi-agent coordination (2026) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“Deep reinforcement learning frameworks such as PPO[43] and DQN[34] are also used as a benchmark in [53, 57].”
From Large Language Model Agent in Financial Trading: A Survey (2026) · cites this paper as [34]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“While recently proposed multimodal LLMs such as LLaVA [28], GPT-4v[35] possesses the capability to processing visual data, most of these models have not been specifically trained and evaluated on financial visual data such as Kline charts, volume charts.”
From Large Language Model Agent in Financial Trading: A Survey (2026) · cites this paper as [35]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
(2010) · International Conference on Machine Learning · Cited by 13,995
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Self-citationConvolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL · doi:10.5555/303568.303704 · Cited by 4,646
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
The Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3912 · Cited by 2,161
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Self-citation
Cited by
Sorted by citations
Items 1,001–1,061 of 1,061
Unrestricted Adversarial ExamplesPreprint
Brown, T. B., Carlini, N., Zhang, C., Olsson, C., Christiano, P. F., & Goodfellow, I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.08352 · Cited by 99
Koo, J., Mendiratta, V., Rahman, M. R., & Walid, A. (2019) · International Conference on Network and Service Management (CNSM) · doi:10.23919/cnsm46954.2019.9012702 · Cited by 67
Yuan, X., Zhou, J., Shi, Z., Lü, C., & Huang, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5456 · Cited by 66
Drone Navigation and Avoidance of Obstacles Through Deep Reinforcement Learning
Çetin, E., Barrado, C., Muñoz, G., Macias, M., & Pastor, E. (2019) · IEEE/AIAA Digital Avionics Systems Conference (DASC) · doi:10.1109/dasc43569.2019.9081749 · Cited by 67
Cooperative Edge Caching: A Multi-Agent Deep Learning Based Approach
Zhang, Y., Feng, B., Quan, W., Tian, A., Sood, K., Lin, Y., & Zhang, H. (2020) · IEEE Access · doi:10.1109/access.2020.3010329 · Cited by 67
Zhan, X., Xu, H., Zhang, Y., Zhu, X., Yin, H., & Zheng, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i4.20393 · Cited by 67
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Gao, Y., Gu, X., Zhang, H., Lin, H., & Yang, M. (2023) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip58684.2023.00039 · Cited by 75
Chen, L., He, Y., Wang, Q., Pan, W., & Ming, Z. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3150793 · Cited by 68
Le, H., Saeedvand, S., & Hsu, C.-C. J. (2024) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-024-02198-w · Cited by 74
On Improving Cross-dataset Generalization of Deepfake Detectors
Nadimpalli, A. V., & Rattani, A. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00019 · Cited by 79
Using Spatial Reinforcement Learning to Build Forest Wildfire Dynamics Models From Satellite Images
Ganapathi Subramanian, S., & Crowley, M. (2018) · Frontiers in ICT · doi:10.3389/fict.2018.00006 · Cited by 56
Casares, A. P. (2018) · Futures · doi:10.1016/j.futures.2018.05.002 · Cited by 54
Choudhury, A. (2022) · JMIR Human Factors · doi:10.2196/35421 · Cited by 56
Multi-agent modeling and simulation in the AI age
Fan, W., Chen, P., Shi, D., Guo, X., & Kou, L. (2021) · Tsinghua Science and Technology · doi:10.26599/tst.2021.9010005 · Cited by 50
Advancing Fusion with Machine Learning Research Needs Workshop Report
Humphreys, D., Kupresanin, A., Boyer, M. D., Canik, J., Chang, C. S., Cyr, E. C., Granetz, R., Hittinger, J., Kolemen, E., Lawrence, E., et al. (2020) · Journal of Fusion Energy · doi:10.1007/s10894-020-00258-1 · Cited by 47
Observational Overfitting in Reinforcement Learning
Song, X., Jiang, Y., Tu, S., Du, Y., & Neyshabur, B. (2019) · arXiv · doi:10.48550/arxiv.1912.02975 · Cited by 48
Effects of Communication Directionality and AI Agent Differences in Human-AI Interaction
Ashktorab, Z., Dugan, C., Johnson, J., Pan, Q., Zhang, W., Kumaravel, S., & Campbell, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445256 · Cited by 50
Neural Networks Meet Physical Networks: Distributed Inference Between Edge Devices and the Cloud
Chinchali, S. P., Cidon, E., Pergament, E., Chu, T., & Katti, S. (2018) · Proceedings of the 17th ACM Workshop on Hot Topics in Networks · doi:10.1145/3286062.3286070 · Cited by 46
Commission Fee is not Enough: A Hierarchical Reinforced Framework for Portfolio Management
Wang, R., Wei, H., An, B., Feng, Z., & Yao, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i1.16142 · Cited by 45
A Deep Reinforcement Learning Method for Mobile Robot Collision Avoidance based on Double DQN
Xue, X., Li, Z., Zhang, D., & Yan, Y. (2019) · 2019 IEEE 28th International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie.2019.8781522 · Cited by 48
Li, Q., Jia, X., Wang, S., & Yan, J. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-72995-9_9 · Cited by 42
Minimalistic Attacks: How Little It Takes to Fool Deep Reinforcement Learning Policies
Qu, X., Sun, Z., Ong, Y.-S., Gupta, A., & Wei, P. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.2974509 · Cited by 40
Chaffre, T., Moras, J., Chan-Hon-Tong, A., & Marzat, J. (2020) · Proceedings of the 17th International Conference on Informatics in Control, Automation and Robotics · doi:10.5220/0009821603140323 · Cited by 38
AI and Compute: How Much Longer Can Computing Power Drive Artificial Intelligence Progress?
Lohn, A., & Musser, M. (2022) · Center for Security and Emerging Technology · doi:10.51593/2021ca009 · Cited by 39
Reinforcement Learning for Fair Dynamic Pricing
Maestre, R., Duque, J., Rubio, A., & Arevalo, J. (2019) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-030-01054-6_8 · Cited by 37
THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation
Pumacay, W., Singh, I., Duan, J., Krishna, R., Thomason, J., & Fox, D. (2024) · Robotics: Science and Systems XX · doi:10.15607/rss.2024.xx.133 · Cited by 29
Reinforcement learning and bandits for speech and language processing: Tutorial, review and outlook
Lin, B. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122254 · Cited by 28
Rational thoughts in neural codes
Wu, Z., Kwon, M., Daptardar, S., Schrater, P., & Pitkow, X. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912336117 · Cited by 27
AI Playground: Unreal Engine-Based Data Ablation Tool for Deep Learning
Mousavi, M., Khanal, A., & Estrada, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-64559-5_41 · Cited by 27
Learning to Continuously Optimize Wireless Resource in Episodically Dynamic Environment
Sun, H., Pu, W., Zhu, M., Fu, X., Chang, T.-H., & Hong, M. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9413503 · Cited by 21
Pattern recognition of human arm movement using deep reinforcement learning
Seok, W., Kim, Y., & Park, C. (2018) · 2018 International Conference on Information Networking (ICOIN) · doi:10.1109/icoin.2018.8343257 · Cited by 25
Mobile-kube: mobility-aware and energy-efficient service orchestration on kubernetes edge servers
Ghafouri, S., Karami, A., Bakhtiarvan, D. B., Bigdeli, A. S., Gill, S. S., & Doyle, J. (2022) · 2022 IEEE/ACM 15th International Conference on Utility and Cloud Computing (UCC) · doi:10.1109/ucc56403.2022.00019 · Cited by 20
Modeling Touch-based Menu Selection Performance of Blind Users via Reinforcement Learning
Li, Z., Ko, Y.-J., Putkonen, A., Feiz, S., Ashok, V., Ramakrishnan, IV, Oulasvirta, A., & Bi, X. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580640 · Cited by 18
Meta-Transfer Learning-Based Handover Optimization for V2N Communication
Sohaib, R. M., Onireti, O., Tan, K., Sambo, Y., Swash, R., & Imran, M. A. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3431875 · Cited by 15
Self-Net: Lifelong Learning via Continual Self-Modeling
Mandivarapu, J. K., Camp, B., & Estrada, R. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00019 · Cited by 14
In-context Reinforcement Learning with Algorithm Distillation
Laskin, M., Wang, L., Oh, J., Parisotto, E., Spencer, S., Steigerwald, R., Strouse, D., Hansen, S., Filos, A., Brooks, E., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.14215 · Cited by 14
“In the Dark Room and Dark Key-to-Door environments we collect 2000 learning histories with an Asynchronous Advantage Actor-Critic (A3C) (Mnih et al., 2016) with 100 actors, while in DMLab Watermaze we collect 4000 learning histories with a distributed DQN with 16 parallel actors (see Appendix F for asymptotic learning…”
BackgroundMethodInfluentialSelf-citationInterference and Generalization in Temporal Difference Learning
Bengio, E., Pineau, J., & Precup, D. (2020) · arXiv · doi:10.48550/arxiv.2003.06350 · Cited by 14
A New Anti-Jamming Strategy Based on Deep Reinforcement Learning for MANET
Xu, Y., Lei, M., Li, M., Zhao, M., & Hu, B. (2019) · 2019 IEEE 89th Vehicular Technology Conference (VTC2019-Spring) · doi:10.1109/vtcspring.2019.8746494 · Cited by 14
Schmid, J. F., Lauri, M., & Frintrop, S. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967805 · Cited by 12
Islam, S., Chiu, M.-H., Bonjour, T., de Oliveira, R., Bhargava, B., & Kejriwal, M. (2025) · IEEE Intelligent Systems · doi:10.1109/mis.2024.3469574 · Cited by 13
Learning Interactive Real-World Simulators
Yang, S., Du, Y., Ghasemipour, K., Tompson, J., Kaelbling, L., Schuurmans, D., & Abbeel, P. (2023) · arXiv · doi:10.48550/arxiv.2310.06114 · Cited by 346
“While combining diverse data might enable rich interaction, the true value of a simulator like UniSim lies in simulating long episodes to enable optimizing decisions through search [34], planning [35], optimal control [36], or reinforcement learning [37].”
BackgroundConfigurable Agent With Reward As Input: A Play-Style Continuum Generation
Le Pelletier de Woillemont, P., Labory, R., & Corruble, V. (2021) · 2021 IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619127 · Cited by 12
Nguyen, C. H., Shihua, J. M., & Liem, R. P. (2025) · Communications in Transportation Research · doi:10.1016/j.commtr.2025.100165 · Cited by 12
Yamada, J., Shawe-Taylor, J., & Fountas, Z. (2020) · 2020 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206765 · Cited by 11
Large Language Model Agent in Financial Trading: A Survey
Ding, H., Li, Y., Wang, J., Chen, H., Guo, D., & Zhang, Y. (2026) · Proceedings of the 2026 9th International Conference on Computers in Management and Business · doi:10.1145/3802463.3802475 · Cited by 10
Learning of Motor Control from Motor Babbling**This research is supported by CREST, JST.
Aoki, T., Nakamura, T., & Nagai, T. (2016) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2016.10.478 · Cited by 10
Brittle AI, Causal Confusion, and Bad Mental Models: Challenges and Successes in the XAI Program
Druce, J., Niehaus, J., Moody, V., Jensen, D., & Littman, M. L. (2021) · arXiv · doi:10.48550/arxiv.2106.05506 · Cited by 8
Deep reinforcement learning for multi-agent coordination
Aina, K. O., & Ha, S. (2026) · Artificial Life and Robotics · doi:10.1007/s10015-025-01089-z · Cited by 8
Design and evaluation of a global workspace agent embodied in a realistic multimodal environment
Dossa, R. F. J., Arulkumaran, K., Juliani, A., Sasai, S., & Kanai, R. (2024) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2024.1352685 · Cited by 5
Emergence of Collaborative Hunting via Multi-Agent Deep Reinforcement Learning
Tsutsui, K., Takeda, K., & Fujii, K. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-37660-3_15 · Cited by 5
Anastassacos, N., Hailes, S., & Musolesi, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6190 · Cited by 4
Deconstructing Deep Active Inference: A Contrarian Information Gatherer
Champion, T., Grześ, M., Bonheme, L., & Bowman, H. (2024) · Neural Computation · doi:10.1162/neco_a_01697 · Cited by 5
Player-Guided AI outperforms standard AI in Sequence Alignment Puzzles
Mutalova, R., Sarrazin-Gendron, R., Ghasemloo Gheidari, P., Cai, E., Richard, G., Caisse, S., Knight, R., Blanchette, M., Szantner, A., & Waldispühl, J. (2023) · Proceedings of The ACM Collective Intelligence Conference · doi:10.1145/3582269.3615597 · Cited by 1
Dizon-Paradis, O., Wormald, S., Capecci, D., Bhandarkar, A., & Woodard, D. (2023) · doi:10.36227/techrxiv.23739099 · Cited by 1
Qu, Y., Huang, Z., Sheng, Z., Chen, J., Leng, Y., Labi, S., & Chen, S. (2025) · arXiv · doi:10.48550/arxiv.2505.16377 · Cited by 1
MARFT: Multi-Agent Reinforcement Fine-Tuning
Liao, J., Wen, M., Wang, J., & Zhang, W. (2025) · arXiv · doi:10.48550/arxiv.2504.16129
LeRobot: An Open-Source Library for End-to-End Robot Learning
Cadene, R., Aliberts, S., Capuano, F., Aractingi, M., Zouitine, A., Kooijmans, P., Choghari, J., Russi, M., Pascal, C., Palma, S., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.22818
ProcgenOOD: a benchmark for out-of-distribution generalization in reinforcement learning
Corder, K., Park, S. J., & Vindiola, M. M. (2026) · Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications VIII · doi:10.1117/12.3093362
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578
Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120
Self-citationBadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain
Gu, T., Dolan-Gavitt, B., & Garg, S. (2017) · arXiv · doi:10.48550/arxiv.1708.06733 · Cited by 1,061
Metadata
- Authors
- Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1312.5602
- OpenAlex
- W1757796397
- Cited by
- 9,471
- References
- 29
- Citations by year
- 2026: 36 · 2025: 492 · 2024: 1117 · 2023: 1254 · 2022: 1198 · 2021: 1612 · 2020: 1412 · 2019: 1103 · 2018: 674 · 2017: 328 · 2016: 133 · 2015: 84 · 2014: 26
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- deep reinforcement learning, Atari 2600, convolutional neural networks, Q-learning, value function estimation, game-playing agents, Arcade Learning Environment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
