The DOI matches its DataCite record; 31 of the 31 references it cites were found in a registry or an index.
Playing Atari with Deep Reinforcement Learning
Open accessAbstract
We present the first deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is a convolutional neural network, trained with a variant of Q-learning, whose input is raw pixels and whose output is a value function estimating future rewards. We apply our method to seven Atari 2600 games from the Arcade Learning Environment, with no adjustment of the architecture or learning algorithm. We find that it outperforms all previous approaches on six of the games and surpasses a human expert on three of them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“To enhance training stability, we employed Double Q-learning [32] and experience replay [8].”
From Deep reinforcement learning for multi-agent coordination (2026) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“Deep reinforcement learning frameworks such as PPO[43] and DQN[34] are also used as a benchmark in [53, 57].”
From Large Language Model Agent in Financial Trading: A Survey (2026) · cites this paper as [34]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“While recently proposed multimodal LLMs such as LLaVA [28], GPT-4v[35] possesses the capability to processing visual data, most of these models have not been specifically trained and evaluated on financial visual data such as Kline charts, volume charts.”
From Large Language Model Agent in Financial Trading: A Survey (2026) · cites this paper as [35]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
(2010) · International Conference on Machine Learning · Cited by 13,995
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Self-citationConvolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL · doi:10.5555/303568.303704 · Cited by 4,646
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
The Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3912 · Cited by 2,161
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Self-citationTemporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618 · cited 1×
“Perhaps the best-known success story of reinforcement learning is TD-gammon, a backgammonplaying program which learnt entirely by reinforcement learning and self-play, and achieved a superhuman level of play [24].”
Background(1998) · Kybernetes · doi:10.1108/k.1998.27.9.1093.3 · Cited by 1,577
An analysis of temporal-difference learning with function approximation
Tsitsiklis, J. N., & Roy, B. V. (1997) · IEEE Transactions on Automatic Control · doi:10.1109/9.580874 · Cited by 1,290
Deng, L., Hinton, G. E., & Kingsbury, B. E. D. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6639344 · Cited by 1,259
Learning multiple layers of representation
Hinton, G. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.09.004 · Cited by 1,050
Residual Algorithms: Reinforcement Learning with Function Approximation
Baird, L. C. (1995) · Elsevier eBooks · doi:10.1016/b978-1-55860-377-6.50013-x · Cited by 976
Prioritized Sweeping: Reinforcement Learning with Less Data and Less Time
Moore, A., & Atkeson, C. G. (1993) · Machine Learning · doi:10.1023/a:1022635613229 · Cited by 842
Reinforcement learning for robots using neural networks
Lin, L.-J. (1992) · Defense Technical Information Center (DTIC) · Cited by 841
Riedmiller, M. (2005) · Lecture notes in computer science · doi:10.1007/11564096_32 · Cited by 824
Self-citationPedestrian Detection with Unsupervised Multi-stage Feature Learning
Sermanet, P., Kavukcuoglu, K., Chintala, S., & LeCun, Y. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.465 · Cited by 762
Self-citationMachine learning for aerial image labeling
Hinton, G. E., & Mnih, V. (2013) · TSpace (University of Toronto) · Cited by 722
Self-citationDeep auto-encoder neural networks in reinforcement learning
Lange, S., & Riedmiller, M. (2010) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2010.5596468 · Cited by 362
Self-citationA Neuroevolution Approach to General Atari Game Playing
Hausknecht, M. J., Lehman, J., Miikkulainen, R., & Stone, P. (2014) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2013.2294713 · Cited by 193
Toward Off-Policy Learning Control with Function Approximation
Maei, H. R., ri, C. S., Bhatnagar, S., & Sutton, R. (2010) · Cited by 175
Convergent Temporal-Difference Learning with Arbitrary Smooth Function Approximation
Bhatnagar, S., Precup, D., Silver, D., Sutton, R. S., Maei, H. R., & Szepesvári, C. (2009) · neural information processing systems · Cited by 167
Self-citationReinforcement Learning with Factored States and Actions
Sallans, B., & Hinton, G. E. (2004) · doi:10.5555/1005332.1016794 · Cited by 139
Investigating Contingency Awareness Using Atari 2600 Games
Bellemare, M. G., Veness, J., & Bowling, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v26i1.8321 · Cited by 75
Actor-Critic Reinforcement Learning with Energy-Based Policies
Heess, N., Silver, D., & Teh, Y. W. (2012) · Cited by 46
Self-citationPollack, J. B., & Blair, A. (1996) · Cited by 26
Sketch-Based Linear Value Function Approximation
Bellemare, M. G., Veness, J., & Bowling, M. (2012) · Cited by 21
Bayesian Learning of Recursively Factored Environments
Bellemare, M. G., Veness, J., & Bowling, M. (2013) · Cited by 21
Cited by
Sorted by citations
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Self-citationTowards Evaluating the Robustness of Neural Networks
Carlini, N., & Wagner, D. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.49 · Cited by 8,859
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Self-citationSoft actor-critic Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1801.01290 · Cited by 5,594
Metadata
- Authors
- Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1312.5602
- OpenAlex
- W1757796397
- Cited by
- 9,471
- References
- 29
- Citations by year
- 2026: 36 · 2025: 492 · 2024: 1117 · 2023: 1254 · 2022: 1198 · 2021: 1612 · 2020: 1412 · 2019: 1103 · 2018: 674 · 2017: 328 · 2016: 133 · 2015: 84 · 2014: 26
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- deep reinforcement learning, Atari 2600, convolutional neural networks, Q-learning, value function estimation, game-playing agents, Arcade Learning Environment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
