The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Reinforcement Learning: An Introduction
Open accessAbstract
An account of key ideas and algorithms in reinforcement learning. The discussion ranges from the history of the field's intellectual foundations to recent developments and applications. Areas studied include reinforcement learning problems in terms of Markov decision problems and solution methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,010
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
Varga, R. S. (2000) · Springer Series in Computational Mathematics · doi:10.1007/978-3-642-05156-2 · Cited by 5,811
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
Parallel and Distributed Computation: Numerical Methods
Bertsekas, D. P., & Tsitsiklis, J. N. (1989) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 5,293
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Self-citationSome Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
Theory and Practice of Recursive Identification
Lennart Ljung, A., & Söderström, T. (1983) · Lund University Publications (Lund University) · Cited by 3,989
Skinner, B. F. (1938) · Cited by 3,571
Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks
Broomhead, D. S., & Lowe, D. (1988) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 3,443
Adaptive filtering prediction and control
Goodwin, G. C., & Sin, K. S. (1984) · Cited by 3,400
Dynamic Programming and Markov Processes.
Freimer, M., & Howard, R. A. (1961) · Journal of the American Statistical Association · doi:10.2307/2282268 · Cited by 3,378
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,233
THOMPSON, W. R. (1933) · Biometrika · doi:10.1093/biomet/25.3-4.285 · Cited by 2,712
Purposive Behavior in Animals and Men
Rodhom, C., & Tolman, E. C. (1950) · The American Journal of Psychology · doi:10.2307/1418946 · Cited by 2,455
Some aspects of the sequential design of experiments
Robbins, H. (1952) · Bulletin of the American Mathematical Society · doi:10.1090/s0002-9904-1952-09620-8 · Cited by 2,184
Craik, K. J. W. (1943) · Cited by 1,845
Kalos, M. H., & Whitlock, P. A. (1986) · Wiley eBooks · doi:10.1002/9783527617395 · Cited by 1,546
Learning Automata: An Introduction
Narendra, K. S., & Thathachar, M. A. L. (1989) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,540
Stochastic models for learning.
Bush, R. R., & Mosteller, F. (1955) · John Wiley & Sons, Inc. eBooks · doi:10.1037/14496-000 · Cited by 1,511
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450
Self-citationRadial basis functions for multivariable interpolation: a review
Powell, M. J. D. (1987) · Clarendon Press eBooks · Cited by 1,197
Introduction to Stochastic Dynamic Programming.
Berry, D. A., & Ross, S. M. (1986) · Journal of the American Statistical Association · doi:10.2307/2289262 · Cited by 1,133
Stochastic systems : estimation, identification, and adaptive control
Kumar, P. R., & Varaiya, P. (1986) · Medical Entomology and Zoology · Cited by 1,018
Toward a statistical theory of learning.
Estes, W. K. (1950) · Psychological Review · doi:10.1037/h0058559 · Cited by 994
Kanerva, P. (1988) · Medical Entomology and Zoology · Cited by 976
Anderson, J. A., Silverstein, J. W., Ritz, S. A., & Jones, R. S. (1977) · Psychological Review · doi:10.1037//0033-295x.84.5.413 · Cited by 899
Temporal credit assignment in reinforcement learning
Sutton, R. S. (1984) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 749
Adaptive Behavior and Learning
Fantino, E., & Staddon, J. E. R. (1985) · The American Journal of Psychology · doi:10.2307/1422461 · Cited by 710
A Theory of Networks for Approximation and Learning
Poggio, T., & Girosi, F. (1989) · Cited by 707
Narendra, K. S., & Thathachar, M. A. L. (1974) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1974.5408453 · Cited by 668
The Art and Theory of Dynamic Programming
(1977) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6068-0 · Cited by 474
Agre, P. E., & Chapman, D. (1990) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(05)80026-0 · Cited by 372
Is there a cell-biological alphabet for simple forms of learning?
Hawkins, R. D., & Kandel, E. R. (1984) · Psychological Review · doi:10.1037//0033-295x.91.3.375 · Cited by 328
Pattern-recognizing stochastic learning automata
Barto, A. G., & Anandan, P. (1985) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1985.6313371 · Cited by 305
Punish/Reward: Learning with a Critic in Adaptive Threshold Systems
Widrow, B., Gupta, N. K., & Maitra, S. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309272 · Cited by 280
Adaptive Treatment Allocation and the Multi-Armed Bandit Problem
Lai, T. L. (1987) · The Annals of Statistics · doi:10.1214/aos/1176350495 · Cited by 279
Simulation of self-organizing systems by digital computer
Farley, B., & Clark, W. (1954) · Transactions of the IRE Professional Group on Information Theory · doi:10.1109/tit.1954.1057468 · Cited by 270
Associative search network: A reinforcement learning associative memory
Barto, A. G., Sutton, R. S., & Brouwer, P. S. (1981) · Biological Cybernetics · doi:10.1007/bf00453370 · Cited by 240
Modified Policy Iteration Algorithms for Discounted Markov Decision Problems
Puterman, M. L., & Shin, M. C. (1978) · Management Science · doi:10.1287/mnsc.24.11.1127 · Cited by 239
A Survey of Some Results in Stochastic Adaptive Control
Kumar, P. R. (1985) · SIAM Journal on Control and Optimization · doi:10.1137/0323023 · Cited by 217
Connectionist Learning for Control: An Overview
Barto, A. G. (1991) · The MIT Press eBooks · doi:10.7551/mitpress/4939.003.0005 · Cited by 200
An adaptive optimal controller for discrete-time Markov environments
Witten, I. H. (1977) · Information and Control · doi:10.1016/s0019-9958(77)90354-0 · Cited by 180
Intelligent behavior as an adaptation to the task environment
Booker, L. B. (1982) · Deep Blue (University of Michigan) · Cited by 177
A new approach to the design of reinforcement schemes for learning automata
Thathachar, M. A. L., & SASTRY, P. S. (1985) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1985.6313407 · Cited by 176
Landmark learning: An illustration of associative search
Barto, A. G., & Sutton, R. S. (1981) · Biological Cybernetics · doi:10.1007/bf00335152 · Cited by 147
On the Theory of Apportionment
Thompson, W. R. (1935) · American Journal of Mathematics · doi:10.2307/2371219 · Cited by 142
Functional approximations and dynamic programming
Bellman, R., & Dreyfus, S. E. (1959) · Mathematics of Computation · doi:10.1090/s0025-5718-1959-0107376-8 · Cited by 131
Foundations of conditioning and learning
Kimble, G. A. (1967) · Appleton-Century-Crofts eBooks · Cited by 117
Learning and Problem Solving with Multilayer Connectionist Systems
Anderson, C. W. (1986) · Cited by 110
Simulation of anticipatory responses in classical conditioning by a neuron-like adaptive element
Barto, A. G., & Sutton, R. S. (1982) · Behavioural Brain Research · doi:10.1016/0166-4328(82)90001-8 · Cited by 106
Shannon, C. E. (1950) · Scientific American · doi:10.1038/scientificamerican0250-48 · Cited by 89
Moore, J. W., Desmond, J. E., Berthier, N. E., Blazis, D. E. J., Sutton, R. S., & Barto, A. G. (1986) · Behavioural Brain Research · doi:10.1016/0166-4328(86)90092-6 · Cited by 86
On the use of backpropagation in associative reinforcement learning
Williams (1988) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/icnn.1988.23856 · Cited by 72
Brownian Motion and Potential Theory
Hersh, R., & Griego, R. J. (1969) · Scientific American · doi:10.1038/scientificamerican0369-66 · Cited by 69
Gelperin, A., Hopfield, J. J., & Tank, D. W. (1985) · Springer eBooks · doi:10.1007/978-1-4757-5858-0_13 · Cited by 58
A unified theory of heuristic evaluation functions and its application to learning
Christensen, J., & Korf, R. E. (1986) · Cited by 42
On thought: the extrinsic theory.
Galanter, E., & Gerstenhaber, M. (1956) · Psychological Review · doi:10.1037/h0048568 · Cited by 37
The CDP: A Unifying Formulation for Heuristic Search, Dynamic Programming, and Branch-and-Bound
Kumar, V., & Kanal, L. N. (1988) · Springer eBooks · doi:10.1007/978-1-4613-8788-6_1 · Cited by 30
Signature Table Systems and Learning
Biermann, A. W., Fairfield, J. R. C., & Beres, T. R. (1982) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1982.4308882 · Cited by 25
A neural model of adaptive behavior
Hampson, S. E. (1983) · eScholarship (California Digital Library) · Cited by 15
Human operators and automatic adaptive controllers: A comparative study on a particular control task
Witten, I. H., & Corbin, M. J. (1973) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(73)80010-0 · Cited by 12
Byrne, J. H., Gingrich, K. J., & Baxter, D. A. (1989) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60108-5 · Cited by 11
Cited by
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Metadata
- Venue
- IEEE Transactions on Neural Networks
- Published
- 2005-01
- Volume
- 16
- Issue
- 1
- Pages
- 285-286
- ISSN
- 1045-9227 (ISSN-L)
- OpenAlex
- W2121863487
- Cited by
- 24,496
- References
- 66
- FWCI
- 971.52
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
