The DOI matches its Crossref record.
Dynamic Programming
Abstract
Little has been done in the study of these intriguing questions, and I do not wish to give the impression that any extensive set of ideas exists that could be called a "theory." What is quite surprising, as far as the histories of science and philosophy are concerned, is that the major impetus for the fantastic growth of interest in brain processes, both psychological and physiological, has come from a device, a machine, the digital computer. In dealing with a human being and a human society, we enjoy the luxury of being irrational, illogical, inconsistent, and incomplete, and yet of coping. In operating a computer, we must meet the rigorous requirements for detailed instructions and absolute precision. If we understood the ability of the human mind to make effective decisions when confronted by complexity, uncertainty, and irrationality then we could use computers a million times more effectively than we do. Recognition of this fact has been a motivation for the spurt of research in the field of neurophysiology. The more we study the information processing aspects of the mind, the more perplexed and impressed we become. It will be a very long time before we understand these processes sufficiently to reproduce them. In any case, the mathematician sees hundreds and thousands of formidable new problems in dozens of blossoming areas, puzzles galore, and challenges to his heart's content. He may never resolve some of these, but he will never be bored. What more can he ask?
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The multivariate evaluation shows another benefit of deep learning models, which is the ability to handle the curse of dimensionality (Bellman, 2010; Keogh and Mueen, 2017) by leveraging different degrees of smoothness in compositional function (Poggio et al., 2017) as well as the parallel computations of the GPUs (Lu et al., 2015).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bellman, 2010
In the citing paper
“if we store intermediate values of u1D439 ( u1D45B ) in memory and retrieve them whenever necessary, u1D439 ( u1D441 ) can be computed in time linear to u1D441 , achieving an exponential speedup.”
From Quantum Dynamic Programming (2025) · cites this paper as [3]
Citations
Cites
Still being checked.
Cited by
Sorted by citations
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Constrained model predictive control: Stability and optimality
Mayne, D. Q., Rawlings, J. B., Rao, C. V., & Scokaert, P. O. M. (2000) · Automatica · doi:10.1016/s0005-1098(99)00214-9 · Cited by 8,736
Metadata
- Authors
- Bellman, R. E.
- Affiliations
- University of Southern California (US)
- Corresponding author
- Bellman, Richard E.
- Venue
- Science
- Publisher
- Princeton University Press
- Published
- 2010-12-31
- Volume
- 153
- Issue
- 3731
- Pages
- 34-37
- ISSN
- 0036-8075 (ISSN-L)
- OpenAlex
- W2341171179
- Cited by
- 14,588
- References
- 0
- Citations by year
- 2026: 227 · 2025: 367 · 2024: 358 · 2023: 345 · 2022: 332 · 2021: 629 · 2020: 582 · 2019: 575 · 2018: 469 · 2017: 429 · 2016: 440 · 2015: 570 · 2014: 616 · 2013: 615 · 2012: 634
- FWCI
- 137.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- Princeton University Press eBooks (publishedVersion)
- PubMed (publishedVersion)
- Virtual Defense Library (Ministerio de Defensa) (submittedVersion)
- CERN Document Server (European Organization for Nuclear Research) (submittedVersion)
- International Linear Collider (submittedVersion)
- Andalas University Repository (Andalas University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Cognitive Computing and Networks
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Complexity and Algorithms in Graphs
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- dynamic programming, optimization, decision-making, human cognition, information processing, brain processes, neurophysiology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review