The DOI matches its Crossref record.
Dynamic Programming
Abstract
Little has been done in the study of these intriguing questions, and I do not wish to give the impression that any extensive set of ideas exists that could be called a "theory." What is quite surprising, as far as the histories of science and philosophy are concerned, is that the major impetus for the fantastic growth of interest in brain processes, both psychological and physiological, has come from a device, a machine, the digital computer. In dealing with a human being and a human society, we enjoy the luxury of being irrational, illogical, inconsistent, and incomplete, and yet of coping. In operating a computer, we must meet the rigorous requirements for detailed instructions and absolute precision. If we understood the ability of the human mind to make effective decisions when confronted by complexity, uncertainty, and irrationality then we could use computers a million times more effectively than we do. Recognition of this fact has been a motivation for the spurt of research in the field of neurophysiology. The more we study the information processing aspects of the mind, the more perplexed and impressed we become. It will be a very long time before we understand these processes sufficiently to reproduce them. In any case, the mathematician sees hundreds and thousands of formidable new problems in dozens of blossoming areas, puzzles galore, and challenges to his heart's content. He may never resolve some of these, but he will never be bored. What more can he ask?
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The multivariate evaluation shows another benefit of deep learning models, which is the ability to handle the curse of dimensionality (Bellman, 2010; Keogh and Mueen, 2017) by leveraging different degrees of smoothness in compositional function (Poggio et al., 2017) as well as the parallel computations of the GPUs (Lu et al., 2015).”
From Deep learning for time series classification: a review (2019) · cites this paper as Bellman, 2010
In the citing paper
“if we store intermediate values of u1D439 ( u1D45B ) in memory and retrieve them whenever necessary, u1D439 ( u1D441 ) can be computed in time linear to u1D441 , achieving an exponential speedup.”
From Quantum Dynamic Programming (2025) · cites this paper as [3]
Citations
Cites
Still being checked.
Cited by
Sorted by citations
Items 1,001–1,021 of 1,021
A highly accurate and computationally efficient approach for unconstrained iris segmentation
Chen, Y., Adjouadi, M., Han, C., Wang, J., Barreto, A. B., Rishe, N. D., & Andrian, J. H. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.04.017 · Cited by 118
The successor representation and temporal context
Gershman, S. J., Moore, C. D., Todd, M. T., Norman, K. A., & Sederberg, P. B. (2012) · Neural Computation · doi:10.1162/neco_a_00282 · Cited by 117
Randomized clinical trials of artificial intelligence
Angus, D. C. (2020) · JAMA · doi:10.1001/jama.2020.1039 · Cited by 112
Organizing memories for generalization in complementary learning systems
Sun, W., Advani, M., Spruston, N., Saxe, A., & Fitzgerald, J. E. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01382-9 · Cited by 103
System Design Perspective for Human-Level Agents Using Deep Reinforcement Learning: A Survey
Nguyen, N. D., Nguyen, T., & Nahavandi, S. (2017) · IEEE Access · doi:10.1109/access.2017.2777827 · Cited by 100
Singh, V., & Sharma, S. K. (2015) · European Transport Research Review · doi:10.1007/s12544-015-0160-x · Cited by 95
Understanding Human Intelligence through Human Limitations
Griffiths, T. L. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.09.001 · Cited by 88
A Survey of Deep Learning Applications to Autonomous Vehicle Control
Kuutti, S., Bowden, R., Jin, Y., Barber, P., & Fallah, S. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2962338 · Cited by 96
A clustering approach for topic filtering within systematic literature reviews
Weißer, T., Saßmannshausen, T., Ohrndorf, D., Burggräf, P., & Wagner, J. (2020) · MethodsX · doi:10.1016/j.mex.2020.100831 · Cited by 64
LEARNING-BASED MODEL PREDICTIVE CONTROL FOR MARKOV DECISION PROCESSES
Negenborn, R. R., De Schutter, B., Wiering, M. A., & Hellendoorn, H. (2005) · IFAC Proceedings Volumes · doi:10.3182/20050703-6-cz-1902.00280 · Cited by 59
Wang, Z., Li, H.-X., & Chen, C. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2927320 · Cited by 39
Wong, W., Noreika, V., Móró, L., Revonsuo, A., Windt, J., Valli, K., & Tsuchiya, N. (2020) · Neuroscience of Consciousness · doi:10.1093/nc/niaa006 · Cited by 40
Deep reinforcement learning and its applications in medical imaging and radiation therapy: a survey
Xu, L., Zhu, S., & Wen, N. (2022) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ac9cb3 · Cited by 35
Machine learning in the analysis of biomolecular simulations
Kaptan, S., & Vattulainen, I. (2022) · Advances in Physics: X · doi:10.1080/23746149.2021.2006080 · Cited by 31
Modeling generalization in machine learning: a methodological and computational study
Barbiero, P., Squillero, G., & Tonda, A. (2020) · arXiv · doi:10.48550/arxiv.2006.15680 · Cited by 39
Rational thoughts in neural codes
Wu, Z., Kwon, M., Daptardar, S., Schrater, P., & Pitkow, X. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912336117 · Cited by 27
Time-critical dynamic decision modeling in medicine
Xiang, Y., & Poh, K.-L. (2002) · Computers in Biology and Medicine · doi:10.1016/s0010-4825(01)00036-1 · Cited by 22
Count-based exploration with the successor representation
Machado, M. C., Bellemare, M. G., & Bowling, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5955 · Cited by 19
General intelligence requires rethinking exploration
Jiang, M., Rocktäschel, T., & Grefenstette, E. (2022) · arXiv · doi:10.48550/arxiv.2211.07819 · Cited by 17
Using POMDPs for learning cost sensitive decision trees
Maliah, S., & Shani, G. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2020.103400 · Cited by 12
Son, J., Gluza, M., Takagi, R., & Ng, N. H. Y. (2025) · Physical Review Letters · doi:10.1103/physrevlett.134.180602 · Cited by 6
Metadata
- Authors
- Bellman, R. E.
- Affiliations
- University of Southern California (US)
- Corresponding author
- Bellman, Richard E.
- Venue
- Science
- Publisher
- Princeton University Press
- Published
- 2010-12-31
- Volume
- 153
- Issue
- 3731
- Pages
- 34-37
- ISSN
- 0036-8075 (ISSN-L)
- OpenAlex
- W2341171179
- Cited by
- 14,588
- References
- 0
- Citations by year
- 2026: 227 · 2025: 367 · 2024: 358 · 2023: 345 · 2022: 332 · 2021: 629 · 2020: 582 · 2019: 575 · 2018: 469 · 2017: 429 · 2016: 440 · 2015: 570 · 2014: 616 · 2013: 615 · 2012: 634
- FWCI
- 137.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- Princeton University Press eBooks (publishedVersion)
- PubMed (publishedVersion)
- Virtual Defense Library (Ministerio de Defensa) (submittedVersion)
- CERN Document Server (European Organization for Nuclear Research) (submittedVersion)
- International Linear Collider (submittedVersion)
- Andalas University Repository (Andalas University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Cognitive Computing and Networks
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Complexity and Algorithms in Graphs
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- dynamic programming, optimization, decision-making, human cognition, information processing, brain processes, neurophysiology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
