The DOI matches its Crossref record.
Applied Dynamic Programming.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
A Formal Basis for the Heuristic Determination of Minimum Cost Paths
Hart, P., Nilsson, N., & Raphael, B. (1968) · IEEE Transactions on Systems Science and Cybernetics · doi:10.1109/tssc.1968.300136 · Cited by 12,738
Dynamic Programming Algorithm Optimization for Spoken Word Recognition
Sakoe, H., & Chiba, S. (1978) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1978.1163055 · Cited by 6,727
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1023/a:1022676722315 · Cited by 3,907
Optimal Detection of Changepoints With a Linear Computational Cost
Killick, R., Fearnhead, P., & Eckley, I. A. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.737745 · Cited by 2,548
Branch-and-Bound Methods: A Survey
Lawler, E. L., & Wood, D. E. (1966) · Operations Research · doi:10.1287/opre.14.4.699 · Cited by 1,997
Optimal Operation of Multireservoir Systems: State-of-the-Art Review
Labadie, J. W. (2004) · Journal of Water Resources Planning and Management · doi:10.1061/(asce)0733-9496(2004)130:2(93 · Cited by 1,576
The Representation and Matching of Pictorial Structures
Fischler, M. A., & Elschlager, R. A. (1973) · IEEE Transactions on Computers · doi:10.1109/t-c.1973.223602 · Cited by 1,322
Revenue Management Under a General Discrete Choice Model of Consumer Behavior
Talluri, K., & van Ryzin, G. (2004) · Management Science · doi:10.1287/mnsc.1030.0147 · Cited by 1,108
Using dynamic programming for solving variational problems in vision
Amini, A. A., Weymouth, T. E., & Jain, R. C. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.57681 · Cited by 1,008
Historical review of OCR research and development
Mori, S., Suen, C. Y., & Yamamoto, K. (1992) · Proceedings of the IEEE · doi:10.1109/5.156468 · Cited by 892
Intelligent scissors for image composition
Mortensen, E. N., & Barrett, W. A. (1995) · Proceedings of the 22nd annual conference on Computer graphics and interactive techniques - SIGGRAPH '95 · doi:10.1145/218380.218442 · Cited by 778
Online learning control by association and reinforcement
Si, J., & Wang, Y.-T. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914523 · Cited by 773
Reliability optimization of series-parallel systems using a genetic algorithm
Coit, D. W., & Smith, A. E. (1996) · IEEE Transactions on Reliability · doi:10.1109/24.510811 · Cited by 759
A-ECMS: An Adaptive Algorithm for Hybrid Electric Vehicle Energy Management
Musardo, C., Rizzoni, G., & Staccia, B. (2006) · Proceedings of the 44th IEEE Conference on Decision and Control · doi:10.1109/cdc.2005.1582424 · Cited by 726
A survey of maintenance models: The control and surveillance of deteriorating systems
Pierskalla, W. P., & Voelker, J. A. (1976) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800230302 · Cited by 678
Selection for Optimal Life Histories: The Effects of Age Structure
Schaffer, W. M. (1974) · Ecology · doi:10.2307/1935217 · Cited by 669
Semiring-based constraint satisfaction and optimization
Bistarelli, S., Montanari, U., & Rossi, F. (1997) · Journal of the ACM · doi:10.1145/256303.256306 · Cited by 630
Optimization Concepts and Applications in Engineering
Belegundu, A. D., & Chandrupatla, T. R. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511975905 · Cited by 555
A concept for manipulator trajectory planning
Pfeiffer, F., & Johanni, R. (1987) · IEEE Journal on Robotics and Automation · doi:10.1109/jra.1987.1087090 · Cited by 478
Nonlinear Predictive Control and Moving Horizon Estimation — An Introductory Overview
Allgöwer, F., Badgwell, T. A., Qin, J. S., Rawlings, J. B., & Wright, S. J. (1999) · Advances in Control · doi:10.1007/978-1-4471-0853-5_19 · Cited by 474
Maintenance Policies for Stochastically Failing Equipment: A Survey
McCall, J. J. (1965) · Management Science · doi:10.1287/mnsc.11.5.493 · Cited by 465
Simulation–Optimization Modeling: A Survey and Potential Application in Reservoir Systems Operation
Rani, D., & Moreira, M. M. (2010) · Water Resources Management · doi:10.1007/s11269-009-9488-0 · Cited by 460
Dynamic programming for detecting, tracking, and matching deformable contours
Geiger, D., Gupta, A., Costa, L. A., & Vlontzos, J. (1995) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.368194 · Cited by 429
Risk-averse dynamic programming for Markov decision processes
Ruszczyński, A. (2010) · Mathematical Programming · doi:10.1007/s10107-010-0393-3 · Cited by 415
Optimal maintenance models for systems subject to failure–A Review
Sherif, Y. S., & Smith, M. L. (1981) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800280104 · Cited by 409
Using Randomization to Break the Curse of Dimensionality
Rust, J. (1997) · Econometrica · doi:10.2307/2171751 · Cited by 407
Sebastian, T. B., Klein, P. N., & Kimia, B. B. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1159951 · Cited by 374
Air-Breathing Hypersonic Vehicle Tracking Control Based on Adaptive Dynamic Programming
Mu, C., Ni, Z., Sun, C., & He, H. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2516948 · Cited by 307
Capital Budgeting of Interrelated Projects: Survey and Synthesis
Weingartner, H. M. (1966) · Management Science · doi:10.1287/mnsc.12.7.485 · Cited by 296
Variable Neighborhood Decomposition Search
Hansen, P., Mladenović, N., & Perez-Britos, D. (2001) · Journal of Heuristics · doi:10.1023/a:1011336210885 · Cited by 296
On the optimal detection of curves in noisy pictures
Montanari, U. (1971) · Communications of the ACM · doi:10.1145/362588.362594 · Cited by 295
Herbivore Optimal Foraging: A Comparative Test of Three Models
Belovsky, G. E. (1984) · The American Naturalist · doi:10.1086/284254 · Cited by 288
Efficiently Solving the Redundancy Allocation Problem Using Tabu Search
Kulturel-Konak, S., Smith, A. E., & Coit, D. W. (2003) · IIE Transactions · doi:10.1080/07408170304422 · Cited by 285
The convergence of TD(?) for general ?
Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992701 · Cited by 275
A review on deep reinforcement learning for fluid mechanics
Garnier, P., Viquerat, J., Rabault, J., Larcher, A., Kuhnle, A., & Hachem, E. (2021) · Computers & Fluids · doi:10.1016/j.compfluid.2021.104973 · Cited by 270
Risk-Sensitive Reinforcement Learning
Mihatsch, O., & Neuneier, R. (2002) · Machine Learning · doi:10.1023/a:1017940631555 · Cited by 258
An application of heuristic search methods to edge and contour detection
Martelli, A. (1976) · Communications of the ACM · doi:10.1145/359997.360004 · Cited by 258
Q-learning: A data analysis method for constructing adaptive interventions.
Nahum-Shani, I., Qian, M., Almirall, D., Pelham, W. E., Gnagy, B., Fabiano, G. A., Waxmonsky, J. G., Yu, J., & Murphy, S. A. (2012) · Psychological Methods · doi:10.1037/a0029373 · Cited by 174
Istepanian, R., Philip, N., & Martini, M. (2009) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2009.090517 · Cited by 78
Low Earth Orbit Satellite Based Communication Systems—Research Opportunities
Gavish, B. (1997) · European Journal of Operational Research · doi:10.1016/s0377-2217(96)00390-6 · Cited by 28
Rafiq, A., Wang, P., Wei, M., Ali Muthanna, M. S., & Josbert, N. N. (2022) · Security and Communication Networks · doi:10.1155/2022/6469380 · Cited by 7
Retracted
Metadata
- Authors
- Freimer, M., Bellman, R. E., & Dreyfus, S. E.
- Venue
- Journal of the American Statistical Association
- Publisher
- JSTOR
- Published
- 1964-03
- Volume
- 59
- Issue
- 305
- Pages
- 293
- ISSN
- 0162-1459 (ISSN-L)
- OpenAlex
- W2062533874
- Cited by
- 2,153
- References
- 0
- FWCI
- 99.37
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.