The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Optimal control of Markov processes with incomplete state information
Open accessOverview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Lastly, if we remove intrinsic value, we are left with maximising extrinsic value or expected utility, which underwrites expected utility theory [66], game theory, optimal control [143, 144] and reinforcement learning [63].”
From The free energy principle made simpler but not too simple (2023) · cites this paper as [144]
In the citing paper
“As a sufficient statistic of h t , the belief provides all information needed for optimal decision-making.”
From Meta-Cognitive Memory Policy Optimization for Long-Horizon LLM Agents (2026) · cites this paper as Åström, 1965
In the citing paper
“The partially observable Markov decision process (POMDP) approach to finding optimal or near-optimal control strategies for partially observable stochastic environments, given a complete model of the environment, was first proposed by Cassandra et al. [25] in 1965, while the algorithm to find the optimal solution was only devised 5 years later”
From A comprehensive survey on machine learning for networking: Evolution, applications and research opportunities (2018) · cites this paper as [25]
Citations
Cites
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
The Mathematical Theory of Optimal Processes
Bellman, R., Pontryagin, L. S., Boltyanskii, V. G., Gamkrelidze, R. V., Mishchenko, E. F., Trirogoff, K. N., & Neustadt, L. W. (1965) · Econometrica · doi:10.2307/1911909 · Cited by 4,211
Dynamic Programming and Markov Processes.
Freimer, M., & Howard, R. A. (1961) · Journal of the American Statistical Association · doi:10.2307/2282268 · Cited by 3,378
Contributions to the theory of games.
(1960) · Journal of the Franklin Institute · doi:10.1016/0016-0032(60)90366-5 · Cited by 1,824
Bellman, R. (1964) · IEEE Transactions on Circuit Theory · doi:10.1109/tct.1964.1082221 · Cited by 991
Stratonovich, R. L. (1960) · Theory of Probability & Its Applications · doi:10.1137/1105015 · Cited by 339
Variationsrechnung und partielle Differential-gleichungen erster Ordnung
I., E. L. (1935) · Nature · doi:10.1038/136814a0 · Cited by 218
Joseph, D. P., & Tou, T. J. (1961) · Transactions of the American Institute of Electrical Engineers Part II Applications and Industry · doi:10.1109/tai.1961.6371743 · Cited by 198
A General Solution for Linear, Sampled-Data Control
Gunckel, T. L., & Franklin, G. F. (1963) · Journal of Basic Engineering · doi:10.1115/1.3656559 · Cited by 143
Optimal Control of Continuous Time, Markov, Stochastic Systems†
FLORENTIN, J. J. (1961) · Journal of Electronics and Control · doi:10.1080/00207216108937350 · Cited by 133
Research works printed but not linked: 7
- Feldbaum, 1962, On optimal control of Markov objects, Autom. Remote Control, 23, 993
- Krassovskii, 1962, Analytical design of controllers in systems with random attributes, I, Autom. Remote Control, 22, 1021
- Krassovskii, 1962, Analytical design of controllers in systems with random attributes, II, Autom. Remote Control, 22, 1141
- Krassovskii, 1962, Analytical design of controllers in systems with random attributes, III, Autom. Remote Control, 22, 1289
- Fleming, 1963, Some Markovian optimization problems, J. Math. Mech., 12, 131
- Zachrisson, 1955, En Stridsvagnsduell med Spelteoretiska Konsekvenser, Artilleritidskr., 84, 112
- Stratonovich, 1962, On optimal control theory. Sufficient coordinates, Autom. Remote Control, 23, 847
Cited by
Bayesian Networks and Decision Graphs
Jensen, F. V., & Nielsen, T. D. (2007) · Information Science and Statistics · doi:10.1007/978-0-387-68282-2 · Cited by 4,129
Planning and acting in partially observable stochastic domains
Kaelbling, L. P., Littman, M. L., & Cassandra, A. R. (1998) · Artificial Intelligence · doi:10.1016/s0004-3702(98)00023-x · Cited by 4,149
Dynamic bayesian networks: representation, inference and learning
Murphy, K. P., & Russell, S. (2002) · Cited by 2,616
Decision-Theoretic Planning: Structural Assumptions and Computational Leverage
Boutilier, C., Dean, T., & Hanks, S. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.575 · Cited by 1,074
Boutaba, R., Salahuddin, M. A., Limam, N., Ayoubi, S., Shahriar, N., Estrada-Solano, F., & Caicedo, O. M. (2018) · Journal of Internet Services and Applications · doi:10.1186/s13174-018-0087-2 · Cited by 1,036
“[25] in 1965, while the algorithm to find the optimal solution was only devised 5 years later [416].”
Method
Metadata
- Authors
- Åström, K. J.
- Affiliations
- IBM (United States) (US)
- Corresponding author
- Åström, K.J
- Venue
- Journal of Mathematical Analysis and Applications
- Publisher
- Elsevier BV
- Published
- 1965-02
- Volume
- 10
- Issue
- 1
- Pages
- 174-205
- ISSN
- 0022-247X (ISSN-L)
- OpenAlex
- W2011418219
- Cited by
- 854
- References
- 18
- Citations by year
- 2026: 27 · 2025: 41 · 2024: 39 · 2023: 52 · 2022: 43 · 2021: 77 · 2020: 47 · 2019: 43 · 2018: 19 · 2017: 13 · 2016: 20 · 2015: 22 · 2014: 18 · 2013: 28 · 2012: 30
- FWCI
- 1.24
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (vor, 17698 d)
- Locations
- Journal of Mathematical Analysis and Applications (publishedVersion)
- Lund University Publications (Lund University) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Adaptive Dynamic Programming Control
- Physical Sciences › Engineering › Control and Systems Engineering › Advanced Control Systems Optimization
- Physical Sciences › Engineering › Control and Systems Engineering › Stability and Controllability of Differential Equations
- Keywords
- optimal control, Markov processes, incomplete state information, partial state information, stochastic control
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Optimal control of Markov processes with incomplete state information. https://app.cochat.ai/papers/10.1016/0022-247x(65)90154-x
- The paper
- Åström, K. J. (1965). Optimal control of Markov processes with incomplete state information. Journal of Mathematical Analysis and Applications. https://doi.org/10.1016/0022-247x(65)90154-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.