The DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
Active inference and agency: optimal control without cost functions
Open accessAbstract
This paper describes a variational free-energy formulation of (partially observable) Markov decision problems in decision making under uncertainty. We show that optimal control can be cast as active inference. In active inference, both action and posterior beliefs about hidden states minimise a free energy bound on the negative log-likelihood of observed states, under a generative model. In this setting, reward or cost functions are absorbed into prior beliefs about state transitions and terminal states. Effectively, this converts optimal control into a pure inference problem, enabling the application of standard Bayesian filtering techniques. We then consider optimal trajectories that rest on posterior beliefs about hidden states in the future. Crucially, this entails modelling control as a hidden state that endows the generative model with a representation of agency. This leads to a distinction between models with and without inference on hidden control states; namely, agency-free and agency-based models, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Another avenue is training paradigms or biofeedback: patients could be given tasks that implicitly re-balance their predictive coding (58).”
From Predictive coding and neurocomputational psychiatry: a mechanistic framework for understanding mental disorders (2026) · cites this paper as [58]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“In OCD, the precision assigned to ϵ becomes pathologically high, effectively amplifying small discrepancies and driving excessive belief updates, even when the external world offers reassurance (58).”
From Predictive coding and neurocomputational psychiatry: a mechanistic framework for understanding mental disorders (2026) · cites this paper as [58]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Computational models suggest that increasing the precision of certain prediction errors can produce OCD-like repetitive checking behaviour as the system tries to resolve an endless stream of perceived mismatches (56, 58).”
From Predictive coding and neurocomputational psychiatry: a mechanistic framework for understanding mental disorders (2026) · cites this paper as [58]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1988) · Cited by 16,582
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,462
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 5×
“This formulation of behaviour is based on ergodic arguments about the nature of self organising systems (Ashby 1947)—for a fuller discussion please see Friston and Ao (2012) and Friston (2010) for their neurobiological implications .”
BackgroundMethodInfluentialSelf-citationRao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 2×
“1995) and, under some simplifying assumptions, corresponds to predictive coding (Rao and Ballard 1999).”
BackgroundClassical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Planning and acting in partially observable stochastic domains
Kaelbling, L. P., Littman, M. L., & Cassandra, A. R. (1998) · Artificial Intelligence · doi:10.1016/s0004-3702(98)00023-x · Cited by 4,149 · cited 1×
“This leads to an extension of the MDP framework to accommodate partially observed states (Kaelbling et al. 1998).”
BackgroundGigerenzer, G., & Gaissmaier, W. (2011) · Annual Review of Psychology · doi:10.1146/annurev-psych-120709-145346 · Cited by 4,037 · cited 2×
“2009) and using heuristic policies (Gigerenzer and Gaissmaier 2011) based on the destruction of costly fixed point attractors (Friston 2010).”
BackgroundMethodWatkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1023/a:1022676722315 · Cited by 3,907 · cited 2×
“This paper considers discrete time (Markov) decision processes of the sort found in optimal control theory, models of behaviour and decision making (Bellman 1952; Watkins and Dayan 1992; Camerer 2003; Daw and Doya 2006; Todorov 2006; Dayan and Daw 2008).”
BackgroundSimple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Research works printed but not linked: 1
- Watkins CJ, Dayan P (1992) Q-learning. Mach Learn 8: 279–292
Cited by
REBUS and the anarchic brain: Toward a unified model of the brain action of psychedelics
Carhart-Harris, R. L., & Friston, K. J. (2019) · Pharmacological Reviews · doi:10.1124/pr.118.017160 · Cited by 1,180
“…to the free-energy principle, we know that an agent can minimize free energy via perceptual (Friston and Kiebel, 2009) and active inference (Friston et al., 2012b), both of which entail sampling and sculpting the world to refine internal representations of it and thus reduce uncertainty or…”
BackgroundSelf-citationActive inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
“We have previously considered epistemic value and salience using continuous time predictive coding schemes and saccadic searches (Friston et al., 2012).”
BackgroundMethodSelf-citationHohwy, J. (2016) · Noûs · doi:10.1111/nous.12062 · Cited by 578
Navigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition
Pezzulo, G., & Cisek, P. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.013 · Cited by 419
“, apple reachability) can influence the competition between proximal actions (picking the berry versus walking) [14].”
The anatomy of choice: active inference and agency
Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00598 · Cited by 340
“…treatments of hierarchical Bayesian inference (Mathys et al., 2011), from theoretical neurobiology (Frank et al., 2007; Fletcher and Frith, 2009; Friston et al., 2012b; Pellicano and Burr, 2012) and from empirical studies (Fiorillo et al., 2008; Coull et al., 2011; Galea et al., 2012; Zokaei et…”
BackgroundMethodInfluentialSelf-citation
Metadata
- Authors
- Friston, K., Samothrakis, S., & Montague, R.
- Affiliations
- Wellcome Centre for Human Neuroimaging (GB)
- University of Essex (GB)
- Corresponding author
- Friston, Karl
- Venue
- Biological Cybernetics
- Published
- 2012-08-03
- Volume
- 106
- Issue
- 8-9
- Pages
- 523-541
- ISSN
- 0340-1200 (ISSN-L)
- 1432-0770
- OpenAlex
- W2091405003
- Cited by
- 241
- References
- 83
- Citations by year
- 2026: 11 · 2025: 16 · 2024: 20 · 2023: 24 · 2022: 12 · 2021: 43 · 2020: 30 · 2019: 24 · 2018: 14 · 2017: 12 · 2016: 10 · 2015: 11 · 2014: 7 · 2013: 4 · 2012: 3
- FWCI
- 4.10
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Biological Cybernetics (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- VTechWorks (Virginia Tech) (submittedVersion)
- Funders
- Wellcome Trust (088130)
- National Institute on Drug Abuse (R01DA011723)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Keywords
- active inference, agency, optimal control, free energy principle, Markov decision process, decision making under uncertainty, Bayesian filtering, prior beliefs, variational inference
- MeSH terms
- Algorithms, Bayes Theorem, Decision Making, Markov Chains, Models, Neurological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Active inference and agency: optimal control without cost functions. https://app.cochat.ai/papers/10.1007/s00422-012-0512-8
- The paper
- Friston, K., Samothrakis, S., & Montague, R. (2012). Active inference and agency: optimal control without cost functions. Biological Cybernetics. https://doi.org/10.1007/s00422-012-0512-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.