Evidence for surprise minimization over value maximization in choice behavior
Open accessThe DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
Classical economic models are predicated on the idea that the ultimate aim of choice is to maximize utility or reward. In contrast, an alternative perspective highlights the fact that adaptive behavior requires agents' to model their environment and minimize surprise about the states they frequent. We propose that choice behavior can be more accurately accounted for by surprise minimization compared to reward or utility maximization alone. Minimizing surprise makes a prediction at variance with expected utility models; namely, that in addition to attaining valuable states, agents attempt to maximize the entropy over outcomes and thus 'keep their options open'. We tested this prediction using a simple binary choice paradigm and show that human decision-making is better explained by surprise minimization compared to utility maximization. Furthermore, we replicated this entropy-seeking behavior in a control task with no explicit utilities. These findings highlight a limitation of purely economic motivations in explaining choice behavior and instead emphasize the importance of belief-based motivations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This marginal likelihood scores the plausibility of a particle pursuing this kind of path and is usually interpreted in terms of expected loss (i.e., negative expected reward or utility) [66, 63], and pragmatic affordance [153, 123].”
From The free energy principle made simpler but not too simple (2023) · cites this paper as [153]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D., & Tversky, A. (1988) · Decision, Probability and Utility · doi:10.1017/cbo9780511609220.014 · Cited by 32,474
Information theory and statistical mechanics
Jaynes, E. T. (1957) · Physical Review · doi:10.1103/physrev.106.620 · Cited by 12,931
Nash, J. F. (1950) · Econometrica · doi:10.2307/1907266 · Cited by 7,840
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Interoceptive inference, emotion, and the embodied self
Seth, A. K. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.007 · Cited by 1,816
Bayesian model selection for group studies
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.025 · Cited by 1,423
Self-citationBayesian surprise attracts human attention
Itti, L., & Baldi, P. (2009) · Vision Research · doi:10.1016/j.visres.2008.09.007 · Cited by 1,224
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.018 · Cited by 809
Self-citationPredictions not commands: Active inference in the motor system
Adams, R. A., Shipp, S., & Friston, K. J. (2013) · Brain Structure and Function · doi:10.1007/s00429-012-0475-5 · Cited by 765
Self-citationActive inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
Self-citationProbabilistic brains: knowns and unknowns
Pouget, A., Beck, J. M., Ma, W. J., & Latham, P. E. (2013) · Nature Neuroscience · doi:10.1038/nn.3495 · Cited by 615
Friston, K. J., Kahan, J., Biswal, B., & Razi, A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.12.009 · Cited by 553
Self-citationCurious model-building control systems
Schmidhuber, J. (1991) · [Proceedings] 1991 IEEE International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1991.170605 · Cited by 541
Computational psychiatry: the brain as a phantastic organ
Friston, K. J., Stephan, K. E., Montague, R., & Dolan, R. J. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70275-5 · Cited by 531
Self-citationActive inference, sensory attenuation and illusions
Brown, H., Adams, R. A., Parees, I., Edwards, M., & Friston, K. (2013) · Cognitive Processing · doi:10.1007/s10339-013-0571-3 · Cited by 488
Self-citationDopamine: generalization and bonuses
Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00048-5 · Cited by 480
Fast and Frugal Heuristics: The Tools of Bounded Rationality
Gigerenzer, G. (2004) · Blackwell Handbook of Judgment and Decision Making · doi:10.1002/9780470752937.ch4 · Cited by 477
Perceptions as Hypotheses: Saccades as Experiments
Friston, K., Adams, R. A., Perrinet, L., & Breakspear, M. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00151 · Cited by 462
Self-citationA free energy principle for biological systems
Karl, F. (2012) · Entropy · doi:10.3390/e14112100 · Cited by 377
Self-citationThe anatomy of choice: active inference and agency
Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00598 · Cited by 340
Self-citationBotvinick, M., & Toussaint, M. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.08.006 · Cited by 292
Does the brain calculate value?
Vlaev, I., Chater, N., Stewart, N., & Brown, G. D. A. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.09.008 · Cited by 289
The anatomy of choice: dopamine and decision-making.
Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0481 · Cited by 289
Self-citationInformation Theory of Decisions and Actions
Tishby, N., & Polani, D. (2011) · Perception-Action Cycle · doi:10.1007/978-1-4419-1452-1_19 · Cited by 267
Computational approaches to psychiatry
Stephan, K. E., & Mathys, C. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.12.007 · Cited by 260
Self-citationBayesian Computation in Recurrent Neural Circuits
Rao, R. P. N. (2004) · Neural Computation · doi:10.1162/08997660460733976 · Cited by 252
The dopaminergic midbrain encodes the expected certainty about desired outcomes
Schwartenbeck, P., FitzGerald, T. H. B., Mathys, C., Dolan, R., & Friston, K. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu159 · Cited by 219
Self-citationProbabilistic models in human sensorimotor control
Wolpert, D. M. (2007) · Human Movement Science · doi:10.1016/j.humov.2007.05.005 · Cited by 212
Exploration, novelty, surprise, and free energy minimization
Schwartenbeck, P., FitzGerald, T., Dolan, R. J., & Friston, K. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00710 · Cited by 207
Self-citationStochastic expected utility theory
Blavatskyy, P. R. (2007) · Journal of Risk and Uncertainty · doi:10.1007/s11166-007-9009-6 · Cited by 147
Loomes, G. (2005) · Experimental Economics · doi:10.1007/s10683-005-5372-9 · Cited by 144
Planning to be surprised: optimal bayesian exploration in dynamic environments
Sun, Y., Gomez, F., & Schmidhuber, J. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22887-2_5 · Cited by 134
Model averaging, optimal inference, and habit formation
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00457 · Cited by 121
Self-citationSelf-deception as self-signalling: a model and experimental evidence
Mijović-Prelec, D., & Prelec, D. (2010) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2009.0218 · Cited by 120
Keep Your Options Open: An Information-Based Driving Principle for Sensorimotor Systems
Klyubin, A. S., Polani, D., & Nehaniv, C. L. (2008) · PLoS ONE · doi:10.1371/journal.pone.0004018 · Cited by 88
Information, Utility and Bounded Rationality
Braun, D. A., & Ortega, P. A. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22887-2_28 · Cited by 85
Active Inference, Evidence Accumulation, and the Urn Task
FitzGerald, T. H. B., Schwartenbeck, P., Moutoussis, M., Dolan, R. J., & Friston, K. (2015) · Neural Computation · doi:10.1162/neco_a_00699 · Cited by 81
Self-citationGriffiths, T. L., & Tenenbaum, J. B. (2011) · Journal of Experimental Psychology: General · doi:10.1037/a0024899 · Cited by 67
Erratum: Computational psychiatry
Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.04.003 · Cited by 65
Self-citationA formal model of interpersonal inference
Moutoussis, M., Trujillo-Barreto, N. J., El-Deredy, W., Dolan, R. J., & Friston, K. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00160 · Cited by 59
Self-citationApproach–Avoidance Processes Contribute to Dissociable Impacts of Risk and Loss on Choice
Wright, N. D., Symmonds, M., Hodgson, K., FitzGerald, T. H. B., Crawford, B., & Dolan, R. J. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.0049-12.2012 · Cited by 42
Self-citationProactive Action Preparation: Seeing Action Preparation as a Continuous and Proactive Process
Pezzulo, G., & Ognibene, D. (2012) · Motor Control · doi:10.1123/mcj.16.3.386 · Cited by 28
Rationalizable Irrationalities of Choice
Dayan, P. (2014) · Topics in Cognitive Science · doi:10.1111/tops.12082 · Cited by 26
A conversion between utility and information
Ortega, P. A., & Braun, D. A. (2010) · Artificial General Intelligence · doi:10.2991/agi.2010.10 · Cited by 23
Research works printed but not linked: 1
- Sun Y., Gomez F. & Schmidhuber J. Planning to Be Surprised: Optimal Bayesian Exploration in Dynamic Environments. Artif Intell 6830, 41– 51 (2011).
Cited by
Active inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156
Self-citationFriston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., ODoherty, J., & Pezzulo, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.022 · Cited by 674
Self-citationOrganoid intelligence (OI): the new frontier in biocomputing and intelligence-in-a-dish
Smirnova, L., Caffo, B. S., Gracias, D. H., Huang, Q., Morales Pantoja, I. E., Tang, B., Zack, D. J., Berlinicke, C. A., Boyd, J. L., Harris, T. D., et al. (2023) · Frontiers in Science · doi:10.3389/fsci.2023.1017235 · Cited by 276
“Broadly, this can be achieved either through maximizing a utility or reward or by minimizing surprise or uncertainty (165, 168).”
BackgroundDeep temporal models and active inference
Friston, K. J., Rosch, R., Parr, T., Price, C., & Bowman, H. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.04.009 · Cited by 237
Self-citationGeneralised free energy and active inference
Parr, T., & Friston, K. J. (2019) · Biological Cybernetics · doi:10.1007/s00422-019-00805-w · Cited by 236
Self-citation
Metadata
- Authors
- Schwartenbeck, P., FitzGerald, T. H. B., Mathys, C., Dolan, R., Kronbichler, M., & Friston, K.
- Affiliations
- Wellcome Centre for Human Neuroimaging (GB)
- University of Salzburg (AT)
- Corresponding author
- Schwartenbeck, Philipp
- ORCID
- Venue
- Scientific Reports
- Published
- 2015-11-13
- Volume
- 5
- Issue
- 1
- Pages
- 16575-16575
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC4643240
- OpenAlex
- W2415954501
- Cited by
- 96
- References
- 47
- Citations by year
- 2026: 4 · 2025: 2 · 2024: 4 · 2023: 18 · 2022: 21 · 2021: 7 · 2020: 12 · 2019: 9 · 2018: 6 · 2017: 4 · 2016: 9
- FWCI
- 4.79
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UEA Digital Repository (University of East Anglia) (acceptedVersion)
- SDL (submittedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Wellcome Trust (091593, 091593/Z/10/, 098362, 098362/Z/12/Z, 091593/Z/10/Z, 098362/Z/12/)
- University College London (098362/Z/12/Z)
- Österreichischen Akademie der Wissenschaften
- Max-Planck-Gesellschaft (098362/Z/12/Z)
- Universität Salzburg
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Experimental Behavioral Economics Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- surprise minimization, entropy maximization, choice behavior, utility maximization, expected utility, adaptive behavior, binary choice, human decision-making
- MeSH terms
- Adolescent, Adult, Algorithms, Choice Behavior, Decision Making, Female, Humans, Male, Motivation, Psychomotor Performance, Reward, Linear Models, Models, Economic, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.