Human visual exploration reduces uncertainty about the sensed world
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
In previous papers, we introduced a normative scheme for scene construction and epistemic (visual) searches based upon active inference. This scheme provides a principled account of how people decide where to look, when categorising a visual scene based on its contents. In this paper, we use active inference to explain the visual searches of normal human subjects; enabling us to answer some key questions about visual foraging and salience attribution. First, we asked whether there is any evidence for 'epistemic foraging'; i.e. exploration that resolves uncertainty about a scene. In brief, we used Bayesian model comparison to compare Markov decision process (MDP) models of scan-paths that did-and did not-contain the epistemic, uncertainty-resolving imperatives for action selection. In the course of this model comparison, we discovered that it was necessary to include non-epistemic (heuristic) policies to explain observed behaviour (e.g., a reading-like strategy that involved scanning from left to right). Despite this use of heuristic policies, model comparison showed that there is substantial evidence for epistemic foraging in the visual exploration of even simple scenes. Second, we compared MDP models that did-and did not-allow for changes in prior expectations over successive blocks of the visual search paradigm. We found that implicit prior beliefs about the speed and accuracy of visual searches changed systematically with experience. Finally, we characterised intersubject variability in terms of subject-specific prior beliefs. Specifically, we used canonical correlation analysis to see if there were any mixtures of prior expectations that could predict between-subject differences in performance; thereby establishing a quantitative link between different behavioural phenotypes and Bayesian belief updating. We demonstrated that better scene categorisation performance is consistently associated with lower reliance on heuristics; i.e., a greater use of a generative model of the scene to direct its exploration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Yarbus, A. L. (1967) · doi:10.1007/978-1-4899-5379-7 · Cited by 3,304
Kapur, S. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.13 · Cited by 2,813
Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention
Chun, M. M., & Jiang, Y. (1998) · Cognitive Psychology · doi:10.1006/cogp.1998.0681 · Cited by 1,959
Bayesian surprise attracts human attention
Itti, L., & Baldi, P. (2009) · Vision Research · doi:10.1016/j.visres.2008.09.007 · Cited by 1,224
Active inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156
Self-citationVariational free energy and the Laplace approximation
Friston, K., Mattout, J., Trujillo-Barreto, N., Ashburner, J., & Penny, W. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.08.035 · Cited by 880
Self-citationActive inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
Self-citationFriston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., ODoherty, J., & Pezzulo, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.022 · Cited by 674
Self-citationScene Construction, Visual Foraging, and Active Inference
Mirza, M. B., Adams, R. A., Mathys, C. D., & Friston, K. J. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00056 · Cited by 165
Self-citation
Research works printed but not linked: 16
- CE Shannon, 1948, A mathematical theory of communication, The Bell System Technical Journal, 27, 379, 10.1002/j.1538-7305.1948.tb01338.x · DOI · Paper page
- Attias H. Planning by Probabilistic Inference. Proc. of the 9th Int. Workshop on Artificial Intelligence and Statistics; 2003; Key West, Florida, USA.
- M Botvinick, 2012, Planning as inference, Trends Cogn Sci, 16, 485, 10.1016/j.tics.2012.08.006 · DOI · Paper page
- KJ Friston, 2016, Bayesian model reduction and empirical Bayes for group (DCM) studies, Neuroimage, 128, 413, 10.1016/j.neuroimage.2015.11.015 · DOI · Paper page
- DH Brainard, 1997, The psychophysics toolbox, Spatial Vision, 10, 433, 10.1163/156856897X00357 · DOI · Paper page
- DG Pelli, 1997, The VideoToolbox software for visual psychophysics: transforming numbers into movies, Spatial Vision, 10, 437, 10.1163/156856897X00366 · DOI · Paper page
- M Kleiner, 2007, What’s new in psychtoolbox-3, Perception, 36, 1
- L Itti, 2000, A salience-based search mechanism for overt and covert shifts of visual attention, Vision Research, 40, 1489, 10.1016/S0042-6989(99)00163-7 · DOI · Paper page
- D Parkhurst, 2002, Modeling the role of salience in the allocation of overt visual attention, Vision Research, 42, 107, 10.1016/S0042-6989(01)00250-4 · DOI · Paper page
- R Rosenholtz, 1999, A simple saliency model predicts a number of motion popout phenomena, Vision Research, 39, 3157, 10.1016/S0042-6989(99)00077-2 · DOI · Paper page
- DJ Parkhurst, 2003, Scene content selected by active vision, Spatial Vision, 16, 125, 10.1163/15685680360511645 · DOI · Paper page
- MM Chun, 2000, Contextual cueing of visual attention, Trends in Cognitive Sciences, 4, 170, 10.1016/S1364-6613(00)01476-5 · DOI · Paper page
- MB Neider, 2006, Scene context guides eye movements during visual search, Vision Research, 46, 614, 10.1016/j.visres.2005.08.025 · DOI · Paper page
- JR Brockmole, 2005, Prioritization of new objects in real-world scenes: Evidence from eye movements, Journal of Experimental Psychology: Human Perception and Performance, 31, 857
- JR Brockmole, 2005, Object appearance, disappearance, and attention prioritization in real-world scenes, Psychonomic Bulletin & Review, 12, 1061, 10.3758/BF03206444 · DOI
- GR Loftus, 1978, Cognitive determinants of fixation location during picture viewing, Journal of Experimental Psychology: Human Perception and Performance, 4, 565
Cited by
Selective Sparse Sampling for Fine-Grained Image Recognition
Ding, Y., Zhou, Y., Zhu, Y., Ye, Q., & Jiao, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00670 · Cited by 278
A step-by-step tutorial on active inference and its application to empirical data
Smith, R., Friston, K. J., & Whyte, C. J. (2022) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2021.102632 · Cited by 246
Self-citationActive inference on discrete state-spaces: A synthesis
Da Costa, L., Parr, T., Sajid, N., Veselic, S., Neacsu, V., & Friston, K. (2020) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2020.102447 · Cited by 226
Self-citationNeuronal message passing using mean-field, bethe, and marginal approximations
Parr, T., Markovic, D., Kiebel, S. J., & Friston, K. J. (2019) · Scientific Reports · doi:10.1038/s41598-018-38246-3 · Cited by 128
Self-citationPerceptual awareness and active inference
Parr, T., Corcoran, A. W., Friston, K. J., & Hohwy, J. (2019) · Neuroscience of Consciousness · doi:10.1093/nc/niz012 · Cited by 91
“validated empirically in human subjects (Mirza et al. 2018).”
Self-citation
Metadata
- Authors
- Mirza, M. B., Adams, R. A., Mathys, C., & Friston, K. J.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-01-05
- Volume
- 13
- Issue
- 1
- Pages
- e0190429
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2782189646
- Cited by
- 85
- References
- 9
- FWCI
- 5.98
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Perception and Action in Complex Environments, Marie-Sklodowska-Curie Grant Agreement (642961)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Human visual exploration reduces uncertainty about the sensed world. https://app.cochat.ai/papers/10.1371/journal.pone.0190429
- The paper
- Mirza, M. B., Adams, R. A., Mathys, C., & Friston, K. J. (2018). Human visual exploration reduces uncertainty about the sensed world. PLOS ONE. https://doi.org/10.1371/journal.pone.0190429
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.