Gaze Control as Prediction
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
The recent study of overt attention during complex scene viewing has emphasized explaining gaze behavior in terms of image properties and image salience independently of the viewer's intentions and understanding of the scene. In this Opinion article, I outline an alternative approach proposing that gaze control in natural scenes can be characterized as the result of knowledge-driven prediction. This view provides a theoretical context for integrating and unifying many of the disparate phenomena observed in active scene viewing, offers the potential for integrating the behavioral study of gaze with the neurobiological study of eye movements, and provides a theoretical framework for bridging gaze control and other related areas of perception and cognition at both computational and neurobiological levels of analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 1×
“First, it allows integration with other areas of cognitive science and neuroscience that consider the fundamental function of brains and their cognitive systems to be the generation of predictions [8,10,51].”
BackgroundEye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733
The attention system of the human brain: 20 years after
Petersen, S. E., & Posner, M. I. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150525 · Cited by 3,439 · cited 1×
“At the neurobiological level of analysis, it is well known that many of the systems that are involved in the neural control of eye movements are also involved in the control of covert visual attention [70].”
BackgroundYarbus, A. L. (1967) · doi:10.1007/978-1-4899-5379-7 · Cited by 3,304
Hierarchical Bayesian inference in the visual cortex
Lee, T. S., & Mumford, D. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001434 · Cited by 1,473
Bayesian surprise attracts human attention
Itti, L., & Baldi, P. (2009) · Vision Research · doi:10.1016/j.visres.2008.09.007 · Cited by 1,224
What do we mean by prediction in language comprehension?
Kuperberg, G. R., & Jaeger, T. F. (2016) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2015.1102299 · Cited by 1,087
Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis
Glimcher, P. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014269108 · Cited by 955 · cited 1×
“This perspective has recently been adopted in many areas of cognitive science and cognitive neuroscience, including learning [52], memory [53–55], reward in motor planning [56,57], object and event perception [58,59], language processing [60–64], high-level scene perception [65], and reading [66,67] (Box 2).”
BackgroundExpectation in perceptual decision making: neural and computational mechanisms
Summerfield, C., & de Lange, F. P. (2014) · Nature Reviews Neuroscience · doi:10.1038/nrn3838 · Cited by 832
Neural mechanisms for detecting and remembering novel events
Ranganath, C., & Rainer, G. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1052 · Cited by 779
Eye guidance in natural vision: reinterpreting salience
Tatler, B. W., Hayhoe, M. M., Land, M. F., & Ballard, D. H. (2011) · Journal of Vision · doi:10.1167/11.5.5 · Cited by 775
From eye movements to actions: how batsmen hit the ball
Land, M. F., & McLeod, P. (2000) · Nature Neuroscience · doi:10.1038/81887 · Cited by 725 · cited 2×
“For example, in a set of classic studies using an early portable eye tracker, cricket batters were found to direct their attention to the location on the ground where the ball will bounce on the way to the batsman [41].”
BackgroundEvidence for a hierarchy of predictions and prediction errors in human cortex
Wacongne, C., Labyt, E., van Wassenhove, V., Bekinschtein, T., Naccache, L., & Dehaene, S. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1117807108 · Cited by 560
Perceptions as Hypotheses: Saccades as Experiments
Friston, K., Adams, R. A., Perrinet, L., & Breakspear, M. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00151 · Cited by 462 · cited 1×
“First, it allows integration with other areas of cognitive science and neuroscience that consider the fundamental function of brains and their cognitive systems to be the generation of predictions [8,10,51].”
BackgroundDecision making, movement planning and statistical decision theory
Trommershäuser, J., Maloney, L. T., & Landy, M. S. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.04.010 · Cited by 314
Diaz, G., Cooper, J., Rothkopf, C., & Hayhoe, M. (2013) · Journal of Vision · doi:10.1167/13.1.20 · Cited by 196
Memory and prediction in natural gaze control.
Diaz, G., Cooper, J., & Hayhoe, M. (2013) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0064 · Cited by 57 · cited 1×
“This type of prediction is not restricted to cricket [43,44].”
Background
Cited by
Meaning-based guidance of attention in scenes as revealed by meaning maps
Henderson, J. M., & Hayes, T. R. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0208-0 · Cited by 259
Self-citationA review of gaze entropy as a measure of visual scanning efficiency
Shiferaw, B., Downey, L., & Crewther, D. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.12.007 · Cited by 203
Predictive Coding: a Theoretical and Experimental Review
Millidge, B., Seth, A., & Buckley, C. L. (2021) · arXiv · doi:10.48550/arxiv.2107.12979 · Cited by 106
Bonner, M. F., & Epstein, R. A. (2021) · Nature Communications · doi:10.1038/s41467-021-24368-2 · Cited by 96
How the Brain’s Navigation System Shapes Our Visual Experience
Nau, M., Julian, J. B., & Doeller, C. F. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.06.008 · Cited by 79
Metadata
- Authors
- Henderson, J. M.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2017-01
- Volume
- 21
- Issue
- 1
- Pages
- 15-23
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W2560145178
- Cited by
- 201
- References
- 20
- FWCI
- 3.99
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.