The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Defending Yarbus: Eye movements reveal observers' task
Open accessAbstract
In a very influential yet anecdotal illustration, Yarbus suggested that human eye-movement patterns are modulated top down by different task demands. While the hypothesis that it is possible to decode the observer's task from eye movements has received some support (e.g., Henderson, Shinkareva, Wang, Luke, & Olejarczyk, 2013; Iqbal & Bailey, 2004), Greene, Liu, and Wolfe (2012) argued against it by reporting a failure. In this study, we perform a more systematic investigation of this problem, probing a larger number of experimental factors than previously. Our main goal is to determine the informativeness of eye movements for task and mental state decoding. We perform two experiments. In the first experiment, we reanalyze the data from a previous study by Greene et al. (2012) and contrary to their conclusion, we report that it is possible to decode the observer's task from aggregate eye-movement features slightly but significantly above chance, using a Boosting classifier (34.12% correct vs. 25% chance level; binomial test, p = 1.0722e - 04). In the second experiment, we repeat and extend Yarbus's original experiment by collecting eye movements of 21 observers viewing 15 natural scenes (including Yarbus's scene) under Yarbus's seven questions. We show that task decoding is possible, also moderately but significantly above chance (24.21% vs. 14.29% chance-level; binomial test, p = 2.4535e - 06). We thus conclude that Yarbus's idea is supported by our data and continues to be an inspiration for future computational and experimental eye-movement research. From a broader perspective, we discuss techniques, features, limitations, societal and technological impacts, and future directions in task decoding from eye movements.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733
Self-citationThe Strength of Weak Learnability
Schapire, R. E. (1990) · Machine Learning · doi:10.1007/bf00116037 · Cited by 4,600
The information available in brief visual presentations
Sperling, G. (1960) · Psychological Monographs: General and Applied · doi:10.1037/h0093759 · Cited by 4,042
Yarbus, A. L. (1967) · doi:10.1007/978-1-4899-5379-7 · Cited by 3,304
Involuntary covert orienting is contingent on attentional control settings
Folk, C. L., Remington, R. W., & Johnston, J. C. (1992) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.18.4.1030 · Cited by 2,487
Image And Brain: The Resolution of the Imagery Debate
Kosslyn, S. M. (1994) · doi:10.7551/mitpress/3653.001.0001 · Cited by 1,977
Attention to eyes is present but in decline in 2–6-month-old infants later diagnosed with autism
Jones, W., & Klin, A. (2013) · Nature · doi:10.1038/nature12715 · Cited by 1,293
Two-year-olds with autism orient to non-social contingencies rather than biological motion
Klin, A., Lin, D. J., Gorrindo, P., Ramsay, G., & Jones, W. (2009) · Nature · doi:10.1038/nature07868 · Cited by 921
Memory Representations in Natural Tasks
Ballard, D. H., Hayhoe, M. M., & Pelz, J. B. (1995) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1995.7.1.66 · Cited by 817
Cited by
Salient Object Detection: A Benchmark
Borji, A., Cheng, M.-M., Jiang, H., & Li, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2487833 · Cited by 1,364
Self-citationSalient Object Detection in the Deep Learning Era: An In-Depth Survey
Wang, W., Lai, Q., Fu, H., Shen, J., Ling, H., & Yang, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3051099 · Cited by 811
Intrinsic and extrinsic effects on image memorability
Bylinskii, Z., Isola, P., Bainbridge, C., Torralba, A., & Oliva, A. (2015) · Vision Research · doi:10.1016/j.visres.2015.03.005 · Cited by 266
Understanding User Reliance on AI in Assisted Decision-Making
Cao, S., & Huang, C.-M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555572 · Cited by 71
The Theoretical and Methodological Opportunities Afforded by Guided Play With Young Children
Yu, Y., Shafto, P., Bonawitz, E., Yang, S. C.-H., Golinkoff, R. M., Corriveau, K. H., Hirsh-Pasek, K., & Xu, F. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01152 · Cited by 59
Metadata
- Authors
- Borji, A., & Itti, L.
- Venue
- Journal of Vision
- Published
- 2014-03-24
- Volume
- 14
- Issue
- 3
- Pages
- 29-29
- ISSN
- 1534-7362 (ISSN-L)
- OpenAlex
- W2033362164
- Cited by
- 246
- References
- 12
- FWCI
- 46.97
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Defending Yarbus: Eye movements reveal observers' task. https://app.cochat.ai/papers/10.1167/14.3.29
- The paper
- Borji, A., & Itti, L. (2014). Defending Yarbus: Eye movements reveal observers' task. Journal of Vision. https://doi.org/10.1167/14.3.29
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.