Sensitivity to value-driven attention is predicted by how we learn from value
Open accessAbstract
Reward learning is known to influence the automatic capture of attention. This study examined how the rate of learning, after high- or low-value reward outcomes, can influence future transfers into value-driven attentional capture. Participants performed an instrumental learning task that was directly followed by an attentional capture task. A hierarchical Bayesian reinforcement model was used to infer individual differences in learning from high or low reward. Results showed a strong relationship between high-reward learning rates (or the weight that is put on learning after a high reward) and the magnitude of attentional capture with high-reward colors. Individual differences in learning from high or low rewards were further related to performance differences when high- or low-value distractors were present. These findings provide novel insight into the development of value-driven attentional capture by showing how information updating after desired or undesired outcomes can influence future deployments of automatic attention.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Learned associations keep affecting selection even when the training and test task are very different.
“Some studies have shown, however, that learned associations keep affecting selection even when the training and test task are very different (e.g., Chelazzi et al., 2014; Jahfari & Theeuwes, 2016; Lee & Shomstein, 2014; Raymond & O’Brien, 2009).”
From Selection history: How reward modulates selectivity of visual attention. (2018) · cites this paper as Jahfari & Theeuwes, 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627 · see citing works
Watkins, C., & Dayan, P. (1992) · Machine-mediated learning · doi:10.1023/a:1022676722315 · Cited by 14,277 · see citing works
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083 · see citing works
The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte CarloPreprint
Homan, M. D., & Gelman, A. (2014) · arXiv (Cornell University) · Cited by 2,964 · see citing works
OpenSesame: An open-source, graphical experiment builder for the social sciences
Mathôt, S., Schreij, D., & Theeuwes, J. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0168-7 · Cited by 2,648 · see citing works
Self-citationSelective Attention Gates Visual Processing in the Extrastriate Cortex
Moran, J., & Desimone, R. (1985) · Science · doi:10.1126/science.4023713 · Cited by 2,433 · see citing works
Selective Attention Gates Visual Processing in the Extrastriate Cortex
Moran, J., & Desimone, R. (2003) · The MIT Press eBooks · doi:10.7551/mitpress/2834.003.0024 · Cited by 2,164 · see citing works
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053 · see citing works
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964 · see citing works
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777 · see citing works
Perceptual selectivity for color and form
Theeuwes, J. (1992) · Perception & Psychophysics · doi:10.3758/bf03211656 · Cited by 1,649 · see citing works
Self-citationTop-down versus bottom-up attentional control: a failed theoretical dichotomy
Awh, E., Belopolsky, A. V., & Theeuwes, J. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.06.010 · Cited by 1,557 · see citing works
Self-citationValue-driven attentional capture
Anderson, B. A., Laurent, P. A., & Yantis, S. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1104047108 · Cited by 1,098 · see citing works
Learned predictions of error likelihood in the anterior cingulate cortex
Brown, J. W., & Braver, T. S. (2005) · Science · doi:10.1126/science.1105783 · Cited by 928 · see citing works
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712 · see citing works
Neurocomputational models of working memory
Durstewitz, D., Seamans, J. K., & B, T. J. S. A. (2000) · Nature Neuroscience · doi:10.1038/81460 · Cited by 710 · see citing works
Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning
Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., & Hutchison, K. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706111104 · Cited by 669 · see citing works
Reward Changes Salience in Human Vision via the Anterior Cingulate
Hickey, C., Chelazzi, L., & Theeuwes, J. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1026-10.2010 · Cited by 606 · cited 1× · see citing works
“Because both learning parameters were restricted between 0 and 1, Spearman’s rank correlation (rho) or partial correlation (rhopcor) was used to evaluate capture–learning relationships.”
MethodSelf-citationLearning and selective attention
Dayan, P., Kakade, S., & Montague, P. R. (2000) · Nature Neuroscience · doi:10.1038/81504 · Cited by 495 · see citing works
Trial-by-trial data analysis using computational models
Daw, N. D. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199600434.003.0001 · Cited by 472 · see citing works
Collins, A. G. E., & Frank, M. J. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07980.x · Cited by 419 · see citing works
Visual Selective Attention and the Effects of Monetary Rewards
Libera, C. D., & Chelazzi, L. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01689.x · Cited by 365 · see citing works
Rewards teach visual selective attention
Chelazzi, L., Perlato, A., Santandrea, E., & Della Libera, C. (2013) · Vision Research · doi:10.1016/j.visres.2012.12.005 · Cited by 354 · see citing works
Learning to Attend and to Ignore Is a Matter of Gains and Losses
Della Libera, C., & Chelazzi, L. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02360.x · Cited by 329 · see citing works
How cognitive modeling can benefit from hierarchical Bayesian models
Lee, M. D. (2010) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2010.08.013 · Cited by 307 · see citing works
Anterior cingulate engagement in a foraging context reflects choice difficulty, not foraging value
Shenhav, A., Straccia, M. A., Cohen, J. D., & Botvinick, M. (2014) · Nature Neuroscience · doi:10.1038/nn.3771 · Cited by 277 · see citing works
Kiss, M., Driver, J., & Eimer, M. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02281.x · Cited by 267 · see citing works
Reward grabs the eye: Oculomotor capture by rewarding stimuli
Theeuwes, J., & Belopolsky, A. V. (2012) · Vision Research · doi:10.1016/j.visres.2012.07.024 · Cited by 237 · see citing works
Self-citationReward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus
Ikeda, T., & Hikosaka, O. (2003) · Neuron · doi:10.1016/s0896-6273(03)00464-1 · Cited by 233 · see citing works
Neural Mechanisms of Incentive Salience in Naturalistic Human Vision
Hickey, C., & Peelen, M. V. (2015) · Neuron · doi:10.1016/j.neuron.2014.12.049 · Cited by 201 · see citing works
Value-driven attentional and oculomotor capture during goal-directed, unconstrained viewing
Anderson, B. A., & Yantis, S. (2012) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-012-0348-2 · Cited by 192 · see citing works
Attention, Reward, and Information Seeking
Gottlieb, J., Hayhoe, M., Hikosaka, O., & Rangel, A. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3270-14.2014 · Cited by 168 · see citing works
Disentangling neural representations of value and salience in the human brain
Kahnt, T., Park, S. Q., Haynes, J., & Tobler, P. N. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320189111 · Cited by 153 · see citing works
O’Doherty, J. P. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.03.027 · Cited by 129 · see citing works
The Role of Dopamine in Value-Based Attentional Orienting
Anderson, B. A., Kuwabara, H., Wong, D. F., Gean, E. G., Rahmim, A., Brašić, J. R., George, N., Frolov, B., Courtney, S. M., & Yantis, S. (2016) · Current Biology · doi:10.1016/j.cub.2015.12.062 · Cited by 118 · see citing works
Exogenous visual orienting by reward
Failing, M., & Theeuwes, J. (2014) · Journal of Vision · doi:10.1167/14.5.6 · Cited by 116 · see citing works
Self-citationBayesian parameter estimation in the Expectancy Valence model of the Iowa gambling task
Wetzels, R., Vandekerckhove, J., Tuerlinckx, F., & Wagenmakers, E. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.001 · Cited by 106 · see citing works
Kahnt, T., Park, S. Q., Cohen, M. X., Beck, A., Heinz, A., & Wrase, J. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21092 · Cited by 101 · see citing works
Value-driven attentional priority is context specific
Anderson, B. A. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0724-0 · Cited by 99 · see citing works
The role of reward prediction in the control of attention.
Sali, A. W., Anderson, B. A., & Yantis, S. (2014) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0037267 · Cited by 96 · see citing works
Attention modulates neuronal correlates of interhemispheric integration and global motion perception
Akin, B., Özdem, C., Eroglu-Koc, S., Keskin, D. T., Fang, F., Doerschner, K., Kersten, D., & Boyacı, H. (2014) · Journal of Vision · doi:10.1167/14.12.30 · Cited by 67 · see citing works
Value-based attentional capture influences context-dependent decision-making
Itthipuripat, S., Cha, K., Rangsipat, N., & Serences, J. T. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00343.2015 · Cited by 64 · see citing works
Validating the PVL-Delta model for the Iowa gambling task
Steingroever, H., Wetzels, R., & Wagenmakers, E. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00898 · Cited by 49 · see citing works
Reward speeds up and increases consistency of visual selective attention: a lifespan comparison
Störmer, V. S., Eppinger, B., & Li, S. (2014) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-014-0273-z · Cited by 49 · see citing works
Reward Activates Stimulus-Specific and Task-Dependent Representations in Visual Association Cortices
Schiffer, A., Müller, T., Yeung, N., & Waszak, F. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.1640-14.2014 · Cited by 33 · see citing works
Jahfari, S., Waldorp, L., Ridderinkhof, K. R., & Scholte, H. S. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00792 · Cited by 27 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Selection history: How reward modulates selectivity of visual attention.
Failing, M., & Theeuwes, J. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1380-y · Cited by 345 · see citing works
“Some studies have shown, however, that learned associations keep affecting selection even when the training and test task are very different (e.g., Chelazzi et al., 2014; Jahfari & Theeuwes, 2016; Lee & Shomstein, 2014; Raymond & O’Brien, 2009).”
BackgroundSelf-citation
- Authors
- Jahfari, S., & Theeuwes, J.
- Affiliations
- Vrije Universiteit Amsterdam (NL)
- Corresponding author
- Jahfari, Sara
- Venue
- Psychonomic Bulletin & Review
- Published
- 2016-06-29
- Volume
- 24
- Issue
- 2
- Pages
- 408-415
- ISSN
- 1069-9384 (ISSN-L)
- 1531-5320
- PMC
- PMC5389992
- OpenAlex
- W2472323680
- Cited by
- 28
- References
- 48
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 4 · 2022: 1 · 2021: 2 · 2020: 6 · 2019: 7 · 2018: 4 · 2017: 1 · 2016: 1
- FWCI
- 2.75
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Psychonomic Bulletin & Review (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- VU Research Portal (publishedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- European Research Council (ERC-2012-AdG-323413)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- value-driven attention, attentional capture, reward learning, learning rate, individual differences, operant conditioning, distractor processing, automatic attention
- MeSH terms
- Adolescent, Adult, Attention, Bayes Theorem, Color Perception, Conditioning, Operant, Feedback, Female, Humans, Individuality, Male, Motivation, Pattern Recognition, Visual, Probability Learning, Reaction Time, Reinforcement, Psychology, Reward, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
