Reward has a residual impact on target selection in visual search, but not on the suppression of distractors
Abstract
In the reinforcement learning literature, good outcome following selection of a visual object is thought to bias perception and attention in favour of similar objects in later experience. This impact of reward might be instantiated in two ways: Reward could prime target features or it could act to facilitate suppression of distractors present when reward was received. Here we report results from an experiment in which reward outcome was selectively associated either with the colour defining a visual search target or with the colour defining a salient distractor in the display. Reward's impact on search was evident only when it was tied to the target; reward made it no easier to ignore a distractor when it subsequently reappeared as a distractor. This suggests that reward acts largely to prime target representations, consistent with the idea that objects associated with good outcome become visually salient.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Reward intertrial priming affects predominantly target representations.
“reward intertrial priming affects predominantly target representations (e.g., Hickey, Chelazzi, & Theeuwes, 2011; Kristjánsson et al., 2010).”
From Selection history: How reward modulates selectivity of visual attention. (2018) · cites this paper as Hickey, Chelazzi, & Theeuwes, 2011
Cites
Neural Mechanisms of Selective Visual Attention
Desimone, R., & Duncan, J. (1995) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.18.030195.001205 · Cited by 8,388 · see citing works
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127 · see citing works
Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method
Cousineau, D. (2005) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.01.1.p042 · Cited by 1,969 · see citing works
Ikemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450 · see citing works
Attentional modulation of visual processing
Reynolds, J. H., & Chelazzi, L. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.26.041002.131039 · Cited by 1,158 · see citing works
Self-citationSpatial filtering during visual search: Evidence from human electrophysiology.
Luck, S. J., & Hillyard, S. A. (1994) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.20.5.1000 · Cited by 1,122 · see citing works
A neural basis for visual search in inferior temporal cortex
Chelazzi, L., Miller, E. K., Duncan, J., & Desimone, R. (1993) · Nature · doi:10.1038/363345a0 · Cited by 1,114 · see citing works
Self-citationPriming of pop-out: I. Role of features
Maljkovic, V., & Nakayama, K. (1994) · Memory & Cognition · doi:10.3758/bf03209251 · Cited by 1,107 · see citing works
Perceptual load as a major determinant of the locus of selection in visual attention
Lavie, N., & Tsal, Y. (1994) · Perception & Psychophysics · doi:10.3758/bf03213897 · Cited by 870 · see citing works
Cross-dimensional perceptual selectivity
Theeuwes, J. (1991) · Perception & Psychophysics · doi:10.3758/bf03212219 · Cited by 711 · see citing works
Self-citationElectrophysiological Indices of Target and Distractor Processing in Visual Search
Hickey, C., Di Lollo, V., & McDonald, J. J. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21039 · Cited by 607 · see citing works
Self-citationReward Changes Salience in Human Vision via the Anterior Cingulate
Hickey, C., Chelazzi, L., & Theeuwes, J. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1026-10.2010 · Cited by 606 · see citing works
Self-citationElectrophysiological Evidence of the Capture of Visual Attention
Hickey, C., McDonald, J. J., & Theeuwes, J. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.4.604 · Cited by 475 · see citing works
Self-citationLuck, S. J., Girelli, M., McDermott, M. T., & Ford, M. A. (1997) · Cognitive Psychology · doi:10.1006/cogp.1997.0660 · Cited by 462 · see citing works
What does a Man do after he Makes an Error? An Analysis of Response Programming
Rabbitt, P., & Rodgers, B. (1977) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640747708400645 · Cited by 399 · see citing works
Found, A., & Müller, H. J. (1996) · Perception & Psychophysics · doi:10.3758/bf03205479 · Cited by 395 · see citing works
Learning to Attend and to Ignore Is a Matter of Gains and Losses
Della Libera, C., & Chelazzi, L. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02360.x · Cited by 329 · see citing works
Self-citationPerceptual learning rules based on reinforcers and attention
Roelfsema, P. R., Arjen Van Ooyen, B., & Watanabe, T. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.11.005 · Cited by 277 · see citing works
Kiss, M., Driver, J., & Eimer, M. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02281.x · Cited by 267 · see citing works
Attention-Gated Reinforcement Learning of Internal Representations for Classification
Roelfsema, P. R., & van Ooyen, A. (2005) · Neural Computation · doi:10.1162/0899766054615699 · Cited by 258 · see citing works
Reward modulates attention independently of action value in posterior parietal cortex
Peck, C. J., Jangraw, D. C., Suzuki, M., Efem, R., & Gottlieb, J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1929-09.2009 · Cited by 219 · see citing works
Hopf, J.-M., Boelmans, K., Schoenfeld, M. A., Luck, S. J., & Heinze, H.-J. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3564-03.2004 · Cited by 209 · see citing works
Reward Guides Vision when It's Your Thing: Trait Reward-Seeking in Reward-Mediated Visual Priming
Hickey, C., Chelazzi, L., & Theeuwes, J. (2010) · PLoS ONE · doi:10.1371/journal.pone.0014087 · Cited by 164 · see citing works
Self-citationKristjansson, A. K., & Driver, J. (2008) · Vision Research · doi:10.1016/j.visres.2008.02.007 · Cited by 159 · see citing works
Kingstone, A. F. (1992) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640749208401284 · Cited by 150 · see citing works
Kristjansson, A., Sigurjonsdottir, O., & Driver, J. (2010) · Attention, Perception & Psychophysics · doi:10.3758/app.72.5.1229 · Cited by 137 · see citing works
Electrophysiological markers of visual dimension changes and response changes.
Töllner, T., Gramann, K., Müller, H. J., Kiss, M., & Martin Eimer, A. (2008) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.34.3.531 · Cited by 122 · see citing works
Locus of dimension weighting: Preattentive or postselective?
Müller, H. J., & Krummenacher, J. (2006) · Visual Cognition · doi:10.1080/13506280500194154 · Cited by 108 · see citing works
Muller, H. J., Krummenacher, J., & Heller, D. (2004) · Visual Cognition · doi:10.1080/13506280344000419 · Cited by 83 · see citing works
Geyer, T., Müller, H. J., & Krummenacher, J. (2007) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.33.4.788 · Cited by 55 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Selection history: How reward modulates selectivity of visual attention.
Failing, M., & Theeuwes, J. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1380-y · Cited by 345 · see citing works
Self-citationRewards teach visual selective attention
Chelazzi, L., Perlato, A., Santandrea, E., & Della Libera, C. (2013) · Vision Research · doi:10.1016/j.visres.2012.12.005 · Cited by 354 · see citing works
Self-citationAttention and associative learning in humans: An integrative review.
Le Pelley, M. E., Mitchell, C. J., Beesley, T., George, D. N., & Wills, A. J. (2016) · Psychological Bulletin · doi:10.1037/bul0000064 · Cited by 329 · see citing works
Grounding cognitive control in associative learning
Abrahamse, E., Braem, S., Notebaert, W., & Verguts, T. (2016) · Psychological Bulletin · doi:10.1037/bul0000047 · Cited by 276 · see citing works
Reward grabs the eye: Oculomotor capture by rewarding stimuli
Theeuwes, J., & Belopolsky, A. V. (2012) · Vision Research · doi:10.1016/j.visres.2012.07.024 · Cited by 237 · see citing works
Self-citationAltering Spatial Priority Maps via Reward-Based Learning
Chelazzi, L., E to inova, J., Calletti, R., Lo Gerfo, E., Sani, I., Della Libera, C., & Santandrea, E. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0277-14.2014 · Cited by 195 · see citing works
Self-citationValue-driven attentional and oculomotor capture during goal-directed, unconstrained viewing
Anderson, B. A., & Yantis, S. (2012) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-012-0348-2 · Cited by 192 · see citing works
Automatic versus Choice-Dependent Value Representations in the Human Brain
Grueschow, M., Polania, R., Hare, T. A., & Ruff, C. C. (2015) · Neuron · doi:10.1016/j.neuron.2014.12.054 · Cited by 130 · see citing works
Reward guides attention to object categories in real-world scenes.
Hickey, C., Kaiser, D., & Peelen, M. V. (2015) · Journal of Experimental Psychology: General · doi:10.1037/a0038627 · Cited by 91 · see citing works
Self-citationPearson, D., Osborn, R., Whitford, T. J., Failing, M., Theeuwes, J., & Le Pelley, M. E. (2016) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-016-1135-2 · Cited by 65 · see citing works
Self-citationHuman ventromedial prefrontal lesions alter incentivisation by reward
Manohar, S. G., & Husain, M. (2016) · Cortex · doi:10.1016/j.cortex.2016.01.005 · Cited by 62 · see citing works
Reward can modulate attentional capture, independent of top-down set
Munneke, J., Hoppenbrouwers, S. S., & Theeuwes, J. (2015) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-015-0958-6 · Cited by 51 · see citing works
Self-citationRewarded visual items capture attention only in heterogeneous contexts
Feldmann‐Wüstefeld, T., Brandhofer, R., & Schubö, A. (2016) · Psychophysiology · doi:10.1111/psyp.12641 · Cited by 49 · see citing works
Vaidya, A. R., & Fellows, L. K. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.1607-15.2015 · Cited by 37 · see citing works
- Authors
- Hickey, C., Chelazzi, L., & Theeuwes, J.
- Affiliations
- Vrije Universiteit Amsterdam (NL)
- University of Verona (IT)
- Corresponding author
- Hickey, Clayton
- Venue
- Visual Cognition
- Publisher
- Informa UK Limited
- Published
- 2011-01
- Volume
- 19
- Issue
- 1
- Pages
- 117-128
- ISSN
- 1350-6285 (ISSN-L)
- 1464-0716
- OpenAlex
- W2110335215
- Cited by
- 89
- References
- 30
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 1 · 2023: 5 · 2022: 5 · 2021: 2 · 2020: 3 · 2019: 5 · 2018: 3 · 2017: 8 · 2016: 10 · 2015: 11 · 2014: 14 · 2013: 7 · 2012: 8
- FWCI
- 7.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Visual Cognition (publishedVersion)
- Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) (submittedVersion)
- Institutional Research Information System (Università degli Studi di Trento) (submittedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- VU Research Portal (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- reward, visual search, distractor suppression, target selection, reinforcement learning, visual saliency, attention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review