The DOI matches its Crossref record; 59 of the 60 references it cites were found in a registry or an index.
Attention, Reward, and Information Seeking
Open accessAbstract
Decision making is thought to be guided by the values of alternative options and involve the accumulation of evidence to an internal bound. However, in natural behavior, evidence accumulation is an active process whereby subjects decide when and which sensory stimulus to sample. These sampling decisions are naturally served by attention and rapid eye movements (saccades), but little is known about how saccades are controlled to guide future actions. Here we review evidence that was discussed at a recent symposium, which suggests that information selection involves basal ganglia and cortical mechanisms and that, across different contexts, it is guided by two central factors: the gains in reward and gains in information (uncertainty reduction) associated with sensory cues.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Research has shown that because agents find pleasure in reducing manageable uncertainty, they are attracted to just-uncertain-enough environments”
From Active inference goes to school: the importance of active learning in the age of large language models (2024) · cites this paper as [53]
Citations
Cites
The magical number 4 in short-term memory: A reconsideration of mental storage capacity
Cowan, N. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01003922 · Cited by 6,779
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764
Visual fixations and the computation and comparison of value in simple choice
Krajbich, I., Armel, C., & Rangel, A. (2010) · Nature Neuroscience · doi:10.1038/nn.2635 · Cited by 1,408
Self-citationRole of the Basal Ganglia in the Control of Purposive Saccadic Eye Movements
Hikosaka, O., Takikawa, Y., & Kawagoe, R. (2000) · Physiological Reviews · doi:10.1152/physrev.2000.80.3.953 · Cited by 1,334
Self-citationSharot, T. (2011) · Current Biology · doi:10.1016/j.cub.2011.10.030 · Cited by 1,187
Value-driven attentional capture
Anderson, B. A., Laurent, P. A., & Yantis, S. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1104047108 · Cited by 1,098
The representation of visual salience in monkey parietal cortex
Gottlieb, J. P., Kusunoki, M., & Goldberg, M. E. (1998) · Nature · doi:10.1038/35135 · Cited by 1,078
Self-citationLongitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey
Selemon, L. D., & Goldman-Rakic, P. S. (1985) · Journal of Neuroscience · doi:10.1523/jneurosci.05-03-00776.1985 · Cited by 1,074
Attention, intention, and priority in the parietal lobe
Bisley, J. W., & Goldberg, M. E. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-060909-152823 · Cited by 1,043
The Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928
Neuronal Activity in the Lateral Intraparietal Area and Spatial Attention
Bisley, J. W., & Goldberg, M. E. (2003) · Science · doi:10.1126/science.1077395 · Cited by 821
Eye guidance in natural vision: reinterpreting salience
Tatler, B. W., Hayhoe, M. M., Land, M. F., & Ballard, D. H. (2011) · Journal of Vision · doi:10.1167/11.5.5 · Cited by 775
Self-citationKrajbich, I. M., & Rangel, A. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1101328108 · Cited by 774
Self-citationExpectation of reward modulates cognitive signals in the basal ganglia
Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998) · Nature Neuroscience · doi:10.1038/1625 · Cited by 643
Self-citationA computational model of action selection in the basal ganglia. I. A new functional anatomy
GURNEY, K. N., Prescott, T. J., & Redgrave, P. (2001) · Biological Cybernetics · doi:10.1007/pl00007984 · Cited by 633
Choosing the greater of two goods: neural currencies for valuation and decision making
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536
Hikosaka, O., & Wurtz, R. H. (1985) · Journal of Neurophysiology · doi:10.1152/jn.1985.53.1.292 · Cited by 478
Self-citationA visual salience map in the primate frontal eye field
Thompson, K. G., & Bichot, N. P. (2005) · Progress in Brain Research · doi:10.1016/s0079-6123(04)47019-8 · Cited by 431
Biasing simple choices by manipulating relative visual attention
Armel, K. C., Beaumel, A., & Rangel, A. (2008) · Judgment and Decision Making · doi:10.1017/s1930297500000413 · Cited by 428
Self-citationRelative visual saliency differences induce sizable bias in consumer choice
Milosavljevic, M., Navalpakkam, V., Koch, C., & Rangel, A. (2011) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2011.10.002 · Cited by 426
Self-citationNeuronal representations of cognitive state: reward or attention?
Maunsell, J. H. R. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.04.003 · Cited by 404
The Attentional Drift-Diffusion Model Extends to Simple Purchasing Decisions
Krajbich, I. M., Lu, D., Camerer, C. F., & Rangel, A. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00193 · Cited by 392
Self-citationBasal ganglia orient eyes to reward
Hikosaka, O., Nakamura, K., & Nakahara, H. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00458.2005 · Cited by 377
Self-citationRewards teach visual selective attention
Chelazzi, L., Perlato, A., Santandrea, E., & Della Libera, C. (2013) · Vision Research · doi:10.1016/j.visres.2012.12.005 · Cited by 354
Parthasarathy, H. B., Schall, J. D., & Graybiel, A. M. (1992) · Journal of Neuroscience · doi:10.1523/jneurosci.12-11-04468.1992 · Cited by 353
Visual and oculomotor selection: links, causes and implications for spatial attention.
Awh, E., Armstrong, K. M., & Moore, T. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.01.001 · Cited by 340
Lim, S.-L., O'Doherty, J. P., & Rangel, A. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1246-11.2011 · Cited by 329
Self-citationLearning to Attend and to Ignore Is a Matter of Gains and Losses
Della Libera, C., & Chelazzi, L. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02360.x · Cited by 329
Saint‐Cyr, J. A., Ungerleider, L. G., & Desimone, R. (1990) · The Journal of Comparative Neurology · doi:10.1002/cne.902980202 · Cited by 319
Modulation of saccadic eye movements by predicted reward outcome
Takikawa, Y., Kawagoe, R., Itoh, H., Nakahara, H., & Hikosaka, O. (2002) · Experimental Brain Research · doi:10.1007/s00221-001-0928-1 · Cited by 287
Self-citationDistinct neural mechanisms of distractor suppression in the frontal and parietal lobe
Suzuki, M., & Gottlieb, J. (2013) · Nature Neuroscience · doi:10.1038/nn.3282 · Cited by 281
Self-citationTowal, R. B., Mormann, M. M., & Koch, C. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1304429110 · Cited by 268
Prefrontal contributions to visual selective attention
Squire, R. F., Noudoost, B., Schafer, R. J., & Moore, T. (2013) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150439 · Cited by 260
Attention, learning, and the value of information
Gottlieb, J. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.034 · Cited by 241
Self-citationReward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus
Ikeda, T., & Hikosaka, O. (2003) · Neuron · doi:10.1016/s0896-6273(03)00464-1 · Cited by 233
Self-citationReward modulates attention independently of action value in posterior parietal cortex
Peck, C. J., Jangraw, D. C., Suzuki, M., Efem, R., & Gottlieb, J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1929-09.2009 · Cited by 219
Self-citationDistinct Basal Ganglia Circuits Controlling Behaviors Guided by Flexible and Stable Values
Kim, H. F., & Hikosaka, O. (2013) · Neuron · doi:10.1016/j.neuron.2013.06.044 · Cited by 214
Self-citationRole of Primate Substantia Nigra Pars Reticulata in Reward-Oriented Saccadic Eye Movement
Sato, M., & Hikosaka, O. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-06-02363.2002 · Cited by 191
Self-citationReward Guides Vision when It's Your Thing: Trait Reward-Seeking in Reward-Mediated Visual Priming
Hickey, C., Chelazzi, L., & Theeuwes, J. (2010) · PLoS ONE · doi:10.1371/journal.pone.0014087 · Cited by 164
In Monkeys Making Value-Based Decisions, LIP Neurons Encode Cue Salience and Not Action Value
Leathers, M. L., & Olson, C. R. (2012) · Science · doi:10.1126/science.1226405 · Cited by 133
What and Where Information in the Caudate Tail Guides Saccades to Visual Objects
Yamamoto, S., Monosov, I. E., Yasuda, M., & Hikosaka, O. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.0828-12.2012 · Cited by 130
Self-citationResponses of striatal neurons in the behaving monkey. 2. Visual processing in the caudal neostriatum
Caan, W., Perrett, D. I., & Rolls, E. T. (1984) · Brain Research · doi:10.1016/0006-8993(84)90735-2 · Cited by 127
Modeling Task Control of Eye Movements
Hayhoe, M., & Ballard, D. H. (2014) · Current Biology · doi:10.1016/j.cub.2014.05.020 · Cited by 125
Self-citationYamamoto, S., Kim, H. F., & Hikosaka, O. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.0318-13.2013 · Cited by 121
Self-citationModeling embodied visual behaviors
Sprague, N. R., Ballard, D. H., & Robinson, A. E. (2007) · ACM Transactions on Applied Perception · doi:10.1145/1265957.1265960 · Cited by 118
Kori, A. A., Miyashita, N., Kato, M., Hikosaka, O., Usui, S., & Matsumura, M. (1995) · Journal of Neuroscience · doi:10.1523/jneurosci.15-01-00928.1995 · Cited by 118
Self-citationRobust Representation of Stable Object Values in the Oculomotor Basal Ganglia
Yasuda, M., Yamamoto, S., & Hikosaka, O. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.3438-12.2012 · Cited by 104
Self-citationControl of attention and gaze in complex environments
Jovancevic, J., Sullivan, B. T., & Hayhoe, M. (2006) · Journal of Vision · doi:10.1167/6.12.9 · Cited by 103
Self-citationEffects of caudate nucleus stimulation on substantia nigra cell activity in monkey
Hikosaka, O., Sakamoto, M., & Miyashita, N. (1993) · Experimental Brain Research · doi:10.1007/bf00227139 · Cited by 98
Self-citationResponses of cells in the tail of the caudate nucleus during visual discrimination learning
Brown, V. J., Desimone, R., & Mishkin, M. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.74.3.1083 · Cited by 90
Hikosaka, O., Yamamoto, S., Yasuda, M., & Kim, H. F. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.07.001 · Cited by 88
Self-citationThe role of uncertainty and reward on eye movements in a virtual driving task
Sullivan, B. T., Johnson, L., Rothkopf, C. A., Ballard, D., & Hayhoe, M. (2012) · Journal of Vision · doi:10.1167/12.13.19 · Cited by 85
Self-citationKim, H. F., Ghazizadeh, A., & Hikosaka, O. (2014) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2014.00120 · Cited by 75
Self-citationNovelty Enhances Visual Salience Independently of Reward in the Parietal Lobe
Foley, N. C., Jangraw, D. C., Peck, C., & Gottlieb, J. P. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4171-13.2014 · Cited by 63
Self-citationControl of gaze while walking: Task structure, reward, and uncertainty
Tong, M. H., Zohar, O., & Hayhoe, M. (2017) · Journal of Vision · doi:10.1167/17.1.28 · Cited by 53
Self-citationMultistable binocular feature-integrated percepts are frozen by intermittent presentation
Kang, P., & Shevell, S. K. (2011) · Journal of Vision · doi:10.1167/11.1.5 · Cited by 42
Distractors slow information accumulation in simple feature search
Kent, C. D., Howard, C. J., & Gilchrist, I. D. (2012) · Journal of Vision · doi:10.1167/12.1.13 · Cited by 28
Automatic Control of Visual Selection
Theeuwes, J. (2012) · Nebraska Symposium on Motivation/The Nebraska symposium on motivation · doi:10.1007/978-1-4614-4794-8_3 · Cited by 13
The effects of task and uncertainty on gaze while walking
Tong, M. H., & Hayhoe, M. (2013) · Journal of Vision · doi:10.1167/13.9.514 · Cited by 1
Self-citation
Cited by
Sorted by citations
Diffusion decision model: Current issues and history
Ratcliff, R., Smith, P. L., Brown, S. D., & McKoon, G. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.01.007 · Cited by 1,630
“This and other diffusion models have been used to account for, among other things, value-based decision, social choice, and purchasing decisions [150,152,153,157,207–210].”
MethodThe Psychology and Neuroscience of Curiosity
Kidd, C., & Hayden, B. Y. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.010 · Cited by 1,026
Towards a neuroscience of active sampling and curiosity
Gottlieb, J., & Oudeyer, P.-Y. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0078-0 · Cited by 494
Self-citationA Closer Look at the Hippocampus and Memory
Voss, J. L., Bridge, D. J., Cohen, N. J., & Walker, J. A. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.05.008 · Cited by 272
Triple dissociation of attention and decision computations across prefrontal cortex
Hunt, L. T., Malalasekera, W. M. N., de Berker, A. O., Miranda, B., Farmer, S. F., Behrens, T. E. J., & Kennerley, S. W. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0239-5 · Cited by 222
Metadata
- Authors
- Gottlieb, J., Hayhoe, M., Hikosaka, O., & Rangel, A.
- Affiliations
- Columbia University (US)
- The University of Texas at Austin (US)
- National Institutes of Health (US)
- California Institute of Technology (US)
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2014-11-12
- Volume
- 34
- Issue
- 46
- Pages
- 15497-15504
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- PMC
- PMC4228145
- OpenAlex
- W2022076766
- Cited by
- 168
- References
- 60
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 11 · 2023: 20 · 2022: 13 · 2021: 19 · 2020: 13 · 2019: 15 · 2018: 13 · 2017: 18 · 2016: 17 · 2015: 13
- FWCI
- 1.54
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Neuroscience (publishedVersion, cc-by-nc-sa)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- CaltechAUTHORS (California Institute of Technology) (submittedVersion, cc-by-nc-sa)
- Funders
- National Institute on Aging (R21AG038866)
- National Institute of Mental Health (P50MH094258)
- National Eye Institute (R01EY005729)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- attention, reward, information seeking, decision-making, evidence accumulation, saccades, rapid eye movements, basal ganglia, cortical control, uncertainty reduction
- MeSH terms
- Animals, Attention, Basal Ganglia, Cerebral Cortex, Choice Behavior, Humans, Reward, Saccades, Information Seeking Behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
