Learning and selective attention

Dayan, Peter; Kakade, Sham; Montague, P. Read

doi:10.1038/81504

Cited by 495Neural and Behavioral Psychology StudiesMemory and Neural MechanismsNeural dynamics and brain function

Learning and selective attention

Dayan, Peter, Kakade, Sham, Montague, P. Read·2000·Nature Neuroscience

DOI 10.1038/81504

Open this paper in CoChat — free account

Abstract

Selective attention involves the differential processing of different stimuli, and has widespread psychological and neural consequences. Although computational modeling should offer a powerful way of linking observable phenomena at different levels, most work has focused on the relatively narrow issue of constraints on processing resources. By contrast, we consider statistical and informational aspects of selective attention, divorced from resource constraints, which are evident in animal conditioning experiments involving uncertain predictions and unreliable stimuli. Neuromodulatory systems and limbic structures are known to underlie attentional effects in such tasks.

Integrity signals

Registry

Crossref · 10.1038/81504

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Normatively, learning rates should vary as a function of uncertainty.
“Normatively, learning rates should vary as a function of uncertainty.7–9”
From Serotonin neurons modulate learning rate through uncertainty (2022) · cites this paper as [7]

Advances in neural information processing systems 7
Cios, K. J., & Shields, M. E. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,089 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Self-citation
Attention and Effort
Egeth, H. E., & Kahneman, D. J. (1975) · The American Journal of Psychology · doi:10.2307/1421603 · Cited by 6,976 · see citing works
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · see citing works
Artificial neural networks: a tutorial
Jain, A. K., Mao, J., & Mohiuddin, K. M. (1996) · Computer · doi:10.1109/2.485891 · Cited by 4,989 · see citing works
Perception and Communication
Lane, S. D. (2016) · Routledge eBooks · doi:10.4324/9781315506173-8 · Cited by 4,724 · see citing works
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works
Perception and communication.
Broadbent, D. E. (1958) · doi:10.1037/10037-000 · Cited by 4,337 · see citing works
Bayesian Learning for Neural Networks
Neal, R. M. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-0745-0 · Cited by 4,276 · see citing works
Advances in neural information processing systems 11
Peter Sollich, A. (1999) · Cited by 3,168 · see citing works
A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · see citing works
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733 · see citing works
Selective Attention Gates Visual Processing in the Extrastriate Cortex
Moran, J., & Desimone, R. (1985) · Science · doi:10.1126/science.4023713 · Cited by 2,433 · see citing works
Selective Attention Gates Visual Processing in the Extrastriate Cortex
Moran, J., & Desimone, R. (2003) · The MIT Press eBooks · doi:10.7551/mitpress/2834.003.0024 · Cited by 2,164 · see citing works
SPACE AND ATTENTION IN PARIETAL CORTEX
Colby, C. L., & Goldberg, M. E. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.319 · Cited by 1,710 · see citing works
Feature-based attention influences motion processing gain in macaque visual cortex
Treue, S., & Trujillo, J. C. M. (1999) · Nature · doi:10.1038/21176 · Cited by 1,465 · see citing works
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · see citing works
CENTRAL CHOLINERGIC SYSTEMS AND COGNITION
Everitt, B. J., & Robbins, T. W. (1997) · Annual Review of Psychology · doi:10.1146/annurev.psych.48.1.649 · Cited by 1,348 · see citing works
Conditioning and Associative Learning
Hill, W. F., & Mackintosh, N. J. (1984) · The American Journal of Psychology · doi:10.2307/1422540 · Cited by 1,323 · see citing works
Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4
McAdams, C. J., & Maunsell, J. H. R. (1999) · Journal of Neuroscience · doi:10.1523/jneurosci.19-01-00431.1999 · Cited by 1,214 · see citing works
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190 · see citing works
Time, rate, and conditioning.
Gallistel, C. R., & Gibbon, J. (2000) · Psychological Review · doi:10.1037/0033-295x.107.2.289 · Cited by 1,122 · see citing works
Spatial attention and neglect: parietal, frontal and cingulate contributions to the mental representation and attentional targeting of salient extrapersonal events
Mesulam, M.-M. (1999) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1999.0482 · Cited by 1,096 · see citing works
Animate vision
Ballard, D. H. (1991) · Artificial Intelligence · doi:10.1016/0004-3702(91)90080-4 · Cited by 1,022 · see citing works
Contemporary Animal Learning Theory.
Abrahamson, D. (1981) · Europe PMC (PubMed Central) · Cited by 945 · see citing works
Reward processing in primate orbitofrontal cortex and basal ganglia
Schultz, W. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.272 · Cited by 942 · see citing works
The attentive brain.
Parasuraman, R. (1998) · Cited by 917 · see citing works
Contemporary Animal Learning Theory
LoLordo, V. M., & Dickinson, A. (1982) · The American Journal of Psychology · doi:10.2307/1422669 · Cited by 891 · see citing works
What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?
Doya, K. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00046-5 · Cited by 739 · see citing works
Latent inhibition and conditioned attention theory.
Lubow, R. E., Schnur, P., & Rifkin, B. (1976) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.2.2.163 · Cited by 733 · see citing works
Latent Inhibition and Conditioned Attention Theory
Lubow, R. E. (1989) · Cambridge University Press eBooks · doi:10.1017/cbo9780511529849 · Cited by 697 · see citing works
Amygdala circuitry in attentional and representational processes.
Holland, P., & Gallagher, M. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01271-6 · Cited by 613 · see citing works
Neural Encoding in Orbitofrontal Cortex and Basolateral Amygdala during Olfactory Discrimination Learning
Schoenbaum, G., Chiba, A. A., & Gallagher, M. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-05-01876.1999 · Cited by 579 · see citing works
Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects
Hatfield, T., Han, J.-S., Conley, M., Gallagher, M., & Holland, P. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-16-05256.1996 · Cited by 555 · see citing works
External noise distinguishes attention mechanisms
Lu, Z., & Dosher, B. A. (1998) · Vision Research · doi:10.1016/s0042-6989(97)00273-3 · Cited by 517 · see citing works
Task Decomposition Through Competition in a Modular Connectionist Architecture: The What and Where Vision Tasks
Jacobs, R. A., Jordan, M. I., & Barto, A. G. (1991) · Cognitive Science · doi:10.1207/s15516709cog1502_2 · Cited by 491 · see citing works
Contemporary Learning Theories: Pavlovian Conditioning and the Status of Traditional Learning Theory
Kehoe, E. J., Klein, S. B., & Mowrer, R. R. (1991) · The American Journal of Psychology · doi:10.2307/1423162 · Cited by 483 · see citing works
Latent inhibition and stimulus generalization of the classically conditioned nictitating membrane response in rabbits (Oryctolagus cuniculus) following hippocampal ablation.
Solomon, P. R., & Moore, J. W. (1975) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0077183 · Cited by 473 · see citing works
Converging operations in the study of visual selective attention.
(1996) · American Psychological Association eBooks · doi:10.1037/10187-000 · Cited by 396 · see citing works
Neural substrates of latent inhibition: The switching model.
Weiner, I. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.442 · Cited by 380 · see citing works
Attention and Control: Have We Been Asking the Wrong Questions? A Critical Review of Twenty-Five Years
Allport, A. (1993) · The MIT Press eBooks · doi:10.7551/mitpress/1477.003.0017 · Cited by 373 · see citing works
Processing of expected and unexpected events during conditioning and attention: A psychophysiological theory.
Grossberg, S. (1982) · Psychological Review · doi:10.1037/0033-295x.89.5.529 · Cited by 373 · see citing works
A Theory of Dopamine Function and Its Role in Cognitive Deficits in Schizophrenia
Cohen, J. D., & Servan‐Schreiber, D. (1993) · Schizophrenia Bulletin · doi:10.1093/schbul/19.1.85 · Cited by 199 · see citing works
Disruption of Decrements in Conditioned Stimulus Processing by Selective Removal of Hippocampal Cholinergic Input
Baxter, M. G., Holland, P. C., & Gallagher, M. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-13-05230.1997 · Cited by 154 · see citing works
Selection of actions in the basal ganglia–thalamocortical circuits: review and model
Kropotov, J. D., & Etlinger, S. C. (1999) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(98)00051-8 · Cited by 144 · see citing works
Bayesian Statistics 2.
Bernardo, J. M., DeGroot, M. H., Lindley, D. V., & Smith, A. F. M. (1987) · Biometrics · doi:10.2307/2531979 · Cited by 110 · see citing works
Restoration of the orienting response to a light by a change in its predictive accuracy
Wilson, P. N., Boumphrey, P., & Pearce, J. M. (2007) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/02724999208250600 · Cited by 103 · see citing works
Brain mechanisms for changes in processing of conditioned stimuli in Pavlovian conditioning: Implications for behavior theory
Holland, P. (1997) · Animal Learning & Behavior · doi:10.3758/bf03209846 · Cited by 84 · see citing works
Disconnection of the amygdala central nucleus and substantia innominata/nucleus basalis disrupts increments in conditioned stimulus processing in rats.
Han, J., Holland, P. C., & Gallagher, M. (1999) · Behavioral Neuroscience · doi:10.1037/0735-7044.113.1.143 · Cited by 78 · see citing works
The orienting response as an index of stimulus associability in rats.
Swan, J. A., & Pearce, J. M. S. (1988) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.14.3.292 · Cited by 77 · see citing works
The Combination of Forecasts: A Bayesian Approach
Bordley, R. F. (1982) · Journal of the Operational Research Society · doi:10.1057/jors.1982.29 · Cited by 58 · see citing works
Rodent posterior parietal cortex as a component of a cortical network mediating directed spatial attention
Corwin, J. V., & Reep, R. L. (1998) · Psychobiology · doi:10.3758/bf03330596 · Cited by 57 · see citing works
Statistical models and sensory attention
Dayan, P. (1999) · International Conference on Artificial Neural Networks · doi:10.1049/cp:19991246 · Cited by 38 · see citing works
Self-citation
The hippocampus: The shock of the new
Eichenbaum, H. (1999) · Current Biology · doi:10.1016/s0960-9822(99)80301-7 · Cited by 18 · see citing works
Formal models of visual attention: A tutorial review.
Bundesen, C. (2004) · American Psychological Association eBooks · doi:10.1037/10187-001 · Cited by 18 · see citing works
The influence of predictive accuracy on serial autoshaping: Evidence of orienting responses.
Swan, J. A., & Pearce, J. M. (1987) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.13.4.407 · Cited by 13 · see citing works

Flagged first, then by citations

Sorted by citations

Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053 · see citing works
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · see citing works
Self-citation
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · see citing works
Self-citation
Precise minds in uncertain worlds: Predictive coding in autism.
Van de Cruys, S., Evers, K., Van der Hallen, R., Van Eylen, L., Boets, B., de-Wit, L., & Wagemans, J. (2014) · Psychological Review · doi:10.1037/a0037665 · Cited by 885 · see citing works
Associative learning of social value
Behrens, T. E. J., Hunt, L. T., Woolrich, M. W., & Rushworth, M. F. S. (2008) · Nature · doi:10.1038/nature07538 · Cited by 925 · see citing works
Neural correlates, computation and behavioural impact of decision confidence
Kepecs, A., Uchida, N., Zariwala, H. A., & Mainen, Z. F. (2008) · Nature · doi:10.1038/nature07200 · Cited by 809 · see citing works
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844 · see citing works
Self-citation
Choice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866 · see citing works
Confidence and certainty: Distinct probabilistic quantities for different goals
Pouget, A., Drugowitsch, J., & Kepecs, A. (2016) · Nature Neuroscience · doi:10.1038/nn.4240 · Cited by 528 · see citing works
Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis
Huys, Q. J., Pizzagalli, D. A., Bogdan, R., & Dayan, P. (2013) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-3-12 · Cited by 480 · see citing works
Self-citation
Bayesian theories of conditioning in a changing world
Courville, A. C., Daw, N. D., & Touretzky, D. S. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.004 · Cited by 457 · see citing works
Context, learning, and extinction
Gershman, S. J., Blei, D. M., & Niv, Y. (2010) · Psychological Review · doi:10.1037/a0017808 · Cited by 386 · see citing works
Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain
Niv, Y., Edlund, J. A., Dayan, P., & O'Doherty, J. P. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5498-10.2012 · Cited by 356 · see citing works
Self-citation
Central Cholinergic Neurons Are Rapidly Recruited by Reinforcement Feedback
Hangya, B., Ranade, S. P., Lorenc, M., & Kepecs, A. (2015) · Cell · doi:10.1016/j.cell.2015.07.057 · Cited by 399 · see citing works
Novelty or Surprise?
Barto, A., Mirolli, M., & Baldassarre, G. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00907 · Cited by 397 · see citing works
“Models of classical conditioning based on Bayesian methods, including the Kalman ﬁlter, have been proposed that go beyond the account provided by the Rescorla-Wagner model (Dayan et al., 2000; Kakade and Dayan, 2002a; Courville et al., 2004, 2006).”
Method
Rethinking extinction
Dunsmoor, J. E., Niv, Y., Daw, N., & Phelps, E. A. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.028 · Cited by 329 · see citing works
Computational psychiatry: towards a mathematically informed understanding of mental illness
Adams, R. A., Huys, Q. J. M., & Roiser, J. P. (2015) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2015-310737 · Cited by 285 · see citing works
Dynamic Interaction between Reinforcement Learning and Attention in Multidimensional Environments
Leong, Y. C., Radulescu, A., Daniel, R., DeWoskin, V., & Niv, Y. (2017) · Neuron · doi:10.1016/j.neuron.2016.12.040 · Cited by 294 · see citing works
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298 · see citing works
Habits, action sequences and reinforcement learning
Dezfouli, A., & Balleine, B. W. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08050.x · Cited by 297 · see citing works
Adaptive learning under expected and unexpected uncertainty
Soltani, A., & Izquierdo, A. (2019) · Nature reviews. Neuroscience · doi:10.1038/s41583-019-0180-y · Cited by 286 · see citing works
Habits without values.
Miller, K. J., Shenhav, A., & Ludvig, E. A. (2019) · Psychological Review · doi:10.1037/rev0000120 · Cited by 280 · see citing works
Responses of pulvinar neurons reflect a subject's confidence in visual categorization
Komura, Y., Nikkuni, A., Hirashima, N., Uetake, T., & Miyamoto, A. (2013) · Nature Neuroscience · doi:10.1038/nn.3393 · Cited by 226 · see citing works
Attention, learning, and the value of information
Gottlieb, J. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.034 · Cited by 241 · see citing works
“…(Holland and Maddux, 2010; Le Pelley, 2010; Pearce and Mackintosh, 2010), , studies of eye movement control in natural behaviors (Hayhoe and Ballard, 2005; Tatler et al., 2011), and computational studies in the machine learning ﬁeld (Dayan and Daw, 2008; Dayan et al., 2000; Oudeyer et al., 2007).”
Background
From prediction error to psychosis: Ketamine as a pharmacological model of delusions
Corlett, P. R., Honey, G. D., & Fletcher, P. C. (2007) · Journal of Psychopharmacology · doi:10.1177/0269881107077716 · Cited by 227 · see citing works
Modulation of pain ratings by expectation and uncertainty: Behavioral characteristics and anticipatory neural correlates
Brown, C. A., Seymour, B., Boyle, Y., El-Deredy, W., & Jones, A. K. P. (2008) · Pain · doi:10.1016/j.pain.2007.05.022 · Cited by 218 · see citing works
Bayesian Prediction and Evaluation in the Anterior Cingulate Cortex
Ide, J. S., Shenoy, P., Yu, A. J., & Li, C.-S. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2201-12.2013 · Cited by 185 · see citing works
Twenty-Five Lessons from Computational Neuromodulation
Dayan, P. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.027 · Cited by 190 · see citing works
Self-citation
Serotonin neurons modulate learning rate through uncertainty
Grossman, C. D., Bari, B. A., & Cohen, J. Y. (2022) · Current Biology · doi:10.1016/j.cub.2021.12.006 · Cited by 164 · see citing works
Observing the observer (I): meta-bayesian models of learning and decision-making
Daunizeau, J., den Ouden, H. E. M., Pessiglione, M., Kiebel, S. J., Stephan, K. E., & Friston, K. J. (2010) · PLoS ONE · doi:10.1371/journal.pone.0015554 · Cited by 167 · see citing works
Does prediction error drive one-shot declarative learning?
Greve, A., Cooper, E., Kaula, A., Anderson, M. C., & Henson, R. (2017) · Journal of Memory and Language · doi:10.1016/j.jml.2016.11.001 · Cited by 164 · see citing works
Exploring a latent cause theory of classical conditioning
Gershman, S. J., & Niv, Y. (2012) · Learning & Behavior · doi:10.3758/s13420-012-0080-8 · Cited by 149 · see citing works
Spatial attention, precision, and Bayesian inference: a study of saccadic response speed
Vossel, S., Mathys, C., Daunizeau, J., Bauer, M., Driver, J., Friston, K. J., & Stephan, K. E. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs418 · Cited by 146 · see citing works
Brain networks for confidence weighting and hierarchical inference during probabilistic learning
Meyniel, F., & Dehaene, S. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1615773114 · Cited by 138 · see citing works
Prediction error, ketamine and psychosis: An updated model
Corlett, P. R., Honey, G. D., & Fletcher, P. C. (2016) · Journal of Psychopharmacology · doi:10.1177/0269881116650087 · Cited by 142 · see citing works
Hallucinations as Top-Down Effects on Perception
Powers, A. R., Kelley, M., & Corlett, P. R. (2016) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2016.04.003 · Cited by 138 · see citing works
An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals
Iigaya, K., Fonseca, M. S., Murakami, M., Mainen, Z. F., & Dayan, P. (2018) · Nature Communications · doi:10.1038/s41467-018-04840-2 · Cited by 120 · see citing works
Self-citation
Children on the autism spectrum update their behaviour in response to a volatile environment
Manning, C., Kilner, J., Neil, L., Karaminis, T., & Pellicano, E. (2017) · Developmental Science · doi:10.1111/desc.12435 · Cited by 103 · see citing works
The indirect relationship of media multitasking self-efficacy on learning performance within the personal learning environment: Implications from the mechanism of perceived attention problems and self-regulation strategies
Wu, J.-Y. (2017) · Computers & Education · doi:10.1016/j.compedu.2016.10.010 · Cited by 104 · see citing works
Attention and expectation in human predictive learning: The role of uncertainty
Hogarth, L., Dickinson, A., Austin, A., Brown, C., & Duka, T. (2008) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210701643439 · Cited by 97 · see citing works
Neural computations of threat
Levy, I., & Schiller, D. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.11.007 · Cited by 95 · see citing works
Abnormal reward prediction-error signalling in antipsychotic naive individuals with first-episode psychosis or clinical risk for psychosis
Ermakova, A. O., Knolle, F., Justicia, A., Bullmore, E. T., Jones, P. B., Robbins, T. W., Fletcher, P. C., & Murray, G. K. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0056-2 · Cited by 91 · see citing works
Explaining compound generalization in associative and causal learning through rational principles of dimensional generalization
Soto, F. A., Gershman, S. J., & Niv, Y. (2014) · Psychological Review · doi:10.1037/a0037018 · Cited by 81 · see citing works
Confidence in beliefs about pain predicts expectancy effects on pain perception and anticipatory processing in right anterior insula
Brown, C. A., Seymour, B., El-Deredy, W., & Jones, A. K. P. (2008) · Pain · doi:10.1016/j.pain.2008.04.028 · Cited by 83 · see citing works
Evidence for model-based computations in the human amygdala during Pavlovian conditioning
Prévost, C., McNamee, D., Jessup, R. K., Bossaerts, P., & O'Doherty, J. P. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002918 · Cited by 79 · see citing works
Divisions of identified parvalbumin-expressing basket cells during working memory-guided decision making
Lagler, M., Ozdemir, A. T., Lagoun, S., Malagon-Vina, H., Borhegyi, Z., Hauer, R., Jelem, A., & Klausberger, T. (2016) · Neuron · doi:10.1016/j.neuron.2016.08.010 · Cited by 67 · see citing works
Human representation learning
Radulescu, A., Shin, Y. S., & Niv, Y. (2021) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-092920-120559 · Cited by 63 · see citing works
Spatiotemporal neural characterization of prediction error valence and surprise during reward learning in humans
Fouragnan, E., Queirazza, F., Retzler, C., Mullinger, K. J., & Philiastides, M. G. (2017) · Scientific Reports · doi:10.1038/s41598-017-04507-w · Cited by 61 · see citing works
Transdiagnostic computations of uncertainty: towards a new lens on intolerance of uncertainty
Sandhu, T. R., Xiao, B., & Lawson, R. P. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105123 · Cited by 51 · see citing works
Dopamine, inference, and uncertainty
Gershman, S. J. (2017) · Neural Computation · doi:10.1162/neco_a_01023 · Cited by 40 · see citing works
Sensitivity to value-driven attention is predicted by how we learn from value
Jahfari, S., & Theeuwes, J. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1106-6 · Cited by 28 · see citing works
A predictive coding account of psychotic symptoms in autism spectrum disorder
van Schalkwyk, G. I., Volkmar, F. R., & Corlett, P. R. (2017) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-017-3065-9 · Cited by 25 · see citing works
Surprise beyond prediction error
Chumbley, J. R., Burke, C. J., Stephan, K. E., Friston, K. J., Tobler, P. N., & Fehr, E. (2014) · Human Brain Mapping · doi:10.1002/hbm.22513 · Cited by 23 · see citing works
Human hippocampus and dorsomedial prefrontal cortex infer and update latent causes during social interaction
Mahmoodi, A., Luo, S., Harbison, C., Piray, P., & Rushworth, M. F. S. (2024) · Neuron · doi:10.1016/j.neuron.2024.09.001 · Cited by 17 · see citing works
A single session of SMR-neurofeedback training improves selective attention emerging from a dynamic structuring of brain-heart interplay
Bouny, P., Arsac, L. M., Pratviel, Y., Boffet, A., Touré Cuq, E., & Deschodt-Arsac, V. (2022) · Brain Sciences · doi:10.3390/brainsci12060794 · Cited by 6 · see citing works

Authors: Dayan, P., Kakade, S., & Montague, P. R.
Affiliations: Gatsby Computational Neuroscience Unit (GB)
Baylor College of Medicine (US)
Corresponding author: Dayan, Peter
ORCID: Dayan, Peter
Montague, P. Read
Venue: Nature Neuroscience
Publisher: Springer Science and Business Media LLC
Published: 2000-11
Volume: 3
Issue: S11
Pages: 1218-1223
ISSN: 1097-6256 (ISSN-L)
1546-1726
DOI: 10.1038/81504
OpenAlex: W1503962455
Cited by: 495
References: 56
Citations by year: 2026: 16 · 2025: 24 · 2024: 23 · 2023: 28 · 2022: 25 · 2021: 26 · 2020: 25 · 2019: 28 · 2018: 20 · 2017: 31 · 2016: 20 · 2015: 19 · 2014: 24 · 2013: 29 · 2012: 25
FWCI: 0.58
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Nature Neuroscience (publishedVersion)
PubMed (publishedVersion)
UCL Discovery (University College London) (submittedVersion)
MPG.PuRe (Max Planck Society) (submittedVersion)
Topics: Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
Keywords: selective attention, learning, statistical learning, animal conditioning, neuromodulation, limbic system, computational modeling of attention
MeSH terms: Animals, Attention, Brain, Conditioning, Psychological, Humans, Learning, Models, Neurological, Neural Pathways, Neurons, Psychomotor Performance, Reproducibility of Results

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Learning and selective attention

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks