The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making
Open accessAbstract
Our decisions are guided by the rewards we expect. These expectations are often based on incomplete knowledge and are thus subject to uncertainty. While the neurophysiology of expected rewards is well understood, less is known about the physiology of uncertainty. We hypothesize that uncertainty, or more specifically errors in judging uncertainty, are reflected in pupil dilation, a marker that has frequently been associated with decision making, but so far has remained largely elusive to quantitative models. To test this hypothesis, we measure pupil dilation while observers perform an auditory gambling task. This task dissociates two key decision variables - uncertainty and reward - and their errors from each other and from the act of the decision itself. We first demonstrate that the pupil does not signal expected reward or uncertainty per se, but instead signals surprise, that is, errors in judging uncertainty. While this general finding is independent of the precise quantification of these decision variables, we then analyze this effect with respect to a specific mathematical model of uncertainty and surprise, namely risk and risk prediction error. Using this quantification, we find that pupil dilation and risk prediction error are indeed highly correlated. Under the assumption of a tight link between noradrenaline (NA) and pupil size under constant illumination, our data may be interpreted as empirical evidence for the hypothesis that NA plays a similar role for uncertainty as dopamine does for reward, namely the encoding of error signals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 2×
“…theoretical frameworks have been proposed on how uncertainty could be incorporated in reward learning and how uncertainty itself could be learned (Pearce and Hall, 1980; Mihatsch and Neuneier, 2002; Yu and Dayan, 2005; Preuschoff and Bossaerts, 2007; Preuschoff et al., 2008) a systematic…”
BackgroundDiscrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 2×
“, 2007) as well as for the tonic dopamine response in non-human primates (Fiorillo et al., 2003).”
BackgroundA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 2×
“Research in this area has been driven by the quantitative predictions of the reward prediction error hypothesis, which was first proposed in the late 1990s (Montague et al., 1996) and has since gained a wealth of evidence (Schultz et al.”
MethodLearning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
The locus coeruleus and noradrenergic modulation of cognition
Sara, S. J. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2573 · Cited by 1,848
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 2×
“…could be incorporated in reward learning and how uncertainty itself could be learned (Pearce and Hall, 1980; Mihatsch and Neuneier, 2002; Yu and Dayan, 2005; Preuschoff and Bossaerts, 2007; Preuschoff et al., 2008) a systematic physiological and neural analysis for uncertainty akin to…”
BackgroundPaulus, M. P., & Stein, M. B. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.03.042 · Cited by 1,325 · cited 1×
“In particular, risk misperception characterizes many mental illnesses, from anxiety and mood disorders (Paulus and Stein, 2006) to addiction and pathological gambling (Bechara, 2003).”
BackgroundMultiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · cited 2×
“, 2009), electrophysiological data of adaptive coding (Tobler et al., 2005) as well as computational models of risk learning (Dayan and Yu, 2006; Preuschoff and Bossaerts, 2007).”
BackgroundThe Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox
Cornelissen, F. W., Peters, E. M., & Palmer, J. (2002) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195489 · Cited by 1,041
Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex
Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027 · cited 2×
“, 2008), non-human primate parietal cortex (Kiani and Shadlen, 2009), the human striatum (Preuschoff et al.”
BackgroundNeural correlates, computation and behavioural impact of decision confidence
Kepecs, A., Uchida, N., Zariwala, H. A., & Mainen, Z. F. (2008) · Nature · doi:10.1038/nature07200 · Cited by 809 · cited 2×
“, 2009), rodent orbitofrontal cortex (Kepecs et al., 2008), non-human primate parietal cortex (Kiani and Shadlen, 2009), the human striatum (Preuschoff et al.”
BackgroundNetwork reset: a simplified overarching theory of locus coeruleus noradrenaline function
Bouret, S., & Sara, S. J. (2005) · Trends in Neurosciences · doi:10.1016/j.tins.2005.09.002 · Cited by 809
Gilzenrat, M. S., Nieuwenhuis, S., Jepma, M., & Cohen, J. D. (2010) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.10.2.252 · Cited by 798
Samuels, E., & Szabadi, E. (2008) · Current Neuropharmacology · doi:10.2174/157015908785777229 · Cited by 764
Weber, E. U., Shafir, S., & Blais, A.-R. (2004) · Psychological Review · doi:10.1037/0033-295x.111.2.430 · Cited by 724
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692
Self-citationBOLD responses reflecting dopaminergic signals in the human ventral tegmental area
D'Ardenne, K., McClure, S. M., Nystrom, L. E., & Cohen, J. D. (2008) · Science · doi:10.1126/science.1150605 · Cited by 661
Dopamine signals for reward value and risk: basic and recent data
Schultz, W. (2010) · Behavioral and Brain Functions · doi:10.1186/1744-9081-6-24 · Cited by 653
Risky Business: Emotion, Decision-Making, and Addiction
Bechara, A. (2003) · Journal of Gambling Studies · doi:10.1023/a:1021223113233 · Cited by 495
Samuels, E., & Szabadi, E. (2008) · Current Neuropharmacology · doi:10.2174/157015908785777193 · Cited by 454
Nieuwenhuis, S., De Geus, E. J., & Aston‐Jones, G. (2011) · Psychophysiology · doi:10.1111/j.1469-8986.2010.01057.x · Cited by 449
Jepma, M., & Nieuwenhuis, S. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21548 · Cited by 439
Mohr, P. N. C., Biele, G., & Heekeren, H. R. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0003-10.2010 · Cited by 411
Locus coeruleus activity in monkey: Phasic and tonic changes are associated with altered vigilance
Rajkowski, J., Kubiak, P., & Aston-Jones, G. (1994) · Brain Research Bulletin · doi:10.1016/0361-9230(94)90175-9 · Cited by 371
Phasic norepinephrine: A neural interrupt signal for unexpected events
Dayan, P., & Yu, A. J. (2006) · Network: Computation in Neural Systems · doi:10.1080/09548980601004024 · Cited by 299
Risk-Sensitive Reinforcement Learning
Mihatsch, O., & Neuneier, R. (2002) · Machine Learning · doi:10.1023/a:1017940631555 · Cited by 258
Pupillary contagion: central mechanisms engaged in sadness processing
Harrison, N. A., Singer, T., Rotshtein, P., Dolan, R. J., & Critchley, H. D. (2006) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsl006 · Cited by 243 · cited 1×
“…are commonly associated with attractiveness (the natural source Frontiers in Neuroscience | Decision Neuroscience September 2011 | Volume 5 | Article 115 | 8 of atropine being referred to as “bella-donna” – beautiful woman) and enhance social valence judgment in others (Harrison et al., 2006).”
BackgroundThe Locus Ceruleus Is Involved in the Successful Retrieval of Emotional Memories in Humans
Sterpenich, V., D’Argembeau, A., Desseilles, M., Balteau, E., Albouy, G., Vandewalle, G., Degueldre, C., Luxen, A., Collette, F., & Maquet, P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1001-06.2006 · Cited by 227
Risk-Sensitive Reinforcement Learning
Shen, Y., Tobia, M. J., Sommer, T., & Obermayer, K. (2014) · Neural Computation · doi:10.1162/neco_a_00600 · Cited by 211
Pupil Size as a Measure of Arousal during Information Processing
BRADSHAW, J. (1967) · Nature · doi:10.1038/216515a0 · Cited by 205
Effect of stimulus uncertainty on the pupillary dilation response and the vertex evoked potential
Friedman, D., Hakerem, G., Sutton, S., & Fleiss, J. L. (1973) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(73)90065-5 · Cited by 204
Modafinil Shifts Human Locus Coeruleus to Low-Tonic, High-Phasic Activity During Functional MRI
Minzenberg, M. J., Watrous, A. J., Yoon, J. H., Ursu, S., & Carter, C. S. (2008) · Science · doi:10.1126/science.1164908 · Cited by 188
Pupil dilation betrays the timing of decisions
Einhäuser, W. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00018 · Cited by 187
Pupil size and spontaneous pupillary waves associated with alertness, drowsiness, and sleep
Yoss, R. E., Moyer, N. J., & Hollenhorst, R. W. (1970) · Neurology · doi:10.1212/wnl.20.6.545 · Cited by 185
Risk-dependent reward value signal in human prefrontal cortex
Tobler, P. N., Christopoulos, G. I., O'Doherty, J. P., Dolan, R. J., & Schultz, W. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0809599106 · Cited by 183
The Neurobiology of Reference-Dependent Value Computation
De Martino, B., Kumaran, D., Holt, B., & Dolan, R. J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4832-08.2009 · Cited by 174
Satterthwaite, T. D., Green, L., Myerson, J., Parker, J. B., Ramaratnam, M., & Buckner, R. L. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.04.066 · Cited by 171
Pupillary dilation as an index of central nervous system α2-adrenoceptor activation
Koss, M. C. (1986) · Journal of Pharmacological Methods · doi:10.1016/0160-5402(86)90002-1 · Cited by 159
Adding prediction risk to the theory of reward learning
PREUSCHOFF, K., & BOSSAERTS, P. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.005 · Cited by 133 · cited 4×
“, 2005) as well as computational models of risk learning (Dayan and Yu, 2006; Preuschoff and Bossaerts, 2007).”
BackgroundInfluentialNeural correlates of risk prediction error during reinforcement learning in humans
d'Acremont, M., Lu, Z.-L., Li, X., Van der Linden, M., & Bechara, A. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.04.096 · Cited by 94 · cited 2×
“…risk, prediction risk errors, volatility) have been reported for the human anterior insula (Preuschoff et al., 2008; De Martino et al., 2009; d’Acremont et al., 2009), rodent orbitofrontal cortex (Kepecs et al., 2008), non-human primate parietal cortex (Kiani and Shadlen, 2009), the human…”
BackgroundMethodPhillips, M. A., Szabadi, E., & Bradshaw, C. M. (2000) · Psychopharmacology · doi:10.1007/s002130000398 · Cited by 84
Astafiev, S. V., Snyder, A. Z., Shulman, G. L., & Corbetta, M. (2010) · Science · doi:10.1126/science.1177200 · Cited by 76
Pupillary Changes during a Decision-Making Task
Simpson, H. M., & Hale, S. M. (1969) · Perceptual and Motor Skills · doi:10.2466/pms.1969.29.2.495 · Cited by 74
Raisig, S., Welke, T., Hagendorf, H., & van der Meer, E. E. (2010) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2010.01.006 · Cited by 60
Neurocognitive Function in Dopamine-β-Hydroxylase Deficiency
Jepma, M., Deinum, J., Asplund, C. L., Rombouts, S. A. R. B., Tamsma, J. T., Tjeerdema, N., Spapé, M., Garland, E. M., Robertson, D., Lenders, J. W. M., et al. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2011.42 · Cited by 44
The Neurobiology of Reference-Dependent Value Computation
Martino, B. D., Kumaran, D., Holt, B., & Dolan, R. J. (2009) · NeuroImage · doi:10.1016/s1053-8119(09)71082-1 · Cited by 16
Cited by
Joshi, S., Li, Y., Kalwani, R. M., & Gold, J. I. (2016) · Neuron · doi:10.1016/j.neuron.2015.11.028 · Cited by 1,387
Orienting and reorienting: the locus coeruleus mediates cognition through arousal
Sara, S. J., & Bouret, S. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.011 · Cited by 1,056
Waking state: rapid variations modulate neural and behavioral responses
McGinley, M. J., Vinck, M., Reimer, J., Batista-Brito, R., Zagha, E., Cadwell, C. R., Tolias, A. S., Cardin, J. A., & McCormick, D. A. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.012 · Cited by 801
“…and Polt, 1960, 1964; Iriki et al., 1996; Jepma and Nieuwenhuis, 2011; Kahneman and Beatty, 1966; Murphy et al., 2011; Murphy et al., 2014b; Nassar et al., 2012; Nishiyama et al., 2007; Onorati et al., 2013; Preuschoff et al., 2011; Tursky et al., 1969; Wierda et al., 2012; Wilhelm et al., 2001).”
Pupil fluctuations track rapid changes in adrenergic and cholinergic activity in cortex
Reimer, J., McGinley, M. J., Liu, Y., Rodenkirch, C., Wang, Q., McCormick, D. A., & Tolias, A. S. (2016) · Nature Communications · doi:10.1038/ncomms13289 · Cited by 926
Pupil fluctuations track fast switching of cortical states during quiet wakefulness
Reimer, J., Froudarakis, E., Cadwell, C. R., Yatsenko, D., Denfield, G. H., & Tolias, A. S. (2014) · Neuron · doi:10.1016/j.neuron.2014.09.033 · Cited by 717
“Surprising and provocative stimuli produce a transient increase in pupil size (Bradley et al., 2008; Hess and Polt, 1960, 1964; Libby et al., 1973; Preuschoff et al., 2011), and pupil dilation preceding stimulus onset is correlated with faster reaction times in psychophysical tasks (Kristjansson et…”
Metadata
- Authors
- Preuschoff, K.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2011
- Volume
- 5
- Pages
- 115-115
- ISSN
- 1662-453X (ISSN-L)
- OpenAlex
- W2159922488
- Cited by
- 519
- References
- 52
- FWCI
- 5.88
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.