The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making
Open accessAbstract
Our decisions are guided by the rewards we expect. These expectations are often based on incomplete knowledge and are thus subject to uncertainty. While the neurophysiology of expected rewards is well understood, less is known about the physiology of uncertainty. We hypothesize that uncertainty, or more specifically errors in judging uncertainty, are reflected in pupil dilation, a marker that has frequently been associated with decision making, but so far has remained largely elusive to quantitative models. To test this hypothesis, we measure pupil dilation while observers perform an auditory gambling task. This task dissociates two key decision variables - uncertainty and reward - and their errors from each other and from the act of the decision itself. We first demonstrate that the pupil does not signal expected reward or uncertainty per se, but instead signals surprise, that is, errors in judging uncertainty. While this general finding is independent of the precise quantification of these decision variables, we then analyze this effect with respect to a specific mathematical model of uncertainty and surprise, namely risk and risk prediction error. Using this quantification, we find that pupil dilation and risk prediction error are indeed highly correlated. Under the assumption of a tight link between noradrenaline (NA) and pupil size under constant illumination, our data may be interpreted as empirical evidence for the hypothesis that NA plays a similar role for uncertainty as dopamine does for reward, namely the encoding of error signals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 2×
“…theoretical frameworks have been proposed on how uncertainty could be incorporated in reward learning and how uncertainty itself could be learned (Pearce and Hall, 1980; Mihatsch and Neuneier, 2002; Yu and Dayan, 2005; Preuschoff and Bossaerts, 2007; Preuschoff et al., 2008) a systematic…”
BackgroundDiscrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 2×
“, 2007) as well as for the tonic dopamine response in non-human primates (Fiorillo et al., 2003).”
BackgroundA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 2×
“Research in this area has been driven by the quantitative predictions of the reward prediction error hypothesis, which was first proposed in the late 1990s (Montague et al., 1996) and has since gained a wealth of evidence (Schultz et al.”
MethodLearning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
The locus coeruleus and noradrenergic modulation of cognition
Sara, S. J. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2573 · Cited by 1,848 · cited 1×
“Thus we provide further experimental evidence for recent theoretical models (Bouret and Sara, 2005; Dayan and Yu, 2006; Sara, 2009).”
Background
Cited by
Joshi, S., Li, Y., Kalwani, R. M., & Gold, J. I. (2016) · Neuron · doi:10.1016/j.neuron.2015.11.028 · Cited by 1,387
Orienting and reorienting: the locus coeruleus mediates cognition through arousal
Sara, S. J., & Bouret, S. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.011 · Cited by 1,056
Waking state: rapid variations modulate neural and behavioral responses
McGinley, M. J., Vinck, M., Reimer, J., Batista-Brito, R., Zagha, E., Cadwell, C. R., Tolias, A. S., Cardin, J. A., & McCormick, D. A. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.012 · Cited by 801
“…and Polt, 1960, 1964; Iriki et al., 1996; Jepma and Nieuwenhuis, 2011; Kahneman and Beatty, 1966; Murphy et al., 2011; Murphy et al., 2014b; Nassar et al., 2012; Nishiyama et al., 2007; Onorati et al., 2013; Preuschoff et al., 2011; Tursky et al., 1969; Wierda et al., 2012; Wilhelm et al., 2001).”
Pupil fluctuations track rapid changes in adrenergic and cholinergic activity in cortex
Reimer, J., McGinley, M. J., Liu, Y., Rodenkirch, C., Wang, Q., McCormick, D. A., & Tolias, A. S. (2016) · Nature Communications · doi:10.1038/ncomms13289 · Cited by 926
Pupil fluctuations track fast switching of cortical states during quiet wakefulness
Reimer, J., Froudarakis, E., Cadwell, C. R., Yatsenko, D., Denfield, G. H., & Tolias, A. S. (2014) · Neuron · doi:10.1016/j.neuron.2014.09.033 · Cited by 717
“Surprising and provocative stimuli produce a transient increase in pupil size (Bradley et al., 2008; Hess and Polt, 1960, 1964; Libby et al., 1973; Preuschoff et al., 2011), and pupil dilation preceding stimulus onset is correlated with faster reaction times in psychophysical tasks (Kristjansson et…”
Pupil diameter covaries with BOLD activity in human locus coeruleus
Murphy, P. R., O'Connell, R. G., O'Sullivan, M., Robertson, I. H., & Balsters, J. H. (2014) · Human Brain Mapping · doi:10.1002/hbm.22466 · Cited by 819
“Pupil diameter has recently emerged as a promising candidate proxy measure for LC activity, and is being increasingly employed for this purpose [Einhauser et al., 2008; Gilzenrat et al., 2010; Jepma and Nieuwenhuis, 2011; Kuipers and Thierry, 2011; Murphy et al., 2011; Nassar et al., 2012; Preuschoff et al., 2011; Sma…”
BackgroundResultRational regulation of learning dynamics by pupil-linked arousal systems
Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., & Gold, J. I. (2012) · Nature Neuroscience · doi:10.1038/nn.3130 · Cited by 722
Locus coeruleus: a new look at the blue spot
Poe, G. R., Foote, S., Eschenko, O., Johansen, J. P., Bouret, S., Aston-Jones, G., Harley, C. W., Manahan-Vaughan, D., Weinshenker, D., Valentino, R., et al. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0360-9 · Cited by 720
Anxious individuals have difficulty learning the causal statistics of aversive environments
Browning, M., Behrens, T. E., Jocham, G., O'Reilly, J. X., & Bishop, S. J. (2015) · Nature Neuroscience · doi:10.1038/nn.3961 · Cited by 476
Pupil-linked arousal is driven by decision uncertainty and alters serial choice bias
Urai, A. E., Braun, A., & Donner, T. H. (2017) · Nature Communications · doi:10.1038/ncomms14637 · Cited by 466
Emotion and Decision Making: Multiple Modulatory Neural Circuits
Phelps, E. A., Lempert, K. M., & Sokol-Hessner, P. (2014) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071013-014119 · Cited by 430
Dissociable effects of surprise and model update in parietal and anterior cingulate cortex
O’Reilly, J. X., Schüffelgen, U., Cuell, S. F., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1305373110 · Cited by 378
Computations of uncertainty mediate acute stress responses in humans
de Berker, A. O., Rutledge, R. B., Mathys, C., Marshall, L., Cross, G. F., Dolan, R. J., & Bestmann, S. (2016) · Nature Communications · doi:10.1038/ncomms10996 · Cited by 330
Decision-related pupil dilation reflects upcoming choice and individual bias
de Gee, J. W., Knapen, T., & Donner, T. H. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1317557111 · Cited by 371
Attention and associative learning in humans: An integrative review.
Le Pelley, M. E., Mitchell, C. J., Beesley, T., George, D. N., & Wills, A. J. (2016) · Psychological Bulletin · doi:10.1037/bul0000064 · Cited by 329
The Pupil Dilation Response to Auditory Stimuli: Current State of Knowledge
Zekveld, A. A., Koelewijn, T., & Kramer, S. E. (2018) · Trends in Hearing · doi:10.1177/2331216518777174 · Cited by 306
Eye tracking and pupillometry are indicators of dissociable latent decision processes.
Cavanagh, J. F., Wiecki, T. V., Kochar, A., & Frank, M. J. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0035813 · Cited by 289
Computational approaches to psychiatry
Stephan, K. E., & Mathys, C. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.12.007 · Cited by 260
Neuromodulatory Correlates of Pupil Dilation
Larsen, R. S., & Waters, J. (2018) · Frontiers in Neural Circuits · doi:10.3389/fncir.2018.00021 · Cited by 262
The neural representation of unexpected uncertainty during value-based decision making
Payzan-LeNestour, E., Dunne, S., Bossaerts, P., & O’Doherty, J. P. (2013) · Neuron · doi:10.1016/j.neuron.2013.04.037 · Cited by 257
Reinforcement learning in depression: a review of computational research
Chen, C., Takahashi, T., Nakagawa, S., Inoue, T., & Kusumi, I. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.05.005 · Cited by 233
The sense of should: A biologically-based framework for modeling social pressure
Theriault, J. E., Young, L., & Barrett, L. F. (2021) · Physics of Life Reviews · doi:10.1016/j.plrev.2020.01.004 · Cited by 201
Bayesian Prediction and Evaluation in the Anterior Cingulate Cortex
Ide, J. S., Shenoy, P., Yu, A. J., & Li, C.-S. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2201-12.2013 · Cited by 185
“A number of recent experimental studies have corroborated model predictions about both neuromodulatory systems (Cordova et al., 2004; Thiel and Fink, 2008; Preuschoff et al., 2011; Nassar et al, 2012; Yu, 2012).”
ResultPharmacological Fingerprints of Contextual Uncertainty
Marshall, L., Mathys, C., Ruge, D., de Berker, A. O., Dayan, P., Stephan, K. E., & Bestmann, S. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002575 · Cited by 158
Confidence controls perceptual evidence accumulation
Balsdon, T., Wyart, V., & Mamassian, P. (2020) · Nature Communications · doi:10.1038/s41467-020-15561-w · Cited by 137
When generating a prediction boosts learning: The element of surprise
Brod, G., Hasselhorn, M., & Bunge, S. A. (2018) · Learning and Instruction · doi:10.1016/j.learninstruc.2018.01.013 · Cited by 131
Meißner, M., & Oll, J. (2019) · Organizational Research Methods · doi:10.1177/1094428117744882 · Cited by 131
A neural network for information seeking
White, J. K., Bromberg-Martin, E. S., Heilbronner, S. R., Zhang, K., Pai, J., Haber, S. N., & Monosov, I. E. (2019) · Nature Communications · doi:10.1038/s41467-019-13135-z · Cited by 129
Bast, N., Poustka, L., & Freitag, C. M. (2018) · European Journal of Neuroscience · doi:10.1111/ejn.13795 · Cited by 121
Arousal-related adjustments of perceptual biases optimize perception in dynamic environments
Krishnamurthy, K., Nassar, M. R., Sarode, S., & Gold, J. I. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0107 · Cited by 117
Catecholaminergic Regulation of Learning Rate in a Dynamic Environment
Jepma, M., Murphy, P. R., Nassar, M. R., Rangel-Gomez, M., Meeter, M., & Nieuwenhuis, S. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005171 · Cited by 91
Cognitive processing of a common stimulus synchronizes brains, hearts, and eyes
Madsen, J., & Parra, L. C. (2022) · PNAS Nexus · doi:10.1093/pnasnexus/pgac020 · Cited by 91
Hesse, J. K., & Tsao, D. Y. (2020) · eLife · doi:10.7554/elife.58360 · Cited by 78
Anterior insula reflects surprise in value-based decision-making and perception
Loued-Khenissi, L., Pfeuffer, A., Einhäuser, W., & Preuschoff, K. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116549 · Cited by 66
Self-citationBalancing new against old information: the role of puzzlement surprise in learning
Faraji, M., Preuschoff, K., & Gerstner, W. (2018) · Neural Computation · doi:10.1162/neco_a_01025 · Cited by 68
“Note that biological correlates of surprise such as pupil dilation (Hess & Polt, 1960; Preuschoff et al., 2011) or the activity of a neuromodulator (Yu”
BackgroundSelf-citationWhat makes the dorsomedial frontal cortex active during reading the mental states of others?
Isoda, M., & Noritake, A. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00232 · Cited by 64
“Evidence suggests that pupil size, an indirect measure of noradrenaline levels (Aston-Jones and Cohen, 2005b), increases with increasing estimation uncertainty (Nieuwenhuis et al., 2005; Preuschoff et al., 2011; Nassar et al., 2012).”
BackgroundBreitwieser, J., & Brod, G. (2021) · Child Development · doi:10.1111/cdev.13393 · Cited by 35
The beneficial effects of meditation: contribution of the anterior cingulate and locus coeruleus.
Craigmyle, N. A. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00731 · Cited by 32
“Pupil dilation following stimuli reflects AC decisions (Aston-Jones and Cohen, 2005; Einhäuser et al., 2010; Preuschoff et al., 2011).”
BackgroundChange is in the eye of the beholder
Yu, A. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3150 · Cited by 24
Biback, C., & Zack, M. (2015) · Current Addiction Reports · doi:10.1007/s40429-015-0064-9 · Cited by 20
The Anterior Insula Processes a Time-Resolved Subjective Risk Prediction Error
Kim, J.-C., Hellrung, L., Nebe, S., & Tobler, P. N. (2025) · The Journal of Neuroscience · doi:10.1523/jneurosci.2302-24.2025 · Cited by 12
Theriault (n.d.) · doi:10.31234/osf.io/pkzr8 · Cited by 51
Revealing User Confidence in Machine Learning-Based Decision Making
Zhou, J., Yu, K., & Chen, F. (2018) · Human–Computer Interaction Series · doi:10.1007/978-3-319-90403-0_11 · Cited by 1
Metadata
- Authors
- Preuschoff, K.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2011
- Volume
- 5
- Pages
- 115-115
- ISSN
- 1662-453X (ISSN-L)
- OpenAlex
- W2159922488
- Cited by
- 519
- References
- 52
- FWCI
- 5.88
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.