Catecholaminergic Regulation of Learning Rate in a Dynamic Environment
Open accessThe DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.
Abstract
Adaptive behavior in a changing world requires flexibly adapting one's rate of learning to the rate of environmental change. Recent studies have examined the computational mechanisms by which various environmental factors determine the impact of new outcomes on existing beliefs (i.e., the 'learning rate'). However, the brain mechanisms, and in particular the neuromodulators, involved in this process are still largely unknown. The brain-wide neurophysiological effects of the catecholamines norepinephrine and dopamine on stimulus-evoked cortical responses suggest that the catecholamine systems are well positioned to regulate learning about environmental change, but more direct evidence for a role of this system is scant. Here, we report evidence from a study employing pharmacology, scalp electrophysiology and computational modeling (N = 32) that suggests an important role for catecholamines in learning rate regulation. We found that the P3 component of the EEG-an electrophysiological index of outcome-evoked phasic catecholamine release in the cortex-predicted learning rate, and formally mediated the effect of prediction-error magnitude on learning rate. P3 amplitude also mediated the effects of two computational variables-capturing the unexpectedness of an outcome and the uncertainty of a preexisting belief-on learning rate. Furthermore, a pharmacological manipulation of catecholamine activity affected learning rate following unanticipated task changes, in a way that depended on participants' baseline learning rate. Our findings provide converging evidence for a causal role of the human catecholamine systems in learning-rate regulation as a function of environmental change.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Second, baseline task performance (in a placebo condition) was considered, as it frequently predicts the behavioral effects of catecholaminergic manipulations (Cools & Robbins, 2004; Jepma et al., 2016, 2018) and therefore may indicate an individual’s baseline placement on the inverted-U curve relating dopamine activity and WM performance.”
From Baseline-dependent effect of dopamine’s precursor L-tyrosine on working memory gating but not updating (2020) · cites this paper as Jepma et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Delorme, A., & Makeig, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.10.009 · Cited by 24,371
Updating P300: An integrative theory of P3a and P3b
Polich, J. (2007) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.04.019 · Cited by 7,919
A new method for off-line removal of ocular artifact
Gratton, G., Coles, M. G. H., & Donchin, E. (1983) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(83)90135-9 · Cited by 5,055
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
The reorienting system of the human brain: from environment to theory of mind
Corbetta, M., Patel, G., & Shulman, G. L. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.017 · Cited by 3,889 · cited 1×
“This catecolaminergic modulation of learning rate may be similar in nature to the mechanism via which phasic NE and DA activity are thought to modulate attention, perception, and other types of learning [11,25,31,70–72].”
ResultIs the P300 component a manifestation of context updating?
Donchin, E., & Coles, M. G. H. (1988) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00058027 · Cited by 3,585
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379
Berridge, C. W., & Waterhouse, B. D. (2003) · Brain Research Reviews · doi:10.1016/s0165-0173(03)00143-7 · Cited by 2,529
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
The use of analogue scales in rating subjective feelings
BOND, A., & LADER, M. (1974) · British Journal of Medical Psychology · doi:10.1111/j.2044-8341.1974.tb02285.x · Cited by 1,972
Donchin, E. (1981) · Psychophysiology · doi:10.1111/j.1469-8986.1981.tb01815.x · Cited by 1,848
The locus coeruleus and noradrenergic modulation of cognition
Sara, S. J. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2573 · Cited by 1,848
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 4×
“Indeed, theoretical and modeling work has suggested that NE signals unexpected uncertainty arising from unsignaled changes in a task context, whereas it is not sensitive to the expected unreliability of outcomes [11].”
BackgroundResultInfluentialDecision making, the P3, and the locus coeruleus–norepinephrine system
Nieuwenhuis, S., Aston-Jones, G., & Cohen, J. D. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.4.510 · Cited by 1,678 · cited 3×
“First, trial-to-trialvariation in P3 amplitude—an index of phasic stimulus-evoked catecholamine release in the cortex [35–37]—mediated the effect of prediction-error magnitude on learning rate, suggesting that the phasic catecholamine response following surprising outcomes drives subsequent…”
BackgroundSelf-citationInverted-U–Shaped Dopamine Actions on Human Working Memory and Cognitive Control
Cools, R., & D'Esposito, M. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.03.028 · Cited by 1,673
Joshi, S., Li, Y., Kalwani, R. M., & Gold, J. I. (2016) · Neuron · doi:10.1016/j.neuron.2015.11.028 · Cited by 1,387
Bymaster, F. (2002) · Neuropsychopharmacology · doi:10.1016/s0893-133x(02)00346-9 · Cited by 1,123
Orienting and reorienting: the locus coeruleus mediates cognition through arousal
Sara, S. J., & Bouret, S. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.011 · Cited by 1,056
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966
Neural mechanisms of visual selective attention
MANGUN, G. R. (1995) · Psychophysiology · doi:10.1111/j.1469-8986.1995.tb03400.x · Cited by 839
Pupil diameter covaries with BOLD activity in human locus coeruleus
Murphy, P. R., O'Connell, R. G., O'Sullivan, M., Robertson, I. H., & Balsters, J. H. (2014) · Human Brain Mapping · doi:10.1002/hbm.22466 · Cited by 819
Self-citationGilzenrat, M. S., Nieuwenhuis, S., Jepma, M., & Cohen, J. D. (2010) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.10.2.252 · Cited by 798
Self-citationNeural mechanisms for detecting and remembering novel events
Ranganath, C., & Rainer, G. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1052 · Cited by 779
A Network Model of Catecholamine Effects: Gain, Signal-to-Noise Ratio, and Behavior
Servan-Schreiber, D., Printz, H., & Cohen, J. D. (1990) · Science · doi:10.1126/science.2392679 · Cited by 767
Rational regulation of learning dynamics by pupil-linked arousal systems
Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., & Gold, J. I. (2012) · Nature Neuroscience · doi:10.1038/nn.3130 · Cited by 722
Self-citationInformation Delivery and the Sensory Evoked Potential
Sutton, S., Tueting, P., Zubin, J., & John, E. R. (1967) · Science · doi:10.1126/science.155.3768.1436 · Cited by 696
Lower level mediation in multilevel models.
Kenny, D. A., Korchmaros, J. D., & Bolger, N. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.115 · Cited by 687
Catechol-o-Methyltransferase, Cognition, and Psychosis: Val158Met and Beyond
Tunbridge, E. M., Harrison, P. J., & Weinberger, D. R. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.10.024 · Cited by 685
Genes, dopamine and cortical signal-to-noise ratio in schizophrenia
Winterer, G., & Weinberger, D. R. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.08.002 · Cited by 600
Nassar, M. R., Wilson, R. C., Heasly, B., & Gold, J. I. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0822-10.2010 · Cited by 560
Self-citationNeuromodulation and cortical function: modeling the physiological basis of behavior
Hasselmo, M. E. (1995) · Behavioural Brain Research · doi:10.1016/0166-4328(94)00113-t · Cited by 556
Pupil dilation signals surprise: evidence for noradrenaline’s role in decision making
Preuschoff, K. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00115 · Cited by 519
PITMAN, E. J. G. (1939) · Biometrika · doi:10.1093/biomet/31.1-2.9 · Cited by 480
Anxious individuals have difficulty learning the causal statistics of aversive environments
Browning, M., Behrens, T. E., Jocham, G., O'Reilly, J. X., & Bishop, S. J. (2015) · Nature Neuroscience · doi:10.1038/nn.3961 · Cited by 476
Varazzani, C., San-Galli, A., Gilardeau, S., & Bouret, S. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.0454-15.2015 · Cited by 452
Nieuwenhuis, S., De Geus, E. J., & Aston‐Jones, G. (2011) · Psychophysiology · doi:10.1111/j.1469-8986.2010.01057.x · Cited by 449
Self-citationBrain mediators of cardiovascular responses to social threat
Wager, T. D., Waugh, C. E., Lindquist, M., Noll, D. C., Fredrickson, B. L., & Taylor, S. F. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.05.043 · Cited by 402
Brain mediators of predictive cue effects on perceived pain
Atlas, L. Y., Bolger, N., Lindquist, M. A., & Wager, T. D. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0057-10.2010 · Cited by 389
Dopamine, affordance and active inference
Friston, K. J., Shiner, T., FitzGerald, T., Galea, J. M., Adams, R., Brown, H., Dolan, R. J., Moran, R., Stephan, K. E., & Bestmann, S. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002327 · Cited by 381 · cited 2×
“Our findings are broadly consistent with the recent proposal that DA balances bottom-up sensory information and top-down prior beliefs during active inference [29].”
BackgroundResultDissociable effects of surprise and model update in parietal and anterior cingulate cortex
O’Reilly, J. X., Schüffelgen, U., Cuell, S. F., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1305373110 · Cited by 378
Cools, R., Frank, M. J., Gibbs, S. E., Miyakawa, A., Jagust, W., & D'Esposito, M. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4467-08.2009 · Cited by 364
Arnsten, A. F. T., & Goldman-Rakic, P. S. (1984) · Brain Research · doi:10.1016/0006-8993(84)90351-2 · Cited by 333 · cited 1×
“It has been proposed that the LC receives uncertainty information via afferent projections from cortical areas, including the ACC [22], which is supported by the existence of anatomical projections from frontal brain regions to the LC [25,74,75].”
BackgroundLapiz, M. D. S., & Morilak, D. A. (2006) · Neuroscience · doi:10.1016/j.neuroscience.2005.09.031 · Cited by 325
Functionally dissociable influences on learning rate in a dynamic environment
McGuire, J. T., Nassar, M. R., Gold, J. I., & Kable, J. W. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.013 · Cited by 299
Self-citationBehavioral Variability through Stochastic Choice and Its Gating by Anterior Cingulate Cortex
Tervo, D. G. R., Proskurin, M., Manakov, M., Kabra, M., Vollmer, A., Branson, K., & Karpova, A. Y. (2014) · Cell · doi:10.1016/j.cell.2014.08.037 · Cited by 280
Wager, T. D., van Ast, V. A., Hughes, B. L., Davidson, M. L., Lindquist, M. A., & Ochsner, K. N. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.05.044 · Cited by 264
Mars, R. B., Debener, S., Gladwin, T. E., Harrison, L. M., Haggard, P., Rothwell, J. C., & Bestmann, S. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2925-08.2008 · Cited by 264
Impaired Learning and Decreased Cortical Norepinephrine after Bilateral Locus Coeruleus Lesions
Anlezark, G. M., Crow, T. J., & Greenway, A. P. (1973) · Science · doi:10.1126/science.181.4100.682 · Cited by 263
Chemistry of the adaptive mind
Cools, R., & Robbins, T. W. (2004) · Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2004.1468 · Cited by 257
The neural representation of unexpected uncertainty during value-based decision making
Payzan-LeNestour, E., Dunne, S., Bossaerts, P., & O’Doherty, J. P. (2013) · Neuron · doi:10.1016/j.neuron.2013.04.037 · Cited by 257
Clinical Pharmacokinetics of Atomoxetine
Sauer, J.-M., Ring, B. J., & Witcher, J. W. (2005) · Clinical Pharmacokinetics · doi:10.2165/00003088-200544060-00002 · Cited by 247
Explicit neural signals reflecting reward uncertainty
Schultz, W., Preuschoff, K., Camerer, C., Hsu, M., Fiorillo, C. D., Tobler, P. N., & Bossaerts, P. (2008) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2008.0152 · Cited by 239
İnsanlarda Yenilik N2 Yanıtı Hedef Uyaranların Zamansal Sınıflamasını Yansıtır
MARAŞLIGİL, B., & ERGENOĞLU, T. (2011) · Journal of Experimental and Clinical Medicine · doi:10.5835/jecm.omu.28.02.002 · Cited by 235
Krugel, L. K., Biele, G., Mohr, P. N. C., Li, S.-C., & Heekeren, H. R. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905191106 · Cited by 229
McGaughy, J., Ross, R. S., & Eichenbaum, H. (2008) · Neuroscience · doi:10.1016/j.neuroscience.2008.01.064 · Cited by 226
Koda, K., Ago, Y., Cong, Y., Kita, Y., Takuma, K., & Matsuda, T. (2010) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.2010.06750.x · Cited by 222
Swanson, C. J., Perry, K. W., Koch-Krueger, S., Katner, J., Svensson, K. A., & Bymaster, F. P. (2006) · Neuropharmacology · doi:10.1016/j.neuropharm.2005.11.022 · Cited by 214
Stimulus-dependent dopamine release in attention-deficit/hyperactivity disorder.
Sikström, S., & Söderlund, G. (2007) · Psychological Review · doi:10.1037/0033-295x.114.4.1047 · Cited by 205
Activation of the noradrenergic system facilitates an attentional shift in the rat
Devauges, V., & Sara, S. J. (1990) · Behavioural Brain Research · doi:10.1016/0166-4328(90)90118-x · Cited by 200
Effects of locus coeruleus lesions on auditory, long-latency, event-related potentials in monkey
Pineda, J., Foote, S., & Neville, H. (1989) · The Journal of Neuroscience · doi:10.1523/jneurosci.09-01-00081.1989 · Cited by 184
Lesions of the dorsal noradrenergic bundle impair attentional set-shifting in the rat
Tait, D. S., Brown, V. J., Farovik, A., Theobald, D. E., Dalley, J. W., & Robbins, T. W. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05612.x · Cited by 179
Correcting for Regression to the Mean in Behavior and Ecology
Kelly, C., & Price, T. D. (2005) · The American Naturalist · doi:10.1086/497402 · Cited by 163
Ford, J. M., Sullivan, E. V., Marsh, L., White, P. M., Lim, K. O., & Adolf Pfefferbaum, A. (1994) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(94)90093-0 · Cited by 158
Newman, L. A., Darling, J., & McGaughy, J. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1097-8 · Cited by 137
On the Origin of Cortical Dopamine: Is it a Co-Transmitter in Noradrenergic Neurons?
Devoto, P., & Flore, G. (2006) · Current Neuropharmacology · doi:10.2174/157015906776359559 · Cited by 136
Neural Basis of Motivational and Cognitive Control
(2011) · The MIT Press eBooks · doi:10.7551/mitpress/9780262016438.001.0001 · Cited by 128
Event-related brain potentials as indices of information extraction and response priming
Gratton, G., Bosco, C. M., Kramer, A. F., COLES, M. G. H., Wickens, C. D., & Donchin, E. (1990) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(90)90087-z · Cited by 128
Dopamine modulates involuntary attention shifting and reorienting: an electromagnetic study
Kähkönen, S., Ahveninen, J., Pekkonen, E., Kaakkola, S., Huttunen, J., Ilmoniemi, R. J., & Jääskeläinen, I. P. (2002) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00305-x · Cited by 127
Le potentiel évoqué cognitif P300 (I) : aspects théorique et psychobiologique
Hansenne, M. (2000) · Neurophysiologie Clinique · doi:10.1016/s0987-7053(00)00223-9 · Cited by 127
Making predictions in a changing world—inference, uncertainty, and learning
O'Reilly, J. X. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00105 · Cited by 126
Inhibition of the norepinephrine transporter improves behavioral flexibility in rats and monkeys
Seu, E., Lang, A., Rivera, R. J., & Jentsch, J. D. (2009) · Psychopharmacology · doi:10.1007/s00213-008-1250-4 · Cited by 121
Invernizzi, R. W., & Garattini, S. K. (2004) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2004.05.026 · Cited by 116
Conflict acts as an implicit cost in reinforcement learning
Cavanagh, J. F., Masters, S. E., Bath, K. G., & Frank, M. J. (2014) · Nature Communications · doi:10.1038/ncomms6394 · Cited by 110
Adaptive coding of action values in the human rostral cingulate zone
Jocham, G., Neumann, J., Klein, T. A., Danielmeier, C., & Ullsperger, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0349-09.2009 · Cited by 106
Taeye, L. D., Vonck, K. E. J., van Bochove, M. E., Boon, P., Roost, D. V., Mollet, L., Meurs, A., Herdt, V. D., Carrette, E., Dauwe, I., et al. (2014) · Neurotherapeutics · doi:10.1007/s13311-014-0272-3 · Cited by 102
Lee, H. S., Kim, M., & Waterhouse, B. D. (2005) · Journal of Comparative Neurology · doi:10.1002/cne.20365 · Cited by 98
Lapiz, M. D. S., Bondi, C. O., & Morilak, D. A. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301235 · Cited by 95
Silvetti, M., Seurinck, R., & Verguts, T. (2012) · Cortex · doi:10.1016/j.cortex.2012.05.008 · Cited by 92
Page, M. E. (2002) · Neuropsychopharmacology · doi:10.1016/s0893-133x(02)00301-9 · Cited by 90
Devoto, P., Flore, G., Pira, L., Longu, G., & Gessa, G. L. (2004) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.2003.02239.x · Cited by 88
Stress, genotype and norepinephrine in the prediction of mouse behavior using reinforcement learning
Lukšys, G., Gerstner, W., & Sandi, C. (2009) · Nature Neuroscience · doi:10.1038/nn.2374 · Cited by 86
Bari, A., & Aston-Jones, G. (2013) · Neuropharmacology · doi:10.1016/j.neuropharm.2012.07.020 · Cited by 85
Astafiev, S. V., Snyder, A. Z., Shulman, G. L., & Corbetta, M. (2010) · Science · doi:10.1126/science.1177200 · Cited by 72
A Model-Based Approach to Trial-By-Trial P300 Amplitude Fluctuations
Kolossa, A., Fingscheidt, T., Wessel, K., & Kopp, B. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00359 · Cited by 63
The effect of the skull on event-related P300
Frodl, T., Meisenzahl, E. M., Müller, D. K., Leinsinger, G., Juckel, G., Hahn, K., Möller, H. ‐., & Hegerl, U. (2001) · Clinical Neurophysiology · doi:10.1016/s1388-2457(01)00587-9 · Cited by 62
Noradrenergic and cholinergic modulation of late ERP responses to deviant stimuli
Brown, S. B. R. E., van der Wee, N. J. A., van Noorden, M. S., Giltay, E. J., & Nieuwenhuis, S. (2015) · Psychophysiology · doi:10.1111/psyp.12544 · Cited by 57
Self-citationThe influence of the noradrenergic system on optimal control of neural plasticity
Silvetti, M., Seurinck, R., van Bochove, M. E., & Verguts, T. (2013) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2013.00160 · Cited by 50
The Role of Dopamine in Temporal Uncertainty
Tomassini, A., Ruge, D., Galea, J. M., Penny, W., & Bestmann, S. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00880 · Cited by 47
Jepma (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00170 · Cited by 45
Learning, the P3, and the Locus Coeruleus-Norepinephrine System
Nieuwenhuis, S. (2011) · Neural Basis of Motivational and Cognitive Control · doi:10.7551/mitpress/9780262016438.003.0012 · Cited by 44
Self-citationBeta receptor-mediated modulation of the late positive potential in humans
de Rover, M., Brown, S. B. R. E., Boot, N. C., Hajcak, G., van Noorden, M. S., van der Wee, N. J. A., & Nieuwenhuis, S. (2011) · Psychopharmacology · doi:10.1007/s00213-011-2426-x · Cited by 41
Self-citationRangel‐Gomez, M., Hickey, C., van Amelsvoort, T., Bet, P. M., & Meeter, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0066469 · Cited by 36
Self-citationDissociable contribution of prefrontal and striatal dopaminergic genes to learning in economic games
Set, E., Saez, I., Zhu, L., Houser, D. E., Myung, N., Zhong, S., Ebstein, R. P., Chew, S. H., & Hsu, M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1316259111 · Cited by 36
Learning and Generalization under Ambiguity: An fMRI Study
Chumbley, J. R., Flandin, G., Bach, D. R., Daunizeau, J., Fehr, E., Dolan, R. J., & Friston, K. J. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002346 · Cited by 20
Modulation of attention by noradrenergic alpha2-agents varies according to arousal level
Coull, J. T. (2001) · Drug News & Perspectives · doi:10.1358/dnp.2001.14.1.858386 · Cited by 15
Jepma, M., Beek, E. T. T., Wagenmakers, E., Gerven, J. M. A. V., & Nieuwenhuis, S. (2010) · Leiden Repository (Leiden University) · Cited by 12
Self-citationGibbs, A. A., Bautista, C. E., Mowlem, F. D., Naudts, K. H., & Duka, D. (2014) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.130131 · Cited by 11
Research works printed but not linked: 5
- A Pfefferbaum, 1987, Skull thickness influences P3 amplitude, Psychopharmacol Bull, 23, 493
- E Donchin, 1988, Is the P300 component a manifestation of context updating?, Behavioral and Brain Sciences, 11, 357, 10.1017/S0140525X00058027 · DOI · Paper page
- MA Eckert, 2010, Looking forward with the locus coeruleus, Science
- AA Gibbs, 2014, Catechol-O-methyltransferase val158met genotype determines effect of reboxetine on emotional memory in healthy male volunteers, Journal of psychiatry & neuroscience: JPN, 39, E24, 10.1503/jpn.130131 · DOI
- M Hansenne, 2000, The p300 cognitive event-related potential. I. Theoretical and psychobiologic perspectives, Neurophysiol Clin, 30, 191
Cited by
Pike, A. C., & Robinson, O. J. (2022) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2022.0051 · Cited by 167
Dorsal anterior cingulate-brainstem ensemble as a reinforcement meta-learner
Silvetti, M., Vassena, E., Abrahamse, E. L., & Verguts, T. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006370 · Cited by 158
Visual Mismatch and Predictive Coding: A Computational Single-Trial ERP Study
Stefanics, G., Heinzle, J., Horváth, A. A., & Stephan, K. E. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.3365-17.2018 · Cited by 124
The interpretation of computational model parameters depends on the context
Eckstein, M. K., Master, S. L., Xia, L., Dahl, R. E., Wilbrecht, L., & Collins, A. G. (2022) · eLife · doi:10.7554/elife.75474 · Cited by 112
Eye pupil signals information gain
Zénon, A. (2019) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2019.1593 · Cited by 126
Metadata
- Authors
- Jepma, M., Murphy, P. R., Nassar, M. R., Rangel-Gomez, M., Meeter, M., & Nieuwenhuis, S.
- Affiliations
- Leiden University (NL)
- University Medical Center Hamburg-Eppendorf (DE)
- Brown University (US)
- Vrije Universiteit Amsterdam (NL)
- Corresponding author
- Jepma, Marieke
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-10-28
- Volume
- 12
- Issue
- 10
- Pages
- e1005171
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC5085041
- OpenAlex
- W2540211666
- Cited by
- 91
- References
- 98
- Citations by year
- 2026: 8 · 2025: 7 · 2024: 11 · 2023: 8 · 2022: 12 · 2021: 10 · 2020: 14 · 2019: 13 · 2018: 7 · 2017: 1
- FWCI
- 4.45
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Leiden Repository (Leiden University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- VU Research Portal (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
- Funders
- National Institute of Mental Health (F32MH102009)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- learning rate, catecholamines, norepinephrine, dopamine, P300, prediction error, environmental change, surprise, belief updating, adaptive learning, neuromodulation, computational models of learning
- MeSH terms
- Adaptation, Physiological, Adolescent, Adult, Brain Mapping, Catecholamines, Dopamine, Double-Blind Method, Female, Humans, Learning, Male, Neuronal Plasticity, Norepinephrine, Parietal Lobe, Ecosystem, Neurotransmitter Agents, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.