Temporal Difference Models and Reward-Related Learning in the Human Brain

A neural substrate of prediction and reward

Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388

A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement

Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268

Learning to predict by the methods of temporal differences

Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148

Predictive reward signal of dopamine neurons

Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564

Spatial registration and normalization of images

Friston, K. J., Ashburner, J., Frith, C., Poline, J.-B., Heather, J. D., & Frackowiak, R. S. J. (1995) · Human Brain Mapping · doi:10.1002/hbm.460030303 · Cited by 3,744

A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.

Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023

Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens

Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244

Functional imaging of neural responses to expectancy and experience of monetary gains and losses

Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404

Dissociation of reward anticipation and outcome with event-related fMRI

Knutson, B., Fong, G. W., Adams, C. M., Varner, J. L., & Hommer, D. (2001) · Neuroreport · doi:10.1097/00001756-200112040-00016 · Cited by 1,300

Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum

Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116

Lateral orbitofrontal cortex integrates predictive information across multiple cues to guide behavior

Tegelbeckers, J., Porter, D. B., Voss, J. L., Schoenbaum, G. M., & Kahnt, T. (2023) · Current Biology · doi:10.1016/j.cub.2023.09.033 · Cited by 20

Predictive mechanisms linking brain opioids to chronic pain vulnerability and resilience

Jones, A. K. P., & Brown, C. A. (2017) · British Journal of Pharmacology · doi:10.1111/bph.13840 · Cited by 17

Towards a computational psychiatry of juvenile obsessive-compulsive disorder

Loosen, A. M., & Hauser, T. U. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.07.021 · Cited by 19

Reinforcement Learning, High-Level Cognition, and the Human Brain

Silvetti, M., & Verguts, T. (2012) · InTech eBooks · doi:10.5772/23471 · Cited by 18

Aging and risk taking: toward an integration of cognitive, emotional, and neurobiological perspectives

Lee, T., & Shao, R. (2014) · Neuroscience and Neuroeconomics · doi:10.2147/nan.s35914 · Cited by 19

Neuropsychiatry

Northoff, G. (2008) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-007-0783-6 · Cited by 17

Espresso Reward Learning, Hold the Dopamine: Theoretical Comment on Robinson et al. (2005).

Berridge, K. C. (2005) · Behavioral Neuroscience · doi:10.1037/0735-7044.119.1.336 · Cited by 17

Neuroeconomics: Opening the “black box” behind the economic behavior

Yu, R., & Zhou, X. (2007) · Chinese Science Bulletin · doi:10.1007/s11434-007-0193-1 · Cited by 17

A model-based fMRI analysis with hierarchical Bayesian parameter estimation.

Ahn, W., Krawitz, A., Kim, W., Busemeyer, J. R., & Brown, J. W. (2013) · Decision · doi:10.1037/2325-9965.1.s.8 · Cited by 16

The moderating influence of heart rate variability on stressor-elicited change in pupillary and attentional indices of emotional processing: An eye-Tracking study

Macatee, R. J., Albanese, B. J., Schmidt, N. B., & Cougle, J. R. (2016) · Biological Psychology · doi:10.1016/j.biopsycho.2016.11.013 · Cited by 21

The effects of life stress and neural learning signals on fluid intelligence

Friedel, E., Schlagenhauf, F., Beck, A., Dolan, R. J., Huys, Q. J. M., Rapp, M. A., & Heinz, A. (2014) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-014-0519-3 · Cited by 18

Principles of Pleasure Prediction

Braver, T. S., & Brown, J. W. (2003) · Neuron · doi:10.1016/s0896-6273(03)00230-7 · Cited by 17

Keynote address: revaluing the orbital prefrontal cortex

DOLAN, R. J. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1401.020 · Cited by 16

Theory-driven computational models of drug addiction in humans: Fruitful or futile?

Lim, T. V., & Ersche, K. D. (2023) · Addiction Neuroscience · doi:10.1016/j.addicn.2023.100066 · Cited by 16

Differential activation of the striatum for decision making and outcomes in a monetary task with gain and loss

Ino, T., Nakai, R., Azuma, T., Kimura, T., & Fukuyama, H. (2009) · Cortex · doi:10.1016/j.cortex.2009.02.022 · Cited by 16

Judgments About Others’ Trustworthiness: An fMRI Study

Watabe, M., Ban, H., & Yamamoto, H. (2011) · Letters on Evolutionary Behavioral Science · doi:10.5178/lebs.2011.16 · Cited by 16

Neural Mechanisms of Decision-Making and the Personal Level

Shea, N. J. (2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199579563.013.0062 · Cited by 16

A Dual Role Hypothesis of the Cortico-Basal-Ganglia Pathways: Opponency and Temporal Difference Through Dopamine and Adenosine

Morita, K., & Kawaguchi, Y. (2019) · Frontiers in Neural Circuits · doi:10.3389/fncir.2018.00111 · Cited by 16

Incentive motivation improves numerosity discrimination: Insights from pupillometry combined with drift-diffusion modelling

Dix, A., & Li, S. (2020) · Scientific Reports · doi:10.1038/s41598-020-59415-3 · Cited by 19

Financial decisions in the household

Burgoyne, C. B., & Kirchler, E. M. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511490118.006 · Cited by 17

Positive Interaction of Social Comparison and Personal Responsibility for Outcomes

Grygolec, J., Coricelli, G., & Rustichini, A. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00025 · Cited by 16

Neural Correlates of Effective Learning in Experienced Medical Decision-Makers

Downar, J. H., Bhatt, M. A., & Montague, P. R. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027768 · Cited by 18

Corticostriatal circuit mechanisms of value-based action selection: Implementation of reinforcement learning algorithms and beyond

Morita, K., Jitsev, J., & Morrison, A. (2016) · Behavioural Brain Research · doi:10.1016/j.bbr.2016.05.017 · Cited by 16

Neuroscience of Drugs and Addiction

Robbins, T. W., Cardinal, R. N., Ciano, P. D., Halligan, P. W., Hellemans, K., Lee, J. L. C., & Everitt, B. J. (2007) · Elsevier eBooks · doi:10.1016/b978-012370624-9/50006-2 · Cited by 16

Basic Methods from Neoclassical Economics

Caplin, A., & Glimcher, P. W. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00001-2 · Cited by 16

Computational Models of Cognitive Control

Verguts, T. (2017) · Wiley eBooks · doi:10.1002/9781118920497.ch8 · Cited by 17

Optogenetically-induced long term depression in the rat orbitofrontal cortex ameliorates stress-induced reversal learning impairment

Adler, S. M., Girotti, M., & Morilak, D. A. (2020) · Neurobiology of Stress · doi:10.1016/j.ynstr.2020.100258 · Cited by 15

Does Amount of Information Support Aesthetic Values?

Grzywacz, N. M., & Aleem, H. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.805658 · Cited by 16

Modelling Spirals of Silence and Echo Chambers by Learning from the Feedback of Others

Banisch, S., Gaisbauer, F., & Olbrich, E. (2022) · Entropy · doi:10.3390/e24101484 · Cited by 19

Smart GAN: a smart generative adversarial network for limited imbalanced dataset

Kumari, D., Vyshnavi, S., Dhar, R., Rajita, B. S. A. S., Panda, S., & Christopher, J. J. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-024-06198-3 · Cited by 15

The striatum and beyond: contributions of the hippocampus to decision making

Wimmer, G. E., & Shohamy, D. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199600434.003.0013 · Cited by 14

Functions of Learning Rate in Adaptive Reward Learning

Wu, X., Wang, T., Liu, C., Wu, T., Jiang, J., Zhou, D., & Zhou, J. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00592 · Cited by 18

Formalizing the Function of Anterior Insula in Rapid Adaptation

Bossaerts, P. L. (2018) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2018.00061 · Cited by 14

Amygdala and nucleus accumbens involvement in appetitive extinction

Kruse, O., Klein, S., León, I. T., Stark, R. M., & Klucken, T. (2020) · Human Brain Mapping · doi:10.1002/hbm.24915 · Cited by 15

Neural underpinnings of morality judgment and moral aesthetic judgment

Cheng, Q., Wen, X., Ye, G., Liu, Y., Kong, Y., & Mo, L. (2021) · Scientific Reports · doi:10.1038/s41598-021-97782-7 · Cited by 19

Causal Inference Gates Corticostriatal Learning

Dorfman, H. M., Tomov, M., Cheung, B., Clarke, D., Gershman, S. J., & Hughes, B. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.2796-20.2021 · Cited by 15

Regional gray matter volume associated with exercise dependence: A voxel‐based morphometry study

Zhang, F., Wang, S., Feng, Y., Qin, K., Li, H., Wu, B., Jia, Z., & Gong, Q. (2021) · Human Brain Mapping · doi:10.1002/hbm.25585 · Cited by 15

Intermediate Sensory Feedback Assisted Multi-Step Neural Decoding for Reinforcement Learning Based Brain-Machine Interfaces

Shen, X., Zhang, X., Huang, Y., Chen, S., Yu, Z., & Wang, Y. (2022) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2022.3210700 · Cited by 15

Stimulus-Dependent Adjustment of Reward Prediction Error in the Midbrain

Takemura, H., Samejima, K., Vogels, R., Sakagami, M., & Okuda, J. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028337 · Cited by 17

The amygdalostriatal and corticostriatal effective connectivity in anticipation and evaluation of facial attractiveness

Yu, H., Zhou, Z., & Zhou, X. (2013) · Brain and Cognition · doi:10.1016/j.bandc.2013.04.011 · Cited by 15

“Virus and Epidemic”: Causal Knowledge Activates Prediction Error Circuitry

Fenker, D. B., Schoenfeld, M. A., Waldmann, M. R., Schuetze, H., Heinze, H., & Düzel, E. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21387 · Cited by 18

Modeling the formation of social conventions from embodied real-time interactions

Freire, I. T., Moulin-Frier, C., Sánchez-Fibla, M., Arsiwalla, X. D., & Verschure, P. F. M. J. (2020) · PLoS ONE · doi:10.1371/journal.pone.0234434 · Cited by 25

Neuroeconomics: what neuroscience can learn from economics

Lohrenz, T. M., & Montague, P. R. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511490118.019 · Cited by 15

Operant Reward Learning in Aplysia

Brembs, B. (2003) · Current Directions in Psychological Science · doi:10.1046/j.0963-7214.2003.01265.x · Cited by 15

Stimulus–outcome learnability differentially activates anterior cingulate and hippocampus at feedback processingPreprint

Rodriguez, P. F. (2009) · Learning & Memory · doi:10.1101/lm.1191609 · Cited by 15

The value of what’s to come: neural mechanisms coupling prediction error and reward anticipationPreprint

Iigaya, K., Hauser, T. U., Kurth-Nelson, Z. L., O’Doherty, J. P., Dayan, P., & Dolan, R. J. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/588699 · Cited by 15

Comparing gratitude and pride: evidence from brain and behavior

Ding, K., & Liu, J. (2022) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-022-01006-y · Cited by 15

Hypothalamic interaction with reward-related regions during subjective evaluation of foods

Ogawa, A., Osada, T., Tanaka, M., Suda, A., Nakajima, K., Oka, S., Kamagata, K., Aoki, S., Oshima, Y., Tanaka, S., et al. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119744 · Cited by 14

The Placebo Effect in Psychosis: Why It Matters and How to Measure It

Hird, E., Diederen, K. M. J., Leucht, S., Jensen, K. B., & McGuire, P. K. (2023) · Biological Psychiatry Global Open Science · doi:10.1016/j.bpsgos.2023.02.008 · Cited by 14

Inversion of hierarchical Bayesian models using Gaussian processes

Lomakina, E. I., Paliwal, S., Diaconescu, A. O., Brodersen, K. H., Aponte, E. A., Buhmann, J. M., & Stephan, K. E. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.05.084 · Cited by 13

Derivation of a novel efficient supervised learning algorithm from cortical-subcortical loops

Chandrashekar, A. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2011.00050 · Cited by 14

Neural Mechanisms of Strategic Adaptation in Attentional Flexibility

Sali, A. W., Jiang, J., & Egner, T. (2020) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01541 · Cited by 15

Neural representation of decision confidence

Chen, J., Feng, T., Shi, J., Liu, L., & Li, H. (2013) · Behavioural Brain Research · doi:10.1016/j.bbr.2013.02.004 · Cited by 15

Understanding decision neuroscience: A multidisciplinary perspective and neural substrates

Miyapuram, K. P., & Pammi, V. S. C. (2013) · Progress in brain research · doi:10.1016/b978-0-444-62604-2.00014-9 · Cited by 18

Youth with substance abuse histories exhibit dysfunctional representation of expected value during a passive avoidance task

White, S. F., Tyler, P. M., Botkin, M. L., Erway, A. K., Thornton, L. C., Kolli, V. B., Pope, K., Meffert, H., & Blair, J. (2016) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2016.08.010 · Cited by 14

Predicting change: Approximate inference under explicit representation of temporal structure in changing environments

Marković, D., Reiter, A. M. F., & Kiebel, S. J. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006707 · Cited by 13

Individual Differences in the Perception of Probability

Khaw, M. W., Stevens, L., & Woodford, M. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008871 · Cited by 14

Economic and psychological determinants of car ownership and use

Gärling, T., & Loukopoulos, P. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511490118.016 · Cited by 15

The influence of trial order on learning from reward vs. punishment in a probabilistic categorization task: experimental and computational analyses

Moustafa, A. A., Gluck, M. A., Herzallah, M. M., & Myers, C. E. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00153 · Cited by 14

Prediction errors drive dynamic changes in neural patterns that guide behavior

Möhring, L., & Gläscher, J. P. (2023) · Cell Reports · doi:10.1016/j.celrep.2023.112931 · Cited by 13

Underlying interactive neural mechanism of motor learning governed by the cerebellum, the basal ganglia, and motor/sensory cortex: a review from theoretical perspective

Torbati, A. H. M., Jami, S., Kobravi, H.-R., Davoudi, N., Gholibeigi, M., & Ashkzari, A. (2024) · Neuroscience and Behavioral Physiology · doi:10.1007/s11055-024-01583-0 · Cited by 13

Bulimia Nervosa and Depression, from the Brain to the Gut Microbiota and Back

Romeo, M., Cavaliere, G., & Traina, G. (2024) · Frontiers in Bioscience-Landmark · doi:10.31083/j.fbl2908277 · Cited by 15

How Accurate Appraisal of Behavioral Costs and Benefits Guides Adaptive Pain Coping

Gandhi, W., Morrison, I., & Schweinhardt, P. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00103 · Cited by 14

The cholinergic contribution to the resting-state functional network in non-demented Parkinson’s disease

Lee, Y., Ham, J. H., Cha, J., Park, Y.-H., Lee, J. J., Sunwoo, M. K., Hong, J. Y., Sohn, Y. H., Lee, P. H., & Lee, P. H. (2018) · Scientific Reports · doi:10.1038/s41598-018-26075-3 · Cited by 13

Signals of anticipation of reward and of mean reward rates in the human brain

Viviani, R., Dommes, L., Bosch, J., Steffens, M., Paul, A., Schneider, K. L., Stingl, J., & Beschoner, P. (2020) · Scientific Reports · doi:10.1038/s41598-020-61257-y · Cited by 14

Hierarchical intrinsically motivated agent planning behavior with dreaming in grid environments

Dzhivelikian, E., Latyshev, A., Kuderov, P., & Panov, A. I. (2022) · Brain Informatics · doi:10.1186/s40708-022-00156-6 · Cited by 14

Reward, Context, and Human Behaviour

Blaukopf, C. L., & DiGirolamo, G. J. (2007) · The Scientific World JOURNAL · doi:10.1100/tsw.2007.122 · Cited by 15

Creativity

Caselli, R. J. (2009) · Cognitive and Behavioral Neurology · doi:10.1097/wnn.0b013e318192cce0 · Cited by 12

Reinforcement magnitudes modulate subthalamic beta band activity in patients with Parkinson’s disease

Schroll, H., Horn, A., Runge, J., Lipp, A., Schneider, G., Krauss, J. K., Hamker, F. H., & Kühn, A. A. (2018) · Scientific Reports · doi:10.1038/s41598-018-26887-3 · Cited by 13

The orbitofrontal cortex processes neurofeedback failure signals

Paret, C., Zähringer, J., Ruf, M., Ende, G., & Schmahl, C. G. (2019) · Behavioural Brain Research · doi:10.1016/j.bbr.2019.111938 · Cited by 13

Structural and functional brain correlates of altered taste processing in anorexia nervosa: A systematic review

Kot, E., Kucharska, K., Monteleone, A. M., & Monteleone, P. (2019) · European Eating Disorders Review · doi:10.1002/erv.2713 · Cited by 13

Abnormal white matter tracts of insula in smokers

Wang, C., Wang, S., Huang, P., Shen, Z., Qian, W. P., Luo, X., Li, K., Zeng, Q., Gu, Q., Yu, H., et al. (2020) · Brain Imaging and Behavior · doi:10.1007/s11682-020-00389-1 · Cited by 13

Multiple systems in macaques for tracking prediction errors and other types of surprise

Grohn, J., Schüffelgen, U., Neubert, F.-X., Bongioanni, A., Verhagen, L., Sallet, J., Kolling, N., & Rushworth, M. F. S. (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000899 · Cited by 13

Understanding the Phonetic Characteristics of Speech Under Uncertainty—Implications of the Representation of Linguistic Knowledge in Learning and Processing

Tomaschek, F., & Ramscar, M. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.754395 · Cited by 14

Correlates of reward‐predictive value in learning‐related hippocampal neural activity

Okatan, M. (2009) · Hippocampus · doi:10.1002/hipo.20535 · Cited by 14

Specific neural correlates of successful learning and adaptation during social exchanges

Smith, A. P. R., Fiorentini, C., Kessler, E., Boyd, H., Roberts, F., & Skuse, D. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nss079 · Cited by 13

Altered Basolateral Amygdala Encoding in an Animal Model of Schizophrenia

Hernandez, A., Burton, A. C., O’Donnell, P., Schoenbaum, G. M., & Roesch, M. R. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.5096-14.2015 · Cited by 15

Value-free reinforcement learning: Policy optimization as a minimal model of operant behaviorPreprint

Bennett, D., Niv, Y., & Langdon, A. (2021) · doi:10.31234/osf.io/ew58m · Cited by 13

Adverse childhood experiences, low self‐esteem, and salient stimulus response in eating disorders

Lagan, S., Shott, M. E., & Frank, G. (2024) · European Eating Disorders Review · doi:10.1002/erv.3064 · Cited by 12

Thermosensory predictive coding underpins an illusion of pain

Ehmsen, J. F., Nikolova, N. E., Christensen, D. E., Banellis, L., Böhme, R. A., Brændholt, M., Courtin, A. S., Krænge, C. E., Mitchell, A. G., Deolindo, C. S., et al. (2025) · Science Advances · doi:10.1126/sciadv.adq0261 · Cited by 12

Top-down control over feedback processing: The probability of valid feedback affects feedback-related brain activity

Ernst, B., & Steinhauser, M. (2017) · Brain and Cognition · doi:10.1016/j.bandc.2017.03.008 · Cited by 12

Movement errors during skilled motor performance engage distinct prediction error mechanisms

Gabitov, E., Lungu, O., Albouy, G., & Doyon, J. (2020) · Communications Biology · doi:10.1038/s42003-020-01465-4 · Cited by 17

How do neural processes give rise to cognition? Simultaneously predicting brain and behavior with a dynamic model of visual working memory.

Buss, A. T., Magnotta, V. A., Penny, W. D., Schöner, G., Huppert, T. J., & Spencer, J. P. (2021) · Psychological Review · doi:10.1037/rev0000264 · Cited by 12

Motivational learning biases are differentially modulated by genetic determinants of striatal and prefrontal dopamine function

Richter, A., de Boer, L., Guitart‐Masip, M., Behnisch, G., Seidenbecher, C. I., & Schott, B. H. (2021) · Journal of Neural Transmission · doi:10.1007/s00702-021-02382-4 · Cited by 11

Neurodevelopment of the incentive network facilitates motivated behaviour from adolescence to adulthood

Willinger, D., Karipidis, I. I., Dimanova, P., Walitza, S., & Brem, S. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118186 · Cited by 12

Neural Response to Expecting a Caloric Sweet Taste Stimulus Predicts Body Mass Index Longitudinally Among Young Adult Women With Anorexia Nervosa

Gorrell, S., Shott, M. E., Pryor, T. L., & Frank, G. (2023) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2023.07.007 · Cited by 12

Error-related Persistence of Motor Activity in Resting-state Networks

Bernardi, N. F., van Vugt, F. T., Valle-Mena, R. R., Vahdat, S., & Ostry, D. J. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01323 · Cited by 12

Modeling implicit learning in a cross-modal audio-visual serial reaction time task

Taesler, P., Jablonowski, J., Fu, Q., & Rose, M. (2018) · Cognitive Systems Research · doi:10.1016/j.cogsys.2018.10.002 · Cited by 12

Region-specific effects of acute haloperidol in the human midbrain, striatum and cortex

Wächtler, C. O., Chakroun, K., Clos, M., Bayer, J., Hennies, N., Beaulieu, J., & Sommer, T. (2020) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2020.04.008 · Cited by 11

Roles of the ClC chloride channel CLH-1 in food-associated salt chemotaxis behavior of C. elegans

Park, C., Sakurai, Y., Sato, H., Kanda, S., Iino, Y., & Kunitomo, H. (2021) · eLife · doi:10.7554/elife.55701 · Cited by 12

Computational Models of Mentalizing

González, B., & Chang, L. J. (2021) · Springer eBooks · doi:10.1007/978-3-030-51890-5_15 · Cited by 12

Reward processing in the human brain

Porcelli, A. J., & Delgado, M. R. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374620-7.00007-8 · Cited by 15

Dual Reward Prediction Components Yield Pavlovian Sign- and Goal-Tracking

Kaveri, S., & Nakahara, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0108142 · Cited by 11

Easy to learn, hard to suppress: The impact of learned stimulus–outcome associations on subsequent action control

van Wouwe, N. C., van den Wildenberg, W. P. M., Ridderinkhof, K. R., Claassen, D. O., Neimat, J. S., & Wylie, S. A. (2015) · Brain and Cognition · doi:10.1016/j.bandc.2015.10.007 · Cited by 13

Reversal learning reveals cognitive deficits and altered prediction error encoding in the ventral striatum in Huntington’s disease

Nickchen, K., Boehme, R., Amador, M. D. M., Hälbig, T. D., Dehnicke, K., Panneck, P., Behr, J., Prass, K., Heinz, A., Deserno, L., et al. (2016) · Brain Imaging and Behavior · doi:10.1007/s11682-016-9660-0 · Cited by 12

Learning Contextual Reward Expectations for Value Adaptation

Rigoli, F., Chew, B., Dayan, P., & Dolan, R. J. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01191 · Cited by 12

Sustainable consumption and lifestyle change

Jackson, T. P. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511490118.014 · Cited by 12

Precision weighting of cortical unsigned prediction errors is mediated by dopamine and benefits learningPreprint

Haarsma, J., Fletcher, P. C., Ziauddeen, H., Spencer, T. J., Diederen, K. M. J., & Murray, G. K. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/288936 · Cited by 12

Neural substrates of parallel devaluation-sensitive and devaluation-insensitive Pavlovian learning in humans

Pool, E. R., Pauli, W. M., Cross, L., & O’Doherty, J. P. (2023) · Nature Communications · doi:10.1038/s41467-023-43747-5 · Cited by 11

Reward magnitude tracking by neural populations in ventral striatum

Fiallos, A. M., Bricault, S., Cai, L. X., Worku, H. A., Colonnese, M. T., Westmeyer, G. G., & Jasanoff, A. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.036 · Cited by 11

Prediction Errors in Neural Processing: Imaging in Humans

Lohrenz, T. M., & Montague, P. R. (2009) · Elsevier eBooks · doi:10.1016/b978-008045046-9.01556-4

Temporal difference models describe higher-order learning in humans

Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605

� Human Brain Mapping 28:294–302(2007) � Separate Brain Regions Code for Salience vs. Valence During Reward Prediction in Humans

Jensen, J., Smith, A. J., Willeit, M., Crawley, A. P., Mikulis, D. J., Vitcu, I., & Kapur, S. (2013)

Separate brain regions code for salience vs. valence during reward prediction in humans

Jensen, J., Smith, A. J., Willeit, M., Crawley, A. P., Mikulis, D. J., Vitcu, I., & Kapur, S. (2006) · Human Brain Mapping · doi:10.1002/hbm.20274 · Cited by 184

Neural Coding of Reward-Prediction Error Signals During Classical Conditioning With Attractive Faces

Bray, S., & O’Doherty, J. P. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01211.2006 · Cited by 185