Evidence for model-based computations in the human amygdala during Pavlovian conditioning
Open accessAbstract
Contemporary computational accounts of instrumental conditioning have emphasized a role for a model-based system in which values are computed with reference to a rich model of the structure of the world, and a model-free system in which values are updated without encoding such structure. Much less studied is the possibility of a similar distinction operating at the level of Pavlovian conditioning. In the present study, we scanned human participants while they participated in a Pavlovian conditioning task with a simple structure while measuring activity in the human amygdala using a high-resolution fMRI protocol. After fitting a model-based algorithm and a variety of model-free algorithms to the fMRI data, we found evidence for the superiority of a model-based algorithm in accounting for activity in the amygdala compared to the model-free counterparts. These findings support an important role for model-based algorithms in describing the processes underpinning Pavlovian conditioning, as well as providing evidence of a role for the human amygdala in model-based inference.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
More recent investigations have detected evidence for model-based computations in the amygdala.
“More recent investigations have looked closely at the distinction between model-based and model-free, detecting evidence for the former in areas such as the amygdala (Prévost et al., 2013).”
From Goals and Habits in the Brain (2013) · cites this paper as Prévost et al., 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033 · see citing works
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · see citing works
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696 · see citing works
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · see citing works
Image matching as a diffusion process: an analogy with maxwell’s demons
Thirion, J.-P. (1998) · Medical Image Analysis · doi:10.1016/s1361-8415(98)80022-4 · Cited by 2,445 · see citing works
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works
Self-citationModel-based influences on humans’ choices and striatal prediction errors
Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779 · see citing works
Bayesian model selection for group studies
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.025 · Cited by 1,423 · see citing works
Jeurgen, K., Assheuer, J., & Paxinos, G. (1997) · Medical Entomology and Zoology · Cited by 1,403 · see citing works
Baxter, M. G., & Murray, E. A. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn875 · Cited by 1,200 · see citing works
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166 · see citing works
Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165 · see citing works
Molecular mechanisms of fear learning and memory
Johansen, J. P., Cain, C. K., Ostroff, L. E., & LeDoux, J. E. (2011) · Cell · doi:10.1016/j.cell.2011.10.009 · Cited by 1,012 · see citing works
Natural selective attention: Orienting and emotion
Bradley, M. M. (2009) · Psychophysiology · doi:10.1111/j.1469-8986.2008.00702.x · Cited by 976 · see citing works
Why We Think Plasticity Underlying Pavlovian Fear Conditioning Occurs in the Basolateral Amygdala
Fanselow, M. S., & LeDoux, J. E. (1999) · Neuron · doi:10.1016/s0896-6273(00)80775-8 · Cited by 914 · see citing works
MR volumetric analysis of the human entorhinal, perirhinal, and temporopolar cortices.
Insausti, R., Juottonen, K., Soininen, H. S., Insausti, A. M., Partanen, K. P. L., Vainio, P. A., Laakso, M. P., & Pitkänen, A. (1998) · PubMed Central · Cited by 774 · see citing works
The amygdala, reward and emotion
Murray, E. A. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.08.013 · Cited by 679 · see citing works
Decision theory, reinforcement learning, and the brain
Dayan, P., & Daw, N. D. (2008) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.8.4.429 · Cited by 580 · see citing works
Yacubian, J., Gläscher, J., Schroeder, K., Sommer, T., Braus, D. F., & Büchel, C. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2915-06.2006 · Cited by 537 · see citing works
Model‐Based fMRI and Its Application to Reward Learning and Decision Making
O’Doherty, J. P., Hampton, A. N., & Kim, H. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.022 · Cited by 509 · see citing works
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498 · see citing works
Learning and selective attention
Dayan, P., Kakade, S., & Montague, P. R. (2000) · Nature Neuroscience · doi:10.1038/81504 · Cited by 495 · see citing works
Multiple model-based reinforcement learning
Doya, K., Samejima, K., Katagiri, K.-I., & Kawato, M. (2002) · Neural Computation · doi:10.1162/089976602753712972 · Cited by 476 · see citing works
Gottfried, J. A., O’Doherty, J. P., & Dolan, R. J. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-24-10829.2002 · Cited by 474 · see citing works
Bayesian theories of conditioning in a changing world
Courville, A. C., Daw, N. D., & Touretzky, D. S. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.004 · Cited by 457 · see citing works
Differential Encoding of Losses and Gains in the Human Striatum
Seymour, B., Daw, N. D., Dayan, P., Singer, T., & Dolan, R. J. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.0400-07.2007 · Cited by 455 · see citing works
Opponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439 · see citing works
Self-citationContext, learning, and extinction
Gershman, S. J., Blei, D. M., & Niv, Y. (2010) · Psychological Review · doi:10.1037/a0017808 · Cited by 386 · see citing works
Non-parametric Diffeomorphic Image Registration with the Demons Algorithm
Vercauteren, T. K., Pennec, X., Aymeric Perchant, B., & Ayache, N. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-75759-7_39 · Cited by 380 · see citing works
Extending animal models of fear conditioning to humans
Delgado, M. R., Olsson, A., & Phelps, E. A. (2006) · Biological Psychology · doi:10.1016/j.biopsycho.2006.01.006 · Cited by 366 · see citing works
Differential roles of human striatum and amygdala in associative learning
Li, J., Schiller, D., Schoenbaum, G. M., Phelps, E. A., & Daw, N. D. (2011) · Nature Neuroscience · doi:10.1038/nn.2904 · Cited by 364 · see citing works
Classical fear conditioning in functional neuroimaging
Büchel, C. (2000) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00078-7 · Cited by 350 · see citing works
Pupillary and Cardiac Activity During Visual Attention
Libby, W. L., Lacey, B. C., & Lacey, J. I. (1973) · Psychophysiology · doi:10.1111/j.1469-8986.1973.tb00526.x · Cited by 308 · see citing works
Yassa, M. A., & Stark, C. E. L. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.09.016 · Cited by 252 · see citing works
Contributions of the Amygdala to Reward Expectancy and Choice Signals in Human Prefrontal Cortex
Hampton, A. N., Adolphs, R., Tyszka, J. M., & O'Doherty, J. P. (2007) · Neuron · doi:10.1016/j.neuron.2007.07.022 · Cited by 213 · see citing works
The Neural Mechanisms Underlying the Influence of Pavlovian Cues on Human Decision Making
Bray, S., Rangel, A., Shimojo, S., Balleine, B., & O'Doherty, J. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.0897-08.2008 · Cited by 193 · see citing works
Miller, M. I., Beg, M. F., Ceritoglu, C., & Stark, C. E. L. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0503892102 · Cited by 173 · see citing works
Neural Coding of Reward-Prediction Error Signals During Classical Conditioning With Attractive Faces
Bray, S., & O’Doherty, J. P. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01211.2006 · Cited by 169 · see citing works
Neural Correlates of Variations in Event Processing during Learning in Basolateral Amygdala
Roesch, M. R., Calu, D. J., Esber, G. R., & Schoenbaum, G. M. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.5781-09.2010 · Cited by 150 · see citing works
Elliott, R., Newman, J. L., Longe, O. A., & Deakin, J. F. W. (2003) · NeuroImage · doi:10.1016/j.neuroimage.2003.10.010 · Cited by 127 · see citing works
Emotional and autonomic consequences of spinal cord injury explored using functional brain imaging
Nicotra, A., Critchley, H., Mathias, C. J., & Dolan, R. J. (2005) · Brain · doi:10.1093/brain/awh699 · Cited by 97 · see citing works
Understanding Neural Coding through the Model-Based Analysis of Decision Making: Figure 1.
Corrado, G. S., & Doya, K. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.1590-07.2007 · Cited by 93 · see citing works
The fear-inhibited light reflex: importance of the anticipation of an aversive event
Bitsios, P., Szabadi, E., & Bradshaw, C. M. (2004) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2003.12.006 · Cited by 83 · see citing works
Prévost, C., McCabe, J. A., Jessup, R. K., Bossaerts, P. L., & O’Doherty, J. P. (2011) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07686.x · Cited by 56 · see citing works
Glover (2000) · doi:10.1002/1522-2594(200007)44:1
Flagged first, then by citations
Cited by
Sorted by citations
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977 · see citing works
The ecology of human fear: survival optimization and the nervous system
Mobbs, D., Hagan, C. C., Dalgleish, T., Silston, B., & Prévost, C. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00055 · Cited by 498 · see citing works
Learning, reward, and decision making
O'Doherty, J. P., Cockburn, J., & Pauli, W. M. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044216 · Cited by 475 · see citing works
The basolateral amygdala in reward learning and addiction
Wassum, K. M., & Izquierdo, A. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.017 · Cited by 306 · see citing works
Abstract context representations in primate amygdala and prefrontal cortex
Saez, A., Rigotti, M., Ostojic, S., Fusi, S., & Salzman, C. D. (2015) · Neuron · doi:10.1016/j.neuron.2015.07.024 · Cited by 183 · see citing works
Howard, J. D., & Kahnt, T. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.3473-16.2017 · Cited by 131 · see citing works
Amygdala and Ventral Striatum Make Distinct Contributions to Reinforcement Learning
Costa, V. D., Monte, O. D., Lucas, D. R., Murray, E. A., & Averbeck, B. B. (2016) · Neuron · doi:10.1016/j.neuron.2016.09.025 · Cited by 133 · see citing works
Revaluing the Role of vmPFC in the Acquisition of Pavlovian Threat Conditioning in Humans
Battaglia, S., Garofalo, S., di Pellegrino, G., & Starita, F. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.0304-20.2020 · Cited by 111 · see citing works
Ojala, K. E., & Bach, D. R. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.04.019 · Cited by 120 · see citing works
The structure of reinforcement-learning mechanisms in the human brain
O’Doherty, J. P., Lee, S. W., & McNamee, D. (2014) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2014.10.004 · Cited by 100 · see citing works
How pupil responses track value-based decision-making during and after reinforcement learning
Slooten, J. C. V., Jahfari, S., Knapen, T. H. J., & Theeuwes, J. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006632 · Cited by 88 · see citing works
The role of learning-related dopamine signals in addiction vulnerability
Huys, Q. J. M., Tobler, P. N., Hasler, G., & Flagel, S. B. (2014) · Progress in brain research · doi:10.1016/b978-0-444-63425-2.00003-9 · Cited by 87 · see citing works
Dissociable Learning Processes Underlie Human Pain Conditioning
Zhang, S., Mano, H., Ganesh, G., Robbins, T. W., & Seymour, B. (2015) · Current Biology · doi:10.1016/j.cub.2015.10.066 · Cited by 84 · see citing works
Pauli, W. M., Larsen, T., Collette, S., Tyszka, J. M., Seymour, B., & O’Doherty, J. P. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.2277-15.2015 · Cited by 81 · see citing works
Amygdala subnuclei response and connectivity during emotional processing
Hrybouski, S., Aghamohammadi‐Sereshki, A., Madan, C. R., Shafer, A. T., Baron, C. A., Seres, P., Beaulieu, C., Olsen, F., & Malykhin, N. V. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.056 · Cited by 78 · see citing works
Devaluation and sequential decisions: linking goal-directed and model-based behavior
Friedel, E., Koch, S., Wendt, J., Heinz, A., Deserno, L., & Schlagenhauf, F. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00587 · Cited by 79 · see citing works
Amygdala-cortical collaboration in reward learning and decision making
Wassum, K. M. (2022) · eLife · doi:10.7554/elife.80926 · Cited by 76 · see citing works
Grady, A. K., Bowen, K. H., Hyde, A. T., Totsch, S. K., & Knight, D. C. (2016) · Behavioral Neuroscience · doi:10.1037/bne0000121 · Cited by 70 · see citing works
To be specific: The role of orbitofrontal cortex in signaling reward identity.
Howard, J. D., & Kahnt, T. (2021) · Behavioral Neuroscience · doi:10.1037/bne0000455 · Cited by 57 · see citing works
Pool, E. R., Pauli, W. M., Kress, C. S., & O’Doherty, J. P. (2019) · Nature Human Behaviour · doi:10.1038/s41562-018-0527-9 · Cited by 52 · see citing works
Ghosh, S. K., Aswani, K., Singh, S., Sahu, S., Fujita, D., & Bandyopadhyay, A. (2014) · Information · doi:10.3390/info5010028 · Cited by 50 · see citing works
Evidence for model-based encoding of Pavlovian contingencies in the human brain
Pauli, W. M., Gentile, G., Collette, S., Tyszka, J. M., & O’Doherty, J. P. (2019) · Nature Communications · doi:10.1038/s41467-019-08922-7 · Cited by 42 · see citing works
Pupil dilation as an implicit measure of appetitive Pavlovian learning
Pietrock, C., Ebrahimi, C., Katthagen, T., Koch, S., Heinz, A., Rothkirch, M., & Schlagenhauf, F. (2019) · Psychophysiology · doi:10.1111/psyp.13463 · Cited by 42 · see citing works
Pupil dilation as an index of Pavlovian conditioning. A systematic review and meta-analysis
Finke, J. B., Roesmann, K., Stalder, T., & Klucken, T. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.09.005 · Cited by 43 · see citing works
Enhanced Pavlovian aversive conditioning to positive emotional stimuli.
Stussi, Y., Pourtois, G., & Sander, D. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000424 · Cited by 37 · see citing works
Effects of positive reinforcement training for heifers on responses to a subcutaneous injection
Lomb, J., Mauger, A., von Keyserlingk, M. A. G., & Weary, D. M. (2021) · Journal of Dairy Science · doi:10.3168/jds.2020-19463 · Cited by 36 · see citing works
Physically active individuals look for more: An eye‐tracking study of attentional bias
Cheval, B., Miller, M. W., Orsholits, D., Berry, T. R., Sander, D., & Boisgontier, M. P. (2020) · Psychophysiology · doi:10.1111/psyp.13582 · Cited by 34 · see citing works
Pool, E. R., Munoz Tord, D., Delplanque, S., Stussi, Y., Cereghetti, D., Vuilleumier, P., & Sander, D. (2022) · The Journal of Neuroscience · doi:10.1523/jneurosci.1124-21.2022 · Cited by 33 · see citing works
Value-Related Neuronal Responses in the Human Amygdala during Observational Learning
Aquino, T. G., Minxha, J., Dunne, S., Ross, I. B., Mamelak, A. N., Rutishauser, U., & O’Doherty, J. P. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.2897-19.2020 · Cited by 28 · see citing works
Atlas, L. Y. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.12.008 · Cited by 31 · see citing works
Evaluation of ambiguous associations in the amygdala by learning the structure of the environment
Madarász, T. J., Díaz-Mataix, L., Akhand, O., Ycu, E. A., LeDoux, J. E., & Johansen, J. P. (2016) · Nature Neuroscience · doi:10.1038/nn.4308 · Cited by 30 · see citing works
The control of tonic pain by active relief learning
Zhang, S., Mano, H., Lee, M., Yoshida, W., Kawato, M., Robbins, T. W., & Seymour, B. (2018) · eLife · doi:10.7554/elife.31949 · Cited by 34 · see citing works
Weissengruber, S., Lee, S. W., O’Doherty, J. P., & Ruff, C. C. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhz019 · Cited by 28 · see citing works
Learned expectations and uncertainty facilitate pain during classical conditioning
Taylor, V. A., Chang, L. J., Rainville, P., & Roy, M. (2017) · Pain · doi:10.1097/j.pain.0000000000000948 · Cited by 25 · see citing works
Instrumental and Pavlovian Mechanisms in Alcohol Use Disorder
Doñamayor, N., Ebrahimi, C., Garbusow, M., Wedemeyer, F., Schlagenhauf, F., & Heinz, A. (2020) · Current Addiction Reports · doi:10.1007/s40429-020-00333-9 · Cited by 22 · see citing works
Slooten, J. C. V., Jahfari, S., Knapen, T. H. J., & Theeuwes, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0185665 · Cited by 22 · see citing works
Malykhin, N. V., Pietrasik, W., Aghamohammadi‐Sereshki, A., Hoang, K. N., Fujiwara, E., & Olsen, F. (2022) · Journal of Neuroscience Research · doi:10.1002/jnr.25152 · Cited by 20 · see citing works
Measuring Pavlovian appetitive conditioning in humans with the postauricular reflex
Stussi, Y., Delplanque, S., Coraj, S., Pourtois, G., & Sander, D. (2018) · Psychophysiology · doi:10.1111/psyp.13073 · Cited by 18 · see citing works
Individual differences in learning positive affective value
Wuensch, L., Pool, E. R., & Sander, D. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.11.001 · Cited by 20 · see citing works
Temperament in Cattle: A Method of Evaluation and Main Characteristics
Данчук, О. В., Karposvkii, V. I., Tomchuk, V., Журенко, О. В., Bobrytska, O. M., & Трокоз, В. О. (2020) · Neurophysiology · doi:10.1007/s11062-020-09853-6 · Cited by 19 · see citing works
Attention hijacked: How social media notifications disrupt cognitive processing
Fournier, H., Fournel, A., Osiurak, F., Koenig, O., Pâris, F., Gaujoux, V., & Ringeval, F. (2026) · Computers in Human Behavior · doi:10.1016/j.chb.2026.108926 · Cited by 18 · see citing works
Kheirabadi, N. R., Chiolerio, A., & Adamatzky, A. (2024) · BioNanoScience · doi:10.1007/s12668-023-01287-8 · Cited by 14 · see citing works
Kolada, E., Bielski, K., Wilk, M., Rymarczyk, K., Bogorodzki, P., Kazulo, P., Kossowski, B., Wypych, M., Marchewka, A., Kaczmarek, L., et al. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.0926-22.2023 · Cited by 13 · see citing works
Pool, E. R., Pauli, W. M., Cross, L., & O’Doherty, J. P. (2023) · Nature Communications · doi:10.1038/s41467-023-43747-5 · Cited by 11 · see citing works
In vivo quantification of amygdala subnuclei using 4.7 T fast spin echo imaging
Aghamohammadi‐Sereshki, A., Huang, Y., Olsen, F., & Malykhin, N. V. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.03.016 · Cited by 10 · see citing works
Colas, J. T., Dundon, N. M., Gerraty, R. T., Saragosa‐Harris, N. M., Szymula, K. P., Tanwisuth, K., Tyszka, J. M., van Geen, C., Ju, H., Toga, A. W., et al. (2022) · Human Brain Mapping · doi:10.1002/hbm.25988 · Cited by 8 · see citing works
Functional organization of the human amygdala in appetitive learning
Kolada, E., Bielski, K., Falkiewicz, M., & Szatkowska, I. (2017) · Acta Neurobiologiae Experimentalis · doi:10.21307/ane-2017-044 · Cited by 8 · see citing works
Testing the Possibility of Model-based Pavlovian Control of Attention to Threat
Talmi, D., Slapkova, M., & Wieser, M. J. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01329 · Cited by 8 · see citing works
Basolateral amygdala dopamine transmits emotional salience
Brickner, M. A., Szot, W. E., Wolff, A. R., Thomas, M. J., & Saunders, B. T. (2026) · Nature Communications · doi:10.1038/s41467-026-74226-2 · Cited by 8 · see citing works
Pool, E. R., & Sander, D. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-821124-3.00005-3 · Cited by 7 · see citing works
Neural Correlates of Causal Confounding
Liljeholm, M. (2019) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01479 · Cited by 6 · see citing works
Aquino, T. G., Courellis, H. S., Mamelak, A. N., Rutishauser, U., & O’Doherty, J. P. (2024) · Journal of Neuroscience · doi:10.1523/jneurosci.1628-23.2024 · Cited by 6 · see citing works
Considering the Influence of the Pavlovian System on Behavior: Appraisal and Value Representation
Sennwald, V., Pool, E. R., & Sander, D. (2017) · Psychological Inquiry · doi:10.1080/1047840x.2017.1259951 · Cited by 6 · see citing works
Sayão, A., Alves, H., Furukawa, E., Wenk, T. S., Cagy, M., Gutierrez-Arango, S., Tripp, G., & Caparelli-Dáquer, E. M. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.639372 · Cited by 6 · see citing works
Lesaint, F., Sigaud, O., & Khamassi, M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0111050 · Cited by 5 · see citing works
Pool, E. R., Tord, D. M., Delplanque, S., Stussi, Y., Cereghetti, D. M., Vuilleumier, P. O., & Sander, D. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.05.02.442349 · Cited by 5 · see citing works
Individually irrational pruning is essential for ecological rationality in a social context
Zendehrouh, S., & Ahmadabadi, M. N. (2020) · Cognitive Psychology · doi:10.1016/j.cogpsych.2020.101272 · Cited by 4 · see citing works
Bidirectional Control of Risk-Seeking Behavior by the Basolateral Amygdala
Cisneros-Franco, J. M., & de Villers‐Sidani, E. (2018) · eNeuro · doi:10.1523/eneuro.0168-18.2018 · Cited by 4 · see citing works
Calabro, R., Lyu, Y., & Leong, Y. C. (2022) · Cerebral Cortex · doi:10.1093/cercor/bhac452 · Cited by 5 · see citing works
The control of tonic pain by active relief learningPreprint
Zhang, S., Mano, H., Lee, M., Yoshida, W., Kawato, M., Robbins, T. W., & Seymour, B. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/222653 · Cited by 3 · see citing works
Pain and self-preservation in autonomous robots: From neurobiological models to psychiatric disease
Piccolo, L., Libera, F. D., Bonarini, A., Seymour, B., & Ishiguro, H. (2017) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2017.8329816 · Cited by 2 · see citing works
Duggins, P., & Eliasmith, C. (2024) · European Journal of Neuroscience · doi:10.1111/ejn.16338 · Cited by 2 · see citing works
Episodic, Semantic, Pavlovian, and Procedural Cognitive MapsPreprint
Fernandes, J. J. F. R., & Holroyd, C. B. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/161141 · Cited by 2 · see citing works
Aquino, T. G., Courellis, H. S., Mamelak, A. N., Rutishauser, U., & O’Doherty, J. P. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.02.10.528055 · Cited by 2 · see citing works
Can automatic reactions mirror exercise dependence?
Quossi, A., Fessler, L., Maltagliati, S., Gardner, B., Miller, M. W., Sander, D., Rebar, A., Szabo, A., & Cheval, B. (2024) · International Journal of Sport and Exercise Psychology · doi:10.1080/1612197x.2024.2387698 · Cited by 1 · see citing works
Hierarchical cue control of drug seeking in the face of costPreprint
Collins, V. L., Bornhoft, K. N., Wolff, A. R., Sinha, S., & Saunders, B. T. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.05.05.490799 · Cited by 1 · see citing works
Pool, E. R., Pauli, W. M., Cross, L., & O’Doherty, J. P. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.01.26.525637 · Cited by 1 · see citing works
Transition ability to safe states reduces fear responses to heightPreprint
Haruno, M., & Fujino, M. (2024) · doi:10.31234/osf.io/r7p6w · Cited by 1 · see citing works
Model-based Pavlovian control of attention to threatPreprint
Talmi, D., Slapkova, M., & Wieser, M. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/288027
Theoretical Insight in Financial Decision and Brain as Fractal Computer Architecture
Njegovanović, A. (2019) · Financial Markets Institutions and Risks · doi:10.21272/fmir.3(2).91-101.2019
PD-12-2 先天性心疾患を増悪させる小児外科疾患とその外科治療 : 治療時期と予後(先天性心疾患合併小児外科疾患の最新の治療戦略と予後,パネルディスカッション,第110回日本外科学会定期学術集会)
川田, 博., 岸本, 英., 盤井, 成., 小澤, 秀., 木戸高志, 萱谷, 太., 稲村, 登., 窪田, 昭., & 川原, 央. (2010) · 日本外科学会雑誌
Stussi, Y., & Coppin, G. (2024) · Biological Psychology · doi:10.1016/j.biopsycho.2024.108805
Measuring Human Pavlovian Reward Conditioning and Memory Retention After Consolidation
Xia, Y., Liu, H., Kälin, O. K., Gerster, S., & Bach, D. R. (2025) · Psychophysiology · doi:10.1111/psyp.70058
Disgust acquisition in Pavlovian conditioning: A systematic review and meta-analysis
Schippers, A. M., Klucken, T., Sperl, M. F. J., Lipp, O. V., & Finke, J. B. (2025) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2025.106499
Emergence of rapid value inference through meta-reinforcement learningPreprint
Lee, J., Hennig, J. A., Frelih, V., Gershman, S. J., & Uchida, N. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2025.11.30.691382
Attention hijacked: How social media notifications disrupt cognitive processingPreprint
Gaujoux, V., Pâris, F., Ringeval, F., Fournier, H., Koenig, O., Osiurak, F., & Fournel, A. (2025) · PsyArXiv (OSF Preprints)
Tonic pain modulates neural correlates of associative phasic pain memories
Hewitt, D., Tong, S., Schreiber, S., & Seymour, B. (2026) · Pain · doi:10.1097/j.pain.0000000000003917
Quantitative Approaches to Pavlovian Conditioning
Mallea, J. I., Daniels, C. W., & Balsam, P. D. (2026) · Springer eBooks · doi:10.1007/978-3-032-17450-5_3
The basolateral amygdala dopamine system shapes dynamic drug seeking statesPreprint
Brickner, M. A., Szot, W. E., Prohofsky, J., Wolff, A. R., Thomas, M. J., & Saunders, B. T. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.09.29.755395
- Authors
- Prévost, C., McNamee, D., Jessup, R. K., Bossaerts, P., & O'Doherty, J. P.
- Affiliations
- Trinity College Dublin (IE)
- California Institute of Technology (US)
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-02-21
- Volume
- 9
- Issue
- 2
- Pages
- e1002918
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC3578744
- OpenAlex
- W2060480068
- Cited by
- 79
- References
- 46
- Citations by year
- 2026: 5 · 2025: 4 · 2024: 6 · 2023: 4 · 2022: 6 · 2021: 6 · 2020: 8 · 2019: 7 · 2018: 7 · 2017: 9 · 2016: 4 · 2015: 6 · 2014: 5 · 2013: 1
- FWCI
- 2.87
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- CaltechAUTHORS (California Institute of Technology) (submittedVersion, cc-by)
- Arrow@dit (Dublin Institute of Technology) (submittedVersion, cc-by-nc-sa)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Science Foundation Ireland (08/IN.1/B1844)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- model-based learning, model-free learning, human amygdala, classical conditioning, associative learning, computational psychiatry, model-based inference
- MeSH terms
- Algorithms, Amygdala, Blinking, Conditioning, Classical, Heart Rate, Humans, Magnetic Resonance Imaging, Male, Models, Neurological, Pupil, Signal Processing, Computer-Assisted, Respiratory Rate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
