Striatal structure and function predict individual biases in learning to avoid pain
Open accessAbstract
Significance: Our ability to learn how to avoid harm is critical for maintaining physical and mental health. However, excessive harm avoidance can be maladaptive, as evident in psychiatric disorders such as avoidant personality disorder and obsessive-compulsive disorder. We therefore investigated the neural factors underlying individual imbalances in harm avoidance behavior. Our findings show that such imbalances can be predicted by the function and structure of an individual’s striatum, a brain region that is critical for goal-directed decisionmaking. Moreover, the neural signals expressed in this region revealed key processes through which individuals learn to avoid harm. These findings highlight a neural basis for imbalanced harm avoidance behavior, extreme forms of which may contribute to psychiatric pathology.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Three decision-making studies that involved avoiding pain or shock examined prediction errors to successful and unsuccessful avoidance, and two found evidence for striatal prediction errors to successful avoidance of shock.
“However, three decision-making studies (Seymour et al., 2012; Roy et al., 2014; Eldar et al., 2016) that involved avoiding pain or shock examined prediction errors to successful and unsuccessful avoidance, and two found evidence for striatal prediction errors to successful avoidance of shock.”
From Active avoidance: Neural mechanisms and attenuation of pavlovian conditioned responding (2017) · cites this paper as Eldar et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369 · see citing works
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. B. (2013) · Oxford University Press eBooks · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,841 · see citing works
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482 · see citing works
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433 · see citing works
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909 · see citing works
Voxel-Based Morphometry—The Methods
Ashburner, J., & Friston, K. J. (2000) · NeuroImage · doi:10.1006/nimg.2000.0582 · Cited by 8,676 · see citing works
Saliency, switching, attention and control: a network model of insula function
Menon, V., & Uddin, L. Q. (2010) · Brain Structure and Function · doi:10.1007/s00429-010-0262-0 · Cited by 5,592 · see citing works
Better Bootstrap Confidence Intervals
Efron, B. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478410 · Cited by 3,462 · see citing works
Differential contribution of amygdala and hippocampus to cued and contextual fear conditioning.
Phillips, R. G., & LeDoux, J. E. (1992) · Behavioral Neuroscience · doi:10.1037/0735-7044.106.2.274 · Cited by 3,292 · see citing works
Differential contribution of amygdala and hippocampus to cued and contextual fear conditioning.
Phillips, R. G., & LeDoux, J. E. (1992) · Behavioral Neuroscience · doi:10.1037//0735-7044.106.2.274 · Cited by 3,262 · see citing works
Spielberger, C. D. (2010) · The Corsini Encyclopedia of Psychology · doi:10.1002/9780470479216.corpsy0943 · Cited by 2,535 · see citing works
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · see citing works
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · see citing works
Self-citationCognitive and emotional control of pain and its disruption in chronic pain
Bushnell, M. C., Čeko, M., & Low, L. A. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3516 · Cited by 2,076 · see citing works
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964 · see citing works
The neural basis of loss aversion in decision-making under risk
Tom, S. M., Fox, C. R., Trepel, C., & Poldrack, R. A. (2007) · Science · doi:10.1126/science.1134239 · Cited by 1,733 · see citing works
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · see citing works
Self-citationNeuron-type-specific signals for reward and punishment in the ventral tegmental area
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., & Uchida, N. (2012) · Nature · doi:10.1038/nature10754 · Cited by 1,318 · see citing works
Striatal Plasticity and Basal Ganglia Circuit Function
Kreitzer, A. C., & Malenka, R. C. (2008) · Neuron · doi:10.1016/j.neuron.2008.11.005 · Cited by 1,009 · see citing works
Abramowitz, J. S., Taylor, S., & McKay, D. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60240-3 · Cited by 1,002 · see citing works
When fear is near: threat imminence elicits prefrontal periaqueductal gray shifts in humans.
Mobbs, D., Petrovic, P., Marchant, J. L., Hassabis, D., Weiskopf, N., Seymour, B., Dolan, R. J., & Frith, C. D. (2007) · Science · doi:10.1126/science.1144298 · Cited by 951 · see citing works
Self-citationHare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792 · see citing works
Pain and the brain: specificity and plasticity of the brain in clinical chronic pain
Apkarian, V. A., Hashmi, J. A., & Baliki, M. N. (2011) · Pain · doi:10.1016/j.pain.2010.11.010 · Cited by 782 · see citing works
Reduced hedonic capacity in major depressive disorder: evidence from a probabilistic reward task
Pizzagalli, D. A., Iosifescu, D., Hallett, L. A., Ratner, K. G., & Fava, M. (2008) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2008.03.001 · Cited by 780 · see citing works
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692 · see citing works
Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning
Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., & Hutchison, K. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706111104 · Cited by 669 · see citing works
Kim, J. J., Rison, R. A., & Fanselow, M. S. (1993) · Behavioral Neuroscience · doi:10.1037/0735-7044.107.6.1093 · Cited by 615 · see citing works
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · see citing works
Self-citationThe involvement of nucleus accumbens dopamine in appetitive and aversive motivation
Salamone, J. D. (1994) · Behavioural Brain Research · doi:10.1016/0166-4328(94)90153-8 · Cited by 584 · see citing works
Yacubian, J., Gläscher, J., Schroeder, K., Sommer, T., Braus, D. F., & Büchel, C. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2915-06.2006 · Cited by 537 · see citing works
Mesolimbic dopaminergic pathways in fear conditioning
Pezze, M. A., & Feldon, J. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.09.004 · Cited by 510 · see citing works
Weiskopf, N., Hutton, C., Josephs, O., & Deichmann, R. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.07.029 · Cited by 488 · see citing works
Reward and motivation in pain and pain relief
Navratilova, E., & Porreca, F. (2014) · Nature Neuroscience · doi:10.1038/nn.3811 · Cited by 481 · see citing works
Development and validation of a scale for hypomanic personality.
Eckblad, M., & Chapman, L. J. (1986) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.95.3.214 · Cited by 479 · see citing works
Huys, Q. J. M., Eshel, N., O'Nions, E., Sheridan, L., Dayan, P., & Roiser, J. P. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002410 · Cited by 439 · see citing works
Self-citationOpponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439 · see citing works
Self-citationFrom Fear to Safety and Back: Reversal of Fear in the Human Brain
Schiller, D., Levy, I., Niv, Y., LeDoux, J. E., & Phelps, E. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2265-08.2008 · Cited by 429 · see citing works
Neuroimaging of the periaqueductal gray: State of the field
Linnman, C., Moulton, E. A., Barmettler, G., Becerra, L. R., & Borsook, D. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.11.095 · Cited by 402 · see citing works
Schönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390 · see citing works
Differential roles of human striatum and amygdala in associative learning
Li, J., Schiller, D., Schoenbaum, G. M., Phelps, E. A., & Daw, N. D. (2011) · Nature Neuroscience · doi:10.1038/nn.2904 · Cited by 364 · see citing works
Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain
Niv, Y., Edlund, J. A., Dayan, P., & O'Doherty, J. P. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5498-10.2012 · Cited by 356 · see citing works
Self-citationHelms, G., Dathe, H., Kallenberg, K., & Dechent, P. (2008) · Magnetic Resonance in Medicine · doi:10.1002/mrm.21732 · Cited by 333 · see citing works
The role of the striatum in aversive learning and aversive prediction errors
Delgado, M. R., Li, J., Schiller, D., & Phelps, E. A. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0161 · Cited by 328 · see citing works
Harm to others outweighs harm to self in moral decision making
Crockett, M. J., Kurth-Nelson, Z. L., Siegel, J. Z., Dayan, P., & Dolan, R. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1408988111 · Cited by 322 · see citing works
Self-citationNeural substrates for expectation-modulated fear learning in the amygdala and periaqueductal gray
Johansen, J. P., Tarpley, J. W., LeDoux, J. E., & Blair, H. T. (2010) · Nature Neuroscience · doi:10.1038/nn.2594 · Cited by 312 · see citing works
Schmidt‐Wilcke, T., Luerding, R., Weigand, T., Jürgens, T. P., Schuierer, G. R., Leinisch, E., & Bogdahn, U. (2007) · Pain · doi:10.1016/j.pain.2007.05.010 · Cited by 301 · see citing works
Dopamine, Time, and Impulsivity in Humans
Pine, A., Shiner, T., Seymour, B., & Dolan, R. J. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.6028-09.2010 · Cited by 300 · see citing works
Self-citationMechanisms underlying dopamine-mediated reward bias in compulsive behaviors
Voon, V., Pessiglione, M., Brezing, C., Gallea, C., Fernandez, H. H., Dolan, R. J., & Hallett, M. (2010) · Neuron · doi:10.1016/j.neuron.2009.12.027 · Cited by 280 · see citing works
Self-citationStriatal activity underlies novelty-based choice in humans
Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277 · see citing works
Self-citationActive Avoidance Learning Requires Prefrontal Suppression of Amygdala-Mediated Defensive Reactions
Moscarello, J. M., & LeDoux, J. E. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2596-12.2013 · Cited by 277 · see citing works
Quantitative FLASH MRI at 3T using a rational approximation of the Ernst equation
Helms, G., Dathe, H., & Dechent, P. (2008) · Magnetic Resonance in Medicine · doi:10.1002/mrm.21542 · Cited by 256 · see citing works
Serotonin Selectively Modulates Reward Value in Human Decision-Making
Seymour, B., Daw, N. D., Roiser, J. P., Dayan, P., & Dolan, R. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.0053-12.2012 · Cited by 252 · see citing works
Self-citationRepresentation of aversive prediction errors in the human periaqueductal gray
Roy, M., Shohamy, D., Daw, N., Jepma, M., Wimmer, G. E., & Wager, T. D. (2014) · Nature Neuroscience · doi:10.1038/nn.3832 · Cited by 246 · see citing works
Rotge, J.-Y., Langbour, N., Guehl, D., Bioulac, B., Jaafari, N., Allard, M., Aouizerate, B., & Burbaud, P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.175 · Cited by 228 · see citing works
Distinct neural signatures for safety and danger in the amygdala and striatum of the mouse.
Rogan, M. T., Leon, K. S., Pérez, D. L., & Kandel, E. (2005) · Neuron · doi:10.1016/j.neuron.2005.02.017 · Cited by 227 · see citing works
Badrinarayan, A., Wescott, S. A., Vander Weele, C. M., Saunders, B. T., Couturier, B. E., Maren, S., & Aragona, B. J. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3557-12.2012 · Cited by 225 · see citing works
Fear as an intervening variable in avoidance conditioning.
Mowrer, O. H., & Lamoreaux, R. R. (1946) · Journal of comparative psychology · doi:10.1037/h0060150 · Cited by 217 · see citing works
Modelling event-related skin conductance responses
Bach, D. R., Flandin, G., Friston, K. J., & Dolan, R. J. (2010) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2010.01.005 · Cited by 215 · see citing works
Self-citationAction bias among elite soccer goalkeepers: The case of penalty kicks
Bar‐Eli, M., Azar, O. H., Ritov, I., Keidar-Levin, Y., & Schein, G. (2007) · Journal of Economic Psychology · doi:10.1016/j.joep.2006.12.001 · Cited by 212 · see citing works
The impact of physiological noise correction on fMRI at 7 T
Hutton, C., Josephs, O., Stadler, J., Featherstone, E., Reid, A., Speck, O., Bernarding, J., & Weiskopf, N. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.04.018 · Cited by 211 · see citing works
Hauser, T. U., Iannaccone, R., Walitza, S., Brandeis, D., & Brem, S. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.09.018 · Cited by 203 · see citing works
Self-citationActive Avoidance Requires a Serial Basal Amygdala to Nucleus Accumbens Shell Circuit
Ramirez, F., Moscarello, J. M., LeDoux, J. E., & Sears, R. M. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.1331-14.2015 · Cited by 198 · see citing works
The role of amygdala nuclei in the expression of auditory signaled two-way active avoidance in rats.
Choi, J.-S., Cain, C. K., & LeDoux, J. E. (2010) · Learning & Memory · doi:10.1101/lm.1676610 · Cited by 187 · see citing works
Interaction between emotional state and learning underlies mood instability
Eldar, E., & Niv, Y. (2015) · Nature Communications · doi:10.1038/ncomms7149 · Cited by 185 · see citing works
Self-citationHelms, G., Draganski, B., Frackowiak, R. S. J., Ashburner, J., & Weiskopf, N. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.053 · Cited by 181 · see citing works
van den Bos, W., Rodriguez, C. A., Schweitzer, J. B., & McClure, S. M. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4105-13.2014 · Cited by 178 · see citing works
The BPQ: A Scale for the Assessment of Borderline Personality Based on DSM-IV Criteria
Poreh, A., Rawlings, D., CLARIDGE, G. S., Freeman, J. L., Faulkner, C., & Shelton, C. (2006) · Journal of Personality Disorders · doi:10.1521/pedi.2006.20.3.247 · Cited by 158 · see citing works
Predicting danger: The nature, consequences, and neural mechanisms of predictive fear learningPreprint
McNally, G. P., & Westbrook, R. F. (2006) · Learning & Memory · doi:10.1101/lm.196606 · Cited by 117 · see citing works
The Price of Pain and the Value of Suffering
Vlaev, I., Seymour, B., Dolan, R. J., & Chater, N. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02304.x · Cited by 96 · see citing works
Self-citationLeong, J. K., Pestilli, F., Wu, C. C., Samanez-Larkin, G. R., & Knutson, B. D. (2016) · Neuron · doi:10.1016/j.neuron.2015.12.015 · Cited by 94 · see citing works
Boll, S., Gamer, M., Gluth, S., Finsterbusch, J., & Büchel, C. (2012) · European Journal of Neuroscience · doi:10.1111/ejn.12094 · Cited by 89 · see citing works
Martinez, R., Gupta, N. S., Lázaro-Muñoz, G., Sears, R. M., Kim, S., Moscarello, J. M., LeDoux, J. E., & Cain, C. K. (2013) · Learning & memory (Cold Spring Harbor, N.Y.) · doi:10.1101/lm.031047.113 · Cited by 80 · see citing works
Taking Action in the Face of Threat: Neural Synchronization Predicts Adaptive Coping
Collins, K. A., Mendelsohn, A., Cain, C. K., & Schiller, D. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2152-14.2014 · Cited by 61 · see citing works
Assessment of Trait and State Aspects of Depression in Schizophrenia
Chiappelli, J., Nugent, K. L., Thangavelu, K., Searcy, K., & Hong, L. E. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt069 · Cited by 59 · see citing works
Complementary roles for amygdala and periaqueductal gray in temporal-difference fear learningPreprint
Cole, S., & McNally, G. P. (2008) · Learning & Memory · doi:10.1101/lm.1120509 · Cited by 42 · see citing works
Bolstad, I., Andreassen, O. A., Reckless, G. E., Sigvartsen, N. P., Server, A., & Jensen, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068494 · Cited by 22 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Sui, J., Jiang, R., Bustillo, J., & Calhoun, V. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.02.016 · Cited by 309 · see citing works
Linking interindividual variability in brain structure to behaviour
Genon, S., Eickhoff, S. B., & Masouleh, S. K. (2022) · Nature reviews. Neuroscience · doi:10.1038/s41583-022-00584-7 · Cited by 193 · see citing works
Pain: A Precision Signal for Reinforcement Learning and Control
Seymour, B. (2019) · Neuron · doi:10.1016/j.neuron.2019.01.055 · Cited by 164 · see citing works
Modeling Avoidance in Mood and Anxiety Disorders Using Reinforcement Learning
Mkrtchian, A., Aylward, J., Dayan, P., Roiser, J. P., & Robinson, O. J. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.01.017 · Cited by 151 · see citing works
Self-citationSeparate mesocortical and mesolimbic pathways encode effort and reward learning signals
Hauser, T. U., Eldar, E., & Dolan, R. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1705643114 · Cited by 135 · see citing works
Self-citationActive avoidance: Neural mechanisms and attenuation of pavlovian conditioned responding
Boeke, E. A., Moscarello, J. M., LeDoux, J. E., Phelps, E. A., & Hartley, C. A. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.3261-16.2017 · Cited by 131 · see citing works
“However, three decision-making studies (Seymour et al., 2012; Roy et al., 2014; Eldar et al., 2016) that involved avoiding pain or shock examined prediction errors to successful and unsuccessful avoidance, and two found evidence for striatal prediction errors to successful avoidance of shock.”
BackgroundComputational modelling of social cognition and behaviour—a reinforcement learning primer
Lockwood, P. L., & Klein-Flügge, M. C. (2020) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsaa040 · Cited by 125 · see citing works
Vervliet, B., Lange, I., & Milad, M. R. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2017.04.011 · Cited by 118 · see citing works
Impaired adaptation of learning to contingency volatility in internalizing psychopathology
Gagne, C. R., Zika, O., Dayan, P., & Bishop, S. (2020) · eLife · doi:10.7554/elife.61387 · Cited by 94 · see citing works
Self-citationApproach-Avoidance Decisions Under Threat: The Role of Autonomic Psychophysiological States
Livermore, J. J. A., Klaassen, F. H., Bramson, B., Hulsman, A. M., Meijer, S. W., Held, L. K., Klumpers, F., de Voogd, L. D., & Roelofs, K. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.621517 · Cited by 101 · see citing works
Decodability of Reward Learning Signals Predicts Mood Fluctuations
Eldar, E., Roth, C., Dayan, P., & Dolan, R. J. (2018) · Current Biology · doi:10.1016/j.cub.2018.03.038 · Cited by 84 · see citing works
Self-citationThe roles of online and offline replay in planning
Eldar, E., Lièvre, G., Dayan, P., & Dolan, R. J. (2020) · eLife · doi:10.7554/elife.56911 · Cited by 74 · see citing works
Self-citationCan robots replace human beings? —Assessment on the developmental potential of construction robot
Ma, X., Mao, C., & Liu, G. (2022) · Journal of Building Engineering · doi:10.1016/j.jobe.2022.104727 · Cited by 77 · see citing works
Modular deep reinforcement learning from reward and punishment for robot navigation
Wang, J., Elfwing, S., & Uchibe, E. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.12.001 · Cited by 62 · see citing works
Model-free decision making is prioritized when learning to avoid harming others
Lockwood, P. L., Klein-Flügge, M. C., Abdurahman, A., & Crockett, M. J. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2010890117 · Cited by 63 · see citing works
Value generalization in human avoidance learning
Norbury, A., Robbins, T. W., & Seymour, B. (2018) · eLife · doi:10.7554/elife.34779 · Cited by 54 · see citing works
Annual Research Review: Developmental computational psychiatry
Hauser, T. U., Will, G., Dubois, M., & Dolan, R. J. (2018) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12964 · Cited by 49 · see citing works
Self-citationDistinct Processing of Aversive Experience in Amygdala Subregions
Michely, J., Rigoli, F., Rutledge, R. B., Hauser, T. U., & Dolan, R. J. (2019) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2019.07.008 · Cited by 46 · see citing works
Self-citationWill, G., Moutoussis, M., Womack, P. M., Bullmore, E. T., Goodyer, I. M., Fonagy, P., Jones, P. B., Rutledge, R. B., & Dolan, R. J. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-0702-4 · Cited by 50 · see citing works
Self-citationRichey, J. A., Ghane, M., Valdespino, A., Coffman, M. C., Strege, M. V., White, S. W., & Ollendick, T. H. (2016) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsw149 · Cited by 46 · see citing works
Model-based aversive learning in humans is supported by preferential task state reactivation
Wise, T., Liu, Y., Chowdhury, F., & Dolan, R. J. (2021) · Science Advances · doi:10.1126/sciadv.abf9616 · Cited by 42 · see citing works
Self-citationSerotonin modulates asymmetric learning from reward and punishment in healthy human volunteers
Michely, J., Eldar, E., Erdman, A., Martin, I. M., & Dolan, R. J. (2022) · Communications Biology · doi:10.1038/s42003-022-03690-5 · Cited by 43 · see citing works
Self-citationQu, C., Météreau, É., Butera, L., Villeval, M. C., & Dreher, J. (2019) · PLoS Biology · doi:10.1371/journal.pbio.3000283 · Cited by 40 · see citing works
Avoidance of learnt fear: Models, potential mechanisms, and future directions.
Wong, A. H. K., Wirth, F., & Pittig, A. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2022.104056 · Cited by 37 · see citing works
Grahek, I., Frömer, R., Fahey, M. P., & Shenhav, A. (2022) · Cerebral Cortex · doi:10.1093/cercor/bhac215 · Cited by 40 · see citing works
Computational perspectives on human fear and anxiety
Yamamori, Y., & Robinson, O. J. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104959 · Cited by 41 · see citing works
How Instructions, Learning, and Expectations Shape Pain and Neurobiological Responses
Atlas, L. Y. (2023) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-101822-122427 · Cited by 34 · see citing works
Pain Neuroimaging in Humans: A Primer for Beginners and Non-Imagers
Moayedi, M., Salomons, T. V., & Atlas, L. Y. (2018) · Journal of Pain · doi:10.1016/j.jpain.2018.03.011 · Cited by 36 · see citing works
Elfwing, S., & Seymour, B. (2017) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2017.8329799 · Cited by 37 · see citing works
Magnetoencephalography decoding reveals structural differences within integrative decision processes
Eldar, E., Bae, G. J., Kurth-Nelson, Z. L., Dayan, P., & Dolan, R. J. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0423-3 · Cited by 30 · see citing works
Self-citationJepma, M., Roy, M., Ramlakhan, K., van Velzen, M., & Dahan, A. (2022) · eLife · doi:10.7554/elife.74149 · Cited by 27 · see citing works
Lengersdorff, L., Wagner, I. C., Lockwood, P. L., & Lamm, C. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.0842-20.2020 · Cited by 26 · see citing works
Oxytocin modulates neurocomputational mechanisms underlying prosocial reinforcement learning
Martins, D., Lockwood, P. L., Cutler, J., Moran, R., & Paloyelis, Y. (2022) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2022.102253 · Cited by 28 · see citing works
Neural Mechanisms of Harm-Avoidance Learning
Hauser, T. U., Eldar, E., & Dolan, R. J. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.1938 · Cited by 27 · see citing works
Self-citationHabermann, M., Strube, A., & Büchel, C. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.09.014 · Cited by 20 · see citing works
Decision-making in brains and robots — the case for an interdisciplinary approach
Lee, S. W., & Seymour, B. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.12.012 · Cited by 19 · see citing works
Driven by Pain, Not Gain: Computational Approaches to Aversion-Related Decision Making in Psychiatry
Paulus, M. P. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.08.025 · Cited by 17 · see citing works
Avoidance Behavioral Difference in Acquisition and Extinction of Pain-Related Fear
Nishi, Y., Osumi, M., Nobusako, S., Takeda, K., & Morioka, S. (2019) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2019.00236 · Cited by 15 · see citing works
How Accurate Appraisal of Behavioral Costs and Benefits Guides Adaptive Pain Coping
Gandhi, W., Morrison, I., & Schweinhardt, P. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00103 · Cited by 14 · see citing works
Perini, I., Čeko, M., Cerliani, L., van Ettinger-Veenstra, H., Minde, J., & Morrison, I. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa078 · Cited by 13 · see citing works
Di Paolo, L. D., White, B., Guénin-Carlut, A., Constant, A., & Clark, A. (2024) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2023.0148 · Cited by 14 · see citing works
“The sense of rising frustration we feel while sitting in an unexpected traffic jam reflects us minimizing error (relative to the action-guiding prediction of arriving soon at our destination) more slowly than expected (e.g. [45]; see also [46–48]).”
BackgroundDeep Reinforcement Learning by Parallelizing Reward and Punishment using the MaxPain Architecture
Wang, J., Elfwing, S., & Uchibe, E. (2018) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2018.8761044 · Cited by 12 · see citing works
Learning whom to cooperate with: neurocomputational mechanisms for choosing cooperative partners
Jin, T., Zhang, S., Lockwood, P. L., Vilares, I., Wu, H., Liu, C., & Ma, Y. (2022) · Cerebral Cortex · doi:10.1093/cercor/bhac365 · Cited by 10 · see citing works
Shimizu, N., Mochizuki, Y., Chen, C., Hagiwara, K., Matsumoto, K., Oda, Y., Hirotsu, M., Okabe, E., Matsubara, T., & Nakagawa, S. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.930466 · Cited by 10 · see citing works
Self-esteem depends on beliefs about the rate of change of social approval
Low, A. A. Y., Hopper, W. J. T., Angelescu, I., Mason, L., Will, G., & Moutoussis, M. (2022) · Scientific Reports · doi:10.1038/s41598-022-10260-6 · Cited by 9 · see citing works
Watarai, M., Hagiwara, K., Mochizuki, Y., Chen, C., Mizumoto, T., Kawashima, C., Koga, T., Okabe, E., & Nakagawa, S. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01117-0 · Cited by 9 · see citing works
SSRIs modulate asymmetric learning from reward and punishmentPreprint
Michely, J., Eldar, E., Erdman, A., Martin, I. M., & Dolan, R. J. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.05.21.108266 · Cited by 9 · see citing works
Self-citationTraining diversity promotes absolute-value-guided choice
Solomyak, L., Sharp, P. B., & Eldar, E. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010664 · Cited by 9 · see citing works
Self-citationZhong, S., Lin, J., Zhang, L., Wang, S., Kemp, G. J., Li, L., & Gong, Q. (2024) · Translational Psychiatry · doi:10.1038/s41398-024-03091-8 · Cited by 7 · see citing works
Neural signatures of model-free learning when avoiding harm to self and otherPreprint
Lockwood, P. L., Klein-Flügge, M. C., Abdurahman, A., & Crockett, M. J. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/718106 · Cited by 7 · see citing works
The roles of online and offline replay in planningPreprint
Eldar, E., Lièvre, G., Dayan, P., & Dolan, R. J. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.03.26.009571 · Cited by 7 · see citing works
Self-citationFear in action: Fear conditioning and alleviation through body movements
Alemany-González, M., Wokke, M. E., Chiba, T., Narumi, T., Kaneko, N., Yokoyama, H., Watanabe, K., Nakazawa, K., Imamizu, H., & Koizumi, A. (2024) · iScience · doi:10.1016/j.isci.2024.109099 · Cited by 4 · see citing works
Experience-based risk taking is primarily shaped by prior learning rather than by decision-making
Erdman, A., Gouwy, A., Sananes, G., Salman, M., Eizenstien, L., Eliav, S., & Eldar, E. (2025) · Nature Communications · doi:10.1038/s41467-025-61609-0 · Cited by 5 · see citing works
Self-citationChen, C., Mochizuki, Y., Hagiwara, K., Hirotsu, M., Matsubara, T., & Nakagawa, S. (2022) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2022.08.003 · Cited by 5 · see citing works
Mochizuki, Y., Harasawa, N., Aggarwal, M., Chen, C., & Fukuda, H. (2024) · PLoS Comput. Biol. · doi:10.1371/journal.pcbi.1012080 · Cited by 4 · see citing works
Getting Below the Surface of Behavioral Symptoms in Psychiatry
Bullmore, E. T. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.12.007 · Cited by 4 · see citing works
Developmental Computational PsychiatryPreprint
Hauser, T. U., Will, G., Dubois, M., & Dolan, R. J. (2018) · doi:10.31234/osf.io/85prq · Cited by 4 · see citing works
Self-citationModel-based aversive learning in humans is supported by preferential task state reactivationPreprint
Wise, T., Liu, Y., Chowdhury, F., & Dolan, R. J. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.11.30.404491 · Cited by 3 · see citing works
Self-citationPain and self-preservation in autonomous robots: From neurobiological models to psychiatric disease
Piccolo, L., Libera, F. D., Bonarini, A., Seymour, B., & Ishiguro, H. (2017) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2017.8329816 · Cited by 2 · see citing works
Sensory-Motor Interactions and the Manipulation of Movement Error
Parmar, P. N., Huang, F. C., & Patton, J. L. (2022) · Springer eBooks · doi:10.1007/978-3-031-08995-4_11 · Cited by 2 · see citing works
Reward-Punishment Reinforcement Learning with Maximum Entropy
Wang, J., & Uchibe, E. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650872 · Cited by 2 · see citing works
Langley, C., Murray, G. K., Armand, S., Knolle, F., Cardinal, R. N., Johansen, A., Jensen, P. S., Feng, J., Stenbæk, D. S., Knudsen, G. M., et al. (2025) · Translational Psychiatry · doi:10.1038/s41398-025-03392-6 · Cited by 4 · see citing works
Habenula–ventral tegmental area functional coupling and risk aversion in humans
Lin, W., Xu, J., Zhang, X., & Dolan, R. J. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2500815122 · Cited by 2 · see citing works
Self-citationValue generalization in human avoidance learningPreprint
Norbury, A., Robbins, T. W., & Seymour, B. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/223149 · Cited by 2 · see citing works
On the duality of pain and pleasure processing: Why two dimensions of valence may be better than onePreprint
Dulberg, Z., & Cohen, J. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.01.22.634365 · Cited by 2 · see citing works
Hegefeld, H., & Davidow, J. Y. (2025) · eLife · doi:10.7554/elife.108428.1 · Cited by 1 · see citing works
How instructions, learning, and expectations shape pain and clinical outcomesPreprint
Atlas, L. Y. (2022) · doi:10.31234/osf.io/qhkat
The resource elasticity of controlPreprint
Solomyak, L., Emanuel, A., & Eldar, E. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.12.16.628674
Self-citationThe resource elasticity of controlPreprint
Solomyak, L., Emanuel, A., & Eldar, E. (2025) · eLife · doi:10.7554/elife.105507.1
Self-citationThe resource elasticity of controlPreprint
Solomyak, L., Emanuel, A., & Eldar, E. (2025) · eLife · doi:10.7554/elife.105507
Self-citationThe resource elasticity of controlPreprint
Solomyak, L., Emanuel, A., & Eldar, E. (2025) · eLife · doi:10.7554/elife.105507.2
Self-citationHegefeld, H., & Davidow, J. Y. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.07.11.664442
Lee, J., & Woo, C. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009342919.016
Emotion Perception and Elicitation
Armony, J., & Vuilleumier, P. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009342919.012
The resource elasticity of controlPreprint
Solomyak, L., Emanuel, A., & Eldar, E. (2025) · eLife · doi:10.7554/elife.105507.3
Self-citationHegefeld, H., & Davidow, J. Y. (2025) · eLife · doi:10.7554/elife.108428
Bayesian attenuation of offset analgesia filters out random disturbances in noxious stimuli
Ishikawa, R., Osumi, M., & Izawa, J. (2025) · PAIN Reports · doi:10.1097/pr9.0000000000001359
Mochizuki, Y., Aggarwal, M., Harasawa, N., & Chen, C. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-26629-4.00124-6
- Authors
- Eldar, E., Hauser, T. U., Dayan, P., & Dolan, R. J.
- Affiliations
- Wellcome Centre for Human Neuroimaging (GB)
- Gatsby Computational Neuroscience Unit (GB)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2016-04-11
- Volume
- 113
- Issue
- 17
- Pages
- 4812-4817
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC4855606
- OpenAlex
- W2338986187
- Cited by
- 79
- References
- 76
- Citations by year
- 2025: 15 · 2024: 7 · 2023: 2 · 2022: 15 · 2021: 2 · 2020: 13 · 2019: 7 · 2018: 7 · 2017: 8 · 2016: 2
- FWCI
- 5.09
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Wellcome Trust (095844/Z/11/Z)
- Gatsby Charitable Foundation (N/A)
- Swiss National Foundation (151641)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- individual differences, striatum, prediction error learning, harm avoidance, individual traits
- MeSH terms
- Adolescent, Adult, Avoidance Learning, Brain Mapping, Choice Behavior, Corpus Striatum, Decision Making, Electroshock, Female, Gambling, Games, Experimental, Humans, Individuality, Learning, Magnetic Resonance Imaging, Male, Oxygen, Pain, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
