Agency and the Calibration of Motivated Behavior
Abstract
The controllability of positive or negative environmental events has long been recognized as a critical factor determining their impact on an organism. In studies across species, controllable and uncontrollable reinforcement have been found to yield divergent effects on subsequent behavior. Here we present a model of the organizing influence of control, or a lack thereof, on the behavioral repertoire. We propose that individuals derive a generalizable estimate of agency from controllable and uncontrollable outcomes, which serves to calibrate their behavioral strategies in a manner that is most likely to be adaptive given their prior experience.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Attributions of causality are a precondition for maintaining a sense of agency.
“and maintaining a sense of agency.5”
From Two prefrontal-subcortical circuits estimate controllability and reflect its impact on learning (2026) · cites this paper as [5]
Cites
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
Generalized expectancies for internal versus external control of reinforcement.
Rotter, J. B. (1966) · Psychological Monographs: General and Applied · doi:10.1037/h0092976 · Cited by 21,937 · see citing works
LeDoux, J. E. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.155 · Cited by 8,444 · see citing works
Effects of stress throughout the lifespan on the brain, behaviour and cognition
Lupien, S. J., McEwen, B. S., Gunnar, M. R., & Heim, C. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2639 · Cited by 6,256 · see citing works
Learned helplessness: Theory and evidence
Maier, S. F., & Seligman, M. E. (1976) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.105.1.3 · Cited by 2,494 · see citing works
Failure to escape traumatic shock.
Seligman, M. E., & Maier, S. F. (1967) · Journal of Experimental Psychology · doi:10.1037/h0024514 · Cited by 1,981 · cited 1× · see citing works
“Corroborating early demonstrations of learned helplessness [1,3], exposure to uncontrollable electric shock in rodents increases defensive reactions (e.”
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775 · see citing works
Locus of control: Current trends in theory and research
Lefcourt, H. M. (1976) · Medical Entomology and Zoology · Cited by 1,763 · see citing works
Species-specific defense reactions and avoidance learning
Bolles, R. C. (1970) · Psychological Review · doi:10.1037/h0028589 · Cited by 1,610 · see citing works
LeDoux, J., Iwata, J., Cicchetti, P., & Reis, D. (1988) · The Journal of Neuroscience · doi:10.1523/jneurosci.08-07-02517.1988 · Cited by 1,580 · see citing works
The contextual brain: implications for fear conditioning, extinction and psychopathology
Maren, S., Phan, K. L., & Liberzon, I. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3492 · Cited by 1,547 · see citing works
Neuronal signalling of fear memory
Maren, S., & Quirk, G. J. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1535 · Cited by 1,428 · see citing works
Socioeconomic status and the brain: mechanistic insights from human and animal research
Hackman, D. A., Farah, M. J., & Meaney, M. J. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2897 · Cited by 1,409 · see citing works
LaBar, K. S., Gatenby, J. C., Gore, J. C., LeDoux, J. E., & Phelps, E. A. (1998) · Neuron · doi:10.1016/s0896-6273(00)80475-4 · Cited by 1,402 · see citing works
Bechara, A., Tranel, D., Damasio, H., Adolphs, R., Rockland, C., & Damasio, A. R. (1995) · Science · doi:10.1126/science.7652558 · Cited by 1,400 · see citing works
Breland, K., & Breland, M. (1961) · American Psychologist · doi:10.1037/h0040090 · Cited by 1,192 · see citing works
A Role for Brain Stress Systems in Addiction
Koob, G. F. (2008) · Neuron · doi:10.1016/j.neuron.2008.06.012 · Cited by 1,056 · see citing works
Socioeconomic gradients predict individual differences in neurocognitive abilities.
Noble, K. G., McCandliss, B. D., & Farah, M. J. (2007) · Developmental Science · doi:10.1111/j.1467-7687.2007.00600.x · Cited by 1,041 · see citing works
Molecular mechanisms of fear learning and memory
Johansen, J. P., Cain, C. K., Ostroff, L. E., & LeDoux, J. E. (2011) · Cell · doi:10.1016/j.cell.2011.10.009 · Cited by 1,012 · see citing works
When fear is near: threat imminence elicits prefrontal periaqueductal gray shifts in humans.
Mobbs, D., Petrovic, P., Marchant, J. L., Hassabis, D., Weiskopf, N., Seymour, B., Dolan, R. J., & Frith, C. D. (2007) · Science · doi:10.1126/science.1144298 · Cited by 951 · see citing works
Amat, J., Baratta, M. V., Paul, E., Bland, S. T., Watkins, L. R., & Maier, S. F. (2005) · Nature Neuroscience · doi:10.1038/nn1399 · Cited by 931 · see citing works
Learned helplessness at fifty: Insights from neuroscience.
Maier, S. F., & Seligman, M. E. P. (2016) · Psychological Review · doi:10.1037/rev0000033 · Cited by 919 · cited 1× · see citing works
“The tendency to assume danger in ambiguous situations is thus an adaptive default setting for defense circuits in the mammalian brain [2,5,6].”
Midbrain circuits for defensive behaviour
Tovote, P., Esposito, M. S., Botta, P., Chaudun, F., Fadok, J. P., Marković, M., Wolff, S. B. E., Ramakrishnan, C., Fenno, L. E., Deisseroth, K. A., et al. (2016) · Nature · doi:10.1038/nature17996 · Cited by 739 · see citing works
Maier, S. F., & Watkins, L. R. (2005) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.03.021 · Cited by 737 · see citing works
The Role of Chaos in Poverty and Children's Socioemotional Adjustment
Evans, G. W., Gonnella, C., Marcynyszyn, L. A., Gentile, L., & Salpekar, N. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.01575.x · Cited by 709 · cited 1× · see citing works
“What roles do these systems play in the inference and behavioral consequences of control? low degree of environmental control, a key mediator of these behavioral outcomes is a high reported level of chaos in the home [59].”
Impaired fear conditioning following unilateral temporal lobectomy in humans
LaBar, K., LeDoux, J., Spencer, D., & Phelps, E. (1995) · The Journal of Neuroscience · doi:10.1523/jneurosci.15-10-06846.1995 · Cited by 631 · see citing works
Rapid innate defensive responses of mice to looming visual stimuli
Yilmaz, M., & Meister, M. (2013) · Current Biology · doi:10.1016/j.cub.2013.08.015 · Cited by 611 · see citing works
Fanselow, M. S., & Lester, L. S. (1988) · Cited by 511 · see citing works
The Evolution of Cognitive Bias
Haselton, M. G., Nettle, D., & Andrews, P. W. (2015) · Wiley eBooks · doi:10.1002/9780470939376.ch25 · Cited by 483 · see citing works
(2003) · The MIT Press eBooks · doi:10.7551/mitpress/2871.001.0001 · Cited by 483 · see citing works
McKay, R. T., & Dennett, D. C. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09990975 · Cited by 474 · see citing works
Conditioned fear assessed by freezing and by the suppression of three different baselines
Bouton, M. E., & Bolles, R. C. (1980) · Animal Learning & Behavior · doi:10.3758/bf03199629 · Cited by 348 · see citing works
Blanchard, D. C., Hynd, A. L., Minke, K. A., Minemoto, T., & Blanchard, R. J. (2001) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(01)00056-2 · Cited by 346 · see citing works
Bouton, M. E., & Swartzentruber, D. (1986) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.12.4.333 · Cited by 335 · see citing works
Occasion Setting in Pavlovian Conditioning
Holland, P. (1992) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60488-0 · Cited by 312 · see citing works
Kavaliers, M., & Choleris, E. (2001) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(01)00042-2 · Cited by 294 · see citing works
Conditioned suppression as a monitor of fear of the CS in the course of avoidance training.
Kamin, L. J., Brimer, C. J., & Black, A. H. (1963) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0047966 · Cited by 290 · see citing works
Active Avoidance Learning Requires Prefrontal Suppression of Amygdala-Mediated Defensive Reactions
Moscarello, J. M., & LeDoux, J. E. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2596-12.2013 · Cited by 277 · see citing works
Self-citationLewis, M., & Goldberg, S. (1968) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1968.tb00568.x · Cited by 267 · see citing works
Long-Term Stress-Induced Analgesia and Activation of the Opiate System
Grau, J. W., Hyson, R. L., Maier, S. F., Madden, J. J., & Barchas, J. D. (1981) · Science · doi:10.1126/science.7268445 · Cited by 266 · see citing works
Dynamic neural activity during stress signals resilient coping
Sinha, R., Lacadie, C., Constable, R. T., & Seo, D. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1600965113 · Cited by 246 · see citing works
A call to action: overcoming anxiety through active coping.
LeDoux, J. E., & Gorman, J. M. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.12.1953 · Cited by 238 · see citing works
Neural structures mediating expression and extinction of platform-mediated avoidance
Bravo-Rivera, C., Roman-Ortiz, C., Brignoni-Perez, E., Sotres-Bayon, F., & Quirk, G. J. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0191-14.2014 · Cited by 206 · see citing works
Active Avoidance Requires a Serial Basal Amygdala to Nucleus Accumbens Shell Circuit
Ramirez, F., Moscarello, J. M., LeDoux, J. E., & Sears, R. M. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.1331-14.2015 · Cited by 198 · see citing works
Self-citationTarabulsy, G. M., Tessier, R., & Kappas, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.120.1.25 · Cited by 192 · see citing works
Deciding How To Decide: Self-Control and Meta-Decision Making
Boureau, Y.-L., Sokol‐Hessner, P., & Daw, N. D. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.08.013 · Cited by 191 · see citing works
The role of amygdala nuclei in the expression of auditory signaled two-way active avoidance in rats.
Choi, J.-S., Cain, C. K., & LeDoux, J. E. (2010) · Learning & Memory · doi:10.1101/lm.1676610 · Cited by 187 · see citing works
The Evolution of Cognitive Bias
Haselton, M. G., Nettle, D., & Murray, D. R. (2015) · doi:10.1002/9781119125563.evpsych241 · Cited by 169 · see citing works
Shanahan, L., Copeland, W., Costello, E. J., & Angold, A. C. (2007) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01822.x · Cited by 165 · see citing works
Baratta, M. V., Christianson, J. P., Gomez, D. M., Zarza, C. M., Amat, J., Masini, C. V., Watkins, L. R., & Maier, S. F. (2007) · Neuroscience · doi:10.1016/j.neuroscience.2007.03.042 · Cited by 156 · see citing works
Neuroethological studies of fear, anxiety, and risky decision-making in rodents and humans
Mobbs, D., & Kim, J. J. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.06.005 · Cited by 152 · see citing works
Mineka, S., Gunnar, M. R., & Champoux, M. (1986) · Child Development · doi:10.2307/1130447 · Cited by 147 · see citing works
A Bayesian formulation of behavioral control
Huys, Q. J. M., & Dayan, P. (2009) · Cognition · doi:10.1016/j.cognition.2009.01.008 · Cited by 144 · see citing works
Maier, S. F. (2015) · Neurobiology of Stress · doi:10.1016/j.ynstr.2014.09.003 · Cited by 143 · see citing works
Lázaro‐Muñoz, G., LeDoux, J. E., & Cain, C. K. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.12.002 · Cited by 134 · see citing works
Active avoidance: Neural mechanisms and attenuation of pavlovian conditioned responding
Boeke, E. A., Moscarello, J. M., LeDoux, J. E., Phelps, E. A., & Hartley, C. A. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.3261-16.2017 · Cited by 131 · cited 2× · see citing works
“responses to stimuli signaling potential threat [28] and control attenuating conditioned responses to novel learned threats [29].”
Self-citationStressor controllability modulates fear extinction in humans
Hartley, C. A., Gorun, A., Reddan, M. C., Ramirez, F., & Phelps, E. A. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2013.12.003 · Cited by 110 · see citing works
Self-citationChristianson, J. P., Paul, E. D., Irani, M., Thompson, B. M., Kubala, K. H., Yirmiya, R., Watkins, L. R., & Maier, S. F. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.04.024 · Cited by 107 · see citing works
Learning to Control the Environment in Infancy
Finkelstein, N. W., & Ramey, C. T. (1977) · Child Development · doi:10.2307/1128329 · Cited by 97 · see citing works
Goodkin, F. (1976) · Learning and Motivation · doi:10.1016/0023-9690(76)90044-8 · Cited by 92 · see citing works
Cain, C. K., & LeDoux, J. E. (2007) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.33.4.451 · Cited by 72 · see citing works
Control of Their Environment Reduces Emotionality in Rats
Joffe, J. M., Rawson, R. A., & Mulick, J. A. (1973) · Science · doi:10.1126/science.180.4093.1383 · Cited by 66 · see citing works
Taking Action in the Face of Threat: Neural Synchronization Predicts Adaptive Coping
Collins, K. A., Mendelsohn, A., Cain, C. K., & Schiller, D. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2152-14.2014 · Cited by 61 · see citing works
Controllability Modulates the Anticipatory Response in the Human Ventromedial Prefrontal Cortex
Kerr, D. L., McLaren, D. G., Mathy, R. M., & Nitschke, J. B. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00557 · Cited by 61 · see citing works
Environmental Contingencies as Sources of Stress in Animals
Overmier, J. B., Patterson, J., & Wielkiewicz, R. M. (1980) · Springer eBooks · doi:10.1007/978-1-4684-1042-6_1 · Cited by 60 · see citing works
Safety out of control: dopamine and defence
Lloyd, K., & Dayan, P. (2016) · Behavioral and Brain Functions · doi:10.1186/s12993-016-0099-7 · Cited by 59 · see citing works
Short- and long-term consequences of stressor controllability in adolescent rats
Kubala, K. H., Christianson, J. P., Kaufman, R. D., Watkins, L. R., & Maier, S. F. (2012) · Behavioural Brain Research · doi:10.1016/j.bbr.2012.06.027 · Cited by 52 · see citing works
Control over a stressor involves the posterior dorsal striatum and the act/outcome circuit
Amat, J., Christianson, J. P., Aleksejev, R. M., Kim, J., Richeson, K. R., Watkins, L. R., & Maier, S. F. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12609 · Cited by 50 · see citing works
Nuclear disconnection within the amygdala reveals a direct pathway to fearPreprint
Jimenez, S. A., & Maren, S. (2009) · Learning & Memory · doi:10.1101/lm.1607109 · Cited by 48 · see citing works
Prefrontal endocannabinoids, stress controllability and resilience: A hypothesis
Worley, N. B., Hill, M. N., & Christianson, J. P. (2017) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2017.04.004 · Cited by 47 · see citing works
Lucas, M., Ilin, Y., Anunu, R., Kehat, O., Xu, L., Desmedt, A., & Richter‐Levin, G. (2014) · Stress · doi:10.3109/10253890.2014.930430 · Cited by 44 · see citing works
Dissociation between conditioned emotional response and extended avoidance performance
Mineka, S., & Gino, A. (1980) · Learning and Motivation · doi:10.1016/0023-9690(80)90029-6 · Cited by 42 · see citing works
Contingent Stimulation: A Review of its Role in Early Development
Gunnar, M. R. (1980) · Springer eBooks · doi:10.1007/978-1-4684-1042-6_6 · Cited by 36 · see citing works
A mechanism-oriented approach to psychopathology: The role of Pavlovian conditioning
Nees, F., Heinrich, A., & Flor, H. (2015) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2015.05.005 · Cited by 31 · see citing works
Learned helplessness and generalization
Lieder, F., Goodman, N. D., & Huys, Q. J. M. (2013) · eScholarship (California Digital Library) · doi:10.5167/uzh-91430 · Cited by 24 · see citing works
Corticolimbic catecholamines in stress: a computational model of the appraisal of controllability
Fiore, V. G., Mannella, F., Mirolli, M., Latagliata, E. C., Valzania, A., Cabib, S., Dolan, R. J., Puglisi‐Allegra, S., & Baldassarre, G. (2014) · Brain Structure and Function · doi:10.1007/s00429-014-0727-7 · Cited by 21 · see citing works
Diverse Effects of Conditioned Threat Stimuli on BehaviorPreprint
Moscarello, J. M., & LeDoux, J. E. (2014) · Cold Spring Harbor Symposia on Quantitative Biology · doi:10.1101/sqb.2014.79.024968 · Cited by 21 · see citing works
Self-citation
Flagged first, then by citations
1 of the 80 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Motivation and cognitive control in depression
Grahek, I., Shenhav, A., Musslick, S., Krebs, R. M., & Koster, E. H. W. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.04.011 · Cited by 360 · see citing works
Amaro, H. D. L. A., Sánchez, M., Bautista, T. G., & Cox, R. J. A. (2021) · Neuropharmacology · doi:10.1016/j.neuropharm.2021.108518 · Cited by 334 · see citing works
Rethinking avoidance: Toward a balanced approach to avoidance in treating anxiety disorders
Hofmann, S. G., & Hay, A. C. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.03.004 · Cited by 315 · see citing works
Expectations of reward and efficacy guide cognitive control allocation
Frömer, R., Lin, H., Wolf, C. K. D., Inzlicht, M., & Shenhav, A. (2021) · Nature Communications · doi:10.1038/s41467-021-21315-z · Cited by 243 · see citing works
Cohodes, E. M., Kitt, E. R., Baskin-sommers, A. R., & Gee, D. G. (2020) · Developmental Psychobiology · doi:10.1002/dev.21969 · Cited by 125 · see citing works
Controllability governs the balance between Pavlovian and instrumental action selection
Dorfman, H. M., & Gershman, S. (2019) · Nature Communications · doi:10.1038/s41467-019-13737-7 · Cited by 86 · see citing works
Early Social Adversity, Altered Brain Functional Connectivity, and Mental Health
Holz, N. E., Berhe, O., Sacu, S., Schwarz, E., Tesarz, J., Heim, C. C., & Tost, H. (2022) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.10.019 · Cited by 114 · see citing works
A Reward-Based Framework of Perceived Control
Ly, V., Wang, K. S., Bhanji, J. P., & Delgado, M. R. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00065 · Cited by 112 · see citing works
The study of active avoidance: a platform for discussion
Diehl, M. M., Bravo-Rivera, C., & Quirk, G. J. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.09.010 · Cited by 95 · see citing works
Decomposing the Motivation to Exert Mental Effort
Shenhav, A., Fahey, M. P., & Grahek, I. (2021) · Current Directions in Psychological Science · doi:10.1177/09637214211009510 · Cited by 101 · see citing works
Levy, I., & Schiller, D. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.11.007 · Cited by 95 · see citing works
Modeling the evolution of sensitive periods
Frankenhuis, W. E., & Walasek, N. (2019) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2019.100715 · Cited by 99 · see citing works
Early adversity and the development of explore–exploit tradeoffs
Frankenhuis, W. E., & Alison Gopnik, C. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.04.001 · Cited by 65 · see citing works
Stress-sensitive inference of task controllability
Ligneul, R., Mainen, Z. F., Ly, V., & Cools, R. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01306-w · Cited by 60 · see citing works
Roberts, C., Sahakian, B. J., & Robbins, T. W. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.09.001 · Cited by 61 · see citing works
A Decision Architecture for Safety Computations
Tashjian, S. M., Zbozinek, T. D., & Mobbs, D. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.01.013 · Cited by 60 · see citing works
Building Resilience: The Stress Response as a Driving Force for Neuroplasticity and Adaptation
Hermans, E. J., Hendler, T., & Kalisch, R. (2024) · Biological Psychiatry · doi:10.1016/j.biopsych.2024.10.016 · Cited by 60 · see citing works
Controllability over stressor decreases responses in key threat-related brain areas
Limbachia, C., Morrow, K., Khibovska, A., Meyer, C., Padmala, S., & Pessoa, L. (2021) · Communications Biology · doi:10.1038/s42003-020-01537-5 · Cited by 55 · see citing works
Adolescents exhibit reduced Pavlovian biases on instrumental learning
Raab, H. A., & Hartley, C. A. (2020) · Scientific Reports · doi:10.1038/s41598-020-72628-w · Cited by 48 · see citing works
Self-citationVentral hippocampus mediates the context-dependence of two-way signaled avoidance in male rats
Oleksiak, C. R., Ramanathan, K. R., Miles, O. W., Perry, S. J., Maren, S., & Moscarello, J. M. (2021) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2021.107458 · Cited by 42 · see citing works
Self-citationThe Interplay Between Affective Processing and Sense of Agency During Action Regulation: A Review
Kaiser, J., Buciuman, M.-O., Gigl, S., Gentsch, A., & Schütz‐Bosbach, S. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.716220 · Cited by 43 · see citing works
Grahek, I., Frömer, R., Fahey, M. P., & Shenhav, A. (2022) · Cerebral Cortex · doi:10.1093/cercor/bhac215 · Cited by 40 · see citing works
Prediction or Causation? Towards a Redefinition of Task Controllability
Ligneul, R. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.02.009 · Cited by 34 · see citing works
The rational use of causal inference to guide reinforcement learning strengthens with age
Cohen, A. O., Nussenbaum, K., Dorfman, H. M., Gershman, S. J., & Hartley, C. A. (2020) · npj Science of Learning · doi:10.1038/s41539-020-00075-3 · Cited by 33 · see citing works
Self-citationThe value of choice facilitates subsequent memory across development
Katzman, P. L., & Hartley, C. A. (2020) · Cognition · doi:10.1016/j.cognition.2020.104239 · Cited by 31 · see citing works
Self-citationGee, D. G., Sisk, L. M., Cohodes, E. M., & Bryce, N. V. (2022) · Nature Communications · doi:10.1038/s41467-022-33416-4 · Cited by 31 · see citing works
Boroujeni, K. B., Sigona, M. K., Treuting, R. L., Manuel, T. J., Caskey, C. F., & Womelsdorf, T. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001785 · Cited by 26 · see citing works
Developmental shifts in computations used to detect environmental controllability
Raab, H. A., Foord, C., Ligneul, R., & Hartley, C. A. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010120 · Cited by 25 · see citing works
Self-citationUnderstanding the development of reward learning through the lens of meta-learning
Nussenbaum, K., & Hartley, C. A. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00304-1 · Cited by 28 · see citing works
Self-citationA Case for Translation from the Clinic to the Laboratory
Kredlow, M. A., de Voogd, L. D., & Phelps, E. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916211039852 · Cited by 18 · see citing works
Distributed and Multifaceted Effects of Threat and Safety
Morrow, K., Murty, D. V. P. S., Kim, J., Song, S., Hu, K., & Pessoa, L. (2021) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01807 · Cited by 18 · see citing works
Moscarello, J. M. (2020) · Learning & Memory · doi:10.1101/lm.050377.119 · Cited by 20 · see citing works
Self-citationDon't stress, it's under control: Neural correlates of stressor controllability in humans
Meine, L. E., Meier, J., Meyer, B., & Wessa, M. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118701 · Cited by 19 · see citing works
Sanchís-Ollé, M., Fuentes, S., Úbeda-Contreras, J., Lalanza, J. F., Ramos-Prats, A., Armario, A., & Nadal, R. A. (2019) · Scientific Reports · doi:10.1038/s41598-019-40061-3 · Cited by 19 · see citing works
Qi, X., Jiang, Y., & Lian, R. (2024) · BMC Psychology · doi:10.1186/s40359-024-01621-z · Cited by 18 · see citing works
A sex-specific role for the bed nucleus of the stria terminalis in proactive defensive behavior
Guerra, D. P., Wang, W., de Souza, K. A., & Moscarello, J. M. (2023) · Neuropsychopharmacology · doi:10.1038/s41386-023-01581-9 · Cited by 17 · see citing works
Self-citationCohodes, E. M., Sisk, L. M., Keding, T. J., Mandell, J. D., Notti, M. E., & Gee, D. G. (2023) · Development and Psychopathology · doi:10.1017/s0954579423000822 · Cited by 17 · see citing works
Rahmadhani, W., Suyanto, J., Soe, T. K., & Mutoharoh, S. (2021) · Disease Prevention and Public Health Journal (DPPHJ) · doi:10.12928/dpphj.v15i2.4413 · Cited by 16 · see citing works
A Rational Account of Cognitive Control Development in Childhood
Steinbeis, N. (2023) · Annual Review of Developmental Psychology · doi:10.1146/annurev-devpsych-120221-040058 · Cited by 18 · see citing works
Gerhard, D. M., & Meyer, H. C. (2021) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2021.107543 · Cited by 16 · see citing works
Towards a neurocomputational account of social controllability: From models to mental health
Na, S., Rhoads, S. A., Yu, A. N. C., Fiore, V. G., & Gu, X. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105139 · Cited by 15 · see citing works
Bianchi, R., & Schonfeld, I. S. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.695539 · Cited by 14 · see citing works
Sex Differences in Fearful Personality Traits Are Mediated by Physical Strength
Manson, J. H., Chua, K. J., Rodriguez, N. N., Barlev, M., Durkee, P. K., & Lukaszewski, A. W. (2022) · Social Psychological and Personality Science · doi:10.1177/19485506221094086 · Cited by 14 · see citing works
Editorial: the psychopharmacology of extinction—from theory to therapy
Milton, A. L., & Holmes, A. (2019) · Psychopharmacology · doi:10.1007/s00213-018-5152-9 · Cited by 14 · see citing works
Barnett (2024) · doi:10.1089/psymed.2023.0010 · Cited by 13 · see citing works
Agency, Cultural Consonance and Depressive Symptoms: A Brazilian Example
Dressler, W. W., Balieiro, M. C., & dos Santos, J. E. (2019) · Ethos · doi:10.1111/etho.12238 · Cited by 13 · see citing works
The Antecedents and Consequences of Fear at Work
Jordan, P. J., Troth, A. C., Ashkanasy, N. M., & Humphrey, R. H. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108573887.031 · Cited by 13 · see citing works
Reducing shock imminence eliminates poor avoidance in ratsPreprint
Laughlin, L. C., Moloney, D. M., Samels, S. B., Sears, R. M., & Cain, C. K. (2020) · bioRxiv · doi:10.1101/lm.051557.120 · Cited by 14 · see citing works
Spiliopoulos, O. M., Brown, C., Hilder, P. E., Tilbrook, A. J., & Descovich, K. (2025) · Reviews in Aquaculture · doi:10.1111/raq.70051 · Cited by 11 · see citing works
When effort matters: Expectations of reward and efficacy guide cognitive control allocationPreprint
Frömer, R., Lin, H., Wolf, C. K. D., Inzlicht, M., & Shenhav, A. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.05.14.095935 · Cited by 11 · see citing works
Neural effects of controllability as a key dimension of stress exposure
Cohodes, E. M., Odriozola, P., Mandell, J. D., Caballero, C., McCauley, S., Zacharek, S. J., Hodges, H. R., Haberman, J. T., Smith, M., Thomas, J., et al. (2022) · Development and Psychopathology · doi:10.1017/s0954579421001498 · Cited by 10 · see citing works
Self-citationGiersiepen, M., Schütz‐Bosbach, S., & Kaiser, J. (2023) · Biological Psychology · doi:10.1016/j.biopsycho.2023.108659 · Cited by 10 · see citing works
Guitart‐Masip, M., Walsh, A. T., Dayan, P., & Olsson, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-45179-z · Cited by 11 · see citing works
The role of mPFC and MTL neurons in human choice under goal-conflict
Gazit, T., Gonen, T., Gurevitch, G., Cohen, N., Strauss, I., Zeevi, Y., Yamin, H. G., Fahoum, F., Hendler, T., & Fried, I. (2020) · Nature Communications · doi:10.1038/s41467-020-16908-z · Cited by 10 · see citing works
Situation selection and modification in social inhibition: a person-centered approach
Duijndam, S., Karreman, A., Denollet, J., & Kupper, N. H. M. (2021) · Anxiety Stress & Coping · doi:10.1080/10615806.2021.1908541 · Cited by 10 · see citing works
Rutherford, L. G., & Milton, A. L. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.104514 · Cited by 10 · see citing works
A Translational Paradigm to Study the Effects of Uncontrollable Stress in Humans
Meine, L. E., Schüler, K., Richter-Levin, G., Scholz, V., & Wessa, M. (2020) · International Journal of Molecular Sciences · doi:10.3390/ijms21176010 · Cited by 8 · see citing works
Evaluating user perception and emotion of microinteractions using a contradictory semantic scale
Ma, J. Y., & Chen, C. (2021) · Journal of the Society for Information Display · doi:10.1002/jsid.1075 · Cited by 9 · see citing works
Hartley, C. A., Coelho, C. A. O., Boeke, E. A., Ramirez, F., & Phelps, E. (2018) · Psychopharmacology · doi:10.1007/s00213-018-5082-6 · Cited by 10 · see citing works
Self-citationIntersect between brain mechanisms of conditioned threat, active avoidance, and reward
Badarnee, M., Wen, Z., Hammoud, M. Z., Glimcher, P. W., Cain, C. K., & Milad, M. R. (2025) · Communications Psychology · doi:10.1038/s44271-025-00197-7 · Cited by 8 · see citing works
Baroni, M., Valdrighi, G., Guazzini, A., & Duradoni, M. (2025) · Sustainability · doi:10.3390/su17136154 · Cited by 11 · see citing works
Cain, C. K. (2023) · Current topics in behavioral neurosciences · doi:10.1007/7854_2023_434 · Cited by 10 · see citing works
The Lesser Evil: Pavlovian-Instrumental Transfer & Aversive Motivation.
Campese, V. D. (2021) · Behavioural Brain Research · doi:10.1016/j.bbr.2021.113431 · Cited by 8 · see citing works
Adolescents flexibly adapt action selection based on controllability inferencesPreprint
Raab, H. A., Goldway, N., Foord, C., & Hartley, C. A. (2024) · Learning & Memory · doi:10.1101/lm.053901.123 · Cited by 8 · see citing works
Self-citationIbañez, G. E., Sánchez, M., Villalba, K., & Amaro, H. D. L. A. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-03931-1 · Cited by 7 · see citing works
Stress-sensitive inference of task controllabilityPreprint
Ligneul, R., Mainen, Z. F., Ly, V., & Cools, R. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.11.19.390393 · Cited by 8 · see citing works
An experimental test of the effects of acute sleep deprivation on affect and avoidance
Campbell, R. L., Feldner, M. T., & Leen‐Feldner, E. W. (2022) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2022.101770 · Cited by 6 · see citing works
Social threat avoidance depends on action-outcome predictability
Sequestro, M., Serfaty, J., Grèzes, J., & Mennella, R. (2024) · Communications Psychology · doi:10.1038/s44271-024-00152-y · Cited by 5 · see citing works
Motivational factors underlying aversive Pavlovian-instrumental transferPreprint
Campese, V. D., Kim, I. T., Kurpas, B., Branigan, L., Draus, C., & LeDoux, J. E. (2020) · Learning & Memory · doi:10.1101/lm.052316.120 · Cited by 6 · see citing works
Sense of control buffers against stress
Fielder, J. C., Shi, J., McGlade, D., Huys, Q. J. M., & Steinbeis, N. (2026) · eLife · doi:10.7554/elife.105025.3 · Cited by 5 · see citing works
Harlé, K. M., Ho, T. C., Connolly, C. G., Simmons, A. N., & Yang, T. T. (2021) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-021-00975-w · Cited by 5 · see citing works
Fear in action: Fear conditioning and alleviation through body movements
Alemany-González, M., Wokke, M. E., Chiba, T., Narumi, T., Kaneko, N., Yokoyama, H., Watanabe, K., Nakazawa, K., Imamizu, H., & Koizumi, A. (2024) · iScience · doi:10.1016/j.isci.2024.109099 · Cited by 4 · see citing works
Schoenfeld, T. J., Rhee, D., Smith, J. A., Padmanaban, V., Brockett, A. T., Jacobs, H. N., & Cameron, H. A. (2023) · Biological Psychiatry Global Open Science · doi:10.1016/j.bpsgos.2023.04.003 · Cited by 5 · see citing works
Biely, K. (2022) · Urban Planning and Transport Research · doi:10.1080/21650020.2022.2145350 · Cited by 5 · see citing works
Calibration and fitness-linked correlates of personality in Conambo, Ecuador
Lukaszewski, A. W., Patton, J. Q., Durkee, P. K., Zerbe, J. G., & Bowser, B. J. (2023) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2023.11.001 · Cited by 4 · see citing works
Volatility-driven learning in human infants
Poli, F., Ghilardi, T., Bersee, J. H. M., Mars, R. B., & Hunnius, S. (2025) · Science Advances · doi:10.1126/sciadv.adu2014 · Cited by 4 · see citing works
Sensitivity to the Instrumental Value of Choice Increases Across Development
Nussenbaum, K., Katzman, P. L., Lu, H., Zorowitz, S., & Hartley, C. A. (2024) · Psychological Science · doi:10.1177/09567976241256961 · Cited by 4 · see citing works
Self-citationMore engagement in inefficient avoidance through partial reinforcement
Leng, L., & Vervliet, B. (2022) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2022.101751 · Cited by 4 · see citing works
Meier, J., Meine, L. E., Schüler, K., & Wessa, M. (2025) · Scientific Reports · doi:10.1038/s41598-025-19958-9 · Cited by 4 · see citing works
Acute stress yields a sex-dependent facilitation of signaled active avoidance in rats
Plas, S. L., Oleksiak, C. R., Pitre, C., Melton, C., Moscarello, J. M., & Maren, S. (2024) · Neurobiology of Stress · doi:10.1016/j.ynstr.2024.100656 · Cited by 3 · see citing works
Self-citationInterface predictability changes betting behavior in computerized gambling
Tanaka, T., & Kawabata, H. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106387 · Cited by 4 · see citing works
Herd Behavior in Millennial Stock Investors in Indonesia: The Concept of Bandarmology
Bharata, W., Fourqoniah, F., & Novianti, R. (2023) · Advances in Social Science, Education and Humanities Research/Advances in social science, education and humanities research · doi:10.2991/978-2-38476-090-9_62 · Cited by 3 · see citing works
Exploring expected reward and efficacy in enhancing cognitive control in patients with depression
Toobaei, M., Taghavi, M. R., Goodarzi, M. A., Sarafraz, M., & Jobson, L. (2023) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2023.2287782 · Cited by 3 · see citing works
Brain encoding during perceived control as a prospective predictor of improvement in quality of life
Dan, R., Brown, A. R., Hutson, L. M., Belleau, E. L., Esfand, S. M., Ruberto, V., Johns, E., Null, K. E., Du, F., & Pizzagalli, D. (2024) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsae075 · Cited by 3 · see citing works
Boroujeni, K. B., Sigona, M. K., Treuting, R. L., Manuel, T. J., Caskey, C. F., & Womelsdorf, T. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.08.04.455080 · Cited by 3 · see citing works
Active disambiguation guides inferring controllability and cause in social interactions
Spiering, L., Trier, H. A., O’Reilly, J. X., Kolling, N., Wittmann, M. K., Rushworth, M. F. S., & Scholl, J. (2025) · Nature Communications · doi:10.1038/s41467-025-67853-8 · Cited by 2 · see citing works
Negative affect-driven impulsivity as hierarchical model-based overgeneralization
Okan, A., & Hallquist, M. N. (2025) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2025.01.002 · Cited by 2 · see citing works
Temporal dynamics of effort discounting: The roles of cognitive load and depression
Yang, Y., & Holroyd, C. (2026) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-026-01410-8 · Cited by 2 · see citing works
Chokhani, R., Lloyd, A., Viding, E. M., Gerin, M. I., & McCrory, E. J. P. (2026) · Clinical Psychology Review · doi:10.1016/j.cpr.2026.102722 · Cited by 2 · see citing works
Environmental Enrichment in Aquaculture: Linking Welfare Goals to Practical Applications
Spiliopoulos, O. M., Kadri, S., Sinclair, M., Vanderzwalmen, M., & Brown, C. (2026) · Reviews in Aquaculture · doi:10.1111/raq.70142 · Cited by 2 · see citing works
The enhancement of temporal binding effect after negative social feedback
Chen, Y., Zou, X., Wang, Y., He, H., & Zhang, X. (2024) · Cognition & Emotion · doi:10.1080/02699931.2024.2314985 · Cited by 2 · see citing works
Schepers, M., Lagerweij, P., Geurts, D. E. M., Krause, F., den Ouden, H. E. M., Cools, R., Speckens, A. E. M., & Collin, G. (2025) · BMC Psychiatry · doi:10.1186/s12888-024-06430-7 · Cited by 5 · see citing works
A task-invariant prior explains trial-by-trial active avoidance behaviour across gain and loss tasks
Granwald, T., Dayan, P., Lengyel, M., & Guitart‐Masip, M. (2025) · Communications Psychology · doi:10.1038/s44271-025-00254-1 · Cited by 2 · see citing works
A Decision Architecture for Safety ComputationsPreprint
Tashjian, S. M., Zbozinek, T. D., & Mobbs, D. (2020) · Trends in Cognitive Sciences · doi:10.31234/osf.io/4s8zb · Cited by 3 · see citing works
Adolescents flexibly adapt action selection based on controllability inferencesPreprint
Raab, H. A., Goldway, N., Foord, C., & Hartley, C. A. (2023) · doi:10.31234/osf.io/qypm6 · Cited by 2 · see citing works
Self-citationTwo prefrontal-subcortical circuits estimate controllability and reflect its impact on learning
Liu, Y., Spiering, L., Luo, S., Kingston, N., Grohn, J., & Rushworth, M. F. S. (2026) · Neuron · doi:10.1016/j.neuron.2026.07.029 · Cited by 1 · see citing works
de Vignemont, F. (2024) · Mind & Language · doi:10.1111/mila.12506 · Cited by 1 · see citing works
Ventral hippocampus mediates inter-trial responding in signaled active avoidance
Oleksiak, C. R., Plas, S. L., Carriaga, D., Vasudevan, K., Maren, S., & Moscarello, J. M. (2024) · Behavioural Brain Research · doi:10.1016/j.bbr.2024.115071 · Cited by 1 · see citing works
Self-citationDuijndam, S., Karreman, A., Smet, M. M. D., & Kupper, N. H. M. (2024) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2024.100532 · Cited by 1 · see citing works
Dudziak, M., Franssen, M., Vervliet, B., & Beckers, T. (2025) · Behaviour Research and Therapy · doi:10.1016/j.brat.2025.104842 · Cited by 1 · see citing works
- Authors
- Moscarello, J. M., & Hartley, C. A.
- Affiliations
- Texas A&M University (US)
- New York University (US)
- Corresponding author
- Hartley, Catherine A.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2017-10
- Volume
- 21
- Issue
- 10
- Pages
- 725-735
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W2724667872
- Semantic Scholar
- 24bd6081b37b1302463b08de0a6269812780d500
- Cited by
- 137
- References
- 80
- Citations by year
- 2026: 14 · 2025: 25 · 2024: 18 · 2023: 14 · 2022: 18 · 2021: 20 · 2020: 18 · 2019: 8 · 2018: 2
- FWCI
- 0.86
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Trends in Cognitive Sciences (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Brain and Behavior Research Foundation (1654393)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Free Will and Agency
- Keywords
- agency, controllability, motivated behavior, reinforcement, behavioral repertoire, prior experience, adaptive behavior
- MeSH terms
- Animals, Behavior, Animal, Calibration, Humans, Motivation, Reaction Time, Stress, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review