Context, learning, and extinction
The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Abstract
A. Redish et al. (2007) proposed a reinforcement learning model of context-dependent learning and extinction in conditioning experiments, using the idea of "state classification" to categorize new observations into states. In the current article, the authors propose an interpretation of this idea in terms of normative statistical inference. They focus on renewal and latent inhibition, 2 conditioning paradigms in which contextual manipulations have been studied extensively, and show that online Bayesian inference within a model that assumes an unbounded number of latent causes can characterize a diverse set of behavioral results from such manipulations, some of which pose problems for the model of Redish et al. Moreover, in both paradigms, context dependence is absent in younger animals, or if hippocampal lesions are made prior to training. The authors suggest an explanation in terms of a restricted capacity to infer new causes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Large prediction errors signal that the current latent cause is no longer relevant (i.e., the situation has changed) and a new or stored latent cause should be inferred.”
From Does mental context drift or shift? (2017) · cites this paper as [43]
In the citing paper
“According to a recent theory of latent cause inference, people build up a library of statistical models of their environment, and then infer which is the hidden, or “latent,” cause of their current sensory observations [43–46].”
From Does mental context drift or shift? (2017) · cites this paper as [43]
In the citing paper
“From a statistical perspective, superposition of latent causes is straightforward to model; in fact, existing latent cause models infer a continuous probability distribution over latent causes [43].”
From Does mental context drift or shift? (2017) · cites this paper as [43]
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,459
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
(1978) · UA Campus Repository (The University of Arizona) · Cited by 8,010
Introduction to the theory of neural computation
(1994) · Neural Networks · doi:10.1016/0893-6080(94)90014-0 · Cited by 6,401
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems
Dayan, P., & Abbott, L. F. (2001) · Cited by 4,099
Simple memory: a theory for archicortex
Marr, D. (1971) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1971.0078 · Cited by 2,771 · cited 2×
“Our model may also shed new light on a long-standing question about the hippocampus and memory in general (Marr, 1971; McNaughton & Morris, 1987): When a new observation is made, under what circumstances is a new trace encoded or an old trace retrieved? Our model frames this as a choice between assigning an observatio…”
BackgroundMethod
Cited by
Items 201–300 of 379
DREAM Architecture: a Developmental Approach to Open-Ended Learning in RoboticsPreprint
Doncieux, S., Bredèche, N., Goff, L. K. L., Girard, B., Coninx, A., Sigaud, O., Khamassi, M., Díaz-Rodríguez, N., Filliat, D., Hospedales, T. M., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.06223 · Cited by 20
“In contrast, recent Neuroscience work attempting to model adaptive state creation during animal reward learning generally focused on too restricted representations [23, 157].”
ResultA probabilistic successor representation for context-dependent learning
Geerts, J. P., Gershman, S. J., Burgess, N., & Stachenfeld, K. L. (2024) · Psychological Review · doi:10.1037/rev0000414 · Cited by 14
“To model the multiple context setting, we build on the literature that casts context as a latent state that the animal needs to infer from observations (Gershman et al., 2010; Sanders et al., 2020).”
BackgroundMethodSelf-citationContext-dependent savings in procedural category learning
Crossley, M. J., Ashby, F. G., & Maddox, W. T. (2014) · Brain and Cognition · doi:10.1016/j.bandc.2014.09.008 · Cited by 14
Crossley, M. J., Horvitz, J. C., Balsam, P. D., & Ashby, F. G. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00473.2015 · Cited by 14
Extracellular matrix: a new player in memory maintenance and psychiatric disorders
Bach, D. R., Brown, S. A., Kleim, B., & Tyagarajan, S. K. (2019) · Swiss Medical Weekly · doi:10.4414/smw.2019.20060 · Cited by 13
Learning Contextual Reward Expectations for Value Adaptation
Rigoli, F., Chew, B., Dayan, P., & Dolan, R. J. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01191 · Cited by 14
Scheveneels, S., Boddez, Y., Vervliet, B., & Hermans, D. (2019) · Behavior Therapy · doi:10.1016/j.beth.2019.03.001 · Cited by 13
The Effect of Outcome Probability on Generalization in Predictive Learning
Ram, H., Struyf, D., Vervliet, B., Menahem, G., & Liberman, N. (2019) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000429 · Cited by 17
Using electrodermal activity to estimate fear learning differences in anxiety: A multiverse analysis
Greaves, M. D., Felmingham, K. L., Ney, L. J., Nicholson, E., Li, S., Vervliet, B., Harrison, B. J., Graham, B. M., & Steward, T. (2024) · Behaviour Research and Therapy · doi:10.1016/j.brat.2024.104598 · Cited by 12
Contextualizing predictive minds
Butz, M. V., Mittenbühler, M., Schwöbel, S., Achimova, A., Gumbsch, C., Otte, S., & Kiebel, S. J. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105948 · Cited by 22
“…approaches have successfully modeled human-like behavior in a variety of experimental paradigms, including sensorimotor learning as well as behavior in task-switching and the Stroop task (Butz, 2022; Gershman et al., 2010; Heald et al., 2021; Schw ¨ obel et al., 2021b; Mittenbühler et al., 2024).”
InfluentialYanaoka, K., Wout, F. V. ‘., Saito, S., & Jarrold, C. (2021) · Developmental Science · doi:10.1111/desc.13181 · Cited by 13
Anxiety and Beyond: Diversity in Ventral Hippocampus Circuits and Function
van der Veldt, S., Bagot, R. C., Ciocchi, S., Ito, R., Kheirbek, M. A., MacAskill, A. F., & Amilhon, B. (2025) · Journal of Neuroscience · doi:10.1523/jneurosci.1304-25.2025 · Cited by 13
Keidar, T., Williams-Spooner, M. J., Wong, F. S., Westbrook, R. F., & Holmes, N. M. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.0067-23.2023 · Cited by 14
Categorization is ‘baked’ into the brain
Barrett, L. F., & Miller, E. K. (2026) · Nature reviews. Neuroscience · doi:10.1038/s41583-026-01036-2 · Cited by 36
Slower reacquisition after partial extinction in human contingency learning.
Morís, J., Barberia, I., Vadillo, M. A., Andrades, A., & López, F. J. (2016) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000282 · Cited by 14
“For example, according to Gershman, Blei, and Niv (2010) the mechanism involved would be quite different.”
BackgroundModeling Decision-Making Systems in Addiction
Kurth-Nelson, Z. L., & Redish, A. D. (2011) · Springer eBooks · doi:10.1007/978-1-4614-0751-5_6 · Cited by 14
“We extend quantitative decision-making theories to account for ways that organisms identify and utilize structure in the world to make decisions (Redish et al. 2007; Courville 2006; Gershman et al. 2010), which may be altered in addiction.”
BackgroundMethodInfluentialContext-gated statistical learning and its role in visual-saccadic decisions.
Ludwig, C. J. H., Farrell, S., Ellis, L. A., Hardwicke, T. E., & Gilchrist, I. D. (2012) · Journal of Experimental Psychology General · doi:10.1037/a0024916 · Cited by 10
“An illustration of this point may be found in a study by Anderson and Carpenter (2006).”
BackgroundResultInfluentialPotent attenuation of context fear by extinction training contiguous with acquisition
Bernier, B. E., Lacagnina, A. F., & Drew, M. R. (2014) · Learning & Memory · doi:10.1101/lm.036673.114 · Cited by 10
“A related idea is included in the state classification model (Redish et al. 2007; Gershman et al. 2010), which proposes that extinction can be coded as either a component of acquisition or an independent event, and the behavioral effects of extinction vary depending on which of these two coding schemes is invoked.”
BackgroundMethodInfluentialClustering and the efficient use of cognitive resourcesPreprint
Dasgupta, I., & Griffiths, T. L. (2021) · PsyArXiv (OSF Preprints) · doi:10.1016/j.jmp.2022.102675 · Cited by 13
Natural forgetting reversibly modulates engram expression
O’Leary, J. D., Bruckner, R., Autore, L., & Ryan, T. J. (2024) · eLife · doi:10.7554/elife.92860.3 · Cited by 16
The utility of a latent-cause framework for understanding addiction phenomena
Pisupati, S., Langdon, A., Konova, A. B., & Niv, Y. (2024) · Addiction Neuroscience · doi:10.1016/j.addicn.2024.100143 · Cited by 12
“Formally, such a process of latent cause discovery can be captured using Bayesian nonparametric models [29] with “ infinite-capacity ” priors that allow agents to flexibly create new latent causes in the face of unfamiliar or changing experiences, store old latent causes in memory, and infer their…”
BackgroundSelf-citationReconciling shared versus context-specific information in a neural network model of latent causes
Lu, Q., Nguyen, T. T., Zhang, Q., Hasson, U., Griffiths, T. L., Zacks, J. M., Gershman, S. J., & Norman, K. A. (2024) · Scientific Reports · doi:10.1038/s41598-024-64272-5 · Cited by 15
Self-citationVelázquez-Vargas, C. A., Daw, N. D., & Taylor, J. A. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012471 · Cited by 10
“We believe this is a result of the formation of the novel visuomotor mapping at an early stage of learning [1], and the abrupt change in variability could have separated the mapping memory from future updates [90,91], preventing it from being forgotten.”
Interference Underlies Attenuation upon Relearning in Sensorimotor Adaptation
Avraham, G., & Ivry, R. B. (2025) · eNeuro · doi:10.1523/eneuro.0132-25.2025 · Cited by 10
“From a Bayesian perspective, the participant forms an inference about the causal structure of the environment, with the nonperturbed feed-back being linked to a speci fi c target (the context; Gershman et al., 2010, 2015).”
Exploring the hierarchical structure of human plans via program generation
Correa, C. G., Sanborn, S., Ho, M. K., Callaway, F., Daw, N. D., & Griffiths, T. L. (2024) · Cognition · doi:10.1016/j.cognition.2024.105990 · Cited by 30
“…from a clustering prior over the abstract (subroutine-level) actions (Johnson et al., 2006), resembling approaches used to model clustering and reuse in categorization (Anderson, 1991), reinforcement learning (Gershman, Blei, & Niv, 2010), and causal learning (Kemp, Goodman, & Tenenbaum, 2010).”
Song, M. R., & Fellous, J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089494 · Cited by 8
“The characteristic circuit of the hippocampus suited for pattern completion and separation may support formation and retrieval of prior beliefs [42].”
BackgroundMathematical Characterization of Changes in Fear During Exposure Therapy
Portêlo, A., Shiban, Y., & Maia, T. V. (2021) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2021.01.005 · Cited by 8
Model based control can give rise to devaluation insensitive choice
Garrett, N., Allan, S., & Daw, N. D. (2023) · Addiction Neuroscience · doi:10.1016/j.addicn.2023.100070 · Cited by 8
Yanaoka, K., Wout, F. V. ‘., Saito, S., & Jarrold, C. (2023) · Cognition · doi:10.1016/j.cognition.2023.105650 · Cited by 12
Humans learn generalizable representations through efficient coding
Fang, Z., & Sims, C. R. (2025) · Nature Communications · doi:10.1038/s41467-025-58848-6 · Cited by 19
Fonteyne, R., & Baeyens, F. (2011) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000094 · Cited by 7
Sure enough: efficient Bayesian learning and choice
Foley, B. R., & Marjoram, P. (2017) · Animal Cognition · doi:10.1007/s10071-017-1107-5 · Cited by 10
“It is also a simpler scenario than optimum models for learning and exploiting resources in changing environments (Biernaskie et al. 2009; Wilson et al. 2010; Gershman et al. 2010).”
BackgroundAcute memory deficits in chemotherapy-treated adults
Lindner, O. C., Mayes, A. R., McCabe, M. G., & Talmi, D. (2017) · Memory · doi:10.1080/09658211.2017.1300667 · Cited by 7
Pool, E. R., & Sander, D. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-821124-3.00005-3 · Cited by 11
Learning to use episodic memory for event prediction
Lu, Q., Hasson, U., & Norman, K. A. (2020) · Code Ocean · doi:10.24433/co.5779179.v1 · Cited by 13
Quintero, M. J., Flores, A., Gutiérrez-Huerta, M. T., Molina, P., López, F. J., & Morís, J. (2021) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218211043434 · Cited by 10
“More recent models (e.g., Gershman et al., 2010; Redish et al., 2007) propose that the accumulation of these prediction errors may also serve as a segmentation signal, indicating a novel state in the environment and, thus, demanding the formation of a new memory.”
MethodExplaining the Return of Fear with Revised Rescorla-Wagner Models
Paskewitz, S., Stoddard, J., & Jones, M. (2022) · Computational Psychiatry · doi:10.5334/cpsy.88 · Cited by 7
“The past decade or so has seen the fruitful application of memory retrieval models to Pavlovian conditioning and the return of fear, particularly in the form of latent cause models (Gershman et al., 2010; Gershman, Monfils, Norman, & Niv, 2017; Gershman & Niv, 2012).”
BackgroundMethodInfluentialBarack, D. L., Bakkour, A., Shohamy, D., & Salzman, C. D. (2023) · Scientific Reports · doi:10.1038/s41598-023-27662-9 · Cited by 9
“We discovered that (1) for single choices, informative tiles were preferred earlier in trials than rewarding ones; (2) for pairs of choices, information outcomes predicted decisions to choose a neighboring tile; (3) for sequences of choices, decreases in information outcomes below the average of the environment predic…”
BackgroundDeficits in category learning in older adults: Rule-based versus clustering accounts.
Badham, S. P., Sanborn, A. N., & Maylor, E. A. (2017) · Psychology and Aging · doi:10.1037/pag0000183 · Cited by 18
Leshinskaya, A., & Thompson‐Schill, S. L. (2019) · Journal of Experimental Psychology General · doi:10.1037/xge0000594 · Cited by 7
Panayi, M. C., Khamassi, M., & Killcross, S. (2021) · Behavioral Neuroscience · doi:10.1037/bne0000454 · Cited by 8
“Because A was presented during a long series of days in this context, and because the introduction of B in compound with A did not change the reward schedule, the model considered that the same state is governing the task in Stages 1 and 2, as in latent cause theories of conditioning (Gershman et al., 2010).”
Models and Methods for Reinforcement Learning
Dayan, P., & Nakahara, H. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn513 · Cited by 6
Trait anxiety is associated with hidden state inference during aversive reversal learningPreprint
Zika, O., Wiech, K., Reinecke, A., Browning, M. D., & Schuck, N. W. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.04.01.483303 · Cited by 6
Mnemonic prediction errors promote detailed memoriesPreprint
Bein, O., Plotkin, N. A., & Davachi, L. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/b5z8a · Cited by 7
Fear in action: Fear conditioning and alleviation through body movements
Alemany-González, M., Wokke, M. E., Chiba, T., Narumi, T., Kaneko, N., Yokoyama, H., Watanabe, K., Nakazawa, K., Imamizu, H., & Koizumi, A. (2024) · iScience · doi:10.1016/j.isci.2024.109099 · Cited by 5
“This result is in line with the theoretical and experimental studies suggesting that extinction is a form of inhibitory learning rather than an erasure of acquired fear (52, 58, 59).”
Moul, C., Don, H. J., & Livesey, E. J. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01068-6 · Cited by 6
“1) The individual may interpret the underlying base-rate as volatile; rather than a single stable base-rate, the individual may interpret their experiences as being indicative of base-rates that change relatively frequently (Gershman et al., 2010).”
BackgroundTesting the psychological validity of cluster construction biases
Austerweil, J. L. (2014) · eScholarship (California Digital Library) · Cited by 5
A model for recovery-from-extinction effects in Pavlovian conditioning and exposure therapy
Nihei, M., Hojo, D., Tanaka, T., & Sawa, K. (2023) · Learning & Behavior · doi:10.3758/s13420-023-00578-0 · Cited by 6
Communicating the library as a learning environment
Nitecki, D. A., & Needham, K. (2016) · Journal of learning spaces · Cited by 9
Learning to learn about uncertain feedback
Faraut, M. C. M., Procyk, E., & Wilson, C. R. E. (2016) · Learning & Memory · doi:10.1101/lm.039768.115 · Cited by 13
“So, in these cases, subjects learn to learn about uncertain tasks and, in doing so, acquire abstract information about latent task structure, even when not necessary (Kornell et al. 2007; Gershman et al. 2010; Collins and Frank 2013).”
BackgroundImprecise neural computations as source of human adaptive behavior in volatile environmentsPreprint
Findling, C., Chopin, N., & Koechlin, É. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/799239 · Cited by 5
“Secondly, we recorded the performance of human participants in such environments and observed that the Weber-imprecision model accounts for human performances significantly better than (1) the optimal adaptive models, (2) their standard, biologically plausible algorithmic approximations, and (3) reinforcement learning.”
BackgroundMethodInfluentialA rational account of the repulsion effectPreprint
Bhui, R., & Xiang, Y. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/hxjqv · Cited by 7
Explaining the effectiveness of fear extinction through latent-cause inferencePreprint
Song, M., Jones, C. E., Monfils, M., & Niv, Y. (2021) · doi:10.31234/osf.io/2fhr7 · Cited by 5
“Recent theoretical work [6] suggested a formalization of the way animals decide when to learn a new association and when to update old associations using a latent-cause inference framework.”
BackgroundMethodInfluentialSelf-citationReconciling time and prediction error theories of associative learning
Hamou, N., Gershman, S. J., & Reddy, G. (2025) · Nature Communications · doi:10.1038/s41467-025-65137-9 · Cited by 6
Self-citationComputational origins of cortical brain circuits for social cognition
Mahmoodi, A., & Rushworth, M. F. S. (2026) · Nature reviews. Neuroscience · doi:10.1038/s41583-026-01028-2 · Cited by 9
Bridging Computation and Representation in Associative Learning
Gershman, S. J. (2025) · Computational Brain & Behavior · doi:10.1007/s42113-025-00242-y · Cited by 7
“More sophisticated Bayesian algorithms, such as particle filtering (Daw & Courville, 2008; Gershman et al., 2010) and assumed density filtering (Daw et al., 2008), have been proposed to explain Pavlovian conditioning, albeit in discrete time and with different probabilistic assumptions.”
Self-citationThe Ubiquity of Time in Latent-cause Inference
Mirea, D.-M., Shin, Y. S., DuBrow, S., & Niv, Y. (2024) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_02231 · Cited by 4
“The latent-cause inference framework provides a rational basis for such generalization, while also accommodating situations that are completely new and cannot build on past experience (Radulescu, Shin, & Niv, 2021; Gershman, Blei, & Niv, 2010; Courville, Daw, & Touretzky, 2005; Anderson, 1991).”
BackgroundSelf-citationNeurobiology and computational structure of decision-making in addiction
Huys, Q. J. M., Beck, A., Dayan, P., & Heinz, A. (2014) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-91433 · Cited by 5
Leeuwis, M., Asar, Y., White, J. J., Rasman, B. G., & Forbes, P. A. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2404909121 · Cited by 3
A Flexible Mechanism of Rule Selection Enables Rapid Feature-Based Reinforcement Learning
Balcarras, M., & Womelsdorf, T. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00125 · Cited by 5
Dynamic integration of conceptual information during learning
Inhoff, M. C., Libby, L. A., Noguchi, T., Love, B. C., & Ranganath, C. (2018) · PLoS ONE · doi:10.1371/journal.pone.0207357 · Cited by 7
Evolutionary particle filtering for sequential dependency learning from video data
Yoo, J. H., Seok, H.-S., & Zhang, B. (2012) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2012.6256411 · Cited by 4
“One of dominant strengths of particle filtering is its inference capability for latent states [7].”
BackgroundLearning to use past evidence in a sophisticated world model
Ahilan, S., Solomon, R. B., Breton, Y.-A., Conover, K. L., Niyogi, R. K., Shizgal, P., & Dayan, P. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007093 · Cited by 4
Addiction as a Symptom of Failure Modes in the Machineries of Decision Making
Redish, A. D. (2015) · Wiley eBooks · doi:10.1002/9781118472415.ch7 · Cited by 4
Wood, M. A. (2010) · Apollo (University of Cambridge) · doi:10.17863/cam.16464 · Cited by 3
Individual Learning Phenotypes Drive Collective CognitionPreprint
Cook, C. N., Lemanski, N. J., Mosqueiro, T. S., Ozturk, C., Gadau, J., Pinter‐Wollman, N., & Smith, B. H. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/761676 · Cited by 5
Simultaneous Underweighting and Overestimation of Rare Events: Unpacking a ParadoxPreprint
Szollosi, A., Liang, G., Konstantinidis, E., Donkin, C., & Newell, B. R. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/fmsze · Cited by 4
Contextual overtraining accelerates habit formation in new stimuliPreprint
Lesage, E., & Verguts, T. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7m6bh · Cited by 5
ABA and AAB renewal of alcohol seeking in rats are reduced by exposure to beer before extinction
Mason, T. A., Nieto, J., Uengoer, M., & Bernal‐Gamboa, R. (2024) · Behavioural Processes · doi:10.1016/j.beproc.2024.105110 · Cited by 3
Hippocampus supports multi-task reinforcement learning under partial observability
Pedamonti, D., Mohinta, S., Dimitrov, M. V., Malagon‐Vina, H., Ciocchi, S., & Costa, R. P. (2025) · Nature Communications · doi:10.1038/s41467-025-64591-9 · Cited by 9
“Another hypothesis is that the brain performs latent-state inference, using accumulated evidence (e.g., reward history, environmental cues) to infer which task is currently active 68,69 .”
Action repetition biases choice in context-dependent decision-making
Wagner, B., Wolf, H. B., & Kiebel, S. J. (2025) · Communications Psychology · doi:10.1038/s44271-025-00363-x · Cited by 8
Prediction error determines how memories are organized in the brain
Kennedy, N. G. W., Lee, J. C., Killcross, S., Westbrook, R. F., & Holmes, N. M. (2024) · eLife · doi:10.7554/elife.95849 · Cited by 12
“The initial experiments confirmed that gradual extinction does, indeed, have these effects, as predicted by the Cochran-Cisler model and other latent state models (e.g. Gershman et al., 2010 ).”
BackgroundMethodResultInfluentialA neurocomputational account of multi-line electronic gambling machines
Peters, J. (2025) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.12.009 · Cited by 4
Computational markers show specific deficits for dyslexia and ADHD in complex learning settings
Gabay, Y., Jacob, L., Mansour, A., & Hertz, U. (2025) · npj Science of Learning · doi:10.1038/s41539-025-00323-4 · Cited by 7
Affective and computational determinants of threat extinction biases
Stussi, Y. (2025) · Behaviour Research and Therapy · doi:10.1016/j.brat.2025.104804 · Cited by 5
Learning and transfer of working memory gating policiesPreprint
Bhandari, A., & Badre, D. (2017) · bioRxiv · doi:10.1101/144543 · Cited by 36
Generalizing to generalize: when (and when not) to be compositional in task structure learningPreprint
Franklin, N. T., & Frank, M. J. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/547406 · Cited by 3
Learning to synchronize: Midfrontal theta dynamics during rule switchingPreprint
Verbeke, P., Ergo, K., Loof, E. D., & Verguts, T. (2022) · OSF Preprints (OSF Preprints) · Cited by 3
Bradfield, L. A., & Hart, G. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/tk5gn · Cited by 3
Learning generalizable visuomotor mappings fo r de novo skillsPreprint
Velázquez-Vargas, C. A., Daw, N. D., & Taylor, J. A. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.07.18.549179 · Cited by 3
Natural forgetting reversibly modulates engram expressionPreprint
O’Leary, J. D., Bruckner, R., Autore, L., & Ryan, T. J. (2023) · eLife · doi:10.7554/elife.92860.1 · Cited by 6
Berwian, I. M., Pisupti, S., Chiu, J. C., Ren, Y., & Niv, Y. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5yhr7 · Cited by 3
Self-citationRottman, B. M., & Zhang, Y. (2025) · Cognitive Research Principles and Implications · doi:10.1186/s41235-025-00614-9 · Cited by 5
“In a changing world, it is reasonable to assume that recent events are more predictive of the future than are events from the distant past (Bouton, 1997; Courville, 2006; Courville et al., 2006; Daw et al., 2008; Gershman et al., 2010 for related work from a rational perspective).”
Fang, X., & Piray, P. (2026) · Psychological Review · doi:10.1037/rev0000638 · Cited by 7
Extinction context is learned by pigeons, not given by the environment
Peschken, J., Hahn, L. A., Pusch, R., & Rose, J. (2025) · Communications Psychology · doi:10.1038/s44271-025-00261-2 · Cited by 3
“The literature suggests that attention mechanisms 32,33 and learning processes 34,35 play key roles in context formation.”
Reinstatement and Reacquisition of Extinguished Behavior: Evidence from the Laboratory
Bouton, M. E. (2025) · Autism and child psychopathology series · doi:10.1007/978-3-031-91965-7_5 · Cited by 3
Forster, A., Rodrigues, J., Sperlich, B., & Hewig, J. S. (2026) · Psychophysiology · doi:10.1111/psyp.70217 · Cited by 3
“…a substantial body of evidence indicates that large prediction errors are more likely to generate new associations, encoded as distinct memory traces, rather than directly updating preexisting ones (Bouton and Moody 2004; Gershman et al. 2010; Fernández et al. 2016; Sevenster et al. 2014).”
Shinohara, S., Morita, D., Hirai, H., Kuribayashi, R., Manome, N., Moriyama, T., Nakajima, Y., Gunji, Y., & Chung, U. (2026) · Biosystems · doi:10.1016/j.biosystems.2026.105742 · Cited by 3
Effects of novelty and reward-based fear extinction on memory generalization
Laing, P. A. F., & Dunsmoor, J. E. (2026) · Behaviour Research and Therapy · doi:10.1016/j.brat.2026.105023 · Cited by 3
The Neural Basis of Simultaneous Multitasking
Garner, K., & Dux, P. E. (2022) · Springer eBooks · doi:10.1007/978-3-031-04760-2_6 · Cited by 4
Avid: A Variational Inference Deliberation For Meta-Learning
Javaheri, A., Kheradpisheh, S. R., Farahani, H., Khoee, A. G., & Ganjtabesh, M. (2022) · International Conference on Computer and Knowledge Engineering · doi:10.1109/iccke57176.2022.9960005 · Cited by 2
“These factors explain why humans can solve new tasks with little training data [12], [13].”
BackgroundSurprise-minimization as a solution to the structural credit assignment problem
Wurm, F., Ernst, B., & Steinhauser, M. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012175 · Cited by 4
Identifying Transfer Learning in the Reshaping of Inductive Biases
Székely, A., Török, B., Kiss, M. M., Janacsek, K., Németh, D., & Orbán, G. (2024) · Open Mind · doi:10.1162/opmi_a_00158 · Cited by 5
“…learn or meta-learning), is possible since primate perception doesn ’ t specialize in processing a stream of unrelated stimuli but exploits the fact that the rules and regularities structuring the environment can effectively generalize to novel situations (Brady et al., 2009; Gershman & Niv, 2010).”
BackgroundInfluentialRottman, B. M., & Ahn, W. (2011) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0024829 · Cited by 6
Placing Approach-Avoidance Conflict Within the Framework of Multi-objective Reinforcement Learning
Enkhtaivan, E., Nishimura, J., & Cochran, A. L. (2023) · Bulletin of Mathematical Biology · doi:10.1007/s11538-023-01216-6 · Cited by 2
“…reinforcement learning models have been adapted in order to describe different aspects of human decision-making such as sensitivity to risk (Ross et al. 2018; Niv et al. 2012; Enkhtaivan et al. 2021) or learning latent states (Redish et al. 2007; Cochran and Cisler 2019; Gershman et al. 2010).”
Towards a unifying theory of generalizationPreprint
Schulz, E. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/rzj2m · Cited by 2
“163 Another area of related research comes from the associative learning literature, where it has been shown that context can act as an additional cue to maximize reward (cf Bouton & King, 1983; Gershman et al., 2010).”
BackgroundCoupled Contagion: A Two-Fears Epidemic ModelPreprint
Epstein, J. M., Hatna, E., & Crodelle, J. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.11045 · Cited by 2
“Both the fear acquisition phase and fear extinction phases can be modeled mathematically [37].”
BackgroundThe neural basis of multitaskingPreprint
Garner, K., & Dux, P. E. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/jqxeb · Cited by 2
Model-based foraging using latent-cause inferencePreprint
Harhen, N. C., Hartley, C. A., & Bornstein, A. M. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/dfztu · Cited by 2
“…a model that borrows from rational models of categorization (Anderson, 1991; Sanborn, Griffiths, & Navarro, 2006, 2010) and latent cause theory (Gershman, Niv, & Blei, 2010) to explain how foragers learn a model of the environment, and we extend these models to explain how that knowledge is…”
BackgroundMethodFear and Safety Learning in Anxiety- and Stress-Related Disorders: An Updated Meta-AnalysisPreprint
Kausche, F. M., Carsten, H. P., Sobania, K. M., & Riesel, A. (2024) · doi:10.31234/osf.io/qb5dh · Cited by 2
Metadata
- Authors
- Gershman, S. J., Blei, D. M., & Niv, Y.
- Affiliations
- Princeton University (US)
- Venue
- Psychological Review
- Published
- 2010
- Volume
- 117
- Issue
- 1
- Pages
- 197-209
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2086710210
- Cited by
- 386
- References
- 74
- Citations by year
- 2026: 26 · 2025: 29 · 2024: 38 · 2023: 27 · 2022: 24 · 2021: 33 · 2020: 22 · 2019: 32 · 2018: 21 · 2017: 26 · 2016: 29 · 2015: 17 · 2014: 15 · 2013: 16 · 2012: 15
- FWCI
- 8.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Review (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Google and Microsoft Research
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Keywords
- context-dependent learning, extinction, reinforcement learning, state classification, Bayesian inference, latent inhibition, renewal, hippocampus, age differences
- MeSH terms
- Bayes Theorem, Conditioning, Classical, Extinction, Psychological, Hippocampus, Humans, Learning, Models, Psychological, Semantics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.