The ubiquity of model-based reinforcement learning

Cited by (380)

Items 201–300 of 380

1. The two‐step task, avoidance, and OCD
   Matthew A. Geramita, Eric A. Yttri, Susanne E. Ahmari · 2020 · Journal of Neuroscience Research
2. Better, worse, or different than expected: on the role of value and identity prediction errors in fear memory reactivation
   Anna M. V. Gerlicher, Sjoerd A Verweij, Merel Kindt · 2022 · Scientific Reports
3. Neural evidence for age-related deficits in the representation of state spaces
   Alexa Ruel, Florian Bolenz, Shu Li, Adrian G. Fischer, Ben Eppinger · 2022 · Cerebral Cortex
4. Integrative hippocampal and decision-making neurocircuitry during goal-relevant predictions and encoding
   Sheri J. Y. Mizumori, Valerie L. Tryon · 2015 · Progress in brain research
5. Olfactory preference conditioning changes the reward value of reinforced and non-reinforced odors
   Nicolas Torquet, Pascaline Aimé, Belkacem Messaoudi, Samuel Garcia, Elodie Ey, Rémi Gervais, A Julliard, Nadine Ravel · 2014 · Frontiers in Behavioral Neuroscience
6. Neural Correlates of Temporal Credit Assignment in the Parietal Lobe
   Timothy M. Gersch, Nicholas C. Foley, Ian W. Eisenberg, Jacqueline P. Gottlieb · 2014 · PLoS ONE
7. Post-error Slowing During Instrumental Learning is Shaped by Working Memory-based Choice Strategies
   Samuel D. McDougle · 2021 · Neuroscience
8. Social Concepts Simplify Complex Reinforcement Learning
   Leor M. Hackel, David A. Kalkstein · 2023 · Psychological Science
9. Inductive biases of neural network modularity in spatial navigation
   Ruiyi Zhang, Xaq Pitkow, Dora E. Angelaki · 2024 · Science Advances
10. Contextualizing predictive minds
    Martin V. Butz, Maximilian Mittenbühler, Sarah Schwöbel, Asya Achimova, Christian Gumbsch, Sebastian Otte, Stefan J. Kiebel · 2024 · Neuroscience & Biobehavioral Reviews
11. The Feedback-related Negativity Codes Components of Abstract Inference during Reward-based Decision-making
    Andrea M. F. Reiter, Stefan Koch, Erich Schröger, Hermann Hinrichs, Hans‐Jochen Heinze, Lorenz Deserno, Florian Schlagenhauf · 2016 · Journal of Cognitive Neuroscience
12. Mouse Behavior on the Trial-Unique Nonmatching-to-Location (TUNL) Touchscreen Task Reflects a Mixture of Distinct Working Memory Codes and Response Biases
    Daniel Bennett, Jay Nakamura, Chitra Vinnakota, Elysia Sokolenko, Jess Nithianantharajah, Maarten van den Buuse, Nigel C. Jones, Suresh Sundram, Rachel Hill · 2023 · Journal of Neuroscience
13. Limb-related sensory prediction errors and task-related performance errors facilitate human sensorimotor learning through separate mechanisms
    Anushka Oza, Adarsh Kumar, Apoorva Sharma, Pratik K. Mutha · 2024 · PLoS Biology
14. Policies or knowledge: priors differ between a perceptual and sensorimotor task
    Claire Chambers, Hugo L. Fernandes, Konrad Paul Kording · 2019 · Journal of Neurophysiology
15. Out of control: computational dynamic control dysfunction in stress- and anxiety-related disorders
    Jonathon R. Howlett, Martin P. Paulus · 2024 · Discover Mental Health
16. Humans rationally balance detailed and temporally abstract world models
    Ari E. Kahn, Nathaniel D. Daw · 2025 · Communications Psychology
17. Computational Neural Mechanisms of Goal-Directed Planning and Problem Solving
    Justin M. Fine, Noah Zarr, Joshua W. Brown · 2020 · Computational Brain & Behavior
18. Combining learned controllers to achieve new goals based on linearly solvable MDPs
    Eiji Uchibe, Kenji Doya · 2014 · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
19. Choice-selective sequences dominate in cortical relative to thalamic inputs to nucleus accumbens, providing a potential substrate for credit assignment
    Nathan F. Parker, Avinash Baidya, Julia Cox, Laura M. Haetzel, Anna Zhukovskaya, Malavika Murugan, Ben Engelhard, Mark S. Goldman, Ilana B. Witten · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
20. The comparable strategic flexibility of model-free and model-based learning
    Alexandre L. S. Filipowicz, Jonathan Levine, Eugenio Piasini, Gaia Tavoni, Joseph W. Kable, Joshua I. Gold · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
21. Model-based Reinforcement Learning for Service Mesh Fault Resiliency in a Web Application-level
    Fanfei Meng, Lalita Jategaonkar Jagadeesan, Marina Thottan · 2021 · arXiv (Cornell University)
22. Distributed Intracranial Activity Underlying Human Decision-making Behavior
    Jacqueline A. Overton, Karen Anne Moxon, Matthew P. Stickle, Logan M. Peters, Jack J. Lin, Edward F. Chang, Robert Thomas Knight, Ming Hsu, Ignacio Sáez · 2025 · Journal of Neuroscience
23. Microfoundations of Adaptive Search in Complex Tasks: The Role of Cognitive Abilities and Styles
    Carsten Bergenholtz, Oana Vuculescu, Ali Amidi · 2023 · Organization Science
24. Model-based reinforcement learning for service mesh fault resiliency in a web application-level
    Fanfei Meng, Lalita Jategaonkar Jagadeesan, Marina Thottan · 2024 · Applied and Computational Engineering
25. Prefrontal solution to the bias-variance tradeoff during reinforcement learning
    Dongjae Kim, Jaeseung Jeong, Sang Wan Lee · 2021 · Cell Reports
26. Opening Burton's Clock: Psychiatric insights from computational cognitive models
    Daniel Bennett, Y. Niv · 2018
27. Self-utility distance as a computational approach to understanding self-concept clarity
    Josué García‐Arch, Christoph W. Korn, Lluís Fuentemilla · 2025 · Communications Psychology
28. Neural Representation of Costs and Rewards in Decision Making
    Yixuan Chen · 2021 · Brain Sciences
29. Reinforcement learning with associative or discriminative generalization across states and actions: fMRI at 3 T and 7 T
    Jaron T. Colas, Neil M. Dundon, Raphael T. Gerraty, Natalie Marie Saragosa-Harris, Karol P. Szymula, Koranis Tanwisuth, J. Michael Tyszka, Camilla van Geen, Harang Ju, Arthur W. Toga et al. · 2022 · Human Brain Mapping
30. Deep reinforcement learning for the heat transfer control of pulsating impinging jets
    Sajad Salavatidezfouli, Saeid Moradi Zadeh, Giovanni Stabile, Gianluigi Rozza · 2023 · Advances in Computational Science and Engineering
31. Altered behavioral and neural responsiveness to counterfactual gains in the elderly
    Michael J. Tobia, Rong Guo, Jan P. Gläscher, Ulrike Schwarze, Stefanie Brassen, Christian Büchel, Klaus Obermayer, Tobias Sommer · 2016 · Cognitive Affective & Behavioral Neuroscience
32. Happiness as an intrinsic motivator in reinforcement learning
    Yue Gao, Shimon Edelman · 2016 · Adaptive Behavior
33. A theory of actions and habits: The interaction of rate correlation and contiguity systems in free-operant behavior
    Omar D. Perez, Anthony Dickinson · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
34. Generalized cue reactivity in rat dopamine neurons after opioids
    Collin M. Lehmann, Nora E. Miller, Varun S. Nair, Kauê Machado Costa, Geoffrey M. Schoenbaum, Khaled Moussawi · 2025 · Nature Communications
35. Introspective access to value-based multi-attribute choice processes
    Adam Morris, Ryan W. Carlson, Hedy Kober A, Molly J. Crockett · 2025 · Nature Communications
36. Exacerbation of the credit assignment problem in rats with lesions of the medial prefrontal cortex is revealed by Bayesian analysis of behavior in the pre-solution period of learning
    Jiachao Wang, David S. Tait, Verity Joy Brown, Eric M. Bowman · 2019 · Behavioural Brain Research
37. A System Computational Model of Implicit Emotional Learning
    Luca Puviani, Sidita Rama · 2016 · Frontiers in Computational Neuroscience
38. Conceptual advances in the cognitive neuroscience of learning: Implications for relational frame theory
    Nigel A. Vahey, Marc Bennett, Robert Whelan · 2017 · Journal of Contextual Behavioral Science
39. Reward prediction errors, not sensory prediction errors, play a major role in model selection in human reinforcement learning
    Yihao Wu, Masahiko Morita, Jun Izawa · 2022 · Neural Networks
40. Opening Burton’s Clock: Psychiatric Insights from Computational Cognitive Models
    Daniel Bennett, Yael Niv · 2020 · The Cognitive Neurosciences
41. The algorithmic neuroanatomy of action-outcome learning
    Richard W. Morris, Amir Dezfouli, Kristi R. Griffiths, Mike E. Le Pelley, Bernard W. Balleine · 2017 · bioRxiv (Cold Spring Harbor Laboratory)
42. Reinforcement Learning and Decision Making in Anorexia Nervosa
    Christina E. Wierenga, Carina S. Brown, Erin E. Reilly · 2025 · Current Psychiatry Reports
43. Adaptation and learning as strategies to maximize reward in neurofeedback tasks
    Rodrigo Osuna-Orozco, Yi Zhao, Hannah M. Stealey, Hung‐Yun Lu, Enrique Contreras-Hernandez, Samantha R. Santacruz · 2024 · Frontiers in Human Neuroscience
44. The role of causal structure in implicit evaluation
    Benedek Kurdi, Adam Morris, Fiery Andrews Cushman · 2022 · Cognition
45. Procedural Memory
    Karolina Janacsek, Dezső Németh · 2022
46. Neural correlates of valence-dependent belief and value updating during uncertainty reduction: An fNIRS study
    Xue-Rui Peng, Indra Bundil, Stefan Schulreich, Shu Li · 2023 · NeuroImage
47. Robust encoding of scene anticipation during human spatial navigation
    Yumi Shikauchi, Shin Ishii · 2016 · Scientific Reports
48. Ventral striatal lesions disrupt dopamine neuron signaling of differences in cue value caused by changes in reward timing but not number.
    Yuji K. Takahashi, Geoffrey M. Schoenbaum · 2016 · Behavioral Neuroscience
49. Continuous support for rehabilitation using machine learning
    Patrick Philipp, Nicole Merkle, Kai Gand, Carola Gißke · 2019 · it - Information Technology
50. Considering the Influence of the Pavlovian System on Behavior: Appraisal and Value Representation
    Vanessa Sennwald, Eva R. Pool, David Sander · 2017 · Psychological Inquiry
51. Bayesian Inference of Other Minds Explains Human Choices in Group Decision Making
    Koosha Khalvati, Seongmin A. Park, Saghar Mirbagheri, Rémi Philippe, Mariateresa Sestito, Jean‐Claude Dreher, Rajesh P. N. Rao · 2018 · bioRxiv (Cold Spring Harbor Laboratory)
52. Introspective access to value-based multi-attribute choice processes
    Adam Morris, Ryan W. Carlson, Hedy Kober A, Molly J. Crockett · 2023
53. Neural dynamics encoding risky choices during deliberation reveal separate choice subspaces
    Logan M. Peters, Alec Roadarmel, Jacqueline A. Overton, Matthew P. Stickle, Jack J. Lin, Zhaodan Kong, Ignacio Sáez, Karen Anne Moxon · 2025 · Progress in Neurobiology
54. A new take on model-based and model-free influences on mental effort and striatal prediction errors
    Carolina Feher da Silva, Gaia Lombardi, Micah G. Edelson, Todd Anthony Hare · 2023 · Conference on Cognitive Computational Neuroscience (CCN)
55. Assessing value representation in animals
    Aurore San‐Galli, Sébastien Bouret · 2014 · Journal of Physiology-Paris
56. Intellectual Investment, Dopaminergic Gene Variation, and Life Events: A Critical Examination
    Alexander Strobel, Anja Strobel, Sören Enge, Monika Fleischhauer, Andreas Reif, Klaus‐Peter Lesch, Kristin Anacker · 2018 · Personality Neuroscience
57. Dynamics, Adaptation and Control for Mental Models: A Cognitive Architecture
    Laila van Ments, Jan Treur A · 2022 · Studies in systems, decision and control
58. Do Artificial Reinforcement-Learning Agents Matter Morally?
    Brian Tomasik · 2014 · arXiv (Cornell University)
59. Proactive and reactive construction of memory-based preferences
    Jonathan Nicholas, Nathaniel D. Daw, Daphna Shohamy · 2025 · Nature Communications
60. Prospective and retrospective values integrated in frontal cortex drive predictive choice
    Kosuke Hamaguchi, Hiromi Takahashi-Aoki, Dai Watanabe · 2022 · Proceedings of the National Academy of Sciences
61. The Bayesian Brain and Tinnitus
    Dirk De Ridder, Sven Vanneste, William Sedley, Karl John Friston · 2024 · Springer eBooks
62. Self Regulation of Memory Processing Centers of the Brain
    Sheri J. Y. Mizumori · 2015 · Springer eBooks
63. Moral Metaphysics, Moral Psychology, and the Cognitive Sciences
    Peter Railton · 2019 · Oxford University Press eBooks
64. Deficits in access consciousness, integrative function, and consequent autonoetic thinking in schizophrenia
    Nicholas S. Patniyot · 2021 · Medical Hypotheses
65. The dorsal hippocampus’ role in context-based timing in rodents
    Benjamin J. De Corte, Sean J. Farley, Kelsey A. Heslin, Krystal Lynn Parker, John H. Freeman · 2022 · Neurobiology of Learning and Memory
66. The behavioral signature of stepwise learning strategy in male rats and its neural correlate in the basal forebrain
    Hachi E. Manzur, Ksenia Y. Vlasov, You-Jhe Jhong, Hung-Yen Chen, Shih‐Chieh Lin · 2023 · Nature Communications
67. Goal-Directed Deficits in Schizophrenia
    Richard W. Morris · 2018 · Elsevier eBooks
68. Alpha EEG power reflects the suppression of Pavlovian bias during social reinforcement learning
    James C. Thompson, M. Westwater · 2017 · bioRxiv
69. Document-editing Assistants and Model-based Reinforcement Learning as a Path to Conversational AI
    Katya Kudashkina, Patrick M. Pilarski, Richard S. Sutton · 2020 · arXiv (Cornell University)
70. A single dose of the catecholamine precursor Tyrosine reduces physiological arousal and decreases decision thresholds in reinforcement learning and temporal discounting
    David Mathar, Mani Erfanian Abdoust, Deniz Tuszus, Tobias Marrenbach, Jan Peters · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
71. On the effects of impulsivity and compulsivity on neural correlates of model-based performance
    Kerstin Dück, Raoul Dieterich, Rebecca Overmeyer, Tanja Endraß · 2024 · Scientific Reports
72. Learning from outcomes shapes reliance on moral rules versus cost–benefit reasoning
    Maximilian Maier, Vanessa Cheung, Falk Lieder · 2025 · Nature Human Behaviour
73. Global neural encoding of behavioral strategies in mice during perceptual decision-making task with two different sensory patterns
    Shuo Wang, Huayi Gao, Yutaro Ueoka, Kotaro Ishizu, Akihiro Funamizu · 2024 · iScience
74. Learning patterns in noise: Environmental statistics explain the sequential effect
    Friederike Schüür, Brian P. Tam, Laurence T. Maloney · 2013
75. The biological and behavioral computations that influence dopamine responses
    William R. Stauffer · 2018 · Current Opinion in Neurobiology
76. Dual Competition between the Basal Ganglia and the Cortex: from Action-Outcome to Stimulus-Response
    Meropi Topalidou, Daisuke Kase, Thomas Boraud, Nicolas P. Rougier · 2017 · bioRxiv (Cold Spring Harbor Laboratory)
77. Electrophysiological correlates of state transition prediction errors
    Danesh Shahnazian, José J. F. Ribas Fernandes, Clay B. Holroyd · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
78. Awake hippocampal-prefrontal replay mediates spatial learning and decision making
    Justin D. Shin, Wenbo Tang, Shantanu P. Jadhav · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
79. Humans are primarily model-based and not model-free learners in the two-stage task
    Todd Anthony Hare, Carolina Feher da Silva · 2019 · Zurich Open Repository and Archive (University of Zurich)
80. Dissociable mechanistic contributions of limb and task related errors during human sensorimotor learning
    Anushka Oza, Adarsh Kumar, Apoorva Sharma, Pratik K. Mutha · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
81. The role of causal structure in implicit evaluation
    Benedek Kurdi, Adam Morris, Fiery Andrews Cushman · 2020
82. Dissociation between task structure learning and performance in human model-based reinforcement learning
    Sabrine Hamroun, Maël P. Lebreton, Stefano Palminteri · 2022
83. Awake Hippocampal-Prefrontal Replay Mediates Spatial Learning and Decision Making
    Justin D. Shin, Wenbo Tang, Shantanu P. Jadhav · 2019 · SSRN Electronic Journal
84. Multi-areal neural dynamics encode human decision making
    Jacqueline A. Overton, Karen Anne Moxon, Matthew P. Stickle, Logan M. Peters, Jack J. Lin, Edward F. Chang, Robert Thomas Knight, Ming Hsu, Ignacio Sáez · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
85. Data Driven Equation Discovery Reveals Non-linear Reinforcement Learning in Humans
    Kyle J. LaFollette, Janni Yuval, Roey Schurr, David E. Melnikoff, Amit Goldenberg · 2023
86. Proactive and reactive construction of memory-based preferences
    Jonathan Nicholas, Nathaniel D. Daw, Daphna Shohamy A · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
87. Human hippocampal ripples prioritize model-based learning
    Xiaoyu Zhou, Xiongfei Wang, Xiangyu Hu, Haiteng Wang, Jinbo Zhang, Qianqian Yu, Jiahua Xu, Zhibing Xiao, Li He, Yunzhe Liu · 2026 · Neuron
88. Prosocial learning: Model-based or model-free?
    Parisa Navidi, Sepehr Saeedpour, Sara Ershadmanesh, Mostafa Miandari Hossein, Bahador Bahrami · 2023 · PLoS ONE
89. Reinforcement learning-based assimilation of the WOFOST crop model
    Haochong Chen, Xiangning Yuan, Jian Kang, Danni Yang, Tianyi Yang, Xiang Ao, Sien Li · 2024 · Smart Agricultural Technology
90. The state of hybrid artificial intelligence for interstellar missions
    Alex A. Ellery · 2025 · Progress in Aerospace Sciences
91. Integrating neuro-psychological habit research into consumer choice models
    Ryan Webb, Jessica Fong, Peter Landry, Julia Levine, Alexandra Wellsjo, Olivia Natan, Asaf Mazar, Clarice Zhao, Phillippa J. Lally, Sanne de Wit et al. · 2025 · International Journal of Research in Marketing
92. Towards a Mechanistic Understanding of Age-Related Changes in Learning and Decision Making
    Ben Eppinger, Rasmus Bruckner · 2015 · Elsevier eBooks
93. Executive function supports single-shot endowment of value to arbitrary transient goals
    Samuel D. McDougle, Ian C. Ballard, Beth Baribault, Sonia J. Bishop, Anne Gabrielle Eva Collins · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
94. Population coding of reward prediction errors through opponent organization in the fronto parietal network
    Nicholas C. Foley, Michael Cohanpour, Mulugeta Semework, Sameer Anil Sheth, Jacqueline P. Gottlieb · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
95. Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference
    Lorenz Deserno, Rani Moran, Jochen Michely, Ying Lee, Peter Dayan, Raymond J. Dolan · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
96. Assembling hierarchies of action using sequencing and abstraction: studies and models of zero-shot learning
    Gwydion Williams, Stefano Palminteri, Patrick Haggard · 2022
97. Global neural encoding of model-free and inference-based strategies in mice
    Shuo Wang, Huayi Gao, Kotaro Ishizu, Akihiro Funamizu · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
98. Striatal cell-type specific encoding stability and reorganization for goal-directed behavior and habit
    Melissa Malvaez, Alvina Liang, Baila S. Hall, Jacqueline R. Giovanniello, Natalie Paredes, Jorge A. González, Garrett J. Blair, Ana C. Sias, Michael D. Murphy, Wanyi Guo et al. · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
99. Goal-Directed Control in Schizophrenia: Loss-Biased Engagement of the Anterior Cingulate Relates to Negative-Symptom Outcomes
    Wolfgang Omlor, Giacomo Cecere, Akhil Ratan Misra, Gao-Yang Huang, Xiaoyan Wu, Victoria Edkins, Giulio Pergola, Boris B. Quednow, Philippe N. Tobler, Philipp Homan · 2025 · medRxiv
100. The neural and psychological mechanisms of yoga and mindfulness meditation
     Tim Gard · 2015