The ubiquity of model-based reinforcement learning

Cited by (380)

Items 101–200 of 380

1. Subregional specificity in human striatal habit learning: a meta-analytic review of the fMRI literature
   Tara K. Patterson, Barbara Jean Knowlton · 2017 · Current Opinion in Behavioral Sciences
2. Dopaminergic Modulation of Human Intertemporal Choice: A Diffusion Model Analysis Using the D2-Receptor Antagonist Haloperidol
   Ben Wagner, Mareike Clos, Tobias Sommer, Jan Peters · 2020 · Journal of Neuroscience
3. Neurocomputational Dynamics of Sequence Learning
   Arkady Konovalov, Ian M. Krajbich · 2018 · Neuron
4. Hippocampus Guides Adaptive Learning during Dynamic Social Interactions
   Oriel FeldmanHall, David F. Montez, Elizabeth A. Phelps, Lila Davachi, Vishnu P. Murty · 2020 · Journal of Neuroscience
5. Can People Learn about ‘Black Swans’? Experimental Evidence
   Élise Payzan-LeNestour · 2018 · Review of Financial Studies
6. Bidirectional Modulation of Substantia Nigra Activity by Motivational State
   Mark A. Rossi, David Fan, Joseph W. Barter, Henry H. Yin · 2013 · PLoS ONE
7. Dimensional psychiatry: mental disorders as dysfunctions of basic learning mechanisms
   Andreas Heinz, Florian Schlagenhauf, Anne Beck, Carolin Wackerhagen · 2016 · Journal of Neural Transmission
8. Deliberation and Procedural Automation on a Two-Step Task for Rats
   Brendan M. Hasz, A. David Redish · 2018 · Frontiers in Integrative Neuroscience
9. A Network for Computing Value Equilibrium in the Human Medial Prefrontal Cortex
   Keno Juechems, Jan Balaguer, Santiago Herce Castañón, Marı́a Ruz, Jill X. O’Reilly, Christopher Summerfield · 2019 · Neuron
10. New roles for dopamine in motor skill acquisition: lessons from primates, rodents, and songbirds
    Alynda N. Wood · 2021 · Journal of Neurophysiology
11. Choice-selective sequences dominate in cortical relative to thalamic inputs to NAc to support reinforcement learning
    Nathan F. Parker, Avinash Baidya, Julia Cox, Laura M. Haetzel, Anna Zhukovskaya, Malavika Murugan, Ben Engelhard, Mark S. Goldman, Ilana B. Witten · 2022 · Cell Reports
12. Nicotinic alteration of decision-making
    Naudé, Jérémie, Dongelmans, Malou, Faure, Philippe · 2015 · Neuropharmacology
13. A Computational Model of Dual Competition between the Basal Ganglia and the Cortex
    Meropi Topalidou, Daisuke Kase, Thomas Boraud, Nicolas P. Rougier · 2018 · eNeuro
14. Homeostatic regulation of memory systems and adaptive decisions
    Sheri J. Y. Mizumori, Yong Sang Jo · 2013 · Hippocampus
15. Human Choice Strategy Varies with Anatomical Projections from Ventromedial Prefrontal Cortex to Medial Striatum
    Payam Piray, Ivan Toni, Roshan Cools · 2016 · Journal of Neuroscience
16. How Imagination and Memory Shape the Moral Mind
    Brendan Bo O’Connor, Zoë Fowler · 2022 · Personality and Social Psychology Review
17. Implicit Value Updating Explains Transitive Inference Performance: The Betasort Model
    Greg Jensen, Fabián Muñoz, Yelda Alkan, Vincent P. Ferrera, H. S. Terrace · 2015 · PLoS Computational Biology
18. Getting to know you: general and specific neural computations for learning about people
    Damian A. Stanley · 2015 · Social Cognitive and Affective Neuroscience
19. Realigning Models of Habitual and Goal-Directed Decision-Making
    Kevin J. Miller, Elliot Andrew Ludvig, Giovanni Pezzulo, Amitai Shenhav · 2018 · Elsevier eBooks
20. A flexible and generalizable model of online latent-state learning
    Amy Louise Cochran, Josh M. Cisler · 2019 · PLoS Computational Biology
21. Manipulating the revision of reward value during the intertrial interval increases sign tracking and dopamine release
    Brian Lee, Ronny N. Gentry, Gregory B. Bissonette, Rae J. Herman, John J. Mallon, Daniel W. Bryden, Donna J. Calu, Geoffrey M. Schoenbaum, Étienne Coutureau, Alain R. Marchand et al. · 2018 · PLoS Biology
22. Sleep homeostasis, habits and habituation
    Vladyslav V. Vyazovskiy, Mark E. Walton, Stuart N. Peirson, David M. Bannerman · 2017 · Current Opinion in Neurobiology
23. Active Inference, Belief Propagation, and the Bethe Approximation
    Sarah Schwöbel, Stefan J. Kiebel, Dimitrije Marković · 2018 · Neural Computation
24. Striatal and hippocampal contributions to flexible navigation in rats and humans
    Christoffer J. Gahnstrom, Hugo J. Spiers · 2020 · Brain and Neuroscience Advances
25. Rapid Bayesian learning in the mammalian olfactory system
    Naoki Hiratani, Peter E. Latham · 2020 · Nature Communications
26. Computational approaches to schizophrenia: A perspective on negative symptoms
    Deserno, Lorenz, Heinz, Andreas, Schlagenhauf, Florian · 2017 · Schizophrenia Research
27. Stress enhances model-free reinforcement learning only after negative outcome
    Heyeon Park, Daeyeol Lee, Jeanyung Chey · 2017 · PLoS ONE
28. Spatial encoding in dorsomedial prefrontal cortex and hippocampus is related during deliberation
    Brendan M. Hasz, A. David Redish · 2020 · Hippocampus
29. The learning of prospective and retrospective cognitive maps within neural circuits
    Vijay Mohan K Namboodiri, Garret D. Stuber · 2021 · Neuron
30. Goal-Directed and Habitual Control in Human Substance Use: State of the Art and Future Directions
    Nuria Doñamayor, Claudia Ebrahimi, Viktoria Anna Arndt, Franziska Weiß, Florian Schlagenhauf, Tanja Endraß · 2022 · Neuropsychobiology
31. Viewing Adaptive Social Choice Through the Lens of Associative Learning
    Oriel FeldmanHall, Joseph E. Dunsmoor · 2018 · Perspectives on Psychological Science
32. Habit learning in hierarchical cortex–basal ganglia loops
    Javier Baladron, Fred Henrik Hamker · 2020 · European Journal of Neuroscience
33. Combined model-free and model-sensitive reinforcement learning in non-human primates
    Bruno Miranda, W. M. Nishantha Malalasekera, Timothy E.J. Behrens, Peter Dayan, Steven Wayne Kennerley · 2020 · PLoS Computational Biology
34. Quantifying aberrant approach-avoidance conflict in psychopathology: A review of computational approaches
    Allison M. Letkiewicz, Haley Colgate Kottler, Stewart A. Shankman, Amy Louise Cochran · 2023 · Neuroscience & Biobehavioral Reviews
35. Electrophysiological correlates reflect the integration of model-based and model-free decision information
    Ben Eppinger, Maik Walter, Shu Li · 2017 · Cognitive Affective & Behavioral Neuroscience
36. More rapid reversal learning following overtraining in the rat is evidence that behavioural and cognitive flexibility are dissociable
    Sandeep S. Dhawan, David S. Tait, Verity Joy Brown · 2019 · Behavioural Brain Research
37. Multiplexing signals in reinforcement learning with internal models and dopamine
    Hiroyuki Nakahara · 2014 · Current Opinion in Neurobiology
38. How instructions shape aversive learning: higher order knowledge, reversal learning, and the role of the amygdala
    Lauren Yvette Atlas · 2019 · Current Opinion in Behavioral Sciences
39. Advanced Parkinson's disease effect on goal-directed and habitual processes involved in visuomotor associative learning
    Fadila Hadj‐Bouziane, Isabelle Bénatru, Andrea Brovelli, Hélène Klinger, Stéphane Thobois, Emmanuel Broussolle, Driss Boussaoud, Martine Meunier · 2013 · Frontiers in Human Neuroscience
40. Rethinking model-based and model-free influences on mental effort and striatal prediction errors
    Carolina Feher da Silva, Gaia Lombardi, Micah G. Edelson, Todd Anthony Hare · 2023 · Nature Human Behaviour
41. Mouse tracking reveals structure knowledge in the absence of model-based choice
    Arkady Konovalov, Ian M. Krajbich · 2020 · Nature Communications
42. Concepts, Frames and Cascades in Semantics, Cognition and Ontology
    Sebastian Löbner, Thomas Gamerschlag, Tobias Kalenscher A, Markus Schrenk, Henk Zeevat · 2021 · Language, cognition and mind
43. Gambling Environment Exposure Increases Temporal Discounting but Improves Model-Based Control in Regular Slot-Machine Gamblers
    Ben Wagner, David Mathar, Jan Peters · 2022 · Computational Psychiatry
44. Learning action-oriented models through active inference
    Alexander Tschantz, Anil K. Seth, Christopher L. Buckley · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
45. Modeling learner-controlled mental model learning processes by a second-order adaptive network model
    Rajesh Bhalwankar, Jan Treur A · 2021 · PLoS ONE
46. The orbitofrontal cortex: A goal-directed cognitive map framework for social and non-social behaviors
    Weikang Shi, Olivia C. Meisner, Sylvia Blackmore, Monika P. Jadi, Anirvan S. Nandy, Steve W. C. Chang · 2023 · Neurobiology of Learning and Memory
47. Optimizing aerodynamic stability in compressible flow around a vibrating cylinder with deep reinforcement learning
    Mostafa Barzegar Gerdroodbary, Iman Shiryanpoor, Sajad Salavatidezfouli, Amir Musa Abazari, Jose Carlos Pascoa · 2024 · Physics of Fluids
48. The minority report: some common assumptions to reconsider in the modelling of the brain and behaviour
    Shimon Edelman · 2015 · Journal of Experimental & Theoretical Artificial Intelligence
49. Memory Transformation Enhances Reinforcement Learning in Dynamic Environments
    Adam Santoro, Paul W. Frankland, Blake A. Richards · 2016 · Journal of Neuroscience
50. How higher goals are constructed and collapse under stress: A hierarchical Bayesian control systems perspective
    Rutger Goekoop, Roy de Kleijn · 2021 · Neuroscience & Biobehavioral Reviews
51. Deconstructing value-based decision making via temporally selective manipulation of neural activity: Insights from rodent models
    Caitlin A. Orsini, Caesar M. Hernandez, Jennifer L. Bizon, Barry Setlow · 2018 · Cognitive Affective & Behavioral Neuroscience
52. The role of intelligence in economic decision making
    Aldo Rustichini · 2015 · Current Opinion in Behavioral Sciences
53. Distinct fronto-striatal couplings reveal the double-faced nature of response–outcome relations in instruction-based learning
    Hannes Ruge, Uta Wolfensteller · 2014 · Cognitive Affective & Behavioral Neuroscience
54. Learning and forgetting using reinforced Bayesian change detection
    Vincent Moens, Alexandre Zénon · 2019 · PLoS Computational Biology
55. Procedural learning during declarative control.
    Matthew J. Crossley, F. Gregory Ashby · 2015 · Journal of Experimental Psychology Learning Memory and Cognition
56. Inference as a fundamental process in behavior
    Ramón Bartolo, Bruno B. Averbeck · 2020 · Current Opinion in Behavioral Sciences
57. Computational Models for Affect Dynamics
    Niels Vanhasbroeck, Sigert Ariens, Francis Tuerlinckx, Tim Loossens · 2021 · Springer eBooks
58. The Neural Bases of Action-Outcome Learning in Humans
    Richard W. Morris, Amir Dezfouli, Kristi R. Griffiths, Mike E. Le Pelley, Bernard W. Balleine · 2022 · Journal of Neuroscience
59. The Development of Goal-Directed Decision-Making
    Hillary A. Raab, Catherine A. Hartley · 2018 · Elsevier eBooks
60. Modeling the development of internal mental models by an adaptive network model
    Rajesh Bhalwankar, Jan Treur A · 2021 · Procedia Computer Science
61. Enhancing models of social and strategic decision making with process tracing and neural data
    Arkady Konovalov, Christian Carl Ruff · 2021 · Wiley Interdisciplinary Reviews Cognitive Science
62. Learning to Predict Without Looking Ahead: World Models Without Forward Prediction
    C. Daniel Freeman, Luke Metz, David Ha · 2019 · arXiv (Cornell University)
63. Human Motives
    Peter Carruthers · 2024
64. Task assignment for hybrid scenarios in spatial crowdsourcing: A Q-Learning-based approach
    Mingze Wang, Yingjie Wang, Akshita Maradapu Vera Venkata Sai, Zhaowei Liu, Yang Gao, Xiangrong Tong, Zhipeng Cai · 2022 · Applied Soft Computing
65. Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum
    Shingo Tanaka, Xiaochuan Pan, Mineki Oguchi, Jessica Elizabeth Taylor, Masamichi Sakagami · 2015 · Frontiers in Psychology
66. Evaluation of linearly solvable Markov decision process with dynamic model learning in a mobile robot navigation task
    Ken Kinjo, Eiji Uchibe, Kenji Doya · 2013 · Frontiers in Neurorobotics
67. Executive Function Assigns Value to Novel Goal-Congruent Outcomes
    Samuel D. McDougle, Ian C. Ballard, Beth Baribault, Sonia J. Bishop, Anne Gabrielle Eva Collins · 2021 · Cerebral Cortex
68. Of goals and habits
    Nathaniel D. Daw · 2015 · Proceedings of the National Academy of Sciences
69. No Central Executive? Decision Formation Through Multi-Area Population Dynamics
    Chandramouli Chandrasekaran, Diksha Gupta, Mitra Javadzadeh, Tian Wang, Miguel Vivar-Lazo, Tatiana A. Engel, Paul Cisek, Christopher R. Fetsch · 2025 · Journal of Neuroscience
70. The catecholamine precursor Tyrosine reduces autonomic arousal and decreases decision thresholds in reinforcement learning and temporal discounting
    David Mathar, Mani Erfanian Abdoust, Tobias Marrenbach, Deniz Tuzsus, Jan Peters · 2022 · PLoS Computational Biology
71. Reinforcement Learning Under Uncertainty: Expected Versus Unexpected Uncertainty and State Versus Reward Uncertainty
    Adnane Ez‐zizi, Simon Farrell, David S. Leslie, Gaurav Malhotra, Casimir J. H. Ludwig · 2023 · Computational Brain & Behavior
72. Optimal timing
    David M. Freestone, Russell M. Church · 2016 · Current Opinion in Behavioral Sciences
73. Orbitofrontal cortex populations are differentially recruited to support actions
    Christian Cazares, Drew C. Schreiner, Mariela Lopez Valencia, Christina M. Gremel · 2022 · Current Biology
74. Part-Time Bayesians: Incentives and Behavioral Heterogeneity in Belief Updating
    Carlos Alós‐Ferrer, Michele Garagnani · 2023 · Management Science
75. Hierarchical control over foraging behavior by anterior cingulate cortex
    Ricardo J. Alejandro, Clay B. Holroyd · 2024 · Neuroscience & Biobehavioral Reviews
76. Learning and memory processes in behavioural addiction: A systematic review
    Ronald Kipkirui Ngetich, Cristina Villalba-García, Yanisha Soborun, Teodóra Vékony, Andrea Czakó, Zsolt Demetrovics, Dezső Németh · 2024 · Neuroscience & Biobehavioral Reviews
77. Complex behavior from intrinsic motivation to occupy future action-state path space
    Jorge Ram'irez-Ruiz, D. Grytskyy, Chiara Mastrogiuseppe, Yamen Habib, Rubén Moreno-Bote · 2022 · Nature Communications
78. A sequence bottleneck for animal intelligence and language?
    Johan Lind, Anna Jon-And · 2024 · Trends in Cognitive Sciences
79. Developmental differences in the neural dynamics of observational learning
    Julia M. Rodriguez Buritica, Hauke R. Heekeren, Shu Li, Ben Eppinger · 2018 · Neuropsychologia
80. Chasing probabilities — Signaling negative and positive prediction errors across domains
    David Meder, Kristoffer Hougaard Madsen, Oliver J. Hulme, Hartwig Roman Siebner · 2016 · NeuroImage
81. Neural Mechanisms of Human Decision-Making
    Seth A. Herd, Kai A. Krueger, Ananta Nair, J. Mollick, R. O'Reilly · 2019 · Cognitive, Affective, & Behavioral Neuroscience
82. Instructions and experiential learning have similar impacts on pain and pain-related brain responses but produce dissociations in value-based reversal learning
    Lauren Yvette Atlas, Troy C. Dildine, Esther E. Palacios‐Barrios, Qingbao Yu, Richard C. Reynolds, Linnea Banker, Shara S Grant, Daniel S. Pine · 2022 · eLife
83. Reversal Learning in Humans and Gerbils: Dynamic Control Network Facilitates Learning
    Christian Jarvers, Tobias Brosch, André Brechmann, Marie L. Woldeit, Andreas L. Schulz, Frank W. Ohl, Marcel Lommerzheim, Heiko Neumann B · 2016 · Frontiers in Neuroscience
84. Lesions of ventrolateral striatum eliminate lose-shift but not win-stay behaviour in rats
    Rajat Thapa, Aaron J. Gruber · 2018 · Neurobiology of Learning and Memory
85. Deep imagination is a close to optimal policy for planning in large decision trees under limited resources
    Chiara Mastrogiuseppe, Rubén Moreno‐Bote · 2022 · Scientific Reports
86. Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference
    Lorenz Deserno, Rani Moran, Jochen Michely, Ying Lee, Peter Dayan, Raymond J. Dolan · 2021 · eLife
87. Searching far away from the lamp-post: An agent-based model
    Oana Vuculescu · 2016 · Strategic Organization
88. Embodied Decisions and the Predictive Brain
    Christopher Burr · 2017 · PhilPapers (PhilPapers Foundation)
89. A Second-Order Adaptive Network Model for Learner-Controlled Mental Model Learning Processes
    Rajesh Bhalwankar, Jan Treur A · 2021 · Studies in computational intelligence
90. Towards machines that understand people
    Andrew Howes, Jussi Jokinen, Antti Oulasvirta · 2023 · AI Magazine
91. The influence of internal models on feedback-related brain activity
    Franz Wurm, Benjamin Ernst, Marco Steinhauser · 2020 · Cognitive Affective & Behavioral Neuroscience
92. Multimedia Network Public Opinion Supervision Prediction Algorithm Based on Big Data
    Yangfan Tong, Wei Sun · 2020 · Complexity
93. Humans are primarily model-based learners in the two-stage task
    Carolina Feher da Silva, Todd Anthony Hare · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
94. Relevance of working memory for reinforcement learning in older adults varies with timescale of learning
    Irene van de Vijver, Romain Ligneul · 2019 · Aging Neuropsychology and Cognition
95. Brain signals of a Surprise-Actor-Critic model: Evidence for multiple learning modules in human decision making
    Vasiliki Liakoni, Marco P. Lehmann, Alireza Modirshanechi, Johanni Brea, Antoine Lutti, Wulfram Gerstner, Kerstin Preuschoff · 2021 · NeuroImage
96. Desiderata for Normative Models of Synaptic Plasticity
    Colin Bredenberg, Cristina Savin · 2024 · Neural Computation
97. Recalibrating timing behavior via expected covariance between temporal cues
    Benjamin J. De Corte, Rebecca R Della Valle, Matthew S. Matell · 2018 · eLife
98. A Computational Neuroscience Perspective on the Change Process in Psychotherapy
    Ryan P. Smith, Richard D. Lane, Lynn Nadel, Michael Moutoussis · 2020 · Oxford University Press eBooks
99. The neural network basis of altered decision‐making in patients with amyotrophic lateral sclerosis
    Kazunori Imai, Michihito Masuda, Hirohisa Watanabe, Aya Ogura, Reiko Ohdake, Yasuhiro Tanaka, Toshiyasu Kato, Kazuya Kawabata, Yuichi Riku, Kazuhiro Hara et al. · 2020 · Annals of Clinical and Translational Neurology
100. Re-Thinking the Organization of Cortico-Basal Ganglia-Thalamo-Cortical Loops
     Javier Baladron, Fred Henrik Hamker · 2023 · Cognitive Computation