Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees

Cited by (435)

Items 101–200 of 435

1. Increased and biased deliberation in social anxiety
   Lindsay E. Hunter, Elana A. Meer, Claire M. Gillan, Ming Hsu, Nathaniel D. Daw · 2021 · Nature Human Behaviour
2. Are we of two minds?
   Nathaniel D. Daw · 2018 · Nature Neuroscience
3. Confidence resets reveal hierarchical adaptive learning in humans
   Micha Heilbron, Florent Meyniel · 2019 · PLoS Computational Biology
4. Aberrant Salience Is Related to Reduced Reinforcement Learning Signals and Elevated Dopamine Synthesis Capacity in Healthy Adults
   Rebecca Boehme, Lorenz Deserno, Tobias Gleich, Teresa Katthagen, Anne Pankow, J. Behr, Ralph Buchert, Jonathan Paul Roiser, Andreas Heinz, Florian Schlagenhauf · 2015 · Journal of Neuroscience
5. Slips of Action and Sequential Decisions: A Cross-Validation Study of Tasks Assessing Habitual and Goal-Directed Action Control
   Zsuzsika Sjoerds, Anja Dietrich, Lorenz Deserno, Sanne de Wit, Arno Villringer, Hans‐Jochen Heinze, Florian Schlagenhauf, Annette Horstmann · 2016 · Frontiers in Behavioral Neuroscience
6. Modeling the hypothalamus-pituitary-adrenal axis: A review and extension
   Hosseinichimeh, Niyousha, Rahmandad, Hazhir, Wittenborn, Andrea K. · 2015 · Mathematical Biosciences
7. Reinforcement Learning and Causal Models
   Samuel Joseph Gershman · 2017 · Oxford University Press eBooks
8. Naturalistic reinforcement learning
   Toby Wise, Kara J. Emery, Angela Radulescu · 2023 · Trends in Cognitive Sciences
9. Thyroid hormone remodels cortex to coordinate body-wide metabolism and exploration
   Daniel R. Hochbaum, Lauren Hulshof, Amanda Urke, Wengang Wang, Alexandra C. Dubinsky, Hannah C Farnsworth, Richard Hakim, Sherry Lin, Giona Kleinberg, Keiramarie Robertson et al. · 2024 · Cell
10. Adolescents exhibit reduced Pavlovian biases on instrumental learning
    Hillary A. Raab, Catherine A. Hartley · 2020 · Scientific Reports
11. Planning at decision time and in the background during spatial navigation
    Giovanni Pezzulo, Francesco Donnarumma, Domenico Maisto, Ivilin Peev Stoianov · 2019 · Current Opinion in Behavioral Sciences
12. Compositional clustering in task structure learning
    Nicholas Franklin, Michael J. Frank · 2018 · PLoS Computational Biology
13. Humans decompose tasks by trading off utility and computational cost
    Carlos G. Correa, Mark K. Ho, Frederick Callaway, Nathaniel D. Daw, Thomas L. Griffiths · 2023 · PLoS Computational Biology
14. Neurocomputational Dynamics of Sequence Learning
    Arkady Konovalov, Ian M. Krajbich · 2018 · Neuron
15. Neural correlates of weighted reward prediction error during reinforcement learning classify response to cognitive behavioral therapy in depression
    Filippo Queirazza, Elsa Florence Fouragnan, J. Douglas Steele, Jonathan Cavanagh, Marios G. Philiastides · 2019 · Science Advances
16. The computational cost of active information sampling before decision-making under uncertainty
    Pierre Petitet, Bahaaeddin Attaallah, Sanjay Manohar, Masud Husain · 2021 · Nature Human Behaviour
17. Serotonin modulates asymmetric learning from reward and punishment in healthy human volunteers
    Michely, Jochen, Eldar, Eran, Erdman, Alon, Martin, Ingrid M., Dolan, Raymond J. · 2022 · Communications Biology
18. The relationship between apathy and impulsivity in large population samples
    Pierre Petitet, Jacqueline Scholl, Bahaaeddin Attaallah, Daniel Drew, Sanjay Manohar, Masud Husain · 2021 · Scientific Reports
19. Don't Think, Just Feel the Music: Individuals with Strong Pavlovian-to-Instrumental Transfer Effects Rely Less on Model-based Reinforcement Learning
    Sebold, Miriam, Schad, Daniel J., Nebe, Stephan, Garbusow, Maria, Jünger, Elisabeth, Kroemer, Nils B., Kathmann, Norbert, Zimmermann, Ulrich S., Smolka, Michael N., Rapp, Michael A. et al. · 2016 · Journal of Cognitive Neuroscience
20. Rats exhibit similar biases in foraging and intertemporal choice tasks
    Gary A. Kane, Aaron M. Bornstein, Amitai Shenhav, Robert C. Wilson, Nathaniel D. Daw, Jonathan D. Cohen · 2019 · eLife
21. Serotonin and aversive processing in affective and social decision-making
    Molly J. Crockett, Roshan Cools · 2015 · Current Opinion in Behavioral Sciences
22. Multi-step planning in the brain
    Kevin J. Miller, Sarah Jo C Venditto · 2020 · Current Opinion in Behavioral Sciences
23. Neural signatures of arbitration between Pavlovian and instrumental action selection
    Samuel Joseph Gershman, Marc Guitart‐Masip, James F. Cavanagh · 2021 · PLoS Computational Biology
24. Cognitive effort-based decision-making in major depressive disorder
    Yuen‐Siang Ang, Steven E. Gelda, Diego A. Pizzagalli · 2022 · Psychological Medicine
25. Navigating complex decision spaces: Problems and paradigms in sequential choice.
    Matthew M. Walsh, John R. Anderson · 2013 · Psychological Bulletin
26. Don’t Let Me Do That! – Models of Precommitment
    Zeb L. Kurth-Nelson, A. David Redish · 2012 · Frontiers in Neuroscience
27. Nested positive feedback loops in the maintenance of major depression: An integration and extension of previous models
    Ryan S. Smith, Anna Alkozei, William D. S. Killgore, Richard D. Lane · 2017 · Brain Behavior and Immunity
28. Realigning Models of Habitual and Goal-Directed Decision-Making
    Kevin J. Miller, Elliot Andrew Ludvig, Giovanni Pezzulo, Amitai Shenhav · 2018 · Elsevier eBooks
29. Uncertainty alters the balance between incremental learning and episodic memory
    Jonathan Nicholas, Nathaniel D. Daw, Daphna Shohamy · 2022 · eLife
30. Prospective Optimization with Limited Resources
    Joseph Snider, Dongpyo Lee, Howard Poizner A, Sergei Gepshtein · 2015 · PLoS Computational Biology
31. Sleep homeostasis, habits and habituation
    Vladyslav V. Vyazovskiy, Mark E. Walton, Stuart N. Peirson, David M. Bannerman · 2017 · Current Opinion in Neurobiology
32. Psychiatric Neural Networks and Precision Therapeutics by Machine Learning
    Hidetoshi Komatsu, Emi Watanabe, Mamoru Fukuchi · 2021 · Biomedicines
33. A Formal Valuation Framework for Emotions and Their Control
    Quentin J. M. Huys, Daniel Renz · 2017 · Biological Psychiatry
34. Cognitive prostheses for goal achievement
    Lieder, Falk, Chen, Owen X., Krueger, Paul M., Griffiths, Thomas L. · 2019 · Nature Human Behaviour
35. The affective gradient hypothesis: An affect-centered account of motivated behavior
    Amitai Shenhav · 2024 · Trends in Cognitive Sciences
36. Cognitive maps and novel inferences: a flexibility hierarchy
    Erie D. Boorman, Sarah C. Sweigart, Seongmin A. Park · 2021 · Current Opinion in Behavioral Sciences
37. Rational arbitration between statistics and rules in human sequence processing
    Maxime Maheu, Florent Meyniel, Stanislas Dehaene · 2022 · Nature Human Behaviour
38. Reward maximization through discrete active inference
    Da Costa, Lancelot, Sajid, Noor, Parr, Thomas, Friston, Karl, Smith, Ryan · 2023 · Neural Computation
39. Revealing the impact of expertise on human planning with a two-player board game
    Bas van Opheusden, Gianni Galbiati, Ionatan Kuperwajs, Zahy Bnaya, Yunqi li, Wei Ji Ma · 2021 · PsyArXiv (OSF Preprints)
40. A Computational Analysis of Aberrant Delay Discounting in Psychiatric Disorders
    Giles W. Story, Michael Moutoussis, Raymond J. Dolan · 2016 · Frontiers in Psychology
41. Threat of shock and aversive inhibition: Induced anxiety modulates Pavlovian-instrumental interactions.
    Anahit Mkrtchian, Jonathan Paul Roiser, Oliver Joe Robinson · 2017 · Journal of Experimental Psychology General
42. Tasks for aligning human and machine planning
    Bas van Opheusden, Wei Ji Ma · 2019 · Current Opinion in Behavioral Sciences
43. Transcranial Direct Current Stimulation of Right Dorsolateral Prefrontal Cortex Does Not Affect Model-Based or Model-Free Reinforcement Learning in Humans
    Peter Smittenaar, George Prichard, Thomas H. B. FitzGerald, Jörn Diedrichsen, Raymond J. Dolan · 2014 · PLoS ONE
44. Search for solutions, learning, simulation, and choice processes in suicidal behavior
    Alexandre Y. Dombrovski, Michael N. Hallquist · 2021 · Wiley Interdisciplinary Reviews Cognitive Science
45. Oversampled and undersolved: Depressive rumination from an active inference perspective
    Max Berg, Matthias Feldmann, Lukas Kirchner, Tobias Κube · 2022 · Neuroscience & Biobehavioral Reviews
46. A computational neuroscience perspective on subjective wellbeing within the active inference framework
    Ryan S. Smith, Lav R. Varshney, Susumu Nagayama, Masahiro Kazama, Takuya Kitagawa, Managi Shunsuke, Yoshiki Ishikawa · 2022 · International Journal of Wellbeing
47. Magnetoencephalography decoding reveals structural differences within integrative decision processes
    Eran Eldar, Gyung Jin Bae, Zeb L. Kurth-Nelson, Peter Dayan, Raymond J. Dolan · 2018 · Nature Human Behaviour
48. Optimizing the depth and the direction of prospective planning using information values
    Can Eren Sezener, Amir Dezfouli, Mehdi Keramati · 2019 · PLoS Computational Biology
49. Sophisticated Affective Inference: Simulating Anticipatory Affective Dynamics of Imagining Future Events
    Casper Hesp, Alexander Tschantz, Beren Millidge, Maxwell J. D. Ramstead, Karl John Friston, Ryan S. Smith · 2020 · Communications in computer and information science
50. Serotonergic modulation of cognitive computations
    Kenji Doya, Kayoko W. Miyazaki, Katsuhiko Miyazaki · 2021 · Current Opinion in Behavioral Sciences
51. Different brain systems support learning from received and avoided pain during human pain-avoidance learning
    Marieke Jepma, Mathieu Roy, Kiran Ramlakhan, Monique van Velzen, Albert Dahan · 2022 · eLife
52. The Neural Basis of Aversive Pavlovian Guidance during Planning
    Níall Lally, Quentin J. M. Huys, Neir Eshel, Paul Faulkner, Peter Dayan, Jonathan Paul Roiser · 2017 · Journal of Neuroscience
53. A COMMON FRAMEWORK FOR THEORIES OF NORM COMPLIANCE
    Adam Morris, Fiery Andrews Cushman · 2018 · Social Philosophy and Policy
54. Reversal learning strategy in adolescence is associated with prefrontal cortex activation
    Rebecca Boehme, Robert C. Lorenz, Tobias Gleich, Lydia Romund, Patricia Pelz, Sabrina Golde, Eva Flemming, Andrew Wold, Lorenz Deserno, Joachim Behr et al. · 2016 · European Journal of Neuroscience
55. Addiction beyond pharmacological effects: The role of environment complexity and bounded rationality
    Dimitri Ognibene, Vincenzo G. Fiore, Xiaosi Gu · 2019 · Neural Networks
56. The evolution and devolution of cognitive control: The costs of deliberation in a competitive world
    Damon Tomlin, David Gertler Rand, Elliot Andrew Ludvig, Jonathan D. Cohen · 2015 · Scientific Reports
57. Anterior cingulate cortex causally supports flexible learning under motivationally challenging and cognitively demanding conditions
    Kianoush Banaie Boroujeni, Michelle K. Sigona, Robert Louie Treuting, Thomas J. Manuel, Charles F. Caskey, Thilo Womelsdorf · 2022 · PLoS Biology
58. A social inference model of idealization and devaluation.
    Giles W. Story, Ryan S. Smith, Michael Moutoussis, Isabel M. Berwian, Tobias Nolte, Edda Bilek, Jenifer Z. Siegel, Raymond J. Dolan · 2023 · Psychological Review
59. Rationalizable Irrationalities of Choice
    Peter Dayan · 2014 · Topics in Cognitive Science
60. Models of neuromodulation for computational psychiatry
    Sandra Iglesias, Sara Tomiello, Maya Schneebeli, Klaas Enno Stephan · 2016 · Wiley Interdisciplinary Reviews Cognitive Science
61. A model-based analysis of impulsivity using a slot-machine gambling paradigm
    Saee Paliwal, Frederike H. Petzschner, Anna Katharina Schmitz, Marc Tittgemeyer, Klaas Enno Stephan · 2014 · Frontiers in Human Neuroscience
62. Modernizing Conceptions of Valuation and Cognitive-Control Deployment in Adolescent Risk Taking
    Kathy T. Do, Paul B. Sharp, Eva H. Telzer · 2019 · Current Directions in Psychological Science
63. Risk Factors for Addiction and Their Association with Model-Based Behavioral Control
    Andrea M. F. Reiter, Lorenz Deserno, Tilmann Wilbertz, Hans‐Jochen Heinze, Florian Schlagenhauf · 2016 · Frontiers in Behavioral Neuroscience
64. Mouselab-MDP: A new paradigm for tracing how people plan
    Frederick Callaway, Falk Lieder, Paul M. Krueger, Thomas L. Griffiths · 2017
65. Hybrid social learning in human-algorithm cultural transmission
    Brinkmann, L., Gezerli, D., Kleist, K. V., Müller, T. F., Rahwan, I., Pescetelli, N. · 2022 · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
66. Cost Evaluation During Decision-Making in Patients at Early Stages of Psychosis
    Anna O. Ermakova, Nimrod Gileadi, Franziska Knolle, Azucena Justicia, Rachel Joy Anderson, Paul Charles Fletcher, Michael Moutoussis, Graham K. Murray · 2018 · Computational Psychiatry
67. A computational model for decision tree search.
    Bas van Opheusden, Gianni Galbiati, Zahy Bnaya, Yunqi Li, Wei Ji Ma · 2017 · Cognitive Science
68. Intermittent Absence of Control during Reinforcement Learning Interferes with Pavlovian Bias in Action Selection
    Gábor Csifcsák, Eirik Melsæter, Matthias Mittner · 2019 · Journal of Cognitive Neuroscience
69. Anterior cingulate cortex represents action-state predictions and causally mediates model-based reinforcement learning in a two-step decision task
    Thomas Akam, Ines Rodrigues-Vaz, Ivo Marcelo, Xiangyu Zhang, Michael Pereira, Rodrigo Freire Oliveira, Peter Dayan, Rui M. Costa · 2017 · bioRxiv (Cold Spring Harbor Laboratory)
70. Artificial Motivation for Cognitive Software Agents
    Ryan J. McCall, Stan Franklin, Usef Faghihi, Javier Snaider, Sean Kugele · 2020 · Journal of Artificial General Intelligence
71. Control over patch encounters changes foraging behavior
    Sam Hall-McMaster, Peter Dayan, Nicolas W. Schuck · 2021 · iScience
72. The Neuroscience of Suicidal Behavior
    Kees van Heeringen · 2018 · Cambridge University Press eBooks
73. A Computational View on the Nature of Reward and Value in Anhedonia
    Quentin J. M. Huys, Michael D Browning · 2021 · Current topics in behavioral neurosciences
74. Design of a Control Architecture for Habit Learning in Robots
    Erwan Renaudo, Benoît Girard, Raja Chatila, Mehdi Khamassi · 2014 · Lecture notes in computer science
75. Reward-Based Learning, Model-Based and Model-Free
    Quentin J. M. Huys, Anthony Cruickshank, Peggy Seriès · 2014 · Springer eBooks
76. Patient-specific modeling of the neuroendocrine HPA-axis and its relation to depression: ultradian and circadian oscillations
    Gudmand-Hoeyer, Johanne, Timmermann, Stine, Ottesen, Johnny T. · 2014 · Mathematical Biosciences
77. Timing along the cardiac cycle modulates neural signals of reward-based learning
    Elsa Florence Fouragnan, Billy Hosking, Yin Bun Cheung, Brooke A. Prakash, Matthew F. S. Rushworth, Alejandra Sel · 2024 · Nature Communications
78. Computational models as statistical tools
    Daniel Durstewitz, Georgia Koppe, Hazem Toutounji · 2016 · Current Opinion in Behavioral Sciences
79. Decision prioritization and causal reasoning in decision hierarchies
    Ariel Zylberberg · 2021 · PLoS Computational Biology
80. Humans account for cognitive costs when finding shortcuts: An information-theoretic analysis of navigation
    Gian Luca Lancia, Mattia Eluchans, Marco D’Alessandro, Hugo J. Spiers, Giovanni Pezzulo · 2023 · PLoS Computational Biology
81. Diminished reinforcement sensitivity in adolescence is associated with enhanced response switching and reduced coding of choice probability in the medial frontal pole
    Maria Waltmann, Nadine Herzog, Andrea M. F. Reiter, Arno Villringer, Annette Horstmann, Lorenz Deserno · 2023 · Developmental Cognitive Neuroscience
82. Using deep neural networks as a guide for modeling human planning
    Ionatan Kuperwajs, Heiko H. Schütt, Wei Ji Ma · 2023 · Scientific Reports
83. Respective Advantages and Disadvantages of Model-based and Model-free Reinforcement Learning in a Robotics Neuro-inspired Cognitive Architecture
    Erwan Renaudo, Benoît Girard, Raja Chatila, Mehdi Khamassi · 2015 · Procedia Computer Science
84. Strategies for selecting and evaluating information
    Alice Liefgreen, Toby D. Pilditch, David Albert Lagnado · 2020 · Cognitive Psychology
85. Time Spent Thinking in Online Chess Reflects the Value of Computation
    Evan M. Russek, Daniel Acosta‐Kane, Bas van Opheusden, Marcelo Gomes Mattar, Thomas L. Griffiths · 2025 · Cognitive Science
86. Mechanisms Underlying Dopamine-Induced Risky Choice in Parkinson’s Disease With and Without Depression (History)
    Monique H.M. Timmer, Guillaume Sescousse, Rianne A.J. Esselink, Payam Piray, Roshan Cools · 2017 · Computational Psychiatry
87. The relationship between dynamic programming and active inference: the discrete, finite-horizon case.
    Lancelot Da Costa, Noor Sajid, Thomas Parr, Karl John Friston, Ryan S. Smith · 2020 · arXiv (Cornell University)
88. Sample size matters when estimating test–retest reliability of behaviour
    Brendan Williams, Lily FitzGibbon, Daniel Brady, Anastasia Christakou · 2025 · Behavior Research Methods
89. Social discounting of pain
    Giles W. Story, Zeb L. Kurth-Nelson, Molly J. Crockett, Ivo Vlaev, Ara Wardkes Darzi, Raymond J. Dolan · 2020 · Journal of the Experimental Analysis of Behavior
90. The effects of life stress and neural learning signals on fluid intelligence
    Eva Friedel, Florian Schlagenhauf, Anne Beck, Raymond J. Dolan, Quentin J. M. Huys, Michael A. Rapp, Andreas Heinz · 2014 · European Archives of Psychiatry and Clinical Neuroscience
91. Adaptive planning in human search
    Moritz J. F. Krusche, Eric Schulz, Arthur Guez, Maarten Speekenbrink · 2018 · bioRxiv (Cold Spring Harbor Laboratory)
92. Impulsivity and Active Inference
    Muammer Berk Mirza, Rick A. Adams, Thomas Parr, Karl John Friston · 2018 · Journal of Cognitive Neuroscience
93. A computational process-tracing method for measuring people’s planning strategies and how they change over time
    Yash Jain, Frederick Callaway, Thomas L. Griffiths, Peter Dayan, Ruiqi He, Paul M. Krueger, Falk Lieder · 2022 · Behavior Research Methods
94. Decision‐making biases in suicide attempters with major depressive disorder: A computational modeling study using the balloon analog risk task (BART)
    Qinyu Liu, Runqing Zhong, Xinlei Ji, Samuel Law, Fan Xiao, Yimin Wei, Shulin Fang, Xinyuan Kong, Xiaocui Zhang, Shuqiao Yao et al. · 2022 · Depression and Anxiety
95. Decision making under uncertain categorization
    Stephanie Y. Chen, Brian H. Ross, Gregory L. Murphy · 2014 · Frontiers in Psychology
96. Selective maintenance of value information helps resolve the exploration/exploitation dilemma
    Michael N. Hallquist, Alexandre Y. Dombrovski · 2018 · Cognition
97. Computational Mechanisms of Addiction and Anxiety: A Developmental Perspective
    Noam Goldway, Eran Eldar, Gal Shoval, Catherine A. Hartley · 2023 · Biological Psychiatry
98. Towards a neurocomputational account of social controllability: From models to mental health
    Soojung Na, Shawn A Rhoads, Alessandra Nicoletta Cruz Yu, Vincenzo G. Fiore, Xiaosi Gu · 2023 · Neuroscience & Biobehavioral Reviews
99. Drunk decisions: Alcohol shifts choice from habitual towards goal-directed control in adolescent intermediate-risk drinkers
    Elisabeth Obst, Daniel J. Schad, Quentin J. M. Huys, Miriam Sebold, Stephan Nebe, Christian Sommer, Michael N. Smolka, Ulrich S Zimmermann · 2018 · Journal of Psychopharmacology
100. Reinforcement learning: A brief guide for philosophers of mind
     Julia Haas · 2022 · Philosophy Compass