Speed/accuracy trade-off between the habitual and the goal-directed processes

Keramati, Mehdi, Dezfouli, Amir, Piray, Payam·2011·PLoS Computational Biology

Cited by (346)

Items 101–200 of 346

  1. Are we of two minds?
    Nathaniel D. Daw · 2018 · Nature Neuroscience
  2. Subjective selection and the evolution of complex culture
    Manvir Singh · 2022 · Evolutionary Anthropology Issues News and Reviews
  3. The role of expectation in innovation evolution: Exploring hype cycles
    Yuwei Shi, John Herniman · 2022 · Technovation
  4. Reinforcement learning with Marr
    Yael Niv, Angela Langdon · 2016 · Current Opinion in Behavioral Sciences
  5. Theory Integration for Lifestyle Behavior Change in the Digital Age: An Adaptive Decision-Making Framework
    Chao Zhang, Daniël Lakens, Wijnand A. IJsselsteijn · 2021 · Journal of Medical Internet Research
  6. Planning at decision time and in the background during spatial navigation
    Giovanni Pezzulo, Francesco Donnarumma, Domenico Maisto, Ivilin Peev Stoianov · 2019 · Current Opinion in Behavioral Sciences
  7. Caching mechanisms for habit formation in Active Inference
    Domenico Maisto, Karl John Friston, Giovanni Pezzulo · 2019 · Neurocomputing
  8. Dopamine and proximity in motivation and cognitive control
    Andrew Westbrook, Michael J. Frank · 2018 · Current Opinion in Behavioral Sciences
  9. Deficient Goal-Directed Control in a Population Characterized by Extreme Goal Pursuit
    Karin Foerde, Nathaniel D. Daw, Teresa Rufin, B. Timothy Walsh, Daphna Shohamy, JOANNA E. STEINGLASS · 2020 · Journal of Cognitive Neuroscience
  10. Translatable and Back-Translatable Measurement of Impulsivity and Compulsivity: Convergent and Divergent Processes
    Valerie Voon, Jeffrey W. Dalley · 2015 · Current topics in behavioral neurosciences
  11. Context-sensitive valuation and learning
    Lindsay E. Hunter, Nathaniel D. Daw · 2021 · Current Opinion in Behavioral Sciences
  12. A rational reinterpretation of dual-process theories
    Smitha Milli, Falk Lieder, Thomas L. Griffiths · 2021 · Cognition
  13. Deliberation and Procedural Automation on a Two-Step Task for Rats
    Brendan M. Hasz, A. David Redish · 2018 · Frontiers in Integrative Neuroscience
  14. New roles for dopamine in motor skill acquisition: lessons from primates, rodents, and songbirds
    Alynda N. Wood · 2021 · Journal of Neurophysiology
  15. Robust and Rapid Air-Borne Odor Tracking without Casting
    Urvashi Bhattacharyya, Upinder S. Bhalla · 2015 · eNeuro
  16. Cyclical population dynamics of automatic versus controlled processing: An evolutionary pendulum.
    David Gertler Rand, Damon Tomlin, Adam Bear, Elliot Andrew Ludvig, Jonathan D. Cohen · 2017 · Psychological Review
  17. Retrospective model-based inference guides model-free credit assignment
    Rani Moran, Mehdi Keramati, Peter Dayan, Raymond J. Dolan · 2019 · Nature Communications
  18. Neural signatures of arbitration between Pavlovian and instrumental action selection
    Samuel Joseph Gershman, Marc Guitart‐Masip, James F. Cavanagh · 2021 · PLoS Computational Biology
  19. Nicotinic alteration of decision-making
    Naudé, Jérémie, Dongelmans, Malou, Faure, Philippe · 2015 · Neuropharmacology
  20. Plans, Habits, and Theory of Mind
    Samuel Joseph Gershman, Tobias Gerstenberg, Chris L. Baker, Fiery Andrews Cushman · 2016 · PLoS ONE
  21. Navigating complex decision spaces: Problems and paradigms in sequential choice.
    Matthew M. Walsh, John R. Anderson · 2013 · Psychological Bulletin
  22. Perception, Action, and Utility: The Tangled Skein
    Samuel Joseph Gershman, Nathaniel D. Daw · 2012 · The MIT Press eBooks
  23. Realigning Models of Habitual and Goal-Directed Decision-Making
    Kevin J. Miller, Elliot Andrew Ludvig, Giovanni Pezzulo, Amitai Shenhav · 2018 · Elsevier eBooks
  24. Model-based spatial navigation in the hippocampus-ventral striatum circuit: A computational analysis
    Ivilin Peev Stoianov, Cyriel M. A. Pennartz, Carien S. Lansink, Giovanni Pezzulo · 2018 · PLoS Computational Biology
  25. Hippocampal replays under the scrutiny of reinforcement learning models
    Romain D. Cazé, Mehdi Khamassi, Lise Aubin, Benoît Girard · 2018 · Journal of Neurophysiology
  26. Making assessments while taking repeated risks: A pattern of multiple response pathways.
    Timothy Joseph Pleskac, Avishai Wershbale · 2012 · Journal of Experimental Psychology General
  27. Uncertainty alters the balance between incremental learning and episodic memory
    Jonathan Nicholas, Nathaniel D. Daw, Daphna Shohamy A · 2022 · eLife
  28. A Formal Valuation Framework for Emotions and Their Control
    Quentin J. M. Huys, Daniel Renz · 2017 · Biological Psychiatry
  29. Leveraging cognitive neuroscience for making and breaking real-world habits
    Buabang, Eike K., Donegan, Kelly R., Rafei, Parnian, Gillan, Claire M. · 2025 · Trends in Cognitive Sciences
  30. Bounded Rational Decision-Making from Elementary Computations That Reduce Uncertainty
    Sebastian Gottwald, Daniel A. Braun · 2019 · Entropy
  31. Combined model-free and model-sensitive reinforcement learning in non-human primates
    Bruno Miranda, W. M. Nishantha Malalasekera, Timothy E.J. Behrens, Peter Dayan, Steven Wayne Kennerley · 2020 · PLoS Computational Biology
  32. Strategy selection as rational metareasoning
    Falk Lieder, Thomas L. Griffiths · 2016
  33. Interactive Development of Adaptive Learning and Memory
    Catherine A. Hartley, Kate Nussenbaum, Alexandra O. Cohen · 2021 · Annual Review of Developmental Psychology
  34. Optimizing the depth and the direction of prospective planning using information values
    Can Eren Sezener, Amir Dezfouli, Mehdi Keramati · 2019 · PLoS Computational Biology
  35. Mouse tracking reveals structure knowledge in the absence of model-based choice
    Arkady Konovalov, Ian M. Krajbich · 2020 · Nature Communications
  36. Habitual Preference for the Nondrug Reward in a Drug Choice Setting
    Youna Vandaele, Karine Guillem, Serge H. Ahmed · 2020 · Frontiers in Behavioral Neuroscience
  37. Physiological and behavioral signatures of reflective exploratory choice
    A. Ross Otto, W. Bradley Knox, Arthur B. Markman, Bradley C. Love · 2014 · Cognitive Affective & Behavioral Neuroscience
  38. Balancing control: A Bayesian interpretation of habitual and goal-directed behavior
    Sarah Schwöbel, Dimitrije Marković, Michael N. Smolka, Stefan J. Kiebel · 2020 · Journal of Mathematical Psychology
  39. Bayesian controller fusion: Leveraging control priors in deep reinforcement learning for robotics
    Krishan Rana, Vibhavari Dasagi, Jesse Haviland, Ben Talbot, Michael John Milford, Niko Sünderhauf · 2023 · The International Journal of Robotics Research
  40. The Computational Complexity of Valuation and Motivational Forces in Decision-Making Processes
    A. David Redish, Nathan W. Schultheiss, Evan C. Carter · 2015 · Current topics in behavioral neurosciences
  41. Neural evidence for the successor representation in choice evaluation
    Evan M. Russek, Ida Momennejad, Matthew Botvinick, Samuel Joseph Gershman, Nathaniel D. Daw · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
  42. Neurophysiological mechanisms underlying affiliative social behavior: Insights from comparative research
    Brenda M. Stoesz, James F. Hare, Wanda M. Snow · 2012 · Neuroscience & Biobehavioral Reviews
  43. Addiction beyond pharmacological effects: The role of environment complexity and bounded rationality
    Dimitri Ognibene, Vincenzo G. Fiore, Xiaosi Gu · 2019 · Neural Networks
  44. Bayesian Cue Integration as a Developmental Outcome of Reward Mediated Learning
    Thomas H. Weisswange, Constantin A. Rothkopf, Tobias Rodemann, Jochen Triesch · 2011 · PLoS ONE
  45. Mixing memory and desire: How memory reactivation supports deliberative decision‐making
    Shaoming Wang, Samuel Franklin Feng, Aaron M. Bornstein · 2021 · Wiley Interdisciplinary Reviews Cognitive Science
  46. Reinforcer predictability and stimulus salience promote discriminated habit learning.
    Eric A. Thrailkill, Noelle L. Michaud, Mark E. Bouton · 2021 · Journal of Experimental Psychology Animal Learning and Cognition
  47. Childhood unpredictability, life history, and intuitive versus deliberate cognitive styles
    Xinrui Wang, Nan Zhu, Lei Chang · 2021 · Personality and Individual Differences
  48. The Psychological and Physiological Mechanisms of Habit Formation
    Nura W. Lingawi, Amir Dezfouli, Bernard W. Balleine · 2016 · Wiley eBooks
  49. Human subjects exploit a cognitive map for credit assignment
    Rani Moran, Peter Dayan, Raymond J. Dolan · 2021 · Proceedings of the National Academy of Sciences
  50. Distinct value computations support rapid sequential decisions
    Andrew Mah, Shannon Sandra Schiereck, Veronica Bossio, Christine M. Constantinople · 2023 · Nature Communications
  51. A Unified Theoretical Framework for Cognitive Sequencing
    Tejas Savalia, Anuj Kumar Shukla, Raju Surampudi Bapi · 2016 · Frontiers in Psychology
  52. Goats show higher behavioural flexibility than sheep in a spatial detour task
    Camille M. C. Raoult, Britta Osthaus, A. C. G. Hildebrand, Alan G. McElligott, Christian Nawroth · 2021 · Royal Society Open Science
  53. Learning and forgetting using reinforced Bayesian change detection
    Vincent Moens, Alexandre Zénon · 2019 · PLoS Computational Biology
  54. Anterior cingulate cortex represents action-state predictions and causally mediates model-based reinforcement learning in a two-step decision task
    Thomas E. Akam, Ines Rodrigues-Vaz, Ivo Marcelo, Xiangyu Zhang, Michael Pereira, Rodrigo Freire Oliveira, Peter Dayan, Rui M. Costa · 2017 · bioRxiv (Cold Spring Harbor Laboratory)
  55. Effort, success, and side of lesion determine arm choice in individuals with chronic stroke
    Sujin Kim, Cheol E. Han, Bokkyu Kim, Carolee Joyce Winstein, Nicolas Schweighofer · 2021 · Journal of Neurophysiology
  56. The Development of Goal-Directed Decision-Making
    Hillary A. Raab, Catherine A. Hartley · 2018 · Elsevier eBooks
  57. Succumb to habit: Behavioral evidence for overreliance on habit learning in Internet addicts
    Bingping Zhou, Wei Wang, Wei Zhang, Ye Li, Jia Nie · 2018 · Computers in Human Behavior
  58. Environmental statistics and the trade-off between model-based and TD learning in humans
    Dylan Alexander Simon, Nathaniel D. Daw · 2011 · neural information processing systems
  59. Design of a Control Architecture for Habit Learning in Robots
    Erwan Renaudo, Benoît Girard, Raja Chatila, Mehdi Khamassi · 2014 · Lecture notes in computer science
  60. Enhancing metacognitive reinforcement learning using reward structures and feedback
    Paul M. Krueger, Falk Lieder, Thomas L. Griffiths · 2021
  61. Potential roles of the rodent medial prefrontal cortex in conflict resolution between multiple decision-making systems
    Amber E. McLaughlin, Geoffrey W. Diehl, A. David Redish · 2020 · International review of neurobiology
  62. Risk aversion in the adjustment of speed-accuracy tradeoff depending on time constraints
    Ryoji Onagawa, Masahiro Shinya, Keiji Ota, Kazutoshi Kudo · 2019 · Scientific Reports
  63. Reward-Based Learning, Model-Based and Model-Free
    Quentin J. M. Huys, Anthony Cruickshank, Peggy Seriès · 2014 · Encyclopedia of Computational Neuroscience
  64. Linear reinforcement learning: Flexible reuse of computation in planning, grid fields, and cognitive control
    Payam Piray, Nathaniel D. Daw · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
  65. Skill Learning by Autonomous Robotic Playing Using Active Learning and Exploratory Behavior Composition
    Simon Hangl, Vedran Dunjko, Hans J. Briegel, Justus Piater · 2020 · Frontiers in Robotics and AI
  66. Interactions of spatial strategies producing generalization gradient and blocking: A computational approach
    Laurent Dollé, Ricardo Chavarriaga, Agnès Guillot, Mehdi Khamassi · 2018 · PLoS Computational Biology
  67. A Neural Mechanism for the Opportunity Cost of Time
    Sara Madureira Constantino, Jessica Dalrymple, Rebecca Gilbert, Sara Varanese, Alessandro Di Rocco, Nathaniel D. Daw · 2017 · bioRxiv (Cold Spring Harbor Laboratory)
  68. Toward a formal theory of proactivity
    Falk Lieder, Gabriela Iwama · 2021 · Cognitive Affective & Behavioral Neuroscience
  69. Executive Function Assigns Value to Novel Goal-Congruent Outcomes
    Samuel D. McDougle, Ian C. Ballard, Beth Baribault, Sonia J. Bishop, Anne Gabrielle Eva Collins · 2021 · Cerebral Cortex
  70. Respective Advantages and Disadvantages of Model-based and Model-free Reinforcement Learning in a Robotics Neuro-inspired Cognitive Architecture
    Erwan Renaudo, Benoît Girard, Raja Chatila, Mehdi Khamassi · 2015 · Procedia Computer Science
  71. Interrupting behaviour: Minimizing decision costs via temporal commitment and low-level interrupts
    Kevin Lloyd, Peter Dayan · 2018 · PLoS Computational Biology
  72. Reinforcement learning approaches to hippocampus-dependent flexible spatial navigation
    Charline Tessereau, Reuben D. O’Dea, Stephen Coombes, Tobias Bast · 2021 · Brain and Neuroscience Advances
  73. Time Spent Thinking in Online Chess Reflects the Value of Computation
    Evan M. Russek, Daniel Acosta‐Kane, Bas van Opheusden, Marcelo Gomes Mattar, Thomas L. Griffiths · 2025 · Cognitive Science
  74. Quantifying Motor Task Performance by Bounded Rational Decision Theory
    Sonja Schach, Sebastian Gottwald, Daniel A. Braun · 2018 · Frontiers in Neuroscience
  75. Optimal nudging for cognitively bounded agents: A framework for modeling, predicting, and controlling the effects of choice architectures.
    Frederick Callaway, Mathew Hardy, Thomas L. Griffiths · 2023 · Psychological Review
  76. Instrumental Divergence and the Value of Control
    Prachi Mistry, Mimi Liljeholm · 2016 · Scientific Reports
  77. Goal-directed and habitual decision making under stress in gambling disorder: An fMRI study
    Tim van Timmeren, Payam Piray, Anna E. Goudriaan, Ruth Janke van Holst · 2023 · Addictive Behaviors
  78. Beta Oscillations in Monkey Striatum Encode Reward Prediction Error Signals
    Ruggero Basanisi, Kévin Marche, Etienne Combrisson, Paul Apicella, Andrea Brovelli · 2023 · Journal of Neuroscience
  79. Effects of subclinical depression on prefrontal–striatal model-based and model-free learning
    Suyeon Heo, Yoondo Sung, Sang Wan Lee · 2021 · PLoS Computational Biology
  80. Studying the wound healing property of biologically and chemically synthesized gold nanoparticles through scratch assay and neural network modeling
    Anjana S. Desai, Aparna Ashok, Shivali Amit Wagle, Neeru Bhagat, Аширова Жадыра Бердимуратовна, Zhanna T. Abdrassulova, Nurshat Abdolla, Zhazira Mukazhanova, Alibek Ydyrys, Ainur Seilkhan · 2025 · Advanced Composites and Hybrid Materials
  81. Reducing Computational Cost During Robot Navigation and Human–Robot Interaction with a Human-Inspired Reinforcement Learning Architecture
    Rémi Dromnelle, Erwan Renaudo, Mohamed Chétouani, Petros A. Maragos, Raja Chatila, Benoît Girard, Mehdi Khamassi · 2022 · International Journal of Social Robotics
  82. Drunk decisions: Alcohol shifts choice from habitual towards goal-directed control in adolescent intermediate-risk drinkers
    Elisabeth Obst, Daniel J. Schad, Quentin J. M. Huys, Miriam Sebold, Stephan Nebe, Christian Sommer, Michael N. Smolka, Ulrich S Zimmermann · 2018 · Journal of Psychopharmacology
  83. Rational metareasoning and the plasticity of cognitive control
    Falk Lieder, Amitai Shenhav, Sebastian Musslick, Thomas L. Griffiths · 2017
  84. Neural autopilot and context-sensitivity of habits
    Colin F. Camerer, Xiaomin Li · 2021 · Current Opinion in Behavioral Sciences
  85. Skill Learning by Autonomous Robotic Playing using Active Learning and Creativity
    Simon Hangl, Vedran Dunjko, Hans J. Briegel, Justus Piater · 2017 · arXiv (Cornell University)
  86. α-Synuclein Selectively Impairs Motor Sequence Learning and Value Sensitivity: Reversal by the Adenosine A2A Receptor Antagonists
    Yan He, Linshan Huang, Ke Wang, Xinran Pan, Qionghui Cai, Feiyang Zhang, Jingjing Yang, Gengjing Fang, Xinyue Zhao, Feng You et al. · 2021 · Cerebral Cortex
  87. When Does Bounded-Optimal Metareasoning Favor Few Cognitive Systems?
    Smitha Milli, Falk Lieder, Thomas L. Griffiths · 2017 · Proceedings of the AAAI Conference on Artificial Intelligence
  88. Model based planners reflect on their model-free propensities
    R. Moran, Mehdi Keramati, R. Dolan · 2021 · PLoS Comput. Biol.
  89. Lack of action monitoring as a prerequisite for habitual and chunked behavior: Behavioral and neural correlates
    Youna Vandaele, Patricia H. Janak · 2022 · iScience
  90. A neural autopilot theory of habit: Evidence from consumer purchases and social media use
    Colin F. Camerer, Yi Xin, Clarice Zhao · 2023 · Journal of the Experimental Analysis of Behavior
  91. A Bayesian Account of Generalist and Specialist Formation Under the Active Inference Framework
    Anthony G. Chen, David A. Benrimoh, Thomas Parr, Karl John Friston · 2020 · Frontiers in Artificial Intelligence
  92. Adaptive coordination of working-memory and reinforcement learning in non-human primates performing a trial-and-error problem solving task
    Guillaume D Viejo, Benoît Girard, Emmanuel Procyk, Mehdi Khamassi · 2017 · Behavioural Brain Research
  93. Instrumental Divergence and Goal-Directed Choice
    Mimi Liljeholm · 2018 · Elsevier eBooks
  94. Neurocognitive basis of model-based decision making and its metacontrol in childhood
    Claire Rosalie Smid, Keertana Ganesan, A. Thompson, Roser Cañigueral, Sebastijan Veselič, Jessica Royer, Wouter Kool, Tobias U. Hauser, Boris C. Bernhardt, Nikolaus Steinbeis · 2023 · Developmental Cognitive Neuroscience
  95. Understanding dual process cognition via the minimum description length principle
    Ted Moskovitz, Kevin J. Miller, Maneesh Sahani, Matthew Botvinick · 2024 · PLoS Computational Biology
  96. Active inference and cognitive control: Balancing deliberation and habits through precision optimization
    Riccardo Proietti, Thomas Parr, Alessia Tessari, Karl John Friston, Giovanni Pezzulo · 2025 · Physics of Life Reviews
  97. Habit formation viewed as structural change in the behavioral network
    Kota Yamada, Koji Toda · 2023 · Communications Biology
  98. Which criteria for autonomously shifting between goal-directed and habitual behaviors in robots?
    Erwan Renaudo, Benoît Girard, Raja Chatila, Mehdi Khamassi · 2015 · IEEE International Conference on Development and Learning (ICDL)
  99. Flexibility to contingency changes distinguishes habitual and goal-directed strategies in humans
    Julie J. Lee, Mehdi Keramati · 2017 · PLoS Computational Biology
  100. The Feedback-related Negativity Codes Components of Abstract Inference during Reward-based Decision-making
    Andrea M. F. Reiter, Stefan Koch, Erich Schröger, Hermann Hinrichs, Hans‐Jochen Heinze, Lorenz Deserno, Florian Schlagenhauf · 2016 · Journal of Cognitive Neuroscience