Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts

Cites (450)

Items 201–400 of 450

1. When Does Model-Based Control Pay Off?
   Kool, Wouter, Cushman, Fiery A., Gershman, Samuel J. · 2016 · PLOS Computational Biology
2. Activation of Dorsal Raphe Serotonergic Neurons Promotes Waiting but Is Not Reinforcing
   Madalena S. Fonseca, Masayoshi Murakami, Zachary F. Mainen · 2015 · Current Biology
3. Computational Grounded Cognition: a new alliance between grounded cognition and computational modeling
   Giovanni Pezzulo, Lawrence W. Barsalou, Angelo Cangelosi, Martin H. Fischer, Ken McRae, Michael James Spivey · 2013 · Frontiers in Psychology
4. Terrain-adaptive locomotion skills using deep reinforcement learning
   Xue Bin Peng, Glen Berseth, Michiel van de Panne · 2016 · ACM Transactions on Graphics
5. Serial Choice Reaction-time as a Function of Response versus Signal-and-Response Repetition
   Paul Bertelson · 1965 · Nature
6. LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS
   Corrado, Greg S., Sugrue, Leo P., Seung, H. Sebastian, Newsome, William T. · 2005 · Journal of the Experimental Analysis of Behavior
7. Perseveration in behavioral neurology
   Jennifer R. Sandson, Martin L. Albert · 1987 · Neurology
8. Global perspectives on the ecology of human-machine systems
   Alfred T. Lee · 1996 · Journal of the American Society for Information Science
9. The Mechanics of Embodiment: A Dialog on Embodiment and Computational Modeling
   Giovanni Pezzulo, Lawrence W. Barsalou, Angelo Cangelosi, Martin H. Fischer, Ken McRae, Michael James Spivey · 2011 · Frontiers in Psychology
10. Model-Based Cognitive Neuroscience Approaches to Computational Psychiatry
    Thomas V. Wiecki, Jeffrey S. Poland, Michael J. Frank · 2015 · Clinical Psychological Science
11. Conditional Computation in Neural Networks for faster models
    Emmanuel Bengio, Pierre‐Luc Bacon, Joëlle Pineau, Doina Precup · 2015 · arXiv (Cornell University)
12. Autonomous Mechanism of Internal Choice Estimate Underlies Decision Inertia
    Rei Akaishi, Kazumasa Umeda, Asako Mitsuto Nagase, Katsuyuki Sakai · 2013 · Neuron
13. Exploring the consequences of the previous trial
    Jillian H. Fecteau, Douglas P. Munoz · 2003 · Nature reviews. Neuroscience
14. The algorithmic architecture of exploration in the human brain
    Eric Schulz, Samuel Joseph Gershman · 2018 · Current Opinion in Neurobiology
15. Adaptable history biases in human perceptual decisions
    Arman Abrahamyan, Laura Luz Silva, Steven C. Dakin, Matteo Carandini, Justin L. Gardner · 2016 · Proceedings of the National Academy of Sciences
16. Modification of the Backlin-Kirk Combustion Chamber for Micro-Determination of Carbon and Lipoids
    Wm. L. Doyle · 1933 · Science
17. An adaptive optimal controller for discrete-time Markov environments
    Witten, Ian H. · 1977 · Information and Control
18. Uncertainty and Exploration in a Restless Bandit Problem
    Maarten Speekenbrink, Emmanouil Konstantinidis · 2015 · Topics in Cognitive Science
19. The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection
    Akam, Thomas, Rodrigues-Vaz, Ines, Marcelo, Ivo, Zhang, Xiangyu, Pereira, Michael, Oliveira, Rodrigo Freire, Dayan, Peter, Costa, Rui M. · 2021 · Neuron
20. TD(λ) Converges with Probability 1
    Peter Dayan, Terrence J. Sejnowski A B · 1994 · Machine Learning
21. Dopamine and effort-based decision making
    Irma Triasih Kurniawan · 2011 · Frontiers in Neuroscience
22. Reward-based training of recurrent neural networks for cognitive and value-based tasks
    Hui Song, Guangyu Robert Yang, Xiao‐Jing Wang · 2017 · eLife
23. Resource-rational decision making
    Bhui, Rahul, Lai, Lucy, Gershman, Samuel J · 2021 · Current Opinion in Behavioral Sciences
24. Computational neuroimaging strategies for single patient predictions
    Klaas Enno Stephan, Florian Schlagenhauf, Quentin J. M. Huys, Sudhir Raman, Eduardo A. Aponte, Kay Henning Brodersen, Lionel Rigoux, Rosalyn Moran, Jean Daunizeau A, Raymond J. Dolan et al. · 2016 · NeuroImage
25. Assessing inter individual differences with task related functional neuroimaging
    Lebreton, Maël, Bavard, Sophie, Daunizeau, Jean, Palminteri, Stefano · 2019 · Nature Human Behaviour
26. Neuronal Origins of Choice Variability in Economic Decisions
    Camillo Padoa‐Schioppa · 2013 · Neuron
27. Adaptive History Biases Result from Confidence-Weighted Accumulation of past Choices
    Anke Braun, Anne E Urai, Tobias H. Donner · 2018 · Journal of Neuroscience
28. Empirical priors for reinforcement learning models
    Samuel J. Gershman · 2016 · Journal of Mathematical Psychology
29. Reading habits and line bisection: a developmental approach
    Sylvie Chokron A, Maria De Agostini · 1995 · Cognitive Brain Research
30. History-based action selection bias in posterior parietal cortex
    Eun Jung Hwang, Jeffrey E. Dahlen, Madan Mukundan, Takaki Komiyama · 2017 · Nature Communications
31. What Is the Relationship between Dopamine and Effort?
    Mark E. Walton, Sébastien Bouret · 2018 · Trends in Neurosciences
32. Value normalization in decision making: theory and evidence
    Antonio Rangel, John A. Clithero · 2012 · Current Opinion in Neurobiology
33. Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling
    Nitzan Shahar, Tobias U. Hauser, Michael Moutoussis, Rani Moran, Mehdi Keramati, Raymond J. Dolan · 2019 · PLoS Computational Biology
34. Confidence and speed in the two-category judgment
    Donald M. Johnson · 1939 · University of Michigan Library Repository
35. An information-theoretic perspective on the costs of cognition
    Alexandre Zénon, Oleg Solopchuk, Giovanni Pezzulo · 2017 · Neuropsychologia
36. Mechanisms underlying dependencies of performance on stimulus history in a two-alternative forced-choice task
    R.Y. Cho, Leigh E. Nystrom, Eric Brown, Andrew D. Jones, Todd Samuel Braver, Philip J. Holmes, J. D. COHEN · 2002 · Cognitive Affective & Behavioral Neuroscience
37. The Decision to Engage Cognitive Control Is Driven by Expected Reward-Value: Neural and Behavioral Evidence
    Matthew L. Dixon, Kalina Christoff A · 2012 · PLoS ONE
38. On the Fallacy of Imputing the Correlations Found for Groups to the Individuals or Smaller Groups Composing Them
    Edward Lee Thorndike · 1939 · The American Journal of Psychology
39. Hierarchical Bayesian inference for concurrent model fitting and comparison for group studies
    Payam Piray, Amir Dezfouli, Tom Heskes, Michael J. Frank, Nathaniel D. Daw · 2019 · PLoS Computational Biology
40. Beyond reward prediction errors: the role of dopamine in movement kinematics
    Joseph W. Barter, Suellen Li, Dongye Lu, Ryan A. Bartholomew, Mark A. Rossi, Charles T. Shoemaker, Daniel Salas-Meza, Erin Gaidis, Henry H. Yin · 2015 · Frontiers in Integrative Neuroscience
41. Learning Factored Representations in a Deep Mixture of Experts
    David Eigen, Marc’Aurelio Ranzato, Ilya Sutskever · 2013 · arXiv (Cornell University)
42. Neural and Psychological Maturation of Decision-making in Adolescence and Young Adulthood
    Anastasia Christakou, Samuel Joseph Gershman, Yael Niv, Andrew Simmons, Mick J. Brammer, Katya Rubia · 2013 · Journal of Cognitive Neuroscience
43. Inhibition of return in manual and saccadic response systems
    Kevin A. Briand, Abigail L. Larrison, Anne B. Sereno · 2000 · Perception & Psychophysics
44. Empirical Bayes Methods for Combining Likelihoods
    Bradley Efron · 1996 · Journal of the American Statistical Association
45. Between the Devil and the Deep Blue Sea: Tensions Between Scientific Judgement and Statistical Model Selection
    Danielle Navarro · 2018 · Computational Brain & Behavior
46. How hierarchical models improve point estimates of model parameters at the individual level
    Kentaro Katahira · 2016 · Journal of Mathematical Psychology
47. Reinforcement-learning in fronto-striatal circuits
    Bruno B. Averbeck, John P. O’Doherty · 2021 · Neuropsychopharmacology
48. The computational roots of positivity and confirmation biases in reinforcement learning
    Stefano Palminteri, Maël P. Lebreton · 2022 · Trends in Cognitive Sciences
49. Episodic Memory Encoding Interferes with Reward Learning and Decreases Striatal Prediction Errors
    G. Elliott Wimmer, Erin Kendall Braun, Nathaniel D. Daw, Daphna Shohamy A · 2014 · Journal of Neuroscience
50. Spontaneous alternation behavior in animals: A review
    Charles L. Richman, William N. Dember, Paul Kim · 1986 · Current Psychology
51. Brain-wide representations of prior information in mouse decision-making
    Charles Findling, Félix Hubert, Luigi Acerbi, Brandon Benson, Julius Benson, Daniel Birman, Niccolò Bonacchi, E. Kelly Buchanan, Sebastian A. Bruijns, Matteo Carandini et al. · 2025 · Nature
52. The Relative Influences of Priors and Sensory Evidence on an Oculomotor Decision Variable During Perceptual Learning
    Joshua I. Gold, Chi-Tat Law, Patrick M. Connolly, Sharath Bennur · 2008 · Journal of Neurophysiology
53. Scanning direction and line bisection: a study of normal subjects and unilateral neglect patients with opposite reading habits
    Sylvie Chokron A, Paolo Bartolomeo, Marie-Thérèse Perenin, Gérard Helft, M. Imbert · 1998 · Cognitive Brain Research
54. Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks
    Räuker, Tilman, Ho, Anson, Casper, Stephen, Hadfield-Menell, Dylan · 2023 · 2023 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML)
55. Dopaminergic modulation of the exploration/exploitation trade-off in human decision-making
    Karima Chakroun, David Mathar, Antonius Wiehler, Florian Ganzer, Jan Peters · 2020 · eLife
56. An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals
    Iigaya, Kiyohito, Fonseca, Madalena S., Murakami, Masayoshi, Mainen, Zachary F., Dayan, Peter · 2018 · Nature Communications
57. Human reinforcement learning subdivides structured action spaces by learning effector-specific values
    Gershman, Samuel J., Pesaran, Bijan, Daw, Nathaniel D. · 2009 · The Journal of Neuroscience
58. The interpretation of computational model parameters depends on the context
    Maria Katharina Eckstein, Sarah L. Master, Liyu Xia, Ronald E. Dahl, Linda Wilbrecht, Anne Gabrielle Eva Collins · 2022 · eLife
59. Choice-Induced Preference Change in the Free-Choice Paradigm: A Critical Methodological Review
    Keise Izuma, Kou Murayama · 2013 · Frontiers in Psychology
60. Individual differences in computational psychiatry: A review of current challenges
    Povilas Karvelis, Martin P. Paulus, Andreea Oliviana Diaconescu · 2023 · Neuroscience & Biobehavioral Reviews
61. Theoretically Informed Generative Models Can Advance the Psychological and Brain Sciences: Lessons from the Reliability Paradox
    Nathaniel Haines, Peter D. Kvam, Louis H. Irving, Colin Tucker Smith, Theodore P. Beauchaine, Mark A. Pitt, Woo‐Young Ahn, Brandon M. Turner · 2020
62. What do Reinforcement Learning Models Measure? Interpreting Model Parameters in Cognition and Neuroscience
    Maria Katharina Eckstein, Linda Wilbrecht, Anne Gabrielle Eva Collins · 2021 · Current Opinion in Behavioral Sciences
63. Generalization of value in reinforcement learning by humans
    Wimmer, G. Elliott, Daw, Nathaniel D., Shohamy, Daphna · 2012 · European Journal of Neuroscience
64. Extracting the dynamics of behavior in sensory decision-making experiments
    Nicholas A. Roy, Ji Hyun Bak, Athena Akrami, Carlos D. Brody, Jonathan W. Pillow · 2021 · Neuron
65. Using Bayesian hierarchical parameter estimation to assess the generalizability of cognitive models of choice
    Benjamin Scheibehenne, Thorsten Pachur · 2014 · Psychonomic Bulletin & Review
66. Differential, but not opponent, effects of l-DOPA and citalopram on action learning with reward and punishment
    Marc Guitart‐Masip, Marcos Economides, Quentin J. M. Huys, Michael J. Frank, Rumana Chowdhury, Emrah Düzel, Peter Dayan, Raymond J. Dolan · 2013 · Psychopharmacology
67. From Google Gemini to OpenAI Q* (Q-Star): A Survey on Reshaping the Generative Artificial Intelligence (AI) Research Landscape
    McIntosh, Timothy R., Susnjak, Teo, Liu, Tong, Watters, Paul, Xu, Dan, Liu, Dongwei, Halgamuge, Malka N. · 2025 · Technologies
68. Are computational models of any use to psychiatry?
    Quentin J. M. Huys, Michael Moutoussis, Jonathan H. Williams · 2011 · Neural Networks
69. Anterior Prefrontal Cortex Contributes to Action Selection through Tracking of Recent Reward Trends
    Christopher K. Kovach, Nathaniel D. Daw, David Rudrauf, Daniel Tranel, John P. O’Doherty, Ralph Adolphs · 2012 · Journal of Neuroscience
70. Adaptive properties of differential learning rates for positive and negative outcomes
    Romain D. Cazé, Matthijs A. A. van der Meer · 2013 · Biological Cybernetics
71. Competitive-Cooperative-Concurrent Reinforcement Learning with Importance Sampling
    Eiji Uchibe, Kenji Doya · 2004 · The MIT Press eBooks
72. Origin of perseveration in the trade-off between reward and complexity
    Samuel Joseph Gershman · 2020 · Cognition
73. Distinction between Externally vs. Internally Guided Decision-Making: Operational Differences, Meta-Analytical Comparisons and Their Theoretical Implications
    Takashi Nakao, Hideki Ohira, Georg Northoff · 2012 · Frontiers in Neuroscience
74. Information about action outcomes differentially affects learning from self-determined versus imposed choices
    Valérian Chambon, Héloïse Théro, Marie Vidal, Henri Vandendriessche, Patrick Haggard, Stefano Palminteri · 2020 · Nature Human Behaviour
75. A neuro-computational model of economic decisions
    Aldo Rustichini, Camillo Padoa‐Schioppa · 2015 · Journal of Neurophysiology
76. Brain Hemispheres Selectively Track the Expected Value of Contralateral Options
    Stefano Palminteri, Thomas Boraud, Gilles Lafargue, Bruno Dubois, Mathias Pessiglione · 2009 · Journal of Neuroscience
77. Taming the beast: extracting generalizable knowledge from computational models of cognition
    Matthew R. Nassar, Michael J. Frank · 2016 · Current Opinion in Behavioral Sciences
78. MCP: Learning Composable Hierarchical Control with Multiplicative Compositional Policies
    Peng, Xue Bin, Chang, Michael, Zhang, Grace, Pieter Abbeel, Sergey Levine · 2019 · arXiv (Cornell University)
79. Improving the reliability of computational analyses: Model-based planning and its relationship with compulsivity
    Vanessa M Brown, Jia-Zhou Chen, C. Gillan, R. Price · 2020 · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging
80. A Brief Survey of Variables That Influence Random-Generation
    G. S. Tune · 1964 · Perceptual and Motor Skills
81. Dopaminergic action prediction errors serve as a value-free teaching signal
    Francesca Greenstreet, Hernando Martínez Vergara, Yvonne Johansson, Sthitapranjya Pati, Laura Schwarz, Stephen C. Lenzi, Jesse P. Geerts, Matthew Wisdom, Alina Gubanova, Lars B. Rollik et al. · 2025 · Nature
82. Sequential Effects in Two-Choice Reaction Time Tasks: Decomposition and Synthesis of Mechanisms
    Juan Gao, KongFatt Wong‐Lin, Philip J. Holmes, Patrick Simen, Jonathan D. Cohen · 2009 · Neural Computation
83. The statistical structures of reinforcement learning with asymmetric value updates
    Kentaro Katahira · 2018 · Journal of Mathematical Psychology
84. Computational evidence for hierarchically structured reinforcement learning in humans
    Maria Katharina Eckstein, Anne Gabrielle Eva Collins · 2020 · Proceedings of the National Academy of Sciences
85. The relation between reinforcement learning parameters and the influence of reinforcement history on choice behavior
    Kentaro Katahira · 2015 · Journal of Mathematical Psychology
86. Motor cortex activity predicts response alternation during sensorimotor decisions
    Anna-Antonia Pape, Markus Siegel · 2016 · Nature Communications
87. Change, stability, and instability in the Pavlovian guidance of behaviour from adolescence to young adulthood
    Michael Moutoussis, Edward Thomas Bullmore, Ian Michael Goodyer, Peter Fonagy, Peter Brian Jones, Raymond J. Dolan, Peter Dayan · 2018 · PLoS Computational Biology
88. Dopamine role in learning and action inference
    Rafał Bogacz · 2020 · eLife
89. Context-dependent outcome encoding in human reinforcement learning
    Stefano Palminteri, Maël P. Lebreton · 2021 · Current Opinion in Behavioral Sciences
90. Policy compression: An information bottleneck in action selection
    Lucy Lai, S. Gershman · 2021 · The psychology of learning and motivation
91. Actor–Critic Models of Reinforcement Learning in the Basal Ganglia: From Natural to Artificial Rats
    Mehdi Khamassi, Loïc Lachèze, Benoît Girard, Alain Berthoz, Agnès Guillot · 2005 · Adaptive Behavior
92. Not that bad after all: Generation of random sequences.
    Yaakov Kareev · 1992 · Journal of Experimental Psychology Human Perception & Performance
93. The effects of hand preference and gender on finger tapping performance asymmetry by the use of an infra-red light measurement device
    Sergio L. Schmidt, Rosinda Martins Oliveira, Thomas Eichenberg Krahe, Cláudio Carneiro Filgueiras · 2000 · Neuropsychologia
94. On the ability to inhibit simple thoughts and actions: II. Stop-signal studies of repetition priming.
    Gordon D. Logan · 1985 · Journal of Experimental Psychology Learning Memory and Cognition
95. The Outcome‐Representation Learning Model: A Novel Reinforcement Learning Model of the Iowa Gambling Task
    Nathaniel Haines, Jasmin Vassileva, Woo‐Young Ahn · 2018 · Cognitive Science
96. Reinforcement Learning Interpretation Methods: A Survey
    Alnour Alharin, Thanh-Nam Doan, Mina Sartipi · 2020 · IEEE Access
97. Dynamic computational phenotyping of human cognition
    Roey Schurr, Daniel Reznik, Hanna Hillman, Rahul Bhui, Samuel Joseph Gershman · 2024 · Nature Human Behaviour
98. Computational Phenotyping: Using Models to Understand Individual Differences in Personality, Development, and Mental Illness
    Edward H. Patzelt, Catherine A. Hartley, Samuel Joseph Gershman · 2018 · Personality Neuroscience
99. Models that learn how humans learn: The case of decision-making and its disorders
    Amir Dezfouli, Kristi R. Griffiths, Fabio Tozeto Ramos, Peter Dayan, Bernard W. Balleine · 2019 · PLoS Computational Biology
100. Predicting human decisions with behavioural theories and machine learning
     Ori Plonsky, Reut Apel, Eyal Ert, Moshe Tennenholtz, David Bourgin, Joshua C. Peterson, Daniel Reichman, Thomas L. Griffiths, Stuart Russell, Even C Carter et al. · 2025 · Nature Human Behaviour
101. Sufficient reliability of the behavioral and computational readouts of a probabilistic reversal learning task
     Maria Waltmann, Florian Schlagenhauf, Lorenz Deserno · 2022 · Behavior Research Methods
102. Anatomical dissociation of intracerebral signals for reward and punishment prediction errors in humans
     Maëlle C. M. Gueguen, Alizée Lopez‐Persem, Pablo B. Billeke, J.-P. Lachaux, Sylvain Rheims, Philippe Kahane, Lorella Minotti, Olivier David A, Mathias Pessiglione, Julien Bastin · 2021 · Nature Communications
103. Why and how the brain weights contributions from a mixture of experts
     John P. O’Doherty, Sang Wan Lee, Reza Tadayonnejad, Jeffrey Cockburn, Kyo Iigaya, Caroline J. Charpentier · 2021 · Neuroscience & Biobehavioral Reviews
104. Value representations in the rodent orbitofrontal cortex drive learning, not choice
     Kevin J. Miller, Matthew Botvinick, Carlos D. Brody · 2022 · eLife
105. Credit assignment to state-independent task representations and its relationship with model-based decision making
     Nitzan Shahar, Rani Moran, Tobias U. Hauser, Rogier Kievit, Daniel McNamee, Michael Moutoussis, Raymond J. Dolan, Edward Thomas Bullmore, Raymond J. Dolan, Ian Michael Goodyer et al. · 2019 · Proceedings of the National Academy of Sciences
106. Discovering cognitive strategies with tiny recurrent neural networks
     Ji-An, Li, Benna, Marcus K., Mattar, Marcelo G. · 2025 · Nature
107. Automatic aftereffects in two-choice reaction time: A mathematical representation of some concepts.
     Eric L. L. Soetens, Michel Deboeck, Johan Hueting · 1984 · Journal of Experimental Psychology Human Perception & Performance
108. Dissociation between asymmetric value updating and perseverance in human reinforcement learning
     Michiyo Sugawara, Kentaro Katahira · 2021 · Scientific Reports
109. Using deep learning to predict human decisions and using cognitive models to explain deep learning models
     Matan Fintz, Margarita Osadchy, Uri Hertz · 2022 · Scientific Reports
110. Hand path priming in manual obstacle avoidance: Rapid decay of dorsal stream information
     Steven A. Jax, David Α. Rosenbaum · 2008 · Neuropsychologia
111. Mice exhibit stochastic and efficient action switching during probabilistic decision making
     Celia C. Beron, Shay Q. Neufeld, Scott W. Linderman, Bernardo Luis Sabatini · 2022 · Proceedings of the National Academy of Sciences
112. Pavlovian Control of Escape and Avoidance
     Alexander J. Millner, Samuel Joseph Gershman, Matthew K. Nock, Hanneke E.M. den Ouden · 2017 · Journal of Cognitive Neuroscience
113. Between the devil and the deep blue sea: Tensions between scientific judgement and statistical model selection
     Danielle Navarro · 2018
114. Automatic aftereffects in two-choice reaction time: A mathematical representation of some concepts.
     Eric L. L. Soetens, Michel Deboeck, Johan Hueting · 1984 · Journal of Experimental Psychology Human Perception & Performance
115. Tonic exploration governs both flexibility and lapses
     R. Becket Ebitz, Brianna J. Sleezer, Hank Peter Jedema, Charles W. Bradberry, Benjamin Y. Hayden · 2019 · PLoS Computational Biology
116. A Normative Account of Confirmation Bias During Reinforcement Learning
     Germain Lefebvre, Christopher Summerfield, Rafał Bogacz · 2021 · Neural Computation
117. Movement-Specific Repetition Suppression in Ventral and Dorsal Premotor Cortex during Action Observation
     Jasminka Majdandžić, Harold Bekkering A, Hein Thomas van Schie, Ivan Toni · 2009 · Cerebral Cortex
118. A modular neural-network model of the basal ganglia’s role in learning and selecting motor behaviours
     Gianluca Baldassarre · 2002 · Cognitive Systems Research
119. Forgetting in Reinforcement Learning Links Sustained Dopamine Signals to Motivation
     Ayaka Kato, Kenji Morita · 2016 · PLoS Computational Biology
120. Joint modeling of reaction times and choice improves parameter identifiability in reinforcement learning models
     Ian C. Ballard, Samuel M. McClure · 2019 · Journal of Neuroscience Methods
121. Metacontrol for Adaptive Imagination-Based Optimization
     Jessica B. Hamrick, Andrew J. Ballard, Razvan Pascanu, Oriol Vinyals, Nicolas Heess, Peter Battaglia · 2017 · arXiv (Cornell University)
122. Opposite effects of choice history and evidence history resolve a paradox of sequential choice bias
     Ella Bosch, Matthias Fritsche, Benedikt Ehinger, Floris P. de Lange · 2020 · Journal of Vision
123. Repetition suppression for performed hand gestures revealed by fMRI
     Antonia F. de C. Hamilton, Scott T. Grafton · 2008 · Human Brain Mapping
124. The Convergence of TD(λ) for General λ
     Peter Dayan · 1992 · Machine Learning
125. Separating response‐execution bias from decision bias: Arguments for an additional parameter in Ratcliff's diffusion model
     Andreas Voß, Jochen Voß, Karl Christoph Klauer · 2009 · British Journal of Mathematical and Statistical Psychology
126. Striatal dopamine ramping may indicate flexible reinforcement learning with forgetting in the cortico-basal ganglia circuits
     Kenji Morita, Ayaka Kato · 2014 · Frontiers in Neural Circuits
127. Response repetition biases in human perceptual decisions are explained by activity decay in competitive attractor models
     James John Bonaiuto, Archy O. de Berker, Sven Bestmann · 2016 · eLife
128. Not that bad after all: Generation of random sequences.
     Yaakov Kareev · 1992 · Journal of Experimental Psychology Human Perception & Performance
129. The role of response bias in perceptual learning.
     Pete R. Jones, David Richard Moore, Daniel E. Shub · 2015 · Journal of Experimental Psychology Learning Memory and Cognition
130. Perseveration. Part I: A review
     Gillian Hotz, Nancy Helm‐Estabrooks · 1995 · Brain Injury
131. Process dynamics in delay discounting decisions: An attractor dynamics approach
     Stefan Scherbaum, Simon Frisch, Susanne Leiberg, Steven J. Lade, Thomas Goschke, Maja Dshemuchadse · 2016 · Judgment and Decision Making
132. Frequency of Perseveration in Normal Subjects
     Amy E. Ramage, Kathryn A. Bayles, Nancy Helm‐Estabrooks · 1999 · Brain and Language
133. Inhibition of Return Arises from Inhibition of Response Processes: An Analysis of Oscillatory Beta Activity
     Bernhard Pastötter, Simon Hanslmayr, Karl‐Heinz T. Bäuml · 2007 · Journal of Cognitive Neuroscience
134. Reliability of Decision-Making and Reinforcement Learning Computational Parameters
     Anahit Mkrtchian, Vincent Valton, Jonathan Paul Roiser · 2023 · Computational Psychiatry
135. Test–retest reliability of reinforcement learning parameters
     Jessica Vera Schaaf, Laura Weidinger, Lucas Molleman, Wouter van den Bos · 2023 · Behavior Research Methods
136. Mixtures of strategies underlie rodent behavior during reversal learning
     Nhat Minh Le, Murat Yıldırım, Yizhi Wang, 弘記 杉原, Mehrdad Jazayeri, Mriganka Sur · 2023 · PLoS Computational Biology
137. A Healthy Fear of the Unknown: Perspectives on the Interpretation of Parameter Fits from Computational Models in Neuroscience
     Matthew R. Nassar, Joshua I. Gold · 2013 · PLoS Computational Biology
138. How the Level of Reward Awareness Changes the Computational and Electrophysiological Signatures of Reinforcement Learning
     Camile Maria Costa Corrêa, Samuel Noorman, Jun Jiang, Stefano Palminteri, Michael X Cohen, Maël P. Lebreton, Simon van Gaal · 2018 · Journal of Neuroscience
139. Choice-confirmation bias and gradual perseveration in human reinforcement learning.
     Stefano Palminteri · 2022 · Behavioral Neuroscience
140. Neural signatures of arbitration between Pavlovian and instrumental action selection
     Samuel Joseph Gershman, Marc Guitart‐Masip, James F. Cavanagh · 2021 · PLoS Computational Biology
141. The Dorsomedial Striatum Reflects Response Bias during Learning
     Eyal Yaacov Kimchi, Mark Laubach · 2009 · Journal of Neuroscience
142. The relative merit of empirical priors in non-identifiable and sloppy models: Applications to models of learning and decision-making
     Mikhail S. Spektor, David Kellen · 2018 · Psychonomic Bulletin & Review
143. A neural network walks into a lab: towards using deep nets as models for human behavior
     Wei Ji Ma, Benjamin Peters · 2020 · arXiv (Cornell University)
144. A Proof of the Law of Effect
     Edward Lee Thorndike · 1933 · Science
145. The limits and potentials of deep learning for robotics
     Sünderhauf, Niko, Brock, Oliver, Scheirer, Walter, Hadsell, Raia, Fox, Dieter, Leitner, Jürgen, Upcroft, Ben, Abbeel, Pieter, Burgard, Wolfram, Milford, Michael et al. · 2018 · The International Journal of Robotics Research
146. Dopaminergic Balance between Reward Maximization and Policy Complexity
     Naama Parush, Naftali Tishby, Hagai Bergman · 2011 · Frontiers in Systems Neuroscience
147. Enhancing the psychometric properties of the Iowa gambling task using full generative modeling
     Sullivan-Toole, Holly, Haines, Nathaniel, Dale, Kristina, Olino, Thomas M. · 2022 · Computational Psychiatry
148. Linking confidence biases to reinforcement-learning processes.
     Nahuel Salem-Garcia, Stefano Palminteri, Maël P. Lebreton · 2023 · Psychological Review
149. How Predictable are “Spontaneous Decisions” and “Hidden Intentions”? Comparing Classification Results Based on Previous Responses with Multivariate Pattern Analysis of fMRI BOLD Signals
     Martin Lages, Katarzyna Jaworska · 2012 · Frontiers in Psychology
150. Cost-benefit trade-offs in decision-making and learning
     Nura Sidarus, Stefano Palminteri, V. Chambon · 2019 · PLoS Comput. Biol.
151. Combined model-free and model-sensitive reinforcement learning in non-human primates
     Bruno Miranda, W. M. Nishantha Malalasekera, Timothy E.J. Behrens, Peter Dayan, Steven Wayne Kennerley · 2020 · PLoS Computational Biology
152. Dopamine release in human associative striatum during reversal learning
     Filip Grill, Marc Guitart‐Masip, Jarkko J. Johansson, Lars Stiernman Jonasson, Jan Axelsson, Lars H Nyberg, Anna Rieckmann · 2024 · Nature Communications
153. Empirical Bayes Methods for Combining Likelihoods
     Bradley Efron · 1996 · Journal of the American Statistical Association
154. Decision Making, Affect, and Learning
     Mauricio R. Delgado, Elizabeth A. Phelps, Trevor William Robbins · 2011 · Oxford University Press eBooks
155. Stimulus similarity determines the prevalence of behavioral laterality in a visual discrimination task for mice
     Mario Treviño · 2014 · Scientific Reports
156. From Classical Methods to Generative Models: Tackling the Unreliability of Neuroscientific Measures in Mental Health Research
     Nathaniel Haines, Holly Sullivan‐Toole, Thomas M. Olino · 2023 · Biological Psychiatry Cognitive Neuroscience and Neuroimaging
157. Distinct prediction errors in mesostriatal circuits of the human brain mediate learning about the values of both states and actions: evidence from high-resolution fMRI
     Jaron T. Colas, Wolfgang M. Pauli, Tobias Larsen, J. Michael Tyszka, John P. O’Doherty · 2017 · PLoS Computational Biology
158. A Survey of Explainable Reinforcement Learning
     Milani, Stephanie, Topin, Nicholay, Veloso, Manuela, Fang, Fei · 2022 · arXiv
159. Biases in estimating the balance between model-free and model-based learning systems due to model misspecification
     Asako Toyama, Kentaro Katahira, Hideki Ohira · 2019 · Journal of Mathematical Psychology
160. Troubleshooting Bayesian cognitive models.
     Beth Baribault, Anne Gabrielle Eva Collins · 2023 · Psychological Methods
161. Post-response βγ power predicts the degree of choice-based learning in internally guided decision-making
     Takashi Nakao, Noriaki Kanayama, Kentaro Katahira, Misaki Odani, Yosuke Ito, Yuki Hirata, Reika Nasuno, 尾崎 繁, Ryosuke Hiramoto, Makoto Miyatani et al. · 2016 · Scientific Reports
162. Multi-Task Reinforcement Learning With Attention-Based Mixture of Experts
     Guangran Cheng, Lu Dong, Wenzhe Cai, Changyin Sun · 2023 · IEEE Robotics and Automation Letters
163. Repetition effects in grasping.
     Peter Dixon, Scott McAnsh, Lenore E. Read · 2011 · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale
164. Cognitive Model Discovery via Disentangled RNNs
     Kevin J. Miller, Maria Katharina Eckstein, Matthew Botvinick · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
165. The DalHouses: 100 new photographs of houses with ratings of typicality, familiarity, and degree of similarity to faces
     Jillian Filliter, Jacqueline M. Glover, Patricia A. McMullen · 2015 · Behavior Research Methods
166. Now and then: Hand choice is influenced by recent action history
     Kenneth F. Valyear, Aoife M. Fitzpatrick, Neil M. Dundon · 2018 · Psychonomic Bulletin & Review
167. MoËT: Mixture of Expert Trees and its application to verifiable reinforcement learning
     Marko Vasić, Andrija Petrović, Kaiyuan Wang, Mladen Nikolić, Rishabh Singh, Sarfraz Khurshid D · 2022 · Neural Networks
168. Attentional Selection Can Be Predicted by Reinforcement Learning of Task-relevant Stimulus Features Weighted by Value-independent Stickiness
     Matthew Balcarras, Salva Ardid, Daniel Kaping, Stefan Everling, Thilo Womelsdorf · 2015 · Journal of Cognitive Neuroscience
169. Sequential response bias in randomized response sequences: A computer simulation
     Sjoerd Wiegersma · 1982 · Acta Psychologica
170. Discovering Cognitive Strategies with Tiny Recurrent Neural Networks
     Jian Li, Marcus K. Benna, Marcelo Gomes Mattar · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
171. From predictive models to cognitive models: Separable behavioral processes underlying reward learning in the rat
     Kevin J. Miller, Matthew Botvinick, Carlos D. Brody · 2018 · bioRxiv (Cold Spring Harbor Laboratory)
172. A simple computational algorithm of model-based choice preference
     Asako Toyama, Kentaro Katahira, Hideki Ohira · 2017 · Cognitive Affective & Behavioral Neuroscience
173. Model-based estimation of subjective values using choice tasks with probabilistic feedback
     Kentaro Katahira, Shoko Yuki, Kazuo Okanoya · 2017 · Journal of Mathematical Psychology
174. Reinforcement Learning With Parsimonious Computation and a Forgetting Process
     Asako Toyama, Kentaro Katahira, Hideki Ohira · 2019 · Frontiers in Human Neuroscience
175. Adaptive Choice Biases in Mice and Humans
     Mario Treviño, Ricardo Medina‐Coss y León, Belén Haro · 2020 · Frontiers in Behavioral Neuroscience
176. Confirmation bias optimizes reward learning
     Tor Tarantola, Tomas Folke, Annika Boldt, Omar David Perez, Benedetto De Martino · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
177. Neural and computational underpinnings of biased confidence in human reinforcement learning
     Chih-Chung Ting, Nahuel Salem-Garcia, Stefano Palminteri, Jan Benjamin Engelmann, Maël P. Lebreton · 2023 · Nature Communications
178. Adaptive optimal training of animal behavior
     Ji Hyun Bak, Jung Yoon Choi, Athena Akrami · 2017 · Bulletin of the American Physical Society
179. Artificial neural networks for model identification and parameter estimation in computational cognitive models
     Milena Rmus, Ti-Fen Pan, Liyu Xia, Anne Gabrielle Eva Collins · 2024 · PLoS Computational Biology
180. Efficient inference for time-varying behavior during learning.
     Nicholas A Roy, Ji Hyun Bak, Athena Akrami · 2018 · PubMed
181. Temporal chunking as a mechanism for unsupervised learning of task-sets
     Flora Bouchacourt, Stefano Palminteri, Étienne Koechlin, Srdjan Ostojic · 2020 · eLife
182. Towards Applicable Reinforcement Learning: Improving the Generalization and Sample Efficiency with Policy Ensemble
     Zhengyu Yang, Kan Ren, Xufang Luo, Minghuan Liu, Weiqing Liu, Jiang Bian, Weinan Zhang, Dongsheng Li · 2022 · International Joint Conference on Artificial Intelligence
183. Tracking subjects’ strategies in behavioural choice experiments at trial resolution
     Silvia Maggi, Rebecca M Hock, Martin J. O’Neill, Mark J. Buckley, Paula M. Moran, Tobias Bast, Musa Basseer Sami, Mark D. Humphries · 2024 · eLife
184. Value-based decision making via sequential sampling with hierarchical competition and attentional modulation
     Jaron T. Colas · 2017 · PLoS ONE
185. Decision-making in brains and robots — the case for an interdisciplinary approach
     Sang Wan Lee, Ben Seymour · 2019 · Current Opinion in Behavioral Sciences
186. Continuous Action Reinforcement Learning From a Mixture of Interpretable Experts
     Riad Akrour, Davide Tateo, Jan Peters · 2021 · IEEE Transactions on Pattern Analysis and Machine Intelligence
187. Hierarchical Bayesian models of reinforcement learning: Introduction and comparison to alternative methods
     Camilla van Geen, Raphael T. Gerraty · 2021 · Journal of Mathematical Psychology
188. Using deep neural networks as a guide for modeling human planning
     Ionatan Kuperwajs, Heiko H. Schütt, Wei Ji Ma · 2023 · Scientific Reports
189. Harnessing the flexibility of neural networks to predict dynamic theoretical parameters underlying human choice behavior
     Yoav Ger, Eliya Nachmani, Lior Wolf, Nitzan Shahar · 2024 · PLoS Computational Biology
190. Cognitive Choice Modeling
     Zheng Joyce Wang, Jerome R. Busemeyer · 2021 · The MIT Press eBooks
191. Predictive and Interpretable: Combining Artificial Neural Networks and Classic Cognitive Models to Understand Human Learning and Decision Making
     Eckstein, Maria K., Summerfield, Christopher, Daw, Nathaniel D., Miller, Kevin J. · 2023
192. Examinations of Biases by Model Misspecification and Parameter Reliability of Reinforcement Learning Models
     Asako Toyama, Kentaro Katahira, Yoshihiko Kunisato · 2023 · Computational Brain & Behavior
193. Undermatching Is a Consequence of Policy Compression
     Bilal A. Bari, Samuel Joseph Gershman · 2022 · Journal of Neuroscience
194. Isomorphic decisional biases across perceptual tasks
     Mario Treviño, Santiago Castiello, Óscar Arias-Carrión, Braniff de la Torre-Valdovinos, Ricardo Leon · 2021 · PLoS ONE
195. Revisiting the importance of model fitting for model-based fMRI: It does matter in computational psychiatry
     Kentaro Katahira, Asako Toyama · 2021 · PLoS Computational Biology
196. Force tuning explains changes in phasic dopamine signaling during stimulus-reward learning
     Konstantin I. Bakhurin, Ryan N. Hughes, Qiaochu Jiang, M Afzal Hossain, Boris S Gutkin, Isabella P. Fallon, Henry H. Yin · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
197. Comparing the test-retest reliability of behavioral, computational and self-reported individual measures of reward and punishment sensitivity in relation to mental health symptoms
     Stefano Vrizzi, Anis Najar, Cédric Lemogne · 2023
198. Undesirable Choice Biases with Small Differences in the Spatial Structure of Chance Stimulus Sequences
     David Herrera, Mario Treviño · 2015 · PLoS ONE
199. Choice perseveration in value-based decision making: The impact of inter-trial interval and mood
     Ulrike Senftleben, Martin Schoemann, Diana Schwenke, Sarah Richter, Maja Dshemuchadse, Stefan Scherbaum · 2019 · Acta Psychologica
200. To stay or not to stay: The stability of choice perseveration in value-based decision making
     Ulrike Senftleben, Martin Schoemann, Matthias Rudolf, Stefan Scherbaum · 2020 · Quarterly Journal of Experimental Psychology