Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts

Colas, Jaron T., O’Doherty, John P., Grafton, Scott T.·2024·PLOS Computational Biology
DOI 10.1371/journal.pcbi.1011950

Cites (450)

Items 401–450 of 450

  1. Dynamic computational phenotyping of human cognition
    Roey Schurr, Daniel Reznik, Hanna Hillman · 2023
  2. Hysteresis as an Implicit Prior in Tactile Spatial Decision Making
    Sabrina D. Thiel, Sebastian Bitzer, Till Nierhaus, Christian Kalberlah, Sven Preusser, Jane Neumann, Vadim V. Nikulin, Elke E. van der Meer, Arno Villringer, Burkhard Pleger · 2014 · PLoS ONE
  3. Perseveration effects in reaching and grasping rely on motor priming and not perception
    Scott Glover, Peter Dixon · 2013 · Experimental Brain Research
  4. Disentangled behavioural representations
    Amir Dezfouli, Hassan Ashtiani, Omar Ghattas · 2019 · MPG.PuRe (Max Planck Society)
  5. Assigning the right credit to the wrong action: compulsivity in the general population is associated with augmented outcome-irrelevant value-based learning
    Nitzan Shahar, T. Hauser, R. Moran, M. Moutoussis, E. Bullmore, R. Dolan, Nspn consortium · 2021 · Translational Psychiatry
  6. A Survey on Interpretable Reinforcement Learning
    Claire Glanois, Paul Weng, Matthieu Zimmer · 2021 · arXiv (Cornell University)
  7. The effects of induced positive and negative affect on Pavlovian-instrumental interactions
    Isla D. Weber, S. Zorowitz, Y. Niv, Daniel Bennett · 2022 · Cognition & Emotion
  8. Improving the reliability of the Pavlovian go/no-go task for computational psychiatry research
    Samuel Zorowitz, Gili Karni, Natalie Paredes, Nathaniel D. Daw, Yael Niv · 2023
  9. Two Routes to the Same Action: An Action Repetition Priming Study
    Jennifer Randerath, Kenneth F. Valyear, Anna Hood · 2014 · Journal of Motor Behavior
  10. Decision heuristics in contexts integrating action selection and execution
    Neil M. Dundon, Jaron T. Colas, Neil Garrett, Viktoriya Babenko, Elizabeth J. Rizor, Dengxian Yang, Máirtín MacNamara, Linda Ruth Petzold, Scott T. Grafton · 2023 · Scientific Reports
  11. Human decision making balances reward maximization and policy compression
    Lucy Lai, Samuel J. Gershman · 2023
  12. The construction and use of cognitive maps in model-based control.
    Ata B. Karagoz, Zachariah M. Reagh, Wouter Kool · 2023 · Journal of Experimental Psychology General
  13. Hand selection for object grasping is influenced by recent motor history
    Kenneth F. Valyear, Scott H. Frey · 2013 · Psychonomic Bulletin & Review
  14. Motor actions influence subsequent sensorimotor decisions
    Anna-Antonia Pape, Nima Noury, Markus Siegel · 2017 · Scientific Reports
  15. Test-retest reliability of affective bias tasks
    Alexandra Claire Pike, Katrina Tan, Hoda Jaber Ansari · 2022
  16. Test-retest reliability of reinforcement learning parameters
    Jessica Vera Schaaf, Laura Weidinger, Lucas Molleman · 2023
  17. Explaining the flaws in human random generation as local sampling with momentum
    Lucas Castillo, Pablo León-Villagrá, Nick Chater A, Adam N. Sanborn · 2024 · PLoS Computational Biology
  18. Sequential dependencies between trials in free choice tasks
    Carsten Allefeld, Chun Siong Soon, Carsten Bogler · 2013 · arXiv (Cornell University)
  19. Learning Where to Look for High Value Improves Decision Making Asymmetrically
    Jaron Colas, Joy Lu · 2017 · Frontiers in Psychology
  20. Exploration–Exploitation Mechanisms in Recurrent Neural Networks and Human Learners in Restless Bandit Problems
    Deniz Tuzsus, A.M.A. Brands, Ioannis Pappas, Jan Peters · 2024 · Computational Brain & Behavior
  21. Recurrent processing improves occluded object recognition and gives rise to perceptual hysteresis
    Markus Ernst, Thomas Burwick, Jochen Triesch · 2021 · Journal of Vision
  22. Choice Type Impacts Human Reinforcement Learning
    Milena Rmus, Amy R. Zou, A. Collins · 2022 · Journal of Cognitive Neuroscience
  23. Dissociation in decision bias mechanism between probabilistic information and previous decision
    Yoshiyuki Kaneko, Katsuyuki Sakai · 2015 · Frontiers in Human Neuroscience
  24. Action chunking as conditional policy compression
    Lai, Lucy, Huang, Ann Zixiang, Gershman, Samuel J. · 2022
  25. Probabilistic integration of preceding responses explains response bias in perceptual decision making
    Daniel Schlunegger, Fred W. Mast · 2023 · iScience
  26. From Classical Methods to Generative Models: Tackling the Unreliability of Neuroscientific Measures in Mental Health Research
    Nathaniel Haines, Holly Sullivan‐Toole, Thomas M. Olino · 2023
  27. Dissecting the Complexities of Learning With Infinite Hidden Markov Models
    Sebastian A. Bruijns, Kcénia Bougrova, Inês C. Laranjeira, Petrina Lau, Guido T. Meijer, Nathaniel J Miska, Jean‐Paul Noel, Alejandro Pan-Vazquez, Noam Roth, Karolina Z. Socha et al. · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
  28. Test-retest reliability of canonical reinforcement learning models
    Laura Weidinger, Andrea Gradassi, Lucas Molleman · 2019 · Conference on Cognitive Computational Neuroscience (CCN)
  29. Differences in Learning Across the Lifespan Emerge via Resource-Rational Computations
    Rasmus Bruckner, Matthew R. Nassar, Shu Li, Ben Eppinger · 2020
  30. Reinforcement learning with associative or discriminative generalization across states and actions: fMRI at 3 T and 7 T
    Jaron T. Colas, Neil M. Dundon, Raphael T. Gerraty, Natalie Marie Saragosa-Harris, Karol P. Szymula, Koranis Tanwisuth, J. Michael Tyszka, Camilla van Geen, Harang Ju, Arthur W. Toga et al. · 2022 · Human Brain Mapping
  31. Instruction effects on randomness in sequence generation
    Maja Guseva, Carsten Bogler, Carsten Allefeld, John­–Dylan Haynes · 2023 · Frontiers in Psychology
  32. Motor System-Dependent Effects of Amygdala and Ventral Striatum Lesions on Explore–Exploit Behaviors
    Franco Giarrocco, Vincent D. Costa, Benjamin M. Basile, Maia S. Pujara, Elisabeth A. Murray, Bruno B. Averbeck · 2023 · Journal of Neuroscience
  33. Influences of Reinforcement and Choice Histories on Choice Behavior in Actor-Critic Learning
    Kentaro Katahira, Kenta Kimura · 2022 · Computational Brain & Behavior
  34. Pseudo-learning effects in reinforcement learning model-based analysis: A problem of misspecification of initial preference
    Kentaro Katahira, Bai Yu, Takashi Nakao · 2017
  35. Computational modeling of choice-induced preference change: A Reinforcement-Learning-based approach
    Jianhong Zhu, Junya Hashimoto, Kentaro Katahira · 2021 · PLoS ONE
  36. Distributed processing of side-choice biases
    Mario Treviño, Ricardo Medina‐Coss y León · 2020 · Brain Research
  37. Choice History Bias in Intertemporal Choice
    Martin Schoemann, Stefan Scherbaum · 2019
  38. Independent, not irrelevant: Trial order causes systematic misestimation of economic choice traits.
    Nidhi V Banavar, Aaron M. Bornstein · 2023
  39. Choice Repetition Bias in Intertemporal Choice: An Eye‐Tracking Study
    Ulrike Senftleben, Martin Schoemann, Stefan Scherbaum · 2024 · Journal of Behavioral Decision Making
  40. Using recurrent neural network to estimate irreducible stochasticity in human choice behavior
    Yoav Ger, Moni Shahar, Nitzan Shahar · 2024 · eLife
  41. Examinations of Biases by Model Misspecification and Parameter Reliability of Reinforcement Learning Models
    Asako Toyama, Kentaro Katahira, Yoshihiko Kunisato · 2022
  42. Choice anticipation as gated accumulation of sensory predictions
    Brandon Caie, Dominik Endres, Aarlenne Zein Khan, Gunnar Blohm · 2025 · Journal of Neurophysiology
  43. Probabilistic Mixture-of-Experts for Efficient Deep Reinforcement Learning
    Jie Ren, Yewen Li, Zihan Ding · 2021 · arXiv (Cornell University)
  44. Multi-Task Reinforcement Learning with Mixture of Orthogonal Experts
    Ahmed Hendawy, Jan Peters, Carlo D’Eramo · 2023 · arXiv (Cornell University)
  45. On the Reliability and Generalizability of Brain-inspired Reinforcement Learning Algorithms
    Dongjae Kim, Jee Hang Lee, Jae Hoon Shin, Minsu Abel Yang, Sang Wan Lee · 2020 · arXiv (Cornell University)
  46. Long short-term prediction guides human metacognitive reinforcement learning
    Sang Wan Lee, Dongjae Kim, Jee Hang Lee, Wooseok Jung, So Hyun Kim · 2023 · Research Square
  47. Computational and neural mechanisms underlying the influence of action affordances on value learning
    Sanghyun Yi, John P. O’Doherty · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
  48. Towards Applicable Reinforcement Learning: Improving the Generalization and Sample Efficiency with Policy Ensemble
    Zhengyu Yang, Kan Ren, Xufang Luo · 2022 · arXiv (Cornell University)
  49. A reinforcement learning model with choice traces for a progressive ratio schedule
    Keiko Ihara, Yu Shikano, Sae Kato, Sho Yagishita, Kenji F. Tanaka, Norio Takata · 2024 · Frontiers in Behavioral Neuroscience
  50. Computational and neural mechanisms underlying the influence of action affordances on value learning
    Sanghyun Yi, John P. O’Doherty · 2026 · Nature Communications