Decision theory, reinforcement learning, and the brain

Maximum Likelihood from Incomplete Data Via the <i>EM</i> Algorithm

Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444 · see citing works

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works

Dynamic Programming

Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588 · see citing works

Untitled work

(1995) · Cited by 10,558 · see citing works

Untitled work

(1966) · Medical Entomology and Zoology · Cited by 10,293 · see citing works

A neural substrate of prediction and reward

Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works

Signal detection theory and psychophysics

Ingleby, D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,616 · see citing works

Markov decision processes: Discrete stochastic dynamic programming

Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037 · see citing works

Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning

Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 7,936 · see citing works

Statistical Decision Theory and Bayesian Analysis

Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722 · see citing works

A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement

Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works

Learning from Delayed Rewards

Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,406 · see citing works

Learning to predict by the methods of temporal differences

Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · see citing works

Humans integrate visual and haptic information in a statistically optimal fashion

Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844 · see citing works

Neural systems of reinforcement for drug addiction: from actions to habits to compulsion

Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785 · see citing works

The Neural Basis of Decision Making

Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764 · see citing works

Neuro-dynamic Programming

(2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,601 · see citing works

Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems

Dayan, P., & Abbott, L. F. (2001) · Cited by 3,153 · see citing works

Separate neural systems value immediate and delayed monetary rewards

McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089 · see citing works

The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks

Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059 · see citing works

Stastical Decision Theory and Bayesian Analysis.

Ghosh, M., & Berger, J. O. (1988) · Journal of the American Statistical Association · doi:10.2307/2288950 · Cited by 2,901 · see citing works

NEURAL MECHANISMS OF ADDICTION: The Role of Reward-Related Learning and Memory

Hyman, S. E., Malenka, R. C., & Nestler, E. J. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113009 · Cited by 2,647 · see citing works

Getting formal with dopamine and reward

Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works

Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control

Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · see citing works

The debate over dopamine’s role in reward: the case for incentive salience

Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347 · see citing works

Cortical substrates for exploratory decisions in humans

Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · see citing works

Optimal Foraging Theory: A Critical Review

Pyke, G. H. (1984) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.es.15.110184.002515 · Cited by 2,217 · see citing works

A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants

Neal, R. M., & Hinton, G. E. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_12 · Cited by 2,187 · see citing works

The time course of perceptual choice: The leaky, competing accumulator model.

Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152 · see citing works

Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning

O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works

A framework for mesencephalic dopamine systems based on predictive Hebbian learning

Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works

Bayesian integration in sensorimotor learning

Körding, K. P., & Wolpert, D. M. (2004) · Nature · doi:10.1038/nature02169 · Cited by 2,004 · see citing works

The analysis of visual motion: a comparison of neuronal and psychophysical performance

Britten, K., Shadlen, M., Newsome, W., & Movshon, J. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04745.1992 · Cited by 1,958 · see citing works

The neural correlates of subjective value during intertemporal choice

Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916 · see citing works

Markov Decision Processes: Discrete Stochastic Dynamic Programming

Baxter, L. A., & Puterman, M. L. (1995) · Technometrics · doi:10.2307/1269932 · Cited by 1,889 · see citing works

The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasks.

Bogacz, R., Brown, E., Moehlis, J., Holmes, P. J., & Cohen, J. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.4.700 · Cited by 1,845 · see citing works

Neural correlates of decision variables in parietal cortex

Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · see citing works

Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task

Roitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589 · cited 2× · see citing works

Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping

Ng, A. Y., Harada, D., & Russell, S. (1999) · Cited by 1,586 · see citing works

Temporal difference models and reward-related learning in the human brain

O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · see citing works

Neuro-Dynamic Programming

Bertsekas, D. P. (2001) · Encyclopedia of Optimization · doi:10.1007/0-306-48332-7_333 · Cited by 1,486 · see citing works

Modeling Response Times for Two-Choice Decisions

Ratcliff, R., & Rouder, J. N. (1998) · Psychological Science · doi:10.1111/1467-9280.00067 · Cited by 1,478 · see citing works

Bayesian inference with probabilistic population codes

Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457 · see citing works

The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.

Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390 · see citing works

Integrated Architectures for Learning, Planning, and Reacting Based on Approximating Dynamic Programming

Sutton, R. S. (1990) · Elsevier eBooks · doi:10.1016/b978-1-55860-141-3.50030-4 · Cited by 1,348 · see citing works

Probabilistic decision making by slow reverberation in cortical circuits

Wang, X.-J. (2002) · Neuron · doi:10.1016/s0896-6273(02)01092-9 · Cited by 1,242 · see citing works

Models of Information Processing in the Basal Ganglia

(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190 · see citing works

Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration

Cohen, J. D., McClure, S. M., & Yu, A. J. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2098 · Cited by 1,121 · see citing works

Psychology and neurobiology of simple decisions

Smith, P. L., & Ratcliff, R. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.01.006 · Cited by 1,051 · see citing works

A relationship between behavioral choice and the visual responses of neurons in macaque MT

Britten, K. H., Newsome, W. T., Shadlen, M. N., Celebrini, S., & Movshon, J. A. (1996) · Visual Neuroscience · doi:10.1017/s095252380000715x · Cited by 1,049 · see citing works

Multi-Armed Bandit Allocation Indices.

Bather, J. A., & Gittins, J. C. (1990) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2982809 · Cited by 1,043 · see citing works

Breakdown of Will

Ainslie, G. W. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9781139164191 · Cited by 958 · see citing works

Neural computations that underlie decisions about sensory stimuli

Gold, J. I., & Shadlen, M. N. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01567-9 · Cited by 881 · see citing works

A computational analysis of the relationship between neuronal and behavioral responses to visual motion

Shadlen, M., Britten, K., Newsome, W., & Movshon, J. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-04-01486.1996 · Cited by 824 · see citing works

SENSE AND THE SINGLE NEURON: Probing the Physiology of Perception

Parker, A. J., & Newsome, W. T. (1998) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.21.1.227 · Cited by 801 · see citing works

On the Convergence of Stochastic Iterative Dynamic Programming Algorithms

Jaakkola, T., Jordan, M. I., & Singh, S. P. (1994) · Neural Computation · doi:10.1162/neco.1994.6.6.1185 · Cited by 797 · see citing works

Noise characteristics and prior expectations in human visual speed perception

Stocker, A. A., & Simoncelli, E. P. (2006) · Nature Neuroscience · doi:10.1038/nn1669 · Cited by 780 · see citing works

Dynamic Modeling in Behavioral Ecology.

Caraco, T. B., Newman, J. A., Mangel, M., & Clark, C. (1990) · Evolution · doi:10.2307/2409517 · Cited by 761 · see citing works

Coordination of Actions and Habits in the Medial Prefrontal Cortex of Rats

Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748 · see citing works

Motion perception: seeing and deciding.

Shadlen, M. N., & Newsome, W. T. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.2.628 · Cited by 723 · see citing works

Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens

Day, J. J., Roitman, M. F., Wightman, R. M., & Carelli, R. M. (2007) · Nature Neuroscience · doi:10.1038/nn1923 · Cited by 710 · see citing works

Metalearning and neuromodulation

Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704 · see citing works

Dynamic Modeling in Behavioral Ecology

Mangel, M., & Clark, C. (1989) · Princeton University Press eBooks · doi:10.1515/9780691206967 · Cited by 623 · see citing works

Temporal difference models describe higher-order learning in humans

Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · see citing works

Test of optimal sampling by foraging great tits

Krebs, J. R., Kacelnik, A., & Taylor, P. (1978) · Nature · doi:10.1038/275027a0 · Cited by 599 · see citing works

Learning in Embedded Systems

Kaelbling, L. P. (1993) · doi:10.7551/mitpress/4168.001.0001 · Cited by 599 · see citing works

Markov Decision Processes: Discrete Stochastic Dynamic Programming

Puterman, M. L. (2005) · Cited by 588 · see citing works

Bandit Problems, Sequential Allocation of Experiments.

Jones, P. W., Berry, D. A., & Fristedt, B. (1987) · Journal of the Operational Research Society · doi:10.2307/2582852 · Cited by 583 · see citing works

Probabilistic reasoning by neurons

Yang, T., & Shadlen, M. N. (2007) · Nature · doi:10.1038/nature05852 · Cited by 581 · see citing works

Banburismus and the Brain

Gold, J. I., & Shadlen, M. N. (2002) · Neuron · doi:10.1016/s0896-6273(02)00971-6 · Cited by 547 · see citing works

Optimal representation of sensory information by neural populations

Jazayeri, M., & Movshon, J. A. (2006) · Nature Neuroscience · doi:10.1038/nn1691 · Cited by 530 · see citing works

Infinite-Horizon Policy-Gradient Estimation

Baxter, J., & Bartlett, P. L. (2001) · Cited by 525 · see citing works

Cortico–basal ganglia circuit mechanism for a decision threshold in reaction time tasks

Lo, C.-C., & Wang, X.-J. (2006) · Nature Neuroscience · doi:10.1038/nn1722 · Cited by 505 · see citing works

Actor–critic models of the basal ganglia: new anatomical and computational perspectives

Joel, D., Niv, Y., & Ruppin, E. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00047-3 · Cited by 500 · see citing works

Statistical Decision Theory

Berger, J. O. (1989) · Palgrave Macmillan UK eBooks · doi:10.1007/978-1-349-20181-5_26 · Cited by 496 · see citing works

Dopamine: generalization and bonuses

Kakade, S. M., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00048-5 · Cited by 477 · see citing works

Adaptive Critics and the Basal Ganglia

Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0018 · Cited by 466 · see citing works

The computational neurobiology of learning and reward

Daw, N. D., & Doya, K. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.03.006 · Cited by 462 · see citing works

Sequential Analysis

Wald, A. (1947) · CERN Document Server (European Organization for Nuclear Research) · Cited by 446 · see citing works

Bayesian integration of visual and auditory signals for spatial localization

Battaglia, P., Jacobs, R. A., & Aslin, R. Ν. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001391 · Cited by 426 · see citing works

Decisions uncertainty. and the brain: The science of neuroeconomics

(2003) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(03)90161-1 · Cited by 425 · see citing works

NATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE

Hilton, W. (1983) · Cited by 376 · see citing works

Bayesian Q-learning

Dearden, R., Friedman, N., & Russell, S. (1998) · Cited by 369 · see citing works

Probabilistic Interpretation of Population Codes

Zemel, R. S., Dayan, P., & Pouget, A. (1998) · Neural Computation · doi:10.1162/089976698300017818 · Cited by 333 · see citing works

Optimal integration of texture and motion cues to depth

Jacobs, R. A. (1999) · Vision Research · doi:10.1016/s0042-6989(99)00088-7 · Cited by 324 · see citing works

Probabilistic Interpretation of Population Codes

Zemel, R. S., Dayan, P., & Pouget, A. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/4924.003.0011 · Cited by 320 · see citing works

Reinforcement learning with perceptual aliasing: the perceptual distinctions approach

Chrisman, L. (1992) · Cited by 316 · see citing works

Bayesian Spiking Neurons I: Inference

Deneve, S. (2008) · Neural Computation · doi:10.1162/neco.2008.20.1.91 · Cited by 313 · see citing works

Decision theory: what “should” the nervous system do?

Körding, K. (2007) · Science · doi:10.1126/science.1142998 · Cited by 313 · see citing works

A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task

Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., Imamizu, H., & Kawato, M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3417-03.2004 · Cited by 300 · see citing works

The application of statistical decision theory to animal behaviour

McNamara, J. M., & Houston, A. I. (1980) · Journal of Theoretical Biology · doi:10.1016/0022-5193(80)90265-9 · Cited by 300 · see citing works

Striatal activity underlies novelty-based choice in humans

Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277 · see citing works

Statistical decision theory and the selection of rapid, goal-directed movements

Trommershäuser, J., Maloney, L. T., & Landy, M. S. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001419 · Cited by 276 · see citing works

Dopaminergic Mechanisms in Actions and Habits: Figure 1.

Wickens, J. R., Horvitz, J. C., Costa, R. M., & Killcross, S. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1671-07.2007 · Cited by 271 · see citing works

Value-dependent selection in the brain: Simulation in a synthetic neural model

Friston, K. J., Tononi, G., Reeke, G. N., Sporns, O., & Edelman, G. M. (1994) · Neuroscience · doi:10.1016/0306-4522(94)90592-4 · Cited by 268 · see citing works

What is reinforced by phasic dopamine signals?

Redgrave, P., GURNEY, K. N., & Reynolds, J. N. J. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.10.007 · Cited by 254 · see citing works

Bayesian Computation in Recurrent Neural Circuits

Rao, R. P. N. (2004) · Neural Computation · doi:10.1162/08997660460733976 · Cited by 252 · see citing works

Bayesian decision theory and psychophysics

Yuille, A. L., & Bülthoff, H. H. (1996) · Perception as Bayesian Inference · doi:10.1017/cbo9780511984037.006 · Cited by 250 · cited 4× · see citing works

Statistical decision theory and trade-offs in the control of motor response

Maloney, L. T., Landy, M. S., & Trommershäuser, J. (2003) · Spatial Vision · doi:10.1163/156856803322467527 · Cited by 225 · see citing works

Learning of sequential movements by neural network model with dopamine-like reinforcement signal

Suri, R. E., & Schultz, W. (1998) · Experimental Brain Research · doi:10.1007/s002210050467 · Cited by 198 · see citing works

Resolution of Uncertainty in Prefrontal Cortex

Yoshida, W., & Ishii, S. (2006) · Neuron · doi:10.1016/j.neuron.2006.05.006 · Cited by 196 · see citing works

Representation and timing in theories of the dopamine system

Daw, N. D., Courville, A. C., & Touretzky, D. S. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1637 · Cited by 173 · see citing works

Untitled work

(2007) · MPG.PuRe (Max Planck Society) · Cited by 169 · see citing works

Multi-Armed Bandit Allocation Indices

Jones, P. W., & Gittins, J. C. (1989) · Journal of the Operational Research Society · doi:10.2307/2582928 · Cited by 165 · see citing works

On the Convergence of Stochastic Iterative Dynamic Programming Algorithms

Jaakkola, T., Jordan, M. I., & Singh, S. P. (1993) · doi:10.21236/ada276517 · Cited by 161 · see citing works

Striatal dopamine in motor activation and reward-mediated learning: steps towards a unifying model

Wickens, J. R. (1990) · Journal of Neural Transmission · doi:10.1007/bf01245020 · Cited by 145 · see citing works

Plastic Corticostriatal Circuits for Action Learning

Costa, R. M. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.015 · Cited by 124 · see citing works

Implicit knowledge of visual uncertainty guides decisions with asymmetric outcomes

Whiteley, L., & Sahani, M. (2008) · Journal of Vision · doi:10.1167/8.3.2 · Cited by 114 · see citing works

Humans Rapidly Estimate Expected Gain in Movement Planning

Trommershäuser, J., Landy, M. S., & Maloney, L. T. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01816.x · Cited by 112 · see citing works

Bandit Problems: Sequential Allocation of Experiments.

Bather, J. A., Berry, D. A., & Fristedt, B. (1986) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2981558 · Cited by 107 · see citing works

Learning in embedded systems

(1993) · Choice Reviews Online · doi:10.5860/choice.31-1560 · Cited by 101 · see citing works

The Speed and Accuracy of a Simple Perceptual Decision: A Mathematical Primer

Shadlen, M. N., Hanks, T. D., Churchland, A. K., Kiani, R., & Yang, T. (2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262042383.003.0010 · Cited by 94 · see citing works

Exploration Bonuses and Dual Control

Dayan, P., & Sejnowski, T. J. (1996) · Machine Learning · doi:10.1023/a:1018357105171 · Cited by 92 · see citing works

Doubly Distributional Population Codes: Simultaneous Representation of Uncertainty and Multiplicity

Sahani, M., & Dayan, P. (2003) · Neural Computation · doi:10.1162/089976603322362356 · Cited by 90 · see citing works

Why Choose This Book?: How We Make Decisions

Montague, R. (2006) · Medical Entomology and Zoology · Cited by 86 · see citing works

Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration

Cohen, J. D., McClure, S. M., & Yu, A. J. (2008) · doi:10.1093/oso/9780199230617.003.0014 · Cited by 84 · see citing works

Separate Neural Systems Value Immediate and Delayed Monetary Rewards

McClure, S. M., Laibson, D., Loewenstein, G. F., & Cohen, J. (2007) · doi:10.1093/oso/9780199257072.003.0022 · Cited by 66 · see citing works

An exploration-exploitation model based on norepinepherine and dopamine activity

McClure, S. M., Gilzenrat, M. S., & Cohen, J. D. (2005) · neural information processing systems · Cited by 61 · see citing works

Introduction to Stochastic Dynamic Programming: Probability and Mathematical

Ross, S. M. (1983) · Academic Press, Inc. eBooks · Cited by 51 · see citing works

Exact Inferences in a Neural Implementation of a Hidden Markov Model

Beck, J. M., & Pouget, A. (2007) · Neural Computation · doi:10.1162/neco.2007.19.5.1344 · Cited by 44 · see citing works

Probabilistic population codes and the exponential family of distributions

Beck, J. M., Ma, W. J., Latham, P. E., & Pouget, A. (2007) · Progress in brain research · doi:10.1016/s0079-6123(06)65032-2 · Cited by 40 · see citing works

Toward a Prefrontal Microcircuit Model for Cognitive Deficits in Schizophrenia

Wang, X. (2006) · Pharmacopsychiatry · doi:10.1055/s-2006-931501 · Cited by 35 · see citing works

The Speed and Accuracy of a Simple Perceptual Decision: A Mathematical Primer

Shadlen, M. N., Hanks, T. D., Churchland, A. K., Kiani, R., & Yang, T. (2006) · The MIT Press eBooks · doi:10.7551/mitpress/1535.003.0016 · Cited by 24 · see citing works

Optimal Change-Detection and Spiking Neurons

Yu, A. J. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0198 · Cited by 22 · see citing works

Why Choose this Book? How we make decisions

Crotts, J. C. (2008) · Tourism Analysis · Cited by 6 · see citing works

Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex

Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027 · see citing works

Goals and Habits in the Brain

Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977 · see citing works

Action understanding as inverse planning

Baker, C. L., Saxe, R., & Tenenbaum, J. B. (2009) · Cognition · doi:10.1016/j.cognition.2009.07.005 · Cited by 920 · see citing works

Computational psychiatry

Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.018 · Cited by 809 · see citing works

Information-seeking, curiosity, and attention: computational and neural mechanisms

Gottlieb, J., Oudeyer, P.-Y., Lopes, M., & Baranes, A. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.001 · Cited by 784 · see citing works

Computational psychiatry: the brain as a phantastic organ

Friston, K. J., Stephan, K. E., Montague, R., & Dolan, R. J. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70275-5 · Cited by 531 · see citing works

The hierarchical basis of neurovisceral integration

Smith, R., Thayer, J. F., Khalsa, S. S., & Lane, R. D. (2017) · Neuroscience &amp; Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.003 · Cited by 523 · see citing works

Choice Certainty Is Informed by Both Evidence and Decision Time

Kiani, R., Corthell, L., & Shadlen, M. N. (2014) · Neuron · doi:10.1016/j.neuron.2014.12.015 · Cited by 470 · see citing works

Allostatic Self-efficacy: A Metacognitive Theory of Dyshomeostasis-Induced Fatigue and Depression

Stephan, K. E., Manjaly, Z. M., Mathys, C. D., Weber, L. A. E., Paliwal, S., Gard, T., Tittgemeyer, M., Fleming, S. M., Haker, H., Seth, A. K., et al. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00550 · Cited by 437 · see citing works

Go and no-go learning in reward and punishment: Interactions between affect and effect

Guitart‐Masip, M., Huys, Q. J. M., Fuentemilla, L., Dayan, P., Düzel, E., & Dolan, R. J. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.04.024 · Cited by 418 · see citing works

Cognitive control over learning: Creating, clustering, and generalizing task-set structure.

Collins, A. G. E., & Frank, M. J. (2013) · Psychological Review · doi:10.1037/a0030852 · Cited by 421 · see citing works

Opponent actor learning (OpAL): Modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive.

Collins, A. G. E., & Frank, M. J. (2014) · Psychological Review · doi:10.1037/a0037015 · Cited by 395 · see citing works

Mood as representation of momentum

Eldar, E., Rutledge, R. B., Dolan, R. J., & Niv, Y. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.07.010 · Cited by 383 · see citing works

Revealing Neurocomputational Mechanisms of Reinforcement Learning and Decision-Making With the hBayesDM Package

Ahn, W., Haines, N., & Zhang, L. (2017) · Computational Psychiatry · doi:10.1162/cpsy_a_00002 · Cited by 354 · see citing works

The dissociable effects of punishment and reward on motor learning

Galea, J. M., Mallia, E., Rothwell, J. C., & Diedrichsen, J. (2015) · Nature Neuroscience · doi:10.1038/nn.3956 · Cited by 359 · see citing works

Over the river, through the woods: cognitive maps in the hippocampus and orbitofrontal cortex

Wikenheiser, A. M., & Schoenbaum, G. M. (2016) · Nature reviews. Neuroscience · doi:10.1038/nrn.2016.56 · Cited by 353 · see citing works

Being a Beast Machine: The Somatic Basis of Selfhood

Seth, A. K., & Tsakiris, M. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.08.008 · Cited by 357 · see citing works

Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation

Dayan, P., & Berridge, K. C. (2014) · Cognitive, Affective, &amp; Behavioral Neuroscience · doi:10.3758/s13415-014-0277-8 · Cited by 357 · see citing works

The anatomy of choice: active inference and agency

Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00598 · Cited by 340 · see citing works

Predictive representations can link model-based reinforcement learning to model-free mechanisms

Russek, E. M., Momennejad, I., Botvinick, M., Gershman, S. J., & Daw, N. D. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005768 · Cited by 321 · see citing works

Negative Symptoms and the Failure to Represent the Expected Reward Value of Actions

Gold, J. M. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.1269 · Cited by 319 · see citing works

The basolateral amygdala in reward learning and addiction

Wassum, K. M., & Izquierdo, A. (2015) · Neuroscience &amp; Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.017 · Cited by 306 · see citing works

A computational framework for the study of confidence in humans and animals

Kepecs, A., & Mainen, Z. F. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0037 · Cited by 305 · see citing works

Striatal Prediction Error Modulates Cortical Coupling

den Ouden, H. E. M., Daunizeau, J., Roiser, J., Friston, K. J., & Stephan, K. E. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4458-09.2010 · Cited by 304 · see citing works

Dysfunctions of decision‐making and cognitive control as transdiagnostic mechanisms of mental disorders: advances, gaps, and needs in current research

Goschke, T. (2014) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1410 · Cited by 293 · see citing works

Reinforcement learning can account for associative and perceptual learning on a visual-decision task

Law, C.-T., & Gold, J. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2304 · Cited by 286 · see citing works

The anatomy of choice: dopamine and decision-making.

Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0481 · Cited by 289 · see citing works

Active inference and agency: optimal control without cost functions

Friston, K., Samothrakis, S., & Montague, R. (2012) · Biological Cybernetics · doi:10.1007/s00422-012-0512-8 · Cited by 241 · see citing works

Attention, learning, and the value of information

Gottlieb, J. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.034 · Cited by 241 · see citing works

Glutamatergic model psychoses: prediction error, learning, and inference

Corlett, P. R., Honey, G. D., Krystal, J. H., & Fletcher, P. C. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.163 · Cited by 229 · see citing works

Mice alternate between discrete strategies during perceptual decision-making

Ashwood, Z. C., Roy, N. A., Stone, I. R., Laboratory, T. I. B., Urai, A. E., Churchland, A. K., Pouget, A., & Pillow, J. W. (2022) · Nature Neuroscience · doi:10.1038/s41593-021-01007-z · Cited by 229 · see citing works

Parallel goal-directed and habitual control of human drug-seeking: Implications for dependence vulnerability.

Hogarth, L., & Chase, H. W. (2011) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/a0022913 · Cited by 225 · see citing works

Depression: a decision-theoretic analysis

Huys, Q. J. M., Daw, N. D., & Dayan, P. (2015) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071714-033928 · Cited by 221 · see citing works

Working Memory Contributions to Reinforcement Learning Impairments in Schizophrenia

Collins, A. G. E., Brown, J. K., Gold, J. M., Waltz, J. A., & Frank, M. J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0989-14.2014 · Cited by 214 · see citing works

Is There a ‘Social’ Brain? Implementations and Algorithms

Lockwood, P. L., Apps, M. A. J., & Chang, S. W. C. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.06.011 · Cited by 202 · see citing works

Error and Expectation in Language Learning: The Curious Absence of Mouses in Adult Speech

Ramscar, M., Dye, M., & McCauley, S. M. (2013) · Language · doi:10.1353/lan.2013.0068 · Cited by 204 · see citing works

Modeling Trait Anxiety: From Computational Processes to Personality

Raymond, J. G., Steele, J. D., & Seriès, P. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00001 · Cited by 203 · see citing works

The Neuroscience of Learning: Beyond the Hebbian Synapse

Gallistel, C. R., & Matzel, L. D. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143807 · Cited by 197 · see citing works

Am i self-conscious? (or does self-organization entail self-consciousness?)

Friston, K. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00579 · Cited by 197 · see citing works

The Basal Ganglia Do Not Select Reach Targets but Control the Urgency of Commitment

Thura, D., & Cisek, P. (2017) · Neuron · doi:10.1016/j.neuron.2017.07.039 · Cited by 195 · see citing works

A reinforcement learning diffusion decision model for value-based decisions

Fontanesi, L., Gluth, S., Spektor, M. S., & Rieskamp, J. (2019) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1554-2 · Cited by 195 · see citing works

Decision Making Under Uncertainty: A Neural Model Based on Partially Observable Markov Decision Processes

Rao, R. P. N. (2010) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2010.00146 · Cited by 190 · see citing works

Bayesian Prediction and Evaluation in the Anterior Cingulate Cortex

Ide, J. S., Shenoy, P., Yu, A. J., & Li, C.-S. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2201-12.2013 · Cited by 185 · see citing works

Granularity and the acquisition of grammatical gender: How order-of-acquisition affects what gets learned

Arnon, I., & Ramscar, M. (2011) · Cognition · doi:10.1016/j.cognition.2011.10.009 · Cited by 177 · see citing works

Estimates of projection overlap and zones of convergence within frontal-striatal circuits

Averbeck, B. B., Lehman, J., Jacobson, M., & Haber, S. N. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.5806-12.2014 · Cited by 179 · see citing works

Motivational neural circuits underlying reinforcement learning

Averbeck, B. B., & Costa, V. D. (2017) · Nature Neuroscience · doi:10.1038/nn.4506 · Cited by 175 · see citing works

Reciprocal relations between cognitive neuroscience and formal cognitive models: opposites attract?

Forstmann, B. U., Wagenmakers, E., Eichele, T., Brown, S. D., & Serences, J. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.04.002 · Cited by 172 · see citing works

Reward-based training of recurrent neural networks for cognitive and value-based tasks

Song, H., Yang, G. R., & Wang, X. (2017) · eLife · doi:10.7554/elife.21492 · Cited by 169 · see citing works

Enhanced cognitive flexibility in reversal learning induced by removal of the extracellular matrix in auditory cortex

Happel, M. F. K., Niekisch, H., Castiblanco Rivera, L. L., Ohl, F. W., Deliano, M., & Frischknecht, R. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1310272111 · Cited by 176 · see citing works

Reinforcement Learning in Patients With Mood and Anxiety Disorders vs Control Individuals

Pike, A. C., & Robinson, O. J. (2022) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2022.0051 · Cited by 168 · see citing works

Midbrain dopamine neurons signal belief in choice accuracy during a perceptual decision

Lak, A., Nomoto, K., Keramati, M., Sakagami, M., & Kepecs, A. (2017) · Current Biology · doi:10.1016/j.cub.2017.02.026 · Cited by 170 · see citing works

Pain: A Precision Signal for Reinforcement Learning and Control

Seymour, B. (2019) · Neuron · doi:10.1016/j.neuron.2019.01.055 · Cited by 167 · see citing works

Reconciling cognitive and affective neuroscience perspectives on the brain basis of emotional experience

Panksepp, J., Lane, R. D., Solms, M., & Smith, R. S. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.09.010 · Cited by 167 · see citing works

Perceptual decision making: drift-diffusion model is equivalent to a Bayesian model

Bitzer, S., Park, H., Blankenburg, F., & Kiebel, S. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00102 · Cited by 153 · see citing works

Action Selection and Action Value in Frontal-Striatal Circuits

Seo, M., Lee, E., & Averbeck, B. B. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.037 · Cited by 161 · see citing works

Assessing inter individual differences with task related functional neuroimaging

Lebreton, M., Bavard, S., Daunizeau, J., & Palminteri, S. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0681-8 · Cited by 160 · see citing works

What’s in a word? How instructions, suggestions, and social information change pain and emotion

Koban, L., Jepma, M., Geuter, S., & Wager, T. D. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.014 · Cited by 155 · see citing works

Animal affect and decision-making

Mendl, M., & Paul, E. S. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.01.025 · Cited by 161 · see citing works

Plan, Activity, and Intent Recognition

Sukthankar, G., Geib, C., Bui, H., Pynadath, D. V., & Goldman, R. P. (2014) · Elsevier eBooks · doi:10.1016/c2012-0-01169-6 · Cited by 157 · see citing works

How instructed knowledge modulates the neural systems of reward learning

Li, J., Delgado, M. R., & Phelps, E. A. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014938108 · Cited by 149 · see citing works

The functional neuroanatomy of decision making: Prefrontal control of thought and action

Coutlee, C. G., & Huettel, S. A. (2011) · Brain Research · doi:10.1016/j.brainres.2011.05.053 · Cited by 153 · see citing works

Signals in Human Striatum Are Appropriate for Policy Update Rather than Value Prediction

Li, J., & Daw, N. D. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.6316-10.2011 · Cited by 149 · see citing works

Where Does Value Come From?

Juechems, K., & Summerfield, C. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.07.012 · Cited by 147 · see citing works

Why do delusions persist?

Corlett, P. R. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.012.2009 · Cited by 146 · see citing works

Dopaminergic and Prefrontal Basis of Learning from Sensory Confidence and Reward Value

Lak, A., Okun, M., Moss, M. M., Gurnani, H., Farrell, K., Wells, M. J., Reddy, C. B., Kepecs, Á., Harris, K. D., & Carandini, M. (2019) · Neuron · doi:10.1016/j.neuron.2019.11.018 · Cited by 128 · see citing works

Free Energy, Value, and Attractors

Friston, K. J., & Ao, P. (2011) · Computational and Mathematical Methods in Medicine · doi:10.1155/2012/937860 · Cited by 140 · see citing works

Orbitofrontal Circuits Control Multiple Reinforcement-Learning Processes

Groman, S. M., Keistler, C., Keip, A. J., Hammarlund, E., Dileone, R., Pittenger, C., Lee, D., & Taylor, J. R. (2019) · Neuron · doi:10.1016/j.neuron.2019.05.042 · Cited by 142 · see citing works

The functional neuroanatomy of decision-making.

Rosenbloom, M., Schmahmann, J., & Price, B. (2012) · The Journal of Neuropsychiatry and Clinical Neurosciences · doi:10.1176/appi.neuropsych.11060139 · Cited by 125 · see citing works

Bayesian modelling of Jumping-to-Conclusions bias in delusional patients

Moutoussis, M., Bentall, R. P., El-Deredy, W., & Dayan, P. (2011) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2010.548678 · Cited by 137 · see citing works

Decision-making under uncertainty: biases and Bayesians

Trimmer, P. C., Houston, A. I., Marshall, J. A. R., Mendl, M., Paul, E. S., & McNamara, J. M. (2011) · Animal Cognition · doi:10.1007/s10071-011-0387-4 · Cited by 137 · see citing works

Moral Learning: Conceptual foundations and normative relevance

Railton, P. (2016) · Cognition · doi:10.1016/j.cognition.2016.08.015 · Cited by 130 · see citing works

A neural network for information seeking

White, J. K., Bromberg-Martin, E. S., Heilbronner, S. R., Zhang, K., Pai, J., Haber, S. N., & Monosov, I. E. (2019) · Nature Communications · doi:10.1038/s41467-019-13135-z · Cited by 129 · see citing works

Computational Rationality as a Theory of Interaction

Oulasvirta, A., Jokinen, J., & Howes, A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517739 · Cited by 128 · see citing works

Dark control: The default mode network as a reinforcement learning agent

Dohmatob, E., Dumas, G., & Bzdok, D. (2020) · Human Brain Mapping · doi:10.1002/hbm.25019 · Cited by 121 · see citing works

Can the neuroeconomics revolution revolutionize psychiatry?

Hasler, G. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.04.011 · Cited by 117 · see citing works

Modeling Human Plan Recognition Using Bayesian Theory of Mind

Baker, C. L., & Tenenbaum, J. B. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-398532-3.00007-5 · Cited by 114 · see citing works

Bayesian Models of Development

Stamps, J. A., & Frankenhuis, W. E. (2016) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2016.01.012 · Cited by 114 · see citing works

Unconscious emotion: A cognitive neuroscientific perspective

Smith, R. S., & Lane, R. D. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.08.013 · Cited by 113 · see citing works

Predictive maps in rats and humans for spatial navigation

de Cothi, W., Nyberg, N., Griesbauer, E.-M., Ghanamé, C., Zisch, F., Lefort, J. M., Fletcher, L., Newton, C., Renaudineau, S., Bendor, D., et al. (2022) · Current Biology · doi:10.1016/j.cub.2022.06.090 · Cited by 109 · see citing works

The many faces of precision (Replies to commentaries on “Whatever next? Neural prediction, situated agents, and the future of cognitive science”)

Clark, A. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00270 · Cited by 108 · see citing works

Adolescent risk-taking in the context of exploration and social influence

Ciranka, S., & van den Bos, W. (2021) · Developmental Review · doi:10.1016/j.dr.2021.100979 · Cited by 112 · see citing works

The perception of probability.

Gallistel, C. R., Krishan, M., Liu, Y., Miller, R., & Latham, P. E. (2014) · Psychological Review · doi:10.1037/a0035232 · Cited by 107 · see citing works

Lapses in perceptual decisions reflect exploration

Pisupati, S., Chartarifsky, L., Khanal, A., & Churchland, A. K. (2021) · eLife · doi:10.7554/elife.55490 · Cited by 105 · see citing works

The neural substrate of prior information in perceptual decision making: a model-based analysis

Forstmann, B. U. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00040 · Cited by 106 · see citing works

A Roadmap for the Development of Applied Computational Psychiatry

Paulus, M., Huys, Q., & Maia, T. (2016) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2016.05.001 · Cited by 108 · see citing works

Reinforcement biases subsequent perceptual decisions when confidence is low, a widespread behavioral phenomenon

Lak, A., Hueske, E., Hirokawa, J., Masset, P., Ott, T., Urai, A. E., Donner, T. H., Carandini, M., Tonegawa, S., Uchida, N., et al. (2020) · eLife · doi:10.7554/elife.49834 · Cited by 95 · see citing works

Opponent control of behavior by dorsomedial striatal pathways depends on task demands and internal state

Bolkan, S. S., Stone, I. R., Pinto, L., Ashwood, Z. C., Iravedra-García, J. M., Herman, A. L., Singh, P., Bandi, A., Cox, J., Zimmerman, C. A., et al. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01021-9 · Cited by 104 · see citing works

Impaired Flexible Reward-Based Decision-Making in Binge Eating Disorder: Evidence from Computational Modeling and Functional Neuroimaging

Reiter, A. M. F., Heinze, H., Schlagenhauf, F., & Deserno, L. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.95 · Cited by 103 · see citing works

Belief state representation in the dopamine system

Babayan, B. M., Uchida, N., & Gershman, S. J. (2018) · Nature Communications · doi:10.1038/s41467-018-04397-0 · Cited by 101 · see citing works

How to set the switches on this thing

Dayan, P. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.05.011 · Cited by 99 · see citing works

Decision-making in schizophrenia: A predictive-coding perspective

Sterzer, P., Voss, M., Schlagenhauf, F., & Heinz, A. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.05.074 · Cited by 100 · see citing works

Cognition and behavior in context: a framework and theories to explain natural resource use decisions in social-ecological systems

Constantino, S. M., Schlüter‬, M., Weber, E. U., & Wijermans, N. (2021) · Sustainability Science · doi:10.1007/s11625-021-00989-w · Cited by 111 · see citing works

Risk-Taking Behavior: Dopamine D2/D3 Receptors, Feedback, and Frontolimbic Activity

Kohno, M., Ghahremani, D. G., Morales, A. M., Robertson, C. L., Ishibashi, K., Morgan, A., Mandelkern, M. A., & London, E. D. (2013) · Cerebral Cortex · doi:10.1093/cercor/bht218 · Cited by 97 · see citing works

Discovery of hierarchical representations for efficient planning

Tomov, M. S., Yagati, S., Kumar, A., Yang, W., & Gershman, S. J. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007594 · Cited by 97 · see citing works

From compulsivity to compulsion: the neural basis of compulsive disorders

Robbins, T. W., Banca, P., & Belin, D. (2024) · Nature reviews. Neuroscience · doi:10.1038/s41583-024-00807-z · Cited by 99 · see citing works

Multiplicity of control in the basal ganglia: computational roles of striatal subregions

Bornstein, A. M., & Daw, N. D. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.02.009 · Cited by 97 · see citing works

On-line confidence monitoring during decision making

Dotan, D., Meyniel, F., & Dehaene, S. (2017) · Cognition · doi:10.1016/j.cognition.2017.11.001 · Cited by 98 · see citing works

Understanding Interpersonal Function in Psychiatric Illness Through Multiplayer Economic Games

King‐Casas, B., & Chiu, P. H. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.03.033 · Cited by 94 · see citing works

The Tortoise and the Hare: Interactions between Reinforcement Learning and Working Memory

Collins, A. G. E. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01238 · Cited by 97 · see citing works

Reward-Guided Learning with and without Causal Attribution

Jocham, G., Brodersen, K. H., Constantinescu, A. O., Kahn, M. C., Ianni, A. M., Walton, M. E., Rushworth, M. F. S., & Behrens, T. E. J. (2016) · Neuron · doi:10.1016/j.neuron.2016.02.018 · Cited by 92 · see citing works

CONNECTIONS BETWEEN C N OMPUTATIONAL AND NEUROBIOLOGICAL PERSPECTIVES ON DECISION MAKING Decision theory, reinforcement learning, and the brain

Dayan, P., & Daw, N. D. (2008)

A Bayesian model of simple value-based decision-making

Rangel, A. (2010) · Frontiers in Neuroscience · doi:10.3389/conf.fnins.2010.03.00167

Decision Making Under Uncertainty: A Neural Model Based on Partially Observable Markov Decision Processes

Rao, R. P. N. (2010) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2010.00146 · Cited by 190 · see citing works

Dynamical Foundations of the Neural Circuit for Bayesian Decision Making

Morita, K. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00239.2009 · Cited by 2 · see citing works

Reward Optimization in the Primate Brain: A Probabilistic Model of Decision Making under Uncertainty

Huang, Y., & Rao, R. P. N. (2013) · PLoS ONE · doi:10.1371/journal.pone.0053344 · Cited by 37 · see citing works