Integrated Bayesian models of learning and decision making for saccadic eye movements
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
The neurophysiology of eye movements has been studied extensively, and several computational models have been proposed for decision-making processes that underlie the generation of eye movements towards a visual stimulus in a situation of uncertainty. One class of models, known as linear rise-to-threshold models, provides an economical, yet broadly applicable, explanation for the observed variability in the latency between the onset of a peripheral visual target and the saccade towards it. So far, however, these models do not account for the dynamics of learning across a sequence of stimuli, and they do not apply to situations in which subjects are exposed to events with conditional probabilities. In this methodological paper, we extend the class of linear rise-to-threshold models to address these limitations. Specifically, we reformulate previous models in terms of a generative, hierarchical model, by combining two separate sub-models that account for the interplay between learning of target locations across trials and the decision-making process within trials. We derive a maximum-likelihood scheme for parameter estimation as well as model comparison on the basis of log likelihood ratios. The utility of the integrated model is demonstrated by applying it to empirical saccade data acquired from three healthy subjects. Model comparison is used (i) to show that eye movements do not only reflect marginal but also conditional probabilities of target locations, and (ii) to reveal subject-specific learning profiles over trials. These individual learning profiles are sufficiently distinct that test samples can be successfully mapped onto the correct subject by a naïve Bayes classifier. Altogether, our approach extends the class of linear rise-to-threshold models of saccadic decision making, overcomes some of their previous limitations, and enables statistical inference both about learning of target locations across trials and the decision-making process within trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 1×
“The decision process can be parameterized by modelling subjects as Bayesian observers who collect evidence about the true state of the world and , combined with their prior expectations , accept one of two competing hypotheses about it ( Knill & Pouget , 2004 ) .”
RELATIVE AND ABSOLUTE STRENGTH OF RESPONSE AS A FUNCTION OF FREQUENCY OF REINFORCEMENT 1, 2
Herrnstein, R. J. (1961) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1961.4-267 · Cited by 2,281
The time course of perceptual choice: The leaky, competing accumulator model.
Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152 · cited 2×
“…Nazir and Jacobs (1991)), it assumes a fixed threshold and a linear increase whose rate is subject to variation across trials, yet fixed within a given trial (for a debate on the relationship between the two approaches see Carpenter and Reddi (2001), Ratcliff (2001), Usher and McClelland (2001)).”
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Neural Basis of a Perceptual Decision in the Parietal Cortex (Area LIP) of the Rhesus Monkey
Shadlen, M. N., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.4.1916 · Cited by 1,755
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · cited 1×
“…might, for example, represent the posterior probabilities of the target hypotheses, as derived from the subject's prior (Basso & Wurtz, 1997, 1998; Platt & Glimcher, 1999) and the sensory evidence (i.e., the likelihood of the data) collected up to that point in time (Carpenter, 2004; Carpenter &…”
Newsome, W., & Pare, E. (1988) · The Journal of Neuroscience · doi:10.1523/jneurosci.08-06-02201.1988 · Cited by 1,615 · cited 1×
“One seminal series of studies is based on the random dot-motion task designed by Newsome and colleagues (Newsome & Pare, 1988).”
Roitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589 · cited 1×
“Based on a reaction time version of the same task (Roitman & Shadlen, 2002), Shadlen and colleagues advanced the hypothesis that rising activity before a saccade, which had also been observed in the frontal eye fields (FEF), represented the ratio of the log likelihoods that the two possible eye…”
Modeling Response Times for Two-Choice Decisions
Ratcliff, R., & Rouder, J. N. (1998) · Psychological Science · doi:10.1111/1467-9280.00067 · Cited by 1,478
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
Neuronal correlates of a perceptual decision
Newsome, W. T., Britten, K. H., & Movshon, J. A. (1989) · Nature · doi:10.1038/341052a0 · Cited by 1,177
Neural Control of Voluntary Movement Initiation
Hanes, D. P., & Schall, J. D. (1996) · Science · doi:10.1126/science.274.5286.427 · Cited by 1,145 · cited 2×
“…the countermanding paradigm; Hanes and Carpenter (1999)) to study how neural signals in the FEFs would finally trigger the initiation of saccades (Hanes & Schall, 1996; Hanes, Thompson, & Schall, 1995; Schall & Thompson, 1999; Thompson, Bichot, & Schall, 1997; Thompson, Hanes, Bichot, & Schall,…”
Psychology and neurobiology of simple decisions
Smith, P. L., & Ratcliff, R. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.01.006 · Cited by 1,051
Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque
Kim, J.-N., & Shadlen, M. N. (1999) · Nature Neuroscience · doi:10.1038/5739 · Cited by 950 · cited 1×
“…Shadlen, Britten, Newsome, and Movshon (1996) suggested a computational explanation of the neuronal mechanisms producing the resulting saccade and provided experimental verification of its key assumptions (Gold & Shadlen, 2000; Kim & Shadlen, 1999; Shadlen et al., 1996; Shadlen & Newsome, 2001).”
Cortical microstimulation influences perceptual judgements of motion direction
Salzman, C. D., Britten, K. H., & Newsome, W. T. (1990) · Nature · doi:10.1038/346174a0 · Cited by 881
Neural computations that underlie decisions about sensory stimuli
Gold, J. I., & Shadlen, M. N. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01567-9 · Cited by 881
Comparing dynamic causal models.
Penny, W. D., Stephan, K. E., Mechelli, A., & Friston, K. J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.03.026 · Cited by 848
Self-citationSynaptic plasticity and dysconnection in schizophrenia
Stephan, K. E., Baldeweg, T., & Friston, K. J. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.10.005 · Cited by 841 · cited 1×
“, 2002) and learning tasks (Stephan et al., 2006).”
Self-citationNeural computation of log likelihood in control of saccadic eye movements
Carpenter, R. H. S., & Williams, M. L. L. (1995) · Nature · doi:10.1038/377059a0 · Cited by 823 · cited 18×
“…state orientation Strong state orientation Unstable transition orientation Stable transition orientation All B T B T B T B T B T B T S-1 7 948 7 985 4 557 5 691 5 685 28 3866 S-2 12 1727 12 1736 11 1554 11 mechanism ( Carpenter & Williams, 1995 ; Leach & Carpenter, 2001 ; Reddi et al., 2003 ) .”
InfluentialMotion perception: seeing and deciding.
Shadlen, M. N., & Newsome, W. T. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.2.628 · Cited by 723
Neural basis of deciding, choosing and acting
Schall, J. D. (2001) · Nature reviews. Neuroscience · doi:10.1038/35049054 · Cited by 528 · cited 2×
“…of a biophysically conceivable mechanism that explains saccade latencies and their variability across trials (for reviews see Glimcher (2001, 2003), Gold and Shadlen (2001), Platt (2002), Ratcliff and Smith (2004), Schall (2001, 2003), Smith and Ratcliff (2004) and Usher and McClelland (2001)).”
Role of frontal eye fields in countermanding saccades: visual, movement, and fixation activity
Hanes, D. P., Patterson, W. F., & Schall, J. D. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.79.2.817 · Cited by 492
NEURAL SELECTION AND CONTROL OF VISUALLY GUIDED EYE MOVEMENTS
Schall, J. D., & Thompson, K. G. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.241 · Cited by 489 · cited 4×
“In their experiment , Schall and Thompson ( 1999 ) trained rhesus monkeys to stare at a central fixation stimulus and , as soon as eight secondary targets appeared , to elicit a saccade towards the oddball .”
InfluentialDYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS
Lau, B., & Glimcher, P. W. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.110-04 · Cited by 485
Modulation of Neuronal Activity in Superior Colliculus by Changes in Target Probability
Basso, M. A., & Wurtz, R. H. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-18-07519.1998 · Cited by 474
The influence of urgency on decision time
Reddi, B. A. J., & Carpenter, R. H. S. (2000) · Nature Neuroscience · doi:10.1038/77739 · Cited by 411 · cited 2×
“Motivated by the question of why saccadic latencies displayed large variance in all of the above tasks, an even simpler reaction time paradigm was investigated by Carpenter and colleagues (Carpenter & Williams, 1995; Reddi & Carpenter, 2000).”
Bayesian Computation in Recurrent Neural Circuits
Rao, R. P. N. (2004) · Neural Computation · doi:10.1162/08997660460733976 · Cited by 252 · cited 2×
“Furthermore, the way the brain might implement Bayesian inference can be expressed in alternative mathematical ways (Jazayeri & Movshon, 2006; Ma, Beck, Latham, & Pouget, 2006; Rao, 2004).”
Accuracy, Information, and Response Time in a Saccadic Decision Task
Reddi, B. A. J., Asrress, K. N., & Carpenter, R. H. S. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00689.2002 · Cited by 217
LINEAR-NONLINEAR-POISSON MODELS OF PRIMATE CHOICE DYNAMICS
Corrado, G. S., Sugrue, L. P., Seung, H. S., & Newsome, W. T. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.23-05 · Cited by 206
The dynamics of choice among multiple alternatives
McMillen, T., & Holmes, P. (2006) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2005.10.003 · Cited by 153
Extended LATER model can account for trial-by-trial variability of both pre- and post-processes
Nakahara, H., Nakamura, K., & Hikosaka, O. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.07.001 · Cited by 45 · cited 3×
“…such as arrangements of multiple LATER units in parallel (Carpenter, 2004; Robinson, 1973), mixture models (Nakahara, Nakamura, & Hikosaka, 2006), or the assumption that both the rate of rise and the baseline level of the decision signal are trial-by-trial random variables (Nakahara et al., 2006).”
Cited by
Bayesian model selection for group studies
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.025 · Cited by 1,423
Self-citationAttention, uncertainty, and free-energy
Feldman, H., & Friston, K. J. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00215 · Cited by 1,365
“For example, the latency of saccades to a target can be reduced if the target is more likely to appear on one side – and this relationship can be learned in as few as 150 trials (Carpenter and Williams, 1995; Anderson and Carpenter, 2006; Brodersen et al., 2008).”
Self-citationTen simple rules for dynamic causal modeling
Stephan, K. E., Penny, W. D., Moran, R. J., den Ouden, H. E. M., Daunizeau, J., & Friston, K. J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.11.015 · Cited by 803
“An implementation of this procedure will be available in forthcoming SPM versions. competing models of learning and decision making (Brodersen et al., 2008; den Ouden et al., submitted for publication; Hampton et al., 2006).”
Self-citationA Bayesian foundation for individual learning under uncertainty
Mathys, C. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00039 · Cited by 655
Striatal Prediction Error Modulates Cortical Coupling
den Ouden, H. E. M., Daunizeau, J., Roiser, J., Friston, K. J., & Stephan, K. E. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4458-09.2010 · Cited by 304
“For example, human subjects can infer changing conditional probabilities among sensory events (Behrens et al., 2007; Brodersen et al., 2008), even when these probabilities are not relevant for overt behavior (den Ouden et al., 2009).”
Self-citation
Metadata
- Authors
- Brodersen, K. H., Penny, W. D., Harrison, L. M., Daunizeau, J., Ruff, C. C., Duzel, E., Friston, K. J., & Stephan, K. E.
- Venue
- Neural Networks
- Publisher
- Elsevier BV
- Published
- 2008-11
- Volume
- 21
- Issue
- 9
- Pages
- 1247-1260
- ISSN
- 0893-6080 (ISSN-L)
- OpenAlex
- W2012230597
- Cited by
- 40
- References
- 31
- FWCI
- 1.95
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.