The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Reward rate optimization in two-alternative decision making: Empirical tests of theoretical predictions.
Open accessAbstract
The drift-diffusion model (DDM) implements an optimal decision procedure for stationary, 2-alternative forced-choice tasks. The height of a decision threshold applied to accumulating information on each trial determines a speed-accuracy tradeoff (SAT) for the DDM, thereby accounting for a ubiquitous feature of human performance in speeded response tasks. However, little is known about how participants settle on particular tradeoffs. One possibility is that they select SATs that maximize a subjective rate of reward earned for performance. For the DDM, there exist unique, reward-rate-maximizing values for its threshold and starting point parameters in free-response tasks that reward correct responses (R. Bogacz, E. Brown, J. Moehlis, P. Holmes, & J. D. Cohen, 2006). These optimal values vary as a function of response-stimulus interval, prior stimulus probability, and relative reward magnitude for correct responses. We tested the resulting quantitative predictions regarding response time, accuracy, and response bias under these task manipulations and found that grouped data conformed well to the predictions of an optimally parameterized DDM.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Simplex Method for Function Minimization
Nelder, J. A., & Mead, R. (1965) · The Computer Journal · doi:10.1093/comjnl/7.4.308 · Cited by 28,905
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513 · cited 6×
“As a description of evidence integration, it also follows directly from the assumption of sequential sampling from one of two Gaussian distributions with equal variance c(2) and means equal to A and A, respectively (Ratcliff, 1978); in the terminology of signal detection theory, 0, and d’ 2Ac (Green & Swets, 1966).”
BackgroundMethodInfluentialThe Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059 · cited 4×
“…were greater than 60:40 and RSI was less than 1 s.7 7 In contrast to our difficulty in fitting the DDM to data produced by unequally likely stimuli, Ratcliff and McKoon (2008) were able to fit data reliably with RSI values comparable to our fastest condition and with a stimulus ratio of 75:25.”
MethodInfluentialThe time course of perceptual choice: The leaky, competing accumulator model.
Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152 · cited 3×
“…same approach is applicable to models such as the Ornstein– Uhlenbeck process incorporated into decision field theory (Busemeyer & Townsend, 1993) and the leaky-competing accumulator model of Usher and McClelland (2001); these models, like the extended DDM, contain the pure DDM as a special case.”
BackgroundMethodNeural Basis of a Perceptual Decision in the Parietal Cortex (Area LIP) of the Rhesus Monkey
Shadlen, M. N., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.4.1916 · Cited by 1,755
Roitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589 · cited 1×
“…physiological research on the neural mechanisms that may underlie this type of decision making (e.g., Carpenter & Williams, 1995; Gold & Shadlen, 2002; Hanes & Schall, 1996; Ratcliff, Cherian, & Segraves, 2003; Roitman & Shadlen, 2002; Schall, 2001; Shadlen & Newsome, 2001; Smith & Ratcliff, 2004).”
BackgroundModeling Response Times for Two-Choice Decisions
Ratcliff, R., & Rouder, J. N. (1998) · Psychological Science · doi:10.1111/1467-9280.00067 · Cited by 1,478
Speed-accuracy tradeoff and information processing dynamics
Wickelgren, W. A. (1977) · Acta Psychologica · doi:10.1016/0001-6918(77)90012-9 · Cited by 1,304 · cited 2×
“Such a tradeoff between speed and accuracy has long been recognized as a ubiquitous feature of human behavior in speeded response tasks (Fitts, 1966; Garrett, 1922; Pachella & Pew, 1968; Schouten & Bekker, 1967; Wickelgren, 1977).”
BackgroundNeural Control of Voluntary Movement Initiation
Hanes, D. P., & Schall, J. D. (1996) · Science · doi:10.1126/science.274.5286.427 · Cited by 1,145
Ratcliff, R., & Tuerlinckx, F. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196302 · Cited by 838 · cited 20×
“This was done to produce a substantial sample of error RTs, which is useful for constraining fits of the DDM (Ratcliff & Tuerlinckx, 2002).”
BackgroundMethodInfluential
Cited by
Diffusion decision model: Current issues and history
Ratcliff, R., Smith, P. L., Brown, S. D., & McKoon, G. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.01.007 · Cited by 1,630
“An alternative definition of optimality is reward rate maximization [76], defined as maximizing the number of correct decisions (and the associated reward) per unit time [72,77–81].”
BackgroundThe speed-accuracy tradeoff: history, physiology, methodology, and behavior
Heitz, R. P. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00150 · Cited by 938
Cognitive effort: A neuroeconomic approach
Westbrook, A., & Braver, T. S. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-015-0334-y · Cited by 606
A tutorial on Bayesian nonparametric models
Gershman, S. J., & Blei, D. M. (2012) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2011.08.004 · Cited by 605
Brain plasticity through the life span: Learning to learn and action video games
Bavelier, D., Green, C. S., Pouget, A., & Schrater, P. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-060909-152832 · Cited by 541
Elapsed Decision Time Affects the Weighting of Prior Probability in a Perceptual Decision Task
Hanks, T. D., Mazurek, M. E., Kiani, R., Hopp, E., & Shadlen, M. N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.5613-10.2011 · Cited by 378
Bias in the Brain: A Diffusion Model Analysis of Prior Probability and Potential Payoff
Mulder, M. J., Wagenmakers, E.-J., Ratcliff, R., Boekel, W., & Forstmann, B. U. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4156-11.2012 · Cited by 421
Perceptual Decision Making in Rodents, Monkeys, and Humans
Hanks, T. D., & Summerfield, C. (2017) · Neuron · doi:10.1016/j.neuron.2016.12.003 · Cited by 372
Suboptimality in perceptual decision making
Rahnev, D., & Denison, R. N. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000936 · Cited by 342
The Computational and Neural Basis of Cognitive Control: Charted Territory and New Frontiers
Botvinick, M. M., & Cohen, J. D. (2014) · Cognitive Science · doi:10.1111/cogs.12126 · Cited by 322
Self-citationA Model of Interval Timing by Neural Integration
Simen, P., Balci, F., deSouza, L., Cohen, J. D., & Holmes, P. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.3121-10.2011 · Cited by 315
Self-citationThe effects of aging on the speed–accuracy compromise: Boundary optimality in the diffusion model.
Starns, J. J., & Ratcliff, R. (2010) · Psychology and Aging · doi:10.1037/a0018022 · Cited by 310
Cognitive Control: Core Constructs and Current Considerations
Cohen, J. D. (2017) · The Wiley Handbook of Cognitive Control · doi:10.1002/9781118920497.ch1 · Cited by 179
Self-citationSummerfield, C., & Tsetsos, K. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00070 · Cited by 167
Mulder, M. J., Bos, D., Weusten, J. M. H., van Belle, J., van Dijk, S. C., Simen, P., van Engeland, H., & Durston, S. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.07.031 · Cited by 131
Self-citationDivergent Research Methods Limit Understanding of Working Memory Training
Pergher, V., Shalchy, M. A., Pahor, A., Van Hulle, M. M., Jaeggi, S. M., & Seitz, A. R. (2020) · Journal of Cognitive Enhancement · doi:10.1007/s41465-019-00134-7 · Cited by 56
“Feedback is usually delivered based on participants’ accuracy and/or response speed and is typically designed to encourage participants to optimize their performance to achieve better learning and/or greater reward (Simen et al. 2009).”
Background
Metadata
- Authors
- Simen, P., Contreras, D., Buck, C., Hu, P., Holmes, P., & Cohen, J. D.
- Venue
- Journal of Experimental Psychology: Human Perception and Performance
- Published
- 2009
- Volume
- 35
- Issue
- 6
- Pages
- 1865-1897
- ISSN
- 0096-1523 (ISSN-L)
- 1939-1277
- OpenAlex
- W2042880323
- Cited by
- 218
- References
- 17
- FWCI
- 6.55
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.