Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability
Open accessAbstract
Three methods for fitting the diffusion model (Ratcliff, 1978) to experimental data are examined. Sets of simulated data were generated with known parameter values, and from fits of the model, we found that the maximum likelihood method was better than the chi-square and weighted least squares methods by criteria of bias in the parameters relative to the parameter values used to generate the data and standard deviations in the parameter estimates. The standard deviations in the parameter values can be used as measures of the variability in parameter estimates from fits to experimental data. We introduced contaminant reaction times and variability into the other components of processing besides the decision process and found that the maximum likelihood and chi-square methods failed, sometimes dramatically. But the weighted least squares method was robust to these two factors. We then present results from modifications of the maximum likelihood and chi-square methods, in which these factors are explicitly modeled, and show that the parameter values of the diffusion model are recovered well. We argue that explicit modeling is an important method for addressing contaminants and variability in nondecision processes and that it can be applied in any theoretical approach to modeling reaction time.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The 0.3 s cutoff was chosen as a conservative threshold for fast outliers based on best practices in the drift diffusion modeling literature.
“The 0.3 s cutoff was chosen as a conservative threshold for fast outliers based on best practices in the drift diffusion modeling literature 49 , and also given that even the simplest perceptual discrimination decisions are rarely made faster than 0.3 s.”
From Crowdsourcing punishment: Individuals reference group preferences to inform their own punitive decisions (2019) · cites this paper as [49]
In “Contaminant Reaction Times” (page not provided), the paper uses 300 msec as an example of an initial cutoff for examining fast responses. It then recommends raising the cutoff and checking accuracy to determine an appropriate value; it does not establish 0.3 s as a generally conservative fixed threshold. (LLM, conf=0.85)
Experimental — accuracy not yet measuredThe 5 s cutoff was chosen as a conservative threshold for slow outliers based on DDM characterization for relatively fast decisions of 1-1.5s.
“Similarly, given that DDMs have been best characterized for relatively fast decisions of 1–1.5s 37 , we chose to threshold slow outliers at a conservative cutoff of 5 s, which excluded a small number of trials 49 .”
From Crowdsourcing punishment: Individuals reference group preferences to inform their own punitive decisions (2019) · cites this paper as [49]
In “The Diffusion Model” (page unavailable), the paper says diffusion models best apply to two-choice decisions whose reaction times do not average much over 1 second. In “Contaminant Reaction Times” (page unavailable), it recommends setting a slow-outlier cutoff above which few responses fall, depending on the research goal. It does not specify a 5-second cutoff or derive one from the model’s usual decision times; the citing authors’ choice of 5 seconds is their own. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
An introduction to probability theory and its applications
(1958) · Journal of the Franklin Institute · doi:10.1016/0016-0032(58)90688-4 · Cited by 29,620 · see citing works
A Simplex Method for Function Minimization
Nelder, J. A., & Mead, R. (1965) · The Computer Journal · doi:10.1093/comjnl/7.4.308 · Cited by 28,905 · see citing works
Draper, N. R., & Smith, H. (2005) · Technometrics · doi:10.1198/tech.2005.s303 · Cited by 17,993 · see citing works
Linear Statistical Inference and its Applications
Rao, C. R. (1973) · Wiley series in probability and statistics · doi:10.1002/9780470316436 · Cited by 10,474 · see citing works
Jeffreys, H., Moran, P. A. P., & Chatfield, C. (1922) · Nature · doi:10.1038/109132a0 · Cited by 7,837 · see citing works
The Advanced Theory of Statistics.
Clarke, G. M., Kendall, M. G., & Stuart, A. (1978) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2344782 · Cited by 6,727 · see citing works
An Introduction to Probability Theory and Its Applications.
Bharucha-Reid, A. T., & Feller, W. (1967) · American Mathematical Monthly · doi:10.2307/2314609 · Cited by 6,180 · see citing works
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513 · see citing works
Self-citationZiegel, E. R., Lehmann, E. L., & Casella, G. (1999) · Technometrics · doi:10.2307/1270597 · Cited by 4,203 · see citing works
Linear Statistical Inference and Its Applications.
Robertson, C., & Rao, C. R. (1975) · Biometrics · doi:10.2307/2529568 · Cited by 3,611 · see citing works
Bain, L. J., Draper, N. R., & Smith, H. (1967) · Technometrics · doi:10.2307/1266329 · Cited by 3,327 · see citing works
Methods for dealing with reaction time outliers.
Ratcliff, R. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.3.510 · Cited by 2,142 · see citing works
Self-citationDecision field theory: a dynamic-cognitive approach to decision making in an uncertain environment.
Busemeyer, J., & Townsend, J. (1993) · Psychology Review · doi:10.1037/0033-295x.100.3.432 · Cited by 2,000 · see citing works
Seber, G. A. F., & Wild, C. J. (1989) · Wiley series in probability and statistics · doi:10.1002/0471725315 · Cited by 1,962 · see citing works
The Advanced Theory of Statistics.
Kendall, M. G., & Stuart, A. (1968) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2986781 · Cited by 1,584 · see citing works
Modeling Response Times for Two-Choice Decisions
Ratcliff, R., & Rouder, J. N. (1998) · Psychological Science · doi:10.1111/1467-9280.00067 · Cited by 1,478 · see citing works
Self-citationThe Advanced Theory of Statistics.
Cox, D. R., Kendall, M. G., & Stuart, A. (1967) · Biometrika · doi:10.2307/2335072 · Cited by 1,375 · see citing works
Lehmann, E. L. (1983) · Springer eBooks · doi:10.1007/978-1-4757-2769-2 · Cited by 1,357 · see citing works
A Comparison of Sequential Sampling Models for Two-Choice Reaction Time.
Ratcliff, R., & Smith, P. L. (2004) · Psychological Review · doi:10.1037/0033-295x.111.2.333 · Cited by 1,227 · see citing works
Self-citationGroup reaction time distributions and an analysis of distribution statistics.
Ratcliff, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.446 · Cited by 1,025 · see citing works
Self-citationInformation theory of choice-reaction times
Laming, D. (1968) · Medical Entomology and Zoology · Cited by 952 · see citing works
The Advanced Theory of Statistics.
Watson, G. S., Kendall, M. G., Stuart, A., & Ord, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288735 · Cited by 921 · see citing works
Multialternative decision field theory: A dynamic connectionst model of decision making.
Roe, R. M., Busemeyer, J. R., & Townsend, J. T. (2001) · Psychological Review · doi:10.1037/0033-295x.108.2.370 · Cited by 765 · see citing works
Encyclopedia of Statistical Sciences.
Tanur, J. M., Casella, G., Dykstra, R. L., Finster, M., Gaver, D. P., Greenhouse, J. B., Iversen, G. R., Jasso, G., Kmenta, J., Press, S. J., et al. (1989) · Journal of the American Statistical Association · doi:10.2307/2289675 · Cited by 728 · see citing works
The Advanced Theory of Statistics
Champernowne, D. G., & Kendall, M. G. (1947) · The Economic Journal · doi:10.2307/2225825 · Cited by 702 · see citing works
Models for choice-reaction time
Stone, M. (1960) · Psychometrika · doi:10.1007/bf02289729 · Cited by 696 · see citing works
Connectionist and diffusion models of reaction time.
Ratcliff, R., Zandt, T. V., & McKoon, G. (1999) · Psychological Review · doi:10.1037/0033-295x.106.2.261 · Cited by 588 · see citing works
Self-citationA Diffusion Model Account of the Lexical Decision Task.
Ratcliff, R., Gómez, P., & McKoon, G. (2004) · Psychological Review · doi:10.1037/0033-295x.111.1.159 · Cited by 579 · see citing works
Self-citationSilvey, S. D. (1976) · Routledge eBooks · doi:10.1201/9780203738641 · Cited by 559 · see citing works
Decision Processes in Visual Perception
(1979) · Elsevier eBooks · doi:10.1016/c2013-0-11654-6 · Cited by 511 · see citing works
A Sequential Theory of Psychological Discrimination
Link, S. W., & Heath, R. A. (1975) · Psychometrika · doi:10.1007/bf02291481 · Cited by 492 · see citing works
Retrieval processes in recognition memory.
Ratcliff, R., & Murdock, B. B. (1976) · Psychological Review · doi:10.1037/0033-295x.83.3.190 · Cited by 467 · see citing works
Self-citationEffects of truncation on reaction time analysis.
Ulrich, R., & Miller, J. O. (1994) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.123.1.34 · Cited by 379 · see citing works
Evidence for an Accumulator Model of Psychophysical Discrimination
VICKERS, D. (1970) · Ergonomics · doi:10.1080/00140137008931117 · Cited by 369 · see citing works
Ratcliff, R. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196283 · Cited by 339 · see citing works
Self-citationHow to fit a response time distribution
Zandt, T. V. (2000) · Psychonomic Bulletin & Review · doi:10.3758/bf03214357 · Cited by 335 · see citing works
The effects of aging on reaction time in a signal detection task.
Ratcliff, R., Thapar, A., & McKoon, G. (2001) · Psychology and Aging · doi:10.1037/0882-7974.16.2.323 · Cited by 331 · see citing works
Self-citationTheoretical interpretations of the speed and accuracy of positive and negative responses.
Ratcliff, R. (1985) · Psychology Review · doi:10.1037/0033-295x.92.2.212 · Cited by 294 · see citing works
Self-citationA theory of order relations in perceptual matching.
Ratcliff, R. (1981) · Psychological Review · doi:10.1037/0033-295x.88.6.552 · Cited by 265 · see citing works
Self-citationBalota, D. A., & Spieler, D. H. (1999) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.128.1.32 · Cited by 254 · see citing works
The relative judgment theory of two choice response time
Link, S. W. (1975) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(75)90053-x · Cited by 251 · see citing works
Dynamic Stochastic Models for Decision Making under Time Constraints
Diederich, A. (1997) · Journal of Mathematical Psychology · doi:10.1006/jmps.1997.1167 · Cited by 244 · see citing works
Quantile maximum likelihood estimation of response time distributions
Heathcote, A., Brown, S. D., & Mewhort, D. J. K. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196299 · Cited by 241 · see citing works
A diffusion model account of masking in two-choice letter identification.
Ratcliff, R., & Rouder, J. N. (2000) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.26.1.127 · Cited by 238 · see citing works
Self-citationContinuous versus discrete information processing: Modeling accumulation of partial information.
Ratcliff, R. (1988) · Psychological Review · doi:10.1037/0033-295x.95.2.238 · Cited by 231 · see citing works
Self-citationThe accumulator model of two-choice discrimination
Smith, P. L., & Vickers, D. (1988) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(88)90043-0 · Cited by 223 · see citing works
Psychophysically principled models of visual simple reaction time.
Smith, P. L. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.567 · Cited by 218 · see citing works
Balota, D. A., & Spieler, D. H. (1999) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.128.1.32 · Cited by 202 · see citing works
A Recruitment Theory of Simple Behavior
LaBerge, D. (1962) · Psychometrika · doi:10.1007/bf02289645 · Cited by 193 · see citing works
Correction for fast guessing and the speed-accuracy tradeoff in choice reaction time
Yellott, J. I. (1971) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(71)90011-3 · Cited by 186 · see citing works
A diffusion model account of masking in two-choice letter identification.
Ratcliff, R., & Rouder, J. N. (2000) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.26.1.127 · Cited by 182 · see citing works
Self-citationThe elusive tradeoff: Speed vs accuracy in visual discrimination tasks
Swensson, R. G. (1972) · Perception & Psychophysics · doi:10.3758/bf03212837 · Cited by 171 · see citing works
Fundamental derivations from decision field theory
Busemeyer, J. R., & Townsend, J. T. (1992) · Mathematical Social Sciences · doi:10.1016/0165-4896(92)90043-5 · Cited by 161 · see citing works
Fast guesses in choice reaction time
Ollman, R. (1966) · Psychonomic Science · doi:10.3758/bf03328004 · Cited by 154 · see citing works
SOME ALTERNATIVE STOCHASTIC MODELS OF CHOICE1
Audley, R., & Pike, A. (1965) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1965.tb00342.x · Cited by 147 · see citing works
Retrieval processes in recognition
Mandler, G., & Boeck, W. J. (1974) · Memory & Cognition · doi:10.3758/bf03198129 · Cited by 126 · see citing works
Zandt, T. V., & Ratcliff, R. (1995) · Psychonomic Bulletin & Review · doi:10.3758/bf03214411 · Cited by 115 · see citing works
Self-citationA note on modeling accumulation of information when the rate of accumulation changes over time
Ratcliff, R. (1980) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(80)90006-1 · Cited by 112 · see citing works
Self-citationStrategies and automaticity: I. Basic findings and conceptual framework.
Strayer, D. L., & Kramer, A. F. (1994) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.20.2.318 · Cited by 102 · see citing works
Anderson, O. D., & Silvey, S. D. (1976) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2988138 · Cited by 101 · see citing works
Time‐dependent Poisson counter models of response latency in simple judgment
Smith, P. L., & Zandt, T. V. (2000) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711000159349 · Cited by 91 · see citing works
A comparison of four methods for simulating the diffusion process
Tuerlinckx, F., Maris, E., Ratcliff, R., & de Boeck, P. A. L. (2001) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195402 · Cited by 82 · see citing works
Self-citationGrouping corrections and maximum likelihood equations
Lindley, D. V. (1950) · Mathematical Proceedings of the Cambridge Philosophical Society · doi:10.1017/s0305004100025512 · Cited by 63 · see citing works
Pike, A. R. (1966) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1966.tb00351.x · Cited by 59 · see citing works
Discriminating between the frequency of occurrence of two alternative events
Vickers, D., Caudrey, D., & Willson, R. (1971) · Acta Psychologica · doi:10.1016/0001-6918(71)90018-7 · Cited by 56 · see citing works
Cheng, R. C. H., & Amin, N. A. K. (1981) · Technometrics · doi:10.1080/00401706.1981.10486295 · Cited by 52 · see citing works
Cheng, R. C. H., & Amin, N. A. K. (1981) · Technometrics · doi:10.2307/1267789 · Cited by 42 · see citing works
Diffusion and Random Walk Processes
Smith, P. L., & Ratcliff, R. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.43037-0 · Cited by 30 · see citing works
Self-citationObtaining meaningful results from Fourier deconvolution of reaction time data.
Smith, P. L. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.533 · Cited by 19 · see citing works
Diffusion and Random Walk Processes
Ratcliff, R. (2001) · Elsevier eBooks · doi:10.1016/b0-08-043076-7/00620-3 · Cited by 17 · see citing works
Self-citationEffects of truncation on reaction time
Ullrich, R., & Miller, J. (1994) · Cited by 14 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Audley, R. J., & Pike, A. R. (1965). Some alternative stochastic mod- els of choice. British Journal of Mathematical & Statistical Psychol- ogy, 18, 207-225.
- Gill, P. E., Murray, W., Saunders, M. A., & Wright, M. H. (1998). User's guide for NPSOL 5.0: A Fortran package for nonlinear pro- gramming (Tech. Rep. SOL 86-1). Stanford: Stanford University, Sys- tems Optimization Laboratory.
- Jeffreys, H. (1961). Theory of probability (3rd ed.). Oxford: Oxford University Press.
- Link, S. W. (1975). The relative judgement theory of two choice re- sponse time. Journal of Mathematical Psychology, 12, 114-135.
Cited by
Sorted by citations
The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059 · see citing works
Self-citationDiffusion decision model: Current issues and history
Ratcliff, R., Smith, P. L., Brown, S. D., & McKoon, G. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.01.007 · Cited by 1,630 · see citing works
“The standard model that we will discuss was developed by Ratcliff in the 1970s [2] and has only changed in assuming a single diffusion process instead of racing processes [3] and in adding across trial variability in starting point [4,5] and nondecision time [6].”
MethodSelf-citationHDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python
Wiecki, T. V., Sofer, I., & Frank, M. J. (2013) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2013.00014 · Cited by 1,047 · see citing works
Psychology and neurobiology of simple decisions
Smith, P. L., & Ratcliff, R. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.01.006 · Cited by 1,051 · see citing works
Self-citationTwo-stage dynamic signal detection: A theory of choice, decision time, and confidence.
Pleskac, T. J., & Busemeyer, J. R. (2010) · Psychological Review · doi:10.1037/a0019737 · Cited by 722 · see citing works
Inhibitory control in mind and brain: An interactive race model of countermanding saccades.
Boucher, L., Palmeri, T. J., Logan, G. D., & Schall, J. D. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.376 · Cited by 485 · see citing works
Ratcliff, R., Hasegawa, Y. T., Hasegawa, R. P., Smith, P. L., & Segraves, M. A. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00393.2006 · Cited by 236 · see citing works
Self-citationA ballistic model of choice response time
Brown, S., & Heathcote, A. (2005) · Psychological Review · doi:10.1037/0033-295x.112.1.117 · Cited by 228 · see citing works
From salience to saccades: multiple-alternative gated stochastic accumulator model of visual search
Purcell, B. A., Schall, J. D., Logan, G. D., & Palmeri, T. J. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4622-11.2012 · Cited by 179 · see citing works
Karalunas, S. L., Huang-Pollock, C. L., & Nigg, J. T. (2012) · Neuropsychology · doi:10.1037/a0029936 · Cited by 104 · see citing works
Modeling individual differences in response time and accuracy in numeracy
Ratcliff, R., Thompson, C. A., & McKoon, G. (2015) · Cognition · doi:10.1016/j.cognition.2014.12.004 · Cited by 77 · see citing works
Self-citationUnconscious information changes decision accuracy but not confidence
Vlassova, A., Donkin, C., & Pearson, J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403619111 · Cited by 70 · see citing works
Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making
Franzen, L., Delis, I., De Sousa, G., Kayser, C., & Philiastides, M. G. (2020) · Nature Communications · doi:10.1038/s41467-020-19306-7 · Cited by 57 · see citing works
Son, J.-Y., Bhandari, A., & FeldmanHall, O. (2019) · Scientific Reports · doi:10.1038/s41598-019-48050-2 · Cited by 37 · see citing works
From bad to worse: Symbolic equivalence and opposition in fear generalisation
Bennett, M., Hermans, D., Dymond, S., Vervoort, E., & Baeyens, F. (2015) · Cognition and Emotion · doi:10.1080/02699931.2014.973833 · Cited by 27 · see citing works
Cochrane, A., Sims, C. R., Bejjanki, V. R., Green, C. S., & Bavelier, D. (2023) · npj Science of Learning · doi:10.1038/s41539-023-00168-9 · Cited by 20 · see citing works
Evidence accumulation and neural correlates of uncertainty in obsessive-compulsive disorder
Zhao, Y.-J., Zhang, Y., Wang, Q., Manssuer, L., Cui, H., Ding, Q., Sun, B., Liu, W., & Voon, V. (2023) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2023.05.011 · Cited by 8 · see citing works
- Authors
- Ratcliff, R., & Tuerlinckx, F.
- Affiliations
- Northwestern University (US)
- KU Leuven (BE)
- Corresponding author
- Ratcliff, Roger
- Venue
- Psychonomic Bulletin & Review
- Published
- 2002-09
- Volume
- 9
- Issue
- 3
- Pages
- 438-481
- ISSN
- 1069-9384 (ISSN-L)
- 1531-5320
- PMC
- PMC2474747
- OpenAlex
- W2006388199
- Cited by
- 838
- References
- 71
- Citations by year
- 2026: 34 · 2025: 39 · 2024: 51 · 2023: 53 · 2022: 51 · 2021: 44 · 2020: 56 · 2019: 58 · 2018: 62 · 2017: 38 · 2016: 50 · 2015: 44 · 2014: 39 · 2013: 23 · 2012: 30
- FWCI
- 7.82
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Psychonomic Bulletin & Review (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Lirias (KU Leuven) (submittedVersion, other-oa)
- Funders
- National Institute on Aging (AG17083, R01AG017083, R01 AG17083)
- National Institute of Mental Health (R37MH044640, MH01891, K05MH001891, R37 MH 44640, MH 44640, K05 MH 01891)
- National Institute on Deafness and Other Communication Disorders (R01 DC 01240, R01DC001240)
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- diffusion models, parameter estimation, maximum likelihood estimation, chi-square fitting, weighted least squares, parameter variation
- MeSH terms
- Humans, Reaction Time, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review