The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
The ‘Heuristics and Biases’ Bias in Expert Elicitation
Abstract
Summary: In the early 1970s Tversky and Kahneman published a series of papers on ‘heuristics and biases’ describing human inadequacies in assessing probabilities, culminating in a highly popular article in Science. This seminal research has been heavily cited in many fields, including statistics, as the definitive research on probability assessment. Curiously, although this work was debated at the time and more recent work has largely refuted many of the claims, this apparent heuristics and biases bias in elicitation research has gone unremarked. Over a decade of research into the frequency effect, the importance of framing, and cognitive models more generally, has been almost completely ignored by the statistical literature on expert elicitation. To remedy this situation, this review offers a guide to the psychological research on assessing probabilities, both old and new, and gives concrete guidelines for eliciting expert knowledge.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Availability: A heuristic for judging frequency and probability
Tversky, A., & Kahneman, D. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90033-9 · Cited by 9,984
Judgment under Uncertainty: Heuristics and Biases
(1982) · doi:10.1017/cbo9780511809477 · Cited by 8,240
On the psychology of prediction.
Kahneman, D., & Tversky, A. (1973) · Psychological Review · doi:10.1037/h0034747 · Cited by 6,202
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
Perception and the Representative Design of Psychological Experiments
Brunswik, E. (1956) · doi:10.1525/9780520350519 · Cited by 2,974
Calibration of probabilities: the state of the art to 1980
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982) · Judgment under Uncertainty · doi:10.1017/cbo9780511809477.023 · Cited by 1,967
Probabilistic mental models: a Brunswikian theory of confidence
Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991) · Psychological Review · doi:10.1037/0033-295x.98.4.506 · Cited by 1,506
Cosmides, L. (1996) · Cognition · doi:10.1016/0010-0277(95)00664-8 · Cited by 1,293
Support theory: a nonextensional representation of subjective probability
Tversky, A., & Koehler, D. J. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.547 · Cited by 1,167
Cited by
Eliciting Expert Knowledge in Conservation Science
MARTIN, T. G., BURGMAN, M. A., FIDLER, F., KUHNERT, P. M., LOW‐CHOY, S., MCBRIDE, M., & MENGERSEN, K. (2012) · Conservation Biology · doi:10.1111/j.1523-1739.2011.01806.x · Cited by 829
Archaeological assessment reveals Earth’s early transformation through land use
Stephens, L., Fuller, D., Boivin, N., Rick, T., Gauthier, N., Kay, A., Marwick, B., Armstrong, C. G., Barton, C. M., Denham, T., et al. (2019) · Science · doi:10.1126/science.aax1192 · Cited by 608
A guide to eliciting and using expert knowledge in Bayesian ecological models
Kuhnert, P. M., Martin, T. G., & Griffiths, S. P. (2010) · Ecology Letters · doi:10.1111/j.1461-0248.2010.01477.x · Cited by 441
Guidance on Expert Knowledge Elicitation in Food and Feed Safety Risk Assessment
Authority, E. F. S. (2014) · EFSA Journal · doi:10.2903/j.efsa.2014.3734 · Cited by 330
Choy, S. L., O'Leary, R., & Mengersen, K. (2009) · Ecology · doi:10.1890/07-1886.1 · Cited by 283
Metadata
- Authors
- Kynn, M.
- Venue
- Journal of the Royal Statistical Society Series A: Statistics in Society
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-09-18
- Volume
- 171
- Issue
- 1
- Pages
- 239-264
- ISSN
- 0964-1998 (ISSN-L)
- 1467-985X
- OpenAlex
- W2014977541
- Cited by
- 222
- References
- 17
- FWCI
- 5.37
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The ‘Heuristics and Biases’ Bias in Expert Elicitation. https://app.cochat.ai/papers/10.1111/j.1467-985x.2007.00499.x
- The paper
- Kynn, M. (2008). The ‘Heuristics and Biases’ Bias in Expert Elicitation. Journal of the Royal Statistical Society Series A: Statistics in Society. https://doi.org/10.1111/j.1467-985x.2007.00499.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.