Understanding ‘Unlikely (20% Likelihood)’ or ‘20% Likelihood (Unlikely)’ Outcomes: The Robustness of the Extremity Effect
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Calls to communicate uncertainty using mixed, verbal‐numerical formats (‘unlikely [0–33%]’) have stemmed from research comparing mixed with solely verbal communications. Research using the new ‘which outcome’ approach to investigate understanding of verbal probability expressions suggests, however, that mixed formats might convey disadvantages compared with purely numerical communications. When asked to indicate an outcome that is ‘unlikely’, participants have been shown to often indicate outcomes with a value exceeding the maximum value shown, equivalent to a 0% probability —an ‘extremity effect’. Recognising the potential consequences of communication recipients expecting an ‘unlikely’ event to never occur, we extend the ‘which outcome’ work across four experiments, using verbal, numerical, and verbal‐numerical communication formats, as well as a previously unconsidered numerical‐verbal format. We examine how robust the effect is in the context of consequential outcomes and over non‐normal distributions. We also investigate whether participants are aware of the inconsistency in their responses from a traditional ‘how likely’ and ‘which outcome’ task. We replicate and extend previous findings, with preference for extreme outcomes (including above maximum values) observed in both verbal and verbal‐numerical formats. Our results suggest caution in blanket usage of recently recommended verbal‐numerical formats for the communication of uncertainty. Copyright © 2018 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Peters, E., Västfjäll, D., Slovic, P., Mertz, C. K., Mazzocco, K., & Dickert, S. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01720.x · Cited by 1,180
“How Probable is Probable? A Numerical Translation of Verbal Probability Expressions.”
Beyth‐Marom, R. (1982) · Journal of Forecasting · doi:10.1002/for.3980010305 · Cited by 527
Budescu, D. V., Broomell, S., & Por, H.-H. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02284.x · Cited by 402 · cited 3×
“That the ‘extremity effect’ continued to occur in the V-N format is of particular relevance to current literature, given recent recommendations to use a mixed format approach to express uncertainty (Budescu et al., 2009, 2012, 2014; Patt & Dessai, 2005; Witteman & Renooij, 2003).”
BackgroundPrediction with a Generalized Cost of Error Function
Granger, C. W. J. (1969) · Journal of the Operational Research Society · doi:10.1057/jors.1969.52 · Cited by 324
The interpretation of IPCC probabilistic statements around the world
Budescu, D. V., Por, H.-H., Broomell, S. B., & Smithson, M. (2014) · Nature Climate Change · doi:10.1038/nclimate2194 · Cited by 291
Effective Communication of Uncertainty in the IPCC Reports
Budescu, D. V., Por, H.-H., & Broomell, S. B. (2012) · Climatic Change · doi:10.1007/s10584-011-0330-3 · Cited by 261 · cited 3×
“That the ‘extremity effect’ continued to occur in the V-N format is of particular relevance to current literature, given recent recommendations to use a mixed format approach to express uncertainty (Budescu et al., 2009, 2012, 2014; Patt & Dessai, 2005; Witteman & Renooij, 2003).”
Background
Cited by
Communicating uncertainty about facts, numbers and science
van der Bles, A. M., van der Linden, S., Freeman, A. L. J., Mitchell, J., Galvao, A. B., Zaval, L., & Spiegelhalter, D. J. (2019) · Royal Society Open Science · doi:10.1098/rsos.181870 · Cited by 456
The effects of communicating uncertainty on public trust in facts and numbers
van der Bles, A. M., van der Linden, S., Freeman, A. L. J., & Spiegelhalter, D. J. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1913678117 · Cited by 348
Communicating uncertainty using words and numbers
Dhami, M. K., & Mandel, D. R. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.03.002 · Cited by 69
Negative verbal probabilities undermine communication of climate science
Juanchich, M., Teigen, K. H., Shepherd, T. G., & Sirota, M. (2025) · Nature Climate Change · doi:10.1038/s41558-025-02472-1 · Cited by 2
“…when asked what is ‘unlikely’ in a distribution of quantitative outcomes (for example, sea-level rise and temperature rise), people tend to select extreme outcomes from beyond the range of possible values 24–26 —whereas they associate positive directionality with less extreme outcomes 24,27,28 .”
Metadata
- Authors
- Jenkins, S. C., Harris, A. J. L., & Lark, R. M.
- Venue
- Journal of Behavioral Decision Making
- Publisher
- Wiley
- Published
- 2018-01-23
- Volume
- 31
- Issue
- 4
- Pages
- 572-586
- ISSN
- 0894-3257 (ISSN-L)
- 1099-0771
- OpenAlex
- W2803230576
- Cited by
- 28
- References
- 6
- FWCI
- 3.05
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.