Guidance on Communication of Uncertainty in Scientific Assessments
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
This document provides guidance for communicators on how to communicate the various expressions of uncertainty described in EFSA's document: 'Guidance on uncertainty analysis in scientific assessments'. It also contains specific guidance for assessors on how best to report the various expressions of uncertainty. The document provides a template for identifying expressions of uncertainty in scientific assessments and locating the specific guidance for each expression. The guidance is structured according to EFSA's three broadly defined categories of target audience: 'entry', 'informed' and 'technical' levels. Communicators should use the guidance for entry and informed audiences, while assessors should use the guidance for the technical level. The guidance was formulated using evidence from the scientific literature, grey literature and two EFSA research studies, or based on judgement and reasoning where evidence was incomplete or missing. The limitations of the evidence sources inform the recommendations for further research on uncertainty communication.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
“Risk, Ambiguity, and the Savage Axioms.”
Ellsberg, D. (1961) · The Quarterly Journal of Economics · doi:10.2307/1884324 · Cited by 7,891
Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations
Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G. (2016) · European Journal of Epidemiology · doi:10.1007/s10654-016-0149-3 · Cited by 3,200
Visualizing Uncertainty About the Future
Spiegelhalter, D., Pearson, M., & Short, I. (2011) · Science · doi:10.1126/science.1191181 · Cited by 682
Budescu, D. V., Broomell, S., & Por, H.-H. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02284.x · Cited by 402 · cited 5×
“, 2009, 2012) and reversal of the order established between the terms (Budescu et al., 2009).”
BackgroundInfluentialMorton, T. A., Rabinovich, A., Marshall, D., & Bretschneider, P. (2011) · Global Environmental Change · doi:10.1016/j.gloenvcha.2010.09.013 · Cited by 391
Johnson, B. B., & Slovic, P. (1995) · Risk Analysis · doi:10.1111/j.1539-6924.1995.tb00341.x · Cited by 374
Jensen, J. D. (2008) · Human Communication Research · doi:10.1111/j.1468-2958.2008.00324.x · Cited by 298 · cited 1×
“However, Jensen (2008) found that hedging was positively associated with perceptions that study limitations were reported clearly.”
BackgroundThe interpretation of IPCC probabilistic statements around the world
Budescu, D. V., Por, H.-H., Broomell, S. B., & Smithson, M. (2014) · Nature Climate Change · doi:10.1038/nclimate2194 · Cited by 291
Effective Communication of Uncertainty in the IPCC Reports
Budescu, D. V., Por, H.-H., & Broomell, S. B. (2012) · Climatic Change · doi:10.1007/s10584-011-0330-3 · Cited by 261 · cited 2×
“• For the online versions of communication documents, interactive links and animations can help into adapting the information to the user’s needs and ways of understanding (Spiegelhalter et al., 2011; Budescu et al., 2012).”
BackgroundError Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error
Correll, M., & Gleicher, M. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346298 · Cited by 258 · cited 1×
“Similarly, bar charts with error bars can be misleading, as values inside the bar are seen as likelier than values outside the bar (Correll and Gleicher, 2014).”
BackgroundRisk and Uncertainty Communication
Spiegelhalter, D. (2017) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-010814-020148 · Cited by 248 · cited 5×
“• Online versions of communication documents could provide links between probability terms and optional graphic displays related to the sources of uncertainty and to uncertainty scales (Spiegelhalter et al., 2011; Spiegelhalter, 2017).”
BackgroundMethodInfluentialPublic preferences for informed choice under conditions of risk uncertainty
Frewer, L. J., Miles, S., Brennan, M., Kuznesof, S., Ness, M., & Ritson, C. (2002) · Public Understanding of Science · doi:10.1088/0963-6625/11/4/304 · Cited by 153
Han, P. K. J., Klein, W. M. P., Lehman, T., Killam, B., Massett, H., & Freedman, A. N. (2011) · Medical Decision Making · doi:10.1177/0272989x10371830 · Cited by 135
Seeing What You Want to See: How Imprecise Uncertainty Ranges Enhance Motivated Reasoning
Dieckmann, N. F., Gregory, R., Peters, E., & Hartman, R. (2017) · Risk Analysis · doi:10.1111/risa.12639 · Cited by 84 · cited 2×
“Further studies by the same team (Dieckmann et al., 2017) confirmed that perceptions of the distribution underlying numerical ranges were affected by the motivations and worldviews of the recipients.”
Background
Cited by
EFSA Scientific Committee, More, S. J., Bampidis, V., Benford, D., Bennekou, S. H., Bragard, C., Halldorsson, T. I., Hernández‐Jerez, A. F., Koutsoumanis, K., Naegeli, H., et al. (2019) · EFSA Journal · doi:10.2903/j.efsa.2019.5634 · Cited by 574
Self-citationEFSA Scientific Committee, More, S., Bampidis, V., Benford, D., Bragard, C., Halldorsson, T., Hernández‐Jerez, A., Hougaard Bennekou, S., Koutsoumanis, K., Lambré, C., et al. (2021) · EFSA Journal · doi:10.2903/j.efsa.2021.6768 · Cited by 395
The effects of communicating uncertainty on public trust in facts and numbers
van der Bles, A. M., van der Linden, S., Freeman, A. L. J., & Spiegelhalter, D. J. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1913678117 · Cited by 348
Mills, S., Lane, J. A., Smith, G. J., Grimaldi, K. A., Ross, R. P., & Stanton, C. (2019) · Nutrients · doi:10.3390/nu11071468 · Cited by 88
“The probability term is the overall judgement of the evidence provided and is based on the European Food Safety Authority (EFSA) guidance document expressing uncertainty in scientific assessment [268] to help describe the likelihood of an outcome where firm conclusions are difficult to draw.”
BackgroundCommunicating uncertainty using words and numbers
Dhami, M. K., & Mandel, D. R. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.03.002 · Cited by 69
Metadata
- Authors
- Authority, E. F. S., Hart, A., Maxim, L., Siegrist, M., Von Goetz, N., da Cruz, C., Merten, C., Mosbach‐Schulz, O., Lahaniatis, M., Smith, A., & Hardy, A.
- Venue
- EFSA Journal
- Publisher
- Wiley
- Published
- 2019-01
- Volume
- 17
- Issue
- 1
- Pages
- e05520-e05520
- ISSN
- 1831-4732 (ISSN-L)
- OpenAlex
- W2909145596
- Cited by
- 134
- References
- 14
- FWCI
- 42.41
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.