The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Risk and Uncertainty Communication
Abstract
This review briefly examines the vast range of techniques used to communicate risk assessments arising from statistical analysis. After discussing essential psychological and sociological issues, I focus on individual health risks and relevant research on communicating numbers, verbal expressions, graphics, and conveying deeper uncertainty. I then consider practice in a selection of diverse case studies, including gambling, the benefits and risks of pharmaceuticals, weather forecasting, natural hazards, climate change, environmental exposures, security and intelligence, industrial reliability, and catastrophic national and global risks. There are some tentative final conclusions, but the primary message is to acknowledge expert guidance, be clear about objectives, and work closely with intended audiences.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“research shows that humans in general suffer from a variety of cognitive biases, some of which hinder our understanding of uncertainty [60,107,115].”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [115]
Citations
Cites
GRADE guidelines: 3. Rating the quality of evidence
Balshem, H., Helfand, M., Schünemann, H. J., Oxman, A. D., Kunz, R., Brozek, J., Vist, G. E., Falck-Ytter, Y., Meerpohl, J., & Norris, S. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.015 · Cited by 8,285
“Risk, Ambiguity, and the Savage Axioms.”
Ellsberg, D. (1961) · The Quarterly Journal of Economics · doi:10.2307/1884324 · Cited by 7,891
Visualizing Uncertainty About the Future
Spiegelhalter, D., Pearson, M., & Short, I. (2011) · Science · doi:10.1126/science.1191181 · Cited by 682 · cited 1×
“…many systematic and nonsystematic reviews of the use of graphics in risk communication, primarily in the health fields (Ancker et al. 2006, Visschers et al. 2009, Spiegelhalter et al. 2011, Hildon et al. 2012, Stephens et al. 2012, Trevena et al. 2013, Zipkin et al. 2014, Hallgreen et al. 2016).”
BackgroundSelf-citationThe role of social and decision sciences in communicating uncertain climate risks
Pidgeon, N., & Fischhoff, B. (2011) · Nature Climate Change · doi:10.1038/nclimate1080 · Cited by 680
The interpretation of IPCC probabilistic statements around the world
Budescu, D. V., Por, H.-H., Broomell, S. B., & Smithson, M. (2014) · Nature Climate Change · doi:10.1038/nclimate2194 · Cited by 291
Assessing and presenting summaries of evidence in Cochrane Reviews
Langendam, M. W., Akl, E. A., Dahm, P., Glasziou, P., Guyatt, G., & Schünemann, H. J. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-81 · Cited by 282
Research works printed but not linked: 124
- Akl EA, 2011, Cochrane Database Syst. Rev., 3, CD006776
- 10.1197/jamia.M2115 · DOI
- 10.1177/0272989X10369006 · DOI
- ASQ (Am. Soc. for Qual.), 2004, Failure Mode Effects Analysis (FMEA)
- Bammer G, 2008, Uncertainty and Risk: Multidisciplinary Perspectives
- 10.1016/j.envint.2015.12.031 · DOI
- 10.1016/j.envhaz.2007.08.004 · DOI
- Bouder F, 2007, The Tolerability of Risk: A New Framework for Risk Management
- 10.1175/BAMS-88-5-651 · DOI
- Cancer Research UK, 2015, Lifetime Risk of Cancer
- Carlyle T, 1871, Oliver Cromwell's Letters and Speeches: With Elucidations
- Channel 4, 2011, Channel 4 Television Documentary
- COMEAP (Comm. Med. Eff. Air Pollut.)., 2009, Long-term exposure to air pollution: effect on mortality
- 10.1177/0272989X07306783 · DOI
- Cvetkovich G, 2013, Social Trust and the Management of Risk, 10.4324/9781315071350 · DOI
- 10.1175/BAMS-D-11-00150.1 · DOI
- Dep. Homel. Secur., 2011, The Strategic National Risk Assessment in Support of PPD 8: A Comprehensive Risk-Based Approach Toward a Secure and Resilient Nation
- 10.1515/9781400835287 · DOI
- 10.1111/risa.12358 · DOI
- Douglas M, 1983, Risk and Culture: An Essay on the Selection of Technological and Environmental Dangers, 10.1525/9780520907393 · DOI · Paper page
- 10.2903/j.efsa.2015.3978 · DOI
- EMA (Eur. Med. Agency)., 2014, Benefit-Risk Methodology Project. Update on Work Package 5: Effects Table Pilot (Phase I)
- EMA (Eur. Med. Agency)., 2016, Section 4.8: Undesirable Effects
- EPA (U.S. Environ. Prot. Agency)., 2011, Vocabulary catalog: Integrated Risk Information System (IRIS) glossary
- 10.1177/0272989X05278931 · DOI
- 10.1093/jnci/djr318 · DOI
- 10.1177/0272989X06297101 · DOI
- 10.1111/j.1539-6924.1995.tb00308.x · DOI · Paper page
- Fischhoff B, 2006, Horizons, 10, 3
- Fischhoff B, 2011, Communicating Risks and Benefits: An Evidence-Based User's Guide
- 10.1073/pnas.1317504111 · DOI · Paper page
- Friedman JA, 2015, Intell. Natl. Secur., 30, 1, 10.1080/02684527.2014.972613 · DOI
- 10.1037/a0024850 · DOI
- 10.1001/archinternmed.2009.481 · DOI · Paper page
- Galesic M, 2009, Health Psychol. Off. J. Div. Health Psychol. Am. Psychol. Assoc., 28, 210
- 10.1111/tops.12172 · DOI
- 10.1177/0272989X10369000 · DOI
- 10.1136/bmj.g7091 · DOI
- 10.1136/bmj.e245 · DOI
- 10.1111/j.1539-6924.2005.00608.x · DOI
- 10.1038/477264a · DOI
- 10.1002/pds.3880 · DOI
- 10.1177/0272989X10371830 · DOI · Paper page
- 10.3399/bjgp14X677824 · DOI
- 10.1093/intqhc/mzr072 · DOI
- 10.1002/pds.3958 · DOI
- IPCC (Intergov. Panel Clim. Change)., 2013, Climate Change 2013: The Physical Science Basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change
- ISO (Int. Stan. Organ.), 2009, ISO 31000—Risk Management
- 10.1109/IEEM.2012.6838079 · DOI
- 10.1016/S0304-3894(02)00283-2 · DOI
- 10.1002/met.121 · DOI
- 10.22323/2.14030404 · DOI
- Kahneman D, 2006, Judgment under Uncertainty: Heuristics and Biases
- 10.1111/j.1539-6924.2012.01844.x · DOI
- 10.1111/j.1539-6924.2009.01261.x · DOI
- 10.1136/qshc.2003.009076 · DOI
- 10.1111/hex.12344 · DOI
- Knight F, 1921, Risk, Uncertainty and Profit
- 10.1111/risa.12531 · DOI
- 10.1111/j.1539-6924.2010.01511.x · DOI
- 10.1177/0002716296545001009 · DOI
- 10.1111/j.1539-6924.2007.00940.x · DOI
- 10.1111/j.1539-6924.2011.01722.x · DOI
- 10.1177/2047487313518479 · DOI
- Marchio J, 2014, Stud. Intell., 58, 31
- 10.1002/9780470061596 · DOI
- Moore RA, 2014, Cochrane Database Syst. Rev., 3, CD007938
- Morgan G, 2009, Best Practice Approaches for Characterizing, Communicating, and Incorporating Scientific Uncertainty in Climate Decision Making
- 10.1017/CBO9780511814679 · DOI
- 10.1016/j.envint.2016.01.004 · DOI
- 10.1175/2008WAF2007088.1 · DOI
- NRC (Natl. Res. Counc.), 1989, Improving Risk Communication.
- 10.1136/bmj.327.7417.745 · DOI
- 10.1002/hyp.9253 · DOI
- 10.1196/annals.1399.001 · DOI
- 10.1037/a0016978 · DOI
- 10.1177/0272989X10391672 · DOI
- 10.1002/pd.4606 · DOI
- 10.1002/pds.3859 · DOI
- 10.1177/0272989X12451057 · DOI
- 10.1111/bjop.12081 · DOI
- 10.1111/risa.12453 · DOI
- Ropeik D, 2010, How Risky Is It, Really? Why Our Fears Don't Always Match the Facts
- Sandberg A, Bostrom N. 2008. Global catastrophic risks survey. Tech. Rep. 2008–1, Future Humanity Inst., Univ. Oxford
- 10.1111/j.1539-6924.1993.tb01321.x · DOI
- 10.1111/j.1539-6924.1994.tb00026.x · DOI
- 10.1080/01621459.1951.10500768 · DOI
- Savage LJ, 1972, The Foundations of Statistics
- 10.1111/risa.12169 · DOI
- 10.1073/pnas.1214646110 · DOI
- 10.1177/0272989X13514776 · DOI
- 10.1111/j.1539-6924.2011.01773.x · DOI
- 10.1126/science.3563507 · DOI · Paper page
- Slovic P, 2000, The Perception of Risk
- 10.1111/j.1467-8721.2006.00461.x · DOI · Paper page
- 10.1186/1472-6947-8-31 · DOI
- 10.1136/bmj.324.7332.261 · DOI
- 10.1136/bmj.e8223 · DOI
- 10.1111/1471-0528.12663 · DOI
- 10.1098/rsta.2011.0163 · DOI
- 10.1002/wcc.187 · DOI
- 10.1038/sj.embor.7400953 · DOI
- 10.1016/S0749-5978(03)00003-7 · DOI
- 10.1213/ANE.0b013e3181e8570a · DOI
- Taleb N, 2007, The Black Swan: the Impact of the Highly Improbable
- 10.1111/j.1365-2753.2005.00596.x · DOI
- 10.1186/1472-6947-13-S2-S7 · DOI
- UK Cabinet Off., 2010, Fact Sheet2: National Security Risk Assessment
- UK Cabinet Off., 2011, Communicating Risk Guidance
- UK Cabinet Off., 2012, National Risk Register for Civil Emergencies—2012 Update
- UK Cabinet Off., 2015, National Risk Register for Civil Emergencies—2015 Edition
- 10.1177/1075547015614970 · DOI
- 10.1146/annurev-statistics-062713-085841 · DOI
- 10.1111/j.1539-6924.2008.01137.x · DOI
- 10.1007/978-3-642-12233-0_18 · DOI
- World Econ. Forum., 2016, The Global Risks Report 2016, 11th Edition
- 10.1177/016224399101600108 · DOI · Paper page
- 10.1002/(SICI)1099-0720(199712)11:6<495::AID-ACP481>3.0.CO;2-J · DOI · Paper page
- 10.1177/0272989X13516198 · DOI
- 10.2196/jmir.1665 · DOI
- 10.1177/0272989X10364244 · DOI
- 10.1016/j.pec.2008.05.010 · DOI
- 10.2196/jmir.2030 · DOI
- 10.7326/M14-0295 · DOI
Cited by
Sorted by citations
Items 101–200 of 237
Runge, M. C., Shea, K., Howerton, E., Yan, K.-T., Hochheiser, H., Rosenstrom, E. T., Probert, W., Borchering, R., Marathe, M., Lewis, B. L., et al. (2023) · medRxiv · doi:10.1101/2023.10.11.23296887 · Cited by 9
“Key challenges include communication of the nuances of scenario projections to lay audiences (as different from forecasts), and visualization of uncertainty (Kamal et al., 2021; Hullman et al., 2019; Hägele et al., 2022; Spiegelhalter, 2017).”
Evaluation of Human-Understandability of Global Model Explanations using Decision Tree
Sivaprasad, A., Reiter, E., Tintarev, N., & Oren, N. (2023) · ECAI Workshops · doi:10.1007/978-3-031-50396-2_3 · Cited by 9
“To express the probabilities, we use verbal mapping proposed by [26].”
BackgroundMethodHow to Measure Effect Sizes for Rational Decision Making
Jäntgen, I. (2023) · Philosophia Scientiæ · doi:10.1017/psa.2023.23 · Cited by 9
“As established by Sprenger and Stegenga (2017), absolute measures but not relative ones always do so for choices between a treatment and a control group treatment.”
BackgroundInfluentialValuing non-marginal changes in mortality and morbidity risk.
Herrera-Araujo, D., Rheinberger, C., & Hammitt, J. (2022) · Journal of Health Economics · doi:10.1016/j.jhealeco.2022.102627 · Cited by 9
“(Spiegelhalter, 2017).”
BackgroundFranzen, D., von Voigt, S. N., Sörries, P., Tschorsch, F., & Müller-Birn, C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.04061 · Cited by 9
“” Several publications (e.g., [53, 54]) recommend presenting the probabilities of both events together as “5 % have side effects, 95 % do not” to avoid bias induced by the presentation chosen.”
BackgroundLabonne, P., & Weale, M. (2020) · Journal of the Royal Statistical Society: Series A (Statistics in Society) · doi:10.1111/rssa.12568 · Cited by 9
“For a detailed discussion about uncertainty and ways of communicating it see Spiegelhalter (2017). The accuracy of the approximation to the temporal aggregation constraint can be evaluated by aggregating the unobserved components’ smoothed estimates by using the exact observation function (1) and comparing the resulti…”
BackgroundMethodThe dynamics of uncertainty: a systematic review of non-linear dynamical systems in decision-making
Bajpai, S., & Sameer, A. (2025) · Nonlinear Dynamics · doi:10.1007/s11071-025-11180-6 · Cited by 13
Vromans, R., van de Ven, C. C. M., Willems, S. J. W., Krahmer, E., & Swerts, M. G. J. (2024) · Risk Analysis · doi:10.1111/risa.14319 · Cited by 8
“A consistent finding in the literature is that different people typically have various numerical interpretations of the same verbal probability expressions (for reviews, see Simpson, 1963; Spiegelhalter, 2017; Visscher et al., 2009).”
Bearth, A., Roth, N., Wilks, M. F., & Siegrist, M. (2024) · Risk Analysis · doi:10.1111/risa.14296 · Cited by 8
“…et al., 1995), the term “risk” was used in a general manner, recent research sought to understand whether the public differentiates between the concepts of risk and hazard (Freudenstein et al., 2020) or how epistemic uncertainty is best communicated (Jansen et al., 2020a; Spiegelhalter, 2017).”
Recommendations for Improved Tropical Cyclone Formation and Position Probabilistic Forecast Products
Dunion, J., Davis, C., Titley, H., Greatrex, H., Yamaguchi, M., Methven, J., Ashrit, R., Wang, Z., Yu, H., Fontan, A.-C., et al. (2023) · Tropical Cyclone Research and Review · doi:10.1016/j.tcrr.2023.11.003 · Cited by 8
Dihge, L., Bendahl, P., Skarping, I. D., Hjärtström, M., Ohlsson, M., & Rydén, L. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2023.1102254 · Cited by 15
“Speci fi cally, the guiding principles of risk communication (27, 28) have been implemented in the web-based format of the NILS tool and involve the following: I) Presenting the numeric estimate of the probability of N0 for an individual patient.”
MethodGeorgiou, N., Morgan, R., & French, J. C. (2022) · Australian Journal of Forensic Sciences · doi:10.1080/00450618.2022.2104370 · Cited by 8
“However, Rumsfeld’s triptych has been described as the ‘simplest’ attempt to structuring uncertainty 84 despite the existence of a range of taxonomies of uncertainty that have been developed across a number of other disciplines, such as environmental science 85 .”
BackgroundTiede, K. E., Ripke, F., Degen, N., & Gaissmaier, W. (2020) · Medical decision making · doi:10.1177/0272989x20904357 · Cited by 8
Gregory, R., Satterfield, T., & Boyd, D. R. (2019) · Risk Analysis · doi:10.1111/risa.13409 · Cited by 8
“For example, several reviews (Morgan et al., 2009; Oppenheimer, Little, & Cooke, 2016; Spiegelhalter, 2017) describe choices ranging from less precise verbal likelihood phrases and evaluative labels to more precise density or cumulative probability distributions, including a variety of visual and…”
BackgroundThomassen, D., Hackmann, T., Goeman, J., Steyerberg, E., & le Cessie, S. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100911 · Cited by 7
Dhungana, A., Doyle, E., Prasanna, R., & McDonald, G. W. (2025) · Environment Systems and Decisions · doi:10.1007/s10669-025-10039-w · Cited by 8
“In a world increasingly threatened by disasters, effectively communicating uncertainty in decision-making is crucial (Doyle et al. 2018; Lammers et al. 2024; Schneider 2016; Spiegelhalter 2017).”
An Ontology-Based Approach Toward Traceable Behavior Specifications in Automated Driving
Salem, N. F., Nolte, M., Haber, V., Menzel, T., Steege, H., Graubohm, R., & Maurer, M. (2024) · IEEE Access · doi:10.1109/access.2024.3494036 · Cited by 7
“However, the specific ontologies that are used in our application examples are subject to ontological uncertainties [71] and are limited to the scope of the considered scenarios.”
The Power of Numeric Evidence in Science Communication
Peters, E., & Bunquin, J. B. A. (2024) · Current Directions in Psychological Science · doi:10.1177/09637214241242465 · Cited by 7
“Additional instantiations of these and other strategies can be found in excellent articles about risk and uncertainty (Spiegelhalter, 2017; Fagerlin et al., 2011), data visualization (Garcia-Retamero & Cokely, 2013), adding familiar perspectives to numbers to help make sense of them (Riederer et…”
BackgroundFallon, E., Bargary, N., Quinn, F., Leavy, A., & Hannigan, A. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05048-3 · Cited by 7
“These numbers may need qualifiers, however, which acknowledge that they are the best estimates available, given the current research evidence, and that estimates come with uncertainty [24].”
BackgroundGlaser, M., Lengyel, D., Toulouse, C., & Schwan, S. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09659-4 · Cited by 7
“In a similar vein, Spiegelhalter (2017) distinguishes aleatoric uncertainty (i.e., the unpredictability of future events which we cannot know and which is similar to the unknown unknowns and scientific uncertainty by Gustafson & Rice, 2020) from epistemic uncertainty (uncertainty from a lack of…”
BackgroundThe effects of releasing early results from ongoing clinical trials
Ventz, S., Bacallado, S., Rahman, R., Tolaney, S., Schoenfeld, J., Alexander, B., & Trippa, L. (2021) · Nature Communications · doi:10.1038/s41467-021-21116-4 · Cited by 7
Okan, Y., Smith, S., & de Bruin, W. B. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-029551 · Cited by 7
The future of polygenic risk scores in direct-to-consumer genomics
Sun, Y.-H., Vines, J., & Tenesa, A. (2025) · Nature Genetics · doi:10.1038/s41588-025-02313-z · Cited by 6
Absolute and relative risks of mental disorders in families: a Danish register-based study.
Pedersen, C. B., Pedersen, M. G., Antonsen, S., Pedersen, E. M., Horsdal, H., Debost, J., Mortensen, P., Petersen, L., Vilhjálmsson, B., Nielsen, J. F., et al. (2025) · Lancet psychiatry · doi:10.1016/s2215-0366(25)00196-8 · Cited by 6
How Should We Communicate Information Regarding Birth Choices to Women?: An Online Randomised Survey
Bradley, V., Hunt, A., Bunni, E., Kingdon, C., Finikarides, L., Bonnett, L., Cunningham, C., Burden, C., Ficquet, J., Parry-Smith, W., et al. (2025) · BJOG: an International Journal of Obstetrics and Gynaecology · doi:10.1111/1471-0528.18314 · Cited by 6
“Risk communication may also play an important role in aiding the comparison of two risks [17–19].”
Moriarty, A. S., Castleton, J., McMillan, D., Riley, R. D., Snell, K. I. E., Archer, L., Paton, L. W., Gilbody, S. M., & Chew-Graham, C. A. (2024) · Health Expectations · doi:10.1111/hex.70059 · Cited by 6
The Noisy Work of Uncertainty Visualisation Research: A Review
Mason, H., Cook, D., Goodwin, S., Tanaka, E., & VanderPlas, S. (2024) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-042825-110607 · Cited by 6
“Since the purpose of a visualisation is to give a quick gist of the information (Spiegelhalter 2017), this hedging should be communicated visually without the need for complicated mental calculations.”
InfluentialA consistent terminology to communicate ground-related uncertainty
Erharter, G., Lacasse, S., Tschuchnigg, F., Tentschert, E., Becker, D., & Phoon, K. (2024) · Engineering Geology · doi:10.1016/j.enggeo.2024.107744 · Cited by 6
“0.0001 (10 -4 ) Spiegelhalter (2017) American risk experts and were first used for the analysis of dam safety.”
BackgroundInfluentialPolarized framing of scientific uncertainty during COVID-19 pandemic in Morocco
Zag, H., & Mifdal, M. (2024) · Atlantic Journal of Communication · doi:10.1080/15456870.2024.2370274 · Cited by 8
“It is a situation of inadequate information in terms of inexactness, unreliability, and bordering on ignorance (Funtowicz & Ravetz, 1990; Spiegelhalter, 2017).”
Predicting COVID: Understanding audience responses to predictive journalism via online comments
Allaham, M., & Diakopoulos, N. (2022) · New Media & Society · doi:10.1177/14614448221135632 · Cited by 6
“Nevertheless, a large degree of uncertainty and speculation remains in news making (Neiger, 2007; Spiegelhalter, 2017), especially when predicting the future.”
Uncertainty: Nothing is more certain
Cripps, S., & Durrant‐Whyte, H. (2022) · Environmetrics · doi:10.1002/env.2745 · Cited by 6
“In contrast parameter and model uncertainty is uncertainty that is attributable to a lack of information and is often referred to epistemic uncertainty, see Hacking (1975), Fox and Ülkümen (2011), Spiegelhalter (2017) for discussions on the topic.”
The Ethics of COVID-19 Risk Communication
Wu, J. H., & John, S. (2021) · Journal of general internal medicine · doi:10.1007/s11606-021-06600-3 · Cited by 6
“Likewise, the US Centers for Disease Control and Prevention (CDC) has recommended six core principles to guide “Crisis and Emergency Risk Communication”: (1) be first, (2) be right, (3) be credible, (4) express empathy, (5) promote action, and (6) show respect.”
BackgroundQuality of Stroke Patient Information Applied in Randomized Controlled Trials—Literature Review
Alegiani, A., Rahn, A., Steckelberg, A., Thomalla, G., Heesen, C., & Köpke, S. (2020) · Frontiers in Neurology · doi:10.3389/fneur.2020.526515 · Cited by 6
“However, most patients appreciate this transparent approach (19) and the use of absolute risks is generally recommended (60).”
BackgroundUnderstanding Uncertainty and Risk in Management
Jedynak, P., & Bąk, S. (2020) · Journal of Intercultural Management · doi:10.2478/joim-2020-0030 · Cited by 6
“Analyzing the definitions of uncertainty presented in Table 1, four categories of approaches to defining them can be identified: · due to reasons (Smithson, 1999; Krickx, 2000; Carbonara & Caizza, 2010), · due to the ability / inability to assess probability (van der Heijden, 2000; Holton, 2004; Spiegelhalter, 2017),”
BackgroundJudging risk magnitude: walking to the left and base jumping to the right
Macnamara, A., Loetscher, T., & Keage, H. (2018) · Experimental Brain Research · doi:10.1007/s00221-018-5449-2 · Cited by 6
“Both Spiegelhalter (2017), and GarciaRetamero and Galesic (2010) report that the visual formats (e.g. percentages, frequency, graphics) used when presenting risk information can significantly affect how the message is comprehended; and further, that it is critical to develop optimal risk…”
BackgroundCalibration, Sensitivity and Uncertainty Analysis of Complex Ecological Models—A Review
Malchow, A.-K., & Hartig, F. (2026) · Ecology Letters · doi:10.1111/ele.70375 · Cited by 5
“Moreover, the appropriate communication of uncertainties (Spiegelhalter 2017) is often not part of these technical reviews.”
Assessing confidence in frontier AI safety cases
Barrett, S., Fox, P., Krook, J., Mondal, T., Mylius, S., & Tlaie, A. (2025) · arXiv.org · doi:10.48550/arxiv.2502.05791 · Cited by 5
“A combination of words, numbers and graphics used collectively, allows for greater communication interpretability on the topic [38].”
InfluentialConformal Risk Control for Pulmonary Nodule Detection
Hulsman, R., Comte, V., Bertolini, L., Wiesenthal, T., Gallardo, A. P., & Ceresa, M. (2024) · International Symposium on Conformal and Probabilistic Prediction with Applications · doi:10.48550/arxiv.2412.20167 · Cited by 5
“Disagreement among experts on what constitutes the ground truth concerning a pulmonary nodule is a matter of ontological uncertainty (Spiegelhalter, 2017), measuring the limitations of the proposed prediction pipeline as a description of reality.”
Vromans, R., van Goor, L. M. A., & Pauws, S. C. (2024) · Journal of Risk Research · doi:10.1080/13669877.2024.2368191 · Cited by 5
“…and that other formats such as natural frequencies (i.e. 9 out of 100 people) or visual aids (i.e. icon arrays) are more suitable formats for communicating complex health risk information (Bonner et al. 2021; Gigerenzer et al. 2008; Spiegelhalter 2017; Fagerlin, Zikmund-Fisher, and Ubel 2011).”
Tiede, K. E., & Gaissmaier, W. (2023) · Medical decision making · doi:10.1177/0272989x231202505 · Cited by 5
“The use of graphical representation formats is recommended by the International Patient Decision Aid Standards (IPDAS) 5 because a multitude of studies has shown that graphical representation formats lead to better understanding of medical information compared with numerical representation formats (for reviews, see Ga…”
BackgroundWebb, E., Meads, D. M., Eskytė, I., Ford, H. L., Bekker, H., Chataway, J., Pepper, G., Marti, J., Okan, Y., Pavitt, S. H., et al. (2023) · Patient · doi:10.1007/s40271-023-00622-1 · Cited by 6
A Mixed Analysis of Influencing Factors for Trust in a Risk-Aware Autonomy
Huang, L.-X., Cummings, M., & Ono, M. (2020) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181320641027 · Cited by 5
“trust, and specifically on the visual aids for risk evaluation (Spiegelhalter, 2017), such as the risk budget bar and the yellow circles estimating possible future vehicle locations.”
BackgroundTruth Telling about Tobacco and Nicotine
Annechino, R., & Antin, T. M. J. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16040530 · Cited by 5
Southwell, B. G., Sheff, S. E., Squiers, L., Madson, G., Mitchell, B., Pechta, L., Sokler, L. A., & Mitchko, J. (2025) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000002280 · Cited by 4
Effective Sample Size for the Kaplan-Meier Estimator: A Valuable Measure of Uncertainty?
Hackmann, T., Thomassen, D., Stiggelbout, A., le Cessie, S., Putter, H., de Wreede, L. D., & Steyerberg, E. (2025) · American Statistician · doi:10.1080/00031305.2025.2542390 · Cited by 4
Kohut, K., Morton, K., Turner, L., Foster, R., Bancroft, E. K., Burn, J., Crosbie, E. J., Valentin, M. D., Esplen, M. J., Hanson, H., et al. (2025) · Journal of Genetic Counseling · doi:10.1002/jgc4.70089 · Cited by 5
“It was not surprising that people struggled to understand their cancer risks and what it meant to them, given established challenges presenting risk information to the public (Freeman, 2019; Spiegelhalter, 2017).”
A Diffusion-Based Method for Learning the Multi-Outcome Distribution of Medical Treatments
Ma, Y.-C., Schweisthal, J., Zhang, H.-R., & Feuerriegel, S. (2025) · Knowledge Discovery and Data Mining · doi:10.1145/3711896.3736819 · Cited by 4
“Hence, relying on averaged causal quantities for medical decision-making can be misleading and, in some cases, even dangerous [43, 46].”
Умови невизначеності як джерело ризиків у підприємницькій діяльності
Lopashchuk, I., Лопащук, В. О., & Іким, А. В. (2025) · Проблеми сучасних трансформацій Серія економіка та управління · doi:10.54929/2786-5738-2025-19-03-01 · Cited by 4
Major‐Smith, D., Morgan, J., Halstead, I. N., & Golding, J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0319796 · Cited by 6
“…probabilities to aid interpretation of effect sizes where relevant; that is, we reported absolute effect sizes (i.e., %-point differences between levels of the exposure) in addition to relative effect sizes (i.e., odds ratios and relative risk ratios), as the former are easier to interpret [57].”
Psychological insights for judging expertise and implications for adversarial legal contexts
Martire, K. A., Neal, T. M. S., Gobet, F. R., Chin, J. M., Berengut, J. F., & Edmond, G. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-025-00430-4 · Cited by 9
Cai, M.-D., & Kay, M. (2024) · International Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642329 · Cited by 4
“8 Additionally, Spiegelhalter [75] ofers advice for how to communicate and visualize uncertainty, like expressing uncertainty as a proportion, frequency, or percentage with a clear denominator and visualizing uncertainty several ways to reach diferent audiences.”
BackgroundMakriyannis, C., Johnston, R. J., & Zawojska, E. (2024) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2024.104481 · Cited by 4
Johannsen, B. M. W., Larsen, J. T., Liu, X., Madsen, K. B., Mægbæk, M. L., Albiñana, C., Bergink, V., Laursen, T. M., Bech, B. H., Mortensen, P. B., et al. (2023) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13622 · Cited by 5
“13,14 In comparison, absolute risk of a given outcome provides the proportion of individuals who will develop the disorder of interest.”
Williams, L., Mulder, K. J., Charlton-Perez, A., Lickiss, M., Black, A., McCloy, R., McSorley, E., & Young, J. (2023) · Geoscience Communication · doi:10.5194/gc-6-111-2023 · Cited by 4
Attitudes about Brain–Computer Interface (BCI) technology among Spanish rehabilitation professionals
Astobiza, A. M., Vailhen, D. R.-A., Ausín, T., Martín, M. T., Aparicio, M., & López, D. (2021) · AI & Society · doi:10.1007/s00146-021-01292-z · Cited by 5
Communicating Uncertainty in Explanations of the Outcomes of Machine Learning Models
Zukerman, I., & Maruf, S. (2024) · International Conference on Natural Language Generation · doi:10.18653/v1/2024.inlg-main.4 · Cited by 4
“In the future, it is worth investigating additional modalities, such as words and graphs, e.g., charts and icon arrays (Spiegelhalter, 2017; Zipkin et al., 2014), as well as combinations of modalities.”
BackgroundInfluentialDemichelis, A., & Ongaro, M. (2024) · AIMS Geosciences · doi:10.3934/geosci.2024028 · Cited by 4
PregnancyLine: A Visual Analysis System for Pregnancy Care and Risk Communication
Li, L., Liu, Z., Wang, X., Zhang, X., & Wang, L. (2022) · IEEE Access · doi:10.1109/access.2022.3204694 · Cited by 6
“The communication of risk involves a description of reality, which can be expressed as a qualitative and subjective assessment of events [25].”
BackgroundCummings, M. L., Huang, L., & Ono, M. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-819472-0.00018-6 · Cited by 5
Gray, N., Page, H., Buchan, I., & Joyce, D. (2024) · medRxiv · doi:10.1145/3830235 · Cited by 3
“There are numerous approaches that could be used to express the uncertainty of a clinical outcome all of which have potential benefits and drawbacks, although there is little consensus as to what the best approach would be [11].”
Burmester, A. B., Clement, M., Becker, J. U., & Otten, C. (2024) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-024-01054-5 · Cited by 3
Green, P. J., Gill, R., Mackenzie, N., Mortera, J., & Thompson, W. (2022) · doi:10.48550/arxiv.2210.00962 · Cited by 3
“Critical thinking techniques such as the “double standard test”, the “outsider test”, the “conformity test”, and the “selective skeptic test” are likely to be useful in testing inference and argument.(61) Courts in the UK have warned, at the highest level, that “there is a danger that so-called ‘epidemiological eviden…”
BackgroundSparse directed acyclic graphs incorporating the covariates
Guo, X., & Zhang, H. (2018) · Statistical Papers · doi:10.1007/s00362-018-1027-8 · Cited by 3
Harris, K. W., Syme, S., Kasparian, N. A., Chang, J. C., Arnold, R. M., Bulls, H., Divanovic, A. A., Colosimo, C., Weinberg, J., & Burke, J. G. (2026) · Pediatric Cardiology · doi:10.1007/s00246-026-04416-8 · Cited by 2
Characteristics of Participants Screened and Randomized to the Melanoma Self Surveillance Trial.
Medcalf, E., Ackermann, D., Williams, J., Turner, R. M., Espinoza, D., Wu, Z., Fann, A., Kharel, P., Janda, M., Cust, A., et al. (2026) · JAMA dermatology · doi:10.1001/jamadermatol.2026.0083 · Cited by 2
Baker, M., Younger, C., & Lyall, D. (2025) · Radiography · doi:10.1016/j.radi.2025.103212 · Cited by 2
GDR-learners: Orthogonal Learning of Generative Models for Potential Outcomes
Melnychuk, V., & Feuerriegel, S. (2025) · arXiv.org · doi:10.48550/arxiv.2509.22953 · Cited by 2
“The aleatoric uncertainty is particularly important for reliable decision-making (Spiegelhalter, 2017; van der Bles et al., 2019): by knowing the whole distribution of the PO, decision-makers such as clinicians may be able to evaluate the probabilities of unwanted outcomes.”
Unequal Uncertainty: Rethinking Algorithmic Interventions for Mitigating Discrimination from AIPreprint
Sargeant, H., Jorgensen, M., Shah, A., Goring, S., Weller, A., & Bhatt, U. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.07872 · Cited by 5
“However, this is certainly not the norm (Spiegelhalter 2017); thus, we focus on instances when a selective algorithmic intervention is triggered due to a confidence value being below a specified threshold.”
Jenkinson, B., McKenzie, M., Limmer, A., Charlton, V., Hardiman, L., Ura, A. L., Lawler, S., Bonner, C., & Doust, J. A. (2025) · Research Involvement and Engagement · doi:10.1186/s40900-025-00771-7 · Cited by 2
“We also sought to present the risk information in absolute terms, using icon arrays, in accord with accepted risk communication practices [42–44].”
Doyle, E., Thompson, J., Hill, S. R., Williams, M., Paton, D., Harrison, S. E., Bostrom, A., & Becker, J. S. (2025) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2025.105731 · Cited by 2
Patient-Centred Explainability in IVF Outcome PredictionPreprint
Sivaprasad, A., Reiter, E., McLernon, D. J., Tintarev, N., Bhattacharya, S., & Oren, N. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.18760
“In addition to numeric representation, graphical, textual and tabular risk communication methods are also well explored in literature[24], however, with no conclusive evidence of an appropriate method.”
Alptekin, C., Wohlgemut, J., Perkins, Z., Marsh, W., Tai, N., & Yet, B. (2024) · Int. J. Medical Informatics · doi:10.1016/j.ijmedinf.2024.105702 · Cited by 2
Petal-X: Human-Centered Visual Explanations to Improve Cardiovascular Risk Communication
Rojo, D., Lamqaddam, H., Gosak, L., & Verbert, K. (2024) · arXiv.org · doi:10.48550/arxiv.2406.18690 · Cited by 2
“Although risk communication is complex and there is no one-size-fits-all communication strategy, visual representation of risk can improve patient understanding and satisfaction [32,36,41].”
BackgroundVromans, R., Bol, N., van Wezel, M. M. C., & Krahmer, E. (2024) · BMC Public Health · doi:10.1186/s12889-024-18669-6 · Cited by 2
“Consistent with dual coding theory and CTML, there is large body of literature showing that different types of visual aids can improve understanding and perception of different types of (complex) health statistics [21, 22, 30].”
BackgroundProbability and informed consent
Ben-Moshe, N., Levinstein, B. A., & Livengood, J. (2023) · Theoretical Medicine and Bioethics · doi:10.1007/s11017-023-09636-0 · Cited by 2
“numerical probability expressions, see [8-17].”
READINESS TO RISK IN THE ASPECT OF THE INDIVIDUAL’S PSYCHOLOGICAL SAFETY
Medovikova, E., & Morozova, I. (2022) · Ergodesign · doi:10.30987/2658-4026-2022-3-229-238 · Cited by 2
Impfbereitschaft, Impfskepsis und Impfung in der COVID-19-Pandemie
Haug, S., Altenbuchner, A., Zachmayer, T., & Weber, K. (2022) · GWP – Gesellschaft, Wirtschaft, Politik · doi:10.3224/gwp.v71i2.08 · Cited by 2
Bangdiwala, S., Gomez, A. C., Monsalves, M., & Palmeiro, Y. (2021) · Social and Health Sciences · doi:10.25159/2957-3645/10332 · Cited by 2
“Even better, different levels of risk should have verbal and numerical definitions, accompanied by clear visualisations that are easy to understand by the target population (Spiegelhalter, 2017), considering the population’s numeracy level.”
BackgroundDelacroix, S. (2024) · Social Science Research Network · doi:10.2139/ssrn.4751774 · Cited by 2
Towards a Deliberative Framework for Systemic Risk Communication
Hofbauer, B., Guimaraes, R., Schweizer, P., Hochrainer-Stigler, S., & Dryhurst, S. (2026) · IOP Conference Series: Earth and Environment · doi:10.1088/1755-1315/1668/1/012007 · Cited by 1
García-Zamora, S., da Silva, F. T., Labudovic, I., & Vicco, M. H. (2026) · Journal of Evaluation In Clinical Practice · doi:10.1111/jep.70558 · Cited by 1
Uncertainty displays in pandemic dashboards: a review of COVID-19 use cases
Tessema, T., Shahezian, M., Vasquez, H. M., Rosella, L., & Donmez, B. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1869108 · Cited by 1
“This concern is consistent with longstanding challenges in risk communication, where presenting uncertainty may be perceived as undermining clarity or public confidence, which could explain the reliance on simplified dashboard designs observed in this study (4).”
InfluentialDemetriades, A. (2026) · Neurologia medico-chirurgica · doi:10.2176/jns-nmc.2025-0454 · Cited by 1
CURE2026: Communicating Uncertainty to foster Realistic Expectations via Human-Centered Design
Gajcin, J., Jeromela, J., Wester, J., Schömbs, S., Kleanthous, S., Ramamurthy, K. N., Hauptmann, H., & Amin, R. M. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742414.3794961
“…uncertainty communication is plagued by challenges such as cognitive biases [4, 25, 35], numeracy skills [11, 26], calibrating risk perception, [29] and increased cognitive load [13], with research fnding that lay users can struggle to interpret probabilities and uncertainty visualizations…”
Risk Perception and Communication, Plugged‐In: Fifty Years of Process
Warren, G. W., & Duckett, S. M. (2026) · Risk Analysis · doi:10.1111/risa.70205 · Cited by 1
“From our observations, and those noted by Spiegelhalter ( 2017 ), many risk communication practitioners still predominantly operate within the first three stages of Fischhoff’s ( 1995 ) stages: Getting the numbers right , telling people the numbers , and, to a limited extent, explaining what the…”
Algorithm Perception When Using Threat Intelligence in Vulnerability Risk Assessment
van Gerwen, S., Papotti, A., Tuma, K., & Massacci, F. (2026) · Risk Analysis · doi:10.1111/risa.70178 · Cited by 1
“A considerable amount of literature has been published on risk and uncertainty communication in the past (Balog-Way et al. 2020 , Spiegelhalter 2017 ).”
Jahn‐Eimermacher, A., Klein, L., & Grieser, G. (2025) · Statistical Methods in Medical Research · doi:10.1177/09622802251393626 · Cited by 1
“32 The TRIPOD statement 33 provides guidance on how to report a prediction model, but it does not address how to report the resulting predictions.”
A Set of New Tools to Measure the Effective Value of Probabilistic Forecasts of Continuous Variables
Salle, J. L. G. L., David, M., & Lauret, P. (2025) · Forecasting · doi:10.3390/forecast7020030 · Cited by 1
Words or numbers? How framing uncertainties affects risk assessment and decision-making
Bodenberger, R., & Thommes, K. (2026) · Journal of Risk Research · doi:10.1080/13669877.2026.2667755 · Cited by 3
“Even though past research has frequently highlighted that the communication of uncertainty is tricky (see for a review Spiegelhalter 2017), research on the effects of communication practices on subsequent decision-making is still in its infancy.”
Zhou, L., & Guo, Y. (2025) · Journal of Comparative Policy Analysis · doi:10.1080/13876988.2024.2442575 · Cited by 1
“Effective policy design in this context requires the government to develop a deep understanding of how local populations form their risk perceptions, enabling them to reduce perceived threats and foster confidence in public institutions (Lachlan and Spence 2010; He et al. 2013; Spiegelhalter 2017).”
The National Risk Register 2023: some reasoned reflections
Grindrod, P., Bowman, C. E., Smith, G., & Stasinakis, A. (2024) · Sustainable and Resilient Infrastructure · doi:10.1080/23789689.2024.2404277 · Cited by 1
Benefits and Harms of Interception and Early Detection of Cancer
Parmigiani, G. (2024) · Hematology/Oncology Clinics of North America · doi:10.1016/j.hoc.2024.04.003 · Cited by 2
Animating Hypothetical Trips to Communicate Space-Based Temporal Uncertainty on Digital Maps
Koval, M., Jansen, Y., & Chevalier, F. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3388517 · Cited by 1
“Uncertainty can refer to different phenomena (see work by Spiegel-halter [54] for a deeper discussion), but this article is concerned with the visualization of aleatoric uncertainty (i.e., calculable risk given a mathematical model to make predictions of future outcomes).”
Christiansen, E., Reilev, M., Larsen, C. P., Bilenberg, N., & Agerbo, E. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.115824 · Cited by 1
“However, the use of relative measures can increase the perceived size of the effect and absolute risk estimates should be added to improve clinical value (Noordzij et al., 2017; Novelli et al., 2021; Spiegelhalter, 2017; Stensrud and Hern ´ an, 2020).”
BackgroundLinguistically Communicating Uncertainty in Patient-Facing Risk Prediction Models
Sivaprasad, A., & Reiter, E. (2024) · UNCERTAINLP · doi:10.48550/arxiv.2401.17511 · Cited by 1
“Mapping confidence intervals to verbal terms is the commonly employed approach in risk communication (Spiegelhalter, 2017).”
MethodGaissmaier, W., Tiede, K. E., & Garcia-Retamero, R. (2023) · Medical decision making · doi:10.1177/0272989x231201579 · Cited by 1
Watanabe, M., & Fujimi, T. (2022) · Research in Economics · doi:10.1016/j.rie.2022.09.007 · Cited by 1
Fujimi, T., Watanabe, M., & Tatano, H. (2021) · Mitigation and Adaptation Strategies for Global Change · doi:10.1007/s11027-021-09950-9 · Cited by 2
“2001; Spieglhalter 2017; Spieglhalter et al.”
Bolong, J., & Attan, S. A. (2020) · International Journal of Academic Research in Business and Social Sciences · doi:10.6007/ijarbss/v10-i15/8248 · Cited by 1
“It regards the media that can transmit needed information for uncertainty reduction and ambiguity resolution to achieve the goal of communication (Spiegelhalter, 2017).”
BackgroundSantos, M. T. D. R., Silva, M. V. D. C., & Cardoso, T. A. D. O. (2020) · Saúde em Debate · doi:10.1590/0103-11042020e207 · Cited by 1
Metadata
- Authors
- Spiegelhalter, D.
- Affiliations
- University of Cambridge (GB)
- Corresponding author
- Spiegelhalter, David
- ORCID
- Spiegelhalter, David
- Venue
- Annual Review of Statistics and Its Application
- Publisher
- Annual Reviews
- Published
- 2017-03-07
- Volume
- 4
- Issue
- 1
- Pages
- 31-60
- ISSN
- 2326-8298 (ISSN-L)
- 2326-831X
- OpenAlex
- W2529483981
- Cited by
- 248
- References
- 0
- Citations by year
- 2026: 33 · 2025: 35 · 2024: 32 · 2023: 31 · 2022: 31 · 2021: 29 · 2020: 26 · 2019: 15 · 2018: 16
- FWCI
- 4.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Annual Review of Statistics and Its Application (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Risk Perception and Management
- Health Sciences › Health Professions › General Health Professions › Patient-Provider Communication in Healthcare
- Social Sciences › Sociology and Political Science › Climate Change Communication and Perception
- Keywords
- risk communication, uncertainty communication, risk assessment, health risks, gambling, weather forecasting, natural hazards, climate change, environmental exposure, production reliability, catastrophic risk, expert guidance, audience understanding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review