Public perception and communication of scientific uncertainty.
The DOI matches its Crossref record; 46 of the 47 references it cites were found in a registry or an index.
Abstract
Understanding how the public perceives uncertainty in scientific research is fundamental for effective communication about research and its inevitable uncertainty. Previous work found that scientific evidence differentially influenced beliefs from individuals with different political ideologies. Evidence that threatens an individual's political ideology is perceived as more uncertain than nonthreatening evidence. The authors present 3 studies examining perceptions of scientific uncertainty more broadly by including sciences that are not politically polarizing. Study 1 develops scales measuring perceptions of scientific uncertainty. It finds (a) 3 perceptual dimensions of scientific uncertainty, with the primary dimension representing a perception of precision; (b) the precision dimension of uncertainty is strongly associated with the perceived value of a research field; and (c) differences in perceived uncertainty across political affiliations. Study 2 manipulated these dimensions, finding that Republicans were more sensitive than Democrats to descriptions of uncertainty associated with a research field (e.g., psychology). Study 3 found that these views of a research field did not extend to the evaluation of individual results produced by the field. Together, these studies show that perceptions of scientific uncertainty associated with entire research fields are valid predictors of abstract perceptions of scientific quality, benefit, and allocation of funding. Yet, they do not inform judgments about individual results. Therefore, polarization in the acceptance of specific results is not likely due to individual differences in perceived scientific uncertainty. Further, the direction of influence potentially could be reversed, such that perceived quality of scientific results could be used to influence perceptions about scientific research fields. (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Many scientific claims are limited by measurement error, modeling approximations, and statistical assumptions (Broomell and Kane, 2017).”
From A review of the effects of uncertainty in public science communication (2020) · cites this paper as Broomell and Kane, 2017
Citations
Cites
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Slovic, P. (1987) · Science · doi:10.1126/science.3563507 · Cited by 9,271 · cited 2×
“Study 1 draws on research methods from risk perception and risk scaling (Fischhoff, Slovic, Lichtenstein, Read, & Combs, 1978; Slovic, 1987; Willis, DeKay, Fischhoff, & Morgan, 2005), research pivotal in identifying the differences in how experts and the public perceive their exposure to risk from hazards and disaster…”
Method“Risk, Ambiguity, and the Savage Axioms.”
Ellsberg, D. (1961) · The Quarterly Journal of Economics · doi:10.2307/1884324 · Cited by 7,891
How safe is safe enough? A psychometric study of attitudes towards technological risks and benefits
Fischhoff, B., Slovic, P., Lichtenstein, S., Read, S., & Combs, B. (1978) · Policy Sciences · doi:10.1007/bf00143739 · Cited by 2,834 · cited 1×
“These items were generated based on the approach used by Fischhoff et al. (1978) to link risk perceptions to policy-related variables.”
MethodDefining Uncertainty: A Conceptual Basis for Uncertainty Management in Model-Based Decision Support
Walker, W. E., Harremoës, P., Rotmans, J., van der Sluijs, J. P., van Asselt, M. B. A., Janssen, P., & Krayer von Krauss, M. P. (2003) · Integrated Assessment · doi:10.1076/iaij.4.1.5.16466 · Cited by 2,067 · cited 2×
“Explicit attempts to create normative frameworks for characterizing uncertainty include NUSAP (Funtowicz & Ravetz, 1990), uncertainty matrices (Walker et al., 2003), subjective scales adapted from the U.S. legal system’s level of evidence (Weiss, 2003), and the elicitation of Bayesian credible…”
BackgroundA better lemon squeezer? maximum-likelihood regression with beta-distributed dependent variables.
Smithson, M., & Verkuilen, J. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.1.54 · Cited by 1,788 · cited 2×
“A full treatment for how to implement and interpret maximum likelihood regression using beta-distributed variables can be found in Smithson and Verkuilen (2006).”
MethodBalance as bias: global warming and the US prestige press
Boykoff, M. T., & Boykoff, J. M. (2004) · Global Environmental Change · doi:10.1016/j.gloenvcha.2003.10.001 · Cited by 1,699 · cited 1×
“For example, consider the approach of the branding global warming versus climate change (Akerlof & Maibach, 2011; Whitmarsh, 2009) and the negative impact of highlighting expert disagreements about climate science (Boykoff & Boykoff, 2004; Lewandowsky, Gignac, & Vaughan, 2013).”
BackgroundUncertain Judgements: Eliciting Experts' Probabilities
O'Hagan, A., Buck, C. E., Daneshkhah, A., Eiser, J. R., Garthwaite, P. H., Jenkinson, D. J., Oakley, J. E., & Rakow, T. (2006) · doi:10.1002/0470033312 · Cited by 1,550
The base-rate fallacy in probability judgments
Bar-Hillel, M. (1980) · Acta Psychologica · doi:10.1016/0001-6918(80)90046-3 · Cited by 1,183 · cited 2×
“We believe this is a form of base-rate neglect (Bar-Hillel, 1980) where decision makers rely on detailed individuating information and ignore their beliefs about the base-rate of overturned results produced by a field.”
BackgroundCompetence in experts: The role of task characteristics
Shanteau, J. (1992) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(92)90064-e · Cited by 864 · cited 2×
“Therefore, scientific research fields are also viewed in terms of the uncertainties that generally plague their theories, measurements, and results (also called task characteristics; Shanteau, 1992).”
BackgroundFeygina, I., Jost, J. T., & Goldsmith, R. E. (2010) · Personality and Social Psychology Bulletin · doi:10.1177/0146167209351435 · Cited by 720
The Role of Conspiracist Ideation and Worldviews in Predicting Rejection of Science
Lewandowsky, S., Gignac, G. E., & Oberauer, K. (2013) · PLoS ONE · doi:10.1371/journal.pone.0075637 · Cited by 693 · cited 1×
“Zia and Todd (2010) and Lewandowsky, Gignac, and Oberauer (2013) found a positive correlation between conservative political identity and belief that science surrounding climate change was highly uncertain.”
BackgroundThe role of social and decision sciences in communicating uncertain climate risks
Pidgeon, N., & Fischhoff, B. (2011) · Nature Climate Change · doi:10.1038/nclimate1080 · Cited by 680 · cited 2×
“In addition, the uncertainty associated with climate change has important implications for decision making and risk communication (see, Budescu et al., 2014; Lewandowsky, Risbey, Smithson, Newell, & Hunter, 2014; Lewandowsky, Risbey, Smithson, & Newell, 2014; Pidgeon & Fischhoff, 2011).”
BackgroundAmbiguity Aversion and Comparative Ignorance
Fox, C. R., & Tversky, A. (2000) · Choices, Values, and Frames · doi:10.1017/cbo9780511803475.031 · Cited by 670
The pivotal role of perceived scientific consensus in acceptance of science
Lewandowsky, S., Gignac, G. E., & Vaughan, S. (2013) · Nature Climate Change · doi:10.1038/nclimate1720 · Cited by 527 · cited 1×
“Lewandowsky, Gignac, and Vaughan (2013) reported that beliefs about a large scientific consensus with regard to climate change are positively correlated with beliefs about the existence of climate change.”
BackgroundFree-Market Ideology and Environmental Degradation: The Case of Belief in Global Climate Change
Heath, Y., & Gifford, R. (2006) · Environment and Behavior · doi:10.1177/0013916505277998 · Cited by 473 · cited 1×
“For example, polarized perceptions of uncertainty are especially apparent for climate change with psychological studies revealing differences in beliefs, values, and action based on political affiliation (Budescu et al., 2012; Feygina, Jost, & Goldsmith, 2010; Heath & Gifford, 2006).”
BackgroundNisbet, E. C., Cooper, K. E., & Garrett, R. K. (2015) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716214555474 · Cited by 437
Climategate, Public Opinion, and the Loss of Trust
Leiserowitz, A. A., Maibach, E. W., Roser-Renouf, C., Smith, N., & Dawson, E. (2013) · American Behavioral Scientist · doi:10.1177/0002764212458272 · Cited by 406
The sciences of science communication
Fischhoff, B. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1213273110 · Cited by 362 · cited 1×
“T hi s ar tic le is in te nd ed so le ly fo r th e pe rs on al us e of th e in di vi du al us er an d is no t to be di ss em in at ed br oa dl y. (Fischhoff, 2011, 2013; Pidgeon & Fischhoff, 2011).”
Communicating the Uncertainty of Harms and Benefits of Medical Interventions
Politi, M. C., Han, P. K. J., & Col, N. F. (2007) · Medical Decision Making · doi:10.1177/0272989x07307270 · Cited by 344
Perceived scientific agreement and support for government action on climate change in the USA
McCright, A. M., Dunlap, R. E., & Xiao, C. (2013) · Climatic Change · doi:10.1007/s10584-013-0704-9 · Cited by 334 · cited 1×
“McCright et al. (2013) and Nisbet et al. (2015) found that it was possible to manipulate this relationship by varying whether scientific messages included a politically charged element.”
BackgroundCommunicating scientific uncertainty
Fischhoff, B., & Davis, A. L. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1317504111 · Cited by 312 · cited 1×
“Scientists are increasingly turning to psychology for help in designing effective communications (e.g., Fischhoff & Davis, 2014).”
BackgroundThe interpretation of IPCC probabilistic statements around the world
Budescu, D. V., Por, H.-H., Broomell, S. B., & Smithson, M. (2014) · Nature Climate Change · doi:10.1038/nclimate2194 · Cited by 291 · cited 1×
“In addition, the uncertainty associated with climate change has important implications for decision making and risk communication (see, Budescu et al., 2014; Lewandowsky, Risbey, Smithson, Newell, & Hunter, 2014; Lewandowsky, Risbey, Smithson, & Newell, 2014; Pidgeon & Fischhoff, 2011).”
BackgroundSelf-citationEffective Communication of Uncertainty in the IPCC Reports
Budescu, D. V., Por, H.-H., & Broomell, S. B. (2012) · Climatic Change · doi:10.1007/s10584-011-0330-3 · Cited by 261 · cited 1×
“For example, polarized perceptions of uncertainty are especially apparent for climate change with psychological studies revealing differences in beliefs, values, and action based on political affiliation (Budescu et al., 2012; Feygina, Jost, & Goldsmith, 2010; Heath & Gifford, 2006).”
BackgroundSelf-citationParents’ vaccination comprehension and decisions
Downs, J. S., de Bruin, W. B., & Fischhoff, B. (2008) · Vaccine · doi:10.1016/j.vaccine.2008.01.011 · Cited by 245 · cited 1×
“These results typically need to battle psychological limitations such as the improper evaluation of evidence (Tversky & Kahneman, 1974), compelling anecdotes (Arkes & Gaissmaier, 2012), and incomplete mental models (Downs et al., 2008).”
BackgroundProcessing Linguistic Probabilities: General Principles and Empirical Evidence
Budescu, D. V., & Wallsten, T. S. (1995) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60313-8 · Cited by 199 · cited 1×
“In Study 3 we investigate the connection between perceptions of scientific uncertainty established in Studies 1 and 2 with evaluations of individual results using a theory introduced by Budescu and Wallsten (1995), called the congruency principle.”
MethodThe center and range of the probability interval as factors affecting ambiguity preferences
Curley, S. P., & Yates, J. F. (1985) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(85)90016-0 · Cited by 186 · cited 1×
“Previous studies demonstrating ambiguity aversion found that participants prefer gambles that are precisely specified over gambles that are imprecisely specified, even at a premium (Curley & Yates, 1985).”
BackgroundZia, A., & Todd, A. M. (2010) · Public Understanding of Science · doi:10.1177/0963662509357871 · Cited by 172 · cited 1×
“Zia and Todd (2010) and Lewandowsky, Gignac, and Oberauer (2013) found a positive correlation between conservative political identity and belief that science surrounding climate change was highly uncertain.”
BackgroundConfidence in aggregation of expert opinions
Budescu, D. V., & Rantilla, A. K. (2000) · Acta Psychologica · doi:10.1016/s0001-6918(00)00037-8 · Cited by 170 · cited 1×
“Diverging estimates have been found to (a) lower confidence (Budescu & Rantilla, 2000) and, if independently sampled, (b) increase judgment accuracy (Yaniv, Choshen-Hillel, & Milyavsky, 2009).”
BackgroundConflict Aversion: Preference for Ambiguity vs Conflict in Sources and Evidence
Smithson, M. (1999) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1999.2844 · Cited by 158 · cited 3×
“However, the dis-preference for conflict relative to imprecision is not ubiquitous and is sensitive to framing effects (Smithson, 1999).”
BackgroundYaniv, I., Choshen-Hillel, S., & Milyavsky, M. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0014589 · Cited by 108
Patients Derogate Physicians Who Use a Computer-Assisted Diagnostic Aid
Arkes, H. R., Shaffer, V. A., & Medow, M. A. (2007) · Medical Decision Making · doi:10.1177/0272989x06297391 · Cited by 101
Scientific uncertainty and climate change: Part I. Uncertainty and unabated emissions
Lewandowsky, S., Risbey, J. S., Smithson, M., Newell, B. R., & Hunter, J. (2014) · Climatic Change · doi:10.1007/s10584-014-1082-7 · Cited by 89
Aggregate, Disaggregate, and Hybrid Analyses of Ecological Risk Perceptions
Willis, H. H., DeKay, M. L., Fischhoff, B., & Morgan, M. G. (2005) · Risk Analysis · doi:10.1111/j.1539-6924.2005.00599.x · Cited by 85
The appeal of vague financial forecasts
Du, N., Budescu, D. V., Shelly, M. K., & Omer, T. C. (2010) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2010.10.005 · Cited by 82
Scientific uncertainty and climate change: Part II. Uncertainty and mitigation
Lewandowsky, S., Risbey, J. S., Smithson, M. J., & Newell, B. R. (2014) · Climatic Change · doi:10.1007/s10584-014-1083-6 · Cited by 80
Expressing scientific uncertainty
Weiss, C. (2003) · Law, Probability and Risk · doi:10.1093/lpr/2.1.25 · Cited by 72 · cited 4×
“legal system’s level of evidence (Weiss, 2003), and the elicitation of Bayesian credible intervals (Morgan & Henrion, 1990; O’Hagan et al.”
BackgroundInfluentialModeling certainty equivalents for imprecise gambles
Budescu, D. V., Kuhn, K. M., Kramer, K. M., & Johnson, T. R. (2002) · Organizational Behavior and Human Decision Processes · doi:10.1016/s0749-5978(02)00014-6 · Cited by 69
Did the Arctic Ice Recover? Demographics of True and False Climate Facts
Hamilton, L. C. (2012) · Weather Climate and Society · doi:10.1175/wcas-d-12-00008.1 · Cited by 60 · cited 1×
“In addition, Hamilton (2012) provided evidence that the public exhibits a biased assimilation of scientific information, where educated individuals accept specific pieces of evidence that are in agreement with their political beliefs and reject evidence that disagrees with their political beliefs.”
BackgroundCommunicating about the risks of terrorism (or anything else).
Fischhoff, B. (2011) · American Psychologist · doi:10.1037/a0024570 · Cited by 57 · cited 2×
“In addition, the uncertainty associated with climate change has important implications for decision making and risk communication (see, Budescu et al., 2014; Lewandowsky, Risbey, Smithson, Newell, & Hunter, 2014; Lewandowsky, Risbey, Smithson, & Newell, 2014; Pidgeon & Fischhoff, 2011).”
BackgroundThe Effects of Presenting Imprecise Probabilities in Intelligence Forecasts
Dieckmann, N. F., Mauro, R., & Slovic, P. (2010) · Risk Analysis · doi:10.1111/j.1539-6924.2010.01384.x · Cited by 54
Psychological Research and the Prostate-Cancer Screening Controversy
Arkes, H. R., & Gaissmaier, W. (2012) · Psychological Science · doi:10.1177/0956797612437428 · Cited by 54 · cited 1×
“These results typically need to battle psychological limitations such as the improper evaluation of evidence (Tversky & Kahneman, 1974), compelling anecdotes (Arkes & Gaissmaier, 2012), and incomplete mental models (Downs et al., 2008).”
BackgroundExpert judgments of pandemic influenza risks
de Bruin, W. B., Fischhoff, B., Brilliant, L., & Caruso, D. (2006) · Global Public Health · doi:10.1080/17441690600673940 · Cited by 50
A rose by any other name ...?: What members of the general public prefer to call “climate change”
Akerlof, K., & Maibach, E. W. (2011) · Climatic Change · doi:10.1007/s10584-011-0070-4 · Cited by 48 · cited 1×
“For example, consider the approach of the branding global warming versus climate change (Akerlof & Maibach, 2011; Whitmarsh, 2009) and the negative impact of highlighting expert disagreements about climate science (Boykoff & Boykoff, 2004; Lewandowsky, Gignac, & Vaughan, 2013).”
BackgroundHandling uncertainty in science
Palmer, T. N., & Hardaker, P. J. (2011) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2011.0280 · Cited by 44 · cited 1×
“Uncertainty is a natural part of scientific research and can arise from varied sources with which the public may (or may not) be familiar (Morgan & Henrion, 1990; Palmer & Hardaker, 2011; Rowe, 1994).”
BackgroundListings: Science in culture 2015
Cressey, D. (2014) · Nature · doi:10.1038/517018a · Cited by 1 · cited 4×
“…(Weiss, 2003), in areas as diverse as climate change (Budescu, Por, & Broomell, 2012; Budescu, Por, Broomell, & Smithson, 2014), forensics (Cressey, 2015), medicine (Politi, Han, & Col, 2007), terror threats (Dieckmann, Mauro, & Slovic, 2010), pandemics (Bruine de Bruin, Fischhoff,…”
BackgroundInfluential
Cited by
A review of the effects of uncertainty in public science communication
Gustafson, A., & Rice, R. E. (2020) · Public Understanding of Science · doi:10.1177/0963662520942122 · Cited by 291
“…generalizations, disagreement among experts, conflicting evidence, a deficit of extant data, an expanding problem space, an alternative set of underlying models and assumptions, or fundamental unfalsifiability (Broomell and Kane, 2017; Pidgeon and Beattie, 1997; Rice et al., 2018; Zehr, 2000).”
BackgroundFischhoff, B., & Broomell, S. B. (2020) · Annual Review of Psychology · doi:10.1146/annurev-psych-010419-050747 · Cited by 163
“They might wonder whether lay observers’ sense of uncertainty suggests problems that analysts do not see or acknowledge (Broomell & Kane 2017).”
BackgroundSelf-citationThe Effects of Uncertainty Frames in Three Science Communication Topics
Gustafson, A., & Rice, R. E. (2019) · Science Communication · doi:10.1177/1075547019870811 · Cited by 151
“Political ideology and partisan identification often are important influences on individuals’ opinions about science issues, and some research has found that political views moderate the effects of uncertainty frames (Broomell & Kane, 2017).”
BackgroundResultInfluentialNo Replication, No Trust? How Low Replicability Influences Trust in Psychology
Wingen, T., Berkessel, J. B., & Englich, B. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550619877412 · Cited by 119
“As an additional dependent variable, we measured participants perceived value of psychological science with 4 items (e.g., “Please rate the societal benefit of research produced by psychological science”; a ¼ .80; 1 ¼ very low, 5 ¼ very high; adapted from Broomell & Kane, 2017).”
BackgroundMethodAnglin, S. M. (2019) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2019.02.004 · Cited by 53
Metadata
- Authors
- Broomell, S. B., & Kane, P. B.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- Journal of Experimental Psychology: General
- Published
- 2017
- Volume
- 146
- Issue
- 2
- Pages
- 286-304
- ISSN
- 0096-3445 (ISSN-L)
- 1939-2222
- OpenAlex
- W2581641843
- Cited by
- 64
- References
- 47
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 6 · 2023: 8 · 2022: 7 · 2021: 10 · 2020: 11 · 2019: 5 · 2018: 2 · 2017: 5
- FWCI
- 16.10
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Experimental Psychology General (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Carnegie Mellon University
- Topics
- Social Sciences › Sociology and Political Science › Climate Change Communication and Perception
- Social Sciences › Sociology and Political Science › Risk Perception and Management
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- scientific uncertainty, public perception of science, science communication, political ideology, research funding allocation, scale development
- MeSH terms
- Attitude, Communication, Humans, Judgment, Politics, Public Opinion, Research Support as Topic, Science, United States, Uncertainty, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.