The problems of increasing transparency on uncertainty
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Public regulators (such as European Food Safety Authority, European Medicines Agency, and European Centre for Disease Prevention and Control) are placing increasing demands on scientists to make uncertainties about their evidence transparent to the public. The stated goal is utilitarian, to inform and empower the public and ensure the accountability of policy and decision-making around the use of scientific evidence. However, it is questionable what constitutes uncertainty around the evidence on any given topic, and, while the goal is laudable, we argue the drive to increase transparency on uncertainty of the scientific process specifically does more harm than good, and may not serve the interests of those intended. While highlighting some of the practical implications of making uncertainties transparent using current guidelines, the aim is to discuss what could be done to make it worthwhile for both public and scientists.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Yet, science communicators (e.g. journalists) and scientists themselves are often reluctant to implement it (5–7).”
From Expressions of uncertainty in online science communication hinder information diffusion (2024) · cites this paper as [7]
In the citing paper
“The widespread concern is that expressing uncertainty will undermine the public's trust in science and hinder the dissemination and implementation of scientific findings (7).”
From Expressions of uncertainty in online science communication hinder information diffusion (2024) · cites this paper as [7]
Citations
Cites
Knight, F. H. (1921) · Cited by 16,656
Gauchat, G. (2012) · American Sociological Review · doi:10.1177/0003122412438225 · Cited by 1,091 · cited 1×
“Trust in experts has declined in recent years, though trust in scientists is much higher than in public officials and has remained fairly stable over time (Gauchat, 2012; Ipsos MORI, 2016).”
BackgroundIgnorance is bliss: Or seven reasons not to use uncertainty analysis
Pappenberger, F., & Beven, K. J. (2006) · Water Resources Research · doi:10.1029/2005wr004820 · Cited by 555 · cited 2×
“Assuming the many practical problems of carrying out uncertainty analyses are eradicated, what form should the analyses take? Many experts and policy makers struggle to adequately grasp basic concepts around uncertainty analyses (Pappenberger and Beven, 2006), and for the public to derive a clear understanding they ca…”
BackgroundSinatra, G. M., Kienhues, D., & Hofer, B. K. (2014) · Educational Psychologist · doi:10.1080/00461520.2014.916216 · Cited by 388 · cited 1×
“Scientific literacy among the public varies (Sinatra et al., 2014), and the public is not a homogenous group with the same values, beliefs and attitudes.”
BackgroundUnderstanding modern transparency
Meijer, A. (2009) · International Review of Administrative Sciences · doi:10.1177/0020852309104175 · Cited by 380 · cited 1×
“Moves toward greater transparency in information for public consumption reflects shifts in political, social and cultural attitudes (Meijer, 2009).”
BackgroundHaufler, V. (2010) · Global Environmental Politics · doi:10.1162/glep_a_00014 · Cited by 358 · cited 1×
“Further missing from current knowledge is an appreciation of how the existing information is used by the public (Bouder et al., 2015; Gupta, 2010; Haufler, 2010).”
BackgroundUncertainty: A guide to dealing with uncertainty in quantitative risk and policy analysis
Monaco, R. M. (1992) · International Journal of Forecasting · doi:10.1016/0169-2070(92)90021-z · Cited by 324
Jensen, J. D. (2008) · Human Communication Research · doi:10.1111/j.1468-2958.2008.00324.x · Cited by 298 · cited 1×
“There is also research showing that the public are capable of handling scientific evidence that carries discourse-based caveats and hedges, and that people place greater trust in scientists and journalists when such doubts are communicated (Jensen, 2008).”
BackgroundUncertainty Analysis of Climate Change and Policy Response
Webster, M., Forest, C., Reilly, J., Babiker, M., Kicklighter, D., Mayer, M., Prinn, R., Sarofim, M., Sokolov, A., Stone, P., et al. (2003) · Climatic Change · doi:10.1023/b:clim.0000004564.09961.9f · Cited by 284
Analysis of recent pharmaceutical regulatory documents on analytical method validation
Rozet, E., Ceccato, A., Hubert, C., Ziemons, E., Oprean, R., Rudaz, S., Boulanger, B., & Hubert, P. (2007) · Journal of Chromatography A · doi:10.1016/j.chroma.2007.03.111 · Cited by 266 · cited 2×
“…encourage scientists to conduct structured uncertainty analyses (Bouder et al., 2015; Gupta, 2010; Gupta and Mason, 2016; Reffstrup et al., 2010; Rozet et al., 2007; Speigelhalter and Riesch, 2011; Webster et al., 2003) which regulatory bodies make accessible on their websites without the need…”
BackgroundThe Political Origins of Transparency
Berliner, D. (2014) · The Journal of Politics · doi:10.1017/s0022381613001412 · Cited by 259 · cited 2×
“Some commentators have proposed that the political origins came with the establishment of Freedom of Information (FOI) laws (Berliner, 2014) granting public access to private data, and now found in over 80 countries and many of which came into force since the 1990s; we pick up this point again…”
BackgroundCarroll, L. (1893) · Medical Entomology and Zoology · Cited by 257
Assessing the performance of freedom of information
Hazell, R., & Worthy, B. (2010) · Government Information Quarterly · doi:10.1016/j.giq.2010.03.005 · Cited by 201 · cited 1×
“Several surveys have evaluated FOI requests and found low rates of uptake across several countries (Hazell and Worthy, 2010; Worthy and Hazell, 2016).”
BackgroundRisk assessment of mixtures of pesticides. Current approaches and future strategies
Reffstrup, T. K., Larsen, J. C., & Meyer, O. (2010) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2009.09.013 · Cited by 198 · cited 2×
“…triggered initiatives that encourage scientists to conduct structured uncertainty analyses (Bouder et al., 2015; Gupta, 2010; Gupta and Mason, 2016; Reffstrup et al., 2010; Rozet et al., 2007; Speigelhalter and Riesch, 2011; Webster et al., 2003) which regulatory bodies make accessible on their…”
BackgroundDon't know, can't know: embracing deeper uncertainties when analysing risks
Spiegelhalter, D. J., & Riesch, H. (2011) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2011.0163 · Cited by 185 · cited 2×
“…in the context of such uncertainty analyses, for the reason that in different contexts different representational formats might be easier to interpret than others, regardless of expertise of the audience (Spiegelhalter and Riesch, 2011) and it will be important to investigate this in future work.”
BackgroundTransparency in Global Environmental Governance: A Coming of Age?
(2010) · Global Environmental Politics · doi:10.1162/glep_e_00011 · Cited by 173 · cited 4×
“…for greater transparency have triggered initiatives that encourage scientists to conduct structured uncertainty analyses (Bouder et al., 2015; Gupta, 2010; Gupta and Mason, 2016; Reffstrup et al., 2010; Rozet et al., 2007; Speigelhalter and Riesch, 2011; Webster et al., 2003) which…”
BackgroundInfluentialDisclosing or obscuring? The politics of transparency in global climate governance
Gupta, A., & Mason, M. (2015) · Current Opinion in Environmental Sustainability · doi:10.1016/j.cosust.2015.11.004 · Cited by 145 · cited 2×
“…transparency have triggered initiatives that encourage scientists to conduct structured uncertainty analyses (Bouder et al., 2015; Gupta, 2010; Gupta and Mason, 2016; Reffstrup et al., 2010; Rozet et al., 2007; Speigelhalter and Riesch, 2011; Webster et al., 2003) which regulatory bodies make…”
BackgroundWrestling with uncertain risks: EU regulation of GMOs and the uncertainty paradox
van Asselt, M. B. A., & Vos, E. (2008) · Journal of Risk Research · doi:10.1080/13669870801990806 · Cited by 138 · cited 3×
“Uncertainty expressed by the scientists, therefore, is transposed and repackaged to convey certainty (Van Asselt and Vos, 2008; Verdonck et al., 2007).”
BackgroundEnvironmental Decisions in the Face of Uncertainty
Institute of Medicine (2013) · National Academies Press eBooks · doi:10.17226/12568 · Cited by 130
Scientific uncertainty in media content: Introduction to this special issue
Peters, H. P., & Dunwoody, S. (2016) · Public Understanding of Science · doi:10.1177/0963662516670765 · Cited by 89 · cited 1×
“Indeed, except when it is drawn upon as a motivator for new research, uncertainty will be downplayed by scientists (Peters and Dunwoody, 2016), and for the obvious reason of not casting doubt upon their own work.”
BackgroundMARGETTS, H. (2011) · The Political Quarterly · doi:10.1111/j.1467-923x.2011.02253.x · Cited by 72 · cited 1×
“Others have claimed that increasing demands for access to data from institutions is the consequence of the growing availability and use of data on the Internet (Margetts, 2011).”
BackgroundGuenther, L., & Ruhrmann, G. (2016) · Public Understanding of Science · doi:10.1177/0963662515625479 · Cited by 72 · cited 1×
“…affecting scientists, biases can occur in policy makers’ interpretations of the analyses, not to mention in journalistic communication (an area receiving recent attention in the literature) (see Guenther and Ruhrmann, 2016; Kohl et al., 2015; Lehmkuhl and Peters, 2016; Simmerling and Janich, 2015).”
BackgroundEuropean Commission reform and the origins of the European Transparency Initiative
Cini, M. (2008) · Journal of European Public Policy · doi:10.1080/13501760802133245 · Cited by 66 · cited 1×
“The European Commission underwent significant reform between 2000 and 2004 in response to growing political concerns around administrative ethics, and during that period the European Transparency initiative was born (Cini, 2008).”
BackgroundTransparency in Europe: A Quantitative Study
Bouder, F., Way, D., Löfstedt, R., & Evensen, D. (2015) · Risk Analysis · doi:10.1111/risa.12386 · Cited by 64 · cited 3×
“Demands for greater transparency have triggered initiatives that encourage scientists to conduct structured uncertainty analyses (Bouder et al., 2015; Gupta, 2010; Gupta and Mason, 2016; Reffstrup et al., 2010; Rozet et al., 2007; Speigelhalter and Riesch, 2011; Webster et al., 2003) which…”
BackgroundSelf-citationKohl, P. A., Kim, S. Y., Peng, Y., Akin, H., Koh, E. J., Howell, A. P., & Dunwoody, S. (2016) · Public Understanding of Science · doi:10.1177/0963662515615087 · Cited by 64 · cited 2×
“Aside from the biases affecting scientists, biases can occur in policy makers’ interpretations of the analyses, not to mention in journalistic communication (an area receiving recent attention in the literature) (see Guenther and Ruhrmann, 2016; Kohl et al., 2015; Lehmkuhl and Peters, 2016; Simmerling and Janich, 2015…”
BackgroundHendriks, F., Kienhues, D., & Bromme, R. (2016) · Public Understanding of Science · doi:10.1177/0963662516646048 · Cited by 53 · cited 1×
“Some types of self-raised uncertainty, such as ethical concerns, do not appear to detract from trust in the source (Hendriks et al., 2016).”
BackgroundLehmkuhl, M., & Peters, H. P. (2016) · Public Understanding of Science · doi:10.1177/0963662516646047 · Cited by 45 · cited 2×
“Aside from the biases affecting scientists, biases can occur in policy makers’ interpretations of the analyses, not to mention in journalistic communication (an area receiving recent attention in the literature) (see Guenther and Ruhrmann, 2016; Kohl et al., 2015; Lehmkuhl and Peters, 2016; Simmerling and Janich, 2015…”
BackgroundMeder, B., Lec, F. L., & Osman, M. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.04.008 · Cited by 39 · cited 1×
“In the latter case, outcomes can be fully specified and probabilities assigned to each, and in the former case, the probabilities are not known, and in extreme cases, it may not be possible to fully specify the outcomes (Meder et al., 2013).”
BackgroundSelf-citationDisruptive, Dynamic and Democratic? Ten Years of FOI in the UK
Worthy, B., & Hazell, R. (2016) · Parliamentary Affairs · doi:10.1093/pa/gsv069 · Cited by 38 · cited 3×
“Several surveys have evaluated FOI requests and found low rates of uptake across several countries (Hazell and Worthy, 2010; Worthy and Hazell, 2016).”
BackgroundRhetorical functions of a ‘language of uncertainty’ in the mass media
Simmerling, A., & Janich, N. (2015) · Public Understanding of Science · doi:10.1177/0963662515606681 · Cited by 37 · cited 2×
“Aside from the biases affecting scientists, biases can occur in policy makers’ interpretations of the analyses, not to mention in journalistic communication (an area receiving recent attention in the literature) (see Guenther and Ruhrmann, 2016; Kohl et al., 2015; Lehmkuhl and Peters, 2016; Simmerling and Janich, 2015…”
BackgroundEvidence-based uncertainty analysis: What should we now do in Europe? A view point
Lofstedt, R., & Bouder, F. (2021) · Journal of Risk Research · doi:10.1080/13669877.2017.1316763 · Cited by 37 · cited 3×
“Scientists are called upon to conduct research by public bodies to help guide policy decisions (Löfstedt and Bouder, 2017; Van Asselt and Vos, 2008), and the demand for making transparent the uncertainties around scientific evidence can be traced to reforms around regulatory decision-making.”
BackgroundSelf-citationStakeholders’ rationales for representing uncertainties of biotechnological research
Post, S., & Maier, M. (2016) · Public Understanding of Science · doi:10.1177/0963662516645039 · Cited by 32 · cited 2×
“First, by conducting uncertainty analyses, scientists might be biased towards downplaying uncertainty in their evidence (Post and Maier, 2016), and which could lead to a distortion in the conclusions that are drawn.”
BackgroundImproving Uncertainty Analysis in European Union Risk Assessment of Chemicals
Verdonck, F. A. M., Souren, A., van Asselt, M. B. A., Sprang, P. A. V., & Vanrolleghem, P. A. (2007) · Integrated Environmental Assessment and Management · doi:10.1002/ieam.5630030304 · Cited by 30
de VRIES, M. S., & Sobis, I. (2016) · International Journal of Public Sector Management · doi:10.1108/ijpsm-11-2015-0197 · Cited by 21 · cited 1×
“However, it has been suggested that increasing transparency does not necessarily increase trust in the judgment of public officials and public institutions (De Vries and Sobis, 2016).”
BackgroundWasike, B. (2016) · Government Information Quarterly · doi:10.1016/j.giq.2016.05.001 · Cited by 19 · cited 2×
“Not all requests are granted (around 18%–20% in the United Kingdom in the first 3 years for UKCG-DATA) and, when they are, delays can go beyond the statutory deadline (Wasike, 2016; Worthy and Hazell, 2016).”
BackgroundImproving Uncertainty Analysis in European Union Risk Assessment of Chemicals
Verdonck, F. A. M., Souren, A., van Asselt, M. B., et al. (2007) · Integrated Environmental Assessment and Management · doi:10.1897/1551-3793(2007)3[333:iuaieu]2.0.co;2 · Cited by 17 · cited 1×
“Uncertainty expressed by the scientists, therefore, is transposed and repackaged to convey certainty (Van Asselt and Vos, 2008; Verdonck et al., 2007).”
Backgroundvan Asselt, M. B. A., & Vos, E. (2005) · Water Science & Technology · doi:10.2166/wst.2005.0148 · Cited by 12 · cited 1×
“The interpretations of the evidence alongside uncertainty estimates are susceptible to what is known as the uncertainty paradox (Van Asselt and Vos, 2005).”
BackgroundStakeholders' rationales for representing of scientific uncertainties of biotechnological Research
Post, S., & Maier, M. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-125876 · Cited by 12 · cited 2×
“First, by conducting uncertainty analyses, scientists might be biased towards downplaying uncertainty in their evidence (Post and Maier, 2016), and which could lead to a distortion in the conclusions that are drawn.”
BackgroundMaking a meal out of uncertainty
Osman, M. (2016) · Journal of Risk Research · doi:10.1080/13669877.2016.1240708 · Cited by 8 · cited 2×
“…furthermore, provision of estimates of uncertainty around what scientists did not know at the time and how that might impact their conclusions, in addition to description of individual aspects of what they did not know and how these uncertainties might each impact conclusions (Osman, 2016).”
BackgroundSelf-citation(EFSA), E. F. S. A. (2016) · EFSA Supporting Publications · doi:10.2903/sp.efsa.2016.en-1011 · Cited by 4
Cited by
The effects of communicating uncertainty on public trust in facts and numbers
van der Bles, A. M., van der Linden, S., Freeman, A. L. J., & Spiegelhalter, D. J. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1913678117 · Cited by 348
Predictors and consequences of intellectual humility
Porter, T., Elnakouri, A., Meyers, E. A., Shibayama, T., Jayawickreme, E., & Grossmann, I. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00081-9 · Cited by 248
The Evolving Field of Risk Communication
Balog‐Way, D., McComas, K., & Besley, J. (2020) · Risk Analysis · doi:10.1111/risa.13615 · Cited by 220
Scientific Testimony: Its roles in science and society
Gerken, M. (2022) · doi:10.1093/oso/9780198857273.001.0001 · Cited by 76
Reporting preprints in the media during the COVID-19 pandemic
Schalkwyk, F. B. V., & Dudek, J. (2022) · Public Understanding of Science · doi:10.1177/09636625221077392 · Cited by 42
Metadata
- Authors
- Osman, M., Heath, A. J., & Löfstedt, R.
- Affiliations
- Queen Mary University of London (GB)
- Linnaeus University (SE)
- King's College London (GB)
- Corresponding author
- Osman, Magda
- Venue
- Public Understanding of Science
- Publisher
- SAGE Publications
- Published
- 2017-05-23
- Volume
- 27
- Issue
- 2
- Pages
- 131-138
- ISSN
- 0963-6625 (ISSN-L)
- 1361-6609
- OpenAlex
- W2619799607
- Cited by
- 42
- References
- 40
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 7 · 2023: 3 · 2022: 20 · 2021: 1 · 2020: 3 · 2019: 3
- FWCI
- 4.19
- Type
- journal article
- Language
- en
- Open access
- green
- qmro.qmul.ac.uk
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Public Understanding of Science (publishedVersion)
- PubMed (publishedVersion)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion)
- Research Portal (King's College London) (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Risk Perception and Management
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Keywords
- scientific uncertainty, scientific evidence, EFSA, European Medicines Agency, European Centre for Disease Prevention and Control, science communication
- MeSH terms
- Communicable Disease Control, Decision Making, European Union, Science, Evidence-Based Medicine, Disclosure, Information Dissemination, Uncertainty, Food Safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.