Policy: Twenty tips for interpreting scientific claims
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There are several ways to spin a report (4, 6, 8–10).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [6]
In the citing paper
“A user’s guide to detect misleading claims in clinical research reports (79) and tips for interpreting claims (6) are available, but should be more widely used.”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [6]
Citations
Cites
Reliability Evaluation of Power Systems
Billinton, R., & Allan, R. N. (1984) · Springer eBooks · doi:10.1007/978-1-4615-7731-7 · Cited by 3,350
Remedies for pseudoreplication
Millar, R. B., & Anderson, M. J. (2004) · Fisheries Research · doi:10.1016/j.fishres.2004.08.016 · Cited by 292
Lay Foibles and Expert Fables in Judgments about Risk
Fischhoff, B., Slovic, P., & Lichtenstein, S. (1982) · The American Statistician · doi:10.1080/00031305.1982.10482845 · Cited by 266
Borsuk, M. E., Stow, C. A., & Reckhow, K. H. (2003) · Journal of Water Resources Planning and Management · doi:10.1061/(asce)0733-9496(2003)129:4(271 · Cited by 105
Statistical reform in medicine, psychology and ecology
Fidler, F. M., Cumming, G., Burgman, M. A., & Thomason, N. R. (2004) · The Journal of Socio-Economics · doi:10.1016/j.socec.2004.09.035 · Cited by 102
Self-citationIMPROVING RISK ASSESSMENT FOR NONTARGET SAFETY OF TRANSGENIC CROPS
Marvier, M. (2002) · Ecological Applications · doi:10.1890/1051-0761(2002)012[1119:irafns]2.0.co;2 · Cited by 90
Simple Analgesics for Arthritis
Huskisson, E. C. (1974) · BMJ · doi:10.1136/bmj.4.5938.196 · Cited by 86
Doubleday, R., & Wilsdon, J. (2012) · Nature · doi:10.1038/485301a · Cited by 29
Maslova, E., Halldorsson, T. I., Strøm, M., & Olsen, S. F. (2011) · Journal of Nutritional Science · doi:10.1017/jns.2012.5 · Cited by 1
Research works printed but not linked: 1
- Fischhoff, B., Slovic, P. & Lichtenstein, S. Am. Stat. 36, 240–255 (1982).
Cited by
Misrepresentation and distortion of research in biomedical literature
Boutron, I., & Ravaud, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1710755115 · Cited by 273
“A user’s guide to detect misleading claims in clinical research reports (79) and tips for interpreting claims (6) are available, but should be more widely used.”
BackgroundThe effect of scientific evidence on conservation practitioners’ management decisions
Walsh, J. C., Dicks, L. V., & Sutherland, W. J. (2015) · Conservation Biology · doi:10.1111/cobi.12370 · Cited by 244
Self-citationUnderstanding and managing trust at the climate science–policy interface
Lacey, J., Howden, M., Cvitanovic, C., & Colvin, R. M. (2018) · Nature Climate Change · doi:10.1038/s41558-017-0010-z · Cited by 187
Policy: The art of science advice to government
Gluckman, P. (2014) · Nature · doi:10.1038/507163a · Cited by 183
The major barriers to evidence‐informed conservation policy and possible solutions
Rose, D. C., Sutherland, W. J., Amano, T., González‐Varo, J. P., Robertson, R. J., Simmons, B. I., Wauchope, H. S., Kovács, E. K., Durán, A. P., Vadrot, A. B. M., et al. (2018) · Conservation Letters · doi:10.1111/conl.12564 · Cited by 158
“In reading the exchange between Sutherland, Spiegelhalter, and Burgman (2013) and Tyler (2013), for example, we may have expected scientists to place the emphasis on training policy-makers to comprehend science, in other words blaming policy-makers for lack of understanding, rather than criticizing…”
BackgroundSelf-citationScience–policy processes for transboundary water governance
Armitage, D. R., de Loë, R. C., Morris, M., Edwards, T. W. D., Gerlak, A. K., Hall, R. I., Huitema, D., Ison, R. L., Livingstone, D., MacDonald, G., et al. (2015) · AMBIO · doi:10.1007/s13280-015-0644-x · Cited by 182
“…(2010); Wolfe et al. (2012); Government of Canada (2010); N.B.: Over the last decade, the authors have worked on a range of natural and social science studies in all of these basins 123 Royal Swedish Academy of Sciences 2015 www.kva.se/en 2006; Lejano and Ingram 2009; Sutherland et al. 2013).”
BackgroundHistorical perspectives on the impact of n-3 and n-6 nutrients on health
Lands, B. (2014) · Progress in Lipid Research · doi:10.1016/j.plipres.2014.04.002 · Cited by 145
The Passions and the Interests: Unpacking the 'Sharing Economy'Preprint
Codagnone, C., Biagi, F., & Fabienne, A. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2793901 · Cited by 180
“127 ix In the past five years criticisms in the media have shattered the scientific enterprise (Glenn Begley, 2013); Nature published a piece containing 20 tips for politicians to interpret scientific claim where the key message is that uncertainty and measurement errors are always present in any scientific work (Suth…”
BackgroundRöckmann, C., van Leeuwen, J., Goldsborough, D., Kraan, M., & Piet, G. J. (2014) · Marine Policy · doi:10.1016/j.marpol.2014.10.019 · Cited by 129
Can we save large carnivores without losing large carnivore science?
Allen, B. L., Allen, L. R., Andrén, H., Ballard, G., Boitani, L., Engeman, R. M., Fleming, P. J. S., Ford, A. T., Haswell, P. M., Kowalczyk, R., et al. (2017) · Food Webs · doi:10.1016/j.fooweb.2017.02.008 · Cited by 112
Chalmers, I., Oxman, A. D., Dahlgren, A., Ryan-Vig, S., Pannell, S., Sewankambo, N. K., Semakula, D., Nsangi, A., Albarqouni, L., Glasziou, P., et al. (2018) · BMJ Evidence-Based Medicine · doi:10.1136/ebmed-2017-110829 · Cited by 83
Beven, K. J., Aspinall, W. P., Bates, P., Borgomeo, E., Goda, K., Hall, J. W., Page, T., Phillips, J. C., Simpson, M. H., Smith, P. J., et al. (2018) · Natural hazards and earth system sciences · doi:10.5194/nhess-18-2769-2018 · Cited by 99
“…of specifying odds or probabilities for epistemic uncertainties means that any resulting decisions will necessarily be conditional on the assumptions (as discussed, for example, by Pappenberger and Beven, 2006; Beven, 2009; Sutherland et al., 2013; Rougier and Beven, 2013; and Juston et al., 2013).”
BackgroundConservation Research, Policy and Practice
Sutherland, W. J., Brotherton, P. N. M., Ockendon, N., Pettorelli, N., Vickery, J. A., Davies, Z. G., Boyd, I., Wintle, B. C., Kennicutt, M. C., II, Altringham, J. D., et al. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108638210 · Cited by 88
Self-citationHaneef, R., Lazarus, C., Ravaud, P., Yavchitz, A., & Boutron, I. (2015) · PLOS ONE · doi:10.1371/journal.pone.0140889 · Cited by 70
“First, we identified spin from a literature review on spin in published articles [5, 6, 12, 14, 16–27] and on reporting of scientific results in media and press releases [2, 4, 7, 9, 13, 28–38].”
BackgroundThe case for policy-relevant conservation science
Rose, D. C. (2014) · Conservation Biology · doi:10.1111/cobi.12444 · Cited by 70
“For example, Sutherland et al. (2013) argue that conservation evidence will be more influential if policy makers understand “20 points” about science.”
BackgroundInfluentialCooke, S. J., Rytwinski, T., Taylor, J. J., Nyboer, E. A., Nguyen, V. M., Bennett, J., Young, N., Aitken, S. M., Auld, G. A., Lane, J., et al. (2020) · Environmental Reviews · doi:10.1139/er-2020-0045 · Cited by 82
“Yet, despite being called for more than a decade ago (i.e., Sutherland et al. 2013), evidence-based management still faces many challenges.”
BackgroundIncreased scientific rigor will improve reliability of research and effectiveness of management
Sells, S. N., Bassing, S. B., Barker, K. J., Forshee, S. C., Keever, A. C., Goerz, J. W., & Mitchell, M. S. (2018) · Journal of Wildlife Management · doi:10.1002/jwmg.21413 · Cited by 71
“Basing management decisions on inferences gained from rigorously tested a priori hypotheses increases the likelihood of those decisions resulting in the desired effect (Sutherland et al. 2013).”
BackgroundReasons to Be Skeptical about Sentience and Pain in Fishes and Aquatic Invertebrates
Diggles, B. K., Arlinghaus, R., Browman, H. I., Cooke, S. J., Cooper, R. L., Cowx, I. G., Derby, C. D., Derbyshire, S. W. G., Hart, P. J. B., Jones, B., et al. (2023) · Reviews in Fisheries Science & Aquaculture · doi:10.1080/23308249.2023.2257802 · Cited by 74
“…thinking to the various scientific issues highlighted here is vitally important if policy makers are to interpret the limited data available (Sutherland et al. 2013) and develop sound policies which avoid the potential “lose-lose” situations and unintended consequences which could otherwise…”
BackgroundDistinguishing relative specialist and generalist species in the fossil record
Wilson, B., & Hayek, L. C. (2015) · Marine Micropaleontology · doi:10.1016/j.marmicro.2015.07.001 · Cited by 60
Calling for a new agenda for conservation science to create evidence-informed policy
Rose, D. C., Amano, T., González‐Varo, J. P., Mukherjee, N., Robertson, R. J., Simmons, B. I., Wauchope, H. S., & Sutherland, W. J. (2019) · Biological Conservation · doi:10.1016/j.biocon.2019.108222 · Cited by 68
“Poor communication can enhance the chances of evidence being misinterpreted, particularly by non-specialist policy-makers (Rose and Parsons, 2015; Sutherland et al., 2013).”
BackgroundSelf-citationRecent advances in understanding neuropathic pain: glia, sex differences, and epigenetics
Machelska, H., & Celik, M. Ö. (2016) · F1000Research · doi:10.12688/f1000research.9621.1 · Cited by 60
Foxcroft, L. C., Spear, D., van Wilgen, N. J., & McGeoch, M. A. (2019) · NeoBiota · doi:10.3897/neobiota.43.29644 · Cited by 67
“Although there is a rapidly expanding body of literature, this knowledge is often difficult to access and remains outside the realms of policy makers and managers (Cook et al. 2010, Sutherland et al. 2013).”
BackgroundWhen are hypotheses useful in ecology and evolution?
Betts, M. G., Hadley, A. S., Frey, D. W., Frey, S. J. K., Gannon, D. G., Harris, S. H., Kim, H., Kormann, U. G., Leimberger, K. G., Moriarty, K. M., et al. (2021) · Ecology and Evolution · doi:10.1002/ece3.7365 · Cited by 61
“By understanding and testing mechanisms, science becomes more reliable and transferable (Ayres & Lombardero, 2017; Houlahan et al., 2017; Sutherland et al., 2013) (Figure 1).”
BackgroundRiparian Zones—From Policy Neglected to Policy Integrated
Urbanič, G., Politti, E., Rodríguez‐González, P. M., Payne, R., Schook, D. M., Alves, M. H., Anđelković, A., Bruno, D., Chilikova–Lubomirova, M., Lonardo, S. D., et al. (2022) · Frontiers in Environmental Science · doi:10.3389/fenvs.2022.868527 · Cited by 59
Transforming Conservation: A Practical Guide to Evidence and Decision Making
Amano, T., Bako, L. A., Best, M., Boenisch, N., Boersch‐Supan, P. H., Browne, D., Buckley, Y. M., Burgman, M. A., Cadotte, M. W., Canessa, S., et al. (2022) · Open Book Publishers · doi:10.11647/obp.0321 · Cited by 61
Self-citationEvaluation of Spin in the Abstracts of Emergency Medicine Randomized Controlled Trials
Vaughn, V., Riddle, J., Brown, J., Schiesel, M., Wayant, C., & Vassar, M. B. (2019) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2019.03.011 · Cited by 49
Dieckmann, N. F., & Johnson, B. B. (2019) · PLoS ONE · doi:10.1371/journal.pone.0211269 · Cited by 45
A conceptual framework for the emerging discipline of conservation physiology
Coristine, L. E., Robillard, C. M., Kerr, J. T., O’Connor, C. M., Lapointe, D., & Cooke, S. J. (2014) · Conservation Physiology · doi:10.1093/conphys/cou033 · Cited by 44
“When both sides of the conservation physiology discipline can view the findings of the other, it leads to a mutual awareness of contributions (Sutherland et al., 2013), a need highlighted and partly addressed by the newly created journal, Conservation Physiology.”
BackgroundProstate Segmentation Based on Variant Scale Patch and Local Independent Projection
Wu, Y., Liu, G., Huang, M., Guo, J., Jiang, J., Yang, W., Chen, W., & Feng, Q. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2308901 · Cited by 34
Mapping transition potential with stakeholder- and policy-driven scenarios in Rotterdam City
Larondelle, N., Frantzeskaki, N., & Haase, D. (2016) · Ecological Indicators · doi:10.1016/j.ecolind.2016.02.028 · Cited by 38
Macher, C., Steins, N. A., Ballesteros, M., Kraan, M., Frangoudès, K., Bailly, D., Bertignac, M., Colloca, F., Fitzpatrick, M., García, D., et al. (2021) · Aquatic Living Resources · doi:10.1051/alr/2021010 · Cited by 45
Mobilizing practitioners to support the Emergency Recovery Plan for freshwater biodiversity
Twardek, W. M., Nyboer, E. A., Tickner, D., O’Connor, C. M., Lapointe, N. W. R., Taylor, M. K., Gregory‐Eaves, I., Smol, J. P., Reid, A. J., Creed, I. F., et al. (2021) · Conservation Science and Practice · doi:10.1111/csp2.467 · Cited by 36
Beyond Calculations: A Course in Statistical Thinking
Steel, E. A., Liermann, M. C., & Guttorp, P. M. (2019) · The American Statistician · doi:10.1080/00031305.2018.1505657 · Cited by 37
“In the third section, Using Science in Society, we focus on interpreting scientific claims (Sutherland et al. 2013), communication of risk, communication with and by the media, applications of statistical insight in controversial topics such as climate change, and the ability (or lack of ability)…”
BackgroundJensen-Ryan, D., & German, L. (2018) · Science and Public Policy · doi:10.1093/scipol/scy032 · Cited by 30
Scientific rigor through videogames
Treuille, A., & Das, R. (2014) · Trends in Biochemical Sciences · doi:10.1016/j.tibs.2014.08.005 · Cited by 22
Towards linking environmental law and science
Moore, J. W., Nowlan, L., Olszynski, M. Z. P., Jacob, A. L., Favaro, B., Collins, L. M., Williams-Davidson, G. L. T.-L., & Weitz, J. (2018) · FACETS · doi:10.1139/facets-2017-0106 · Cited by 35
Ottwell, R., Rogers, T., Anderson, J. M., Johnson, A., & Vassar, M. B. (2020) · JMIR Dermatology · doi:10.2196/16978 · Cited by 27
“Guidelines have been developed and published, which will assist reviewers in the detection and interpretation of misleading claims [32,33].”
BackgroundJanzen, H. H. (2016) · Soil Science Society of America Journal · doi:10.2136/sssaj2016.05.0143 · Cited by 31
“Owing to inscrutable complexity, our ecosystems’ future vitalities can never be predicted precisely (Boyd, 2012; Weinberger, 2012; Sutherland et al., 2013; Villa et al., 2014)–only time, across a span exceeding our view, will reveal their evolving, interwoven trajectories.”
BackgroundEpistemic uncertainties and natural hazard risk assessment – Part 1: A review of the issuesPreprint
Beven, K. J., Aspinall, W. P., Bates, P., Borgomeo, E., Goda, K., Hall, J. W., Page, T., Phillips, J. C., Rougier, J. T., Simpson, M. H., et al. (2015) · doi:10.5194/nhessd-3-7333-2015 · Cited by 25
“Some of theses issues are15 discussed by Pappenberger and Beven (2006); Sutherland et al. (2013) and Juston et al., 2013).”
BackgroundFallon, A., Lankford, B. A., & Weston, D. (2021) · Ecology and Society · doi:10.5751/es-12504-260237 · Cited by 44
Integrating critical periods for bear cub survival into temporal regulations of human activities
Planella, A., Jímenez, J., Palomero, G., Ballesteros, F., Blanco, J. C., & López‐Bao, J. V. (2019) · Biological Conservation · doi:10.1016/j.biocon.2019.05.051 · Cited by 21
Policy and population behavior in the age of Big Data
Ruggeri, K., Yoon, H., Kácha, O., van der Linden, S., & Muennig, P. A. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.05.010 · Cited by 23
Consumer’s Guide to Regulatory Impact Analysis: Ten Tips for Being an Informed Policymaker
Dudley, S. E., Belzer, R. B., Blomquist, G. C., Brennan, T. J., Carrigan, C., Cordes, J. J., Cox, L. A., Fraas, A. G., Graham, J. D., Gray, G. M., et al. (2017) · Journal of Benefit-Cost Analysis · doi:10.1017/bca.2017.11 · Cited by 20
Evaluating naturalness and functioning of urban green infrastructure
Hanna, E., Bruno, D., & Comín, F. A. (2022) · Urban forestry & urban greening · doi:10.1016/j.ufug.2022.127825 · Cited by 30
Castle, G., Kennedy, M. S., & Allen, B. L. (2023) · Biological Conservation · doi:10.1016/j.biocon.2023.110234 · Cited by 18
Effect size reporting among prominent health journals: a case study of odds ratios
Chu, B. K., Liu, M., Leas, E. C., Althouse, B. M., & Ayers, J. W. (2020) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2020-111569 · Cited by 25
The Problem of Biased Data and Potential Solutions for Health and Environmental Assessments
Suter, G. W., & Cormier, S. M. (2014) · Human and Ecological Risk Assessment An International Journal · doi:10.1080/10807039.2014.974499 · Cited by 17
“• Educate decision makers about scientific knowledge and uncertainties so that they can independently judge bias (Sutherland et al. 2013).”
BackgroundFacilitating the transition to sustainable green chemistry
Burgman, M. A., Tennant, M., Voulvoulis, N., Makuch, Z., & Madani, K. M. (2018) · Current Opinion in Green and Sustainable Chemistry · doi:10.1016/j.cogsc.2018.04.006 · Cited by 16
Self-citationPage, T., Smith, P. J., Beven, K. J., Pianosi, F., Sarrazin, F., Almeida, S., Holcombe, E., Freer, J. E., Chappell, N. A., & Wagener, T. (2023) · Hydrology and earth system sciences · doi:10.5194/hess-27-2523-2023 · Cited by 16
Governance for Effective Policy‐Relevant Scientific Research: The Shared Governance Model
Burgman, M. A. (2015) · Asia & the Pacific Policy Studies · doi:10.1002/app5.104 · Cited by 14
“…literature provide advice on the things scientists and policy-makers can do to ensure that science contributes effectively to policy (for example, Cortner 2000; Pannell 2004; Briggs 2006; Roux et al. 2006; Gibbons et al. 2008; Rudd 2011, Sutherland et al. 2013, 2014; Spruijt et al. 2014).”
BackgroundSelf-citationRandomized Trials, Observational Registries, and the Foundations of Evidence-Based Medicine
Diamond, G. A. (2014) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2014.01.420 · Cited by 14
Thomson, M. C., Mason, S. J., Platzer, B. L., Mihretie, A., Omumbo, J., Mantilla, G., Ceccato, P., Jancloes, M., & Connor, S. J. (2014) · Earth Perspectives · doi:10.1186/2194-6434-1-17 · Cited by 18
The conservation research–practice gap: a case study of a threatened bird
Pérez‐Granados, C., & López-Iborra, G. M. (2021) · Oryx · doi:10.1017/s003060532000023x · Cited by 12
Pirrone, N., Mazzetti, P., Cinnirella, S., Athanasopoulou, E., Gerasopoulos, E., Klánová, J., Lehmann, A., Masó, J., Petäjä, T., Pokorný, L., et al. (2022) · Environmental Science & Policy · doi:10.1016/j.envsci.2022.09.006 · Cited by 12
Communicating Economic Concepts and Research in a Challenging Environment
Davis, J. (2018) · Journal of Agricultural Economics · doi:10.1111/1477-9552.12300 · Cited by 12
Demla, S., Shinn, E., Ottwell, R., Arthur, W., Khattab, M., Hartwell, M. L., Wright, D., & Vassar, M. B. (2021) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2021.03.032 · Cited by 13
How people decide who is correct when groups of scientists disagree
Johnson, B. B., Mayorga, M. W., & Dieckmann, N. F. (2023) · Risk Analysis · doi:10.1111/risa.14204 · Cited by 16
A simple informative intervention in primary care increases statin adherence
Casula, M., Tragni, E., Piccinelli, R., Zambon, A., Fendi, L. D., Scotti, L., Corrao, G., Gambera, M., Catapano, A. L., & Filippi, A. (2015) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-015-1975-z · Cited by 13
“Even if practitioners have access to journals through their organisation or from colleagues at research institutions, the time and skills required to search for, read, and synthesise, the primary literature can limit their ability to apply the useful scientific information to their management decisions [44].”
The provision and utility of earth science to decision-makers: synthesis and key findings
Quigley, M. C., Bennetts, L. G., Durance, P., Kuhnert, P., Lindsay, M., Pembleton, K. G., Roberts, M. E., & White, C. J. (2019) · Environment Systems & Decisions · doi:10.1007/s10669-019-09737-z · Cited by 13
Eroğlu, M., & Erbil, A. Ö. (2021) · Environmental Science & Policy · doi:10.1016/j.envsci.2021.09.022 · Cited by 11
Legal geography, geography, and the research‐policy nexus
Bartel, R. (2015) · Geographical Research · doi:10.1111/1745-5871.12159 · Cited by 12
GTest: a software tool for graphical assessment of empirical distributions’ Gaussianity
Barca, E., Bruno, E., Bruno, D. E., & Passarella, G. (2016) · Environmental Monitoring and Assessment · doi:10.1007/s10661-016-5138-1 · Cited by 12
“Unfortunately, as pointed out by Glantz (2005), practitioners often apply such procedures in a biased fashion, drawing from them sometimes incorrect conclusions (Sutherland et al. 2013).”
BackgroundMetcalfe, D. B., Anders, E. M., Axén, H., Axelsson, E. P., Bermudez, A., Bartholomew, D. C., Butt, N., Cadillo‐Quiroz, H., Chaudhary, N., Callebaut, T., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-67617-4 · Cited by 24
Rewilded horses in European nature conservation – a genetics, ethics, and welfare perspective
Lovász, L., Sommer‐Trembo, C., Barth, J. M. I., Scasta, J. D., Gancharova-Hill, R., Lemoine, R. T., Kerekes, V., Merckling, L., Bouskila, A., Svenning, J., et al. (2024) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.13146 · Cited by 14
Evidence into action: a policy brief exemplar supporting attainment of nursing now
Benton, D., Watkins, M., Beasley, C. J., Ferguson, S. L., & Holloway, A. S. (2020) · International Nursing Review · doi:10.1111/inr.12573 · Cited by 13
The Progress of Science—Past, Present and Future
Rörsch, A. (2014) · Humanities · doi:10.3390/h3040442 · Cited by 12
“(2013) [87].”
Association Claims in the Sequencing Era
Pulit, S. L., Leusink, M., Menelaou, A., & de Bakker, P. I. W. (2014) · Genes · doi:10.3390/genes5010196 · Cited by 11
“Nature also recently ran a column that discussed the role of bias, the inexact nature of measurements, and the important distinction between correlation and causation [77].”
BackgroundBayesian scrutiny of simple rainfall–runoff models used in forest water management
Greenwood, A. J. B., Schoups, G., Campbell, E. P., & Lane, P. N. J. (2014) · Journal of Hydrology · doi:10.1016/j.jhydrol.2014.01.074 · Cited by 8
Working at the science‐policy interface
Boden, L., Auty, H. K., Goddard, P., Stott, A. W., Ball, N., & Mellor, D. J. (2014) · Veterinary Record · doi:10.1136/vr.g1430 · Cited by 8
The Role of Evidence in Theories of the Policy Process
Cairney, P. (2016) · Palgrave Macmillan UK eBooks · doi:10.1057/978-1-137-51781-4_2 · Cited by 18
Squazzoni, F. (2017) · Understanding complex systems · doi:10.1007/978-3-319-42424-8_9 · Cited by 8
The decision maker’s lament: If I only had some science!
Bisbal, G. A. (2024) · AMBIO · doi:10.1007/s13280-024-01986-w · Cited by 7
“…presented with the notion of some scientific output that could improve or strengthen the decision-making process, it may be helpful for them to mentally look ahead and ask in advance what exactly will they receive when the anticipated products or findings become available (Sutherland et al. 2013).”
Background5. Improving the Reliability of Judgements
Wintle, B. C., Mukherjee, N., Hemming, V., Canessa, S., & McBride, M. F. (2022) · Open Book Publishers · doi:10.11647/obp.0321.05 · Cited by 6
Working with government – innovative approaches to evidence-based policy-making
Arndt, E., Burgman, M. A., Schneider, K. G., & Robinson, A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108638210.013 · Cited by 7
Self-citationVozzo, M. L., Christofidis, M., Griffiths, L. L., Kelly, R., Manion, M. L., Barmand, S., Bolin, J. A., Fuenzalida-Miralles, P. A., Harris, M. L., Issell, A., et al. (2025) · Frontiers in Ocean Sustainability · doi:10.3389/focsu.2024.1526776 · Cited by 5
1. Introduction: The Evidence Crisis and the Evidence Revolution
Sutherland, W. J. (2022) · Open Book Publishers · doi:10.11647/obp.0321.01 · Cited by 6
Self-citation7. Framing the Problem and Identifying Potential Solutions
Esmail, N., Green, R. E., Petrovan, S. O., Salafsky, N., Taylor, N. G., & Wilson, J. D. (2022) · Open Book Publishers · doi:10.11647/obp.0321.07 · Cited by 6
Goldson, S. L., Gluckman, P., & Allen, K. (2014) · Journal of Consumer Protection and Food Safety · doi:10.1007/s00003-014-0888-6 · Cited by 5
“In fact, scientists may tend to overestimate the utility of what they know while policy-makers may equally underestimate what they do not know (e.g., Sutherland et al. 2013; Tyler 2013).”
BackgroundEditorial: The Fall of Mechanogrowth Factor?
Rotwein, P. S. (2014) · Molecular Endocrinology · doi:10.1210/me.2013-1411 · Cited by 5
11. Creating a Culture of Evidence Use
Frick, W. F., Cooke, S. J., Dickson, I., Jackson, H. A., Keller, K. E., la Luz, A. D., Parks, D., McPherson, T., Simkins, A. T., Tanshi, I., et al. (2022) · Open Book Publishers · doi:10.11647/obp.0321.11 · Cited by 4
The Next Direction for Primatology? A Commentary on Setchell (2013)
Hopper, L. M., Morgan, D., & Ross, S. R. (2014) · International Journal of Primatology · doi:10.1007/s10764-014-9764-6 · Cited by 4
Kerley, G. I. H., Behrens, K. G., Carruthers, J., Diemont, M., du Plessis, J. J., Minnie, L., Somers, M. J., Tambling, C. J., Turpie, J. K., Wilson, S., et al. (2019) · South African Journal of Science · doi:10.17159/sajs.2019/5766 · Cited by 4
2. Gathering and Assessing Pieces of Evidence
White, T., Amano, T., Boersch‐Supan, P. H., Christie, A. P., Freckleton, R. P., Quinzin, M. C., Rezaie, A. M., Sutherland, W. J., & Yamashita, H. (2022) · Open Book Publishers · doi:10.11647/obp.0321.02 · Cited by 5
Self-citationResearchers and Practitioners: Building Collaboration for Evidence-Based Policy-Making
Bartel, R., & Bricknell, S. (2016) · Palgrave Macmillan UK eBooks · doi:10.1007/978-1-137-56257-9_12 · Cited by 4
Trends in anecdotal fox sightings in Tasmania accounted for by psychological factors
Marks, C., Clark, M., Obendorf, D., Hall, G., Soares, I., & Pereira, F. (2017) · Conservation Biology · doi:10.1111/cobi.12944 · Cited by 4
“Overall, there has been little critical assessment of anecdotal information as part of an evidence-based approach (Sutherland et al. 2013) for confirming invasive species incursions and directing eradication efforts.”
BackgroundJohnson, B. B. (2019) · Risk Analysis · doi:10.1111/risa.13298 · Cited by 4
Influence of Leadership Style on Information Systems Project Outcomes
Raghavan, V. V., & Chinta, R. C. (2022) · Journal of Computer Information Systems · doi:10.1080/08874417.2022.2121781 · Cited by 4
“But , as Sutherland et al. (2013) noted, we can draw much insight from an in-depth examination of the sign of the coefficients for directional effects and the ratios of standardized coefficients for relative direct effects for further empirical affirmation in future research studies.”
BackgroundInfluential10. How Conservation Practice Can Generate Evidence
Ockendon, N., Cadotte, M. W., Eklund, J., Ferraro, P. J., Fisher, M., Hancock, M. H., & Worthington, T. A. (2022) · Open Book Publishers · doi:10.11647/obp.0321.10 · Cited by 4
Science and decision making from both sides of the fence
Ritman, K. (2014) · Journal of Consumer Protection and Food Safety · doi:10.1007/s00003-014-0894-8 · Cited by 3
“This highlights the need to have translators of science into policy (Sutherland et al. 2013), who are able to help refine the questions being asked by policy makers and match the appropriate scientific research findings to answer the question, as well as sorting through contestable results and…”
12. Transforming Practice: Checklists for Delivering Change
Amano, T., Bako, L. A., Best, M., Boenisch, N., Boersch‐Supan, P. H., Browne, D., Buckley, Y. M., Burgman, M. A., Cadotte, M. W., Canessa, S., et al. (2022) · Open Book Publishers · doi:10.11647/obp.0321.12 · Cited by 2
Self-citation8 Making Decisions for Policy and Practice
Cook, C. N., Burgman, M. A., Rumpff, L., & Thornton, A. (2022) · Open Book Publishers · doi:10.11647/obp.0321.08 · Cited by 3
Self-citation4. Presenting Conclusions from Assessed Evidence
Sutherland, W. J., Amano, T., Boenisch, N., Cheng, S. H., Christie, A. P., Godfray, H. C. J., Grainger, M., McLean, A. R., Morgan, W. H., Ockendon, N., et al. (2022) · Open Book Publishers · doi:10.11647/obp.0321.04 · Cited by 2
Self-citationE-Learning Material of Evidence-Based Medicine for Laypersons
Okabayashi, S., Kitazawa, K., Kawamura, T., & Nakayama, T. (2022) · HLRP Health Literacy Research and Practice · doi:10.3928/24748307-20221113-01 · Cited by 3
“…12 existing materials (four Japanese books, six websites [four Japanese and two English], and two journal articles in English [Berger et al., 2010; Sutherland et al., 2013]) that included contents regarding essential components of EBM, epidemiology, and critical appraisal of literature for…”
BackgroundOrtega‐Calvo, M., Santos‐Lozano, J. M., Lapetra, J., Salas‐Salvadó, J., Martínez‐González, M. Á., Lamuela-Raventós, R. M., & Estruch, R. (2014) · Open Journal of Philosophy · doi:10.4236/ojpp.2014.44064 · Cited by 4
“If a reader is aware of the existence of scientific patina (Sutherland et al., 2013), that reader will know how to look through it and see the masterpiece hidden underneath.”
BackgroundPost-truth era and impact on the science associated with sport and exercise medicine
Lambert, M. (2016) · South African Journal of Sports Medicine · doi:10.17159/2078-516x/2016/v28i3a1838 · Cited by 2
“This has been attempted by the authors of a paper which lists 20 points which non-scientists should understand.[5] Examples of these points in the paper include: Differences and chance cause variation, Bias is rife, Controls are important, Correlation does not imply causation, Extrapolating beyond the data is risky an…”
BackgroundPark, H.-S., Chung, S., & Kim, S. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.145940 · Cited by 4
O’Connor, Z. (2016) · Springer eBooks · doi:10.1007/978-1-4419-8071-7_228 · Cited by 2
Risk Assessment and Regulatory Impact Analysis
Dudley, S. E., & Gray, G. M. (2024) · doi:10.1002/9781119742975.ch33 · Cited by 2
9. Creating Evidence-Based Policy and Practice
Downey, H., Boenisch, N., Browne, D., Buckley, Y. M., Cranston, G. R., Dicks, L. V., Hughes, J., Latrémouille, C., Morgan, W. H., Muir, M. J., et al. (2022) · Open Book Publishers · doi:10.11647/obp.0321.09 · Cited by 1
Research excellence and scientific advisory boards
Göser, M., Wimmer, S., & Sauer, J. (2023) · Science and Public Policy · doi:10.1093/scipol/scad041 · Cited by 1
Metadata
- Authors
- Sutherland, W. J., Spiegelhalter, D., & Burgman, M.
- Affiliations
- University of Cambridge (GB)
- The University of Melbourne (AU)
- Corresponding author
- Sutherland, William J.
- Venue
- Nature
- Published
- 2013-11-20
- Volume
- 503
- Issue
- 7476
- Pages
- 335-337
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1983347685
- Cited by
- 129
- References
- 9
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 5 · 2023: 8 · 2022: 20 · 2021: 9 · 2020: 9 · 2019: 12 · 2018: 10 · 2017: 8 · 2016: 10 · 2015: 8 · 2014: 23 · 2013: 2
- FWCI
- 31.40
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Physical Sciences › Environmental Science › Management, Monitoring, Policy and Law › Conservation, Ecology, Wildlife Education
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- evidence evaluation, scientific literacy, non-scientists, advisors, limitations of evidence, public understanding of science, science communication
- MeSH terms
- Administrative Personnel, Animals, Humans, Policy Making, Public Policy, Research Design, Science, Bias, Sample Size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.