Policy: Twenty tips for interpreting scientific claims
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There are several ways to spin a report (4, 6, 8–10).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [6]
In the citing paper
“A user’s guide to detect misleading claims in clinical research reports (79) and tips for interpreting claims (6) are available, but should be more widely used.”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [6]
Citations
Cites
Reliability Evaluation of Power Systems
Billinton, R., & Allan, R. N. (1984) · Springer eBooks · doi:10.1007/978-1-4615-7731-7 · Cited by 3,350
Remedies for pseudoreplication
Millar, R. B., & Anderson, M. J. (2004) · Fisheries Research · doi:10.1016/j.fishres.2004.08.016 · Cited by 292
Lay Foibles and Expert Fables in Judgments about Risk
Fischhoff, B., Slovic, P., & Lichtenstein, S. (1982) · The American Statistician · doi:10.1080/00031305.1982.10482845 · Cited by 266
Borsuk, M. E., Stow, C. A., & Reckhow, K. H. (2003) · Journal of Water Resources Planning and Management · doi:10.1061/(asce)0733-9496(2003)129:4(271 · Cited by 105
Statistical reform in medicine, psychology and ecology
Fidler, F. M., Cumming, G., Burgman, M. A., & Thomason, N. R. (2004) · The Journal of Socio-Economics · doi:10.1016/j.socec.2004.09.035 · Cited by 102
Self-citationIMPROVING RISK ASSESSMENT FOR NONTARGET SAFETY OF TRANSGENIC CROPS
Marvier, M. (2002) · Ecological Applications · doi:10.1890/1051-0761(2002)012[1119:irafns]2.0.co;2 · Cited by 90
Simple Analgesics for Arthritis
Huskisson, E. C. (1974) · BMJ · doi:10.1136/bmj.4.5938.196 · Cited by 86
Doubleday, R., & Wilsdon, J. (2012) · Nature · doi:10.1038/485301a · Cited by 29
Maslova, E., Halldorsson, T. I., Strøm, M., & Olsen, S. F. (2011) · Journal of Nutritional Science · doi:10.1017/jns.2012.5 · Cited by 1
Research works printed but not linked: 1
- Fischhoff, B., Slovic, P. & Lichtenstein, S. Am. Stat. 36, 240–255 (1982).
Cited by
Items 101–129 of 129
6. Identifying Stakeholders and Collaborating with Communities
Best, M., Irvine, R. L., Bako, L. A., Citegetse, G., Field, A., Roe, D., Rose, D. C., & Spencer, J. (2022) · Open Book Publishers · doi:10.11647/obp.0321.06 · Cited by 1
Role of Long-Term Experiments in Understanding Ecosystem Response to Global Change
Janzen, H. H., & Ellert, B. H. (2017) · CRC Press eBooks · doi:10.1201/9781315368252-20 · Cited by 1
How the Scientific Method Invalidates “Fake News”
Carlton, M., & Leininger, L. (2021) · NC Digital Online Collection of Knowledge and Scholarship (The University of North Carolina at Greensboro) · Cited by 1
3. Assessing Collated and Synthesised Evidence
Sutherland, W. J., Cheng, S. H., Christie, A. P., Cooke, S. J., Koricheva, J., Randall, N., Smith, R. K., & Stewart, R. J. (2022) · Open Book Publishers · doi:10.11647/obp.0321.03 · Cited by 1
Self-citationPolicy tips: heed risks of uncertainty
Rosenberg, A. A. (2013) · Nature · doi:10.1038/504376b · Cited by 1
O’Connor, Z. (2020) · Springer eBooks · doi:10.1007/978-3-642-27851-8_228-2 · Cited by 1
O’Connor, Z. (2015) · Springer eBooks · doi:10.1007/978-3-642-27851-8_228-1 · Cited by 1
Rewilded horses in European nature conservation – a genetics, ethics and welfare perspectivePreprint
Lovász, L., Sommer‐Trembo, C., Barth, J. M. I., Scasta, J. D., Gancharova-Hill, R., Lemoine, R. T., Kerekes, V., Merckling, L., Svenning, J., & Fages, A. (2024) · doi:10.31219/osf.io/t84jn · Cited by 1
Pawsey, R. J. (2014) · ePrints Soton (University of Southampton)
Tips for understanding the medical literature
Greener, M. (2014) · Independent Nurse · doi:10.12968/indn.2014.3.30
Policy tips: six more practical pointers
Padian, K. (2013) · Nature · doi:10.1038/504376a
Interpreting clinical studies: The devil is in the detail
Greener, M. (2014) · Nurse Prescribing · doi:10.12968/npre.2014.12.8.406
Bridges, D. (2018) · Springer eBooks · doi:10.1007/978-3-319-94253-7_6
Scientific Policy Advising: Exploring the Science-Policy Ecosystem
Woensel, L. V. (2019) · St Antony's series · doi:10.1007/978-3-030-32126-0_1
Kano, M. R. (2020) · TRENDS IN THE SCIENCES · doi:10.5363/tits.25.4_76
Grand Celebration: 10th Anniversary of the Human Genome Project
Rampelotto, P. H., Burn, J., Lupski, J., & Nelson, K. (2016) · MDPI eBooks · doi:10.3390/books978-3-03842-170-2
Post-truth era and impact on the science associated with sport and exercise medicine
Lambert, M. (2017) · South African Journal of Sports Medicine · doi:10.17159/2078-516x/2016/v28i3a1868
From Fish Movement to Knowledge Movement: Understanding and Improving Science
Palme, C. D. (2019) · doi:10.22215/etd/2019-13433
“Others have criticized peerreviewed scientific papers with them being too formal in style, difficult to access, and hardly ever read by policy-makers, therefore, rarely reaches its intended user group (Sutherland et al. 2013; Young et al. 2016).”
Background13. Supplementary Material from Online Resources
Sutherland, W. J. (2022) · Open Book Publishers · doi:10.11647/obp.0321.13
Self-citationPreface: A Vision of Transformed Conservation Practice
Sutherland, W. J. (2022) · Open Book Publishers · doi:10.11647/obp.0321.14
Self-citationHooft, R. W. W., Harrison, E., & Martin, C. S. (2023) · F1000Research · doi:10.12688/f1000research.128167.1
Disease outbreak response: why epidemiology plays a central role
Ellis‐Iversen, J., Avigad, R., Gibbens, J. C., Hepple, R., & PATERSON, A. (2023) · Scientific and Technical Review (World Organisation for Animal Health) · doi:10.20506/rst.42.3361
O’Connor, Z. (2023) · Springer eBooks · doi:10.1007/978-3-030-89862-5_228
Mertz, A. F., & Mishra, A. (2024) · Routledge eBooks · doi:10.4324/9781003280316-30
Chmiel, M. (2025) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83608-940-720251017
Chapter 13: Science and Sustainable Development
Lawson, I. T., Roucoux, K. H., Coronado, E. N. H., & Bartels, M. P. (2026) · Springer eBooks · doi:10.1007/978-3-032-13886-6_13
Translating biodiversity science into policy
Gaston, K. J. (2026) · doi:10.1093/9780198972877.003.0112
Metadata
- Authors
- Sutherland, W. J., Spiegelhalter, D., & Burgman, M.
- Affiliations
- University of Cambridge (GB)
- The University of Melbourne (AU)
- Corresponding author
- Sutherland, William J.
- Venue
- Nature
- Published
- 2013-11-20
- Volume
- 503
- Issue
- 7476
- Pages
- 335-337
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1983347685
- Cited by
- 129
- References
- 9
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 5 · 2023: 8 · 2022: 20 · 2021: 9 · 2020: 9 · 2019: 12 · 2018: 10 · 2017: 8 · 2016: 10 · 2015: 8 · 2014: 23 · 2013: 2
- FWCI
- 31.40
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Physical Sciences › Environmental Science › Management, Monitoring, Policy and Law › Conservation, Ecology, Wildlife Education
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- evidence evaluation, scientific literacy, non-scientists, advisors, limitations of evidence, public understanding of science, science communication
- MeSH terms
- Administrative Personnel, Animals, Humans, Policy Making, Public Policy, Research Design, Science, Bias, Sample Size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.