CoChat

Promoting Learning from Null or Negative Results in Prevention Science Trials

Open access

The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.

Abstract

There can be a tendency for investigators to disregard or explain away null or negative results in prevention science trials. Examples include not publicizing findings, conducting spurious subgroup analyses, or attributing the outcome post hoc to real or perceived weaknesses in trial design or intervention implementation. This is unhelpful for several reasons, not least that it skews the evidence base, contributes to research "waste", undermines respect for science, and stifles creativity in intervention development. In this paper, we identify possible policy and practice responses when interventions have null (ineffective) or negative (harmful) results, and argue that these are influenced by: the intervention itself (e.g., stage of gestation, perceived importance); trial design, conduct, and results (e.g., pattern of null/negative effects, internal and external validity); context (e.g., wider evidence base, state of policy); and individual perspectives and interests (e.g., stake in the intervention). We advance several strategies to promote more informative null or negative effect trials and enable learning from such results, focusing on changes to culture, process, intervention design, trial design, and environment.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s11121-020-01140-4

Cites

64 of 64 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 64 references

Research works printed but not linked: 4

  1. Davies R Planning evaluability assessments: A synthesis of the literature with recommendations 2013 London Department for International Development
  2. FNP National Unit, & Dartington Service Design Lab FNP ADAPT: Using evidence, pragmatism and collaboration to change the Family Nurse Partnership programme in England 2020 London FNP National Unit
  3. Lipsey MW Howell JC Kelly MR Chapman G Carver D Improving the effectiveness of juvenile programs: A new perspective on evidence-based practice 2010 Washington, DC Georgetown University, Center for Juvenile Justice Reform
  4. Syed M Black box thinking: The surprising truth about success (and why some people never learn from their mistakes) 2015 London John Murray

Cited by

See all 42

Metadata

Authors
Axford, N., Berry, V., Lloyd, J., Hobbs, T., & Wyatt, K.
Affiliations
  • University of Plymouth (GB)
  • University of Exeter (GB)
  • Dartington Service Design Lab (GB)
Corresponding author
Berry, Vashti
Venue
Prevention Science
Published
2020-08-04
Volume
23
Issue
5
Pages
751-763
ISSN
  • 1389-4986 (ISSN-L)
  • 1573-6695
OpenAlex
W3041367671
Cited by
34
References
64
Citations by year
2026: 10 · 2025: 6 · 2024: 1 · 2023: 6 · 2022: 7 · 2021: 4
FWCI
4.44
Type
journal article
Language
en
Open access
Licence
Locations
  • Prevention Science (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Open Research Exeter (University of Exeter) (publishedVersion, cc-by)
  • PEARL (University of Plymouth) (submittedVersion, public-domain)
  • Figshare (submittedVersion, cc-by)
Funders
University of Exeter
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Keywords
negative results, research waste, subgroup analysis, trial design, intervention effectiveness, evidence base, research culture
MeSH terms
Negative Results, Humans, Research Design

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Promoting Learning from Null or Negative Results in Prevention Science Trials. https://app.cochat.ai/papers/10.1007/s11121-020-01140-4
The paper
Axford, N., Berry, V., Lloyd, J., Hobbs, T., & Wyatt, K. (2022). Promoting Learning from Null or Negative Results in Prevention Science Trials. Prevention Science. https://doi.org/10.1007/s11121-020-01140-4

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.