CoChat

Interpreting Null Findings from Trials of Alcohol Brief Interventions

Open access
Heather, Nick · 2014 · Frontiers in Psychiatry
Cited by 32

The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.

Abstract

The effectiveness of alcohol brief intervention (ABI) has been established by a succession of meta-analyses but, because the effects of ABI are small, null findings from randomized controlled trials are often reported and can sometimes lead to skepticism regarding the benefits of ABI in routine practice. This article first explains why null findings are likely to occur under null hypothesis significance testing (NHST) due to the phenomenon known as "the dance of the p-values." A number of misconceptions about null findings are then described, using as an example the way in which the results of the primary care arm of a recent cluster-randomized trial of ABI in England (the SIPS project) have been misunderstood. These misinterpretations include the fallacy of "proving the null hypothesis" that lack of a significant difference between the means of sample groups can be taken as evidence of no difference between their population means, and the possible effects of this and related misunderstandings of the SIPS findings are examined. The mistaken inference that reductions in alcohol consumption seen in control groups from baseline to follow-up are evidence of real effects of control group procedures is then discussed and other possible reasons for such reductions, including regression to the mean, research participation effects, historical trends, and assessment reactivity, are described. From the standpoint of scientific progress, the chief problem about null findings under the conventional NHST approach is that it is not possible to distinguish "evidence of absence" from "absence of evidence." By contrast, under a Bayesian approach, such a distinction is possible and it is explained how this approach could classify ABIs in particular settings or among particular populations as either truly ineffective or as of unknown effectiveness, thus accelerating progress in the field of ABI research.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fpsyt.2014.00085

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 30 references

Research works printed but not linked: 15

  1. Jonas, 2012, Screening, Behavioral Counseling, and Referral in Primary Care to Reduce Alcohol Misuse
  2. Ballesteros, 2004, Brief interventions for hazardous drinkers delivered in primary care are equally effective in men and women, Addiction, 99, 103, 10.1111/j.1360-0443.2004.00499.x · DOI
  3. 2011, Appraisal for Screening for Alcohol Misuse
  4. Rosenthal, 1979, The ‘file drawer problem’ and tolerance for null results, Psychol Bull, 86, 638, 10.1037/0033-2909.86.3.638 · DOI · Paper page
  5. Heather, 2012, Can screening and brief intervention lead to population-level reductions in alcohol-related harm?, Addict Sci Clin Pract, 7, 15, 10.1186/1940-0640-7-15 · DOI · Paper page
  6. Cumming, 2012, Understanding the New Statistics: Effect Sizes, Confidence Intervals, and Meta-analysis
  7. Cohen, 1988, Statistical Power Analysis for the Behavioural Sciences
  8. 2010, Publication Manual of the American Psychological Association
  9. Schmidt, 1997, Eight common but false objections to the discontinuation of significance testing in the analysis of research data, 37
  10. 2004, Alcohol Harm Reduction Strategy for England
  11. Kaner, 2009, Screening and brief interventions for hazardous and harmful alcohol use in primary care: a randomised controlled trial protocol, BMC Public Health, 9, 287, 10.1186/1471-2458-9-287 · DOI · Paper page
  12. Drummond, 1990, The relationship between alcohol dependence and alcohol-related problems in a clinical population, Br J Addict, 85, 357, 10.1111/j.1360-0443.1990.tb00652.x · DOI · Paper page
  13. Fisher, 1971, The Design of Experiments
  14. Saitz, 2013, SIPS trial findings most consistent with a lack of effectiveness of brief intervention in real clinical practice (letter), Br Med J, 346, e8501, 10.1136/bmj.e8501 · DOI · Paper page
  15. 2013, Clarifying Alcohol Brief Interventions: 2013 Update

Cited by

See all 32

Metadata

Authors
Heather, N.
Venue
Frontiers in Psychiatry
Published
2014-07-16
Volume
5
Pages
85-85
ISSN
1664-0640 (ISSN-L)
OpenAlex
W2112943852
Cited by
32
References
30
FWCI
3.60
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Interpreting Null Findings from Trials of Alcohol Brief Interventions. https://app.cochat.ai/papers/10.3389/fpsyt.2014.00085
The paper
Heather, N. (2014). Interpreting Null Findings from Trials of Alcohol Brief Interventions. Frontiers in Psychiatry. https://doi.org/10.3389/fpsyt.2014.00085

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.