The Variability of Outcomes Used in Efficacy and Effectiveness Trials of Alcohol Brief Interventions: A Systematic Review
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: The purpose of this study was to characterize recent alcohol brief intervention (ABI) efficacy and effectiveness trials, summarize outcomes, and show how variability in outcomes and reporting compromises the evidence base. METHOD: A systematic review and narrative synthesis of articles from 10 databases were undertaken (January 2000-November 2017); study selection represented recent, readily available publications. The National Institute of Care Excellence (NICE) Public Health Guideline 24 (Alcohol use disorders: prevention) informed ABI definitions. The review was conducted using Centre for Reviews and Dissemination (CRD) guidance and pre-registered on PROSPERO (CRD42016047185). Seven a priori specified domains were used to classify outcomes: biomarkers, alcohol-related outcomes, economic factors/resource use, health measures, life impact, intervention factors, and psychological/behavioral factors. RESULTS: The search identified 405 trials from 401 eligible papers. In 405 trials, 2,641 separate outcomes were measured in approximately 1,560 different ways. The most common outcomes used were the number of drinks consumed in a week and frequency of heavy episodic drinking. Biomarkers were least frequently used. The most common primary outcome was weekly drinks. By trial type, the most frequent outcome in efficacy and effectiveness trials was frequency of heavy drinking. CONCLUSIONS: Consumption outcomes predominated; however, no single outcome was found in all trials. This comprehensive outcome map and methodological detail on ABI effectiveness and efficacy trials can aid decision making in future trials. There was a diversity of instruments, time points, and outcome descriptions in methods and results sections. Compliance with reporting guidance would support data synthesis and improve trial quality. This review establishes the need for a core outcome set (COS)/minimum data standard and supports the Outcome Reporting in Brief Interventions: Alcohol initiative (ORBITAL) to improve standards in the ABI field through a COS for effectiveness and efficacy randomized trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rehm, J., Mathers, C., Popova, S., Thavorncharoensap, M., Teerawattananon, Y., & Patra, J. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60746-7 · Cited by 3,870 · cited 2×
“This may reflect the predominance of publishing or funding opportunities available to those researchers, the high levels of hazardous and harmful use of alcohol in these countries (Rehm et al., 2009), or be a consequence of the pre-specified”
BackgroundCONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., Ader, D., Fries, J. F., Bruce, B., & Rose, M. (2007) · Medical Care · doi:10.1097/01.mlr.0000258615.42478.55 · Cited by 3,118
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
The COMET Handbook: version 1.0
Williamson, P. R., Altman, D. G., Bagley, H., Barnes, K. L., Blazeby, J. M., Brookes, S. T., Clarke, M., Gargon, E., Gorst, S., Harman, N., et al. (2017) · Trials · doi:10.1186/s13063-017-1978-4 · Cited by 2,011 · cited 4×
“This was registered at the start of the project at the Linking powered by eXtyles COMET Initiative (Shorter et al., 2016b) and the protocol has been published (Shorter et al., 2017).”
MethodInfluentialSelf-citationEffectiveness of brief alcohol interventions in primary care populations
Kaner, E. F., Beyer, F. R., Muirhead, C., Campbell, F., Pienaar, E. D., Bertholet, N., Daeppen, J. B., Saunders, J. B., & Burnand, B. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004148.pub4 · Cited by 1,665
Developing core outcome sets for clinical trials: issues to consider
Williamson, P. R., Altman, D. G., Blazeby, J. M., Clarke, M., Devane, D., Gargon, E., & Tugwell, P. (2012) · Trials · doi:10.1186/1745-6215-13-132 · Cited by 1,661
Self-citationReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319
Self-citationBabor, T. F., McRee, B. G., Kassebaum, P. A., Grimaldi, P. L., Ahmed, K., & Bray, J. (2007) · Substance Abuse · doi:10.1300/j465v28n03_03 · Cited by 1,100
Self-citation
Cited by
Bendtsen, M., McCambridge, J., Åsberg, K., & Bendtsen, P. (2021) · Addiction · doi:10.1111/add.15294 · Cited by 71
“As an indication of the magnitude of the problem, the Outcome Reporting in Brief Intervention Trials: Alcohol (ORBITAL) project [33], which aims to produce a core outcome set for brief alcohol interventions, identified 2641 different outcomes used, measured in approximately 1560 different ways, in 405 trials of brief…”
BackgroundBeyer, F., Lynch, E., & Kaner, E. (2018) · Current Addiction Reports · doi:10.1007/s40429-018-0198-7 · Cited by 66
Sileo, K. M., Miller, A. P., Wagman, J. A., & Kiene, S. M. (2021) · Addiction · doi:10.1111/add.15227 · Cited by 47
Metadata
- Authors
- Shorter, G. W., Bray, J. W., Giles, E. L., O’Donnell, A. J., Berman, A. H., Holloway, A., Heather, N., Barbosa, C., Stockdale, K. J., Scott, S. J., Clarke, M., & Newbury-Birch, D.
- Venue
- Journal of Studies on Alcohol and Drugs
- Publisher
- Alcohol Research Documentation, Inc.
- Published
- 2019-05
- Volume
- 80
- Issue
- 3
- Pages
- 286-298
- ISSN
- 1937-1888 (ISSN-L)
- 1938-4114
- OpenAlex
- W2949986287
- Cited by
- 39
- References
- 22
- FWCI
- 1.29
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.