The Variability of Outcomes Used in Efficacy and Effectiveness Trials of Alcohol Brief Interventions: A Systematic Review
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: The purpose of this study was to characterize recent alcohol brief intervention (ABI) efficacy and effectiveness trials, summarize outcomes, and show how variability in outcomes and reporting compromises the evidence base. METHOD: A systematic review and narrative synthesis of articles from 10 databases were undertaken (January 2000-November 2017); study selection represented recent, readily available publications. The National Institute of Care Excellence (NICE) Public Health Guideline 24 (Alcohol use disorders: prevention) informed ABI definitions. The review was conducted using Centre for Reviews and Dissemination (CRD) guidance and pre-registered on PROSPERO (CRD42016047185). Seven a priori specified domains were used to classify outcomes: biomarkers, alcohol-related outcomes, economic factors/resource use, health measures, life impact, intervention factors, and psychological/behavioral factors. RESULTS: The search identified 405 trials from 401 eligible papers. In 405 trials, 2,641 separate outcomes were measured in approximately 1,560 different ways. The most common outcomes used were the number of drinks consumed in a week and frequency of heavy episodic drinking. Biomarkers were least frequently used. The most common primary outcome was weekly drinks. By trial type, the most frequent outcome in efficacy and effectiveness trials was frequency of heavy drinking. CONCLUSIONS: Consumption outcomes predominated; however, no single outcome was found in all trials. This comprehensive outcome map and methodological detail on ABI effectiveness and efficacy trials can aid decision making in future trials. There was a diversity of instruments, time points, and outcome descriptions in methods and results sections. Compliance with reporting guidance would support data synthesis and improve trial quality. This review establishes the need for a core outcome set (COS)/minimum data standard and supports the Outcome Reporting in Brief Interventions: Alcohol initiative (ORBITAL) to improve standards in the ABI field through a COS for effectiveness and efficacy randomized trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rehm, J., Mathers, C., Popova, S., Thavorncharoensap, M., Teerawattananon, Y., & Patra, J. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60746-7 · Cited by 3,870
CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · BMJ · doi:10.1136/bmj.i5239 · Cited by 3,404
Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., Ader, D., Fries, J. F., Bruce, B., & Rose, M. (2007) · Medical Care · doi:10.1097/01.mlr.0000258615.42478.55 · Cited by 3,118
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
The COMET Handbook: version 1.0
Williamson, P. R., Altman, D. G., Bagley, H., Barnes, K. L., Blazeby, J. M., Brookes, S. T., Clarke, M., Gargon, E., Gorst, S., Harman, N., et al. (2017) · Trials · doi:10.1186/s13063-017-1978-4 · Cited by 2,011 · cited 4×
“This was registered at the start of the project at the Linking powered by eXtyles COMET Initiative (Shorter et al., 2016b) and the protocol has been published (Shorter et al., 2017).”
MethodInfluentialSelf-citationEffectiveness of brief alcohol interventions in primary care populations
Kaner, E. F., Beyer, F. R., Muirhead, C., Campbell, F., Pienaar, E. D., Bertholet, N., Daeppen, J. B., Saunders, J. B., & Burnand, B. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004148.pub4 · Cited by 1,665
Developing core outcome sets for clinical trials: issues to consider
Williamson, P. R., Altman, D. G., Blazeby, J. M., Clarke, M., Devane, D., Gargon, E., & Tugwell, P. (2012) · Trials · doi:10.1186/1745-6215-13-132 · Cited by 1,661
Self-citationReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319
Self-citationBabor, T. F., McRee, B. G., Kassebaum, P. A., Grimaldi, P. L., Ahmed, K., & Bray, J. (2007) · Substance Abuse · doi:10.1300/j465v28n03_03 · Cited by 1,100
Self-citationMoyer, A., Finney, J. W., Swearingen, C. E., & Vergun, P. (2002) · Addiction · doi:10.1046/j.1360-0443.2002.00018.x · Cited by 1,092
Developing core outcome measurement sets for clinical trials: OMERACT filter 2.0
Boers, M., Kirwan, J. R., Wells, G., Beaton, D., Gossec, L., d'Agostino, M.-A., Conaghan, P. G., Bingham, C. O., Brooks, P., Landewé, R., et al. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.11.013 · Cited by 781
Bertholet, N. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.9.986 · Cited by 710 · cited 2×
“Numerous systematic reviews (Ballesteros et al., 2003; Ballesteros et al., 2004a; Ballesteros et al., 2004b; Beich et al., 2003; Bertholet et al., 2005; Kaner et al., 2018; O'Donnell et al., 2014) suggest ABIs in primary health care are effective, but these reviews report substantial”
BackgroundA taxonomy has been developed for outcomes in medical research to help improve knowledge discovery
Dodd, S., Clarke, M., Becker, L., Mavergames, C., Fish, R., & Williamson, P. R. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.12.020 · Cited by 625 · cited 1×
“The first draft was informed by a presentation at the COMET V meeting in Amsterdam (attended by GWS in September 2016), since published in Dodd et al. (2018).”
Self-citationThe impact of brief alcohol interventions in primary healthcare: a systematic review of reviews
O'Donnell, A., Anderson, P., Newbury-Birch, D., Schulte, B., Schmidt, C., Reimer, J., & Kaner, E. (2014) · Alcohol and Alcoholism · doi:10.1093/alcalc/agt170 · Cited by 613 · cited 1×
“Numerous systematic reviews (Ballesteros et al., 2003; Ballesteros et al., 2004a; Ballesteros et al., 2004b; Beich et al., 2003; Bertholet et al., 2005; Kaner et al., 2018; O'Donnell et al., 2014) suggest ABIs in primary health care are effective, but these reviews report substantial”
BackgroundSelf-citationMoher, D., Pham, B., Lawson, M., & Klassen, T. (2003) · Health Technology Assessment · doi:10.3310/hta7410 · Cited by 500 · cited 4×
“Although focusing on peer-reviewed literature may have also limited the number of non-English articles included, it is in keeping with our intention to focus on those articles that are likely to be most accessible and influential for many decision makers.”
BackgroundInfluentialU.S. Preventive Services Task Force* (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-140-7-200404060-00016 · Cited by 387
Ballesteros, J., Duffy, J. C., Querejeta, I., Ariño, J., & González‐Pinto, A. (2004) · Alcoholism: Clinical and Experimental Research · doi:10.1097/01.alc.0000122106.84718.67 · Cited by 251
Field, C. A., Baird, J., Saitz, R., Caetano, R., & Monti, P. M. (2010) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2010.01297.x · Cited by 80 · cited 1×
“Commentators have urged caution in making broad clinical practice recommendations as a result (Bernstein et al., 2009; Bernstein et al., 2010; Field et al., 2010; Heather, 2016; McCambridge & Saitz, 2017; Saitz et al., 2006; Saitz, 2010).”
BackgroundBERNSTEIN, J. A., BERNSTEIN, E., & HEEREN, T. C. (2010) · Drug and Alcohol Review · doi:10.1111/j.1465-3362.2010.00174.x · Cited by 68 · cited 2×
“Our review provides the first systematic and quantifiable evidence to support previous calls for standard definitions of ABI outcomes to compare across studies (Bernstein et al., 2010).”
BackgroundBray, J. W., Cowell, A. J., & Hinde, J. M. (2011) · Medical Care · doi:10.1097/mlr.0b013e318203624f · Cited by 65
Self-citationThe efficacy-effectiveness distinction in trials of alcohol brief intervention
Heather, N. (2014) · Addiction Science & Clinical Practice · doi:10.1186/1940-0640-9-13 · Cited by 48
Self-citation
Cited by
Bendtsen, M., McCambridge, J., Åsberg, K., & Bendtsen, P. (2021) · Addiction · doi:10.1111/add.15294 · Cited by 71
“As an indication of the magnitude of the problem, the Outcome Reporting in Brief Intervention Trials: Alcohol (ORBITAL) project [33], which aims to produce a core outcome set for brief alcohol interventions, identified 2641 different outcomes used, measured in approximately 1560 different ways, in 405 trials of brief…”
BackgroundBeyer, F., Lynch, E., & Kaner, E. (2018) · Current Addiction Reports · doi:10.1007/s40429-018-0198-7 · Cited by 66
Sileo, K. M., Miller, A. P., Wagman, J. A., & Kiene, S. M. (2021) · Addiction · doi:10.1111/add.15227 · Cited by 47
Metadata
- Authors
- Shorter, G. W., Bray, J. W., Giles, E. L., O’Donnell, A. J., Berman, A. H., Holloway, A., Heather, N., Barbosa, C., Stockdale, K. J., Scott, S. J., Clarke, M., & Newbury-Birch, D.
- Venue
- Journal of Studies on Alcohol and Drugs
- Publisher
- Alcohol Research Documentation, Inc.
- Published
- 2019-05
- Volume
- 80
- Issue
- 3
- Pages
- 286-298
- ISSN
- 1937-1888 (ISSN-L)
- 1938-4114
- OpenAlex
- W2949986287
- Cited by
- 39
- References
- 22
- FWCI
- 1.29
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.