Using Bayes factors for testing hypotheses about intervention effectiveness in addictions research
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Background and Aims: It has been proposed that more use should be made of Bayes factors in hypothesis testing in addiction research. Bayes factors are the ratios of the likelihood of a specified hypothesis (e.g. an intervention effect within a given range) to another hypothesis (e.g. no effect). They are particularly important for differentiating lack of strong evidence for an effect and evidence for lack of an effect. This paper reviewed randomized trials reported in Addiction between January and June 2013 to assess how far Bayes factors might improve the interpretation of the data. Methods: Seventy‐five effect sizes and their standard errors were extracted from 12 trials. Seventy‐three per cent (n = 55) of these were non‐significant (i.e. P > 0.05). For each non‐significant finding a Bayes factor was calculated using a population effect derived from previous research. In sensitivity analyses, a further two Bayes factors were calculated assuming clinically meaningful and plausible ranges around this population effect. Results: Twenty per cent (n = 11) of the non‐significant Bayes factors were < ⅓ and 3.6% (n = 2) were > 3. The other 76.4% (n = 42) of Bayes factors were between ⅓ and 3. Of these, 26 were in the direction of there being an effect (Bayes factor > 1 and < 3); 12 tended to favour the hypothesis of no effect (Bayes factor < 1 and > ⅓); and for four there was no evidence either way (Bayes factor = 1). In sensitivity analyses, 13.3% of Bayes Factors were < ⅓ (n = 20), 62.7% (n = 94) were between ⅓ and 3 and 24.0% (n = 36) were > 3, showing good concordance with the main results. Conclusions: Use of Bayes factors when analysing data from randomized trials of interventions in addiction research can provide important information that would lead to more precise conclusions than are obtained typically using currently prevailing methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490 · cited 2×
“original label sounded too decisive (3, 11).”
MethodUsing Bayes to get the most out of non-significant results
Dienes, Z. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00781 · Cited by 1,998 · cited 5×
“Bayes factors were calculated using the online calculator provided by Dienes [8] and the modified version using R code by Christie [9,10].”
MethodInfluentialSelf-citationDefault Bayes factors for ANOVA designs
Rouder, J. N., Morey, R. D., Speckman, P. L., & Province, J. M. (2012) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2012.08.001 · Cited by 1,800
Bayesian Cognitive Modeling: A Practical Course
Lee, M. D., & Wagenmakers, E.-J. (2014) · doi:10.1017/cbo9781139087759 · Cited by 1,795
Methadone maintenance therapy versus no opioid replacement therapy for opioid dependence
Mattick, R. P., Breen, C., Kimber, J., & Davoli, M. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002209.pub2 · Cited by 1,654 · cited 1×
“001; RaR=Rate ratio; RR= Relative risk; OR=Odds ratio; MD=mean difference; range of population SD reflects the CI of the expected effect size; α range of population SD based on opinion on a viable effect; a one directional relationship was assumed in all instances; Based on: a (31); b (32) c (33) ; d (34); e (35); f (…”
BackgroundAntidepressants for smoking cessation
Howes, S., Hartmann-Boyce, J., Livingstone-Banks, J., Hong, B., & Lindson, N. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000031.pub5 · Cited by 1,352
Livingston, J. D., Milne, T., Fang, M. L., & Amari, E. (2012) · Addiction · doi:10.1111/j.1360-0443.2011.03601.x · Cited by 927 · cited 1×
“001; RaR = rate ratio; RR = relative risk; OR = odds ratio; MD =mean difference; range of population SD reflects the CI of the expected effect size; αrange of population SD based on opinion on a viable effect; a one‐directional relationship was assumed in all instances; Based on: [31]; [32]; [33]; [34]; [35]; [36]; va…”
BackgroundNicotine replacement therapy for smoking cessation
Stead, L. F., Perera, R., Bullen, C., Mant, D., & Lancaster, T. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000146.pub3 · Cited by 721
Cited by
Sensitivity and specificity of information criteria
(2019) · doi:10.1093/bib/bbz016 · Cited by 718
Adapting interventions to new contexts—The ADAPT guidance
Moore, G., Campbell, M., Copeland, L., Craig, P., Movsisyan, A., Hoddinott, P., Littlecott, H., O’Cathain, A., Pfadenhauer, L., Rehfuess, E., et al. (2021) · BMJ · doi:10.1136/bmj.n1679 · Cited by 511
Crane, D., Garnett, C., Michie, S., West, R., & Brown, J. (2018) · Scientific Reports · doi:10.1038/s41598-018-22420-8 · Cited by 118
Self-citationHajek, P., Przulj, D., Pesola, F., Griffiths, C., Walton, R., McRobbie, H., Coleman, T., Lewis, S., Whitemore, R., Clark, M., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01808-0 · Cited by 85
Objective Facebook behaviour: Differences between problematic and non-problematic users
Marino, C., Finos, L., Vieno, A., Lenzi, M., & Spada, M. M. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.04.015 · Cited by 73
Metadata
- Authors
- Beard, E., Dienes, Z., Muirhead, C., & West, R.
- Venue
- Addiction
- Publisher
- Wiley
- Published
- 2016-08-10
- Volume
- 111
- Issue
- 12
- Pages
- 2230-2247
- ISSN
- 0965-2140 (ISSN-L)
- 1360-0443
- OpenAlex
- W2472306680
- Cited by
- 132
- References
- 15
- FWCI
- 12.66
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.