Effectiveness of a Proactive Mail-Based Alcohol Internet Intervention for University Students: Dismantling the Assessment and Feedback Components in a Randomized Controlled Trial
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
BACKGROUND: University students in Sweden routinely receive proactive mail-based alcohol Internet interventions sent from student health services. This intervention provides personalized normative feedback on alcohol consumption with suggestions on how to decrease drinking. Earlier feasibility trials by our group and others have examined effectiveness in simple parallel-groups designs. OBJECTIVE: To evaluate the effectiveness of electronic screening and brief intervention, using a randomized controlled trial design that takes account of baseline assessment reactivity (and other possible effects of the research process) due to the similarity between the intervention and assessment content. The design of the study allowed for exploration of the magnitude of the assessment effects per se. METHODS: This trial used a dismantling design and randomly assigned 5227 students to 3 groups: (1) routine practice assessment and feedback, (2) assessment-only without feedback, and (3) neither assessment nor feedback. At baseline all participants were blinded to study participation, with no contact being made with group 3. We approached students 2 months later to participate in a cross-sectional alcohol survey. All interventions were fully automated and did not have any human involvement. All data used in the analysis were based on self-assessment using questionnaires. The participants were unaware that they were participating in a trial and thus were also blinded to which group they were randomly assigned. RESULTS: Overall, 44.69% (n = 2336) of those targeted for study completed follow-up. Attrition was similar in groups 1 (697/1742, 40.01%) and 2 (737/1742, 42.31% retained) and lower in group 3 (902/1743, 51.75% retained). Intention-to-treat analyses among all participants regardless of their baseline drinking status revealed no differences between groups in all alcohol parameters at the 2-month follow-up. Per-protocol analyses of groups 1 and 2 among those who accepted the email intervention (36.2% of the students who were offered the intervention in group 1 and 37.3% of the students in group2 ) and who were risky drinkers at baseline (60.7% follow-up rate in group 1 and 63.5% in group 2) suggested possible small beneficial effects on weekly consumption attributable to feedback. CONCLUSIONS: This approach to outcome evaluation is highly conservative, and small benefits may follow the actual uptake of feedback intervention in students who are risky drinkers, the precise target group. TRIAL REGISTRATION: International Standard Randomized Controlled Trial Number (ISRCTN): 24735383; http://www.controlled-trials.com/ISRCTN24735383 (Archived by WebCite at http://www.webcitation.org/6Awq7gjXG).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SAUNDERS, J. B., AASLAND, O. G., BABOR, T. F., DE LA FUENTE, J. R., & GRANT, M. (1993) · Addiction · doi:10.1111/j.1360-0443.1993.tb02093.x · Cited by 13,597 · cited 2×
“In the intention-to-treat analysis we assessed risky drinking at follow-up with the AUDIT questionnaire [30], asking the students about their drinking habits during the last 4 weeks.”
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 2×
“It is also a significant problem in the conduct of online trials in other populations as underscored by Eysenbach [32] and others [33].”
Effectiveness of brief alcohol interventions in primary care populations
Kaner, E. F., Beyer, F. R., Muirhead, C., Campbell, F., Pienaar, E. D., Bertholet, N., Daeppen, J. B., Saunders, J. B., & Burnand, B. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004148.pub4 · Cited by 1,665
Brief interventions for alcohol problems: a review
BIEN, T. H., MILLER, W. R., & TONIGAN, J. S. (1993) · Addiction · doi:10.1111/j.1360-0443.1993.tb00820.x · Cited by 1,577 · cited 1×
“Several reviews of brief alcohol interventions have noted unexpected levels of reductions in drinking among control groups [27,28].”
Effectiveness of brief alcohol interventions in primary care populations
Kaner, E. F. S., Dickinson, H. O., Beyer, F. R., Campbell, F., Schlesinger, C., Heather, N., Saunders, J. B., Burnand, B., & Pienaar, E. D. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004148.pub3 · Cited by 746
Individual-level interventions to reduce college student drinking: A meta-analytic review
Carey, K. B., Scott-Sheldon, L. A. J., Carey, M. P., & DeMartini, K. S. (2007) · Addictive Behaviors · doi:10.1016/j.addbeh.2007.05.004 · Cited by 699 · cited 1×
“A meta-analysis conducted by Carey et al [16] found that students receiving personalized normative feedback demonstrated significant reductions in harmful alcohol-related behaviors.”
Kypri, K., Saunders, J. B., Williams, S. M., McGee, R. O., Langley, J. D., Cashell‐Smith, M. L., & Gallagher, S. J. (2004) · Addiction · doi:10.1111/j.1360-0443.2004.00847.x · Cited by 287
McCambridge, J., & Kypri, K. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023748 · Cited by 242 · cited 2×
“A recently published systematic review of randomized evaluations of assessment effects in brief intervention found somewhat equivocal evidence of assessment reactivity when studies with adults, some of which identified no brief intervention effects, were included [26].”
Self-citationMethodological Challenges in Online Trials
Murray, E., Khadjesari, Z., White, I. R., Kalaitzaki, E., Godfrey, C., McCambridge, J., Thompson, S. G., & Wallace, P. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1052 · Cited by 195 · cited 1×
“It is also a significant problem in the conduct of online trials in other populations as underscored by Eysenbach [32] and others [33].”
Self-citationKypri, K. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.249 · Cited by 170 · cited 2×
“One exception is several randomized controlled trials performed in Australia by Kypri et al, including a large-scale study of 13,000 university students [20].”
Jenkins, R. J., McAlaney, J., & McCambridge, J. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.09.016 · Cited by 103 · cited 2×
“Such reductions have usually been explained by regression to the mean, the effects of natural variation in people’s drinking patterns, and by a possible inadvertent intervention effect of the assessment and research procedures [21].”
Self-citationReactivity to alcohol assessment measures: an experimental test
Walters, S. T., Vader, A. M., Harris, T. R., & Jouriles, E. N. (2009) · Addiction · doi:10.1111/j.1360-0443.2009.02632.x · Cited by 90
Boon, B., Risselada, A., Huiberts, A., Riper, H., & Smit, F. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1695 · Cited by 56 · cited 1×
“Several studies have assessed the effectiveness of various forms of Internet-based screening, combined with brief interventions, to change drinking behaviors, as shown for example by Boon et al [4] and Saitz et al [5].”
Bendtsen, P., Johansson, K., & Åkerlind, I. (2006) · Addictive Behaviors · doi:10.1016/j.addbeh.2005.06.002 · Cited by 52 · cited 6×
“Study Setting and Population The study was performed at Linköping University in the mid to southern part of Sweden among all 5227 freshmen entering the university.”
InfluentialSelf-citation
Cited by
A tutorial on sensitivity analyses in clinical trials: the what, why, when and how
Thabane, L., Mbuagbaw, L., Zhang, S., Samaan, Z., Marcucci, M., Ye, C., Thabane, M., Giangregorio, L., Dennis, B., Kosa, D., et al. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-92 · Cited by 893
“However, a sensitivity analysis based on the PP analysis (including only those with risky drinking at baseline and who answered the follow-up survey; n = 408) suggested a small beneficial effect on weekly alcohol consumption [31].”
Brief alcohol interventions for adolescents and young adults: A systematic review and meta-analysis
Tanner-Smith, E. E., & Lipsey, M. W. (2015) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2014.09.001 · Cited by 468
Kaner, E. F., Beyer, F. R., Garnett, C., Crane, D., Brown, J., Muirhead, C., Redmore, J., O'Donnell, A., Newham, J. J., de Vocht, F., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011479.pub2 · Cited by 308
Social norms information for alcohol misuse in university and college students
Foxcroft, D. R., Moreira, M. T., Almeida Santimano, N. M., & Smith, L. A. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006748.pub4 · Cited by 159
Choosing sensitivity analyses for randomised trials: principles
Morris, T. P., Kahan, B. C., & White, I. R. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-11 · Cited by 75
“It is common for authors to compare the results of intention-to-treat with per-protocol analysis; see for example [8,9].”
Metadata
- Authors
- Bendtsen, P., McCambridge, J., Bendtsen, M., Karlsson, N., & Nilsen, P.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2012-10-31
- Volume
- 14
- Issue
- 5
- Pages
- e142
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2115071147
- Cited by
- 57
- References
- 14
- FWCI
- 4.74
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.