Interpreting the Outcomes of Automated Internet-Based Randomized Trials: Example of an International Smoking Cessation Study
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Smoking is one of the largest contributors to the global burden of disease. Internet interventions have been shown to reduce smoking rates successfully. However, improved methods of evaluating effectiveness need to be developed for large-scale Internet intervention trials. OBJECTIVE: To illustrate a method to interpret outcomes of large-scale, fully automated, worldwide Internet intervention trials. METHODS: A fully automated, international, Internet-based smoking cessation randomized controlled trial was conducted in Spanish and English, with 16,430 smokers from 165 countries. The randomized controlled trial replicated a published efficacy trial in which, to reduce follow-up attrition, 1000 smokers were followed up by phone if they did not provide online follow-up data. RESULTS: The 7-day self-reported abstinence rates ranged from 36.18% (2239/6189) at 1 month to 41.34% (1361/3292) at 12 months based on observed data. Given high rates of attrition in this fully automated trial, when participants unreachable at follow-up were presumed to be smoking, the abstinence rates ranged from 13.63% (2239/16.430) at 1 month to 8.28% (1361/16,430) at 12 months. We address the problem of interpreting results with high follow-up attrition rates and propose a solution based on a smaller study with intensive phone follow-up. CONCLUSIONS: Internet-based smoking cessation interventions can help large numbers of smokers quit. Large-scale international outcome studies can be successfully implemented using automated Internet sites. Interpretation of the studies' results can be aided by extrapolating from results obtained from subsamples that are followed up by phone or similar cohort maintenance methods. TRIAL REGISTRATION: ClinicalTrials.gov NCT00721786; http://clinicaltrials.gov/ct2/show/NCT00721786 (Archived by WebCite at http://www.webcitation.org/63mhoXYPw).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 1×
“Attrition is a recognized concern in Internet trials [20], which affects interpretation of results in two ways: (1) if most participants drop out, the remaining sample is highly self-selected and may not be representative of the original visitors, and (2) if participants do not complete the intervention, but respond t…”
BackgroundGlasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1261 · Cited by 1,836
Glasgow, R. E., Klesges, L. M., Dzewaltowski, D. A., Bull, S. S., & Estabrooks, P. (2004) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2701_2 · Cited by 635
Glasgow, R. E. (2006) · Health Education Research · doi:10.1093/her/cyl081 · Cited by 565
Nortriptyline and Cognitive-Behavioral Therapy in the Treatment of Cigarette Smoking
Hall, S. M., Reus, V. I., Muñoz, R. F., Sees, K. L., Humfleet, G., Hartz, D. T., Frederick, S., & Triffleman, E. (1998) · Archives of General Psychiatry · doi:10.1001/archpsyc.55.8.683 · Cited by 385 · cited 1×
“5), indicating moderate dependence, and similar to face-to-face smoking cessation trials [36-39].”
BackgroundSelf-citationHappy Ending: a randomized controlled trial of a digital multi‐media smoking cessation intervention
Brendryen, H., & Kraft, P. (2008) · Addiction · doi:10.1111/j.1360-0443.2007.02119.x · Cited by 292
Strecher, V., McClure, J., Alexander, G., Chakraborty, B., Nair, V., Konkel, J., Greene, S., Couper, M., Carlier, C., Wiese, C., et al. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1002 · Cited by 264 · cited 1×
“Reports indicate that, in fact, Internet interventions can obtain quit rates comparable with those of other treatment modalities [12-19].”
ResultUsing evidence-based internet interventions to reduce health disparities worldwide.
Muñoz, R. F. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1463 · Cited by 242 · cited 1×
“Such an approach would contribute to the use of evidence-based Internet interventions to reduce health disparities worldwide [43].”
BackgroundSelf-citationMarks, I. M., Cavanagh, K., & Gega, L. (2007) · Psychology Press eBooks · doi:10.4324/9780203962152 · Cited by 167
International Spanish/English Internet smoking cessation trial yields 20% abstinence rates at 1 year
Muñoz, R. F., Barrera, A. Z., Delucchi, K., Penilla, C., Torres, L. D., & Pérez-Stable, E. J. (2009) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntp090 · Cited by 127
Self-citation
Cited by
Rogers, M. A., Lemmen, K., Kramer, R., Mann, J., & Chopra, V. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7111 · Cited by 259
“Of these studies, there were 268 unique RCTs that were self-help Internet-based interventions; and of the 268 studies, there were 57 trials demonstrating a health benefit with a functional website [77-138].”
BackgroundMorris, R. R., Schueller, S. M., & Picard, R. W. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4167 · Cited by 206
Systematic review and meta-analysis of internet interventions for smoking cessation among adults
Graham, A., Carpenter, K., Cha, S., Cole, S., Jacobs, M., Raskob, M., & Cole-Lewis, H. (2016) · Substance Abuse and Rehabilitation · doi:10.2147/sar.s101660 · Cited by 114
Parks, A. C., Williams, A. L., Tugade, M. M., Hokes, K. E., Honomichl, R. D., & Zilca, R. D. (2018) · International Journal of Wellbeing · doi:10.5502/ijw.v8i2.745 · Cited by 87
Metadata
- Authors
- Leykin, Y., Aguilera, A., Torres, L. D., Pérez-Stable, E. J., & Muñoz, R. F.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2012-02-07
- Volume
- 14
- Issue
- 1
- Pages
- e5
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2084916627
- Cited by
- 32
- References
- 11
- FWCI
- 2.83
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Interpreting the Outcomes of Automated Internet-Based Randomized Trials: Example of an International Smoking Cessation Study. https://app.cochat.ai/papers/10.2196/jmir.1829
- The paper
- Leykin, Y., Aguilera, A., Torres, L. D., Pérez-Stable, E. J., & Muñoz, R. F. (2012). Interpreting the Outcomes of Automated Internet-Based Randomized Trials: Example of an International Smoking Cessation Study. Journal of Medical Internet Research. https://doi.org/10.2196/jmir.1829
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.