Participant Recruitment and Retention in Remote eHealth Intervention Trials: Methods and Lessons Learned From a Large Randomized Controlled Trial of Two Web-Based Smoking Interventions
Open accessPublished version of a preprint
The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Despite having many advantages, online eHealth trials are not without challenges-notably, participant recruitment, and outcome data retention. Moreover, publications from these trials rarely provide detailed information on the methods used for recruitment and retention or discuss implications of the methods for future studies. OBJECTIVE: To address this need for empirical guidance regarding recruitment and outcome data retention planning, we aim to describe the methods and lessons learned from the recruitment and retention procedures used in a large randomized trial of 2 Web-based smoking cessation interventions. METHODS: To ensure a demographically and geographically diverse participant sample, we used the recruitment strategies (1) traditional, (2) Web-based, and (3) online survey panel methods and adaptively modified each in response to recruitment success. At baseline, participants indicated how they heard about the study and answered demographic questions. To maximize trial retention at each of the 3-, 6-, and 12-month assessment points, 4 survey modalities (first Web, followed by phone, mail, and postcard) were sequentially timed over a 30-day period. Participants received US $25 for submitting their responses, regardless of modality, and received an additional US $10 bonus for completing the Web survey within 24h of electronic notification. RESULTS: We randomized 2637 smokers in 16 months and achieved 88% retention at 12-months. Participants (79.26% female, 72.60% Caucasian) were recruited from all 50 states. The majority of participants were recruited through Facebook (49.43%), followed by the survey panel (20.85%), free internet sources (14.54%), traditional media (11.34%), and Google ads (3.84%). Descriptively, participant demographics varied by recruitment source. Of the completed follow-up surveys, most were completed by Web (92%). Retention rates did not vary by recruitment source. CONCLUSIONS: Continuous monitoring and refinement of multiple recruitment methods, particularly of online advertising campaigns, allowed us to maximize the effectiveness of recruitment strategies in recruiting a large, diverse sample of smokers. Likewise, offering multiple follow-up survey modalities in sequential order along with time-dependent bonus incentives enabled us to obtain outcome data from a very high level of enrolled participants for the duration of the trial protocol. These strategies may be similarly useful in other trials. TRIAL REGISTRATION: ClinicalTrials.gov NCT01812278; https://clinicaltrials.gov/ct2/show/NCT01812278 (Archived by WebCite at http://www.webcitation.org/71gy5GLvO).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“An established protocol that has yielded high outcome data retention rates (85-90%) in our previous trials,60 and proven feasible in the Quit2Heal pilot trial28 is currently being implemented.”
From Efficacy of smartphone applications to help cancer patients quit smoking: Protocol of the Quit2Heal randomized controlled trial (2023) · cites this paper as [60]
The cited source says what the claim attributes to it.
In the citing paper
“we are employing social media recruitment strategies that yielded nationwide recruitment in previous digital smoking cessation trials”
From Efficacy of smartphone applications to help cancer patients quit smoking: Protocol of the Quit2Heal randomized controlled trial (2023) · cites this paper as [60]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
Morbidity and Mortality Weekly Report
(2010) · Wilderness & Environmental Medicine · doi:10.1016/j.wem.2010.09.015 · Cited by 2,950
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 2×
“Another major methodological challenge faced by online eHealth trials is keeping participants engaged in the study protocol and achieving adequate rates of outcome data retention [2,9,16-19].”
BackgroundKontos, E., Blake, K. D., Chou, W.-Y. S., & Prestin, A. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3117 · Cited by 917 · cited 1×
“This is not surprising as women are more likely to utilize eHealth programs [59].”
BackgroundDillman, D. A., Phelps, G., Tortora, R., Swift, K., Kohrell, J., Berck, J., & Messer, B. L. (2009) · Social Science Research · doi:10.1016/j.ssresearch.2008.03.007 · Cited by 850
The Use of Facebook in Recruiting Participants for Health Research Purposes: A Systematic Review
Whitaker, C., Stevelink, S., & Fear, N. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7071 · Cited by 724
How much loss to follow-up is acceptable in long-term randomised trials and prospective studies?
Fewtrell, M. S., Kennedy, K., Singhal, A., Martin, R. M., Ness, A., Hadders-Algra, M., Koletzko, B., & Lucas, A. (2008) · Archives of Disease in Childhood · doi:10.1136/adc.2007.127316 · Cited by 601
Dropout from Internet‐based treatment for psychological disorders
Melville, K. M., Casey, L. M., & Kavanagh, D. J. (2010) · British Journal of Clinical Psychology · doi:10.1348/014466509x472138 · Cited by 597 · cited 1×
“Another major methodological challenge faced by online eHealth trials is keeping participants engaged in the study protocol and achieving adequate rates of outcome data retention [2,9,16-19].”
Background
Research works printed but not linked: 1
- Jahangiry, L, 2014, Iran J Public Health, 43, 1248
Cited by
Efficacy of Smartphone Applications for Smoking Cessation: A Randomized Clinical Trial
Bricker, J. B., Watson, N. L., Mull, K. E., Sullivan, B. M., & Heffner, J. L. (2020) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2020.4055 · Cited by 207
Self-citationSocial Media Use for Research Participant Recruitment: Integrative Literature Review
Darko, E. M., Kleib, M., & Olson, J. (2022) · Journal of Medical Internet Research · doi:10.2196/38015 · Cited by 202
Online Patient Recruitment in Clinical Trials: Systematic Review and Meta-Analysis
Brøgger-Mikkelsen, M., Ali, Z., Zibert, J. R., Andersen, A. D., & Thomsen, S. F. (2020) · Journal of Medical Internet Research · doi:10.2196/22179 · Cited by 165
“As pointed out previously, a large proportion of the studies that compared online and offline methods utilized online recruitment strategies only after realizing that offline strategies did not provide enough participants [6,7,28,36,46,62].”
InfluentialCohen, S. A., & Greaney, M. L. (2022) · Current Epidemiology Reports · doi:10.1007/s40471-022-00313-9 · Cited by 198
The Role of Social Media in Enhancing Clinical Trial Recruitment: Scoping Review
Darmawan, I., Bakker, C., Brockman, T. A., Patten, C. A., & Eder, M. (2020) · Journal of Medical Internet Research · doi:10.2196/22810 · Cited by 164
“1299/2637 (49) — Watson et al (2018) [48]”
BackgroundInfluential
Metadata
- Authors
- Watson, N. L., Mull, K. E., Heffner, J. L., McClure, J. B., & Bricker, J. B.
- Affiliations
- Fred Hutch Cancer Center (US)
- Kaiser Permanente Washington Health Research Institute (US)
- University of Washington (US)
- Corresponding author
- Watson, Noreen L
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2018-08-24
- Volume
- 20
- Issue
- 8
- Pages
- e10351
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6128955
- OpenAlex
- W2886267432
- Cited by
- 118
- References
- 59
- Citations by year
- 2026: 5 · 2025: 13 · 2024: 21 · 2023: 14 · 2022: 13 · 2021: 21 · 2020: 18 · 2019: 11 · 2018: 2
- FWCI
- 8.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Institute on Drug Abuse (F32DA041100, R01DA038411)
- National Cancer Institute (R01CA192849, R01CA166646, P30CA006516)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Smoking Behavior and Cessation
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- participant recruitment, participant retention, digital health interventions, online advertising, Facebook recruitment
- MeSH terms
- Tobacco Smoking, Female, Humans, Male, Middle Aged, Smoking Cessation, Telemedicine, Patient Selection, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Participant Recruitment and Retention in Remote eHealth Intervention Trials: Methods and Lessons Learned From a Large Randomized Controlled Trial of Two Web-Based Smoking Interventions. https://app.cochat.ai/papers/10.2196/10351
- The paper
- Watson, N. L., Mull, K. E., Heffner, J. L., McClure, J. B., & Bricker, J. B. (2018). Participant Recruitment and Retention in Remote eHealth Intervention Trials: Methods and Lessons Learned From a Large Randomized Controlled Trial of Two Web-Based Smoking Interventions. Journal of Medical Internet Research. https://doi.org/10.2196/10351
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


