Following Up Nonrespondents to an Online Weight Management Intervention: Randomized Trial Comparing Mail versus Telephone
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Attrition, or dropout, is a problem faced by many online health interventions, potentially threatening the inferential value of online randomized controlled trials. OBJECTIVE: In the context of a randomized controlled trial of an online weight management intervention, where 85% of the baseline participants were lost to follow-up at the 12-month measurement, the objective was to examine the effect of nonresponse on key outcomes and explore ways to reduce attrition in follow-up surveys. METHODS: A sample of 700 non-respondents to the 12-month online follow-up survey was randomly assigned to a mail or telephone nonresponse follow-up survey. We examined response rates in the two groups, costs of follow-up, reasons for nonresponse, and mode effects. We ran several logistic regression models, predicting response or nonresponse to the 12-month online survey as well as predicting response or nonresponse to the follow-up survey. RESULTS: We analyzed 210 follow-up respondents in the mail and 170 in the telephone group. Response rates of 59% and 55% were obtained for the telephone and mail nonresponse follow-up surveys, respectively. A total of 197 respondents (51.8%) gave reasons related to technical issues or email as a means of communication, with older people more likely to give technical reasons for non-completion; 144 (37.9%) gave reasons related to the intervention or the survey itself. Mail follow-up was substantially cheaper: We estimate that the telephone survey cost about US $34 per sampled case, compared to US $15 for the mail survey. The telephone responses were subject to possible social desirability effects, with the telephone respondents reporting significantly greater weight loss than the mail respondents. The respondents to the nonresponse follow-up did not differ significantly from the 12-month online respondents on key outcome variables. CONCLUSIONS: Mail is an effective way to reduce attrition to online surveys, while telephone follow-up might lead to overestimating the weight loss for both the treatment and control groups. Nonresponse bias does not appear to be a significant factor in the conclusions drawn from the randomized controlled trial.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A note on a general definition of the coefficient of determination
NAGELKERKE, N. J. D. (1991) · Biometrika · doi:10.1093/biomet/78.3.691 · Cited by 5,927 · cited 1×
“030, while the Nagelkerke [26] max-rescaled R measure was 0.”
BackgroundThe Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 5×
“In his review of the problem, Eysenbach [2] argues for a “science of attrition,” saying that “Nonusage data per se should be of great interest to researchers, and attrition curves may be underreported and underanalyzed.”
BackgroundInfluentialWhat is meant by intention to treat analysis? Survey of published randomised controlled trials
Hollis, S., & Campbell, F. (1999) · BMJ · doi:10.1136/bmj.319.7211.670 · Cited by 2,160
Nonresponse in Household Interview Surveys
Groves, R. M., & Couper, M. P. (1998) · doi:10.1002/9781118490082 · Cited by 761
Self-citationAn Experimental Comparison of Web and Telephone Surveys
Fricker, S. (2005) · Public Opinion Quarterly · doi:10.1093/poq/nfi027 · Cited by 445
Clarke, G., Eubanks, D., Reid, E., Kelleher, C., O'Connor, E., DeBar, L. L., Lynch, F., Nunley, S., & Gullion, C. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.2.e16 · Cited by 372 · cited 1×
“Clarke and colleagues [14] assigned participants to a telephone or mail reminder, but similarly did not use these modes to collect follow-up data.”
BackgroundChristensen, H., Griffiths, K. M., Korten, A. E., Brittliffe, K., & Groves, C. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.4.e46 · Cited by 240
Farvolden, P., Denisoff, E., Selby, P., Bagby, R. M., & Rudy, L. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e7 · Cited by 223 · cited 1×
“For example, only 1% of participants completed all 12 weeks of a panic disorder program [4], 33% completed all five modules of a depression program [5], and 35% completed a follow-up questionnaire about 10 weeks after enrollment in a smoking-cessation trial [6].”
BackgroundGlasgow, R. E., Nelson, C. C., Kearney, K. A., Reid, R., Ritzwoller, D. P., Strecher, V. J., Couper, M. P., Green, B., & Wildenhaus, K. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.2.e11 · Cited by 216 · cited 2×
“On the basis of this work, we implemented a mail-only nonresponse follow-up study in a second controlled trial of a weight loss program [30].”
BackgroundMethodSelf-citation
Cited by
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251
Webb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517
The Delivery of Public Health Interventions via the Internet: Actualizing Their Potential
Bennett, G. G., & Glasgow, R. E. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100235 · Cited by 800
Designing Effective Web Surveys
Couper, M. P. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511499371 · Cited by 463
Self-citationKirwan, M., Vandelanotte, C., Fenning, A., & Duncan, M. J. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2588 · Cited by 343
“This is also true of behavioral interventions across varied intervention delivery modalities, especially the Internet [47-49].”
Strategies to improve retention in randomised trials
Brueton, V. C., Tierney, J., Stenning, S., Harding, S., Meredith, S., Nazareth, I., & Rait, G. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000032.pub2 · Cited by 279
Strategies to improve retention in randomised trials: a Cochrane systematic review and meta-analysis
Brueton, V. C., Tierney, J. F., Stenning, S., Meredith, S., Harding, S., Nazareth, I., & Rait, G. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-003821 · Cited by 253
Geraghty, A. W. A., Wood, A. M., & Hyland, M. E. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2010.03.007 · Cited by 241
Methodological Challenges in Online Trials
Murray, E., Khadjesari, Z., White, I. R., Kalaitzaki, E., Godfrey, C., McCambridge, J., Thompson, S. G., & Wallace, P. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1052 · Cited by 195
“High drop-out rates are another noted feature of online evaluations (the Law of Attrition [39]), with follow-up rates being often markedly lower in online trials than in conventional trials [30,31,41,42].”
BackgroundMethodKelders, S. M., Van Gemert-Pijnen, J. E. W. C., Werkman, A., Nijland, N., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1624 · Cited by 156
Khadjesari, Z., Murray, E., Kalaitzaki, E., White, I. R., McCambridge, J., Thompson, S. G., Wallace, P., & Godfrey, C. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1523 · Cited by 114
Mobile Intervention Design in Diabetes: Review and Recommendations
Mulvaney, S. A., Ritterband, L. M., & Bosslet, L. (2011) · Current Diabetes Reports · doi:10.1007/s11892-011-0230-y · Cited by 92
Riper, H., Kramer, J., Keuken, M., Smit, F., Schippers, G., & Cuijpers, P. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1102 · Cited by 52
“High loss to follow-up is therefore a potential concern in all Web-based self-help interventions [51,52].”
BackgroundUnderstanding adherence to web-based interventions
Kelders, S. M. (2012) · doi:10.3990/1.9789036534178 · Cited by 29
Metadata
- Authors
- Couper, M. P., Peytchev, A., Strecher, V. J., Rothert, K., & Anderson, J.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2007-06-13
- Volume
- 9
- Issue
- 2
- Pages
- e16
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2090142756
- Cited by
- 63
- References
- 12
- FWCI
- 14.68
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.