Does recruitment source moderate treatment effectiveness? A subgroup analysis from the EVIDENT study, a randomised controlled trial of an internet intervention for depressive symptoms
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Objective: This study aims to examine whether the effects of internet interventions for depression generalise to participants recruited in clinical settings. Design: This study uses subgroup analysis of the results of a randomised, controlled, single-blind trial. Setting: The study takes place in five diagnostic centres in Germany. Participants: A total of 1013 people with mild to moderate depressive symptoms were recruited from clinical sources as well as internet forums, statutory insurance companies and other sources. Interventions: This study uses either care-as-usual alone (control) or a 12-week internet intervention (Deprexis) plus usual care (intervention). Main outcome measures: The primary outcome measure was self-rated depression severity (Patient Health Questionnaire-9) at 3 months and 6 months. Further measures ranged from demographic and clinical parameters to a measure of attitudes towards internet interventions (Attitudes towards Psychological Online Interventions Questionnaire). Results: The recruitment source was only associated with very few of the examined demographic and clinical characteristics. Compared with participants recruited from clinical sources, participants recruited through insurance companies were more likely to be employed. Clinically recruited participants were as severely affected as those from other recruitment sources but more sceptical of internet interventions. The effectiveness of the intervention was not differentially associated with recruitment source (treatment by recruitment source interaction=0.28, p=0.84). Conclusion: Our results support the hypothesis that the intervention we studied is effective across different recruitment sources including clinical settings. Trial registration number: ClinicalTrials.gov NCT01636752 .
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Analysing controlled trials with baseline and follow up measurements
Vickers, A. J., & Altman, D. G. (2001) · BMJ · doi:10.1136/bmj.323.7321.1123 · Cited by 2,116
Gueorguieva, R., & Krystal, J. H. (2004) · Archives of General Psychiatry · doi:10.1001/archpsyc.61.3.310 · Cited by 1,529
Statistics in Medicine — Reporting of Subgroup Analyses in Clinical Trials
Wang, R., Lagakos, S. W., Ware, J. H., Hunter, D. J., & Drazen, J. M. (2007) · New England Journal of Medicine · doi:10.1056/nejmsr077003 · Cited by 1,445 · cited 2×
“Subgroup analyses examining associations between recruitment source and intervention effectiveness require large sample sizes.(17) We have recently published one of the largest randomised trials of an internet intervention, the EVIDENT trial.”
BackgroundResultMonitoring Depression Treatment Outcomes With the Patient Health Questionnaire-9
L??we, B., Un??tzer, J., Callahan, C. M., Perkins, A. J., & Kroenke, K. (2004) · Medical Care · doi:10.1097/00005650-200412000-00006 · Cited by 1,354
Andrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013196 · Cited by 1,311
Subgroup analyses in randomized trials: risks of subgroup-specific analyses;
Brookes, S. T., Whitely, E., Egger, M., Smith, G. D., Mulheran, P. A., & Peters, T. J. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.08.009 · Cited by 775
Internet-based psychological treatments for depression
Johansson, R., & Andersson, G. (2012) · Expert Review of Neurotherapeutics · doi:10.1586/ern.12.63 · Cited by 509
Gilbody, S., Littlewood, E., Hewitt, C., Brierley, G., Tharmanathan, P., Araya, R., Barkham, M., Bower, P., Cooper, C., Gask, L., et al. (2015) · BMJ · doi:10.1136/bmj.h5627 · Cited by 409
Handling missing data in RCTs; a review of the top medical journals
Bell, M. L., Fiero, M., Horton, N. J., & Hsu, C.-H. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-118 · Cited by 395 · cited 1×
“No missing values were substituted as LMMs based on all observed data are valid and unbiased methods for missing at random data (MAR).(31) The outcome was analysed as change from baseline with a random intercept for the participant.”
MethodTherapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults
Olthuis, J. V., Watt, M. C., Bailey, K., Hayden, J. A., & Stewart, S. H. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011565.pub2 · Cited by 390
Berger, T., Hämmerli, K., Gubser, N., Andersson, G., & Caspar, F. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.616531 · Cited by 383
Self-citationMeyer, B., Berger, T., Caspar, F., Beevers, C. G., Andersson, G., & Weiss, M. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1151 · Cited by 363 · cited 1×
“Briefly, this programme consists of modules covering content that is broadly consistent with CBT (eg, cognitive restructuring, behavioural activation, acceptance and mindfulness, problem-solving).(21) The intervention can be used with or without guidance by a clinician.”
MethodSelf-citationArnberg, F. K., Linton, S. J., Hultcrantz, M., Heintz, E., & Jonsson, U. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098118 · Cited by 330
Kuester, A., Niemeyer, H., & Knaevelsrud, C. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.11.004 · Cited by 261
Self-guided psychological treatment for depressive symptoms: a meta-analysis
Cuijpers, P., Donker, T., Johansson, R., Mohr, D. C., van Straten, A., & Andersson, G. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021274 · Cited by 250 · cited 1×
“2 However, most participants in these studies have been recruited through media advertisements,(7) 9 so it remains unclear whether they are similar to those seeking face-to-face treatment in regular clinical settings(7) and whether the effects for internet interventions generalise across different recruitment settings…”
BackgroundHedman, E., Ljótsson, B., Kaldo, V., Hesser, H., El Alaoui, S., Kraepelien, M., Andersson, E., Rück, C., Svanborg, C., Andersson, G., et al. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.10.023 · Cited by 224
Meyer, B., Bierbrodt, J., Schröder, J., Berger, T., Beevers, C. G., Weiss, M., Jacob, G., Späth, C., Andersson, G., Lutz, W., et al. (2015) · Internet Interventions · doi:10.1016/j.invent.2014.12.003 · Cited by 188 · cited 1×
“However, this difference may also depend on symptom severity, as we have previously observed stronger effects among severely depressed individuals who used an internet intervention and received concurrent antidepressant medication.(4)”
BackgroundSelf-citationA Brief Web-Based Screening Questionnaire for Common Mental Disorders: Development and Validation
Donker, T., Straten, A. V., Marks, I., & Cuijpers, P. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1134 · Cited by 166
Effectiveness of Guided Internet-Based Cognitive Behavior Therapy in Regular Clinical Settings
Andersson, G., & Hedman, E. (2013) · Verhaltenstherapie · doi:10.1159/000354779 · Cited by 165
Therapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults
Olthuis, J. V., Watt, M. C., Bailey, K., Hayden, J. A., & Stewart, S. H. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011565 · Cited by 150
Schröder, J., Sautier, L., Kriston, L., Berger, T., Meyer, B., Späth, C., Köther, U., Nestoriuc, Y., Klein, J. P., & Moritz, S. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.08.044 · Cited by 149
Self-citationSchröder, J., Berger, T., Meyer, B., Lutz, W., Hautzinger, M., Späth, C., Eichenberg, C., Klein, J. P., & Moritz, S. (2017) · Cognitive Therapy and Research · doi:10.1007/s10608-017-9850-0 · Cited by 113 · cited 2×
“They were asked to provide demographic data and to complete two questionnaires: an unstandardised questionnaire that assessed their recruitment experience and the Attitudes towards Psychological Online Interventions Questionnaire, adapted for healthcare professionals (APOI-HP).(28)”
BackgroundMethodSelf-citationTitov, N., Andrews, G., Kemp, A., & Robinson, E. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010885 · Cited by 97 · cited 1×
“These findings might provide some orientation for researchers wishing to recruit participants with certain demographics as it has been noted that participants in internet studies as well as outpatient treatment centres are more highly educated than the general population.(14) Participants recruited through clinical se…”
BackgroundMoritz, S., Schröder, J., Meyer, B., & Hauschildt, M. (2013) · Depression and Anxiety · doi:10.1002/da.21988 · Cited by 53
Self-citationLindner, P., Nyström, M. B. T., Hassmén, P., Andersson, G., & Carlbring, P. (2015) · Internet Interventions · doi:10.1016/j.invent.2015.04.002 · Cited by 51
Cited by
Frampton, G. K., Shepherd, J., Pickett, K., Griffiths, G., & Wyatt, J. C. (2020) · Trials · doi:10.1186/s13063-020-04358-3 · Cited by 119
The association between adherence and outcome in an Internet intervention for depression
Fuhr, K., Schröder, J., Berger, T., Moritz, S., Meyer, B., Lutz, W., Hohagen, F., Hautzinger, M., & Klein, J. P. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.12.028 · Cited by 97
Self-citationTaylor, C. B., Graham, A. K., Flatt, R. E., Waldherr, K., & Fitzsimmons-Craft, E. E. (2021) · European Journal of Public Health · doi:10.1093/eurpub/ckz208 · Cited by 114
Wallin, E., Norlund, F., Olsson, E. M. G., Burell, G., Held, C., & Carlsson, T. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9690 · Cited by 36
“It has also been suggested that participants recruited in routine care may have less favorable views of internet-based interventions [19] and that those recruited through a consecutive clinical procedure are less motivated to engage in internet-based interventions compared with patients recruited through self-referral…”
BackgroundSchuster, R., Kalthoff, I., Walther, A., Köhldorfer, L., Partinger, E., Berger, T., & Laireiter, A.-R. (2019) · Journal of Medical Internet Research · doi:10.2196/11860 · Cited by 25
“Fourth, compared with previous bGT depression studies [40,41] and studies on Web-based interventions [91,92], the current sample composition is more balanced with regard to gender and the level of education.”
Self-citation
Metadata
- Authors
- Klein, J. P., Gamon, C., Späth, C., Berger, T., Meyer, B., Hohagen, F., Hautzinger, M., Lutz, W., Vettorazzi, E., Moritz, S., & Schröder, J.
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2017-07
- Volume
- 7
- Issue
- 7
- Pages
- e015391
- ISSN
- 2044-6055 (ISSN-L)
- OpenAlex
- W2735811634
- Cited by
- 24
- References
- 26
- FWCI
- 4.97
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.