Outpatient and self-referred participants: adherence to treatment components and outcome in an internet intervention targeting anxiety disorders.
Open accessAbstract
OBJECTIVE: While adherence is an important factor influencing the effectiveness of internet interventions, many studies operationalize adherence only by the number of sessions and do not report adherence to specific treatment components. The goal of this study was to investigate adherence to treatment components as well as outcome in outpatients and self-referred participants who participated in an internet intervention targeting anxiety. METHOD: -test and χ2 tests adherence to treatment components based on the number of completed exercises was compared between participant groups. A 2 × 2 repeated measures ANOVA was used to compare pre-to post symptom change between participant groups. Primary measures included the Generalized Anxiety Disorder Scale-7 (GAD-7) and the Mini Social Phobia Inventory (Mini-SPIN). Using nonparametric bootstrap analyses number of sessions and adherence to treatment components were investigated as potential mediators of the relationship between participant group and outcome. Finally, predictors of adherence to treatment components in outpatient participants were investigated using LASSO and logistic regression. RESULTS: Self-referred participants were more adherent than outpatient participants, however the groups did not differ significantly in outcome. Outpatient participants who adhered to relaxation showed greater improvement during the waiting period than the matched outpatient waitlist sample. The effect of participant group on outcome was mediated via adherence to exposure and number of sessions. CONCLUSIONS: In internet interventions adherence to treatment components differs between participant groups and has a mediating effect on treatment outcome. Therefore, it should be fostered, especially when participants are not self-referred. In line with these findings more studies should investigate relevant participant characteristics in more depth.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
All participants were self-referred from a patient-volunteer list.
“All participants were self-referred from a patient-volunteer list (Arndt et al., 2020).”
From Online ACT intervention for fibromyalgia: An exploratory study of feasibility and preliminary effectiveness with smartphone-delivered experiential sampling assessment (2022) · cites this paper as Arndt et al., 2020
The Methods section (“Flow of participants”) describes two groups, not a sample composed entirely of self-referred participants. Outpatients were recruited through an outpatient clinic, while self-referred participants were recruited through newspaper and university-press advertisements; it does not describe a patient-volunteer list. (LLM, conf=0.92)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredAdherence reflects the degree to which participants receive the active ingredients of the program and was supported to be a significant mediator toward treatment outcomes.
“Adherence reflects the degree to which participants receive the “active ingredients” of the program (Danaher et al., 2006), and was supported to be a significant mediator toward treatment outcomes (Arndt et al., 2020).”
From Can We Boost Treatment Adherence to an Online Transdiagnostic Intervention by Adding Self-Enhancement Strategies? Results From a Randomized Controlled Non-inferiority Trial (2021) · cites this paper as Arndt et al., 2020
The Results section ('Mediation model predicting change in anxiety symptoms'; page unavailable) reports a significant indirect effect of participant group on GAD-7 outcome through adherence to exposure and number of sessions. The claim is broader than that finding: other adherence measures did not significantly mediate the effect, and the mediation was not significant for the social-anxiety outcome. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · see citing works
(2013) · Cited by 44,563 · see citing works
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139 · see citing works
(2017) · Cited by 16,319 · see citing works
(1998) · PubMed · Cited by 10,216 · see citing works
Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., & Herzberg, P. Y. (2008) · Medical Care · doi:10.1097/mlr.0b013e318160d093 · Cited by 4,527 · see citing works
Regression Shrinkage and Selection via The Lasso: A Retrospective
Tibshirani, R. J. (2011) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2011.00771.x · Cited by 3,601 · see citing works
How important are the common factors in psychotherapy? An update
Wampold, B. E. (2015) · World Psychiatry · doi:10.1002/wps.20238 · Cited by 1,728 · cited 1× · see citing works
“Instead of this broad definition of adherence, adherence to treatment components should be more closely investigated, as these components are thought to be responsible for treatment change (Domhardt et al., 2019; Wampold, 2015).”
BackgroundIs General Self-Efficacy a Universal Construct?1
Scholz, U., Gutiérrez Doña, B., Sud, S., & Schwarzer, R. (2002) · European Journal of Psychological Assessment · doi:10.1027//1015-5759.18.3.242 · Cited by 1,637 · see citing works
Psychometric properties of the Social Phobia Inventory (SPIN): New self-rating scale
Connor, K. M., Davidson, J. R. T., Churchill, L. E., Sherwood, A., Weisler, R. H., & Foa, E. (2000) · British Journal of Psychiatry · doi:10.1192/bjp.176.4.379 · Cited by 1,624 · see citing works
Andrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.01.001 · Cited by 922 · see citing works
Beatty, L., & Binnion, C. (2016) · International Journal of Behavioral Medicine · doi:10.1007/s12529-016-9556-9 · Cited by 347 · see citing works
Sieverink, F., Kelders, S. M., & van Gemert-Pijnen, J. E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8578 · Cited by 331 · see citing works
Engagement and retention: measuring breadth and depth of participant use of an online intervention
Couper, M. P., Alexander, G. L., Zhang, N., Little, R. J., Maddy, N., Nowak, M. A., McClure, J. B., Calvi, J. J., Rolnick, S. J., Stopponi, M. A., et al. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1430 · Cited by 244 · see citing works
Domhardt, M., Geßlein, H., von Rezori, R. E., & Baumeister, H. (2019) · Depression and Anxiety · doi:10.1002/da.22860 · Cited by 218 · see citing works
Hilvert-Bruce, Z., Rossouw, P. J., Wong, N., Sunderland, M., & Andrews, G. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.04.001 · Cited by 193 · see citing works
Effectiveness of Guided Internet-Based Cognitive Behavior Therapy in Regular Clinical Settings
Andersson, G., & Hedman, E. (2013) · Verhaltenstherapie · doi:10.1159/000354779 · Cited by 165 · see citing works
Berger, T., Boettcher, J., & Caspar, F. (2014) · Psychotherapy · doi:10.1037/a0032527 · Cited by 158 · see citing works
Self-citationDas Brief Symptom Inventory (BSI) als Instrument zur Qualitätssicherung in der Psychotherapie
Geisheim, C., Hahlweg, K., Fiegenbaum, W., Frank, M., Schröder, B., & von Witzleben, I. (2002) · Diagnostica · doi:10.1026//0012-1924.48.1.28 · Cited by 119 · see citing works
Alfonsson, S., Olsson, E., & Hursti, T. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5352 · Cited by 118 · see citing works
Schröder, J., Berger, T., Meyer, B., Lutz, W., Hautzinger, M., Späth, C., Eichenberg, C., Klein, J. P., & Moritz, S. (2017) · Cognitive Therapy and Research · doi:10.1007/s10608-017-9850-0 · Cited by 113 · see citing works
El Alaoui, S., Ljótsson, B., Hedman, E., Kaldo, V., Andersson, E., Rück, C., Andersson, G., & Lindefors, N. (2015) · PLOS ONE · doi:10.1371/journal.pone.0124258 · Cited by 98 · see citing works
Lutz, W., Tholen, S., Schürch, E., & Berking, M. (2006) · Diagnostica · doi:10.1026/0012-1924.52.1.11 · Cited by 98 · see citing works
Berger, T., Urech, A., Krieger, T., Stolz, T., Schulz, A., Vincent, A., Moser, C. T., Moritz, S., & Meyer, B. (2017) · Psychological Medicine · doi:10.1017/s0033291716002270 · Cited by 98 · see citing works
The Reliability of the Mini-International Neuropsychiatric Interview-Italian Version
Rossi, A., Alberio, R., Porta, A., Sandri, M. F., Tansella, M., & Amaddeo, F. (2004) · Journal of Clinical Psychopharmacology · doi:10.1097/01.jcp.0000139758.03834.ad · Cited by 95 · see citing works
Der Inkongruenzfragebogen (INK)
Holtforth, M. G., & Grawe, K. (2003) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/0084-5345.32.4.315 · Cited by 87 · see citing works
Matsuzawa, Y. K., Lee, Y. S. C., Fraser, F., Langenbahn, D. M., Shallcross, A. J., Powers, S. W., Lipton, R. B., Simon, N. M., & Minen, M. T. (2018) · Headache The Journal of Head and Face Pain · doi:10.1111/head.13429 · Cited by 67 · see citing works
Wiltink, J., Kliem, S., Michal, M., Subič-Wrana, C., Reiner, I., Beutel, M. E., Brähler, E., & Zwerenz, R. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1545-2 · Cited by 63 · see citing works
Defining and Predicting Patterns of Early Response in a Web-Based Intervention for Depression
Lutz, W., Arndt, A., Rubel, J. A., Berger, T., Schröder, J., Späth, C., Meyer, B., Greiner, W., Gräfe, V., Hautzinger, M., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7367 · Cited by 58 · see citing works
Cognitive-behavioral therapy for generalized anxiety
Borza, L. (2017) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2017.19.2/lborza · Cited by 57 · see citing works
Cooper, A. A., Kline, A. C., Baier, A. L., & Feeny, N. C. (2018) · Behavior Modification · doi:10.1177/0145445518792251 · Cited by 48 · see citing works
Kenter, R. M. F., Warmerdam, L., Brouwer-Dudokdewit, C., Cuijpers, P. J., & van Straten, A. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-43 · Cited by 37 · see citing works
Lutz, W., Schürch, E., Stulz, N., Boehnke, J. R., Schöttke, H., Rogner, J., & Wiedl, K. H. (2009) · Diagnostica · doi:10.1026/0012-1924.55.2.106 · Cited by 34 · see citing works
Adherence predictors in an Internet-based Intervention program for depression
Castro, A., del Hoyo, Y. L., Peake, C., Mayoral, F., Botella, C., García‐Campayo, J., Baños, R., Nogueira‐Arjona, R., Roca, M., & Gili, M. (2017) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1366546 · Cited by 27 · see citing works
Koffel, E., Vitiello, M. V., McCurry, S. M., Rybarczyk, B., & Von Korff, M. (2018) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000546 · Cited by 26 · see citing works
Newman, M. G., Lafreniere, L. S., & Jacobson, N. C. (2018) · Psychotherapy Research · doi:10.1080/10503307.2016.1253891 · Cited by 21 · see citing works
Flagged first, then by citations
1 of the 37 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Telephone-based psychological crisis intervention: the Portuguese experience with COVID-19
Ribeiro, E., Sampaio, A., Gonçalves, M. M., Taveira, M. D. C., Cunha, J., Maia, Â., de Matos, M. A. V., Gonçalves, S. F., Figueiredo, B., Freire, T., et al. (2020) · Counselling Psychology Quarterly · doi:10.1080/09515070.2020.1772200 · Cited by 32 · see citing works
Isbăşoiu, A. B., Tulbure, B. T., Rusu, A., & Sava, F. A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.752249 · Cited by 14 · see citing works
Stech, E. P., Chen, A. Z., Sharrock, M. J., Grierson, A. B., Upton, E. L., Mahoney, A., Grisham, J. R., & Newby, J. M. (2021) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2021.102382 · Cited by 9 · see citing works
Food as Medicine Clinic: Early Results and Lessons Learned
Hu, D., Cherian, A., Chagin, K. M., Bier, J., Einstadter, D., Gunzler, D. D., Glenn, A. C., McLaughlin, E., Cook, K., Misak, J., et al. (2022) · Cureus · doi:10.7759/cureus.31912 · Cited by 7 · see citing works
de la Coba, P., Rodríguez-Valverde, M., & Hernández-López, M. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100561 · Cited by 5 · see citing works
“All participants were self-referred from a patient-volunteer list (Arndt et al., 2020).”
BackgroundWu, J., Chang, H.-Y., Kao, C., Hung, K.-C., Yu, T., & Lin, Y. (2025) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2025.120390 · Cited by 5 · see citing works
Huang, Y., Liu, H., Chi, M., Meng, S., & Wang, W. (2025) · Digital Health · doi:10.1177/20552076251333480 · Cited by 7 · see citing works
Motivation to change predicts college students’ utilization of self-help resources
Kaufman, A., & Nemeroff, R. K. (2024) · Journal of American College Health · doi:10.1080/07448481.2024.2334082 · Cited by 4 · see citing works
Bontilao-Lagare, R. S., Mordeno, I. G., & Nalipay, M. J. N. (2024) · Journal of College Student Mental Health · doi:10.1080/28367138.2024.2333752 · Cited by 2 · see citing works
Everson, G., Spring, B., Middleton, J., Richardson, A., & Gardiner, F. W. (2023) · Acta Psychologica · doi:10.1016/j.actpsy.2023.104122 · Cited by 1 · see citing works
Bjarke, J., Gjestad, R., & Nordgreen, T. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100907 · Cited by 1 · see citing works
Telephone-based psychological crisis intervention: the Portuguese experience with COVID-19
Ribeiro, E., Sampaio, A., Gonçalves, M. M., Taveira, M. D. C., Cunha, J., Maia, Â., de Matos, M. A. V., Gonçalves, S. F., Figueiredo, B., Freire, T., et al. (2023) · Routledge eBooks · doi:10.4324/9781003352235-4 · Cited by 1 · see citing works
Osakonor, D., & Tsitsikas, D. A. (2022) · Medicina · doi:10.3390/medicina58091286
- Authors
- Arndt, A., Rubel, J., Berger, T., & Lutz, W.
- Affiliations
- Universität Trier (DE)
- Justus-Liebig-Universität Gießen (DE)
- University of Bern (CH)
- Corresponding author
- Lutz, Wolfgang
- Venue
- Internet Interventions
- Publisher
- Elsevier BV
- Published
- 2020-04
- Volume
- 20
- Pages
- 100319
- ISSN
- 2214-7829 (ISSN-L)
- PMC
- PMC7178477
- OpenAlex
- W3015380354
- Cited by
- 13
- References
- 37
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 2 · 2023: 2 · 2022: 3 · 2021: 2 · 2020: 1
- FWCI
- 1.81
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Internet Interventions (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- BORIS (University Library Bern) (submittedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Open Access CRIS of the University of Bern
- Funders
- Deutsche Forschungsgemeinschaft (LU 660/8-1, LU 660/10-1)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- medication adherence, treatment components, anxiety disorders, generalized anxiety disorder, social anxiety disorder, relaxation techniques, exposure therapy, number of sessions, mediation, predictors of adherence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review