The DOI matches its Crossref record; 100 of the 101 references it cites were found in a registry or an index.
Design and Delivery Features That May Improve the Use of Internet-Based Cognitive Behavioral Therapy for Children and Adolescents With Anxiety: A Realist Literature Synthesis With a Persuasive Systems Design Perspective
Open accessAbstract
BACKGROUND: Internet-based cognitive behavioral therapy (iCBT) is a persuasive system as its design combines therapeutic content, technological features, and interactions between the user and the program to reduce anxiety for children and adolescents. How iCBT is designed and delivered differs across programs. Although iCBT is considered an effective approach for treating child and adolescent anxiety, rates of program use (eg, module completion) are highly variable for reasons that are not clear. As the extent to which users complete a program can impact anxiety outcomes, understanding what iCBT design and delivery features improve program use is critical for optimizing treatment effects. OBJECTIVE: The objectives of this study were to use a realist synthesis approach to explore the design and delivery features of iCBT for children and adolescents with anxiety as described in the literature and to examine their relationship to program use outcomes. METHODS: A search of published and gray literature was conducted up to November 2017. Prespecified inclusion criteria identified research studies, study protocols, and program websites on iCBT for child and adolescent anxiety. Literature was critically appraised for relevance and methodological rigor. The persuasive systems design (PSD) model, a comprehensive framework for designing and evaluating persuasive systems, was used to guide data extraction. iCBT program features were grouped under 4 PSD categories-Primary task support, Dialogue support, System credibility support, and Social support. iCBT design (PSD Mechanisms) and delivery features (Context of use) were linked to program use (Outcomes) using meta-ethnographic methods; these relationships were described as Context-Mechanism-Outcome configurations. For our configurations, we identified key PSD features and delivery contexts that generated moderate-to-high program use based on moderate-to-high quality evidence found across multiple iCBT programs. RESULTS: A total of 44 documents detailing 10 iCBT programs were included. Seven iCBT programs had at least one document that scored high for relevance; most studies were of moderate-to-high methodological rigor. We developed 5 configurations that highlighted 8 PSD features (Tailoring, Personalization [Primary task supports]; Rewards, Reminders, Social role [Dialogue supports]; and Trustworthiness, Expertise, Authority [System credibility supports]) associated with moderate-to-high program use. Important features of delivery Context were adjunct support (a face-to-face, Web- or email-based communications component) and whether programs targeted the prevention or treatment of anxiety. Incorporating multiple PSD features may have additive or synergistic effects on program use. CONCLUSIONS: The Context-Mechanism-Outcome configurations we developed suggest that, when delivered with adjunct support, certain PSD features contribute to moderate-to-high use of iCBT prevention and treatment programs for children and adolescents with anxiety. Standardization of the definition and measurement of program use, formal testing of individual and combined PSD features, and use of real-world design and testing methods are important next steps to improving how we develop and deliver increasingly useful treatments to target users.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“There is some support to suggest that the inclusion of social networking facilities in digital interventions for individuals with serious mental illnesses can assist in fostering a sense of social connectedness [35,140,141], a sense of cooperation (shared goals), and increased accountability toward treatment [137].”
From The therapeutic alliance in digital mental health interventions for serious mental illnesses: narrative review (2020) · cites this paper as [137]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“multiple authors indicated that it is always important to use a systematic approach when planning and executing any sort of literature review to ensure completeness of the results”
From Methods for Human-Centered eHealth Development: Narrative Scoping Review (2022) · cites this paper as [167]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“As adolescents are sensitive to peer influence and can be motivated by interactions with peers [40-42]”
From A Smartphone Serious Game for Adolescents (Grow It! App): Development, Feasibility, and Acceptance Study (2022) · cites this paper as [40]
Experimental — accuracy not yet measuredIn the citing paper
“Credibility support is associated with perceived authority, expertise, and trustworthiness among users of digital interventions, and findings show that its deliberate implementation is also associated with engagement [137].”
From The therapeutic alliance in digital mental health interventions for serious mental illnesses: narrative review (2020) · cites this paper as [137]
In the citing paper
“multiple authors pointed out that often a lot of time has passed between initial data collection and publication of studies—which is especially relevant for the rapidly changing domain of eHealth.”
From Methods for Human-Centered eHealth Development: Narrative Scoping Review (2022) · cites this paper as [167]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877 · cited 1×
“During this stage, we randomly selected 100 citations to assess inter-rater agreement for inclusion or exclusion decisions; Cohen kappa was 0.74 between raters, reflecting substantial agreement [36].”
MethodInfluentialRelation of the therapeutic alliance with outcome and other variables: a meta-analytic review
Martin, D. J., Garske, J. P., & Davis, M. K. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.3.438 · Cited by 3,355 · cited 1×
“It has been suggested that adjunct support may leverage the advantages of therapeutic alliance [101,102], which might include principles of persuasion (eg, users feel the need to respond to social cues [18]), it may establish process expectations and social accountability [103], or it may develop a…”
BackgroundRealist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 3×
“We used a multistep approach to data analysis that was structured according to Pawson’s techniques [27,28] and meta-ethnography [43,44] The second step in the analysis involved reciprocal translation analysis, a meta-ethnographic technique that involved reviewing the Context-Mechanism-Outcome…”
MethodNoblit, G., & Hare, R. (1988) · doi:10.4135/9781412985000 · Cited by 2,723
Webb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517 · cited 1×
“Together, these steps led to the generation of 5 candidate Context-Mechanism-Outcome configurations (Multimedia Appendix 1) [30-34].”
BackgroundPersuasive technology: using computers to change what we think and do
Fogg, B. J. (2002) · Ubiquity · doi:10.1145/764008.763957 · Cited by 1,554
Pace, R., Pluye, P., Bartlett, G., Macaulay, A. C., Salsberg, J., Jagosh, J., & Seller, R. (2012) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2011.07.002 · Cited by 1,331 · cited 1×
“The MMAT is a reliable, efficient, and valid tool that provides different sections for assessing studies of qualitative, randomized, nonrandomized studies, descriptive studies, and mixed-method designs [38-40].”
MethodPersuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 7×
“This method would allow for iCBT program use to not only be measured at end of the intervention but also throughout the program access period to assess usage patterns over time [15], when certain design or delivery features may be more or less activated or present.”
BackgroundMethodResultInfluentialAdherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 3×
“However, it was rare to have information on treatment or technology preferences of users (eg, early completers [22,122]), their psychological characteristics or cognitions (eg, motivation, personality, expectations, and treatment perceptions [123]), or personal circumstances (eg, program access…”
BackgroundA Holistic Framework to Improve the Uptake and Impact of eHealth Technologies
van Gemert-Pijnen, J. E., Nijland, N., van Limburg, M., Ossebaard, H. C., Kelders, S. M., Eysenbach, G., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1672 · Cited by 1,126 · cited 1×
“Together, these steps led to the generation of 5 candidate Context-Mechanism-Outcome configurations (Multimedia Appendix 1) [30-34].”
Background
Research works printed but not linked: 10
- Calear, AL, 2010, Med J Aust, 192, S12
- Spence, S, 2016, Internet-based therapies for child adolescent emotional behavioral problems, 197
- Pawson, R, 1997, Realistic Evaluation
- Walker, JL, 2012, Can J Cardiovasc Nurs, 22, 37
- 2013, Diagnostic and Statistical Manual of Mental Disorders, 5th Edition: DSM-5
- Keller, ML, 2011, An Internet Cognitive-Behavioral Skills-Based Program for Child Anxiety
- 10.1111/cpsp.12173 · doi:10.1111/cpsp.12173 · Paper page
- Martin, DJ, 2000, J Consult Clin Psychol, 68, 438, 10.1037/0022-006X.68.3.438 · doi:10.1037/0022-006x.68.3.438 · Paper page
- Eysenbach, G, 2013, Stud Health Technol Inform, 192, 657
- HalkoSKientzJAPersonality and persuasive technology: an exploratory study on health-promoting mobile applications2010International conference on persuasive technologyJune 7, 2010Copenhagen, DenmarkBerlin, HeidelbergSpringer150161
Cited by
Badawy, S. M., & Radovic, A. (2020) · JMIR Pediatrics and Parenting · doi:10.2196/20049 · Cited by 242
“Importantly, these programs showed moderate to high use, especially with adjunct support from coaches, teachers, or therapists, to demonstrate credibility and to help users complete their target behavior [43].”
BackgroundTremain, H., McEnery, C., Fletcher, K., & Murray, G. (2020) · JMIR Mental Health · doi:10.2196/17204 · Cited by 193
Louwen, C., Reidlinger, D. P., & Milne, N. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04003-y · Cited by 136
Methods for Human-Centered eHealth Development: Narrative Scoping Review
Kip, H., Keizer, J., da Silva, M. C., Beerlage-de Jong, N., Köhle, N., & Kelders, S. M. (2022) · Journal of Medical Internet Research · doi:10.2196/31858 · Cited by 67
“Consequently, not all state-of-the-art knowledge on technologies is published at the point of conducting the review [99,158,163,167,172].”
Rachamim, L., Zimmerman-Brenner, S., Rachamim, O., Mualem, H., Zingboim, N., & Rotstein, M. (2022) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-020-01686-2 · Cited by 47
Metadata
- Authors
- Radomski, A. D., Wozney, L., McGrath, P., Huguet, A., Hartling, L., Dyson, M. P., Bennett, K., & Newton, A. S.
- Affiliations
- University of Alberta (CA)
- Izaak Walton Killam Health Centre (CA)
- Dalhousie University (CA)
- McMaster University (CA)
- Corresponding author
- Newton, Amanda S
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-02-05
- Volume
- 21
- Issue
- 2
- Pages
- e11128
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6379818
- OpenAlex
- W2912197217
- Cited by
- 40
- References
- 101
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 5 · 2023: 5 · 2022: 6 · 2021: 9 · 2020: 5 · 2019: 3
- FWCI
- 0.81
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Alberta Innovates
- Canadian Institutes of Health Research
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Clinical Psychology › Psychological Treatments and Assessments
- Keywords
- internet-based cognitive behavioral therapy, child and adolescent anxiety, persuasive system design, program use, medication adherence, dialogue support, social support, personalization, tailoring, anxiety prevention, anxiety treatment, digital mental health interventions, context-mechanism-outcome configurations, meta-ethnography, realist synthesis
- MeSH terms
- Adolescent, Adult, Anxiety, Child, Female, Humans, Male, Cognitive Behavioral Therapy, Telemedicine, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Design and Delivery Features That May Improve the Use of Internet-Based Cognitive Behavioral Therapy for Children and Adolescents With Anxiety: A Realist Literature Synthesis With a Persuasive Systems Design Perspective. https://app.cochat.ai/papers/10.2196/11128
- The paper
- Radomski, A. D., Wozney, L., McGrath, P., Huguet, A., Hartling, L., Dyson, M. P., Bennett, K., & Newton, A. S. (2019). Design and Delivery Features That May Improve the Use of Internet-Based Cognitive Behavioral Therapy for Children and Adolescents With Anxiety: A Realist Literature Synthesis With a Persuasive Systems Design Perspective. Journal of Medical Internet Research. https://doi.org/10.2196/11128
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.