Mechanisms of Change in Digital Health Interventions for Mental Disorders in Youth: Systematic Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index; 14 of the 53 sources its claims cite were checked for support.
Abstract
Background: Digital health interventions (DHIs) are efficacious for several mental disorders in youth; however, integrated, evidence-based knowledge about the mechanisms of change in these interventions is lacking. Objective: This systematic review aims to comprehensively evaluate studies on mediators and mechanisms of change in different DHIs for common mental disorders in children and adolescents. Methods: A systematic literature search of the electronic databases Cochrane Central Register of Controlled Trials, Embase, MEDLINE, and PsycINFO was conducted, complemented by backward and forward searches. Two independent reviewers selected studies for inclusion, extracted the data, and rated the methodological quality of eligible studies (ie, risk of bias and 8 quality criteria for process research). Results: A total of 25 studies that have evaluated 39 potential mediators were included in this review. Cognitive mediators were the largest group of examined intervening variables, followed by a broad range of emotional and affective, interpersonal, parenting behavior, and other mediators. The mediator categories with the highest percentages of significant intervening variables were the groups of affective mediators (4/4, 100%) and combined cognitive mediators (13/19, 68%). Although more than three-quarters of the eligible studies met 5 or more quality criteria, causal conclusions have been widely precluded. Conclusions: The findings of this review might guide the empirically informed advancement of DHIs, contributing to improved intervention outcomes, and the discussion of methodological recommendations for process research might facilitate mediation studies with more pertinent designs, allowing for conclusions with higher causal certainty in the future.
Overview
CoChat Summary
TL;DR
This systematic review synthesized 25 randomized trials or secondary analyses evaluating 39 mediators of digital health interventions for mental disorders in youth. Cognitive mediators were most frequently studied, affective mediators were most consistently significant, but methodological limitations widely precluded causal conclusions.
Key findings
- Across 25 studies with 4884 randomized participants, 39 potential mediators were examined; 21/39 (54%) were significant.
- Cognitive mediators were the largest group (19/39, 48%), with 13/19 (68%) significant; affective/emotional mediators were significant in 4/4 (100%), interpersonal in 1/4 (25%), parenting behavior in 0/4 (0%), and other mediators in 3/8 (38%).
- Methodological quality was limited: 76% (19/25) of studies had high risk of bias, although most met ≥5 of 8 process-research criteria (DHIPSY: 9/13, 69%; DHIHP: 11/12, 92%).
- Only 1/25 (4%) studies evaluated the time sequence of mediator and outcome change, and 2/25 (8%) experimentally manipulated mediators.
Methods
- Systematic review reported per PRISMA and registered with the Open Science Framework; searches covered Cochrane Central Register of Controlled Trials, Embase, MEDLINE, and PsycINFO from inception to May 30, 2020, plus backward and forward searches.
- Eligible studies were RCTs or secondary analyses of RCTs in youth aged 0–21 with mental disorders or clinically relevant symptoms, evaluating predominantly internet-delivered interventions and reporting at least one mediation analysis.
- Two independent reviewers selected studies, extracted data, and rated quality using the Cochrane RoB2 tool and 8 quality criteria for process research; mediators were classified into categories, and a Wilcoxon rank-sum test compared sample sizes between studies with and without significant mediators.
Limitations
- The paper states that the number of eligible studies was small; generalizability may be reduced because most studies were from Western countries, evaluated internet-based interventions, included predominantly female participants, and relied on older participants.
- The paper states that only English-language papers were included, gray literature was not incorporated, publication bias cannot be ruled out, and including only RCTs may have overestimated study quality.
- The paper states that causal conclusions were widely precluded by methodological shortcomings, especially lack of temporal evaluation and experimental manipulation of mediators; it also notes that findings per mediator category are preliminary because of the small number of mediation studies and heterogeneous evidence base.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
10 Valid · 2 Not valid · 24 Not checked · 68 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“In addition, the well-established finding that guided interventions are more efficacious than unguided interventions in adults [21,22] also seems to apply for DHIPSY in youth [12,20].”
§ Mechanisms of Change in Digital Health Interventions for Mental Disorders in Youth: Systematic Review > Introduction > Background
What the sources say
- Supportedcites [21] source
The citation to this review supports the adult-intervention finding, not the separate claim about DHIPSY in youth, which the citing sentence assigns to other references. The Results (§3.2; page unavailable) report a pooled difference in symptom severity favoring guided over unguided interventions, and the Conclusion (§5; page unavailable) describes guidance as increasing efficacy. (LLM, conf=0.93)
- Not checked yetcites [22] source
- Not checked yetcites [12] source
- Not checked yetcites [20] source
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The efficacy of DHIPSY for some common mental disorders in children and adolescents has been established using meta-analyses [12,16-19].”
§ Mechanisms of Change in Digital Health Interventions for Mental Disorders in Youth: Systematic Review > Introduction > Background
What the sources say
- Not checked yetcites [12] source
- Supportedcites [16] source
The paper’s Discussion reports that its meta-analysis provides evidence for the efficacy of computer- and Internet-based CBT for anxiety and depressive symptoms in youth. Those are the common mental-health problems relevant to this citation; the finding concerns these interventions, not all digital health interventions. (LLM, conf=0.91)
- Partly supportedcites [17] sourceExperimental — accuracy not yet measured
The Anxiety and Depression sections report that meta-analysed computerised CBT improved symptoms in young people, though confidence in much of the evidence was low. The Conclusion says it shows promise, not that efficacy is established across digital psychological interventions: evidence is weaker for children and sparse or inconclusive for other computerised therapies. (LLM, conf=0.88)
- Not checked yetcites [18] source
- Partly supportedcites [19] sourceExperimental — accuracy not yet measured
The Results (section 3.3.2; page unavailable) report that internet-delivered CBT was significantly more effective than a waitlist, and the Conclusions (section 4.3; page unavailable) say it may be successfully adapted for psychiatric and somatic conditions in children and adolescents. The paper evaluates internet-delivered CBT specifically, not DHIPSY interventions generally; it also calls for more high-quality studies, so “efficacy ... has been established” overstates its conclusion. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“1 high-quality RCT [58] sets an example, fulfilling 6 out of 8 quality criteria.”
§ Mechanisms of Change in Digital Health Interventions for Mental Disorders in Youth: Systematic Review > Discussion > Principal Findings
What the sources say
- Partly supportedcites [58] sourceExperimental — accuracy not yet measured
Our copy confirms the identifiable core: Kauer et al. (2012) is indeed a randomized controlled trial — Methods > Trial Design describes a 'multicenter, multiregional, stratified... single-blind, attention-controlled study with balanced (1:1) individual randomization' conducted 'adhering to the reporting recommendations from the CONSORT statement', with registered allocation/blinding (Methods > Randomization) and intention-to-treat analysis (Methods > Analyses). However, nothing in our copy reports or claims that the trial 'fulfilled 6 out of 8 quality criteria'; no quality-appraisal checklist or criteria-count appears anywhere (searched: quality criteria/risk of bias appraisal; CONSORT items/blinding/allocation concealment/attrition). If anything, the Discussion (recruitment shortfall to 114 vs the anticipated 200, uneven group numbers, 'reduced power for a direct effect', participant heterogeneity 'likely to have reduced the overall power') documents limitations rather than a self-assessed high-quality rating. The 6-of-8 score is therefore the citing review's own appraisal, supported by this source only as the identity of the trial, not as its stated quality. (LLM, conf=0.70)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“only 4% (1/25) of the studies [47] actually conducted a statistical evaluation of the time sequence of cause and effect.”
§ Mechanisms of Change in Digital Health Interventions for Mental Disorders in Youth: Systematic Review > Discussion > Principal Findings
What the sources say
- Could not verifycites [47] sourceExperimental — accuracy not yet measured
Our copy of de Bruin et al. (2018) is a single RCT of 116 adolescents; nowhere does it report a review or pooling of 25 studies, nor the statistic that only 4% (1/25) statistically evaluated the time sequence of cause and effect. I searched for '4% (1/25)', 'statistical evaluation of the time sequence of cause and effect', 'systematic review of 25 studies', and causal/temporal-direction wording: the closest passages are the Introduction (p. 3) aim statement and the Discussion (pp. 11-12) on the bi-directional insomnia-psychopathology relationship and mediation, which discuss this study's own design and mediation analysis rather than any survey of prior literature. Nothing in our copy supports, contradicts, or credits the quoted figure to another work, so the claim cannot be settled from this source. (LLM, conf=0.75)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“the findings of our review seem to be in line with those of other research [24,44,45,83], pointing to important methodological shortcomings of mediation studies”
§ Mechanisms of Change in Digital Health Interventions for Mental Disorders in Youth: Systematic Review > Discussion > Principal Findings
What the sources say
- Not checked yetcites [24] source
- Supportedcites [44] source
The Discussion says that research on mediators in psychotherapy for depression remains heterogeneous and often methodologically unsatisfactory, despite advances. It identifies demonstrating a causal relation between mediator change and depression improvement as a major challenge. The supplied passages do not provide page numbers. (LLM, conf=0.92)
- Not checked yetcites [45] source
- Not checked yetcites [83] source
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
52 more claims
Create a free account to see all 104 claims and to verify the 39 references still open.
- Probably not a substantial claim. 30
- It may state two separate claims as one. 23
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Many studies remain challenging to interpret given high rates of bias and few using causal methods to assess impact [122].”
From Towards a youth mental health paradigm: a perspective and roadmap (2023) · cites this paper as [122]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Mechanisms of Change in Digital Health Interventions for Mental Disorders in Youth: Systematic Review > Discussion > Principal Findings
“In studies evaluating DHIHP, only cognitive mediators (perceived norm and alcohol-related expectation) were investigated.”
§ Mechanisms of Change in Digital Health Interventions for Mental Disorders in Youth: Systematic Review > Results > Mediators
“| | Alcohol consumption as coping behavior | Alcohol consumption as coping behavior | 1 (4) | 1 (4) | 18-21 | 18-21 | Unguided | Unguided | Risky drinking behavior | Risky drinking behavior | — | — | No | No | (+) | (+) |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Mechanisms of Change in Digital Health Interventions for Mental Disorders in Youth: Systematic Review > Discussion > Principal Findings
“At this point, 1 high-quality RCT [58] sets an example, fulfilling 6 out of 8 quality criteria.”
§ Mechanisms of Change in Digital Health Interventions for Mental Disorders in Youth: Systematic Review > Results > Quality Assessment of Included Studies
“| | Kauer et al [58] | Yes | Yes | Yes | Yes | No | Noh | No | Yes | 5 |”
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
Preacher, K. J., & Hayes, A. F. (2008) · Behavior Research Methods · doi:10.3758/brm.40.3.879 · Cited by 34,117
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
MacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085542 · Cited by 5,688 · cited 1×
“Although various methods for statistical mediation analysis are available (eg, MacKinnon et al [27]), comprising different approaches such as latent growth curve modeling [28] or structural equation modeling [29], the seminal approach of Baron and Kenny [30] is still one of the most applied…”
Age of onset of mental disorders: a review of recent literature
Kessler, R. C., Amminger, G. P., Aguilar-Gaxiola, S., Alonso, J., Lee, S., & ??st??n, T. B. (2007) · Current Opinion in Psychiatry · doi:10.1097/yco.0b013e32816ebc8c · Cited by 3,457
Mental health of young people: A global public-health challenge
Patel, V., Flisher, A. J., Hetrick, S., & McGorry, P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60368-7 · Cited by 3,126 · cited 1×
“Furthermore, the availability of mental health care is often insufficient to adequately meet treatment demands, particularly in rural regions [8] and low-income countries [9].”
Mediators and Moderators of Treatment Effects in Randomized Clinical Trials
Kraemer, H. C., Wilson, G. T., Fairburn, C. G., & Agras, W. S. (2002) · Archives of General Psychiatry · doi:10.1001/archpsyc.59.10.877 · Cited by 2,562 · cited 1×
“…with the so-called causal-steps approach by Baron and Kenny [30] or by more recent methods correcting some of its limitations (eg, Kraemer et al [31]), it is important to consider that mediators might be identical to a mechanism of change (ie, the actual process responsible for change), but…”
Webb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517 · cited 1×
“…on alcohol consumption or other lifestyle and health behaviors, revealed a considerably smaller effect size (Cohen d =0.14, 95% CI 0.00-0.27) [23] when compared with DHI PSY with a genuine psychotherapeutic foundation such as cognitive behavioral therapy (g=0.72, 95% CI 0.55-0.90; P <.001)…”
InfluentialMediators and Mechanisms of Change in Psychotherapy Research
Kazdin, A. E. (2007) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091432 · Cited by 2,504 · cited 4×
“…some of its limitations (eg, Kraemer et al [31]), it is important to consider that mediators might be identical to a mechanism of change (ie, the actual process responsible for change), but might also be a proxy for 1 or more other variables that do not explain the hypothesized mechanism [25].”
InfluentialChild and adolescent mental health worldwide: evidence for action
Kieling, C., Baker-Henningham, H., Belfer, M., Conti, G., Ertem, I., Omigbodun, O., Rohde, L. A., Srinath, S., Ulkuer, N., & Rahman, A. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60827-1 · Cited by 2,449
Compas, B. E., Jaser, S. S., Bettis, A. H., Watson, K. H., Gruhn, M. A., Dunbar, J. P., Williams, E., & Thigpen, J. C. (2017) · Psychological Bulletin · doi:10.1037/bul0000110 · Cited by 1,555 · cited 1×
“…children and adolescents, considering the consistent pattern of significant findings across studies in our review, as well as by allowing for comprehensive earlier research highlighting the overall importance of emotion regulation competencies for mental health in childhood and adolescence [78].”
Iacobucci, D., Saldanha, N., & Deng, X. (2007) · Journal of Consumer Psychology · doi:10.1016/s1057-7408(07)70020-7 · Cited by 1,362
Rebooting psychotherapy research and practice to reduce the burden of mental illness
Kazdin, A. E., & Blase, S. L. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393527 · Cited by 1,254 · cited 1×
“Furthermore, the availability of mental health care is often insufficient to adequately meet treatment demands, particularly in rural regions [8] and low-income countries [9].”
Radez, J., Reardon, T., Creswell, C., Lawrence, P. J., Evdoka-Burton, G., & Waite, P. (2021) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-019-01469-4 · Cited by 1,119 · cited 1×
“However, a substantial proportion of children and adolescents with mental disorders do not receive adequate psychotherapeutic or psychosocial care [4-6] owing to different individual and structural barriers to treatment uptake [7].”
The impact of guidance on Internet-based mental health interventions — A systematic review
Baumeister, H., Reichler, L., Munzinger, M., & Lin, J. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.08.003 · Cited by 1,037
Self-citationEstimating and testing mediation and moderation in within-subject designs.
Judd, C. M., Kenny, D. A., & McClelland, G. H. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.2.115 · Cited by 846
Hollis, C., Falconer, C. J., Martin, J. L., Whittington, C., Stockton, S., Glazebrook, C., & Davies, E. B. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12663 · Cited by 846 · cited 3×
“Current empirical knowledge suggests that older children and adolescents benefit more from DHI PSY than younger children [12,20].”
The COVID-19 pandemic: the ‘black swan’for mental health care and a turning point for e-health
Wind, T. R., Rijkeboer, M., Andersson, G., & Riper, H. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100317 · Cited by 782
Kazdin, A. E., & Nock, M. K. (2003) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00195 · Cited by 774
Whitney, D. G., & Peterson, M. D. (2019) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2018.5399 · Cited by 770
Internet-delivered psychological treatments: from innovation to implementation
Andersson, G., Titov, N., Dear, B. F., Rozental, A., & Carlbring, P. (2019) · World Psychiatry · doi:10.1002/wps.20610 · Cited by 750 · cited 1×
“Although research on DHIs is a fast growing field [36] and might also offer intriguing opportunities for psychotherapeutic process research [24,37], we are not aware of any systematic review of the mediators and mechanisms of change in DHI PSY and DHI HP for common mental disorders in youth…”
The Role of Common Factors in Psychotherapy Outcomes
Cuijpers, P., Reijnders, M., & Huibers, M. J. H. (2019) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050718-095424 · Cited by 748 · cited 1×
“…literature searches, a finding that corresponds to the limited evidence base of research on mechanisms of change in psychotherapy in general [37,74], and for children and adolescents in specific [24,35,37], necessitating further high-quality research efforts to improve interventions and mental…”
Erskine, H. E., Moffitt, T. E., Copeland, W. E., Costello, E. J., Ferrari, A. J., Patton, G., Degenhardt, L., Vos, T., Whiteford, H. A., & Scott, J. G. (2015) · Psychological Medicine · doi:10.1017/s0033291714002888 · Cited by 688
Dropout from Internet‐based treatment for psychological disorders
Melville, K. M., Casey, L. M., & Kavanagh, D. J. (2010) · British Journal of Clinical Psychology · doi:10.1348/014466509x472138 · Cited by 597 · cited 1×
“Although the current mean dropout rate in this review is rather small compared with other high dropout rates found in DHIs, the well-known issue of limited engagement still warrants future research to further investigate approaches to remedy (study and intervention) attrition [84,85].”
Torous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546
Ebert, D. D., Zarski, A.-C., Christensen, H., Stikkelbroek, Y., Cuijpers, P., Berking, M., & Riper, H. (2015) · PLOS ONE · doi:10.1371/journal.pone.0119895 · Cited by 533 · cited 2×
“…on alcohol consumption or other lifestyle and health behaviors, revealed a considerably smaller effect size (Cohen d =0.14, 95% CI 0.00-0.27) [23] when compared with DHI PSY with a genuine psychotherapeutic foundation such as cognitive behavioral therapy (g=0.72, 95% CI 0.55-0.90; P <.001) [16].”
InfluentialPsychotherapy for Children and Adolescents
Kazdin, A. E. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145105 · Cited by 462
Costello, E. J., He, J.-P., Sampson, N. A., Kessler, R. C., & Merikangas, K. R. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201100518 · Cited by 441
Kauer, S. D., Reid, S. C., Crooke, A. H. D., Khor, A., Hearps, S. J. C., Jorm, A. F., Sanci, L., & Patton, G. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1858 · Cited by 404
Berger, T. (2017) · Psychotherapy Research · doi:10.1080/10503307.2015.1119908 · Cited by 364 · cited 1×
“…from (1) pure self-help interventions without any human support (so-called unguided interventions ) to (2) interventions with some support ( guided interventions ), to (3) videoconference-based psychotherapy with the internet as the sole communication medium between therapists and patients [15].”
Hartling, L., Featherstone, R., Nuspl, M., Shave, K., Dryden, D. M., & Vandermeer, B. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0347-z · Cited by 324
Vigerland, S., Lenhard, F., Bonnert, M., Lalouni, M., Hedman, E., Ahlen, J., Olén, O., Serlachius, E., & Ljótsson, B. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.09.005 · Cited by 292 · cited 2×
“For example, Vigerland et al [19] evaluated the efficacy of internet-based cognitive behavioral therapy for a range of mental disorders, including anxiety, depression, behavioral problems, obsessive-compulsive disorder, and some somatic disorders such as chronic pain and insomnia.”
Research-informed psychotherapy
Grawe, K. (1997) · Psychotherapy Research · doi:10.1080/10503309712331331843 · Cited by 269 · cited 1×
“Second, the therapeutic or working alliance (ie, the professional relationship between therapists and patients; eg, Grawe et al [90]) was not evaluated as a mediator in any of the included studies.”
Pennant, M. E., Loucas, C. E., Whittington, C., Creswell, C., Fonagy, P., Fuggle, P., Kelvin, R., Naqvi, S., Stockton, S., & Kendall, T. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.01.009 · Cited by 269
A Controlled Trial of Web-Based Feedback for Heavy Drinking College Students
Walters, S. T., Vader, A. M., & Harris, T. R. (2007) · Prevention Science · doi:10.1007/s11121-006-0059-9 · Cited by 256
Beyond linear mediation: Toward a dynamic network approach to study treatment processes
Hofmann, S. G., Curtiss, J. E., & Hayes, S. C. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101824 · Cited by 232 · cited 1×
“Furthermore, future studies should resort to more sophisticated and current methods of mediation analysis (eg, Grimm et al [88] and Hofmann et al [89]), ideally capable of clarifying temporal precedence and illustrating the actual pattern of change [24].”
Mailed personalized normative feedback as a brief intervention for at-risk college drinkers.
Collins, S. E., Carey, K. B., & Sliwinski, M. J. (2002) · Journal of Studies on Alcohol · doi:10.15288/jsa.2002.63.559 · Cited by 226
Mechanisms of action in youth psychotherapy
Weersing, V. R., & Weisz, J. R. (2002) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00002 · Cited by 224 · cited 1×
“For example, 2 systematic reviews dedicated to evaluating the mechanisms of change found that only a small number of eligible primary studies actually conducted mediation analyses, with only 9% (6/67) [33] and 17% (8/46) of included clinical trials [34] attempting to evaluate mediation effects.”
Domhardt, M., Geßlein, H., von Rezori, R. E., & Baumeister, H. (2019) · Depression and Anxiety · doi:10.1002/da.22860 · Cited by 218 · cited 1×
“In addition, the well-established finding that guided interventions are more efficacious than unguided interventions in adults [21,22] also seems to apply for DHI PSY in youth [12,20].”
Self-citationEfficacy of web-based personalized normative feedback: A two-year randomized controlled trial.
Neighbors, C., Lewis, M. A., Atkins, D. C., Jensen, M. M., Walter, T., Fossos, N., Lee, C. M., & Larimer, M. E. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0020766 · Cited by 214
Lemmens, L. H. J. M., Müller, V. N. L. S., Arntz, A., & Huibers, M. J. H. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.09.004 · Cited by 211
Levin, M. E., Haeger, J. A., Pierce, B. G., & Twohig, M. P. (2017) · Behavior Modification · doi:10.1177/0145445516659645 · Cited by 207
Reid, A. E., & Carey, K. B. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.06.006 · Cited by 185
Cochrane’s risk of bias tool in the context of psychotherapy outcome research
Munder, T., & Barth, J. (2018) · Psychotherapy Research · doi:10.1080/10503307.2017.1411628 · Cited by 174
Forehand, R., Lafko, N., Parent, J., & Burt, K. B. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.10.001 · Cited by 164
The mediating role of insight for long-term improvements in psychodynamic therapy.
Johansson, P., Høglend, P. A., Ulberg, R., Amlo, S., Marble, A., Bøgwald, K., Sørbye, Ø., Sjaastad, M. C., & Heyerdahl, O. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019245 · Cited by 157
Baumel, A., Pawar, A. K. S., Kane, J. M., & Correll, C. U. (2016) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2016.0048 · Cited by 154
Self-citationDigital mental health apps and the therapeutic alliance: initial review
Henson, P., Wisniewski, H., Hollis, C., Keshavan, M., & Torous, J. (2019) · BJPsych Open · doi:10.1192/bjo.2018.86 · Cited by 152 · cited 1×
“However, the recent development of the working alliance inventory for digital interventions [91] may contribute to future process research, informing the evidence base of the effects of a digital therapeutic alliance in DHIs for youth [37,92].”
Christ, C., Schouten, M. J., Blankers, M., van Schaik, D. J., Beekman, A. T., Wisman, M. A., Stikkelbroek, Y. A., & Dekker, J. J. (2020) · Journal of Medical Internet Research · doi:10.2196/17831 · Cited by 148 · cited 1×
“…RoB assessment indicated a rather limited overall study quality, with 76% (19/25) of the included studies rated with a high RoB, a finding that aligns with the review by Christ et al [81], in which 92% (22/24) included studies on DHIs for adolescents and young adults were assessed with a high RoB .”
Thabrew, H., Stasiak, K., Hetrick, S. E., Wong, S., Huss, J. H., & Merry, S. N. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012489.pub2 · Cited by 141 · cited 1×
“The search strings were built on established prior search strings [24,40] further adapted to specifically meet the research questions at hand and modified for each database in Ovid (for details on all search strings, see Multimedia Appendix 1).”
Mediation Analysis in a Latent Growth Curve Modeling Framework
von Soest, T., & Hagtvet, K. A. (2011) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2011.557344 · Cited by 134
Evaluation of two Web-based alcohol interventions for mandated college students
Doumas, D. M., McKinley, L. L., & Book, P. (2009) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2008.05.009 · Cited by 133
Evaluating an online stress management intervention for college students.
Hintz, S., Frazier, P. A., & Meredith, L. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000014 · Cited by 128 · cited 3×
“Furthermore, 8% (2/25) of the studies, Hintz et al [56] and Jouriles et al [57] implemented direct experimental manipulation of mediators.”
Lewis, M. A., Patrick, M. E., Litt, D. M., Atkins, D. C., Kim, T., Blayney, J. A., Norris, J., George, W. H., & Larimer, M. E. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0035550 · Cited by 108
Domhardt, M., Steubl, L., Boettcher, J., Buntrock, C., Karyotaki, E., Ebert, D. D., Cuijpers, P., & Baumeister, H. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101953 · Cited by 106 · cited 9×
“…is because evidence-based knowledge on the mediators and mechanisms of change (specific for different approaches of DHI PSY and DHI HP ) can inform intervention development and mental health care practices, illustrating pathways to more powerful intervention packages and improved outcomes [24-26].”
InfluentialSelf-citationMurphy, J. G., Dennhardt, A. A., Skidmore, J. R., Martens, M. P., & McDevitt-Murphy, M. E. (2010) · Psychology of Addictive Behaviors · doi:10.1037/a0021347 · Cited by 102 · cited 1×
“The so-called e-CHUG tool was evaluated in 33% (4/12) of the studies [51,57,62,68].”
Anderson, R. E. E., Spence, S. H., Donovan, C. L., March, S., Prosser, S., & Kenardy, J. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1848 · Cited by 102 · cited 4×
“Altogether, data from 25 ( k =25) publications were analyzed [46-70].”
InfluentialSpence, S. H., Donovan, C. L., March, S., Kenardy, J. A., & Hearn, C. S. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.12.003 · Cited by 101
Domhardt, M., Steubl, L., & Baumeister, H. (2020) · Zeitschrift für Kinder- und Jugendpsychiatrie und Psychotherapie · doi:10.1024/1422-4917/a000625 · Cited by 101 · cited 6×
“Here, all interventions for children were conducted with the involvement of parents, suggesting a crucial role of the accompanying human support in DHIs for younger children, which must be corroborated and further specified by forthcoming research [12,79].”
InfluentialSelf-citationDigital Phenotyping and Mobile Sensing
Baumeister, H., & Montag, C. (2019) · Studies in neuroscience, psychology and behavioral economics · doi:10.1007/978-3-030-31620-4 · Cited by 101
Self-citationde Bruin, E. J., Bögels, S. M., Oort, F. J., & Meijer, A. M. (2018) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12834 · Cited by 95
Randomized Clinical Trial of Online Parent Training for Behavior Problems After Early Brain Injury
Wade, S. L., Cassedy, A. E., Shultz, E. L., Zang, H., Zhang, N., Kirkwood, M. W., Stancin, T., Yeates, K. O., & Taylor, H. G. (2017) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2017.09.413 · Cited by 92
A Meta-Analysis on the Efficacy of Technology Mediated CBT for Anxious Children and Adolescents
Podina, I. R., Mogoase, C., David, D., Szentagotai, A., & Dobrean, A. (2016) · Journal of Rational-Emotive & Cognitive-Behavior Therapy · doi:10.1007/s10942-015-0228-5 · Cited by 83
Herrero, R., Vara, M. D., Miragall, M., Botella, C., García-Palacios, A., Riper, H., Kleiboer, A., & Baños, R. M. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17176169 · Cited by 81
A randomized clinical trial of a brief, mailed intervention for symptoms of depression.
Geisner, I. M., Neighbors, C., & Larimer, M. E. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.2.393 · Cited by 77
Lin, J., Ebert, D. D., Lehr, D., Berking, M., & Baumeister, H. (2013) · Die Rehabilitation · doi:10.1055/s-0033-1343491 · Cited by 70
Self-citationDenis, D., Eley, T. C., Rijsdijk, F. V., Zavos, H. M. S., Keers, R., Espie, C. A., Luik, A. I., Badini, I., Derveeuw, S., Hodsoll, J. P., et al. (2019) · Sleep Medicine · doi:10.1016/j.sleep.2019.10.007 · Cited by 63
Latent Growth and Dynamic Structural Equation Models
Grimm, K. J., & Ram, N. (2018) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050817-084840 · Cited by 61
Doumas, D. M., Workman, C. R., Smith, D. M. Y., & Navarro, A. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2010.12.006 · Cited by 53
Moreno-Peral, P., Bellón, J. Á., Huibers, M. J. H., Mestre, J. M., García-López, L. J., Taubner, S., Rodríguez-Morejón, A., Bolinski, F., Sales, C. M. D., & Conejo-Cerón, S. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101813 · Cited by 51 · cited 2×
“Taken together, the findings of our review seem to be in line with those of other research [24,44,45,83], pointing to important methodological shortcomings of mediation studies, which should be amended by future research.”
Mental health care use in adolescents with and without mental disorders
Jörg, F., Visser, E., Ormel, J., Reijneveld, S. A., Hartman, C. A., & Oldehinkel, A. J. (2015) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-015-0754-9 · Cited by 46
Ghaderi, A., Kadesjö, C., Björnsdotter, A., & Enebrink, P. (2018) · Scientific Reports · doi:10.1038/s41598-018-29550-z · Cited by 46
Efficacy of digital health interventions in youth with chronic medical conditions: A meta-analysis
Domhardt, M., Schröder, A., Geirhos, A., Steubl, L., & Baumeister, H. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100373 · Cited by 45 · cited 1×
“Here, all interventions for children were conducted with the involvement of parents, suggesting a crucial role of the accompanying human support in DHIs for younger children, which must be corroborated and further specified by forthcoming research [12,79].”
Self-citationMore Light? Opportunities and Pitfalls in Digitalized Psychotherapy Process Research
Domhardt, M., Cuijpers, P., Ebert, D. D., & Baumeister, H. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.544129 · Cited by 41 · cited 5×
“Although research on DHIs is a fast growing field [36] and might also offer intriguing opportunities for psychotherapeutic process research [24,37], we are not aware of any systematic review of the mediators and mechanisms of change in DHI PSY and DHI HP for common mental disorders in youth…”
InfluentialSelf-citationDunn, M. E., Fried, A., Flori, J. N., Hall, T. V., & Dvorak, R. D. (2019) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000290 · Cited by 35
Schmidt, S. J., & Schimmelmann, B. G. (2015) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-015-0698-0 · Cited by 33 · cited 4×
“…to the limited evidence base of research on mechanisms of change in psychotherapy in general [37,74], and for children and adolescents in specific [24,35,37], necessitating further high-quality research efforts to improve interventions and mental health care practices for this younger age group.”
InfluentialBaumel, A., Mathur, N., Pawar, A. K. S., & Muench, F. J. (2021) · Journal of Child and Family Studies · doi:10.1007/s10826-020-01863-6 · Cited by 33
Self-citationDomhardt, M., Nowak, H., Engler, S., Baumel, A., Grund, S., Mayer, A., Terhorst, Y., & Baumeister, H. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102084 · Cited by 32
Self-citationYoung, C. M., & Neighbors, C. (2019) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.13995 · Cited by 31
Jouriles, E. N., Brown, A. S., Rosenfield, D., McDonald, R., Croft, K., Leahy, M. M., & Walters, S. T. (2010) · Psychology of Addictive Behaviors · doi:10.1037/a0020830 · Cited by 26
Ng, M. Y., DiVasto, K. A., Cootner, S., Gonzalez, N.-A.-R., & Weisz, J. R. (2023) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12367 · Cited by 25
Riley, A. R., Duke, D. C., Freeman, K. A., Hood, K. K., & Harris, M. A. (2015) · Diabetes Care · doi:10.2337/dc14-2519 · Cited by 24
van der Zanden, R. A., Galindo‐Garre, F., Curie, K., Kramer, J., & Cuijpers, P. J. (2013) · Psychological Medicine · doi:10.1017/s003329171300175x · Cited by 23
Meta‐analytic structural equation modeling
(2015) · Wiley eBooks · doi:10.1002/9781118957813.ch7 · Cited by 23
Gilmore, A. K., & Bountress, K. E. (2016) · Addictive Behaviors · doi:10.1016/j.addbeh.2016.05.007 · Cited by 19
Internet- und Mobilebasierte Interventionen in der Psychotherapie
Lin, J., & Baumeister, H. (2015) · Public Health Forum · doi:10.1515/pubhef-2015-0063 · Cited by 19 · cited 1×
“DHIs can be distinguished and characterized based on their theoretical basis, the type of technical implementation, the area of application, and the extent of accompanying human support [13,14].”
Self-citationThabrew, H., Stasiak, K., Hetrick, S. E., Wong, S., Huss, J. H., & Merry, S. N. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012489 · Cited by 18
Wilksch, S. M., O’Shea, A. E., & Wade, T. D. (2018) · International Journal of Eating Disorders · doi:10.1002/eat.23005 · Cited by 14
LaFreniere, L. S., & Newman, M. G. (2019) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2019.102113 · Cited by 14
Research works printed but not linked: 1
- 2018, The State of the World's Children 2017 Children in a Digital World
Cited by
Towards a youth mental health paradigm: a perspective and roadmap
Uhlhaas, P. J., Davey, C. G., Mehta, U. M., Shah, J., Torous, J., Allen, N. B., Avenevoli, S., Bella-Awusah, T., Chanen, A., Chen, E. Y. H., et al. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02202-z · Cited by 318
“Many studies remain challenging to interpret given high rates of bias and few using causal methods to assess impact [122].”
BackgroundYeo, G., Reich, S. M., Liaw, N. A., & Chia, E. Y. M. (2023) · Journal of Medical Internet Research · doi:10.2196/51268 · Cited by 168
“By building knowledge, beliefs, and attitudes regarding mental health, DMHL interventions may have adaptive functions that influence other domains or levels of function (eg, behavior change in treatment uptake and adherence) that spread over time to promote positive mental health development [94].”
InfluentialGlobal youth perspectives on digital health promotion: a scoping review
Ferretti, A., Hubbs, S., & Vayena, E. (2023) · BMC Digital Health · doi:10.1186/s44247-023-00025-0 · Cited by 76
“Review topics range from sexual and reproductive health [22] to mental health [23] and nutrition and physical activity [24, 25], with several studies focused on youth in LMICs [2, 26, 27].”
BackgroundWrightson‐Hester, A., Anderson, G., Dunstan, J., McEvoy, P. M., Sutton, C., MYERS, B. J., Egan, S. J., Tai, S., Johnston-Hollitt, M., Chen, W., et al. (2023) · JMIR Human Factors · doi:10.2196/46849 · Cited by 50
“Therefore, more research is needed to demonstrate the efficacy of conversational agents, including greater transparency and evaluation of the proposed mechanisms of action used [10,22].”
BackgroundGeirhos, A., Domhardt, M., Lunkenheimer, F., Temming, S., Holl, R. W., Minden, K., Warschburger, P., Meissner, T., Mueller-Stierlin, A. S., & Baumeister, H. (2022) · BMC Pediatrics · doi:10.1186/s12887-022-03134-3 · Cited by 37
“Another important aspect in regard to adherence might be parental involvement [77, 78].”
BackgroundSelf-citation
Metadata
- Authors
- Domhardt, M., Engler, S., Nowak, H., Lutsch, A., Baumel, A., & Baumeister, H.
- Affiliations
- Universität Ulm (DE)
- University of Haifa (IL)
- Corresponding author
- Domhardt, Matthias
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-11-26
- Volume
- 23
- Issue
- 11
- Pages
- e29742
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC8665396
- OpenAlex
- W3217071360
- Cited by
- 41
- References
- 93
- Citations by year
- 2026: 7 · 2025: 8 · 2024: 11 · 2023: 10 · 2022: 5
- FWCI
- 1.01
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Bundesministerium für Bildung und Forschung
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- digital health interventions, mechanisms of change, mediators, adolescent mental disorders, children and adolescents, cognitive mediators, parental behavior, process research, causal inference
- MeSH terms
- Adolescent, Mental Disorders, Child, Humans, Parenting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


