The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 159 of the 159 references it cites were found in a registry or an index; 35 of the 169 sources its claims cite were checked for support.
Abstract
Background: Digital mental health interventions offer unique advantages, and research indicates that these interventions are effective for a range of mental health concerns. Although these interventions are less established for individuals with serious mental illnesses, they demonstrate significant promise. A central consideration in traditional face-to-face therapies is the therapeutic alliance, whereas the nature of a digital therapeutic alliance and its relationship with outcomes requires further attention, particularly for individuals with serious mental illnesses. Objective: This narrative review aims to encourage further consideration and critical evaluation of the therapeutic alliance in digital mental health, specifically for individuals with serious mental illnesses. Methods: A narrative review was conducted by combining 3 main areas of the literature: the first examining the evidence for digital mental health interventions for serious mental illnesses, the second illuminating the nature and role of the therapeutic alliance in digital interventions, and the third surrounding practical considerations to enhance a digital therapeutic alliance. Results: Results indicated that a therapeutic alliance can be cultivated in digital interventions for those with serious mental illnesses, but that it may have unique, yet-to-be-confirmed characteristics in digital contexts. In addition, a therapeutic alliance appears to be less directly associated with outcomes in digital interventions than with those in face-to-face therapies. One possibility is that the digital therapeutic alliance is associated with increased engagement and adherence to digital interventions, through which it appears to influence outcomes. A number of design and implementation considerations may enhance the digital therapeutic alliance, including human support and technological features. Conclusions: More research is required to further understand the nature and specific role of a therapeutic alliance in digital interventions for serious mental illnesses, particularly in informing their design. This review revealed several key research priorities to advance the therapeutic alliance in digital interventions.
Overview
CoChat Summary
TL;DR
This narrative review argues that a therapeutic alliance can be cultivated in digital mental health interventions for serious mental illnesses, but its nature and role may differ from face-to-face therapy. It concludes that the digital alliance may be less directly linked to outcomes and may instead influence outcomes through engagement and adherence, with human support and persuasive design features as potential enhancers.
Key findings
- A therapeutic alliance can be experienced in digital interventions, including in a small number of samples with serious mental illnesses, but it may have unique, yet-to-be-confirmed characteristics in digital contexts.
- Evidence for a direct alliance–outcome link in digital interventions is conflicting: a systematic review found an association only in 3 supported-intervention studies, while multiple supported and unsupported studies found no association; no evidence of such an association was found in unsupported digital interventions.
- The review suggests the digital therapeutic alliance may be associated with increased engagement and adherence, which in turn influence outcomes; across the few studies considering this, all reported an association between alliance and engagement/adherence.
- Human support appears beneficial for alliance, engagement, and adherence, but is not always feasible or desirable; design features such as tailoring/personalization, dialogue support, credibility support, and social support may help cultivate a digital therapeutic alliance.
Methods
- Narrative review integrating 3 literature areas: digital mental health interventions for serious mental illnesses, the therapeutic alliance in digital interventions, and practical considerations to enhance a digital therapeutic alliance.
- Focus on intervention studies with participants with psychotic spectrum or bipolar disorder or any author-defined serious mental illness, drawing on broader mental health literature where minimal SMI data exist; excluded contexts where a human delivers the majority of the intervention, web-delivered traditional face-to-face therapy, and blended therapy.
- No systematic search methods or formal bias/quality assessment were used; findings are presented as a broad integration of relevant literature to identify gaps.
Limitations
- Stated: no systematic search methods or formal bias and quality assessment, creating a significant risk of selection bias; included studies cannot be presumed to represent the available literature, and firm conclusions are not warranted.
- Stated: many included analyses were secondary analyses and many were underpowered due to sample size, inflating type I and type II error risk; conceptual issues may also affect results, such as how social withdrawal, mistrust, or paranoia could interact with engagement and alliance.
- Evident from the text: minimal data were available for serious mental illnesses on alliance–outcome and engagement/adherence relationships; alliance measurement was heterogeneous, measured at different times, and engagement/adherence were often used interchangeably or poorly defined, limiting conclusions.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
21 Valid · 7 Not valid · 97 Not checked · 44 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, developing digital interventions for individuals experiencing serious mental illnesses can introduce additional challenges because of illness-related factors, such as cognitive impairments or mistrust, thus requiring specific design considerations [12,16].”
§ The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review > Results > Specific Benefits of Digital Interventions for Serious Mental Illnesses
What the sources say
- Partly supportedcites [12] sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Partly supportedcites [16] sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“3 meta-analyses demonstrated that supported digital interventions for a range of mental health concerns were comparable in efficacy (moderate effect sizes) with face-to-face psychological interventions [20-22].”
§ The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review > Results > Effectiveness of Digital Interventions
What the sources say
- Not checked yetcites [20] source
- Partly supportedcites [21] sourceExperimental — accuracy not yet measured
Our copy does carry the core comparative point for supported (therapist-guided) online interventions: the Abstract and the anxiety Results state effect sizes of 0.7–1.7 for therapist-assisted interventions with 'efficacy similar to face-to-face CBT', and the Discussion adds that they were 'at least as large as standard psychological treatment (0.31) in primary care'. However, three elements of the claim are not supported by this paper: (1) it is a systematic review, not a meta-analysis — the Discussion states that differences in study groups, interventions and periods made generating a pooled standardized mean difference impossible; (2) its scope is depression and anxiety disorders only (panic disorders and phobias explicitly excluded in the anxiety Methods/Results), not 'a range of mental health concerns'; (3) the effect sizes it reports for supported interventions are described as large/robust (0.6–1.9 for therapist-guided depression CBT; 0.7–1.7 for anxiety), with 'modest' reserved for stand-alone, unguided interventions (0.3–0.7). The explicit 'as effective as face-to-face psychotherapy' framing in the Introduction is credited to other works it reviews (Titov, 2011; Reger & Gahm, 2009), though this paper adopts and relies on the comparison in its own Discussion. (LLM, conf=0.72)
- Not checked yetcites [22] source
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“Similarly, Berry et al [55] adapted the ARM for digital contexts by consulting end users and mental health professionals.”
§ The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review > Results > Therapeutic Alliance
What the sources say
- Supportedcites [55] source
The Abstract Methods and Methods ('Stage 3: Development of the Mobile Agnew Relationship Measure (mARM)') state that the ARM was adapted for the mHealth/digital context using ratings and wording suggestions from service users and mental health staff, filtered through a decision-making algorithm on which items to retain, drop or reword. The Discussion ('Contextualizing Findings Within Existing Literature') likewise refers to 'our adaptions to the ARM items' and to what 'service users and staff in our study found hard to relate to'. Both parts of the claim — adaptation of the ARM for digital contexts and consultation of end users plus mental health professionals — are therefore stated in our copy. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“However, it should be noted that some studies involving direct comparisons of supported and unsupported interventions have failed to demonstrate significant differences in effectiveness and/or adherence [89-91]”
§ The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review > Results > Therapeutic Alliance
What the sources say
- Supportedcites [89] source
Titov et al. (2015) is precisely such a direct comparison: the Discussion (p. null) states 'A surprising finding from the present study was that no consistent differences were observed between the clinical outcomes of participants receiving weekly clinician contact and those who received treatment in a self-guided format,' and that these findings are 'inconsistent with results of reviews that have found that clinician-guided treatment is associated with better adherence and treatment outcomes than self-guided interventions.' Section 3.3.4 (Treatment completion and satisfaction rates) reports no difference in lessons completed between CG-CBT and SG-CBT (F1,288 = 3.59, p = .059) and no significant differences in satisfaction/recommendation, and the Discussion summary (p. null) notes 'Treatment completion rates were also similar across the groups.' A minor caveat is that the paper defines its self-guided arm as preceded by an initial therapist interview with monitoring, rather than fully automated unsupported treatment, but this does not alter that the trial found no significant differences in effectiveness or adherence between supported and unsupported delivery. (LLM, conf=0.88)
- Not checked yetcites [90] source
- Supportedcites [91] source
The Discussion 'Summary of main results' states that 'results also generally showed no difference in outcomes following therapist-supported ICBT versus unguided CBT at posttreatment', and Implications for research credits this to the directly comparing studies ('the studies included in our comparison of therapist-supported ICBT versus unguided CBT ... suggest no difference in treatment outcome between the two interventions'). Section 2 documents the five head-to-head trials (Titov 2008c; Furmark 2009a/b; Berger 2011; Greist 2012) with non-significant effect estimates (e.g. 2.4 quality of life SMD 0.07, 95% CI -0.37 to 0.50; Berger 2011 16/27 vs 15/27), and 'Quality of the evidence' adds 'generally quite similar rates of dropout across the interventions investigated (experimental and comparator)', covering the adherence limb of the 'and/or' claim. As a meta-analysis it reports rather than originates these study results, which the rubric accepts. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The findings of multiple meta-analytic and systematic reviews suggest that digital interventions with support tend to have greater effect sizes than those without human support [21,79-83] for outcomes, including depression and anxiety symptoms, and general well-being.”
§ The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review > Results > Therapeutic Alliance
What the sources say
- Partly supportedcites [21] sourceExperimental — accuracy not yet measured
The Introduction reports that a prior meta-analysis found larger effect sizes for therapist-supported than unsupported interventions. In its sections on depression and anxiety interventions (page unavailable), this review reports larger effect sizes for guided depression CBT, but says the anxiety studies are too few to compare reliably. It does not establish the claimed difference for general well-being. (LLM, conf=0.87)
- Not checked yetcites [79] source
- Not checked yetcites [80] source
- Partly supportedcites [81] sourceExperimental — accuracy not yet measured
Section 3.2 reports a pooled symptom-severity effect favoring guided over unguided interventions, including trials involving depression and social phobia. The paper does not report general well-being as an outcome of that comparison, so it supports the symptom claim but not that example. (LLM, conf=0.86)
- Not checked yetcites [82] source
- Could not verifycites [83] sourceExperimental — accuracy not yet measured
The prompt contains no matching passage. Searches for therapist support, effect sizes, and well-being returned no full-text passages; the only matches were abstract or metadata text, which cannot serve as evidence under the stated rules. The claim therefore cannot be verified from the available passages of our copy. (LLM, conf=0.65)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
88 more claims · 12 with their cited sources checked
Create a free account to see all 169 claims and to verify the 134 references still open.
- It may state two separate claims as one. 64
- Probably not a substantial claim. 21
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“meta-analyses indicate no impairment of the therapeutic alliance by digital mental health interventions of various types (Berger, 2017; Seuling et al., 2023; Tremain et al., 2020)”
From Virtual Reality exposure therapy in the treatment of public speaking anxiety and social anxiety disorder (2024) · cites this paper as Tremain et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Recent narrative reviews have highlighted the importance of combining digital health interventions with human support in a bid to cultivate digital alliances, thereby promoting engagement and effectiveness (Tremain et al., 2020).”
From Therapeutic games to reduce anxiety and depression in young people: A systematic review and exploratory meta‐analysis of their use and effectiveness. (2024) · cites this paper as Tremain et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review > Results > Therapeutic Alliance
“In a further supported intervention, the WAI-Tech goal and bond subscales were positively correlated with the number of modules completed [53].”
§ The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review > Results > Therapeutic Alliance
“In another study, ratings on the WAI-Tech for a digital intervention were similar to those on the WAI in a face-to-face (treatment as usual) group but were not associated with the outcome: cocaine abstinence [53].”
Citations
Cites
The Elaboration Likelihood Model of Persuasion
Petty, R. E., & Cacioppo, J. T. (1986) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60214-2 · Cited by 8,822
The generalizability of the psychoanalytic concept of the working alliance.
Bordin, E. S. (1979) · Psychotherapy: Theory, Research & Practice · doi:10.1037/h0085885 · Cited by 5,238 · cited 4×
“How the definition by Bordin [39] on therapeutic alliance can apply to unsupported interventions is not yet clear, but it has been suggested that therapeutic goals and therapeutic task components (or analogs thereof) may be cultivated within interactions between users and the intervention, while the bond element may b…”
BackgroundMethodInfluentialDevelopment and validation of the working alliance inventory
Horvath, A. O., & Greenberg, L. S. (1989) · Journal of Counseling Psychology · doi:10.1037//0022-0167.36.2.223 · Cited by 3,520
Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review
Martin, D. J., Garske, J. P., & Davis, M. K. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.3.438 · Cited by 3,355
Client-centered therapy; its current practice, implications, and theory.
Miles, D. W. (1952) · Psychological Bulletin · doi:10.1037/h0053095 · Cited by 2,112
Alliance in individual psychotherapy
Horvath, A. O., Del Re, A. C., Flückiger, C., & Symonds, D. (2011) · Psychotherapy · doi:10.1037/a0022186 · Cited by 2,072
Yatham, L. N., Kennedy, S. H., Parikh, S. V., Schaffer, A., Bond, D. J., Frey, B. N., Sharma, V., Goldstein, B. I., Rej, S., Beaulieu, S., et al. (2018) · Bipolar Disorders · doi:10.1111/bdi.12609 · Cited by 1,852 · cited 1×
“The current Canadian Network for Mood and Anxiety Treatments and International Society for Bipolar Disorders treatment guidelines conclude that, to date, there is insufficient evidence to support the use of digital interventions as adjunctive therapies for BD [33].”
BackgroundThe alliance in adult psychotherapy: A meta-analytic synthesis
Flückiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018) · Psychotherapy · doi:10.1037/pst0000172 · Cited by 1,763
Persuasive Systems Design: Key Issues, Process Model, and System Features
Oinas-Kukkonen, H., & Harjumaa, M. (2009) · Communications of the Association for Information Systems · doi:10.17705/1cais.02428 · Cited by 1,663
Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · cited 1×
“The findings of multiple meta-analytic and systematic reviews suggest that digital interventions with support tend to have greater effect sizes than those without human support [21,79-83] for outcomes, including depression and anxiety symptoms, and general well-being.”
BackgroundComputer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442
Virtual Reality in the Assessment, Understanding, and Treatment of Mental Health Disorders
Freeman, D., Reeve, S., Robinson, A., Ehlers, A., Clark, D., Spanlang, B., & Slater, M. (2017) · Psychological Medicine · doi:10.1017/s003329171700040x · Cited by 1,428
What is user engagement? A conceptual framework for defining user engagement with technology
O'Brien, H. L., & Toms, E. G. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20801 · Cited by 1,397
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 6×
“Theoretically, individuals will be more motivated to perform a target behavior if they can use a system to observe (eg, social facilitation) or compare themselves (eg, social comparison) with others performing the behavior and if they are provided with a means to cooperate or connect [94,121].”
BackgroundInfluentialBarak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008) · Journal of Technology in Human Services · doi:10.1080/15228830802094429 · Cited by 1,283 · cited 2×
“The frequency and type of support also ranges, but most frequently involve regular asynchronous message contact, typically with a professional, aimed at supporting participants’ engagement and progress through the program’s components [22].”
BackgroundThe future of mental health care: peer-to-peer support and social media
Naslund, J. A., Aschbrenner, K. A., Marsch, L. A., & Bartels, S. J. (2016) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796015001067 · Cited by 1,180
The impact of guidance on Internet-based mental health interventions — A systematic review
Baumeister, H., Reichler, L., Munzinger, M., & Lin, J. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.08.003 · Cited by 1,037
A Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies
Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1772 · Cited by 876
Hollis, C., Falconer, C. J., Martin, J. L., Whittington, C., Stockton, S., Glazebrook, C., & Davies, E. B. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12663 · Cited by 846 · cited 1×
“Digital mental health interventions can be defined as “interventions that provide information, support and therapy (emotional, decisional, behavioural and neurocognitive) for physical and/or mental health problems via a technological or digital platform” [2].”
BackgroundCuijpers, P., Donker, T., van Straten, A., Li, J., & Andersson, G. (2010) · Psychological Medicine · doi:10.1017/s0033291710000772 · Cited by 832
The prevalence and correlates of untreated serious mental illness.
(2001) · PubMed Central · Cited by 780
Hedman, E., Ljótsson, B., & Lindefors, N. (2012) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/erp.12.67 · Cited by 672 · cited 1×
“There are several obvious benefits of digital interventions to enhance mental health, such as overcoming logistical barriers and reducing therapeutic costs [3-5].”
BackgroundArdito, R. B., & Rabellino, D. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00270 · Cited by 647
How central is the alliance in psychotherapy? A multilevel longitudinal meta-analysis.
Flückiger, C., Del Re, A. C., Wampold, B. E., Symonds, D., & Horvath, A. O. (2012) · Journal of Counseling Psychology · doi:10.1037/a0025749 · Cited by 576 · cited 1×
“In addition, studies have measured the alliance at different times (midtreatment [69,70], postintervention [68,73], or both [67,71,72]), whereas prior face-to-face research has indicated that the timing of alliance measurement influences its relationship with outcomes [101].”
BackgroundTreatment engagement of individuals experiencing mental illness: review and update
Dixon, L. B., Holoshitz, Y., & Nossel, I. (2016) · World Psychiatry · doi:10.1002/wps.20306 · Cited by 550
Establishing the computer-patient working alliance in automated health behavior change interventions
Bickmore, T., Gruber, A., & Picard, R. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2004.09.008 · Cited by 494 · cited 2×
“However, Bickmore et al [66] evaluated the impact of introducing a relational agent that simulated alliance-promoting behaviors such as social dialogue, empathetic feedback, process comments, humor, and nonverbal communication, alongside a fitness digital intervention.”
BackgroundNewman, M. G., Szkodny, L. E., Llera, S. J., & Przeworski, A. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.008 · Cited by 480 · cited 2×
“Digital interventions vary with regard to their level of professional support, including no support (entirely self-managed interventions); minimal administrative or technical support; and tailored, regular support from a professional [61].”
BackgroundBrouwer, W., Kroeze, W., Crutzen, R., de Nooijer, J., de Vries, N. K., Brug, J., & Oenema, A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1639 · Cited by 455
The digital revolution and its impact on mental health care
Bucci, S., Schwannauer, M., & Berry, N. (2019) · Psychology and Psychotherapy: Theory, Research and Practice · doi:10.1111/papt.12222 · Cited by 444
Ebert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., Brugnera, A., Øverland, S., Trebbi, G., Jensen, K. L., et al. (2018) · European Psychologist · doi:10.1027/1016-9040/a000318 · Cited by 437 · cited 2×
“In addition, supported digital interventions have comparably smaller attrition rates and greater engagement, as demonstrated in systematic reviews [23,85].”
BackgroundRelapse prediction in schizophrenia through digital phenotyping: a pilot study
Barnett, I., Torous, J., Staples, P., Sandoval, L., Keshavan, M., & Onnela, J.-P. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0030-z · Cited by 422
GELLATLY, J., BOWER, P., HENNESSY, S., RICHARDS, D., GILBODY, S., & LOVELL, K. (2007) · Psychological Medicine · doi:10.1017/s0033291707000062 · Cited by 419 · cited 2×
“Several meta-analyses have shown that human support moderates the effectiveness of digital interventions [80,84].”
BackgroundTitov, N., Andrews, G., Davies, M., McIntyre, K., Robinson, E., & Solley, K. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010939 · Cited by 406
Knaevelsrud, C., & Maercker, A. (2007) · BMC Psychiatry · doi:10.1186/1471-244x-7-13 · Cited by 398
Therapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults
Olthuis, J. V., Watt, M. C., Bailey, K., Hayden, J. A., & Stewart, S. H. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011565.pub2 · Cited by 390 · cited 1×
“However, it should be noted that some studies involving direct comparisons of supported and unsupported interventions have failed to demonstrate significant differences in effectiveness and/or adherence [89-91], with authors questioning whether a degree of human support is inherent under randomized controlled trial (R…”
BackgroundBerger, T. (2017) · Psychotherapy Research · doi:10.1080/10503307.2015.1119908 · Cited by 364 · cited 1×
“Several recent reviews have demonstrated that client ratings of the therapeutic alliance in various digital interventions are of similar magnitude to those found in face-to-face therapies [42,57-59], including a small number of samples with serious mental illnesses [42].”
BackgroundAlvarez-Jimenez, M., Alcazar-Corcoles, M. A., González-Blanch, C., Bendall, S., McGorry, P. D., & Gleeson, J. F. (2014) · Schizophrenia Research · doi:10.1016/j.schres.2014.03.021 · Cited by 351
Beatty, L., & Binnion, C. (2016) · International Journal of Behavioral Medicine · doi:10.1007/s12529-016-9556-9 · Cited by 347
The Therapeutic Relationship in E-Therapy for Mental Health: A Systematic Review
Sucala, M., Schnur, J. B., Constantino, M. J., Miller, S. J., Brackman, E. H., & Montgomery, G. H. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2084 · Cited by 344 · cited 1×
“Several recent reviews have demonstrated that client ratings of the therapeutic alliance in various digital interventions are of similar magnitude to those found in face-to-face therapies [42,57-59], including a small number of samples with serious mental illnesses [42].”
BackgroundJosephine, K., Josefine, L., Philipp, D., David, E., & Harald, B. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.021 · Cited by 341 · cited 1×
“However, it should be noted that some studies involving direct comparisons of supported and unsupported interventions have failed to demonstrate significant differences in effectiveness and/or adherence [89-91], with authors questioning whether a degree of human support is inherent under randomized controlled trial (R…”
BackgroundCugelman, B., Thelwall, M., & Dawes, P. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1367 · Cited by 323 · cited 1×
“For example, a meta-analysis demonstrated that adherence to both the intervention and the study was associated with a range of behavioral and health outcomes in digital interventions [103].”
BackgroundChristensen, H., Griffiths, K. M., & Korten, A. (2002) · Journal of Medical Internet Research · doi:10.2196/jmir.4.1.e3 · Cited by 292
Palmqvist, B., Carlbring, P., & Andersson, G. (2007) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/14737167.7.3.291 · Cited by 290 · cited 2×
“The findings of multiple meta-analytic and systematic reviews suggest that digital interventions with support tend to have greater effect sizes than those without human support [21,79-83] for outcomes, including depression and anxiety symptoms, and general well-being.”
BackgroundChick clique: persuasive technology to motivate teenage girls to exercise
Toscos, T., Faber, A., An, S., & Gandhi, M. P. (2006) · CHI '06 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1125451.1125805 · Cited by 280
Berger, T., Caspar, F., Richardson, R., Kneubühler, B., Sutter, D., & Andersson, G. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.12.007 · Cited by 265 · cited 1×
“For example, Berger et al [92] found no differences in the effectiveness of a digital intervention for social anxiety across a range of clinical outcomes between unsupported, minimally supported, and flexibly (on-demand) supported programs; however, participants had access to peer support in this program, potentially…”
BackgroundFit4life: the design of a persuasive technology promoting healthy behavior and ideal weight
Purpura, S., Schwanda, V., Williams, K., Stubler, W., & Sengers, P. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979003 · Cited by 264
Persuasive technology in mobile applications promoting physical activity: a systematic review
Matthews, J., Win, K. T., Oinas-Kukkonen, H., & Freeman, M. (2016) · Journal of Medical Systems · doi:10.1007/s10916-015-0425-x · Cited by 239
Berry, N., Lobban, F., Emsley, R., & Bucci, S. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5250 · Cited by 230 · cited 2×
“The findings of 6 recent systematic reviews of digital interventions for serious mental illnesses demonstrate that these are feasible and acceptable, with preliminary indications that these may be effective for symptoms and cognitive and social outcomes [24-29].”
BackgroundOn the HORYZON: Moderated online social therapy for long-term recovery in first episode psychosis
Alvarez-Jimenez, M., Bendall, S., Lederman, R., Wadley, G., Chinnery, G., Vargas, S., Larkin, M., Killackey, E., McGorry, P. D., & Gleeson, J. F. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2012.10.009 · Cited by 224
Titov, N., Dear, B. F., Staples, L. G., Terides, M. D., Karin, E., Sheehan, J., Johnston, L., Gandy, M., Fogliati, V. J., Wootton, B. M., et al. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.08.002 · Cited by 223
Data mining for health: staking out the ethical territory of digital phenotyping
Martinez-Martin, N., Insel, T. R., Dagum, P., Greely, H. T., & Cho, M. K. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0075-8 · Cited by 218 · cited 2×
“Additional advantages include the provision of real-time and longitudinal patient data, potentially leading to a more accurate diagnosis and treatment decisions, moment-to-moment monitoring, and timely interventions [13].”
BackgroundStiles, W. B., Reynolds, S., Hardy, G. E., & Rees, A. (1994) · Journal of Counseling Psychology · doi:10.1037//0022-0167.41.2.175 · Cited by 209
Baumel, A., Faber, K., Mathur, N., Kane, J. M., & Muench, F. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7270 · Cited by 206 · cited 1×
“In addition, the recently developed Enlight measure was specifically designed to assess the features of digital interventions, including those related to therapeutic alliance [56].”
MethodLehto, T., & Oinas-Kukkonen, H. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1559 · Cited by 203
Bachelor, A. (2013) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.792 · Cited by 203
Establishing Guidelines for Executing and Reporting Internet Intervention Research
Proudfoot, J., Klein, B., Barak, A., Carlbring, P., Cuijpers, P., Lange, A., Ritterband, L., & Andersson, G. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.573807 · Cited by 202
Andersson, G., Paxling, B., Wiwe, M., Vernmark, K., Felix, C. B., Lundborg, L., Furmark, T., Cuijpers, P., & Carlbring, P. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.05.003 · Cited by 202 · cited 3×
“For example, as shown in Multimedia Appendix 1 [53,63-78], 2 recent digital interventions for depression demonstrated positive ratings of the therapeutic alliance, which were lower than those in face-to-face versions [64,65].”
BackgroundActissist: Proof-of-Concept Trial of a Theory-Driven Digital Intervention for Psychosis
Bucci, S., Barrowclough, C., Ainsworth, J., Machin, M., Morris, R., Berry, K., Emsley, R., Lewis, S., Edge, D., Buchan, I., et al. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sby032 · Cited by 196 · cited 1×
“through high use and adherence as well as symptom improvements in favor of the intervention group [31].”
BackgroundDonkin, L., Hickie, I. B., Christensen, H., Naismith, S. L., Neal, B., Cockayne, N. L., & Glozier, N. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2771 · Cited by 193
Hilvert-Bruce, Z., Rossouw, P. J., Wong, N., Sunderland, M., & Andrews, G. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.04.001 · Cited by 193
Hollis, C., Sampson, S., Simons, L., Davies, E. B., Churchill, R., Betton, V., Butler, D., Chapman, K., Easton, K., Gronlund, T. A., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30296-7 · Cited by 186 · cited 1×
“Indeed, the James Lind Alliance identification of key priorities in advancing digital interventions included concerns relating to the therapeutic alliance in the top 10 issues raised [50].”
BackgroundDo We Still Have a Digital Divide in Mental Health? A Five-Year Survey Follow-up
Robotham, D., Satkunanathan, S., Doughty, L., & Wykes, T. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6511 · Cited by 184
Alliance structure assessed by the Agnew Relationship Measure (ARM)
Agnew‐Davies, R., Stiles, W. B., Hardy, G. E., Barkham, M., & Shapiro, D. A. (1998) · British Journal of Clinical Psychology · doi:10.1111/j.2044-8260.1998.tb01291.x · Cited by 182
Goldsmith, L. P., Lewis, S. W., Dunn, G., & Bentall, R. P. (2015) · Psychological Medicine · doi:10.1017/s003329171500032x · Cited by 174 · cited 1×
“Some research also supports the notion of a causal relationship between therapeutic alliance and outcomes in serious mental illnesses, for example, increasing the number of sessions attended was only beneficial in the presence of a strong therapeutic alliance for individuals experiencing psychosis [45].”
ResultDeterminants of adherence to treatment in bipolar disorder: A comprehensive review
Leclerc, E., Mansur, R. B., & Brietzke, E. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.01.036 · Cited by 171 · cited 1×
“In addition, the symptoms and sequelae of BD and psychotic disorders, such as positive and negative symptoms, cognitive difficulties, general psychopathology, and poor social adjustment, are key predictors of poor adherence and engagement in face-to-face therapy [9-12].”
BackgroundBerry, N., Lobban, F., & Bucci, S. (2019) · BMC Psychiatry · doi:10.1186/s12888-018-1979-1 · Cited by 170
Batra, S., Baker, R., Wang, T., Forma, F., DiBiasi, F., & Peters-Strickland, T. (2017) · Medical Devices: Evidence and Research · doi:10.2147/mder.s144158 · Cited by 169
Fullwood, C., Quinn, S., Kaye, L. K., & Redding, C. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.05.029 · Cited by 162
Digital Technology Use Among Individuals with Schizophrenia: Results of an Online Survey
Gay, K., Torous, J., Joseph, A., Pandya, A., & Duckworth, K. (2016) · JMIR Mental Health · doi:10.2196/mental.5379 · Cited by 161
Preschl, B., Maercker, A., & Wagner, B. (2011) · BMC Psychiatry · doi:10.1186/1471-244x-11-189 · Cited by 158 · cited 3×
“Similarly, Preschl et al [73] found that high WAI ratings, equivalent to the face-to-face comparison group, were not associated with treatment outcomes following a supported digital intervention for depression.”
BackgroundMohr, D. C., Duffecy, J., Ho, J., Kwasny, M., Cai, X., Burns, M. N., & Begale, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0070086 · Cited by 153
Digital mental health apps and the therapeutic alliance: initial review
Henson, P., Wisniewski, H., Hollis, C., Keshavan, M., & Torous, J. (2019) · BJPsych Open · doi:10.1192/bjo.2018.86 · Cited by 152
Klein, B., Mitchell, J., Abbott, J.-A., Shandley, K. A., Austin, D., Gilson, K., Kiropoulos, L. A., Cannard, G., & Redman, T. (2010) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2010.04.005 · Cited by 149
Gerhards, S. A. H., Abma, T. A., Arntz, A., de Graaf, L. E., Evers, S. M. A. A., Huibers, M. J. H., & Widdershoven, G. A. M. (2011) · Journal of Affective Disorders · doi:10.1016/j.jad.2010.09.012 · Cited by 141 · cited 1×
“Participants in an unsupported CBT digital intervention for depression echoed this, expressing the desire for support to assist with discipline and motivation [98].”
BackgroundMyths and Realities of Online Clinical Work
Fenichel, M., Suler, J., Barak, A., Zelvin, E., Jones, G., Munro, K., Meunier, V., & Walker-Schmucker, W. (2002) · CyberPsychology & Behavior · doi:10.1089/109493102761022904 · Cited by 138 · cited 2×
“Indeed, some studies have suggested that these offer benefits not attainable through traditional therapy, such as the extension of the therapeutic hour, accessibility when and where users desire, and the provision of anonymity [4,6].”
BackgroundShattock, L., Berry, K., Degnan, A., & Edge, D. (2018) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2135 · Cited by 137 · cited 1×
“Two systematic reviews focusing on psychosis found some evidence that the therapeutic alliance was related to reductions in psychotic symptoms, hospitalizations, and self-esteem outcomes [46] as well as functioning and treatment adherence [47].”
BackgroundPihlaja, S., Stenberg, J.-H., Joutsenniemi, K., Mehik, H., Ritola, V., & Joffe, G. (2018) · Internet Interventions · doi:10.1016/j.invent.2017.11.005 · Cited by 134 · cited 2×
“Several recent reviews have demonstrated that client ratings of the therapeutic alliance in various digital interventions are of similar magnitude to those found in face-to-face therapies [42,57-59], including a small number of samples with serious mental illnesses [42].”
BackgroundWilhelmsen, M., Lillevoll, K., Risør, M. B., Høifødt, R., Johansen, M.-L., Waterloo, K., Eisemann, M., & Kolstrup, N. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-296 · Cited by 133
Online interventions for depression and anxiety – a systematic review
Saddichha, S., Al-Desouki, M., Lamia, A., Linden, I. A., & Krausz, M. (2014) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2014.945934 · Cited by 133 · cited 2×
“The findings of multiple meta-analytic and systematic reviews suggest that digital interventions with support tend to have greater effect sizes than those without human support [21,79-83] for outcomes, including depression and anxiety symptoms, and general well-being.”
BackgroundBaumel, A., & Kane, J. M. (2018) · Journal of Medical Internet Research · doi:10.2196/11491 · Cited by 131
Baumel, A., & Yom-Tov, E. (2018) · Translational Behavioral Medicine · doi:10.1093/tbm/ibx037 · Cited by 128 · cited 1×
“For example, as shown in Multimedia Appendix 1 [53,63-78], 2 recent digital interventions for depression demonstrated positive ratings of the therapeutic alliance, which were lower than those in face-to-face versions [64,65].”
BackgroundHow people with serious mental illness use smartphones, mobile apps, and social media.
Naslund, J. A., Aschbrenner, K. A., & Bartels, S. J. (2016) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000207 · Cited by 126 · cited 1×
“The findings of 6 recent systematic reviews of digital interventions for serious mental illnesses demonstrate that these are feasible and acceptable, with preliminary indications that these may be effective for symptoms and cognitive and social outcomes [24-29].”
BackgroundInternet‐Based Treatment for Panic Disorder: Does Frequency of Therapist Contact Make a Difference?
Klein, B., Austin, D., Pier, C., Kiropoulos, L., Shandley, K., Mitchell, J., Gilson, K., & Ciechomski, L. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070802561132 · Cited by 123
Aref-Adib, G., McCloud, T., Ross, J., O'Hanlon, P., Appleton, V., Rowe, S., Murray, E., Johnson, S., & Lobban, F. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30302-x · Cited by 118
Harrow, M., Hansford, B. G., & Astrachan-Fletcher, E. B. (2009) · Psychiatry Research · doi:10.1016/j.psychres.2008.06.002 · Cited by 116
Hedman, E., Andersson, E., Ljótsson, B., Andersson, G., Andersson, E., Schalling, M., Lindefors, N., & Rück, C. (2012) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2012.01834.x · Cited by 114
A pilot digital intervention targeting loneliness in young people with psychosis
Lim, M. H., Gleeson, J. F. M., Rodebaugh, T. L., Eres, R., Long, K. M., Casey, K., Abbott, J.-A. M., Thomas, N., & Penn, D. L. (2020) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-019-01681-2 · Cited by 108
Killikelly, C., He, Z., Reeder, C., & Wykes, T. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.7088 · Cited by 105
Berry, K., Salter, A., Morris, R., James, S., & Bucci, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8252 · Cited by 103 · cited 3×
“Research findings provide some support for this claim, with qualitative accounts indicating that when users perceived an app as not tailored to their individual needs (eg, generic), the development of a relationship was hindered [55].”
BackgroundMethodResultInfluentialAnderson, R. E. E., Spence, S. H., Donovan, C. L., March, S., Prosser, S., & Kenardy, J. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1848 · Cited by 102 · cited 2×
“For example, as shown in Multimedia Appendix 1 [53,63-78], 2 recent digital interventions for depression demonstrated positive ratings of the therapeutic alliance, which were lower than those in face-to-face versions [64,65].”
BackgroundStallard, P., Richardson, T., & Velleman, S. (2010) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465810000421 · Cited by 102
Effectiveness of Web-based Psychological Interventions for Depression: A Meta-analysis
Cowpertwait, L., & Clarke, D. (2013) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-012-9416-z · Cited by 101
The Working Alliance Inventory for guided Internet interventions (WAI‐I)
Gómez Penedo, J. M., Berger, T., grosse Holtforth, M., Krieger, T., Schröder, J., Hohagen, F., Meyer, B., Moritz, S., & Klein, J. P. (2020) · Journal of Clinical Psychology · doi:10.1002/jclp.22823 · Cited by 100
Wildeboer, G., Kelders, S. M., & van Gemert-Pijnen, J. E. W. C. (2016) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2016.04.005 · Cited by 98
The association between adherence and outcome in an Internet intervention for depression
Fuhr, K., Schröder, J., Berger, T., Moritz, S., Meyer, B., Lutz, W., Hohagen, F., Hautzinger, M., & Klein, J. P. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.12.028 · Cited by 97
Wozney, L., Huguet, A., Bennett, K., Radomski, A. D., Hartling, L., Dyson, M., McGrath, P. J., & Newton, A. S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7573 · Cited by 93
Bergman Nordgren, L., Carlbring, P., Linna, E., & Andersson, G. (2013) · JMIR Research Protocols · doi:10.2196/resprot.2292 · Cited by 92
Hidalgo-Mazzei, D., Mateu, A., Reinares, M., Matic, A., Vieta, E., & Colom, F. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.08.005 · Cited by 92
Empowering the digital therapeutic relationship: virtual clinics for digital health interventions
Torous, J., & Hsin, H. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0028-2 · Cited by 88
(Inter)personal Computing: The Role of the Therapeutic Relationship in E-mental Health
Cavanagh, K., & Millings, A. (2013) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-013-9242-z · Cited by 88
Clarke, J., Proudfoot, J., Whitton, A., Birch, M.-R., Boyd, M., Parker, G., Manicavasagar, V., Hadzi-Pavlovic, D., & Fogarty, A. (2016) · JMIR Mental Health · doi:10.2196/mental.4656 · Cited by 86
Wagner, B., Brand, J., Schulz, W., & Knaevelsrud, C. (2012) · Depression and Anxiety · doi:10.1002/da.21962 · Cited by 84
Smith, T. E., Easter, A., Pollock, M., Pope, L. G., & Wisdom, J. P. (2013) · Psychiatric Services · doi:10.1176/appi.ps.201200394 · Cited by 82 · cited 1×
“Perceived stigma, lack of insight, and lack of trust in available face-to-face treatments have been cited as key reasons for individuals with serious mental illnesses not seeking support for mental health concerns [7,8].”
BackgroundEnrique, A., Palacios, J. E., Ryan, H., & Richards, D. (2019) · Journal of Medical Internet Research · doi:10.2196/12775 · Cited by 81
Only connect: The working alliance in computer-based cognitive behavioral therapy
Kiluk, B. D., Serafini, K., Frankforter, T., Nich, C., & Carroll, K. M. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.10.003 · Cited by 80 · cited 6×
“As mentioned above, these are small studies, including an open trial [65] and secondary analyses [53,63], and the alliance was heterogeneously assessed, raising questions about reliability.”
BackgroundMethodInfluentialLawes-Wickwar, S., McBain, H., & Mulligan, K. (2018) · JMIR Mental Health · doi:10.2196/mental.8816 · Cited by 78 · cited 1×
“The findings of 6 recent systematic reviews of digital interventions for serious mental illnesses demonstrate that these are feasible and acceptable, with preliminary indications that these may be effective for symptoms and cognitive and social outcomes [24-29].”
BackgroundDeterminants of adherence to treatment in first-episode psychosis: a comprehensive review
Leclerc, E., Noto, C., Bressan, R. A., & Brietzke, E. (2015) · Revista Brasileira de Psiquiatria · doi:10.1590/1516-4446-2014-1539 · Cited by 78 · cited 1×
“In addition, the symptoms and sequelae of BD and psychotic disorders, such as positive and negative symptoms, cognitive difficulties, general psychopathology, and poor social adjustment, are key predictors of poor adherence and engagement in face-to-face therapy [9-12].”
BackgroundObjective smartphone data as a potential diagnostic marker of bipolar disorder
Faurholt-Jepsen, M., Busk, J., Þórarinsdóttir, H., Frost, M., Bardram, J. E., Vinberg, M., & Kessing, L. V. (2019) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867418808900 · Cited by 77
Do adherence variables predict outcome in an online program for the prevention of eating disorders?
Manwaring, J. L., Bryson, S. W., Goldschmidt, A. B., Winzelberg, A. J., Luce, K. H., Cunning, D., Wilfley, D. E., & Taylor, C. B. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.2.341 · Cited by 73
Todd, N. J., Jones, S. H., & Lobban, F. A. (2013) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1804 · Cited by 73 · cited 1×
“managing procrastination and motivation issues were likely to be the primary benefits of support within a digital intervention [97].”
BackgroundThe application of persuasive technology to educational settings
Mintz, J., & Aagaard, M. (2012) · Educational Technology Research and Development · doi:10.1007/s11423-012-9232-y · Cited by 72
Schueller, S. M., Tomasino, K. N., & Mohr, D. C. (2017) · Clinical Psychology: Science and Practice · doi:10.1037/h0101740 · Cited by 70 · cited 1×
“Similarly, the content and model of support vary, and this may be an additional factor that impacts effectiveness and engagement [62].”
BackgroundAlvarez-Jimenez, M., Bendall, S., Koval, P., Rice, S., Cagliarini, D., Valentine, L., D’Alfonso, S., Miles, C., Russon, P., Penn, D. L., et al. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024104 · Cited by 69
Bellur, S., & Sundar, S. S. (2017) · Human Communication Research · doi:10.1111/hcre.12094 · Cited by 69
Processes of Social Influence: The Elaboration Likelihood Model of Persuasion
CACIOPPO, J. T., PETTY, R. E., & STOLTENBERG, C. D. (1985) · Advances in Cognitive–Behavioral Research and Therapy · doi:10.1016/b978-0-12-010604-2.50012-4 · Cited by 69
Computerized cognitive behavioural therapy and the therapeutic alliance: A qualitative enquiry
Barazzone, N., Cavanagh, K., & Richards, D. A. (2012) · British Journal of Clinical Psychology · doi:10.1111/j.2044-8260.2012.02035.x · Cited by 67
Impact of Exchanges and Client–Therapist Alliance in Online-Text Psychotherapy
Reynolds, D. J., Stiles, W. B., Bailer, A. J., & Hughes, M. R. (2013) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2012.0195 · Cited by 64
Arnold, C., Villagonzalo, K.-A., Meyer, D., Farhall, J., Foley, F., Kyrios, M., & Thomas, N. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100266 · Cited by 63
An Online Recovery Plan Program: Can Peer Coaching Increase Participation?
Simon, G. E., Ludman, E. J., Goodale, L. C., Dykstra, D. M., Stone, E., Cutsogeorge, D., Operskalski, B., Savarino, J., & Pabiniak, C. (2011) · Psychiatric Services · doi:10.1176/ps.62.6.pss6206_0666 · Cited by 62
Hadjistavropoulos, H. D., Pugh, N. E., Hesser, H., & Andersson, G. (2017) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2014 · Cited by 61 · cited 3×
“Furthermore, Hadjistavropoulos et al [71] reported that ratings were unrelated to outcomes of supported digital interventions for either depression or generalized anxiety disorder.”
BackgroundBrowne, J., Nagendra, A., Kurtz, M., Berry, K., & Penn, D. L. (2019) · Clinical Psychology Review · doi:10.1016/j.cpr.2019.05.002 · Cited by 60 · cited 1×
“Two systematic reviews focusing on psychosis found some evidence that the therapeutic alliance was related to reductions in psychotic symptoms, hospitalizations, and self-esteem outcomes [46] as well as functioning and treatment adherence [47].”
BackgroundCognitive Behaviour Therapy Self-Help: Who Does it Help and What are its Drawbacks?
MacLeod, M., Martinez, R., & Williams, C. (2009) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465808005031 · Cited by 59
Rus-Calafell, M., & Schneider, S. (2020) · mHealth · doi:10.21037/mhealth.2019.09.14 · Cited by 57 · cited 1×
“The findings of 6 recent systematic reviews of digital interventions for serious mental illnesses demonstrate that these are feasible and acceptable, with preliminary indications that these may be effective for symptoms and cognitive and social outcomes [24-29].”
BackgroundThe meaning of social support for persons with serious mental illness.
Chronister, J., Chou, C.-C., Kwan, K.-L. K., Lawton, M., & Silver, K. (2015) · Rehabilitation Psychology · doi:10.1037/rep0000038 · Cited by 57
Ormrod, J. A., Kennedy, L., Scott, J., & Cavanagh, K. (2010) · Cognitive Behaviour Therapy · doi:10.1080/16506071003675614 · Cited by 55 · cited 3×
“In a small, open trial of an unsupported digital intervention, modified ARM ratings were lower than in face-to-face CBT and showed no associations with depression outcomes [65].”
BackgroundAndersson, E., Ljótsson, B., Hedman, E., Enander, J., Kaldo, V., Andersson, G., Lindefors, N., & Rück, C. (2015) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2014.10.003 · Cited by 52
El Alaoui, S., Ljótsson, B., Hedman, E., Svanborg, C., Kaldo, V., & Lindefors, N. (2016) · PLOS ONE · doi:10.1371/journal.pone.0161191 · Cited by 51
Gega, L., Smith, J., & Reynolds, S. (2013) · Psychotherapy Research · doi:10.1080/10503307.2013.766941 · Cited by 47
Lederman, R., Gleeson, J., Wadley, G., D’alfonso, S., Rice, S., Santesteban-Echarri, O., & Alvarez-Jimenez, M. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3301421 · Cited by 46
Naslund, J. A., & Aschbrenner, K. A. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2018-300034 · Cited by 44 · cited 1×
“Furthermore, digital interventions may be uniquely positioned to target the multilevel risk factors associated with poor physical health and mortality in serious mental illnesses [14].”
BackgroundBernard, R., Sabariego, C., & Cieza, A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5442 · Cited by 43
Considering the therapeutic alliance in digital mental health interventions
Henson, P., Peck, P., & Torous, J. (2019) · Harvard Review of Psychiatry · doi:10.1097/hrp.0000000000000224 · Cited by 43
Internet use by patients with bipolar disorder: Results from an international multisite survey
Bauer, R., Conell, J., Glenn, T., Alda, M., Ardau, R., Baune, B. T., Berk, M., Bersudsky, Y., Bilderbeck, A., Bocchetta, A., et al. (2016) · Psychiatry Research · doi:10.1016/j.psychres.2016.05.055 · Cited by 43
Service Engagement in First Episode Psychosis: Clinical and Premorbid Correlates
MacBeth, A., Gumley, A., Schwannauer, M., & Fisher, R. (2013) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e31828e0e19 · Cited by 43 · cited 1×
“In addition, the symptoms and sequelae of BD and psychotic disorders, such as positive and negative symptoms, cognitive difficulties, general psychopathology, and poor social adjustment, are key predictors of poor adherence and engagement in face-to-face therapy [9-12].”
BackgroundMackie, C., Dunn, N., MacLean, S., Testa, V., Heisel, M., & Hatcher, S. (2017) · Evidence Based Mental Health · doi:10.1136/eb-2017-102764 · Cited by 41
Radomski, A. D., Wozney, L., McGrath, P., Huguet, A., Hartling, L., Dyson, M. P., Bennett, K., & Newton, A. S. (2019) · Journal of Medical Internet Research · doi:10.2196/11128 · Cited by 40
Lindner, P., Olsson, E. L., Johnsson, A., Dahlin, M., Andersson, G., & Carlbring, P. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.09.001 · Cited by 39 · cited 1×
“Lindner et al [95] found no differences in effectiveness between telephone and email support in a small trial.”
BackgroundIs the therapeutic alliance overvalued in the treatment of eating disorders?
Brown, A., Mountford, V. A., & Waller, G. (2013) · International Journal of Eating Disorders · doi:10.1002/eat.22177 · Cited by 39 · cited 1×
“Although evidence relating to a direct relationship between ratings of therapeutic alliance and treatment outcomes is inconclusive for digital interventions, one possibility is that the therapeutic alliance is associated with increased engagement and adherence, in turn, influencing outcomes [102].”
BackgroundThomas, N., Farhall, J., Foley, F., Rossell, S. L., Castle, D. J., Ladd, E., Meyer, D., Mihalopoulos, C., Leitan, N., Nunan, C., et al. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-1024-1 · Cited by 39
Self-citationObjective identification and analysis of physiological and behavioral signs of schizophrenia
Osipov, M., Behzadi, Y., Kane, J. M., Petrides, G., & Clifford, G. D. (2015) · Journal of Mental Health · doi:10.3109/09638237.2015.1019048 · Cited by 37
Fletcher, K., Foley, F., Thomas, N., Michalak, E., Berk, L., Berk, M., Bowe, S., Cotton, S., Engel, L., Johnson, S. L., et al. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1805-9 · Cited by 36
Self-citationClarke, S., Hanna, D., Mulholland, C., Shannon, C., & Urquhart, C. (2019) · Psychosis · doi:10.1080/17522439.2019.1632376 · Cited by 36
Richards, P., & Simpson, S. (2015) · British Journal of Guidance & Counselling · doi:10.1080/03069885.2014.936824 · Cited by 32 · cited 1×
“Indeed, some studies have suggested that these offer benefits not attainable through traditional therapy, such as the extension of the therapeutic hour, accessibility when and where users desire, and the provision of anonymity [4,6].”
BackgroundThe therapeutic alliance: is it necessary or sufficient to engender positive outcomes?
Macneil, C. A., Hasty, M. K., Evans, M., Redlich, C., & Berk, M. (2009) · Acta Neuropsychiatrica · doi:10.1111/j.1601-5215.2009.00372.x · Cited by 31
The Potential of Object-Relations Theory for Improving Engagement With Health Apps
Cohen, J., & Torous, J. (2019) · JAMA · doi:10.1001/jama.2019.17141 · Cited by 29
Miragall, M., Baños, R. M., Cebolla, A., & Botella, C. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01531 · Cited by 29
How a Fully Automated eHealth Program Simulates Three Therapeutic Processes: A Case Study
Holter, M. T. S., Johansen, A., & Brendryen, H. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5415 · Cited by 28
Valentine, L., McEnery, C., D’Alfonso, S., Phillips, J., Bailey, E., & Alvarez-Jimenez, M. (2019) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-019-00184-w · Cited by 26
Self-citationWorking Alliance in Patients with Severe Mental Illness Who Need a Crisis Intervention Plan
Ruchlewska, A., Kamperman, A. M., van der Gaag, M., Wierdsma, A. I., & Mulder, N. C. L. (2016) · Community Mental Health Journal · doi:10.1007/s10597-015-9839-7 · Cited by 24
Parada, F., Martínez, V., Espinosa, H. D., Bauer, S., & Moessner, M. (2020) · Telemedicine and e-Health · doi:10.1089/tmj.2018.0272 · Cited by 24
Perceived support and relational effects in psychotherapy process constructs.
Lakey, B., Cohen, J. L., & Neely, L. C. (2008) · Journal of Counseling Psychology · doi:10.1037/0022-0167.55.2.209 · Cited by 23
Designing for Behavior Change—New Models and Moral Issues
Fogg, B. J., & Euchner, J. (2019) · Research-Technology Management · doi:10.1080/08956308.2019.1638490 · Cited by 23
Walsh, A., & Richards, D. (2017) · British Journal of Guidance & Counselling · doi:10.1080/03069885.2016.1153039 · Cited by 20 · cited 1×
“Furthermore, 2 qualitative analyses following digital interventions (for generalized anxiety disorder and depression) revealed that personalized support led to improved motivation to engage while fulfilling the needs for relatedness [99,100].”
BackgroundDevelopment of a Moderated Online Intervention to Treat Social Anxiety in First-Episode Psychosis
McEnery, C., Lim, M. H., Knowles, A., Rice, S., Gleeson, J., Howell, S., Russon, P., Miles, C., D’Alfonso, S., & Alvarez-Jimenez, M. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00581 · Cited by 20
Self-citationWorking Alliance in Internet-Based Cognitive-Behavioral Therapy for Obsessive-Compulsive Disorder
Herbst, N., Franzen, G., Voderholzer, U., Thiel, N., Knaevelsrud, C., Hertenstein, E., Nissen, C., & Külz, A. K. (2016) · Psychotherapy and Psychosomatics · doi:10.1159/000441282 · Cited by 18 · cited 3×
“In addition, Herbst et al [68] found that WAI ratings were associated with symptom reduction in a supported digital intervention for obsessive compulsive disorder (OCD).”
BackgroundAndrade-González, N., Hernández-Gómez, A., Álvarez-Sesmero, S., Gutiérrez-Rojas, L., Vieta, E., Reinares, M., & Lahera, G. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.09.014 · Cited by 18
Beintner, I., Görlich, D., Berger, T., Ebert, D. D., Zeiler, M., Herrero Camarano, R., Waldherr, K., & Jacobi, C. (2019) · Internet Interventions · doi:10.1016/j.invent.2018.05.001 · Cited by 14
Predictors of adherence to low support, computerised, cognitive remediation training in psychosis
Hargreaves, A., Dillon, R., Castorina, M., Furey, E., Walsh, J., Fitzmaurice, B., Hallahan, B., Corvin, A., Robertson, I., & Donohoe, G. (2018) · Psychosis · doi:10.1080/17522439.2018.1522542 · Cited by 14
A questionnaire-based qualitative study of therapist views on computerized CBT
Newton, J., & Sundin, E. (2016) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x16000131 · Cited by 8
Research works printed but not linked: 1
- Kessler, RC, 2001, Health Serv Res, 36, 987
Cited by
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199
To chat or bot to chat: Ethical issues with using chatbots in mental health
Coghlan, S., Leins, K., Sheldrick, S., Cheong, M., Gooding, P., & D'Alfonso, S. (2023) · DIGITAL HEALTH · doi:10.1177/20552076231183542 · Cited by 215
The now and future of ChatGPT and GPT in psychiatry
Cheng, S., Chang, C., Chang, W., Wang, H., Liang, C., Kishimoto, T., Chang, J. P., Kuo, J. S., & Su, K. (2023) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.13588 · Cited by 188
Engagement and retention in digital mental health interventions: a narrative review
Boucher, E. M., & Raiker, J. S. (2024) · BMC Digital Health · doi:10.1186/s44247-024-00105-9 · Cited by 181
Digital Mental Health Challenges and the Horizon Ahead for Solutions
Balcombe, L., & De Leo, D. (2021) · JMIR Mental Health · doi:10.2196/26811 · Cited by 173
Metadata
- Authors
- Tremain, H., McEnery, C., Fletcher, K., & Murray, G.
- Affiliations
- Swinburne University of Technology (AU)
- Orygen (AU)
- Corresponding author
- Tremain, Hailey
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2020-08-07
- Volume
- 7
- Issue
- 8
- Pages
- e17204
- ISSN
- 2368-7959 (ISSN-L)
- PMC
- PMC7442952
- OpenAlex
- W3033785558
- Cited by
- 193
- References
- 150
- Citations by year
- 2026: 37 · 2025: 45 · 2024: 25 · 2023: 37 · 2022: 23 · 2021: 24 · 2020: 1
- FWCI
- 3.34
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Mental Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Swinburne figshare (Swinburne University of Technology) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- therapeutic relationship, digital mental health interventions, severe mental illness, treatment engagement, intervention adherence, intervention design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
