Synchronous Web-Based Psychotherapy for Mental Disorders From a Health Quality Perspective: Scoping Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index; 16 of the 27 sources its claims cite were checked for support.
Abstract
Background: The COVID-19 pandemic necessitated rapid changes to health care delivery, including a shift from in-person to digitally delivered psychotherapy. While these changes helped ensure timely psychotherapy provision, many concerns exist, including clinical, cultural, practical, privacy, and security issues. Objective: This scoping review systematically mapped existing peer-reviewed research on synchronous, therapist-delivered web-based psychotherapy for individuals with a diagnosed mental illness. Data were analyzed through the lens of the Alberta Quality Matrix for Health (AQMH) to assess to what degree this literature addresses key indicators of health care quality. This analysis aided in the identification and organization of knowledge gaps with regard to web-based psychotherapies, highlighting potential disparities between previously prioritized dimensions of care and those requiring further attention. Methods: This review adhered to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. We included peer-reviewed primary research studies in the English language investigating synchronous, therapist-delivered remote psychotherapy delivered to adults (aged 18 years and older) with a Diagnostic and Statistical Manual of Mental Disorders or International Statistical Classification of Diseases diagnosed mental illness. All other citations were excluded. Relevant studies were identified through MEDLINE, APA PsycINFO, Embase (OVID), Web of Science: Core Collection (Clarivate), Cochrane Library (Wiley), and Scopus (Elsevier) databases. Databases were searched on March 18, 2021. For every publication that was taken into consideration, the data were charted independently by 2 reviewers, and in the event of a discrepancy, the principal investigator validated the choice of either extractor. Results were thematically described according to the 6 AQMH dimensions: acceptability, accessibility, appropriateness, effectiveness, efficiency, and safety. Results: From 13,209 publications, 48 articles were included, largely from North American studies. Most studies measured treatment effectiveness (n=48, 100%) and acceptability (n=29, 60%) health quality dimensions. Over 80% (40/48) of studies investigated either a cognitive or exposure intervention for either posttraumatic stress disorder or a mood or anxiety disorder, generally indicating comparable results to in-person therapy. Safety (n=5, 10%) was measured in fewer studies, while treatment accessibility, appropriateness, and efficiency were not explicitly measured in any study, although these dimensions were mentioned as a future direction, hypothesis, or potential outcome. Conclusions: In relation to web-based therapist-delivered psychotherapies for those with a diagnosed mental illness, important aspects of health care quality (accessibility, appropriateness, efficiency, and safety) have received little scientific examination, underscoring a need to address these gaps. There are also significant issues related to the generalizability of this literature, including the underrepresentation of many geographic regions, cultures, populations, clinical contexts, and psychotherapy modalities. Qualitative research in underrepresented populations and settings may uncover important patient and contextual factors important for the future implementation of quality web-based psychotherapy. ©Raman Dhaliwal, Sidney Yap, Fernanda Talarico, Huda Al-Shamali, Robert Mcweeny, Matthew Reeson, Reham Shalaby, Teresa Chen, Elena Spronk, Rayven Snodgrass, Eileen Tu, Taylor Erick, Tyler Marshall, Megan Kennedy, Andrew J Greenshaw, Olga Winkler, Lisa Burback.
Overview
CoChat Summary
## TL;DR
This scoping review mapped 48 peer-reviewed studies on synchronous, therapist-delivered web-based psychotherapy for adults with diagnosed mental illness and assessed them through the Alberta Quality Matrix for Health (AQMH). The literature was concentrated in North America and on effectiveness/acceptability, while accessibility, appropriateness, efficiency, and safety were largely underexamined.
## Key findings
- From 13,209 publications, the review included 48 articles with 4,872 participants; 32/48 (67%) were RCTs, 8/48 (17%) non-RCTs, 6/48 (13%) pretest-posttest studies, and 2/48 (4%) other designs.
- Most studies measured treatment effectiveness (48/48, 100%) and acceptability (29/48, 60%); safety was measured in 5/48 (10%) studies, and no study explicitly measured accessibility, appropriateness, or efficiency.
- More than 80% (40/48) of studies focused on cognitive or exposure interventions for PTSD, depressive disorders, or anxiety disorders; 83% (40/48) of studies were published in the United States or Canada.
- Of the effectiveness studies, 32/48 (67%) reported remote delivery was noninferior to in-person psychotherapy, 12/48 (25%) had no in-person comparator but positive results, and 4/48 (8%) found remote delivery inferior.
## Methods
- Scoping review following PRISMA-ScR; the protocol was not registered a priori.
- Included peer-reviewed English-language primary studies of synchronous, therapist-delivered remote psychotherapy for adults (18+) with DSM- or ICD-diagnosed mental illness; searches were run on March 18, 2021 in MEDLINE, APA PsycINFO, Embase, Web of Science Core Collection, Cochrane Library, and Scopus.
- Two reviewers independently charted data and conducted a thematic analysis organized around AQMH dimensions: acceptability, accessibility, appropriateness, effectiveness, efficiency, and safety.
## Limitations
- The authors state that the AQMH may not capture all dimensions of health care quality in end-user contexts, is not specific to psychotherapy, and may not be optimal for evaluating therapeutic alliance.
- The review was limited to English-language papers and to the populations reported in the source studies, which the authors note limits generalizability; it also cannot address app-based or blended interventions because those were excluded.
- Evident from the text: the evidence base is geographically narrow (mostly the United States and Canada), heavily concentrated in PTSD/depression/anxiety and cognitive/exposure therapies, and seldom reported funding or public/private payment context, limiting broader inferences.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
12 Valid · 2 Not valid · 12 Not checked · 119 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, caveats surrounding web-based delivery, including clinical, cultural, practical, and privacy and security issues, remain underaddressed [7].”
§ Synchronous Web-Based Psychotherapy for Mental Disorders From a Health Quality Perspective: Scoping Review > Introduction > Overview
What the sources say
- Supportedcites [7] source
The Discussion’s Conclusions say that risk, safety, privacy and security, cultural factors, and barriers to digital delivery need further research. The Knowledge Gaps and Future Research section also identifies unresolved clinical and practical questions. Together, these passages support the claim that such caveats remain underaddressed. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Disruptions in routines and activities stemming from the consequences of the pandemic led to increased distress, anxiety, depression, and suicidal ideation both within the general population [3,4] and clinical populations with existing psychiatric disorders [5].”
§ Synchronous Web-Based Psychotherapy for Mental Disorders From a Health Quality Perspective: Scoping Review > Introduction > Overview
What the sources say
- Partly supportedcites [3] sourceExperimental — accuracy not yet measured
Citation [5] is attached to the claim about clinical populations. The Results section reports more moderate-to-severe suicidal ideation among psychiatric patients than healthy controls during lockdown, but it does not establish that disrupted routines caused increases in distress, anxiety, or depression in those patients. The general-population portion is attributed to citations [3,4], not this source. (LLM, conf=0.85)
- Partly supportedcites [4] sourceExperimental — accuracy not yet measured
The Introduction links pandemic-related lifestyle changes to possible mental health problems, and the Discussion reports higher-than-normal depression, anxiety, and distress during COVID-19. The paper does not report suicidal ideation, and it presents lifestyle changes as a possible contributor rather than establishing that disrupted routines caused these outcomes. The sentence assigns the claim about people with existing psychiatric disorders to a separate citation [5], so that part is not assessed here. (LLM, conf=0.86)
- Supportedcites [5] source
Citation [5] is attached to the claim about clinical populations with existing psychiatric disorders, not the separate claim about the general population. The Discussion (page unavailable) states that disrupted daily routines and social rhythms increase stress and exacerbate anxiety, depressive symptoms, and suicidal ideation in people with pre-existent mental health conditions. (LLM, conf=0.92)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Government-mandated physical distancing restrictions necessitated a rapid shift away from in-person mental health services to digitally delivered services (eg, teletherapy, videoconferencing, eHealth, and mobile health) [2].”
§ Synchronous Web-Based Psychotherapy for Mental Disorders From a Health Quality Perspective: Scoping Review > Introduction > Overview
What the sources say
- Partly supportedcites [2] sourceExperimental — accuracy not yet measured
The main text (page not supplied) says that virus transmission hindered face-to-face psychological interventions and that online mental health services were widely implemented in China. It does not attribute that change to government-mandated distancing restrictions or document a rapid shift from existing in-person services; its examples also do not establish every digital format listed in the citing sentence. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“previous research has found that differences in cultural interpretations of certain social behaviors may affect treatment appropriateness [75].”
§ Synchronous Web-Based Psychotherapy for Mental Disorders From a Health Quality Perspective: Scoping Review > Discussion > Appropriateness
What the sources say
- Supportedcites [75] source
The Key considerations section explains that judgments of normality and abnormality vary across cultures and that misinterpretation can lead to inappropriate interventions. This supports the claim that cultural differences in interpreting behavior may affect treatment appropriateness. (LLM, conf=0.88)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“as much of the hesitancy regarding wider use and implementation comes from therapists themselves [74].”
§ Synchronous Web-Based Psychotherapy for Mental Disorders From a Health Quality Perspective: Scoping Review > Discussion > Acceptability
What the sources say
- Supportedcites [74] source
The paper’s introductory discussion says therapists’ concerns hindered the uptake of online therapy by videoconference and that many were reluctant to integrate it into their practices. This supports the claim that therapists themselves contributed to hesitancy about wider use. (LLM, conf=0.92)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
64 more claims · 1 with their cited sources checked
Create a free account to see all 145 claims and every source verdict.
- Probably not a substantial claim. 53
- It may state two separate claims as one. 39
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 1×
“This review followed the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analysis Extension for Scoping Reviews) [14].”
Scoping studies: advancing the methodology
Levac, D., Colquhoun, H., & O'Brien, K. K. (2010) · Implementation Science · doi:10.1186/1748-5908-5-69 · Cited by 15,268 · cited 1×
“Following this, a thematic qualitative analysis was conducted to elucidate notable themes [21].”
JBI Manual for Evidence Synthesis
(2020) · JBI eBooks · doi:10.46658/jbimes-20-01 · Cited by 4,165
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., PRISMA-S Group, Blunt, H., Brigham, T., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-020-01542-z · Cited by 3,714 · cited 1×
“The search process was documented and reported in adherence to the PRISMA-S extension [18].”
COVID-19 pandemic and mental health consequences: Systematic review of the current evidence
Vindegaard, N., & Benros, M. E. (2020) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2020.05.048 · Cited by 3,221 · cited 1×
“The COVID-19 pandemic continues to impact the mental health of individuals and communities worldwide [1].”
(2020) · JBI Manual for Evidence Synthesis · doi:10.46658/jbimes-20-12 · Cited by 2,545
Online mental health services in China during the COVID-19 outbreak
Liu, S., Yang, L., Zhang, C., Xiang, Y.-T., Liu, Z., Hu, S., & Zhang, B. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30077-8 · Cited by 1,992 · cited 1×
“Government-mandated physical distancing restrictions necessitated a rapid shift away from in-person mental health services to digitally delivered services (eg, teletherapy, videoconferencing, eHealth, and mobile health) [2].”
The alliance in adult psychotherapy: A meta-analytic synthesis
Flückiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018) · Psychotherapy · doi:10.1037/pst0000172 · Cited by 1,763 · cited 1×
“The reason for this review’s focus on fully human-delivered interventions is that evidence suggests that therapeutic alliance is an important predictor of psychotherapy success [15].”
Research summary on the therapeutic relationship and psychotherapy outcome.
Lambert, M. J., & Barley, D. E. (2001) · Psychotherapy: Theory, Research, Practice, Training · doi:10.1037/0033-3204.38.4.357 · Cited by 1,621 · cited 1×
“Therefore, acceptability in the AQMH includes the relational and collaborative aspects of care inherent in the concept of therapeutic alliance [13,22].”
Wu, T., Jia, X., Shi, H., Niu, J., Yin, X., Xie, J., & Wang, X. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.11.117 · Cited by 1,138
Cultural Diversity and Mental Health: Considerations for Policy and Practice
Gopalkrishnan, N. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00179 · Cited by 518 · cited 2×
“Further, previous research has found that differences in cultural interpretations of certain social behaviors may affect treatment appropriateness [75].”
Barker, P. M., Reid, A., & Schall, M. W. (2015) · Implementation Science · doi:10.1186/s13012-016-0374-x · Cited by 400
A systematic review of providers’ attitudes toward telemental health via videoconferencing.
Connolly, S. L., Miller, C. J., Lindsay, J. A., & Bauer, M. S. (2020) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12311 · Cited by 389
Suicide, self-harm and suicidal ideation during COVID-19: A systematic review
Farooq, S., Tunmore, J., Wajid Ali, M., & Ayub, M. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114228 · Cited by 350
Ethical Issues in Online Psychotherapy: A Narrative Review
Stoll, J., Müller, J. A., & Trachsel, M. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00993 · Cited by 340
Mohr, D. C., Ho, J., Duffecy, J., Reifler, D., Sokol, L., Burns, M. N., Jin, L., & Siddique, J. (2012) · JAMA · doi:10.1001/jama.2012.5588 · Cited by 330
Morland, L. A., Greene, C. J., Rosen, C. S., Foy, D., Reilly, P., Shore, J., He, Q., & Frueh, C. (2010) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.09m05604blu · Cited by 274 · cited 1×
“These studies discussed access to psychotherapy in various populations, including rural veterans [54-56], psychiatric outpatients living in remote areas [30], and ethnically diverse women living in underserved rural and urban areas [31].”
Delivering Cognitive-Behavior Therapy for Panic Disorder with Agoraphobia in Videoconference
Bouchard, S., Paquin, B., Payeur, R., Allard, M., Rivard, V., Fournier, T., Renaud, P., & Lapierre, J. (2004) · Telemedicine Journal and e-Health · doi:10.1089/153056204773644535 · Cited by 267
Comparative efficacy of individual and group psychotherapy: A meta-analytic perspective.
McRoberts, C., Burlingame, G. M., & Hoag, M. J. (1998) · Group Dynamics: Theory, Research, and Practice · doi:10.1037/1089-2699.2.2.101 · Cited by 253 · cited 1×
“Alternative therapeutic contexts, such as group therapy, were also underrepresented despite validated in-person efficacy [73].”
Morland, L. A., Mackintosh, M.-A., Greene, C. J., Rosen, C. S., Chard, K. M., Resick, P., & Frueh, B. C. (2014) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.13m08842 · Cited by 234 · cited 1×
“These studies discussed access to psychotherapy in various populations, including rural veterans [54-56], psychiatric outpatients living in remote areas [30], and ethnically diverse women living in underserved rural and urban areas [31].”
A randomized trial of telepsychiatry for post-traumatic stress disorder
Frueh, B. C., Monnier, J., Yim, E., Grubaugh, A. L., Hamner, M. B., & Knapp, R. G. (2007) · Journal of Telemedicine and Telecare · doi:10.1258/135763307780677604 · Cited by 220
Socioeconomic Disparities in Patient Use of Telehealth During the Coronavirus Disease 2019 Surge
Darrat, I., Tam, S., Boulis, M., & Williams, A. M. (2021) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2020.5161 · Cited by 219 · cited 1×
“…studies did not account for gender and cultural identity, economic background, or other equity, diversity, and inclusion factors to improve treatment appropriateness for participants, which may impact other indices of quality (acceptability, effectiveness, accessibility, and safety) [75-77].”
Evidence-based apps? A review of mental health mobile applications in a psychotherapy context
Lui, J. H. L., Marcus, D. K., & Barry, C. T. (2017) · Professional Psychology Research and Practice · doi:10.1037/pro0000122 · Cited by 217
Gros, D. F., Yoder, M., Tuerk, P. W., Lozano, B. E., & Acierno, R. (2011) · Behavior Therapy · doi:10.1016/j.beth.2010.07.005 · Cited by 211
Mitchell, J. E., Crosby, R. D., Wonderlich, S. A., Crow, S., Lancaster, K., Simonich, H., Swan-Kremeier, L., Lysne, C., & Cook Myers, T. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2008.02.004 · Cited by 210
Tuerk, P. W., Yoder, M., Ruggiero, K. J., Gros, D. F., & Acierno, R. (2010) · Journal of Traumatic Stress · doi:10.1002/jts.20494 · Cited by 209
Batastini, A. B., Paprzycki, P., Jones, A. C. T., & MacLean, N. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101944 · Cited by 181 · cited 1×
“This is not surprising, given its fundamental importance to treatment, the rapidly growing and relatively nascent nature of this practice, the brisk evolution of technologies, and the impact of the COVID-19 pandemic [71].”
Egede, L. E., Acierno, R., Knapp, R. G., Lejuez, C., Hernandez-Tejada, M., Payne, E. H., & Frueh, B. C. (2015) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00122-4 · Cited by 177
Morland, L. A., Mackintosh, M.-A., Rosen, C. S., Willis, E., Resick, P., Chard, K., & Frueh, B. C. (2015) · Depression and Anxiety · doi:10.1002/da.22397 · Cited by 176
Cuevas, C. D. L., Arredondo, M. T., Cabrera, M. F., Sulzenbacher, H., & Meise, U. (2006) · Telemedicine and e-Health · doi:10.1089/tmj.2006.12.341 · Cited by 173 · cited 1×
“These studies discussed access to psychotherapy in various populations, including rural veterans [54-56], psychiatric outpatients living in remote areas [30], and ethnically diverse women living in underserved rural and urban areas [31].”
Germain, V., Marchand, A., Bouchard, S., Drouin, M., & Guay, S. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070802473494 · Cited by 172
Murphy, L., Markey, K., O' Donnell, C., Moloney, M., & Doody, O. (2021) · Archives of Psychiatric Nursing · doi:10.1016/j.apnu.2021.05.002 · Cited by 166
Stubbings, D. R., Rees, C. S., Roberts, L. D., & Kane, R. T. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2564 · Cited by 162
The Therapeutic Alliance in the Treatment of Personality Disorders
BENDER, D. S. (2005) · Journal of Psychiatric Practice · doi:10.1097/00131746-200503000-00002 · Cited by 155 · cited 1×
“These populations are often associated with greater safety risks, service needs, and challenges in forming and maintaining a therapeutic alliance [79].”
Fann, J. R., Bombardier, C. H., Vannoy, S., Dyer, J., Ludman, E., Dikmen, S., Marshall, K., Barber, J., & Temkin, N. (2015) · Journal of Neurotrauma · doi:10.1089/neu.2014.3423 · Cited by 147
Yuen, E. K., Grös, D. F., Price, M., Zeigler, S., Tuerk, P. W., Foa, E. B., & Acierno, R. E. (2015) · Journal of Clinical Psychology · doi:10.1002/jclp.22168 · Cited by 145
Brenes, G. A., Danhauer, S. C., Lyles, M. F., Hogan, P. E., & Miller, M. E. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.1154 · Cited by 142
Group cognitive processing therapy delivered to veterans via telehealth: A pilot cohort
Morland, L. A., Hynes, A. K., Mackintosh, M., Resick, P. A., & Chard, K. M. (2011) · Journal of Traumatic Stress · doi:10.1002/jts.20661 · Cited by 139
Békés, V., Aafjes-van Doorn, K., Luo, X., Prout, T. A., & Hoffman, L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.705699 · Cited by 134 · cited 2×
“This gap in research should be addressed, as much of the hesitancy regarding wider use and implementation comes from therapists themselves [74].”
Thomas, N., McDonald, C., de Boer, K., Brand, R. M., Nedeljkovic, M., & Seabrook, L. (2021) · Psychology and Psychotherapy: Theory, Research and Practice · doi:10.1111/papt.12332 · Cited by 132 · cited 1×
“…delivered through videoconferencing were effective and easy to access for patients; in particular, there was strong evidence supporting the use of cognitive behavioral therapy (CBT) delivered through videoconferencing for posttraumatic stress disorder (PTSD) and depression treatment [9].”
Dobkin, R. D., Mann, S. L., Gara, M. A., Interian, A., Rodriguez, K. M., & Menza, M. (2020) · Neurology · doi:10.1212/wnl.0000000000009292 · Cited by 127
Dennis, C.-L., Grigoriadis, S., Zupancic, J., Kiss, A., & Ravitz, P. (2020) · The British Journal of Psychiatry · doi:10.1192/bjp.2019.275 · Cited by 119 · cited 1×
“These studies discussed access to psychotherapy in various populations, including rural veterans [54-56], psychiatric outpatients living in remote areas [30], and ethnically diverse women living in underserved rural and urban areas [31].”
Acceptance based behavior therapy for social anxiety disorder through videoconferencing
Yuen, E. K., Herbert, J. D., Forman, E. M., Goetter, E. M., Juarascio, A. S., Rabin, S., Goodwin, C., & Bouchard, S. (2013) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2013.03.002 · Cited by 117
Telepsychotherapy for generalized anxiety disorder: Impact on the working alliance.
Watts, S., Marchand, A., Bouchard, S., Gosselin, P., Langlois, F., Belleville, G., & Dugas, M. J. (2020) · Journal of Psychotherapy Integration · doi:10.1037/int0000223 · Cited by 117
Germain, V., Marchand, A., Bouchard, S., Guay, S., & Drouin, M.-S. (2009) · CyberPsychology & Behavior · doi:10.1089/cpb.2009.0139 · Cited by 105
Perceived risks and use of psychotherapy via telemedicine for patients at risk for suicide
Gilmore, A. K., & Ward-Ciesielski, E. F. (2019) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x17735559 · Cited by 104 · cited 1×
“Similarly, the barriers and facilitators for clinician confidence and capacity to assess and manage safety digitally, given the lack of physical presence in the patient’s environment, are understudied [80,81].”
Maieritsch, K. P., Smith, T. L., Hessinger, J. D., Ahearn, E. P., Eickhoff, J. C., & Zhao, Q. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x15596109 · Cited by 97
Morland, L. A., Mackintosh, M., Glassman, L. H., Wells, S. Y., Thorp, S. R., Rauch, S. A. M., Cunningham, P. B., Tuerk, P. W., Grubbs, K. M., Golshan, S., et al. (2019) · Depression and Anxiety · doi:10.1002/da.22979 · Cited by 96
Griffiths, L., Blignault, I., & Yellowlees, P. (2006) · Journal of Telemedicine and Telecare · doi:10.1258/135763306776738567 · Cited by 94
Matsumoto, K., Sutoh, C., Asano, K., Seki, Y., Urao, Y., Yokoo, M., Takanashi, R., Yoshida, T., Tanaka, M., Noguchi, R., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/12091 · Cited by 83
Five Crucial Challenges in Digital Health
Cummins, N., & Schuller, B. W. (2020) · Frontiers in Digital Health · doi:10.3389/fdgth.2020.536203 · Cited by 83 · cited 1×
“Synchronous web-based delivery of mental health services (mental health care delivered by a health care provider over the phone or through web-based videoconference in real time) is not a novel concept [6].”
Bouchard, S., Payeur, R., Rivard, V., Allard, M., Paquin, B., Renaud, P., & Goyer, L. (2000) · CyberPsychology & Behavior · doi:10.1089/109493100452264 · Cited by 82
Brenes, G. A., Miller, M. E., Williamson, J. D., McCall, W. V., Knudson, M., & Stanley, M. A. (2012) · The American Journal of Geriatric Psychiatry · doi:10.1097/jgp.0b013e31822ccd3e · Cited by 77
Vogel, P. A., Solem, S., Hagen, K., Moen, E. M., Launes, G., Håland, Å. T., Hansen, B., & Himle, J. A. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.10.007 · Cited by 77
Long-Term Effects of Telephone-Delivered Psychotherapy for Late-Life GAD
Brenes, G. A., Danhauer, S. C., Lyles, M. F., Anderson, A., & Miller, M. E. (2017) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2017.05.013 · Cited by 77
Frew, Q., Rennekampff, H.-O., Dziewulski, P., Moiemen, N., Zahn, T., & Hartmann, B. (2019) · Burns · doi:10.1016/j.burns.2018.10.019 · Cited by 71
Goetter, E. M., Herbert, J. D., Forman, E. M., Yuen, E. K., & Thomas, J. G. (2014) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2014.05.004 · Cited by 70
Liu, L., Thorp, S. R., Moreno, L., Wells, S. Y., Glassman, L. H., Busch, A. C., Zamora, T., Rodgers, C. S., Allard, C. B., Morland, L. A., et al. (2020) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x19853947 · Cited by 70
Jones, C., Miguel-Cruz, A., Smith-MacDonald, L., Cruikshank, E., Baghoori, D., Kaur Chohan, A., Laidlaw, A., White, A., Cao, B., Agyapong, V., et al. (2020) · JMIR mHealth and uHealth · doi:10.2196/22079 · Cited by 62 · cited 1×
“However, caveats surrounding web-based delivery, including clinical, cultural, practical, and privacy and security issues, remain underaddressed [7].”
Self-citationTreatment via videoconferencing: A pilot study of delivery by clinical psychology trainees
Dunstan, D. A., & Tooth, S. M. (2012) · Australian Journal of Rural Health · doi:10.1111/j.1440-1584.2012.01260.x · Cited by 60
Telephone-Administered Cognitive Behavior Therapy for Obsessive-Compulsive Disorder
Taylor, S., Thordarson, D. S., Spring, T., Yeh, A. H., Corcoran, K. M., Eugster, K., & Tisshaw, C. (2003) · Cognitive Behaviour Therapy · doi:10.1080/16506070310003639 · Cited by 55
Bouchard, S., Allard, M., Robillard, G., Dumoulin, S., Guitard, T., Loranger, C., Green-Demers, I., Marchand, A., Renaud, P., Cournoyer, L.-G., et al. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.02164 · Cited by 52
Mohr, D. C., Carmody, T., Erickson, L., Jin, L., & Leader, J. (2011) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0022395 · Cited by 50
Marchand, A., Beaulieu-Prévost, D., Guay, S., Bouchard, S., Drouin, M. S., & Germain, V. (2011) · Journal of Aggression, Maltreatment & Trauma · doi:10.1080/10926771.2011.562479 · Cited by 44
Kirkness, C. J., Cain, K. C., Becker, K. J., Tirschwell, D. L., Buzaitis, A. M., Weisman, P. L., McKenzie, S., Teri, L., Kohen, R., Veith, R. C., et al. (2017) · BMC Research Notes · doi:10.1186/s13104-017-2819-y · Cited by 43 · cited 1×
“For example, one of the reviewed studies that mentions treatment appropriateness emphasized that “culturally appropriate examples and language were used to reflect life experiences and context among African American women” [45].”
Ziemba, S., Bradley, N. S., Landry, L.-A., Roth, C. H., Porter, L. S., & Cuyler, R. N. (2014) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2013.0312 · Cited by 41
Stecker, T., McHugo, G., Xie, H., Whyman, K., & Jones, M. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201300433 · Cited by 40
A positive psychology intervention for patients with bipolar depression: a randomized pilot trial
Celano, C. M., Gomez-Bernal, F., Mastromauro, C. A., Beale, E. E., DuBois, C. M., Auerbach, R. P., & Huffman, J. C. (2020) · Journal of Mental Health · doi:10.1080/09638237.2018.1521942 · Cited by 35
Effectiveness of PTSD telehealth treatment in a VA clinical sample.
Wierwille, J. L., Pukay-Martin, N. D., Chard, K. M., & Klump, M. C. (2016) · Psychological Services · doi:10.1037/ser0000106 · Cited by 31
Junkins, A., Psaros, C., Ott, C., Azuero, A., Lambert, C. C., Cropsey, K. L., Savage, R., Haberer, J. E., Safren, S. A., & Kempf, M.-C. (2020) · Journal of Health Psychology · doi:10.1177/1359105320926526 · Cited by 29
Pilot Study of a Telehealth-Delivered Medication-Augmented Exposure Therapy Protocol for PTSD
Olden, M., Wyka, K., Cukor, J., Peskin, M., Altemus, M. M., Lee, F. S., Finkelstein‐Fox, L., Rabinowitz, T., & Difede, J. (2016) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000000563 · Cited by 27
Heffner, J. L., McClure, J. B., Mull, K. E., Anthenelli, R. M., & Bricker, J. B. (2015) · Bipolar Disorders · doi:10.1111/bdi.12300 · Cited by 24
Pierce, B. S., Perrin, P. B., & McDonald, S. D. (2022) · Psychological Services · doi:10.1037/ser0000435 · Cited by 23 · cited 1×
“A pre–COVID-19 study investigating why psychologists did not use telepsychology in their practice found that concerns surrounding insufficient training, patient safety, and privacy issues were the main deterrents [11].”
Hamatani, S., Numata, N., Matsumoto, K., Sutoh, C., Ibuki, H., Oshiro, K., Tanaka, M., Setsu, R., Kawasaki, Y., Hirano, Y., et al. (2019) · JMIR Formative Research · doi:10.2196/15738 · Cited by 23
Lawn, S., Huang, N., Zabeen, S., Smith, D., Battersby, M., Redpath, P., Glover, F., Venning, A., Cameron, J., & Fairweather‐Schmidt, A. K. (2019) · BMC Psychiatry · doi:10.1186/s12888-018-1987-1 · Cited by 21
Valentine, L. M., Donofry, S. D., Broman, R. B., Smith, E. R., Rauch, S. A., & Sexton, M. B. (2020) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x19832419 · Cited by 21 · cited 1×
“For example, one-third of the included studies were conducted in military populations, who may be more open toward web-based psychotherapy due to fear of encountering trauma-related cues at in-person clinics [64].”
Zentner, K., Gaine, G. S., Ethridge, P., Surood, S., & Abba‐Aji, A. (2022) · JMIR Formative Research · doi:10.2196/35535 · Cited by 17 · cited 1×
“These research gaps may contribute to mental health clinicians favoring in-person services more often than web-based services [10], exacerbating clinician hesitancy to provide web-based care.”
Mayer, T. K., Koehler, A., Eyssel, J., & Nieder, T. O. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8050749 · Cited by 16
Smith‐MacDonald, L., Jones, C., Sevigny, P. R., White, A. A., Laidlaw, A., Voth, M., Mikolas, C., Heber, A., Greenshaw, A. J., & Brémault‐Phillips, S. (2021) · JMIR Formative Research · doi:10.2196/26369 · Cited by 15 · cited 1×
“…questions about relative efficacy, the establishment of therapeutic alliances, acceptance of web-based health, technical connectivity challenges, patient privacy and confidentiality, software and equipment availability, usability and reliability, associated costs, and regulatory concerns [8].”
Self-citationCultural and Practical Implications for Psychiatric Telehealth Services: A Response to COVID-19
Goldin, D., Maltseva, T., Scaccianoce, M., & Brenes, F. (2021) · Journal of Transcultural Nursing · doi:10.1177/1043659620973069 · Cited by 14 · cited 1×
“For example, White and African American populations in the United States generally interpret direct eye contact as a sign of respect, while individuals of Native American, Hispanic, and Asian cultures may consider direct eye contact to be disrespectful or rude [78].”
Cowell, J., & Harvie, M. (2012) · Healthcare Management Forum · doi:10.1016/j.hcmf.2012.09.011 · Cited by 4 · cited 1×
“As such, we chose to analyze the literature through the lens of the Alberta Quality Matrix for Health (AQMH) [12], a standardized and validated tool providing holistic evaluation of health systems from patient, provider, and institutional perspectives.”
Shallow groundwater quality at a beef feedlot in southern Alberta.
Alberta Agriculture and Forestry, E., Köhn, J., Iwanyshyn, M., Natural Resources Conservation Board, C., Miedema, L., Alberta Agriculture and Forestry, L., Olson, B. M., Alberta Agriculture and Forestry, L., Kalischuk, A. R., & Alberta Agriculture and Forestry, L. (2016) · Canadian Biosystems Engineering · doi:10.7451/cbe.2016.58.1.11 · Cited by 4
Research works printed but not linked: 2
- Covidence systematic review softwareVeritas Health Innovation2021-03-18https://www.covidence.org/
- First, MB, 2022, Diagnostic and Statistical Manual of Mental Disorders DSM-5-TR: Fifth Edition
Cited by
Wüllner, S., Hecker, T., Flottmann, P., & Hermenau, K. (2025) · PLOS mental health. · doi:10.1371/journal.pmen.0000270 · Cited by 3
“As a large proportion of e-mental health is based on CBT [29,30], this could represent a barrier to use for psycho-therapists from other psychotherapeutic approaches and could result in less experience with e-mental health for non-CBT psychotherapists.”
Jakab, M. (2025) · Current Psychology · doi:10.1007/s12144-025-07906-9 · Cited by 4
“The role of digital technologies in psychotherapy has gained scholarly attention particularly during and after the CoV pandemic (Dhaliwal et al., 2023; Tajan et al., 2023) and is a mainstay of psychotherapy science ever since.”
Yap, S., Allen, R. R., Aquin, C., Bright, K. S., Brown, M. R. G., Burback, L., Winkler, O., Jones, C., Hayward, J., Wells, K., et al. (2024) · Healthcare · doi:10.3390/healthcare12191971 · Cited by 4
Self-citationЕФЕКТИВНІ МЕТОДИ ПСИХОЛОГІЧНОЇ РЕАБІЛІТАЦІЇ ВЕТЕРАНІВ ВІЙНИ: НАВЧАЛЬНІ ПРИКЛАДИ ТА КРАЩІ ПРАКТИКИ
Лівандовська, І., Голярдик, Н., & Клімушева, Г. (2024) · Наукові перспективи (Naukovì perspektivi) · doi:10.52058/2708-7530-2024-1(43)-829-840
Virtual Mental Health Counselling
CDA-AMC (2025) · Canadian Journal of Health Technologies · doi:10.51731/cjht.25.1061
Metadata
- Authors
- Dhaliwal, R., Yap, S., Talarico, F., Al-Shamali, H., Mcweeny, R., Reeson, M., Shalaby, R., Chen, T., Spronk, E., Snodgrass, R., Tu, E., Erick, T., Marshall, T., Kennedy, M., Greenshaw, A. J., Winkler, O., & Burback, L.
- Affiliations
- University of Alberta (CA)
- Corresponding author
- Burback, Lisa
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2023-11-03
- Volume
- 25
- Pages
- e40710
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC10656669
- OpenAlex
- W4387547555
- Cited by
- 8
- References
- 78
- Citations by year
- 2025: 5 · 2024: 3
- FWCI
- 0.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- external beam radiotherapy, remote psychotherapy, mental illness, quality of care, treatment effectiveness, acceptability, treatment safety, post-traumatic stress disorder, mood and anxiety disorders, cognitive behavioral therapy, exposure therapy, COVID-19 pandemic, knowledge gaps, treatment accessibility, treatment appropriateness, treatment efficiency
- MeSH terms
- Adult, Anxiety Disorders, Humans, Psychotherapy, Stress Disorders, Post-Traumatic, Internet, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
