Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index; 24 of the 32 sources its claims cite were checked for support.
Abstract
Objective: There is strong evidence supporting internet-delivered cognitive behaviour therapy (iCBT) and consequently growing demand for iCBT in Canada. Transdiagnostic iCBT that addresses both depression and anxiety is particularly promising as it represents an efficient method of delivering iCBT in routine care. The Online Therapy Unit, funded by the Saskatchewan government, has been offering transdiagnostic iCBT for depression and anxiety since 2013. In this article, to broadly inform implementation efforts, we examined trends in utilization, patient characteristics, and longitudinal improvements for patients receiving transdiagnostic iCBT over 6 years. Methods: Patients who completed telephone screening between November 2013 and December 2019 were included in this observational study. Patients provided demographics and mental health history at screening and completed measures at pre-treatment, post-treatment and at 3- to 4-month follow-up. Treatment engagement and satisfaction were assessed. Results: A total of 5,321 telephone screenings were completed and 4,283 of patients were accepted for treatment over the 6-year period (80.5% acceptance). The most common reason for referral to another service was high suicide risk/severe symptoms (47.1%). Examination of trends showed growing use of transdiagnostic iCBT over time (37% increase per year). There was remarkable stability in patient characteristics across years. Most patients were concurrently using medication (57.3%) with 11.9% reporting using iCBT while on a waiting list for face-to-face treatment highlighting the importance of integrating iCBT with other services. Consistent across years, large improvements in depression and anxiety symptoms were found and maintained at 3- to 4-month follow-up. There was strong patient engagement with iCBT and positive ratings of treatment experiences. Conclusions: As there is growing interest in iCBT in Canada, this large observational study provides valuable information for those implementing iCBT in terms of likely user characteristics, patterns of use, and improvements. This information has potential to assist with resource allocation and planning in Canada and elsewhere. © The Author(s) 2021.
Overview
CoChat Summary
## TL;DR
This 6-year observational study of Saskatchewan’s publicly funded transdiagnostic iCBT program found rising use, stable patient characteristics, and consistently large symptom improvements that were maintained at 3- to 4-month follow-up. The program also showed high engagement and satisfaction, but many patients used iCBT alongside medication or other services.
## Key findings
- Over 6 years, 5,321 telephone screenings were completed and 4,283 patients were accepted for treatment, an 80.5% acceptance rate; treatment use grew by 37% per year, with the Online Therapy Unit showing average annual increases of 37.7% in screenings and 35.3% in starts.
- Patient characteristics were largely stable across years; 83.7% (n = 3,352) had depression and/or anxiety in the clinical range, 60.7% (n = 2,290) reported psychotropic medication use in the last 3 months, and 57.3% were concurrently using medication.
- Symptom outcomes improved significantly on all measures at post-treatment and were maintained at follow-up; among those in the clinical range, effect sizes were large for all post-treatment and follow-up measures except social anxiety, which had a moderate post-treatment effect.
- Recovery and deterioration rates reported in the discussion were 55.7% for depression recovery, 58.7% for anxiety recovery, 1.3% for depression deterioration, and 1.7% for anxiety deterioration; engagement was high, with 80.4% (n = 3,217) accessing at least 4 lessons and 96.3% saying the course was worth their time.
## Methods
- Uncontrolled observational cohort analysis of patients who requested iCBT between November 2013 and December 2019; the paper combines data across and between several registered trials of the Wellbeing Course.
- Patients completed online screening and telephone screening, then provided pre-treatment, 8-week/post-treatment, and 3- to 4-month follow-up measures; treatment engagement and satisfaction were also assessed.
- Analyses used chi-square tests for categorical yearly trends, ANOVA for continuous trends, and generalized estimating equation (GEE) models for symptom change from baseline to post-treatment to follow-up, with missing data imputed.
## Limitations
- The paper states that post-treatment and follow-up data were missing for approximately 30% and 40% of patients, respectively, although it used imputation.
- The study had no control group, used self-report measures rather than diagnostic interviews, and did not track key demographics such as gender and sexual orientation, so some groups may be under-represented.
- The paper also notes that healthcare-use data were only collected in a subsample and with a brief measure, so it could not fully determine whether iCBT reduced use of other services; it did not track additional resource use either.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
14 Valid · 3 Not valid · 5 Not checked · 58 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Examining trends also adds to evidence regarding iCBT in routine care as there are few reports of iCBT outcomes sustained over longer periods after initial implementation efforts conclude. 35”
§ Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years > Introduction
What the sources say
- Partly supportedcites [35] Mohr DC Riper H Schueller SM. A solution-focused research approach to achieve an implementable revolution in digital mental health. JAMA Psychiatry. 2018; 75(2): 113– 114. 29238805 sourceExperimental — accuracy not yet measured
The Sustainable Implementation section (page not available) says funded research often ends with publication of an efficacy trial and argues for sustaining digital mental health interventions after research support is withdrawn. It does not say that reports of long-term iCBT outcomes after initial implementation efforts are few. (LLM, conf=0.78)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A considerable number of patients met criteria for recovery (55.7% for depression; 58.7% for anxiety), and deterioration rates were very low (1.3% for depression; 1.7% for anxiety).”
§ Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Table 2 shows baseline symptom severity for patients who started iCBT each year remained stable (Supplementary Material Table 2 also shows the clinical profile was stable across trials).”
§ Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years > Results > Clinical Profile at Screening
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There were no differences in patient characteristics over time, except for the proportion who indicated having children (range: 51.0% to 63.8%).”
§ Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years > Results > Background
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For the sub-sample who completed healthcare questions at screening (n = 655) and follow-up (n = 453), there was no change in the proportion of patients who reported visits to a psychiatrist (16.6% vs. 16.6%), mental health professional (27% vs. 21.6%), medical or health professional (7.2% vs. 4.9%), or having an emergency room/hospital admission (4.7% vs. 2.6%).”
§ Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years > Results > Secondary Analysis of Healthcare Use
plainn = 453- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
34 more claims
Create a free account to see all 80 claims and every source verdict.
- Probably not a substantial claim. 27
- It may state two separate claims as one. 22
- The quote only partly states this claim. 1
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentχ²(1) = 88.16reported p < .001 · recomputed p < .001
“χ2 (1, N = 655) = 88.16, p < .001”
- Consistentχ²(1) = 81.82reported p < .001 · recomputed p < .001
“χ2 (1, N = 655) = 81.82, p < .001”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · cited 1×
“The PHQ-9 is a 9-item questionnaire assessing depression over the past 2 weeks (range 0 to 27).(36) Scoring 10 suggests a likely depression diagnosis.”
BackgroundA Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 1×
“The GAD-7 is a 7-item questionnaire measuring anxiety over the past 2 weeks (range 0 to 21).(37) Scoring 8 suggests a likely generalized anxiety disorder diagnosis.”
BackgroundVos, T., Abajobir, A. A., Abate, K. H., Abbafati, C., Abbas, K. M., Abd-Allah, F., Abdulkader, R. S., Abdulle, A. M., Abebo, T. A., Abera, S. F., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)32154-2 · Cited by 13,220
KESSLER, R. C., ANDREWS, G., COLPE, L. J., HIRIPI, E., MROCZEK, D. K., NORMAND, S.-L. T., WALTERS, E. E., & ZASLAVSKY, A. M. (2002) · Psychological Medicine · doi:10.1017/s0033291702006074 · Cited by 10,327 · cited 1×
“The K10 includes10 items of psychological distress (ranges 10 to 50).(42) Score > 21 suggests significant distress.”
BackgroundManea, L., Gilbody, S., & McMillan, D. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.110829 · Cited by 1,966
Development and validation of a revised short version of the working alliance inventory
Hatcher, R. L., & Gillaspy, J. A. (2006) · Psychotherapy Research · doi:10.1080/10503300500352500 · Cited by 1,355 · cited 1×
“The 12-item WAI-SR, administered at 8 weeks, resulted in a total working alliance score (range 15 to 60), and task, goal, and bond sub-scores (range 5 to 20).(44)”
MethodPersuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 1×
“, therapist, psychologist) to offer support via weekly asynchronous emails and or telephone calls(10) and for programs to include persuasive design features such as automated emails.(12) While iCBT research emerged over 20 years ago,(13) within Canada, there has been limited access to publicly funded therapist-assiste…”
BackgroundHubbard (2010) · doi:10.1097/ede.0b013e3181caeb90 · Cited by 1,139
Barriers to mental health treatment: results from the National Comorbidity Survey Replication
Mojtabai, R., Olfson, M., Sampson, N. A., Jin, R., Druss, B., Wang, P. S., Wells, K. B., Pincus, H. A., & Kessler, R. C. (2011) · Psychological Medicine · doi:10.1017/s0033291710002291 · Cited by 951 · cited 1×
“, stigma) barriers to treatment.(3) Public health crises, like COVID-19, highlight the need for digital mental health treatments.”
BackgroundThe COVID-19 pandemic: the ‘black swan’for mental health care and a turning point for e-health
Wind, T. R., Rijkeboer, M., Andersson, G., & Riper, H. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100317 · Cited by 782 · cited 1×
“Public health crises, like COVID-19, highlight the need for digital mental health treatments.(4) Consequently, the Canadian government announced “an investment of $240.”
BackgroundInternet-delivered psychological treatments: from innovation to implementation
Andersson, G., Titov, N., Dear, B. F., Rozental, A., & Carlbring, P. (2019) · World Psychiatry · doi:10.1002/wps.20610 · Cited by 750
Self-citationReliability of the self-report version of the panic disorder severity scale
Houck, P. R., Spiegel, D. A., Shear, M. K., & Rucci, P. (2002) · Depression and Anxiety · doi:10.1002/da.10049 · Cited by 406 · cited 1×
“The PDSS-SR is 7-item panic disorder questionnaire (ranges 0 to 28).(39) Scoring 8 suggests a likely panic disorder diagnosis.”
MethodPeters, L., Sunderland, M., Andrews, G., Rapee, R. M., & Mattick, R. P. (2012) · Psychological Assessment · doi:10.1037/a0024544 · Cited by 379 · cited 2×
“SIAS-6 7 and SPS-6 2 suggest a likely social anxiety disorder diagnosis.(41)”
BackgroundEtzelmueller, A., Vis, C., Karyotaki, E., Baumeister, H., Titov, N., Berking, M., Cuijpers, P., Riper, H., & Ebert, D. D. (2020) · Journal of Medical Internet Research · doi:10.2196/18100 · Cited by 356
Self-citationAndersson, G., Carlbring, P., Titov, N., & Lindefors, N. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719839381 · Cited by 324 · cited 1×
“This study did not include a control group, although previous RCTs on the Wellbeing Course,(54) and many randomized controlled trials of iCBT have been undertaken.(6) Self-report measures were used rather than diagnostic interviews and key demographic characteristics (e.”
MethodSelf-citationInternet interventions: Past, present and future
Andersson, G. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.03.008 · Cited by 315
Hedman, E., Ljótsson, B., Kaldo, V., Hesser, H., El Alaoui, S., Kraepelien, M., Andersson, E., Rück, C., Svanborg, C., Andersson, G., et al. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.10.023 · Cited by 224
Titov, N., Dear, B. F., Staples, L. G., Terides, M. D., Karin, E., Sheehan, J., Johnston, L., Gandy, M., Fogliati, V. J., Wootton, B. M., et al. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.08.002 · Cited by 223
Self-citationSunderland, A., & Findlay, L. (2013) · PubMed · Cited by 218
A Solution-Focused Research Approach to Achieve an Implementable Revolution in Digital Mental Health
Mohr, D. C., Riper, H., & Schueller, S. M. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.3838 · Cited by 204 · cited 2×
“Examining trends also adds to evidence regarding iCBT in routine care as there are few reports of iCBT outcomes sustained over longer periods after initial implementation efforts conclude.(35) Research questions explored in this study were as follows: What growth will be observed in iCBT over time? Will users of iCBT…”
BackgroundTitov, N., Dear, B. F., Staples, L. G., Bennett-Levy, J., Klein, B., Rapee, R. M., Shann, C., Richards, D., Andersson, G., Ritterband, L., et al. (2015) · Psychiatric Services · doi:10.1176/appi.ps.201400477 · Cited by 181 · cited 2×
“, assertiveness, beliefs, communication, managing emergencies, mental skills, panic, post-traumatic stress, sleep, and structured problem solving/worry time) are also openly accessible throughout treatment.(11) 194 The Canadian Journal of Psychiatry 67(3)”
BackgroundMethodSelf-citationNewby, J. M., Mackenzie, A., Williams, A. D., McIntyre, K., Watts, S., Wong, N., & Andrews, G. (2013) · Psychological Medicine · doi:10.1017/s0033291713000111 · Cited by 181
The Effectiveness of Online Cognitive Behavioral Treatment in Routine Clinical Practice
Ruwaard, J., Lange, A., Schrieken, B., Dolan, C. V., & Emmelkamp, P. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040089 · Cited by 173
Mental wellness in Canada’s Aboriginal communities: striving toward reconciliation
Boksa, P., Joober, R., & Kirmayer, L. J. (2015) · Journal of Psychiatry & Neuroscience · doi:10.1503/jpn.150309 · Cited by 172
Hedman, E., Ljótsson, B., Rück, C., Bergström, J., Andersson, G., Kaldo, V., Jansson, L., Andersson, E., Andersson, E., Blom, K., et al. (2013) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12079 · Cited by 144
Mojtabai, R., & Jorm, A. F. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.12.039 · Cited by 138
Titov, N., Dear, B. F., Nielssen, O., Wootton, B., Kayrouz, R., Karin, E., Genest, B., Bennett-Levy, J., Purtell, C., Bezuidenhout, G., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30224-7 · Cited by 108 · cited 4×
“Scoring 8 suggests a likely generalized anxiety disorder diagnosis.(33)”
BackgroundMethodInfluentialSelf-citationHadjistavropoulos, H. D., Nugent, M. M., Alberts, N. M., Staples, L., Dear, B. F., & Titov, N. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.05.006 · Cited by 103
Self-citationHadjistavropoulos, H. D., Nugent, M. M., Dirkse, D., & Pugh, N. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1496-7 · Cited by 94 · cited 1×
“Past research on the Wellbeing Course has shown outcomes are strong whether delivered by therapists who specialise in iCBT or by therapists who primarily deliver face-to-face treatment.(15,16) Furthermore, outcomes are comparable with varying support (i.”
ResultSelf-citationFriesen, L. N., Hadjistavropoulos, H. D., Schneider, L. H., Alberts, N. M., Titov, N., & Dear, B. F. (2017) · Pain · doi:10.1097/j.pain.0000000000000802 · Cited by 89
Self-citationHarris, M. G., Baxter, A. J., Reavley, N., Diminic, S., Pirkis, J., & Whiteford, H. A. (2016) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796015000876 · Cited by 71
Hadjistavropoulos, H. D., Schneider, L. H., Edmonds, M., Karin, E., Nugent, M. N., Dirkse, D., Dear, B. F., & Titov, N. (2017) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2017.09.006 · Cited by 71
Self-citationKarin, E., Dear, B. F., Heller, G. Z., Gandy, M., & Titov, N. (2018) · JMIR Mental Health · doi:10.2196/10200 · Cited by 69
Self-citationHadjistavropoulos, H. D., Schneider, L. H., Klassen, K., Dear, B. F., & Titov, N. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2018.1457079 · Cited by 61
Self-citationVigo, D., Haro, J. M., Hwang, I., Aguilar-Gaxiola, S., Alonso, J., Borges, G., Bruffaerts, R., Caldas-de-Almeida, J. M., de Girolamo, G., Florescu, S., et al. (2022) · Psychological Medicine · doi:10.1017/s0033291720003797 · Cited by 60
Reese, R. J., Duncan, B. L., Bohanske, R. T., Owen, J. J., & Minami, T. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0036915 · Cited by 55
Romijn, G., Batelaan, N., Kok, R., Koning, J., van Balkom, A., Titov, N., & Riper, H. (2019) · Journal of Medical Internet Research · doi:10.2196/11706 · Cited by 52
Self-citationHadjistavropoulos, H. D., Schneider, L. H., Mehta, S., Karin, E., Dear, B. F., & Titov, N. (2019) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2019.02.002 · Cited by 46
Self-citationAllen, A. R., Newby, J. M., Mackenzie, A., Smith, J., Boulton, M., Loughnan, S. A., & Andrews, G. (2016) · BJPsych Open · doi:10.1192/bjpo.bp.115.001826 · Cited by 43 · cited 1×
“Scoring 8 suggests a likely panic disorder diagnosis.(40)”
BackgroundSchneider, L. H., Hadjistavropoulos, H. D., Dear, B. F., & Titov, N. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100324 · Cited by 43
Self-citationHadjistavropoulos, H. D., Peynenburg, V., Nugent, M., Karin, E., Titov, N., & Dear, B. F. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100347 · Cited by 32 · cited 1×
“Importantly, this past research shows increasing therapist support beyond once weekly does not improve effects and in fact is associated with higher costs and operational challenges.(20,21)”
BackgroundSelf-citationChiu, M., Gatov, E., Vigod, S. N., Amartey, A., Saunders, N. R., Yao, Z., Pequeno, P., & Kurdyak, P. (2018) · The Canadian Journal of Psychiatry · doi:10.1177/0706743717748926 · Cited by 31
Dirkse, D., Hadjistavropoulos, H. D., Alberts, N. A., Karin, E., Schneider, L. H., Titov, N., & Dear, B. F. (2020) · Journal of Cancer Survivorship · doi:10.1007/s11764-019-00810-9 · Cited by 29
Self-citationMehta, S., Hadjistavropoulos, H., Nugent, M., Karin, E., Titov, N., & Dear, B. F. (2020) · Spinal Cord · doi:10.1038/s41393-019-0398-6 · Cited by 27
Self-citationHadjistavropoulos, H. D., Peynenburg, V., Thiessen, D. L., Nugent, M., Adlam, K., Owens, K. M. B., Karin, E., Dear, B. F., & Titov, N. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100357 · Cited by 25
Self-citationHadjistavropoulos, H. D., Schneider, L. H., Hadjistavropoulos, T., Titov, N., & Dear, B. F. (2018) · Canadian Journal of Pain · doi:10.1080/24740527.2018.1442675 · Cited by 18
Self-citationHadjistavropoulos, H. D., Gullickson, K. M., Schneider, L. H., Dear, B. F., & Titov, N. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100255 · Cited by 17 · cited 1×
“Importantly, this past research shows increasing therapist support beyond once weekly does not improve effects and in fact is associated with higher costs and operational challenges.(20,21)”
BackgroundSelf-citationHadjistavropoulos, H. D., Williams, J. L., Adlam, K., Spice, K., Nugent, M., Owens, K., Sundström, C., Dear, B. F., & Titov, N. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100309 · Cited by 10
Self-citationSundström, C., Hadjistavropoulos, H., Wilhelms, A., Keough, M., & Schaub, M. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02506-2 · Cited by 7 · cited 1×
“Across trials, therapists follow a treatment manual; regular audit and feedback is used to ensure compliance with procedures.(24)”
MethodSelf-citationInternet-delivered Cognitive Behaviour Therapy (ICBT) for Post-secondary Students
(2020) · Case Medical Research · doi:10.31525/ct1-nct04264585 · Cited by 2 · cited 1×
“Still, other trials have studied therapist behaviours in iCBT(21-23) and outcomes of iCBT for alcohol misuse,(24) for various chronic health conditions,(25-30) and for specific populations like postpartum depression/ anxiety(31) or university students.(32) With the growing imperative to offer iCBT in Canada, the purpo…”
Background(2019) · Case Medical Research · doi:10.31525/ct1-nct04012580 · Cited by 1
Research works printed but not linked: 2
- Canadian Agency for Drugs and Technologies in Health. Internet-delivered cognitive behavioural therapy for major depressive disorder and anxiety disorders: an environmental scan. Environmental Scan. 2018. [ accessed 2020]. https://cadth.ca/internet-delivered-cognitive-behavioural-therapy-major-depressive-disorder-and-anxiety-disorders-1 31454188
- Sheehan DV. The anxiety disease. Scribner, (NY): Bantam Books. 1983.
Cited by
Cross, S. P., Karin, E., Staples, L. G., Bisby, M. A., Ryan, K., Duke, G., Nielssen, O., Kayrouz, R., Fisher, A., Dear, B. F., et al. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100506 · Cited by 57
“DMHS already provide treatment as part of routine care in several countries (Titov et al., 2019a; Titov et al., 2018) (Hadjistavropoulos et al., 2021; Nordgreen et al., 2019; Titov et al., 2019b; Ruwaard et al., * Corresponding author at: MindSpot Clinic, Macquarie University, Sydney, Australia.”
Self-citationEustis, E. H., Graham-LoPresti, J. R., Aguilera, A., & Schueller, S. M. (2023) · Journal of Medical Internet Research · doi:10.2196/45409 · Cited by 31
“As such, TESs for mental health are recommended and used as frontline treatments around the world [4,6,7].”
Staples, L., Webb, N., Asrianti, L., Cross, S. P. M., Rock, D. J., Kayrouz, R., Karin, E., Dear, B. F., Nielssen, O. B., & Titov, N. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19020905 · Cited by 40
Self-citationHarty, S., Enrique, Á., Akkol‐Solakoglu, S., Adegoke, A., Farrell, H., Connon, G., Ward, F., Kennedy, C., Chambers, D., & Richards, D. (2023) · International Journal of Mental Health Systems · doi:10.1186/s13033-023-00592-9 · Cited by 47
“User satisfaction ratings were also very high, exceeding 94% for overall satisfaction, consistent with those reported for Mindspot and another well-established national digital CBT service in Canada [32, 48, 49].”
MethodResultSoucy, J. N., Hadjistavropoulos, H. D., Karin, E., Dear, B. F., & Titov, N. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100394 · Cited by 21
Self-citation
Metadata
- Authors
- Hadjistavropoulos, H. D., Peynenburg, V., Thiessen, D. L., Nugent, M., Karin, E., Staples, L., Dear, B. F., & Titov, N.
- Affiliations
- University of Regina (CA)
- Macquarie University (AU)
- Corresponding author
- Hadjistavropoulos, Heather D.
- ORCID
- Venue
- The Canadian Journal of Psychiatry
- Publisher
- SAGE Publications
- Published
- 2021-04-12
- Volume
- 67
- Issue
- 3
- Pages
- 192-206
- ISSN
- 0706-7437 (ISSN-L)
- 1497-0015
- PMC
- PMC8935601
- OpenAlex
- W3155574916
- Cited by
- 52
- References
- 51
- Citations by year
- 2026: 10 · 2025: 12 · 2024: 13 · 2023: 10 · 2022: 4 · 2021: 3
- FWCI
- 6.66
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- The Canadian Journal of Psychiatry (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- Canadian Institutes of Health Research (152917)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- internet-based cognitive behavioral therapy, transdiagnostic treatment, depression, anxiety, treatment utilization, patient characteristics, treatment engagement, treatment satisfaction, telephone screening, medication use, waiting lists, resource allocation
- MeSH terms
- Anxiety Disorders, Humans, Saskatchewan, Cognitive Behavioral Therapy, Treatment Outcome, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.