The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index; 24 of the 32 sources its claims cite were checked for support.
Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years
Open accessAbstract
Objective: There is strong evidence supporting internet-delivered cognitive behaviour therapy (iCBT) and consequently growing demand for iCBT in Canada. Transdiagnostic iCBT that addresses both depression and anxiety is particularly promising as it represents an efficient method of delivering iCBT in routine care. The Online Therapy Unit, funded by the Saskatchewan government, has been offering transdiagnostic iCBT for depression and anxiety since 2013. In this article, to broadly inform implementation efforts, we examined trends in utilization, patient characteristics, and longitudinal improvements for patients receiving transdiagnostic iCBT over 6 years. Methods: Patients who completed telephone screening between November 2013 and December 2019 were included in this observational study. Patients provided demographics and mental health history at screening and completed measures at pre-treatment, post-treatment and at 3- to 4-month follow-up. Treatment engagement and satisfaction were assessed. Results: A total of 5,321 telephone screenings were completed and 4,283 of patients were accepted for treatment over the 6-year period (80.5% acceptance). The most common reason for referral to another service was high suicide risk/severe symptoms (47.1%). Examination of trends showed growing use of transdiagnostic iCBT over time (37% increase per year). There was remarkable stability in patient characteristics across years. Most patients were concurrently using medication (57.3%) with 11.9% reporting using iCBT while on a waiting list for face-to-face treatment highlighting the importance of integrating iCBT with other services. Consistent across years, large improvements in depression and anxiety symptoms were found and maintained at 3- to 4-month follow-up. There was strong patient engagement with iCBT and positive ratings of treatment experiences. Conclusions: As there is growing interest in iCBT in Canada, this large observational study provides valuable information for those implementing iCBT in terms of likely user characteristics, patterns of use, and improvements. This information has potential to assist with resource allocation and planning in Canada and elsewhere. © The Author(s) 2021.
Overview
CoChat Summary
## TL;DR
This 6-year observational study of Saskatchewan’s publicly funded transdiagnostic iCBT program found rising use, stable patient characteristics, and consistently large symptom improvements that were maintained at 3- to 4-month follow-up. The program also showed high engagement and satisfaction, but many patients used iCBT alongside medication or other services.
## Key findings
- Over 6 years, 5,321 telephone screenings were completed and 4,283 patients were accepted for treatment, an 80.5% acceptance rate; treatment use grew by 37% per year, with the Online Therapy Unit showing average annual increases of 37.7% in screenings and 35.3% in starts.
- Patient characteristics were largely stable across years; 83.7% (n = 3,352) had depression and/or anxiety in the clinical range, 60.7% (n = 2,290) reported psychotropic medication use in the last 3 months, and 57.3% were concurrently using medication.
- Symptom outcomes improved significantly on all measures at post-treatment and were maintained at follow-up; among those in the clinical range, effect sizes were large for all post-treatment and follow-up measures except social anxiety, which had a moderate post-treatment effect.
- Recovery and deterioration rates reported in the discussion were 55.7% for depression recovery, 58.7% for anxiety recovery, 1.3% for depression deterioration, and 1.7% for anxiety deterioration; engagement was high, with 80.4% (n = 3,217) accessing at least 4 lessons and 96.3% saying the course was worth their time.
## Methods
- Uncontrolled observational cohort analysis of patients who requested iCBT between November 2013 and December 2019; the paper combines data across and between several registered trials of the Wellbeing Course.
- Patients completed online screening and telephone screening, then provided pre-treatment, 8-week/post-treatment, and 3- to 4-month follow-up measures; treatment engagement and satisfaction were also assessed.
- Analyses used chi-square tests for categorical yearly trends, ANOVA for continuous trends, and generalized estimating equation (GEE) models for symptom change from baseline to post-treatment to follow-up, with missing data imputed.
## Limitations
- The paper states that post-treatment and follow-up data were missing for approximately 30% and 40% of patients, respectively, although it used imputation.
- The study had no control group, used self-report measures rather than diagnostic interviews, and did not track key demographics such as gender and sexual orientation, so some groups may be under-represented.
- The paper also notes that healthcare-use data were only collected in a subsample and with a brief measure, so it could not fully determine whether iCBT reduced use of other services; it did not track additional resource use either.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
14 Valid · 3 Not valid · 5 Not checked · 58 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Examining trends also adds to evidence regarding iCBT in routine care as there are few reports of iCBT outcomes sustained over longer periods after initial implementation efforts conclude. 35”
§ Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years > Introduction
What the sources say
- Partly supportedcites [35] sourceExperimental — accuracy not yet measured
The Sustainable Implementation section (page not available) says funded research often ends with publication of an efficacy trial and argues for sustaining digital mental health interventions after research support is withdrawn. It does not say that reports of long-term iCBT outcomes after initial implementation efforts are few. (LLM, conf=0.78)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A considerable number of patients met criteria for recovery (55.7% for depression; 58.7% for anxiety), and deterioration rates were very low (1.3% for depression; 1.7% for anxiety).”
§ Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years > Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Table 2 shows baseline symptom severity for patients who started iCBT each year remained stable (Supplementary Material Table 2 also shows the clinical profile was stable across trials).”
§ Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years > Results > Clinical Profile at Screening
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There were no differences in patient characteristics over time, except for the proportion who indicated having children (range: 51.0% to 63.8%).”
§ Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years > Results > Background
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For the sub-sample who completed healthcare questions at screening (n = 655) and follow-up (n = 453), there was no change in the proportion of patients who reported visits to a psychiatrist (16.6% vs. 16.6%), mental health professional (27% vs. 21.6%), medical or health professional (7.2% vs. 4.9%), or having an emergency room/hospital admission (4.7% vs. 2.6%).”
§ Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years > Results > Secondary Analysis of Healthcare Use
plainn = 453- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
34 more claims
Create a free account to see all 80 claims and every source verdict.
- Probably not a substantial claim. 27
- It may state two separate claims as one. 22
- The quote only partly states this claim. 1
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentχ²(1) = 88.16reported p < .001 · recomputed p < .001
“χ2 (1, N = 655) = 88.16, p < .001”
- Consistentχ²(1) = 81.82reported p < .001 · recomputed p < .001
“χ2 (1, N = 655) = 81.82, p < .001”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · cited 1×
“The PHQ-9 is a 9-item questionnaire assessing depression over the past 2 weeks (range 0 to 27).(36) Scoring 10 suggests a likely depression diagnosis.”
BackgroundA Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 1×
“The GAD-7 is a 7-item questionnaire measuring anxiety over the past 2 weeks (range 0 to 21).(37) Scoring 8 suggests a likely generalized anxiety disorder diagnosis.”
BackgroundVos, T., Abajobir, A. A., Abate, K. H., Abbafati, C., Abbas, K. M., Abd-Allah, F., Abdulkader, R. S., Abdulle, A. M., Abebo, T. A., Abera, S. F., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)32154-2 · Cited by 13,220
KESSLER, R. C., ANDREWS, G., COLPE, L. J., HIRIPI, E., MROCZEK, D. K., NORMAND, S.-L. T., WALTERS, E. E., & ZASLAVSKY, A. M. (2002) · Psychological Medicine · doi:10.1017/s0033291702006074 · Cited by 10,327 · cited 1×
“The K10 includes10 items of psychological distress (ranges 10 to 50).(42) Score > 21 suggests significant distress.”
BackgroundManea, L., Gilbody, S., & McMillan, D. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.110829 · Cited by 1,966
Development and validation of a revised short version of the working alliance inventory
Hatcher, R. L., & Gillaspy, J. A. (2006) · Psychotherapy Research · doi:10.1080/10503300500352500 · Cited by 1,355 · cited 1×
“The 12-item WAI-SR, administered at 8 weeks, resulted in a total working alliance score (range 15 to 60), and task, goal, and bond sub-scores (range 5 to 20).(44)”
MethodPersuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 1×
“, therapist, psychologist) to offer support via weekly asynchronous emails and or telephone calls(10) and for programs to include persuasive design features such as automated emails.(12) While iCBT research emerged over 20 years ago,(13) within Canada, there has been limited access to publicly funded therapist-assiste…”
BackgroundHubbard (2010) · doi:10.1097/ede.0b013e3181caeb90 · Cited by 1,139
Barriers to mental health treatment: results from the National Comorbidity Survey Replication
Mojtabai, R., Olfson, M., Sampson, N. A., Jin, R., Druss, B., Wang, P. S., Wells, K. B., Pincus, H. A., & Kessler, R. C. (2011) · Psychological Medicine · doi:10.1017/s0033291710002291 · Cited by 951 · cited 1×
“, stigma) barriers to treatment.(3) Public health crises, like COVID-19, highlight the need for digital mental health treatments.”
BackgroundThe COVID-19 pandemic: the ‘black swan’for mental health care and a turning point for e-health
Wind, T. R., Rijkeboer, M., Andersson, G., & Riper, H. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100317 · Cited by 782 · cited 1×
“Public health crises, like COVID-19, highlight the need for digital mental health treatments.(4) Consequently, the Canadian government announced “an investment of $240.”
Background
Research works printed but not linked: 2
- Sunderland A, 2013, Statistics Canada, 24, 3
- Sheehan DV, 1983, The anxiety disease
Cited by
Cross, S. P., Karin, E., Staples, L. G., Bisby, M. A., Ryan, K., Duke, G., Nielssen, O., Kayrouz, R., Fisher, A., Dear, B. F., et al. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100506 · Cited by 57
“DMHS already provide treatment as part of routine care in several countries (Titov et al., 2019a; Titov et al., 2018) (Hadjistavropoulos et al., 2021; Nordgreen et al., 2019; Titov et al., 2019b; Ruwaard et al., * Corresponding author at: MindSpot Clinic, Macquarie University, Sydney, Australia.”
Self-citationEustis, E. H., Graham-LoPresti, J. R., Aguilera, A., & Schueller, S. M. (2023) · Journal of Medical Internet Research · doi:10.2196/45409 · Cited by 31
“As such, TESs for mental health are recommended and used as frontline treatments around the world [4,6,7].”
Staples, L., Webb, N., Asrianti, L., Cross, S. P. M., Rock, D. J., Kayrouz, R., Karin, E., Dear, B. F., Nielssen, O. B., & Titov, N. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19020905 · Cited by 39
Self-citationHarty, S., Enrique, Á., Akkol‐Solakoglu, S., Adegoke, A., Farrell, H., Connon, G., Ward, F., Kennedy, C., Chambers, D., & Richards, D. (2023) · International Journal of Mental Health Systems · doi:10.1186/s13033-023-00592-9 · Cited by 47
“User satisfaction ratings were also very high, exceeding 94% for overall satisfaction, consistent with those reported for Mindspot and another well-established national digital CBT service in Canada [32, 48, 49].”
MethodResultSoucy, J. N., Hadjistavropoulos, H. D., Karin, E., Dear, B. F., & Titov, N. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100394 · Cited by 21
Self-citation
Metadata
- Authors
- Hadjistavropoulos, H. D., Peynenburg, V., Thiessen, D. L., Nugent, M., Karin, E., Staples, L., Dear, B. F., & Titov, N.
- Affiliations
- University of Regina (CA)
- Macquarie University (AU)
- Corresponding author
- Hadjistavropoulos, Heather D.
- ORCID
- Venue
- The Canadian Journal of Psychiatry
- Publisher
- SAGE Publications
- Published
- 2021-04-12
- Volume
- 67
- Issue
- 3
- Pages
- 192-206
- ISSN
- 0706-7437 (ISSN-L)
- 1497-0015
- PMC
- PMC8935601
- OpenAlex
- W3155574916
- Cited by
- 52
- References
- 51
- Citations by year
- 2026: 10 · 2025: 12 · 2024: 13 · 2023: 10 · 2022: 4 · 2021: 3
- FWCI
- 6.66
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- The Canadian Journal of Psychiatry (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- Canadian Institutes of Health Research (152917)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- internet-based cognitive behavioral therapy, transdiagnostic treatment, depression, anxiety, treatment utilization, patient characteristics, treatment engagement, treatment satisfaction, telephone screening, medication use, waiting lists, resource allocation
- MeSH terms
- Anxiety Disorders, Humans, Saskatchewan, Cognitive Behavioral Therapy, Treatment Outcome, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years. https://app.cochat.ai/papers/10.1177/07067437211006873
- The paper
- Hadjistavropoulos, H. D., Peynenburg, V., Thiessen, D. L., Nugent, M., Karin, E., Staples, L., Dear, B. F., & Titov, N. (2022). Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years. The Canadian Journal of Psychiatry. https://doi.org/10.1177/07067437211006873
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.