Initial Outcomes of Transdiagnostic Internet-Delivered Cognitive Behavioral Therapy Tailored to Public Safety Personnel: Longitudinal Observational Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index; 12 of the 69 sources its claims cite were checked for support.
Abstract
Background: Canadian public safety personnel (PSP) experience high rates of mental health disorders and face many barriers to treatment. Internet-delivered cognitive behavioral therapy (ICBT) overcomes many such barriers, and is effective for treating depression, anxiety, and posttraumatic stress disorder (PTSD) symptoms. Objective: This study was designed to fill a gap in the literature regarding the use of ICBT tailored specifically for PSP. We examined the effectiveness of a tailored ICBT program for treating depression, anxiety, and PTSD symptoms among PSP in the province of Saskatchewan. Methods: We employed a longitudinal single-group open-trial design (N=83) with outcome measures administered at screening and at 8 weeks posttreatment. Data were collected between December 5, 2019 and September 11, 2020. Primary outcomes included changes in depression, anxiety, and PTSD symptoms. Secondary outcomes included changes in functional impairment; symptoms of panic, social anxiety, and anger; as well as treatment satisfaction, working alliance, and program usage patterns. Results: Clients reported large symptom reductions on measures of depression and anxiety, as well as moderate reductions on measures of PTSD and secondary symptoms, except for social anxiety. Most clients who reported symptoms above clinical cut-offs on measures of depression, anxiety, and PTSD during screening experienced clinically significant symptom reductions. Results suggested good engagement, treatment satisfaction, and working alliance. Conclusions: Tailored, transdiagnostic ICBT demonstrated promising outcomes as a treatment for depression, anxiety, and PTSD among Saskatchewan PSP and warrants further investigation. Trial Registration: Clinicaltrials.gov NCT04127032; https://www.clinicaltrials.gov/ct2/show/NCT04127032
Overview
CoChat Summary
## TL;DR
This longitudinal single-group open trial found that a transdiagnostic internet-delivered CBT program tailored to Saskatchewan public safety personnel was associated with improved depression, anxiety, PTSD, panic, anger, and functioning. The paper reports promising satisfaction and engagement, but without a control group the results cannot establish causality.
## Key findings
- Among the first 83 clients, the program showed large effect sizes on the PHQ-9 and GAD-7 and a moderate effect size on the PCL-5.
- In the subset of clients with clinically significant symptoms at screening, the authors found large effect sizes on all three primary measures; for secondary measures, effects were generally moderate to large, except for social anxiety, which showed small effect sizes on the combined SIAS-6/SPS-6.
- Of the 62 clients who completed the working alliance and satisfaction questions, 54/62 (86%) said the course increased or greatly increased their confidence in managing symptoms, and 61/62 (98%) said it was worth their time.
- Program use was strong: 79/83 (95%) accessed Lesson 2, 71/83 (86%) Lesson 3, and 64/83 (77%) each accessed Lessons 4 and 5; mean therapist messaging was 4.98 sent and 9.80 received messages per client.
## Methods
- Design: Longitudinal single-group open-trial study with assessments at screening and 8 weeks posttreatment; analysis followed intention-to-treat principles.
- Sample/data: The study included the first 83 clients who enrolled in the PSP Wellbeing Course between December 5, 2019 and July 2, 2020 in Saskatchewan; eligibility required being 18+, current or former PSP, internet access, an emergency contact, and Saskatchewan residence.
- Main analysis: Missing data were handled with multiple imputation using predictive mean matching, and change from pretreatment to posttreatment was modeled with generalized estimating equations (GEEs) using a gamma distribution with a log-link; effect sizes were summarized with Hedges g and proportional symptom reductions.
## Limitations
- The paper states that data were collected during the COVID-19 pandemic, and that the impact of the pandemic on outcomes is unclear.
- The study had no control condition, so there is no direct evidence that symptom change was attributable to the PSP Wellbeing Course.
- At 8 weeks, missing data remained for 23% of clients on the PHQ-9 and GAD-7 and 25% on the PCL-5; the authors note missingness may reflect a unique subset of clients.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
8 Valid · 1 Not valid · 35 Not checked · 77 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The PSP Wellbeing Course was adapted from a transdiagnostic ICBT program called the Wellbeing Course, which was developed for use in the general population by eCentre Clinic at Macquarie University, Australia [28-32].”
§ Initial Outcomes of Transdiagnostic Internet-Delivered Cognitive Behavioral Therapy Tailored to Public Safety Personnel: Longitudinal Observational Study > Methods > Intervention The PSP Wellbeing Course was adapted from a transdiagnostic ICBT program called the Wellbeing Course, which was developed for use in the general population by eCentre Clinic at Macquarie University, Australia [28-32]. The PSP Wellbeing Course is designed to treat symptoms of depression, anxiety, and PTSD. The course consists of five sequential lessons, which are presented in a slideshow format and focus on (1) introducing the cognitive behavioral model and symptom identification, (2) monitoring and challenging maladaptive thoughts, (3) managing physical symptoms, (4) graded exposure, and (5) relapse prevention. Lesson content is relayed through instructive text, diagrams, and illustrative case stories about PSP. Clients are also given access to downloadable materials, weekly homework assignments, and supplementary resources related to issues not addressed in the lessons (eg, assertiveness, communication, sleep problems). Therapists hold graduate degrees in psychology or social work and provide support to clients by phone or secure email up to twice per week, depending on each client’s preference. Each week, clients complete symptom questionnaires and a reflection questionnaire including both open-ended and closed-ended questions designed to gauge response to the treatment program (eg, what clients worked on; any challenges they encountered; and ratings of helpfulness, understanding, and difficulty). The course is designed to be completed in 8 weeks, but clients are provided with therapist support for up to 16 weeks based on symptoms and preference, and are given access to the course materials for 1 year. We tailored the PSP Wellbeing Course using extensive feedback from PSP stakeholders gleaned through 112 interviews [15] and 132 survey responses [23] (eg, replacing generic case stories and examples used to illustrate treatment concepts with case stories and examples about PSP).
What the sources say
- Partly supportedcites [28] sourceExperimental — accuracy not yet measured
Our copy supports the identification core of the claim: in 2.3 Interventions the Wellbeing Course is described as 'a TD-CBT course' built on 'the Macquarie University Model (MUM) of internet-delivered CBT, which was developed over a large number of clinical trials by the eCentreClinic research group', and the course table note (2.3/Results appendix) confirms it 'was designed in such a way that no specific anxiety or depressive disorder was mentioned throughout the materials'. 2.1 Participants places the eCentreClinic at Macquarie University, Sydney, Australia. However, no passage states the Wellbeing Course was 'developed for use in the general population'; our copy instead says it 'has been previously demonstrated as clinically efficacious in treating symptoms of anxiety and depression' and here was trialled in people meeting criteria for MDD with comorbid anxiety, so that qualifier of the claim is unsupported by this source. (LLM, conf=0.78)
- Not checked yetcites [29] source
- Partly supportedcites [30] sourceExperimental — accuracy not yet measured
Our copy supports the identification part of the claim: Section 2.3 (Interventions) describes 'a TD-CBT course, the Wellbeing Course', an internet-delivered transdiagnostic program previously shown clinically efficacious for symptoms of anxiety and depression, and Table 2/notes confirm it deliberately mentions no specific disorder; Sections 2.1 and 2.3 locate the work at the eCentreClinic under Macquarie University ethics approval, and the Conflict statement records Titov and Dear as authors of the treatment programs. What our copy does not support is 'developed for use in the general population': the course is described throughout as a treatment for adults with anxiety and depression (here, principal panic disorder) recruited via the eCentreClinic, with no statement of general-population development or deployment. The 'PSP Wellbeing Course was adapted from' element is the citing paper's own action and is not stated in this source. (LLM, conf=0.75)
- Partly supportedcites [31] sourceExperimental — accuracy not yet measured
Section 2.3 (Interventions) confirms the identifiable core of the claim: the transdiagnostic (TD-CBT) course is named the Wellbeing Course, and both courses were 'based on the Macquarie University Model (MUM) of internet-delivered CBT, which was developed over a large number of clinical trials by the eCentre-Clinic research group' (with Section 2.1 describing eCentreClinic, www.ecentreclinic.org, as the specialist research unit through which participants applied). However, our copy nowhere says the Wellbeing Course was 'developed for use in the general population': it states the course was 'not designed to treat any specific psychological disorder' and aimed at broad symptoms of psychological distress generally, and that it had 'previously demonstrated as clinically efficacious in treating symptoms of anxiety and depression' (Titov et al. 2012, 2013, 2014) — i.e., a transdiagnostic scope, not a general-population indication; the sampled participants here were treatment-seeking respondents to newspaper/NGO advertisements with elevated symptoms. Searches for 'general population' returned only reference-list entries unrelated to the course's development (Löwe et al. 2008 on GAD-7; McEvoy et al. 2011 epidemiology). (LLM, conf=0.70)
- Partly supportedcites [32] sourceExperimental — accuracy not yet measured
Our copy supports the identification part: Section 2.3 (Interventions) names the Wellbeing Course as the transdiagnostic (TD-CBT) course, delivered as five online lessons over eight weeks, 'not designed to treat any specific psychological disorder' but targeting 'symptoms of psychological distress generally'; Section 2.1 places the delivery unit as the eCentreClinic at Macquarie University, and the Declaration of interest states Titov and Dear are authors of the treatment programs used. What our copy does not support is the qualifier 'developed for use in the general population': the paper describes the Wellbeing Course as previously demonstrated efficacious 'in treating symptoms of anxiety and depression' (Titov et al., 2012-2014) in a treatment-seeking, symptomatic sample recruited through the eCentreClinic, not as a general-population program. That population/purpose element of the attributed claim is absent from this source. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“We tailored the PSP Wellbeing Course using extensive feedback from PSP stakeholders gleaned through 112 interviews [15] and 132 survey responses [23] (eg, replacing generic case stories and examples used to illustrate treatment concepts with case stories and examples about PSP).”
§ Initial Outcomes of Transdiagnostic Internet-Delivered Cognitive Behavioral Therapy Tailored to Public Safety Personnel: Longitudinal Observational Study > Methods > Intervention The PSP Wellbeing Course was adapted from a transdiagnostic ICBT program called the Wellbeing Course, which was developed for use in the general population by eCentre Clinic at Macquarie University, Australia [28-32]. The PSP Wellbeing Course is designed to treat symptoms of depression, anxiety, and PTSD. The course consists of five sequential lessons, which are presented in a slideshow format and focus on (1) introducing the cognitive behavioral model and symptom identification, (2) monitoring and challenging maladaptive thoughts, (3) managing physical symptoms, (4) graded exposure, and (5) relapse prevention. Lesson content is relayed through instructive text, diagrams, and illustrative case stories about PSP. Clients are also given access to downloadable materials, weekly homework assignments, and supplementary resources related to issues not addressed in the lessons (eg, assertiveness, communication, sleep problems). Therapists hold graduate degrees in psychology or social work and provide support to clients by phone or secure email up to twice per week, depending on each client’s preference. Each week, clients complete symptom questionnaires and a reflection questionnaire including both open-ended and closed-ended questions designed to gauge response to the treatment program (eg, what clients worked on; any challenges they encountered; and ratings of helpfulness, understanding, and difficulty). The course is designed to be completed in 8 weeks, but clients are provided with therapist support for up to 16 weeks based on symptoms and preference, and are given access to the course materials for 1 year. We tailored the PSP Wellbeing Course using extensive feedback from PSP stakeholders gleaned through 112 interviews [15] and 132 survey responses [23] (eg, replacing generic case stories and examples used to illustrate treatment concepts with case stories and examples about PSP).
What the sources say
- Not checked yetcites [15] source
- Partly supportedcites [23] sourceExperimental — accuracy not yet measured
Methods §2.2 reports survey data from 132 PSP participants, and §2.3 says the survey asked about their perceptions and preferences. But §2.1 says recruitment began around the time the PSP Wellbeing Course launched; this paper does not say the 132 responses were used to tailor the course. The 112 interviews are attached to a different citation in the citing sentence and are not assessed here. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, mean pretreatment social anxiety symptoms were considerably less severe in the present sample than in the Online Therapy Unit’s clients [63]”
§ Initial Outcomes of Transdiagnostic Internet-Delivered Cognitive Behavioral Therapy Tailored to Public Safety Personnel: Longitudinal Observational Study > Discussion > Principal Findings
What the sources say
- Partly supportedcites [63] sourceExperimental — accuracy not yet measured
Our copy does supply pre-treatment social anxiety severity figures for this trial's sample: 51.8% (n = 307) were above the SIAS-6 ≥7 / SPS-6 ≥2 cut-offs at pre-treatment (Results > Patient background, and Table 1), and estimated marginal pre-treatment SIAS-6/SPS-6 totals were 14.00–15.17 (of 48) across the four factorial arms (Results > Primary outcomes, Table 2). However, that sample is a pragmatic factorial RCT divided between the Online Therapy Unit's iCBT clinic and community clinics (Table 1 column headers: 'Once-weekly support iCBT clinic', 'Community clinic', etc.), so its pooled pre-treatment mean is not a value describing 'the Online Therapy Unit's clients' as such; and the paper nowhere compares its severity with another sample, so the 'considerably less severe in the present sample' contrast is the citing authors' own inference, not something this source states. (LLM, conf=0.68)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Descriptively, these outcomes are comparable to the most recent published outcomes of the Wellbeing Course offered by the Online Therapy Unit to the general population of Saskatchewan [63].”
§ Initial Outcomes of Transdiagnostic Internet-Delivered Cognitive Behavioral Therapy Tailored to Public Safety Personnel: Longitudinal Observational Study > Discussion > Principal Findings
What the sources say
- Supportedcites [63] source
The Methods (Intervention) identify the treatment as the Wellbeing Course licensed by the Online Therapy Unit, and Methods (Patient recruitment) describe recruitment of eligible Saskatchewan residents through the Unit’s website. The Results (Primary outcomes) report the course outcomes. The comparison with the citing paper’s own outcomes is the citing authors’ descriptive judgment, not a comparison attributed to this source. (LLM, conf=0.88)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“PSP participating in this study reported concurrent use of psychotropic medication less frequently than clients of the Wellbeing Course [63].”
§ Initial Outcomes of Transdiagnostic Internet-Delivered Cognitive Behavioral Therapy Tailored to Public Safety Personnel: Longitudinal Observational Study > Discussion > Principal Findings
What the sources say
- Supportedcites [63] source
The Results 'Patient background' section of our copy states that 'The majority of patients reported using psychotropic medication (56.8%; n = 377)', giving the benchmark rate for that cohort. The Methods 'Intervention' section confirms every eligible patient in this trial received the transdiagnostic Wellbeing Course, so these are indeed Wellbeing Course clients. The directional comparison ('less frequently') rests on the citing paper's own PSP sample figures, which are not attributed to this source; the source supplies the comparator value it is cited for. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
41 more claims
Create a free account to see all 121 claims and to verify the 57 references still open.
- Probably not a substantial claim. 60
- It may state two separate claims as one. 26
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“PSP report concerns about engaging in face-to-face mental health treatment options, including geographical barriers; the cost of treatment; difficulty navigating services; long wait times; and, in particular, concerns about privacy, confidentiality, and stigma [6,8-10].”
From Web-Based Mindfulness Meditation as an Adjunct to Internet-Delivered Cognitive Behavioral Therapy for Public Safety Personnel: Mixed Methods Feasibility Evaluation Study (2024) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A recent observational trial found that iCBT tailored specifically for PSP was associated with large pre-post reductions in symptoms of generalized anxiety disorder, major depressive disorder, and posttraumatic stress disorder (PTSD), although it was not compared with a control condition [9].”
From Web-Based Mindfulness Meditation as an Adjunct to Internet-Delivered Cognitive Behavioral Therapy for Public Safety Personnel: Mixed Methods Feasibility Evaluation Study (2024) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“At 8 weeks, 80% (32/40) of the clients in this trial had completed all 5 lessons. Similarly, at 8 weeks, 77% of the clients in a prior study of the original PSP Wellbeing Course had completed the course [9].”
From Web-Based Mindfulness Meditation as an Adjunct to Internet-Delivered Cognitive Behavioral Therapy for Public Safety Personnel: Mixed Methods Feasibility Evaluation Study (2024) · cites this paper as [9]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In terms of therapist engagement, clients in this course sent an average of 5.24 emails and received 9.48 emails from their therapists. In the previous version of the course, on average, clients sent 4.98 (SD 5.53) messages to their therapists and received 9.80 (SD 4.71) messages [9].”
The cited source says what the claim attributes to it.
In the citing paper
“These findings are consistent with previous results regarding the PSP Wellbeing Course [9].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Initial Outcomes of Transdiagnostic Internet-Delivered Cognitive Behavioral Therapy Tailored to Public Safety Personnel: Longitudinal Observational Study > Methods > Measures
“At screening and posttreatment, clients were administered the PHQ-9, GAD-7, PLC-5, PDSS-SR, SPS-6, SIAS-6, DAR-5, and SDS.”
§ Initial Outcomes of Transdiagnostic Internet-Delivered Cognitive Behavioral Therapy Tailored to Public Safety Personnel: Longitudinal Observational Study > Methods > Measures
“The Posttraumatic Stress Disorder Checklist for the DSM-5 (PCL-5) measures symptoms of PTSD and includes 20 items rated from 0 (not at all) to 4 (extremely) [38].”
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 2×
“Generalized Anxiety Disorder-7 (GAD-7) is a brief measure of general anxiety symptoms [37].”
Longitudinal data analysis using generalized linear models
LIANG, K.-Y., & ZEGER, S. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.13 · Cited by 18,550 · cited 1×
“We used generalized estimating equations (GEEs) to model the change in symptoms from pretreatment to posttreatment [52].”
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870 · cited 1×
“We ran the imputations and GEE models in R version 4.0.3 using the mice [54] and geepack [55] packages.”
InfluentialElm, E. V., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · BMJ · doi:10.1136/bmj.39335.541782.ad · Cited by 10,766 · cited 1×
“We have followed the STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) statement in preparing the article [26].”
Blevins, C. A., Weathers, F. W., Davis, M. T., Witte, T. K., & Domino, J. L. (2015) · Journal of Traumatic Stress · doi:10.1002/jts.22059 · Cited by 5,233 · cited 1×
“The Posttraumatic Stress Disorder Checklist for the DSM-5 (PCL-5) measures symptoms of PTSD and includes 20 items rated from 0 (not at all) to 4 (extremely) [38].”
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · cited 1×
“Some researchers have recommended calculating Hedges g using the SD of the control or pretreatment group instead of the pooled SD when pretreatment and posttreatment SDs are unequal [56].”
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057 · cited 2×
“The GAD-7 has demonstrated strong psychometric properties, and a score of 10 or greater is typically used to identify a likely diagnosis of generalized anxiety disorder [36,37].”
Bovin, M. J., Marx, B. P., Weathers, F. W., Gallagher, M. W., Rodriguez, P., Schnurr, P. P., & Keane, T. M. (2016) · Psychological Assessment · doi:10.1037/pas0000254 · Cited by 2,532 · cited 2×
“A cut-off of 33 was recommended by several groups to indicate a likely diagnosis of PTSD [39,40].”
Manea, L., Gilbody, S., & McMillan, D. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.110829 · Cited by 1,966 · cited 1×
“A score greater than 9 is typically used to identify a likely diagnosis of major depressive disorder [34].”
Kilpatrick, D. G., Resnick, H. S., Milanak, M. E., Miller, M. W., Keyes, K. M., & Friedman, M. J. (2013) · Journal of Traumatic Stress · doi:10.1002/jts.21848 · Cited by 1,929
The R Package geepack for Generalized Estimating Equations
Halekoh, U., Højsgaard, S., & Yan, J. (2006) · Journal of Statistical Software · doi:10.18637/jss.v015.i02 · Cited by 1,907 · cited 1×
“We ran the imputations and GEE models in R version 4.0.3 using the mice [54] and geepack [55] packages.”
InfluentialDevelopment and validation of a revised short version of the working alliance inventory
Hatcher, R. L., & Gillaspy, J. A. (2006) · Psychotherapy Research · doi:10.1080/10503300500352500 · Cited by 1,355 · cited 1×
“The Working Alliance Inventory-Short Revised (WAI-SR) is a 12-item measure of working alliance with goal, task, and bond subscales that has demonstrated good psychometric properties [50,51].”
Prospective Study of Posttraumatic Stress Disorder and Depression Following Trauma
Shalev, A. Y., Freedman, S., Peri, T., Brandes, D., Sahar, T., Orr, S. P., & Pitman, R. K. (1998) · American Journal of Psychiatry · doi:10.1176/ajp.155.5.630 · Cited by 996 · cited 1×
“Research shows that such events put individuals at risk of developing several emotional disorders, including posttraumatic stress disorder (PTSD), major depressive disorder, and panic disorder [5-10].”
Perkonigg, A., Kessler, R. C., Storz, S., & Wittchen, H. (2000) · Acta Psychiatrica Scandinavica · doi:10.1034/j.1600-0447.2000.101001046.x · Cited by 970
Wortmann, J. H., Jordan, A. H., Weathers, F. W., Resick, P. A., Dondanville, K. A., Hall-Clark, B., Foa, E. B., Young-McCaughan, S., Yarvis, J. S., Hembree, E. A., et al. (2016) · Psychological Assessment · doi:10.1037/pas0000260 · Cited by 913 · cited 1×
“A cut-off of 33 was recommended by several groups to indicate a likely diagnosis of PTSD [39,40].”
Posttraumatic stress disorder and depression following trauma: understanding comorbidity.
O’Donnell, M. L., Creamer, M., & Pattison, P. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.8.1390 · Cited by 770
Internet-Delivered Psychological Treatments
Andersson, G. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-093006 · Cited by 595 · cited 2×
“…therapy skills are taught via online learning platforms and is poised to help overcome these barriers to treatment for PSP. ICBT can be accessed privately and conveniently, and it is cost-effective because it requires less therapist time per client than traditional face-to-face treatments [17,18].”
Psychometric comparison of PHQ-9 and HADS for measuring depression severity in primary care
Cameron, I. M., Crawford, J. R., Lawton, K., & Reid, I. C. (2008) · British Journal of General Practice · doi:10.3399/bjgp08x263794 · Cited by 590 · cited 1×
“The PHQ-9 has demonstrated excellent psychometric properties [33,35,36].”
Mental Disorder Symptoms among Public Safety Personnel in Canada
Carleton, R. N., Afifi, T. O., Turner, S., Taillieu, T., Duranceau, S., LeBouthillier, D. M., Sareen, J., Ricciardelli, R., MacPhee, R. S., Groll, D., et al. (2018) · The Canadian Journal of Psychiatry · doi:10.1177/0706743717723825 · Cited by 558 · cited 2×
“This is important because approximately 15% of Canadian PSP—and 33% in this study’s treatment-seeking sample—struggle with clinically significant social anxiety [11].”
InfluentialSelf-citationMunder, T., Wilmers, F., Leonhart, R., Linster, H. W., & Barth, J. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.658 · Cited by 538 · cited 1×
“The Working Alliance Inventory-Short Revised (WAI-SR) is a 12-item measure of working alliance with goal, task, and bond subscales that has demonstrated good psychometric properties [50,51].”
Mohr, D. C., Lyon, A. R., Lattie, E. G., Reddy, M., & Schueller, S. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7725 · Cited by 432 · cited 1×
“However, it has been argued that the literature on digital mental health interventions would benefit from more research evaluating such interventions in real-world settings [64,65], as we did in this study.”
Reliability of the self-report version of the panic disorder severity scale
Houck, P. R., Spiegel, D. A., Shear, M. K., & Rucci, P. (2002) · Depression and Anxiety · doi:10.1002/da.10049 · Cited by 406 · cited 1×
“The Panic Disorder Severity Scale Self-Report (PDSS-SR) is a psychometrically sound 7-item measure assessing symptoms of panic disorder [41].”
Peters, L., Sunderland, M., Andrews, G., Rapee, R. M., & Mattick, R. P. (2012) · Psychological Assessment · doi:10.1037/a0024544 · Cited by 379 · cited 2×
“The 6-item Social Phobia Scale (SPS-6) and 6-item Social Interaction Anxiety Scale (SIAS-6) are brief measures of social anxiety that are psychometrically sound when administered together or separately [46].”
Reliability and validity of the Panic Disorder Severity Scale: replication and extension
Shear, M. K., Rucci, P., Williams, J., Frank, E., Grochocinski, V., Vander Bilt, J., Houck, P., & Wang, T. (2001) · Journal of Psychiatric Research · doi:10.1016/s0022-3956(01)00028-0 · Cited by 360 · cited 1×
“It is common practice to employ a cut-off score of 8 on the PDSS-SR [42-44], based on the cut-off initially established for the nonself-report PDSS [45].”
A framework for value-creating learning health systems
Menear, M., Blanchette, M.-A., Demers-Payette, O., & Roy, D. (2019) · Health Research Policy and Systems · doi:10.1186/s12961-019-0477-3 · Cited by 343 · cited 2×
“Second, evaluation of early outcomes is consistent with the learning health system approach, which is characterized by a continuous cycle of gathering data from practice, transforming data into knowledge, and implementing knowledge into practice [25].”
Exposures to potentially traumatic events among public safety personnel in Canada
Carleton, R. N., Afifi, T. O., Taillieu, T., Turner, S., Krakauer, R., Anderson, G. S., MacPhee, R. S., Ricciardelli, R., Cramm, H. A., Groll, D., et al. (2019) · Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement · doi:10.1037/cbs0000115 · Cited by 324 · cited 1×
“Through their work, PSP frequently experience or witness potentially traumatic events such as motor vehicle collisions and acts of violence [2-4].”
Self-citationAndersson, G., Carlbring, P., Titov, N., & Lindefors, N. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719839381 · Cited by 324 · cited 2×
“Meta-analyses have shown that ICBT is effective for treating symptoms of a range of mental disorders, including depression, anxiety, and PTSD [19,20].”
Self-citationEconomic evaluations of Internet interventions for mental health: a systematic review
Donker, T., Blankers, M., Hedman, E., Ljótsson, B., Petrie, K., & Christensen, H. (2015) · Psychological Medicine · doi:10.1017/s0033291715001427 · Cited by 316 · cited 1×
“…therapy skills are taught via online learning platforms and is poised to help overcome these barriers to treatment for PSP. ICBT can be accessed privately and conveniently, and it is cost-effective because it requires less therapist time per client than traditional face-to-face treatments [17,18].”
Regression toward the mean and the study of change.
Nesselroade, J. R., Stigler, S. M., & Baltes, P. B. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.622 · Cited by 241 · cited 1×
“However, because these subsets represented a restricted range of pretreatment scores, a greater SD at posttreatment would be expected—even in the absence of a treatment effect—due to regression toward the mean [57].”
Dear, B. F., Staples, L. G., Terides, M. D., Karin, E., Zou, J., Johnston, L., Gandy, M., Fogliati, V. J., Wootton, B. M., McEvoy, P. M., et al. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.09.003 · Cited by 230
Self-citationTitov, N., Dear, B. F., Staples, L. G., Terides, M. D., Karin, E., Sheehan, J., Johnston, L., Gandy, M., Fogliati, V. J., Wootton, B. M., et al. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.08.002 · Cited by 223 · cited 1×
“The PSP Wellbeing Course was adapted from a transdiagnostic ICBT program called the Wellbeing Course, which was developed for use in the general population by eCentre Clinic at Macquarie University, Australia [28-32].”
Self-citationSijbrandij, M., Kunovski, I., & Cuijpers, P. (2016) · Depression and Anxiety · doi:10.1002/da.22533 · Cited by 213 · cited 2×
“Meta-analyses have shown that ICBT is effective for treating symptoms of a range of mental disorders, including depression, anxiety, and PTSD [19,20].”
Maximizing the Impact of e-Therapy and Serious Gaming: Time for a Paradigm Shift
Fleming, T. M., de Beurs, D., Khazaal, Y., Gaggioli, A., Riva, G., Botella, C., Baños, R. M., Aschieri, F., Bavin, L. M., Kleiboer, A., et al. (2016) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2016.00065 · Cited by 212 · cited 3×
“As one group stated, this process begins with establishing “a deep understanding of user needs and preferences, and actively involving users in design processes from the outset” [21].”
A Solution-Focused Research Approach to Achieve an Implementable Revolution in Digital Mental Health
Mohr, D. C., Riper, H., & Schueller, S. M. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.3838 · Cited by 204
Forbes, D., Alkemade, N., Mitchell, D., Elhai, J. D., McHugh, T., Bates, G., Novaco, R. W., Bryant, R., & Lewis, V. (2014) · Depression and Anxiety · doi:10.1002/da.22148 · Cited by 203 · cited 1×
“Scores range from 5 to 25 with a cut-off of 12 [48].”
How to increase reach and adherence of web-based interventions: a design research viewpoint
Ludden, G. D., van Rompay, T. J., Kelders, S. M., & van Gemert-Pijnen, J. E. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4201 · Cited by 185 · cited 1×
“There have been several recent calls for internet interventions to be tailored to the unique needs of their target users to facilitate greater treatment engagement [21,22].”
Titov, N., Dear, B. F., Staples, L. G., Bennett-Levy, J., Klein, B., Rapee, R. M., Andersson, G., Purtell, C., Bezuidenhout, G., & Nielssen, O. B. (2017) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867416671598 · Cited by 183 · cited 1×
“Following precedents set in previous research using the same outcome measures, deterioration was defined as an increase of 5 points on the GAD-7 [59,60] or 10 points on the PCL-5 [61].”
Self-citationTitov, N., Dear, B. F., Staples, L. G., Bennett-Levy, J., Klein, B., Rapee, R. M., Shann, C., Richards, D., Andersson, G., Ritterband, L., et al. (2015) · Psychiatric Services · doi:10.1176/appi.ps.201400477 · Cited by 181
Self-citationMaia, D. B., Marmar, C. R., Metzler, T., Nóbrega, A., Berger, W., Mendlowicz, M. V., Coutinho, E. S. F., & Figueira, I. (2007) · Journal of Affective Disorders · doi:10.1016/j.jad.2006.06.004 · Cited by 177
The impact of killing and injuring others on mental health symptoms among police officers
Komarovskaya, I., Maguen, S., McCaslin, S. E., Metzler, T. J., Madan, A., Brown, A. D., Galatzer-Levy, I. R., Henn-Haase, C., & Marmar, C. R. (2011) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2011.05.004 · Cited by 161 · cited 1×
“Through their work, PSP frequently experience or witness potentially traumatic events such as motor vehicle collisions and acts of violence [2-4].”
Stanley, I. H., Boffa, J. W., Hom, M. A., Kimbrel, N. A., & Joiner, T. E. (2016) · Psychiatry Research · doi:10.1016/j.psychres.2016.11.037 · Cited by 156 · cited 1×
“PSP have also reported high rates of mental health problems in other countries [12-14].”
Ricciardelli, R., Carleton, R. N., Mooney, T., & Cramm, H. (2020) · Health: An Interdisciplinary Journal for the Social Study of Health, Illness and Medicine · doi:10.1177/1363459318800167 · Cited by 148
Self-citationDear, B. F., Staples, L. G., Terides, M. D., Fogliati, V. J., Sheehan, J., Johnston, L., Kayrouz, R., Dear, R., McEvoy, P. M., & Titov, N. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.05.004 · Cited by 114 · cited 1×
“The PSP Wellbeing Course was adapted from a transdiagnostic ICBT program called the Wellbeing Course, which was developed for use in the general population by eCentre Clinic at Macquarie University, Australia [28-32].”
Self-citationTitov, N., Dear, B. F., Nielssen, O., Wootton, B., Kayrouz, R., Karin, E., Genest, B., Bennett-Levy, J., Purtell, C., Bezuidenhout, G., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30224-7 · Cited by 108 · cited 1×
“Following precedents set in previous research using the same outcome measures, deterioration was defined as an increase of 5 points on the GAD-7 [59,60] or 10 points on the PCL-5 [61].”
Self-citationGalatzer‐Levy, I. R., Madan, A., Neylan, T. C., Henn‐Haase, C., & Marmar, C. R. (2011) · Journal of Traumatic Stress · doi:10.1002/jts.20684 · Cited by 105
Ruwaard, J., Broeksteeg, J., Schrieken, B., Emmelkamp, P. M. G., & Lange, A. (2010) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2010.01.010 · Cited by 97
Fogliati, V. J., Dear, B. F., Staples, L. G., Terides, M. D., Sheehan, J., Johnston, L., Kayrouz, R., Dear, R., McEvoy, P. M., & Titov, N. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.03.005 · Cited by 86
Self-citationCaring for the country: fatigue, sleep and mental health in Australian rural paramedic shiftworkers
Courtney, J. A., Francis, A. J. P., & Paxton, S. J. (2013) · Journal of Community Health · doi:10.1007/s10900-012-9599-z · Cited by 85 · cited 1×
“PSP have also reported high rates of mental health problems in other countries [12-14].”
Hawthorne, G., Mouthaan, J., Forbes, D., & Novaco, R. W. (2006) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-005-0986-y · Cited by 77 · cited 1×
“The Dimensions of Anger Reactions Scale (DAR-5) is a 5-item measure of anger that has demonstrated good psychometric properties [47].”
Panic following trauma: the etiology of acute posttraumatic arousal
Nixon, R. D. V., Resick, P. A., & Griffin, M. G. (2002) · Journal of Anxiety Disorders · doi:10.1016/s0887-6185(02)00290-6 · Cited by 70
Karin, E., Dear, B. F., Heller, G. Z., Gandy, M., & Titov, N. (2018) · JMIR Mental Health · doi:10.2196/10200 · Cited by 69 · cited 1×
“A gamma distribution with a log-link function was used to model changes between pretreatment and posttreatment as proportional and to accommodate the skewed response distribution [53].”
Self-citationJasper, K., Weise, C., Conrad, I., Andersson, G., Hiller, W., & Kleinstäuber, M. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.04.002 · Cited by 68 · cited 1×
“To our knowledge, there are no formal guidelines for interpreting WAI-SR scores, but these participant scores fall in the “high/positive” range according to the interpretation of one group of ICBT researchers [62].”
Christensen, H. M., Batterham, P. J., Grant, J. B., Griffiths, K. M., & Mackinnon, A. J. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-154 · Cited by 58 · cited 1×
“It is common practice to employ a cut-off score of 8 on the PDSS-SR [42-44], based on the cut-off initially established for the nonself-report PDSS [45].”
Allen, A. R., Newby, J. M., Mackenzie, A., Smith, J., Boulton, M., Loughnan, S. A., & Andrews, G. (2016) · BJPsych Open · doi:10.1192/bjpo.bp.115.001826 · Cited by 43 · cited 1×
“It is common practice to employ a cut-off score of 8 on the PDSS-SR [42-44], based on the cut-off initially established for the nonself-report PDSS [45].”
The Anxiety Disease and How to Overcome It
Goodwin, D. W. (1984) · American Journal of Psychiatry · doi:10.1176/ajp.141.8.1006 · Cited by 38
McCall, H. C., Beahm, J. D., Fournier, A. K., Burnett, J. L., Carleton, R. N., & Hadjistavropoulos, H. D. (2021) · Canadian Journal of Behavioural Science / Revue canadienne des sciences du comportement · doi:10.1037/cbs0000242 · Cited by 30 · cited 9×
“Canadian PSP experience high rates of mental health problems and face several barriers to mental health care [15,16].”
InfluentialSelf-citationHadjistavropoulos, H. D., Peynenburg, V., Thiessen, D. L., Nugent, M., Adlam, K., Owens, K. M. B., Karin, E., Dear, B. F., & Titov, N. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100357 · Cited by 25 · cited 3×
“Descriptively, these outcomes are comparable to the most recent published outcomes of the Wellbeing Course offered by the Online Therapy Unit to the general population of Saskatchewan [63].”
InfluentialSelf-citationAn Overview of IBM SPSS Statistics
(2016) · Routledge eBooks · doi:10.4324/9781315545899-6 · Cited by 24
McCall, H. C., Sison, A. P., Burnett, J. L., Beahm, J. D., & Hadjistavropoulos, H. D. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17176026 · Cited by 22 · cited 2×
“Canadian PSP appear receptive to therapist-supported ICBT, which was ranked as their most preferred mental health treatment after face-to-face psychological services [23].”
Self-citationByllesby, B. M., Dickstein, B. D., & Chard, K. M. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103483 · Cited by 20 · cited 1×
“Following precedents set in previous research using the same outcome measures, deterioration was defined as an increase of 5 points on the GAD-7 [59,60] or 10 points on the PCL-5 [61].”
Kutchins, H., & Kirk, S. A. (1995) · Social Work · doi:10.1093/sw/40.2.286 · Cited by 14
Research works printed but not linked: 1
- 2013, Diagnostic and statistical manual of mental disorders
Cited by
Moghimi, E., Knyahnytska, Y., Omrani, M., Nikjoo, N., Stephenson, C., Layzell, G., Simpson, A. I. F., & Alavi, N. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.921527 · Cited by 29
“Even so, preliminary evidence supports the success of these innovations in this population (70).”
BackgroundMethodResultInfluentialBeahm, J. D., McCall, H. C., Carleton, R. N., Titov, N., Dear, B., & Hadjistavropoulos, H. D. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100481 · Cited by 23
Self-citationWang, J., Huang, Y., Wang, S., Zhang, Z., He, Y., Wang, X., & Guo, H. (2024) · BMC Public Health · doi:10.1186/s12889-024-18048-1 · Cited by 31
McCall, H. C., Dear, B. F., Landry, C. A., Beahm, J. D., Gregory, J., Titov, N., Carleton, R. N., & Hadjistavropoulos, H. D. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100656 · Cited by 24
Self-citationObuobi-Donkor, G., Shalaby, R., Eboreime, E., Agyapong, B., Phung, N., Eyben, S., Wells, K., Hilario, C. T., Dias, R. D. L., Jones, C., et al. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20054215 · Cited by 17
“For example, a study among Canadian public safety personnel reported that participants experienced decreased depression symptoms, anxiety, and posttraumatic stress symptoms after introducing an iCBT program tailored for public safety personnel [69].”
Background
Metadata
- Authors
- Hadjistavropoulos, H. D., McCall, H. C., Thiessen, D. L., Huang, Z., Carleton, R. N., Dear, B. F., & Titov, N.
- Affiliations
- University of Regina (CA)
- Macquarie University (AU)
- Corresponding author
- Hadjistavropoulos, Heather D
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-05-05
- Volume
- 23
- Issue
- 5
- Pages
- e27610
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC8135031
- OpenAlex
- W3154054391
- Cited by
- 42
- References
- 62
- Citations by year
- 2026: 7 · 2025: 6 · 2024: 14 · 2023: 9 · 2022: 4 · 2021: 2
- FWCI
- 6.51
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- oURspace (University of Regina) (submittedVersion, cc-by)
- Funders
- University of Regina
- Australian Government
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- internet-based cognitive behavioral therapy, public safety personnel, transdiagnostic treatment, depression, anxiety, post-traumatic stress disorder, posttraumatic stress symptoms, social anxiety, treatment engagement, treatment satisfaction, therapeutic relationship, functional disability, Saskatchewan
- MeSH terms
- Anxiety, Anxiety Disorders, Canada, Humans, Cognitive Behavioral Therapy, Treatment Outcome, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
