The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index; 8 of the 32 sources its claims cite were checked for support.
Measurement of Symptom Change Following Web-Based Psychotherapy: Statistical Characteristics and Analytical Methods for Measuring and Interpreting Change
Open accessPublished version of a preprint
Abstract
Background: Accurate measurement of treatment-related change is a key part of psychotherapy research and the investigation of treatment efficacy. For this reason, the ability to measure change with accurate and valid methods is critical for psychotherapy. Objective: The aims of this study were to (1) explore the underlying characteristics of depressive symptom change, measured with the nine-item Patient Health Questionnaire (PHQ-9), following psychotherapy, and (2) compare the suitability of different ways to measure and interpret symptom change. A treatment sample of Web-based psychotherapy participants (n=1098) and a waitlist sample (n=96) were used to (1) explore the statistical characteristics of depressive symptom change, and (2) compare the suitability of two common types of change functions: linear and proportional change. Methods: These objectives were explored using hypotheses that tested (1) the relationship between baseline symptoms and the rate of change, (2) the shape of symptom score distribution following treatment, and (3) measurement error associated with linear and proportional measurement models. Results: Findings demonstrated that (1) individuals with severe depressive baseline symptoms had greater reductions in symptom scores than individuals with mild baseline symptoms (11.4 vs 3.7); however, as a percentage measurement, change remained similar across individuals with mild, moderate, or severe baseline symptoms (50%-55%); (2) positive skewness was observed in PHQ-9 score distributions following treatment; and (3) models that measured symptom change as a proportional function resulted in greater model fit and reduced measurement error (<30%). Conclusions: This study suggests that symptom scales, sharing an implicit feature of score bounding, are associated with a proportional function of change. Selecting statistics that overlook this proportional change (eg, Cohen d) is problematic and leads to (1) artificially increased estimates of change with higher baseline symptoms, (2) increased measurement error, and (3) confounded estimates of treatment efficacy and clinical change. Implications, limitations, and idiosyncrasies from these results are discussed.
Overview
CoChat Summary
TL;DR
This study argues that PHQ-9 symptom change after web-based psychotherapy is better characterized as proportional rather than linear: participants with more severe baseline symptoms changed more in raw points, but changed similarly in percentage terms. Across a treatment sample of 1,098 and a waitlist sample of 96, proportional models fit better and reduced measurement error.
Key findings
- In the treatment sample, participants with severe baseline symptoms reduced PHQ-9 scores more than those with mild symptoms in raw points: 11.4 vs 3.7; yet proportional change was similar across baseline-severity bands at 50%–55%.
- In the waitlist condition, symptom change also depended on baseline severity; severe participants showed 35% proportional improvement, and severe waitlist participants reduced more than moderate treatment participants (7 points vs 6 points).
- PHQ-9 posttreatment distributions showed positive skewness, which increased after treatment.
- Models assuming proportional change had better fit and lower error: the paper reports reduced QIC, AIC, and BIC and a drop in PHQ-9 error variance from σ²=24.122 to σ²=16.716, described as more than 30% less measurement error.
Methods
- Combined clinical data from three published randomized controlled trials of internet-delivered cognitive behavioral therapy (ICBT) conducted in the same clinic; total participants N=1262, with 1098 assessed at both pretreatment and posttreatment. A waitlist sample included n=96.
- Primary outcome was the PHQ-9 (scores 0–27); participants were adults 18–65 years with at least mild depression or anxiety symptoms (minimum ≥5 on PHQ-9 or GAD-7).
- Tested three hypotheses using GEE models, multilevel/mixed models, and raw means, then compared linear vs proportional change models using QIC, AIC, BIC, and residual error/measurement error.
Limitations
- The authors state the findings are preliminary, specific to the PHQ-9, and specific to one treatment model (the Macquarie University online model).
- The paper says it is unclear how far the 50%–55% change generalizes to other symptom scales or treatment models.
- Evident from the text: the sample comes from self-selecting Australian adults in web-based CBT trials, so generalizability beyond this setting is limited.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
5 Valid · 0 Not valid · 12 Not checked · 20 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“common symptom scales, such as the PHQ-9 [29], the Generalized Anxiety Disorder seven-item scale (GAD-7) [30], and prominent others (eg, Kessler Psychological Distress scale) [31], often demonstrate an implicit design feature of score bounding at minimal symptoms.”
§ Measurement of Symptom Change Following Web-Based Psychotherapy: Statistical Characteristics and Analytical Methods for Measuring and Interpreting Change > Introduction
What the sources say
- Supportedcites [29] source
The METHODS section states that 'the PHQ-9 score can range from 0 to 27, since each of the 9 items can be scored from 0 (not at all) to 3 (nearly every day)', i.e. the scale is anchored/bounded at the minimal-symmetry end, and the Abstract repeats the 0 ('not at all') to 3 scoring. The RESULTS (Table 2, Distribution of PHQ-9 Scores According to Depression Diagnostic Status) formalize this with a lowest severity band labelled 'Minimal, 0–4', with 73.4% of patients with no depressive disorder falling in it. Our copy does not use the words 'bounding' or 'floor' — that framing is the citing authors' — but the instrument described is exactly the exemplar the citation is offered for. (LLM, conf=0.82)
- Not checked yetcites [30] source
- Not checked yetcites [31] source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These interventions were almost identical in structure and therapeutic content.”
§ Measurement of Symptom Change Following Web-Based Psychotherapy: Statistical Characteristics and Analytical Methods for Measuring and Interpreting Change > Methods > The Sample
What the sources say
- Partly supportedcites [39] sourceExperimental — accuracy not yet measured
Our copy supports similarity in structure and dose: Section 2.3 (Interventions) states 'the two courses comprise a similar structure and similar amounts and forms of content' (5 lessons over 8 weeks, ~60 slides each, similar case stories and resources), and the Introduction says the TD-CBT and DS-CBT interventions were designed to 'comprise a similar structure, present similar amounts of information, and require a similar amount of therapist contact'. However, the source never calls them 'almost identical', and it explicitly builds therapeutic differences into the comparison: Section 2.3 notes DS-CBT presented all information and skills in the context of MDD with MDD-specific vignettes and no mention of other diagnoses, whereas TD-CBT avoided diagnostic labels and covered distress generally. Also, Section 2.2 describes a 2x2 design of two treatment approaches crossed with two support formats, not three interventions, so the count in the citing sentence is not this paper's description. (LLM, conf=0.78)
- Not checked yetcites [40] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“First, psychological treatment studies often describe an increased rate of clinical change within samples of increased baseline symptom severity [20,28].”
§ Measurement of Symptom Change Following Web-Based Psychotherapy: Statistical Characteristics and Analytical Methods for Measuring and Interpreting Change > Introduction
What the sources say
- Supportedcites [20] source
The results section ('Is the effect of low intensity interventions on depression moderated by baseline depression severity?') reports a significant negative interaction between baseline severity and treatment effect (coefficient -0.1, 95% CI -0.19 to -0.002), stating that 'patients who are more severely depressed at baseline demonstrate larger treatment effects than those who are less severely depressed', and the 'Strengths and weaknesses in relation to other studies' section describes this as the prevailing pattern across individual studies and across high intensity psychological therapies ('higher initial severity was associated with greater treatment effects'). This supports the claim's directional generalisation. The one qualification worth noting is that the paper repeatedly stresses the additional benefit is small (about one extra point on BDI/CES-D per SD of severity) and 'may not be clinically significant', and Box 2 adds that more severe patients remain more symptomatic afterwards. (LLM, conf=0.80)
- Could not verifycites [28] sourceExperimental — accuracy not yet measured
Our copy of Boettcher et al. (2014) reports clinically significant change rates for its own sample (Results > Clinical change, Table 3) and defines CSC on the LSAS-SR (Statistical analyses), but no passage states or examines that higher baseline symptom severity is associated with greater rate of clinical change. The closest material is the Limitations section noting this trial's pre-post effect sizes (d = 1.39) exceeded five previous trials of the same ICBT programme (mean d = 1.04), which the authors attribute to dose (11 vs 9 modules) rather than baseline severity; the only baseline-value-as-predictor analysis concerns initial attention bias score predicting attention bias change (Results > Change in attention bias), not symptom severity predicting clinical change. Searched: baseline symptom severity, initial severity predictor of outcome, clinically significant change, sample more severely symptomatic — none yield a statement of the attributed generalisation. (LLM, conf=0.62)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
None of the sources cited for this claim have been checked yet.
In the paper
“the use of effect sizes, such as Cohen d, is based on statistical assumptions that change is linear.”
§ Measurement of Symptom Change Following Web-Based Psychotherapy: Statistical Characteristics and Analytical Methods for Measuring and Interpreting Change > Introduction
What the sources say
- Could not verifycites [18] sourceExperimental — accuracy not yet measured
Our copy of Lakens (2013) explains how Cohen's d is calculated and which standardizer to use (between-subjects ds, dz, drm, dav, Glass's Δ), the bias correction to Hedges's g, and the availability of bootstrapping when data are not normally distributed (Cohen's d in between-subjects designs; Cohen's d in one-sample or correlated samples comparisons). No passage states or implies that Cohen's d rests on a statistical assumption that change is linear; searches for 'linear change/linearity', 'assumptions underlying Cohen's d', and distributional assumptions returned nothing on that point. Since our copy does not address the claim's specific assertion, it can neither confirm nor contradict it. (LLM, conf=0.70)
- Not checked yetcites [27] Ellis, PD, 2010, The Essential Guide to Effect Sizes: Statistical Power, Meta-Analysis, and the Interpretation of Research Results source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This finding is broadly consistent with the data within previous psychotherapy studies showing increased effect sizes with samples of increased symptoms, even when similar treatments are applied [20,29,32].”
§ Measurement of Symptom Change Following Web-Based Psychotherapy: Statistical Characteristics and Analytical Methods for Measuring and Interpreting Change > Discussion
What the sources say
- Partly supportedcites [20] sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Could not verifycites [29] sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 2 unverifiable. Expand the claim to see per-atom verdicts.
- Not checked yetcites [32] source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
13 more claims
Create a free account to see all 37 claims and to verify the 24 references still open.
- Probably not a substantial claim. 10
- It may state two separate claims as one. 11
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Generalized estimating equation (GEE) models were run in R and examined symptoms from assessment to post-treatment to follow-up after controlling for enrolment year and therapist location. 45”
From Utilization, Patient Characteristics, and Longitudinal Improvements among Patients from a Provincially Funded Transdiagnostic Internet-delivered Cognitive Behavioural Therapy Program: Observational Study of Trends over 6 Years (2022) · cites this paper as [45]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“For example, in this study, individuals with severe baseline symptoms demonstrated effect sizes that increased by nearly threefold (3.9) when compared to individuals with mild symptoms (1.6), even when the same treatment was applied.”
§ Measurement of Symptom Change Following Web-Based Psychotherapy: Statistical Characteristics and Analytical Methods for Measuring and Interpreting Change > Discussion
Reported 3 · recomputed 2.4375
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Longitudinal data analysis using generalized linear models
LIANG, K.-Y., & ZEGER, S. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.13 · Cited by 18,550
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
KESSLER, R. C., ANDREWS, G., COLPE, L. J., HIRIPI, E., MROCZEK, D. K., NORMAND, S.-L. T., WALTERS, E. E., & ZASLAVSKY, A. M. (2002) · Psychological Medicine · doi:10.1017/s0033291702006074 · Cited by 10,327
Lakens, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00863 · Cited by 10,303
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2014) · International Journal of Surgery · doi:10.1016/j.ijsu.2014.07.013 · Cited by 9,909
Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection
Kroenke, K., Spitzer, R. L., Williams, J. B. W., Monahan, P. O., & Löwe, B. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-5-200703060-00004 · Cited by 4,741
Cited by
Karamians, R., Proffitt, R. M., Kline, D., & Gauthier, L. V. (2019) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2019.10.195 · Cited by 171
Predictive models for clinical decision making: Deep dives in practical machine learning
Eloranta, S., & Boman, M. (2022) · Journal of Internal Medicine · doi:10.1111/joim.13483 · Cited by 163
Titov, N., Dear, B. F., Nielssen, O., Wootton, B., Kayrouz, R., Karin, E., Genest, B., Bennett-Levy, J., Purtell, C., Bezuidenhout, G., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30224-7 · Cited by 108
Self-citationHadjistavropoulos, H. D., Peynenburg, V., Thiessen, D. L., Nugent, M., Karin, E., Staples, L., Dear, B. F., & Titov, N. (2022) · The Canadian Journal of Psychiatry · doi:10.1177/07067437211006873 · Cited by 52
Self-citationDear, B. F., Gandy, M., Karin, E., Fogliati, R., Fogliati, V. J., Staples, L. G., Wootton, B. M., Sharpe, L., & Titov, N. (2018) · The Journal of Pain · doi:10.1016/j.jpain.2018.07.005 · Cited by 51
Self-citationWootton, B. M., Karin, E., Titov, N., & Dear, B. F. (2019) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2019.102111 · Cited by 51
Self-citationHadjistavropoulos, H. D., Peynenburg, V. A., Thiessen, D., Nugent, M., Karin, E., Dear, B. F., & Titov, N. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100499 · Cited by 47
Self-citationHadjistavropoulos, H. D., McCall, H. C., Thiessen, D. L., Huang, Z., Carleton, R. N., Dear, B. F., & Titov, N. (2021) · Journal of Medical Internet Research · doi:10.2196/27610 · Cited by 42
“A gamma distribution with a log-link function was used to model changes between pretreatment and posttreatment as proportional and to accommodate the skewed response distribution [53].”
Self-citationGandy, M., Karin, E., McDonald, S., Meares, S., Scott, A. J., Titov, N., & Dear, B. F. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2020.110173 · Cited by 42
Self-citationKarin, E., Crane, M. F., Dear, B. F., Nielssen, O., Heller, G. Z., Kayrouz, R., & Titov, N. (2021) · JMIR Mental Health · doi:10.2196/22700 · Cited by 36
“All models included a gamma scale, an unstructured pattern of within-subject correlation matrix, and a log link function to account for positive skewness and the proportional pattern of symptom change from baseline [26].”
MethodSelf-citationDear, B. F., Johnson, B., Singh, A., Wilkes, B., Brkic, T., Gupta, R., Jones, M. P., Bailey, S., Dudeney, J., Gandy, M., et al. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.06.044 · Cited by 36
Self-citationForsell, E., Isacsson, N. H., Blom, K., Jernelöv, S., Abdesslem, F. B., Lindefors, N., Boman, M., & Kaldo, V. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000462 · Cited by 36
Dear, B. F., Karin, E., Fogliati, R., Dudeney, J., Nielssen, O., Gandy, M., Staples, L., Scott, A. J., Heriseanu, A. I., Bisby, M. A., et al. (2022) · Pain · doi:10.1097/j.pain.0000000000002507 · Cited by 33
Self-citationHadjistavropoulos, H. D., Peynenburg, V., Nugent, M., Karin, E., Titov, N., & Dear, B. F. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100347 · Cited by 32
Self-citationDear, B. F., Scott, A. J., Fogliati, R., Gandy, M., Karin, E., Dudeney, J. E., Nielssen, O. B., McDonald, S., Heriseanu, A. I., Bisby, M. A., et al. (2022) · Psychotherapy and Psychosomatics · doi:10.1159/000522530 · Cited by 34
Self-citationDirkse, D., Hadjistavropoulos, H. D., Alberts, N. A., Karin, E., Schneider, L. H., Titov, N., & Dear, B. F. (2020) · Journal of Cancer Survivorship · doi:10.1007/s11764-019-00810-9 · Cited by 29
Self-citationDear, B. F., Karin, E., Fogliati, R., Dudeney, J., Nielssen, O., Scott, A. J., Gandy, M., Bisby, M. A., Heriseanu, A. I., Hathway, T., et al. (2021) · The Journal of Pain · doi:10.1016/j.jpain.2020.11.003 · Cited by 28
Self-citationMehta, S., Hadjistavropoulos, H., Nugent, M., Karin, E., Titov, N., & Dear, B. F. (2020) · Spinal Cord · doi:10.1038/s41393-019-0398-6 · Cited by 27
Self-citationWootton, B. M., Karin, E., Dear, B. F., Staples, L., Nielssen, O. B., Kayrouz, R., & Titov, N. (2021) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2021.102444 · Cited by 28
Self-citationBisby, M. A., Balakumar, T., Scott, A. J., Titov, N., & Dear, B. F. (2023) · Psychological Medicine · doi:10.1017/s003329172300260x · Cited by 27
Self-citationHadjistavropoulos, H. D., Peynenburg, V., Thiessen, D. L., Nugent, M., Adlam, K., Owens, K. M. B., Karin, E., Dear, B. F., & Titov, N. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100357 · Cited by 25
Self-citationLenz, A. S. (2020) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2020.1784758 · Cited by 23
Schuster, R., Laireiter, A., Berger, T., Moritz, S., Meyer, B., Hohagen, F., & Klein, J. P. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.05.122 · Cited by 23
Peynenburg, V. A., Hadjistavropoulos, H. D., Thiessen, D., Titov, N., & Dear, B. F. (2022) · Journal of Medical Internet Research · doi:10.2196/40637 · Cited by 25
Self-citationKayrouz, R., Karin, E., Staples, L., Nielssen, O. B., Dear, B. F., & Titov, N. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02486-3 · Cited by 22
Self-citationGandy, M., Heriseanu, A. I., Balakumar, T., Karin, E., Walker, J., Hathway, T., Bisby, M. A., Scott, A. J., Dudeney, J., Fisher, A., et al. (2023) · Psychological Medicine · doi:10.1017/s0033291723000338 · Cited by 20
Self-citationStaples, L., Webb, N., Asrianti, L., Cross, S. P. M., Rock, D. J., Kayrouz, R., Karin, E., Dear, B. F., Nielssen, O. B., & Titov, N. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19020905 · Cited by 39
Self-citationZantvoort, K., Isacsson, N. H., Funk, B., & Kaldo, V. (2024) · Digital Health · doi:10.1177/20552076241248920 · Cited by 18
Isacsson, N. H., Abdesslem, F. B., Forsell, E., Boman, M., & Kaldo, V. (2024) · Communications Medicine · doi:10.1038/s43856-024-00626-4 · Cited by 20
Dear, B. F., Walker, J., Karin, E., Asrianti, L., England, J., Feliciano, I. F. G., Bisby, M. A., Nielssen, O. B., Kayrouz, R., Cross, S. P. M., et al. (2023) · Pain Medicine · doi:10.1093/pm/pnad102 · Cited by 18
Self-citationMcLellan, L. F., Woon, S., Hudson, J. L., Lyneham, H. J., Karin, E., & Rapee, R. M. (2023) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2023.102802 · Cited by 23
Self-citationSoucy, J. N., Hadjistavropoulos, H. D., Karin, E., Dear, B. F., & Titov, N. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100394 · Cited by 21
Self-citationGogoulou, E., Boman, M., Abdesslem, F. B., Isacsson, N. H., Kaldo, V., & Sahlgren, M. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.46 · Cited by 15
Wootton, B. M., McDonald, S., Melkonian, M., Karin, E., Titov, N., & Dear, B. F. (2023) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2023.2279492 · Cited by 12
Self-citationOpioid use before and after completion of an online pain management program.
Nielssen, O. B., Karin, E., Staples, L., Titov, N., Gandy, M., Fogliati, V. J., & Dear, B. F. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000407 · Cited by 12
Self-citationStuke, H., Schoofs, N., Johanßen, H., Bermpohl, F., Ülsmann, D., Schulte‐Herbrüggen, O., & Priebe, K. (2021) · European Journal of Psychotraumatology · doi:10.1080/20008198.2021.1958471 · Cited by 12
Anton, M. T., Greenberger, H. M., Andreopoulos, E., & Pande, R. L. (2021) · JMIR Formative Research · doi:10.2196/27570 · Cited by 11
Scott, A. J., Hathway, T., Bisby, M. A., Titov, N., & Dear, B. F. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100778 · Cited by 8
Self-citationKratzer, L., Heinz, P., Knefel, M., Weindl, D., Tschöke, S., Biedermann, S. V., Schröder, J., & Karatzias, T. (2023) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000001671 · Cited by 9
Multiplicative treatment effects in randomized pretest-posttest experimental designs.
Liu, Q., & Maxwell, S. E. (2019) · Psychological Methods · doi:10.1037/met0000222 · Cited by 11
Owens, V. A. M., Hadjistavropoulos, H. D., Schneider, L. H., Gullickson, K. M., Karin, E., Titov, N., & Dear, B. F. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.01.001 · Cited by 8
Self-citationRogala, A., Szczepaniak, M., Michalak, N., & Andersson, G. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100322 · Cited by 9
Heriseanu, A. I., Karin, E., Walker, J., Scott, A. J., Bisby, M. A., Gandy, M., Dudeney, J. E., Fisher, A. C., Titov, N., & Dear, B. F. (2023) · International Journal of Obesity · doi:10.1038/s41366-023-01285-6 · Cited by 9
Self-citationAntidepressant medication use by patients accessing a national digital mental health service
Staples, L., Asrianti, L., Karin, E., Kayrouz, R., Cross, S. P. M., Bisby, M. A., Fisher, A. C., Dear, B. F., Titov, N., & Nielssen, O. B. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.04.042 · Cited by 6
Self-citationPsychometric evaluation of an adult post-COVID-19 symptom tool: a development and validation study
Kuo, P.-Y., Chen, P., Tsai, S.-F., Lin, W.-L., Hung, C., & Huang, S. (2024) · Scientific Reports · doi:10.1038/s41598-024-51287-1 · Cited by 7
Isacsson, N. H., Zantvoort, K., Forsell, E., Boman, M., & Kaldo, V. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100773 · Cited by 6
Cross, S. P., Staples, L. G., Bisby, M. A., Nielssen, O., Fisher, A., Titov, N., & Dear, B. F. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100655 · Cited by 4
“Generalized estimation equation (GEE) modelling examined changes over time from baseline to post-treatment (Karin et al., 2018; Hubbard et al., 2010).”
Self-citationChandra, S. S., Bisby, M. A., Scott, A. J., Titov, N., & Dear, B. F. (2025) · Pain · doi:10.1097/j.pain.0000000000003784 · Cited by 5
Self-citationWootton, B. M., Karin, E., Melkonian, M., McDonald, S., Titov, N., & Dear, B. F. (2024) · Behaviour Research and Therapy · doi:10.1016/j.brat.2024.104643 · Cited by 4
Self-citationHadjistavropoulos, H. D., Peynenburg, V. A., Mehta, S., Adlam, K., Nugent, M., Gullickson, K. M., Titov, N., & Dear, B. F. (2019) · JMIR Mental Health · doi:10.2196/16005 · Cited by 7
Self-citationFaller, Y. N., Peynenburg, V. A., Tessier, E. D., Thiessen, D., & Hadjistavropoulos, H. D. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20075317 · Cited by 3
Dear, B. F., Heriseanu, A. I., Johnson, B., Sander, D., Farmer, K., & Titov, N. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100791 · Cited by 3
Self-citationDear, B. F., Heriseanu, A. I., Johnson, B., Norton, L., Nguyen, H., Richards, A., Pace, S., & Titov, N. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100789 · Cited by 2
Self-citationMcNaughton, D. T., Hancock, M. J., Bisby, M. A., Scott, A. J., Jones, M. P., & Dear, B. F. (2024) · Pain Medicine · doi:10.1093/pm/pnae044 · Cited by 3
Self-citationZhang, Y., Bakir-Demir, T., Taumoepeau, M., Salmon, K., & Reese, E. (2026) · Teaching and Teacher Education · doi:10.1016/j.tate.2026.105596 · Cited by 1
Navin, C., Dear, B. F., Bisby, M. A., Slattery, B. W., Pilch, M., Haugh, S., Connor, L. O., Malone, B., Perez, C., Egan, J., et al. (2026) · Clinical Journal of Pain · doi:10.1097/ajp.0000000000001409 · Cited by 1
Self-citationIsacsson, N. H., Garke, M. Å., & Kaldo, V. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/q6532 · Cited by 1
Nielssen, O. B., Staples, L., Karin, E., Kayrouz, R., Dear, B. F., & Titov, N. (2020) · Research Square · doi:10.21203/rs.3.rs-80609/v1
Self-citationTifft, E. D. (2023) · Scholars Archive - University at Albany (University at Albany, State University of New York) · doi:10.54014/naqt-ghda · Cited by 2
Kayrouz, R., Karin, E., Staples, L., Nielssen, O., Dear, B. F., & Titov, N. (2020) · Figshare · doi:10.6084/m9.figshare.11972712
Self-citationKayrouz, R., Karin, E., Staples, L., Nielssen, O., Dear, B. F., & Titov, N. (2020) · Figshare · doi:10.6084/m9.figshare.11972697
Self-citationKayrouz, R., Karin, E., Staples, L., Nielssen, O., Dear, B. F., & Titov, N. (2020) · Figshare · doi:10.6084/m9.figshare.11972709
Self-citationKayrouz, R., Karin, E., Staples, L., Nielssen, O., Dear, B. F., & Titov, N. (2020) · Figshare · doi:10.6084/m9.figshare.11972691
Self-citationKayrouz, R., Karin, E., Staples, L., Nielssen, O., Dear, B. F., & Titov, N. (2020) · Figshare · doi:10.6084/m9.figshare.11972721
Self-citationKayrouz, R., Karin, E., Staples, L., Nielssen, O., Dear, B. F., & Titov, N. (2020) · Figshare · doi:10.6084/m9.figshare.11972700
Self-citationBielinski, L. L., Arnold, S., Kojan, N., Staeger, L., Berger, T., Bisby, M. A., & Dear, B. F. (2026) · JMIR Research Protocols · doi:10.2196/preprints.102297
Self-citationBrehmer, J., Berg, M., Astudillo, G., Lindegaard, T., Find, A. E., Carlbring, P., Ludvigsson, M., & Andersson, G. (2026) · Journal of Affective Disorders · doi:10.1016/j.jad.2026.122494
Metadata
- Authors
- Karin, E., Dear, B. F., Heller, G. Z., Gandy, M., & Titov, N.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Karin, Eyal
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2018-07-12
- Volume
- 5
- Issue
- 3
- Pages
- e10200
- ISSN
- 2368-7959 (ISSN-L)
- PMC
- PMC6062691
- OpenAlex
- W2801744434
- Cited by
- 69
- References
- 54
- Citations by year
- 2026: 6 · 2025: 1 · 2024: 9 · 2023: 9 · 2022: 7 · 2021: 9 · 2020: 18 · 2019: 9 · 2018: 1
- FWCI
- 11.67
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Mental Health (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- PHQ-9, measurement error, baseline symptom severity, treatment efficacy, waitlist control
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.