The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index; 4 of the 8 sources its claims cite were checked for support.
Predictors and Correlates of Depression and Anxiety Symptom Trajectories in a Large Digital Mental Health Provider: Retrospective Analysis of Data From Rula Health
Open accessAbstract
Background: Depression and anxiety are highly prevalent and burdensome, yet many individuals, especially those with subclinical symptoms, remain underserved by traditional care models. While digital mental health interventions (DMHIs) have improved access, few integrate high-frequency measurement-based care (MBC) or evaluate outcomes across the full spectrum of symptom severity in real-world settings. Objective: The purpose of this study was to examine the effects of participation in a commercial MBC DMHI, Rula Health, on changes in depression and anxiety over time in both subclinical and clinical patients. We aimed to (1) explore the trajectories of anxiety and depression symptoms and (2) examine the impact of demographics and primary diagnosis on depression and anxiety trajectories. Methods: We retrospectively analyzed longitudinal symptom data from adults receiving therapy through Rula Health, an MBC-based DMHI. Depression, via the Patient Health Questionnaire-9 (PHQ-9), and anxiety symptoms, via the Generalized Anxiety Disorder-7 (GAD-7), were measured before each visit over 12 therapy visits. Linear spline mixed-effects models with a knot placed at 5 visits (based on visual inspection) were used to evaluate symptom trajectories and identify moderators of treatment response, including demographic characteristics and primary diagnosis. Results: A total of 365,741 adults (mean age 37.03, SD 11.81 years; 238,839/360,388, 66.27% female; 87,758/145,947, 60.13% White) with 2,685,103 therapy visits were included in the sample. Baseline depression (ie, PHQ-9) and anxiety (ie, GAD-7) scores averaged 9.41 (SD 6.61) and 9.45 (SD 5.65), respectively, decreasing to 6.37 (SD 5.83) and 6.50 (SD 5.01) within 12 visits. Depression (β=−0.72, P<.001) and anxiety (β=−0.72, P<.001) symptoms decreased significantly over the first 5 visits, and to a lesser degree over visits 6‐12 (depression: β=−0.02, P<.001; anxiety: β=−0.0078, P=.004). Faster improvements over visits 1‐5 occurred in younger patients (βPHQ=0.0031, P<.001; βGAD=0.0027, P<.001), and those identifying as Black/African American (βPHQ=–0.089, P<.001; βGAD =−0.042, P<.001), American Indian/Alaska Native (βPHQ=–0.14, P<.001; βGAD=−0.11, P<.001), and Native Hawaiian/Pacific Islander (βPHQ=−0.12, P<.001; βGAD=−0.069, P=.01). Patients with an anxiety (βGAD=−0.071, P<.001) or trauma-related (βGAD=−0.021, P=.03) disorder had faster improvements in GAD-7. Conclusions: This study contributes to the growing evidence base from commercial DMHIs by demonstrating significant improvements in depression and anxiety symptoms across both clinical and subclinical populations using real-world data from a large, national provider. Symptom reductions were most rapid in the first 5 visits, with continued improvements through session 12, especially among historically underserved groups. These findings highlight Rula Health’s ability to deliver early, sustained, and equitable outcomes through an MBC model. © Kelsey Lynn McAlister, Lara Baez, Douglas Newton, Sam Seiniger, Amy Pearlman, Allie Woodhouse, Jennifer Huberty.
Overview
CoChat Summary
## TL;DR
In this retrospective study of 365,741 adults using Rula Health, depression and anxiety symptoms decreased over 12 therapy visits, with the steepest improvement in the first 5 visits. Faster early improvement was seen in some demographic groups and diagnosis categories, especially among younger patients and several racially minoritized groups.
## Key findings
- The sample included 365,741 adults and 2,685,103 therapy visits; mean age was 37.03 years (SD 11.81), 66.27% were female, and 60.13% of the reported race sample was White.
- Mean baseline symptom scores were PHQ-9 9.41 (SD 6.61) and GAD-7 9.45 (SD 5.65), decreasing by visit 12 to 6.37 (SD 5.83) and 6.50 (SD 5.01), respectively; effect sizes were Cohen d = −0.54 for depression and −0.58 for anxiety.
- Symptoms decreased most over the first 5 visits: depression β = −0.72, P < .001 and anxiety β = −0.72, P < .001; later improvements over visits 6–12 were smaller (depression β = −0.02 to −0.032, anxiety β = −0.0078 to −0.021, all reported as significant).
- Faster early improvement was associated with younger age and with Black/African American, American Indian/Alaska Native, and Native Hawaiian/Pacific Islander race; anxiety improved faster in patients with an anxiety disorder (βGAD = −0.071, P < .001) or trauma-related disorder (βGAD = −0.021, P = .03).
## Methods
- Retrospective cohort analysis of secondary, deidentified clinical data from Rula Health, a U.S. commercial measurement-based care digital mental health provider.
- Included adults aged 18+ who received therapy between August 20, 2020, and March 31, 2025; analysis was limited to the first 12 therapy visits.
- Depression and anxiety were assessed with PHQ-9 and GAD-7 before visits; trajectories were modeled with linear spline mixed-effects models using a knot at visit 5, with demographic characteristics and modal primary diagnosis as covariates and interaction terms.
## Limitations
- The paper states that, because this was an observational, non-randomized study, causal conclusions about treatment effectiveness are limited.
- The paper states that it did not measure engagement metrics (such as adherence, completion, or active participation), and it lacked other potentially important variables such as social support, therapy modality, comorbid diagnoses, and life stressors.
- The paper states that post-treatment follow-up data were not collected, so durability of symptom improvements after care ended is unknown.
- Evident from the text: analyses were restricted to the first 12 visits, and the authors note high missingness at exactly 12 visits (~80%), which required last observation carried forward and multiple imputation for sensitivity analyses.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
3 Valid · 0 Not valid · 3 Not checked · 16 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and to a lesser degree over visits 6‐12 (β=−0.021, P<.001)”
§ Predictors and Correlates of Depression and Anxiety Symptom Trajectories in a Large Digital Mental Health Provider: Retrospective Analysis of Data From Rula Health > Results > Patient Symptom Trajectories Over Time
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“6.50 (SD 5.01) for anxiety symptoms”
§ Predictors and Correlates of Depression and Anxiety Symptom Trajectories in a Large Digital Mental Health Provider: Retrospective Analysis of Data From Rula Health > Results > Data Availability and Demographics
plainn = 365,741- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Black/African American race, American Indian/Alaska Native race, and Native Hawaiian/Pacific Islander race were associated with faster improvement in both depression and anxiety over visits 1‐5.”
§ Predictors and Correlates of Depression and Anxiety Symptom Trajectories in a Large Digital Mental Health Provider: Retrospective Analysis of Data From Rula Health > Results > Interaction Effects of Patient Characteristics on Symptom Trajectories Over Time
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A total of 365,741 adults and 2,685,103 therapy visits were included in the analysis.”
§ Predictors and Correlates of Depression and Anxiety Symptom Trajectories in a Large Digital Mental Health Provider: Retrospective Analysis of Data From Rula Health > Results > Data Availability and Demographics
plainn = 365,741- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found that attending more therapy sessions was associated with greater symptom improvement.”
§ Predictors and Correlates of Depression and Anxiety Symptom Trajectories in a Large Digital Mental Health Provider: Retrospective Analysis of Data From Rula Health > Discussion > Conclusions
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
8 more claims
Create a free account to see all 22 claims and every source verdict.
- Probably not a substantial claim. 7
- It may state two separate claims as one. 4
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · cited 1×
“Higher scores indicate greater depression severity [29].”
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 1×
“Higher scores indicate greater anxiety severity [32,33].”
Seber, G. A. F., & Wild, C. J. (1989) · Wiley Series in Probability and Statistics · doi:10.1002/0471725315 · Cited by 1,962
Carlbring, P., Andersson, G., Cuijpers, P., Riper, H., & Hedman-Lagerlöf, E. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1401115 · Cited by 1,232 · cited 1×
“While research supports the effectiveness of teletherapy for depression and anxiety [20-22], most studies do not use large, representative patient samples from real-world DMHIs and do not evaluate interventions that use symptom data in real time to guide clinical care, as is characteristic of true…”
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · cited 1×
“…that use symptom data in real time to guide clinical care, as is characteristic of true MBC. DMHI studies often focus on individuals with moderate to severe symptoms [23,24], despite evidence that those with lower severity symptoms are at high risk of developing clinical disorders [3,4].”
The role of masculinity in men's help-seeking for depression: A systematic review
Seidler, Z. E., Dawes, A. J., Rice, S. M., Oliffe, J. L., & Dhillon, H. M. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.09.002 · Cited by 1,093
Cuijpers, P., Berking, M., Andersson, G., Quigley, L., Kleiboer, A., & Dobson, K. S. (2013) · The Canadian Journal of Psychiatry · doi:10.1177/070674371305800702 · Cited by 1,066 · cited 1×
“Data were limited to the first 12 visits because this is a common length of treatment in clinical trials [34], and thus estimates a relative episode of care at Rula Health.”
Sudden gains and critical sessions in cognitive-behavioral therapy for depression.
Tang, T. Z., & DeRubeis, R. J. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.6.894 · Cited by 684 · cited 2×
“Similar patterns of early symptom reductions have been observed in other studies of DMHIs [46-50], aligning with the idea of “sudden gains” in therapy, where symptoms improve quickly at first, then level out [26].”
Implementing Measurement-Based Care in Behavioral Health: A Review
Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., Douglas, S., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3329 · Cited by 605 · cited 1×
“Despite its well-documented benefits [18], adoption remains low—fewer than 20% of mental health practitioners use it consistently, and only 5% implement it at the recommended frequency [19].”
A review of spline function procedures in R
Perperoglou, A., Sauerbrei, W., Abrahamowicz, M., & Schmid, M. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0666-3 · Cited by 585
Research works printed but not linked: 2
- Rafieifar, Res Soc Work Pract
- Office of the Surgeon General (US), the Center for Mental Health Services (US), and the National Institute of Mental Health (US). Culture counts: the influence of culture and society on mental health. In: Mental Health: Culture, Race, and Ethnicity: A Supplement to Mental Health: A Report of the Surgeon General. Substance Abuse and Mental Health Services Administration (US); 2001. URL: https://www.ncbi.nlm.nih.gov/books/NBK44249 [Accessed 26-03-2025]
Cited by
Baez, L. M., McAlister, K. L., Newton, D. A., Seiniger, S., Woodhouse, A., & Huberty, J. (2025) · JMIR Pediatrics and Parenting · doi:10.2196/81444 · Cited by 3
“Rula Health’s therapy and psychiatry care models have been detailed elsewhere [34].”
Self-citationLuo, Y. X., Qiu, C., & Zhang, Z. N. (2026) · doi:10.2196/preprints.103873
Metadata
- Authors
- McAlister, K. L., Baez, L., Newton, D., Seiniger, S., Pearlman, A., Woodhouse, A., & Huberty, J.
- Corresponding author
- McAlister, Kelsey Lynn
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2025-07-25
- Volume
- 27
- Pages
- e75750-e75750
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC12296207
- OpenAlex
- W4411060629
- Cited by
- 2
- References
- 62
- Citations by year
- 2026: 1 · 2025: 1
- FWCI
- 1.60
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- depression, anxiety, symptom trajectories, digital mental health interventions, measurement-based care, subclinical symptoms, treatment moderators, PHQ-9, GAD-7, primary diagnosis, demographic predictors, real-world evidence, external beam radiotherapy, symptom change over time
- MeSH terms
- Adult, Anxiety, Depression, Female, Humans, Male, Mental Health Services, Middle Aged, Retrospective Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
