CoChat

Digital Mental Health Intervention Plus Usual Care Compared With Usual Care Only and Usual Care Plus In-Person Psychological Counseling for Orthopedic Patients With Symptoms of Depression or Anxiety: Cohort Study

Open access

Published version of a preprint

The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index; 9 of the 11 sources its claims cite were checked for support.

Abstract

Background: Depression and anxiety frequently coexist with chronic musculoskeletal pain and can negatively impact patients' responses to standard orthopedic treatments. Nevertheless, mental health is not routinely addressed in the orthopedic care setting. If effective, a digital mental health intervention may be a feasible and scalable method of addressing mental health in an orthopedic setting. Objective: We aimed to compare 2-month changes in mental and physical health between orthopedic patients who received a digital mental health intervention in addition to usual orthopedic care, those who received usual orthopedic care only (without a specific mental health intervention), and those who received in-person care with a psychologist as part of their orthopedic treatment plan. Methods: In this single-center retrospective cohort study involving ancillary analysis of a pilot feasibility study, 2-month self-reported health changes were compared between a cohort of orthopedic patients who received access to a digital mental health intervention (Wysa) and 2 convenience sample comparison cohorts (patients who received usual orthopedic care without a specific mental health intervention and patients who received in-person care with a psychologist as part of their orthopedic treatment plan). All patients were 18 years or older and reported elevated symptoms of depression or anxiety at an orthopedic clinic visit (Patient-Reported Outcomes Measurement Information System [PROMIS] Depression or Anxiety score ≥55). The digital intervention was a multi-component mobile app that used chatbot technology and text-based access to human counselors to provide cognitive behavioral therapy, mindfulness training, and sleep tools, among other features, with an emphasis on behavioral activation and pain acceptance. Outcomes of interest were between-cohort differences in the 2-month longitudinal changes in PROMIS Depression and Anxiety scores (primary outcomes) and PROMIS Pain Interference and Physical Function scores (secondary outcomes). Results: Among 153 patients (mean age 55, SD 15 years; 128 [83.7%] female; 51 patients per cohort), patients who received the digital mental health intervention showed clinically meaningful improvements at the 2-month follow-up for all PROMIS measures (mean longitudinal improvement 2.8-3.7 points; P≤02). After controlling for age and BMI, the improvements in PROMIS Depression, Pain Interference, and Physical Function were meaningfully greater than longitudinal changes shown by patients who received usual orthopedic care (mean between-group difference 2.6-4.8 points; P≤04). Improvements in PROMIS Physical Function were also meaningfully greater than longitudinal changes shown by patients who received in-person psychological counseling (mean between-group difference 2.4 points; P=.04). Conclusions: Patients who received a digital mental health intervention as part of orthopedic care reported greater 2-month mean improvements in depression, pain interference, and physical function than patients who received usual orthopedic care. They also reported a greater mean improvement in physical function and comparable improvements in depression, anxiety, and pain interference compared with orthopedic patients who received in-person psychological counseling. ©Ashwin J Leo, Matthew J Schuelke, Devyani M Hunt, J Philip Miller, Patricia A Areán, Abby L Cheng.

Overview

CoChat Summary

## TL;DR

In this single-center retrospective cohort study of 153 orthopedic patients with elevated depression or anxiety symptoms, adding the digital mental health intervention Wysa to usual care was associated with greater 2-month improvements in depression, pain interference, and physical function than usual care alone. Compared with in-person psychological counseling, Wysa produced comparable improvements in depression, anxiety, and pain interference, and a greater improvement in physical function.

## Key findings

  • The study included 153 patients with a mean age of 55 years (SD 15); 128 (83.7%) were female, and there were 51 patients per cohort.
  • At 2 months, the digital intervention cohort showed clinically meaningful within-person improvements in:
  • PROMIS Depression: −3.5 points (95% CI −5.9 to −1.1; P=.006)
  • PROMIS Anxiety: −3.7 points (95% CI −5.9 to −1.4; P=.002)
  • PROMIS Pain Interference: −2.8 points (95% CI −5.2 to −0.4; P=.02)
  • PROMIS Physical Function: +3.3 points (95% CI 1.3 to 5.4; P=.002)
  • After adjustment for age and BMI, the digital cohort had greater 2-month improvements than usual care in:
  • Depression: between-group difference −4.8 points (95% CI −7.6 to −1.9; P=.001)
  • Pain Interference: −2.6 points (95% CI −5.1 to −0.2; P=.04)
  • Physical Function: 2.4-2.7 points (reported across tables/text; P=.02 to .04)
  • Compared with in-person psychological counseling, the digital intervention showed a greater improvement in physical function (2.4 points, 95% CI 0.2 to 4.7; P=.04) and no statistically significant or clinically meaningful differences in depression or anxiety.

## Methods

  • Design: Single-center retrospective cohort study with ancillary analysis of a single-arm pilot feasibility study and medical record data; conducted at a tertiary care academic medical center in the United States between 2017 and 2021.
  • Sample: Adults ≥18 years in orthopedic care with elevated PROMIS depression or anxiety scores (≥55); compared a Wysa cohort, a usual orthopedic care convenience sample, and an in-person psychological counseling convenience sample.
  • Analysis: Compared 2-month longitudinal change in PROMIS Depression/Anxiety (primary) and Pain Interference/Physical Function (secondary) using linear mixed models; age and BMI were tested as covariates, but unadjusted models were reported because adjustment did not materially change results.

## Limitations

  • The paper states several limitations of the retrospective, nonrandomized design: possible selection bias, differential attrition, regression to the mean, unmeasured confounding (including concomitant orthopedic and mental health interventions), undetected interaction effects, and temporal/historical bias.
  • The authors note potential healthy participant bias in the digital intervention cohort and possible bias in the comparison cohorts; additionally, only 51 of 61 participants from the prospective Wysa study were included in this analysis.
  • The paper states generalizability is limited because this was a single-center study at a tertiary care center; more broadly, the text also makes evident that cohorts were convenience samples and baseline differences existed between groups (this is stated in the paper).

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/36203

Cites

52 of 52 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Depression scores over a 2-month follow-up in patients who, as part of orthopedic care, were provided a digital mental health intervention (Wysa) (n=51) (green circles), received usual orthopedic care (n=51) (blue triangles), or received “gold standard” in-person care with a psychologist (n=51) (purple squares). The triangle within a circle signifies a between-cohort difference in the longitudinal change between the digital mental health intervention cohort and usual orthopedic care cohort. Error bars represent standard error.
Figure 1 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Depression scores over a 2-month follow-up in patients who, as part of orthopedic care, were provided a digital mental health intervention (Wysa) (n=51) (green circles), received usual orthopedic care (n=51) (blue triangles), or received “gold standard” in-person care with a psychologist (n=51) (purple squares). The triangle within a circle signifies a between-cohort difference in the longitudinal change between the digital mental health intervention cohort and usual orthopedic care cohort. Error bars represent standard error.CC BY · PubMed Central
Figure 2 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Anxiety scores over a 2-month follow-up in patients who, as part of orthopedic care, were provided a digital mental health intervention (Wysa) (n=51) (green circles), received usual orthopedic care (n=51) (blue triangles), or received “gold standard” in-person care with a psychologist (n=51) (purple squares). Error bars represent standard error.
Figure 2 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Anxiety scores over a 2-month follow-up in patients who, as part of orthopedic care, were provided a digital mental health intervention (Wysa) (n=51) (green circles), received usual orthopedic care (n=51) (blue triangles), or received “gold standard” in-person care with a psychologist (n=51) (purple squares). Error bars represent standard error.CC BY · PubMed Central
Figure 3 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Pain Interference scores over a 2-month follow-up in orthopedic patients who, as part of orthopedic care, were provided a digital mental health intervention (Wysa) (n=51) (green circles), received usual orthopedic care (n=51) (blue triangles), or received “gold standard” in-person care with a psychologist (n=51) (purple squares). The triangle within a circle signifies a between-cohort difference in the longitudinal change between the digital mental health intervention cohort and usual orthopedic care cohort. Error bars represent standard error.
Figure 3 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Pain Interference scores over a 2-month follow-up in orthopedic patients who, as part of orthopedic care, were provided a digital mental health intervention (Wysa) (n=51) (green circles), received usual orthopedic care (n=51) (blue triangles), or received “gold standard” in-person care with a psychologist (n=51) (purple squares). The triangle within a circle signifies a between-cohort difference in the longitudinal change between the digital mental health intervention cohort and usual orthopedic care cohort. Error bars represent standard error.CC BY · PubMed Central
Figure 4 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function scores over a 2-month follow-up in orthopedic patients who, as part of orthopedic care, were provided a digital mental health intervention (Wysa) (n=51) (green circles), received usual orthopedic care (n=51) (blue triangles), or received “gold standard” in-person care with a psychologist (n=51) (purple squares). The triangle within a circle signifies a between-cohort difference in the longitudinal change between the digital mental health intervention cohort and usual orthopedic care cohort. The square within a circle signifies a between-cohort difference in the longitudinal change between the digital mental health intervention cohort and “gold standard” in-person psychological counseling cohort. Error bars represent standard error.
Figure 4 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function scores over a 2-month follow-up in orthopedic patients who, as part of orthopedic care, were provided a digital mental health intervention (Wysa) (n=51) (green circles), received usual orthopedic care (n=51) (blue triangles), or received “gold standard” in-person care with a psychologist (n=51) (purple squares). The triangle within a circle signifies a between-cohort difference in the longitudinal change between the digital mental health intervention cohort and usual orthopedic care cohort. The square within a circle signifies a between-cohort difference in the longitudinal change between the digital mental health intervention cohort and “gold standard” in-person psychological counseling cohort. Error bars represent standard error.CC BY · PubMed Central

Verification

Claims the paper makes

4 Valid · 0 Not valid · 0 Not checked · 35 Own results and interpretations

29 more claims

Create a free account to see all 39 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 3
  • It may state two separate claims as one. 2

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 52 references

Research works printed but not linked: 2

  1. Zelaya, C, 2020, NCHS Data Brief, 1
  2. Vranceanu, AM, 2017, Arch Bone Jt Surg, 5, 2

Cited by

Metadata

Authors
Leo, A. J., Schuelke, M. J., Hunt, D. M., Miller, J. P., Areán, P. A., & Cheng, A. L.
Affiliations
  • Washington University in St. Louis (US)
  • University of Washington (US)
Corresponding author
Cheng, Abby L
Venue
JMIR Formative Research
Published
2022-05-04
Volume
6
Issue
5
Pages
e36203
ISSN
2561-326X (ISSN-L)
OpenAlex
W4226502953
Cited by
40
References
51
Citations by year
2026: 7 · 2025: 15 · 2024: 7 · 2023: 9 · 2022: 2
FWCI
6.59
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Formative Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Digital Commons@Becker (Washington University School of Medicine) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
  • Doris Duke Charitable Foundation
  • Georgia Clinical and Translational Science Alliance
  • National Institutes of Health (UL1TR000448, TR000448)
  • National Cancer Institute (P30CA091842)
  • National Institute of Arthritis and Musculoskeletal and Skin Diseases (K23AR074520)
  • National Center for Advancing Translational Sciences
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
Keywords
digital mental health interventions, depression, anxiety, orthopedic patients, chronic musculoskeletal pain, Wysa, chatbots, cognitive behavioral therapy, mindfulness, behavioral activation, pain acceptance, pain interference, physical function, PROMIS, mobile health apps, usual care comparison, feasibility, patient-reported outcomes

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.