CoChat

A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study

Open access

Published version of a preprint

The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index; 17 of the 46 sources its claims cite were checked for support.

Abstract

Background: Symptoms of depression and anxiety commonly coexist with chronic musculoskeletal pain, and when this occurs, standard orthopedic treatment is less effective. However, mental health intervention is not yet a routine part of standard orthopedic treatment, in part because of access-related barriers. Digital mental health intervention is a potential scalable resource that could be feasibly incorporated into orthopedic care. Objective: This study’s primary purpose was to assess the feasibility of introducing a digital mental health intervention (Wysa) in an outpatient orthopedic setting to patients with coexisting symptoms of depression and/or anxiety. The secondary purpose was to perform a preliminary effectiveness analysis of the intervention. Methods: In this single-arm, prospective cohort study, participants included adult patients (18 years and older) who presented to a nonsurgical orthopedic specialist at a single tertiary care academic center for evaluation of a musculoskeletal condition and who self-reported symptoms of depression and/or anxiety (Patient-Reported Outcomes Measurement Information System [PROMIS] Depression and/or Anxiety score ≥55). Face-to-face enrollment was performed by a research coordinator immediately after the participant’s encounter with an orthopedic clinician. Participants were provided 2 months of access to a mobile app called Wysa, which is an established, multicomponent digital mental health intervention that uses chatbot technology and text-based access to human counselors to deliver cognitive behavioral therapy, mindfulness training, and sleep tools, among other features. For this study, Wysa access also included novel, behavioral activation–based features specifically developed for users with chronic pain. Primary feasibility outcomes included the study recruitment rate, retention rate, and engagement rate with Wysa (defined as engagement with a therapeutic Wysa tool at least once during the study period). Secondary effectiveness outcomes were between-group differences in mean longitudinal PROMIS mental and physical health score changes at 2-month follow-up between high and low Wysa users, defined by a median split. Results: The recruitment rate was 29.3% (61/208), retention rate was 84% (51/61), and engagement rate was 72% (44/61). Compared to low users, high users reported greater improvement in PROMIS Anxiety scores (between-group difference −4.2 points, 95% CI −8.1 to −0.2; P=.04) at the 2-month follow-up. Between-group differences in PROMIS Depression (−3.2 points, 95% CI −7.5 to 1.2; P=.15) and Pain Interference scores (−2.3 points, 95% CI −6.3 to 1.7; P=.26) favored high users but did not meet statistical significance. Improvements in PROMIS Physical Function scores were comparable between groups. Conclusions: Delivery of a digital mental health intervention within the context of orthopedic care is feasible and has the potential to improve mental health and pain-related impairment to a clinically meaningful degree. Participants’ engagement rates exceeded industry standards, and additional opportunities to improve recruitment and retention were identified. Further pilot study followed by a definitive, randomized controlled trial is warranted. Trial Registration: ClinicalTrials.gov NCT04640090; https://clinicaltrials.gov/ct2/show/NCT04640090

Overview

CoChat Summary

## TL;DR

This single-arm prospective cohort study found that offering the Wysa digital mental health intervention in an outpatient orthopedic clinic was feasible, with 29.3% recruitment, 84% retention, and 72% of enrolled participants engaging with the app. High users improved more in anxiety than low users at 2 months, with a between-group difference of −4.2 points on PROMIS Anxiety.

## Key findings

  • Recruitment rate was 29.3% (61/208), retention rate was 84% (51/61), and engagement with Wysa was 72% (44/61).
  • Among enrolled participants, the weekly engagement rate was 57% (35/61) and the coach engagement rate was 33% (20/61).
  • Compared with low users, high users showed greater 2-month improvement in PROMIS Anxiety: −4.2 points (95% CI −8.1 to −0.2; P=.04).
  • High users also favored improvement in PROMIS Depression (−3.2 points, 95% CI −7.5 to 1.2; P=.15) and Pain Interference (−2.3 points, 95% CI −6.3 to 1.7; P=.26), but these were not statistically significant; PROMIS Physical Function improved similarly in both groups.

## Methods

  • Design: Single-arm, prospective cohort, pilot feasibility study at a single tertiary care academic medical center in the United States; participants were enrolled from December 8, 2020, through July 14, 2021.
  • Sample/data: Adults 18+ seeing a nonsurgical orthopedic provider for a musculoskeletal condition, with PROMIS Depression and/or Anxiety ≥55; excluded if planning in-person mental health treatment or without a mobile device. Data came from electronic medical records, self-report, and Wysa usage logs.
  • Main analysis: Feasibility was assessed via recruitment, retention, and engagement rates; preliminary effectiveness used linear mixed-effects models comparing high vs low Wysa users (median split) on 2-month changes in PROMIS Depression, Anxiety, Pain Interference, and Physical Function.

## Limitations

  • The paper states the primary limitation was no true control arm because of limited resources.
  • The paper notes possible healthy participant bias: high users may have been more ready than low users to address mental health, and similar bias may have affected who enrolled.
  • Evident from the text: this was a single-center study with nonsurgical orthopedic providers only, so generalizability is limited.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/34889

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Screenshots of Wysa’s chronic pain version.
Figure 1 Screenshots of Wysa’s chronic pain version.CC BY · PubMed Central
Figure 2 Participant flow, from initial study contact through final follow-up.
Figure 2 Participant flow, from initial study contact through final follow-up.CC BY · PubMed Central
Figure 3 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Depression scores over 2-month follow-up in patients who presented to an orthopedic clinic for a musculoskeletal condition, reported coexisting symptoms of depression and/or anxiety, and were high users (n=30, green circles) versus low users (n=31, blue triangles) of a digital mental health intervention (Wysa). Error bars represent standard errors.
Figure 3 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Depression scores over 2-month follow-up in patients who presented to an orthopedic clinic for a musculoskeletal condition, reported coexisting symptoms of depression and/or anxiety, and were high users (n=30, green circles) versus low users (n=31, blue triangles) of a digital mental health intervention (Wysa). Error bars represent standard errors.CC BY · PubMed Central
Figure 4 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Anxiety scores over 2-month follow-up in patients who presented to an orthopedic clinic for a musculoskeletal condition, reported coexisting symptoms of depression and/or anxiety, and were high users (n=30, green circles) versus low users (n=31, blue triangles) of a digital mental health intervention (Wysa). Error bars represent standard errors. Asterisk represents a statistically significant between-group difference in longitudinal score changes from baseline to 2-month follow-up (P<.05).
Figure 4 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Anxiety scores over 2-month follow-up in patients who presented to an orthopedic clinic for a musculoskeletal condition, reported coexisting symptoms of depression and/or anxiety, and were high users (n=30, green circles) versus low users (n=31, blue triangles) of a digital mental health intervention (Wysa). Error bars represent standard errors. Asterisk represents a statistically significant between-group difference in longitudinal score changes from baseline to 2-month follow-up (P<.05).CC BY · PubMed Central
Figure 5 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Pain Interference scores over 2-month follow-up in patients who presented to an orthopedic clinic for a musculoskeletal condition, reported coexisting symptoms of depression and/or anxiety, and were high users (n=30, green circles) versus low users (n=31, blue triangles) of a digital mental health intervention (Wysa). Error bars represent standard errors.
Figure 5 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Pain Interference scores over 2-month follow-up in patients who presented to an orthopedic clinic for a musculoskeletal condition, reported coexisting symptoms of depression and/or anxiety, and were high users (n=30, green circles) versus low users (n=31, blue triangles) of a digital mental health intervention (Wysa). Error bars represent standard errors.CC BY · PubMed Central
Figure 6 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function scores over 2-month follow-up in patients who presented to an orthopedic clinic for a musculoskeletal condition, reported coexisting symptoms of depression and/or anxiety, and were high users (n=30, green circles) versus low users (n=31, blue triangles) of a digital mental health intervention (Wysa). Error bars represent standard errors..
Figure 6 Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function scores over 2-month follow-up in patients who presented to an orthopedic clinic for a musculoskeletal condition, reported coexisting symptoms of depression and/or anxiety, and were high users (n=30, green circles) versus low users (n=31, blue triangles) of a digital mental health intervention (Wysa). Error bars represent standard errors..CC BY · PubMed Central

Verification

Claims the paper makes

6 Valid · 1 Not valid · 15 Not checked · 38 Own results and interpretations

29 more claims · 1 with their cited sources checked

Create a free account to see all 60 claims and to verify the 29 references still open.

See all claims — free account
  • Probably not a substantial claim. 16
  • It may state two separate claims as one. 14

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 44 references

Research works printed but not linked: 3

  1. Zelaya, C, 2020, NCHS Data Brief, 1
  2. Vranceanu, AM, 2017, Arch Bone Jt Surg, 5, 2
  3. Zimmerman, GL, 2000, Am Fam Physician, 61, 1409

Cited by

Metadata

Authors
Leo, A. J., Schuelke, M. J., Hunt, D. M., Metzler, J. P., Miller, J. P., Areán, P. A., Armbrecht, M. A., & Cheng, A. L.
Affiliations
  • Washington University in St. Louis (US)
  • University of Washington (US)
Corresponding author
Cheng, Abby L
Venue
JMIR Formative Research
Published
2022-02-21
Volume
6
Issue
2
Pages
e34889
ISSN
2561-326X (ISSN-L)
OpenAlex
W4205207624
Cited by
70
References
44
Citations by year
2026: 10 · 2025: 20 · 2024: 18 · 2023: 15 · 2022: 7
FWCI
13.25
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Formative Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
  • Doris Duke Charitable Foundation
  • National Institutes of Health
  • National Institute of Arthritis and Musculoskeletal and Skin Diseases (K23AR074520)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
Keywords
digital mental health interventions, depression, anxiety, chronic musculoskeletal pain, orthopedic patients, Wysa, chatbots, mobile application, behavioral activation, cognitive behavioral therapy, mindfulness, PROMIS, feasibility, retention, engagement, treatment-resistant depression, digital therapeutics, mental health outcomes, patient-reported outcomes

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.