A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index; 17 of the 46 sources its claims cite were checked for support.
Abstract
Background: Symptoms of depression and anxiety commonly coexist with chronic musculoskeletal pain, and when this occurs, standard orthopedic treatment is less effective. However, mental health intervention is not yet a routine part of standard orthopedic treatment, in part because of access-related barriers. Digital mental health intervention is a potential scalable resource that could be feasibly incorporated into orthopedic care. Objective: This study’s primary purpose was to assess the feasibility of introducing a digital mental health intervention (Wysa) in an outpatient orthopedic setting to patients with coexisting symptoms of depression and/or anxiety. The secondary purpose was to perform a preliminary effectiveness analysis of the intervention. Methods: In this single-arm, prospective cohort study, participants included adult patients (18 years and older) who presented to a nonsurgical orthopedic specialist at a single tertiary care academic center for evaluation of a musculoskeletal condition and who self-reported symptoms of depression and/or anxiety (Patient-Reported Outcomes Measurement Information System [PROMIS] Depression and/or Anxiety score ≥55). Face-to-face enrollment was performed by a research coordinator immediately after the participant’s encounter with an orthopedic clinician. Participants were provided 2 months of access to a mobile app called Wysa, which is an established, multicomponent digital mental health intervention that uses chatbot technology and text-based access to human counselors to deliver cognitive behavioral therapy, mindfulness training, and sleep tools, among other features. For this study, Wysa access also included novel, behavioral activation–based features specifically developed for users with chronic pain. Primary feasibility outcomes included the study recruitment rate, retention rate, and engagement rate with Wysa (defined as engagement with a therapeutic Wysa tool at least once during the study period). Secondary effectiveness outcomes were between-group differences in mean longitudinal PROMIS mental and physical health score changes at 2-month follow-up between high and low Wysa users, defined by a median split. Results: The recruitment rate was 29.3% (61/208), retention rate was 84% (51/61), and engagement rate was 72% (44/61). Compared to low users, high users reported greater improvement in PROMIS Anxiety scores (between-group difference −4.2 points, 95% CI −8.1 to −0.2; P=.04) at the 2-month follow-up. Between-group differences in PROMIS Depression (−3.2 points, 95% CI −7.5 to 1.2; P=.15) and Pain Interference scores (−2.3 points, 95% CI −6.3 to 1.7; P=.26) favored high users but did not meet statistical significance. Improvements in PROMIS Physical Function scores were comparable between groups. Conclusions: Delivery of a digital mental health intervention within the context of orthopedic care is feasible and has the potential to improve mental health and pain-related impairment to a clinically meaningful degree. Participants’ engagement rates exceeded industry standards, and additional opportunities to improve recruitment and retention were identified. Further pilot study followed by a definitive, randomized controlled trial is warranted. Trial Registration: ClinicalTrials.gov NCT04640090; https://clinicaltrials.gov/ct2/show/NCT04640090
Overview
CoChat Summary
## TL;DR
This single-arm prospective cohort study found that offering the Wysa digital mental health intervention in an outpatient orthopedic clinic was feasible, with 29.3% recruitment, 84% retention, and 72% of enrolled participants engaging with the app. High users improved more in anxiety than low users at 2 months, with a between-group difference of −4.2 points on PROMIS Anxiety.
## Key findings
- Recruitment rate was 29.3% (61/208), retention rate was 84% (51/61), and engagement with Wysa was 72% (44/61).
- Among enrolled participants, the weekly engagement rate was 57% (35/61) and the coach engagement rate was 33% (20/61).
- Compared with low users, high users showed greater 2-month improvement in PROMIS Anxiety: −4.2 points (95% CI −8.1 to −0.2; P=.04).
- High users also favored improvement in PROMIS Depression (−3.2 points, 95% CI −7.5 to 1.2; P=.15) and Pain Interference (−2.3 points, 95% CI −6.3 to 1.7; P=.26), but these were not statistically significant; PROMIS Physical Function improved similarly in both groups.
## Methods
- Design: Single-arm, prospective cohort, pilot feasibility study at a single tertiary care academic medical center in the United States; participants were enrolled from December 8, 2020, through July 14, 2021.
- Sample/data: Adults 18+ seeing a nonsurgical orthopedic provider for a musculoskeletal condition, with PROMIS Depression and/or Anxiety ≥55; excluded if planning in-person mental health treatment or without a mobile device. Data came from electronic medical records, self-report, and Wysa usage logs.
- Main analysis: Feasibility was assessed via recruitment, retention, and engagement rates; preliminary effectiveness used linear mixed-effects models comparing high vs low Wysa users (median split) on 2-month changes in PROMIS Depression, Anxiety, Pain Interference, and Physical Function.
## Limitations
- The paper states the primary limitation was no true control arm because of limited resources.
- The paper notes possible healthy participant bias: high users may have been more ready than low users to address mental health, and similar bias may have affected who enrolled.
- Evident from the text: this was a single-center study with nonsurgical orthopedic providers only, so generalizability is limited.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
6 Valid · 1 Not valid · 15 Not checked · 38 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“Participants’ engagement rates exceeded industry standards”
- Also stated in: § Implications These findings suggest that a fully powered, randomized controlled trial is feasible and warranted to assess the clinical benefit of offering a digital mental health intervention in the context of orthopedic care for patients with coexisting symptoms of depression and/or anxiety. Engagement in our study was notably higher than digital health industry standards, which measure engagement on the order of days instead of weeks or months [40]. The high engagement rates and positive clinical findings in this study are consistent with those in a study of 10,000 participants by Bailey et al [41], in which people with chronic low back and/or knee pain were given a 12-week digital health intervention sponsored by their employers [41]. In that study, 73% of participants continued engagement with the program into the third month. We hypothesize that introducing a digital health intervention through a trusted resource such as a physician or employer may contribute to these higher engagement rates. Furthermore, if an orthopedic provider referred a patient to a digital mental health intervention as part of standard care (as opposed to a research study), we hypothesize that rates of onboarding to the intervention would be even greater than the enrollment rates we observed in this study. Patients who present to an orthopedic clinic for a musculoskeletal condition have demonstrated a willingness to engage with digital (physical) health interventions [42], and incorporation of digital mental health support is a logical next step to improving clinical outcomes in orthopedic care. This line of study may also have implications for ambulatory care settings other than orthopedic clinics. We believe that clinical encounters related to chronic pain are a particularly opportune setting to address mental health because when patients understand that their physical pain experience is directly linked to their mental health, their desire to reduce pain becomes a tangible (and potentially nonstigmatizing) motivator for addressing mental health. This approach of inserting a mental health access point and resources could be applied to other frequently used ambulatory care settings that address chronic pain (eg, primary care, rheumatology, gastroenterology, headache clinics) [43], and it would create opportunities to provide mental health screening and intervention for patients with symptoms of depression and/or anxiety who might not have otherwise sought mental health treatment. In our experience, the orthopedic setting poses some especially challenging barriers to the discussion of mental health with patients, which include patients’ expectations regarding appropriate content to discuss during the clinic encounter and providers’ lack of training and possible lack of inherent interest or budgeted time to discuss mental health with patients. Therefore, evidence of the feasibility of delivering mental health intervention within the orthopedic setting is certainly encouraging for potential success in other ambulatory care settings that address chronic pain. Furthermore, although no coordination was made with patients’ established mental health care providers in this study (for those who were already receiving some form of mental health treatment), better care coordination and communication between nontraditional mental health “access points” (eg, within orthopedics) and patients’ established mental health providers should be focused on in the future. · plain
“Engagement in our study was notably higher than digital health industry standards, which measure engagement on the order of days instead of weeks or months [40].”
§ A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study > Abstract > Conclusions
What the sources say
- Disputedcites [40] sourceExperimental — accuracy not yet measured
Our copy of Baumel et al. (2019) reports the opposite direction: the Principal Findings state 'general user retention is poor, with a median 15-day retention of 3.9% and 30-day retention of 3.3%' and that these figures 'reflect the lower ranges of real-world retention rates reported in developer-led studies', while the Abstract concludes that 'only a small portion of users actually used the apps for a long period of time'. The App Usage section likewise gives a median daily open rate of only 4.0% and the discussion refers to 'the poor active user rates found in our analysis'. No passage frames the observed engagement as exceeding any industry standard or benchmark; the only 'relatively high' engagement noted is for the two peer-support apps relative to other techniques within the sample. (LLM, conf=0.72)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Implications These findings suggest that a fully powered, randomized controlled trial is feasible and warranted to assess the clinical benefit of offering a digital mental health intervention in the context of orthopedic care for patients with coexisting symptoms of depression and/or anxiety. Engagement in our study was notably higher than digital health industry standards, which measure engagement on the order of days instead of weeks or months [40]. The high engagement rates and positive clinical findings in this study are consistent with those in a study of 10,000 participants by Bailey et al [41], in which people with chronic low back and/or knee pain were given a 12-week digital health intervention sponsored by their employers [41]. In that study, 73% of participants continued engagement with the program into the third month. We hypothesize that introducing a digital health intervention through a trusted resource such as a physician or employer may contribute to these higher engagement rates. Furthermore, if an orthopedic provider referred a patient to a digital mental health intervention as part of standard care (as opposed to a research study), we hypothesize that rates of onboarding to the intervention would be even greater than the enrollment rates we observed in this study. Patients who present to an orthopedic clinic for a musculoskeletal condition have demonstrated a willingness to engage with digital (physical) health interventions [42], and incorporation of digital mental health support is a logical next step to improving clinical outcomes in orthopedic care. This line of study may also have implications for ambulatory care settings other than orthopedic clinics. We believe that clinical encounters related to chronic pain are a particularly opportune setting to address mental health because when patients understand that their physical pain experience is directly linked to their mental health, their desire to reduce pain becomes a tangible (and potentially nonstigmatizing) motivator for addressing mental health. This approach of inserting a mental health access point and resources could be applied to other frequently used ambulatory care settings that address chronic pain (eg, primary care, rheumatology, gastroenterology, headache clinics) [43], and it would create opportunities to provide mental health screening and intervention for patients with symptoms of depression and/or anxiety who might not have otherwise sought mental health treatment. In our experience, the orthopedic setting poses some especially challenging barriers to the discussion of mental health with patients, which include patients’ expectations regarding appropriate content to discuss during the clinic encounter and providers’ lack of training and possible lack of inherent interest or budgeted time to discuss mental health with patients. Therefore, evidence of the feasibility of delivering mental health intervention within the orthopedic setting is certainly encouraging for potential success in other ambulatory care settings that address chronic pain. Furthermore, although no coordination was made with patients’ established mental health care providers in this study (for those who were already receiving some form of mental health treatment), better care coordination and communication between nontraditional mental health “access points” (eg, within orthopedics) and patients’ established mental health providers should be focused on in the future. · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Furthermore, a growing body of evidence supports the effectiveness of digital mental health interventions in improving depression and anxiety symptoms, sometimes to a degree equivalent to that obtained from in-person treatment [17-19].”
§ A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study > Introduction > Background
What the sources say
- Supportedcites [17] source
The introductory passage (p. 3) describes more than 200 randomized trials, often finding internet-delivered CBT effective against controls, with anxiety and depression among its typical targets. The Discussion (p. 16) reports that internet-delivered and face-to-face CBT were equally effective for depressive symptoms and several anxiety disorders. This supports the cited sentence’s qualified claim that digital interventions can sometimes achieve comparable results. (LLM, conf=0.90)
- Partly supportedcites [18] sourceExperimental — accuracy not yet measured
The Introduction reports that computerized therapies can reduce anxiety symptoms with efficacy similar to face-to-face treatment, and the Discussion concludes that smartphone interventions can reduce anxiety. The paper does not establish improvement in depression symptoms: the study it describes as targeting major depression is discussed for its anxiety outcome (section 3.6). The Discussion also says smartphone-only therapy had not yet been compared directly with face-to-face therapy. (LLM, conf=0.87)
- Partly supportedcites [19] sourceExperimental — accuracy not yet measured
The Abstract and Discussion report that app-supported smartphone interventions improved depressive and anxiety symptoms compared with controls. The Abstract also says they did not differ significantly from active interventions, including face-to-face treatment, but notes that few studies made those comparisons (n≤13). A nonsignificant difference does not establish equivalent effectiveness to in-person treatment. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
None of the sources cited for this claim have been checked yet.
In the paper
“when this occurs, standard orthopedic treatment is less effective.”
- Also stated in: § Background · plain
“when a person has both conditions simultaneously, the effectiveness of standard treatment for either condition in isolation is reduced [5-7].”
§ A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study > Abstract > Background
What the sources say
- Not checked yetcites [5] source
- Could not verifycites [6] sourceExperimental — accuracy not yet measured
The Results and Discussion (pp. 732–741) address the effect of pain on depression-treatment outcomes, not the effect of depression or anxiety on orthopedic treatment. A search for orthopedic treatment and musculoskeletal-pain outcomes found no passage assessing whether standard orthopedic care is less effective in patients with these conditions. (LLM, conf=0.76)
- Not checked yetcites [7] source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Background · plain
None of the sources cited for this claim have been checked yet.
In the paper
“Chronic pain and psychological impairment such as depression and anxiety are driven by shared biological pathways and neurotransmitters”
§ A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study > Introduction > Background
What the sources say
- Not checked yetcites [5] source
- Could not verifycites [6] sourceExperimental — accuracy not yet measured
The Introduction (paper pp. 732–741) describes pain and depression as frequently co-occurring and discusses antidepressants that can treat certain pain conditions. The Discussion mentions panic symptoms, but neither passage says that pain, depression, and anxiety are driven by shared biological pathways or neurotransmitters. Searches for shared pathways and neurotransmitter mechanisms found no passage addressing that claim. (LLM, conf=0.76)
- Not checked yetcites [7] source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Minimum clinically meaningful effect sizes were a priori chosen in accordance with previously published literature involving patients with chronic musculoskeletal pain who were managed nonoperatively.”
§ A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study > Methods > Outcomes
What the sources say
- Supportedcites [34] source
Lee et al. (2017) is exactly the kind of work the citing sentence invokes: its METHODS ('Minimally important differences') state that 'only MIDs that met 3 a priori criteria were selected,' the third being that 'Effect size (Cohen's d) of each MID falls within plausible range (0.2≤ x≤ 0.8)', reiterated in the DISCUSSION as an effect size 'both large enough to be considered important (≥0.2) and small enough to be considered minimal (0.8≥).' Its cohort (METHODS, 'Study participants') are adults with symptomatic knee osteoarthritis (mean pain duration 8.7 years, i.e. chronic musculoskeletal pain) enrolled in a randomized trial of Tai Chi versus physical therapy — nonoperative management, with intra-articular steroid injection or knee replacement within three months an exclusion. So the cited paper both pre-specifies minimum clinically meaningful effect-size thresholds and does so in a nonoperatively managed chronic musculoskeletal pain population, supporting the identification/exemplification the citation offers. (The 0.2–0.8 bounds themselves are credited in the source to its references 55 and 79, but the claim only asserts that such a priori thresholds appear in prior literature in this population, which the source satisfies.) (LLM, conf=0.82)
- Partly supportedcites [35] sourceExperimental — accuracy not yet measured
The source does fit the descriptive frame of the citation: it is previously published literature on 244 primary care patients with chronic musculoskeletal pain managed nonoperatively (Abstract: secondary analysis of the SCOPE randomized trial of optimized analgesic therapy at the Roudebush VA), and it reports minimum clinically important change values — MID of 2 points (depression) and 2.5 points (anxiety), with a three-point change called a conservative estimate (Discussion). What it does not support is the specific thing attributed: our copy nowhere reports or chooses 'minimum clinically meaningful effect sizes' a priori — the Statistical Analysis section derives the MID post hoc from the standard error of measurement (1 or 2 SEMs, refs 33,34) in raw scale points, not standardized effect sizes, and the paper is a psychometric operating-characteristics analysis rather than a trial protocol setting a priori thresholds. (LLM, conf=0.72)
- Supportedcites [36] source
Chen et al. (2018) is exactly the kind of published literature the citing sentence invokes: its Methods (2.1, Design and Participants) describe Samples 1 and 2 as primary-care RCTs of non-surgical treatments (pharmacological vs behavioral for chronic low back pain; opioid vs non-opioid medication for chronic back pain or hip/knee osteoarthritis), and the Discussion states that 'pain in the two pain trials was chronic and musculoskeletal.' The paper supplies minimum clinically meaningful thresholds for those chronic musculoskeletal pain samples: effect-size-based bounds of 0.2/0.35/0.5 SD (Methods 2.4.1) and recommended MIDs of 2.0–3.0 points (Results 3.4). The only element not stated verbatim is 'managed nonoperatively,' which follows from the trial designs our copy reports; the citing authors' own a priori choice is their statement, not attributed content. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
29 more claims · 1 with their cited sources checked
Create a free account to see all 60 claims and to verify the 29 references still open.
- Probably not a substantial claim. 16
- It may state two separate claims as one. 14
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our previous pilot work related to this digital mental health intervention suggested that depression symptoms continued to improve between 1- and 2-month follow-ups [25].”
From Behavioral Mechanisms That Mediate Mental and Physical Health Improvements in People With Chronic Pain Who Receive a Digital Health Intervention: Prospective Cohort Pilot Study (2023) · cites this paper as [25]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This study adds clinical context to our previously reported finding that it is feasible to deliver a digital mental health intervention in the setting of orthopedic care [14].”
The cited source says what the claim attributes to it.
In the citing paper
“Our preliminary work suggests that a digital mental health intervention (Wysa for Chronic Pain) which was designed to address these 3 behavioral targets can improve self-reported mental and physical health in patients who present for orthopedic management of chronic musculoskeletal pain and have coexisting symptoms of depression and anxiety [25,26].”
Citations
Cites
Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.08.010 · Cited by 51,384 · cited 1×
“All electronic medical record and self-reported data were stored in a secure electronic Research Electronic Data Capture (REDCap; Vanderbilt University) database [32,33].”
MethodThe REDCap consortium: building an international community of software platform partners
Harris, P. A., Taylor, R., Minor, B. L., Elliott, V., Fernandez, M., O'Neal, L., McLeod, L., Delacqua, G., Delacqua, F., Kirby, J., et al. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103208 · Cited by 24,013 · cited 1×
“All electronic medical record and self-reported data were stored in a secure electronic Research Electronic Data Capture (REDCap; Vanderbilt University) database [32,33].”
MethodThe brief resilience scale: Assessing the ability to bounce back
Smith, B. W., Dalen, J., Wiggins, K., Tooley, E., Christopher, P., & Bernard, J. (2008) · International Journal of Behavioral Medicine · doi:10.1080/10705500802222972 · Cited by 6,439 · cited 3×
“3.2 (2.5-3.7)Brief Resilience Scale scorec, median (IQR) Potential for behavior changed, median (IQR) 76 (68-90)Importance of change 69 (50-82)Readiness for change 68 (50-74)Confidence in the ability to change 46 (75)Any pain medication use, n (”
BackgroundInfluentialDepression and Pain Comorbidity: A Literature Review
Bair, M. J., Robinson, R. L., Katon, W., & Kroenke, K. (2003) · Archives of Internal Medicine · doi:10.1001/archinte.163.20.2433 · Cited by 3,463
Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., Ader, D., Fries, J. F., Bruce, B., & Rose, M. (2007) · Medical Care · doi:10.1097/01.mlr.0000258615.42478.55 · Cited by 3,118
Area Deprivation and Widening Inequalities in US Mortality, 1969–1998
Singh, G. K. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.7.1137 · Cited by 1,423 · cited 1×
“aThe national Area Deprivation Index is a community-level measure of social disadvantage based on a person’s 9-digit zip code [37,38].”
BackgroundNeighborhood Socioeconomic Disadvantage and 30-Day Rehospitalization: A Retrospective Cohort Study
Kind, A. J. H., Jencks, S., Brock, J., Yu, M., Bartels, C., Ehlenbach, W., Greenberg, C., & Smith, M. (2014) · Annals of Internal Medicine · doi:10.7326/m13-2946 · Cited by 1,379
Barriers to mental health treatment: results from the WHO World Mental Health surveys
Andrade, L. H., Alonso, J., Mneimneh, Z., Wells, J. E., Al-Hamzawi, A., Borges, G., Bromet, E., Bruffaerts, R., de Girolamo, G., de Graaf, R., et al. (2014) · Psychological Medicine · doi:10.1017/s0033291713001943 · Cited by 1,289 · cited 1×
“Among people who recognize their need for mental health treatment, 64% are resistant to reaching out to another person for assistance and 23% have financial, transportation, or time-related barriers to seeking care [13,14].”
BackgroundCarlbring, P., Andersson, G., Cuijpers, P., Riper, H., & Hedman-Lagerlöf, E. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1401115 · Cited by 1,232 · cited 1×
“Furthermore, a growing body of evidence supports the effectiveness of digital mental health interventions in improving depression and anxiety symptoms, sometimes to a degree equivalent to that obtained from in-person treatment [17-19].”
BackgroundTorous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199 · cited 1×
“With the widespread, everyday use of smartphones, these emerging digital tools could function as efficient, widely available mental health resources for orthopedic clinicians to offer their patients [16,20-22].”
BackgroundInkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063 · cited 1×
“Wysa is a multicomponent intervention that uses artificial intelligence–based chatbot technology and human “coaches” (counselors) with master’s degrees in psychology to deliver therapeutic content such as cognitive behavioral therapy, dialectical behavioral therapy, motivational interviewing, mindfulness training, dee…”
BackgroundObjective user engagement with mental health apps: systematic search and panel-based usage analysis
Baumel, A., Muench, F., Edan, S., & Kane, J. M. (2019) · Journal of Medical Internet Research · doi:10.2196/14567 · Cited by 965 · cited 1×
“Engagement in our study was notably higher than digital health industry standards, which measure engagement on the order of days instead of weeks or months [40].”
ResultMcWilliams, L. A., Cox, B. J., & Enns, M. W. (2003) · Pain · doi:10.1016/s0304-3959(03)00301-4 · Cited by 951 · cited 1×
“Of the over 70 million Americans who have chronic musculoskeletal pain, up to half of them have a comorbid diagnosis of depression and/or anxiety [1-4].”
BackgroundLinardon, J., Cuijpers, P., Carlbring, P., Messer, M., & Fuller‐Tyszkiewicz, M. (2019) · World Psychiatry · doi:10.1002/wps.20673 · Cited by 860 · cited 1×
“Furthermore, a growing body of evidence supports the effectiveness of digital mental health interventions in improving depression and anxiety symptoms, sometimes to a degree equivalent to that obtained from in-person treatment [17-19].”
BackgroundMohr, D. C., Burns, M. N., Schueller, S. M., Clarke, G., & Klinkman, M. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.03.008 · Cited by 693 · cited 1×
“With the widespread, everyday use of smartphones, these emerging digital tools could function as efficient, widely available mental health resources for orthopedic clinicians to offer their patients [16,20-22].”
BackgroundLearning to live with the pain: acceptance of pain predicts adjustment in persons with chronic pain
McCracken, L. M. (1998) · Pain · doi:10.1016/s0304-3959(97)00146-2 · Cited by 685
Firth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675 · cited 1×
“Furthermore, a growing body of evidence supports the effectiveness of digital mental health interventions in improving depression and anxiety symptoms, sometimes to a degree equivalent to that obtained from in-person treatment [17-19].”
BackgroundThe burden of musculoskeletal diseases in the United States
Yelin, E., Weinstein, S., & King, T. (2016) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2016.07.013 · Cited by 537
Lee, H., Hübscher, M., Moseley, G. L., Kamper, S. J., Traeger, A. C., Mansell, G., & McAuley, J. H. (2015) · Pain · doi:10.1097/j.pain.0000000000000146 · Cited by 526 · cited 1×
“For example, among people who seek care for chronic musculoskeletal pain, those with coexisting depression and/or anxiety report worse pain, greater physical impairment, increased postoperative opioid use, and a lower rate of return to work than those without depression and anxiety [8-11].”
BackgroundBartels, S. J., Coakley, E. H., Zubritsky, C., Ware, J. H., Miles, K. M., Areán, P. A., Chen, H., Oslin, D. W., Llorente, M. D., Costantino, G., et al. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.8.1455 · Cited by 417 · cited 1×
“This approach of inserting a mental health access point and resources could be applied to other frequently used ambulatory care settings that address chronic pain (eg, primary care, rheumatology, gastroenterology, headache clinics) [43], and it would create opportunities to provide mental health screening and interven…”
BackgroundSelf-citationA 'stages of change' approach to helping patients change behavior.
Zimmerman, G. L., Olsen, C. G., & Mf, B. (2000) · PubMed · Cited by 337
(2020) · PubMed · Cited by 332
Perceptions and opinions of patients about mental health chatbots: scoping review
Abd-Alrazaq, A. A., Alajlani, M., Ali, N., Denecke, K., Bewick, B. M., & Househ, M. (2021) · Journal of Medical Internet Research · doi:10.2196/17828 · Cited by 301 · cited 1×
“With the widespread, everyday use of smartphones, these emerging digital tools could function as efficient, widely available mental health resources for orthopedic clinicians to offer their patients [16,20-22].”
BackgroundKretzschmar, K., Tyroll, H., Pavarini, G., Manzini, A., Singh, I., & NeurOx Young People’s Advisory Group (2019) · Biomedical Informatics Insights · doi:10.1177/1178222619829083 · Cited by 270
Chen, C. X., Kroenke, K., Stump, T. E., Kean, J., Carpenter, J. S., Krebs, E. E., Bair, M. J., Damush, T. M., & Monahan, P. O. (2018) · Pain · doi:10.1097/j.pain.0000000000001121 · Cited by 199
Lee, A. C., Driban, J. B., Price, L. L., Harvey, W. F., Rodday, A. M., & Wang, C. (2017) · The Journal of Pain · doi:10.1016/j.jpain.2017.05.001 · Cited by 197
Kroenke, K., Yu, Z., Wu, J., Kean, J., & Monahan, P. O. (2014) · Pain Medicine · doi:10.1111/pme.12537 · Cited by 187
Alattas, S. A., Smith, T., Bhatti, M., Wilson-Nunn, D., & Donell, S. (2017) · Knee Surgery, Sports Traumatology, Arthroscopy · doi:10.1007/s00167-016-4314-8 · Cited by 151 · cited 1×
“For example, among people who seek care for chronic musculoskeletal pain, those with coexisting depression and/or anxiety report worse pain, greater physical impairment, increased postoperative opioid use, and a lower rate of return to work than those without depression and anxiety [8-11].”
BackgroundKratz, A. L., Davis, M. C., & Zautra, A. J. (2007) · Annals of Behavioral Medicine · doi:10.1007/bf02879911 · Cited by 143 · cited 1×
“Using behavioral activation and pain acceptance principles, this pain-specific version of Wysa encourages users to “engage with things that bring joy, despite having pain” [25-28].”
BackgroundHewitt, S., Sephton, R., & Yeowell, G. (2020) · Journal of Medical Internet Research · doi:10.2196/15617 · Cited by 116 · cited 1×
“Patients who present to an orthopedic clinic for a musculoskeletal condition have demonstrated a willingness to engage with digital (physical) health interventions [42], and incorporation of digital mental health support is a logical next step to improving clinical outcomes in orthopedic care.”
BackgroundDigital Care for Chronic Musculoskeletal Pain: 10,000 Participant Longitudinal Cohort Study
Bailey, J. F., Agarwal, V., Zheng, P., Smuck, M., Fredericson, M., Kennedy, D. J., & Krauss, J. (2020) · Journal of Medical Internet Research · doi:10.2196/18250 · Cited by 109 · cited 1×
“The high engagement rates and positive clinical findings in this study are consistent with those in a study of 10,000 participants by Bailey et al [41], in which people with chronic low back and/or knee pain were given a 12-week digital health intervention sponsored by their employers [41].”
ResultPAIN AND DEPRESSION: THE EGG AND THE CHICKEN STORY REVISITED
Gambassi, G. (2009) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2009.09.018 · Cited by 93
Jensen, M. P., Ehde, D. M., & Day, M. A. (2016) · The Journal of Pain · doi:10.1016/j.jpain.2016.02.001 · Cited by 77 · cited 1×
“Using behavioral activation and pain acceptance principles, this pain-specific version of Wysa encourages users to “engage with things that bring joy, despite having pain” [25-28].”
BackgroundSymptoms of distress as prospective predictors of pain-related sciatica treatment outcomes
Edwards, R. R., Klick, B., Buenaver, L., Max, M. B., Haythornthwaite, J. A., Keller, R. B., & Atlas, S. J. (2007) · Pain · doi:10.1016/j.pain.2006.10.026 · Cited by 75 · cited 1×
“For example, among people who seek care for chronic musculoskeletal pain, those with coexisting depression and/or anxiety report worse pain, greater physical impairment, increased postoperative opioid use, and a lower rate of return to work than those without depression and anxiety [8-11].”
BackgroundPredictive value of readiness, importance, and confidence in ability to change drinking and smoking
Bertholet, N., Gaume, J., Faouzi, M., Gmel, G., & Daeppen, J.-B. (2012) · BMC Public Health · doi:10.1186/1471-2458-12-708 · Cited by 73 · cited 1×
“dPotential for change measures are scored from 0 to 100, and higher scores are favorable [39].”
BackgroundHow do Orthopaedic Surgeons Address Psychological Aspects of Illness?
Vranceanu, A., Beks, R. B., Guitton, T. G., Janssen, S. J., & Ring, D. (2017) · PubMed · Cited by 73
Ang, D. C., Bair, M. J., Damush, T. M., Wu, J., Tu, W., & Kroenke, K. (2010) · Pain Medicine · doi:10.1111/j.1526-4637.2009.00759.x · Cited by 72 · cited 1×
“Chronic pain and psychological impairment such as depression and anxiety are driven by shared biological pathways and neurotransmitters, and when a person has both conditions simultaneously, the effectiveness of standard treatment for either condition in isolation is reduced [5-7].”
BackgroundBurkhardt, H. A., Alexopoulos, G. S., Pullmann, M. D., Hull, T. D., Areán, P. A., & Cohen, T. (2021) · Journal of Medical Internet Research · doi:10.2196/28244 · Cited by 68
Self-citationDeVeaugh-Geiss, A. M., West, S. L., Miller, W. C., Sleath, B., Gaynes, B. N., & Kroenke, K. (2010) · Pain Medicine · doi:10.1111/j.1526-4637.2010.00830.x · Cited by 63 · cited 1×
“Chronic pain and psychological impairment such as depression and anxiety are driven by shared biological pathways and neurotransmitters, and when a person has both conditions simultaneously, the effectiveness of standard treatment for either condition in isolation is reduced [5-7].”
BackgroundCheng, A. L., Schwabe, M., Doering, M. M., Colditz, G. A., & Prather, H. (2020) · The American Journal of Sports Medicine · doi:10.1177/0363546519883246 · Cited by 56 · cited 1×
“For example, among people who seek care for chronic musculoskeletal pain, those with coexisting depression and/or anxiety report worse pain, greater physical impairment, increased postoperative opioid use, and a lower rate of return to work than those without depression and anxiety [8-11].”
BackgroundSelf-citationInsufficient Dollars and Qualified Personnel to Meet United States Mental Health Needs
Weil, T. P. (2015) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0000000000000271 · Cited by 50 · cited 1×
“Even if all patients had the resources to seek appropriate care, unmet need would persist because of a national shortage of qualified mental health clinicians [15].”
BackgroundAn update on the burden of musculoskeletal diseases in the U.S.
Yelin, E., Weinstein, S., & King, T. (2019) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2019.04.010 · Cited by 33
Kozloff, N., & Sommers, B. D. (2017) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.16m11357 · Cited by 25 · cited 1×
“Among people who recognize their need for mental health treatment, 64% are resistant to reaching out to another person for assistance and 23% have financial, transportation, or time-related barriers to seeking care [13,14].”
BackgroundMental and Social Health Are Inseparable from Physical Health
Ring, D. (2021) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.21.00121 · Cited by 17 · cited 1×
“Collection of mental health screening measures is becoming more commonplace in orthopedic clinics, but it is still not performed universally [44], and collection of these measures may have facilitated the recruitment process for our study.”
Background
Research works printed but not linked: 3
- Zelaya, C, 2020, NCHS Data Brief, 1
- Vranceanu, AM, 2017, Arch Bone Jt Surg, 5, 2
- Zimmerman, GL, 2000, Am Fam Physician, 61, 1409
Cited by
Li, H., Zhang, R., Lee, Y.-C., Kraut, R. E., & Mohr, D. C. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00979-5 · Cited by 598
“…CAs in mental health, only 15 studies incorporated safety assessment or protection measures in CAs, such as access to human experts 20,23,39 , onboarding processes 19,20,25,26,31 , assessment of adverse events 25,29,31,34 and automatic crises or harm identi fi cation 17,19,25,31,34,36,41,42,46,47 .”
BackgroundEngagement and retention in digital mental health interventions: a narrative review
Boucher, E. M., & Raiker, J. S. (2024) · BMC Digital Health · doi:10.1186/s44247-024-00105-9 · Cited by 181
“Some studies have reported above industry standard engagement rates when participants learned about the DMHI through their employer [101] or during a visit to an orthopedic clinic [64].”
BackgroundHua, Y., Siddals, S., Ma, Z., Galatzer‐Levy, I., Xia, W., Hau, C., Na, H., Flathers, M., Linardon, J., Ayubcha, C., et al. (2025) · World Psychiatry · doi:10.1002/wps.21352 · Cited by 117
Mitsea, E., Drigas, A., & Skianis, C. (2023) · Behavioral Sciences · doi:10.3390/bs13121008 · Cited by 101
Artificial intelligence for psychotherapy: a review of the current state and future directions
Beg, M. J., Verma, M., M., V. C. K. M., & Verma, M. K. (2025) · Indian Journal of Psychological Medicine · doi:10.1177/02537176241260819 · Cited by 82
“30 Merry et al. found that SPARX computerized cognitive-behavioral treatment effectively reduced depressive symptoms in teen-agers despite the lack of blinding, highlighting the potential benefits of digital mental health therapy in various settings.”
Metadata
- Authors
- Leo, A. J., Schuelke, M. J., Hunt, D. M., Metzler, J. P., Miller, J. P., Areán, P. A., Armbrecht, M. A., & Cheng, A. L.
- Affiliations
- Washington University in St. Louis (US)
- University of Washington (US)
- Corresponding author
- Cheng, Abby L
- ORCID
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-02-21
- Volume
- 6
- Issue
- 2
- Pages
- e34889
- ISSN
- 2561-326X (ISSN-L)
- PMC
- PMC8902664
- OpenAlex
- W4205207624
- Cited by
- 70
- References
- 44
- Citations by year
- 2026: 10 · 2025: 20 · 2024: 18 · 2023: 15 · 2022: 7
- FWCI
- 13.25
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Formative Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Doris Duke Charitable Foundation
- National Institutes of Health
- National Institute of Arthritis and Musculoskeletal and Skin Diseases (K23AR074520)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- digital mental health interventions, depression, anxiety, chronic musculoskeletal pain, orthopedic patients, Wysa, chatbots, mobile application, behavioral activation, cognitive behavioral therapy, mindfulness, PROMIS, feasibility, retention, engagement, treatment-resistant depression, digital therapeutics, mental health outcomes, patient-reported outcomes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.