Cited by 22Anxiety, Depression, Psychometrics, Treatment, Cognitive ProcessesPsychometric Methodologies and TestingMusculoskeletal pain and rehabilitation

Interpretation of PROMIS Depression and Anxiety Measures Compared with DSM-5 Diagnostic Criteria in Musculoskeletal Patients

Open access
Cheng, Abby L., Downs, Dana L., Brady, Brian K., Hong, Barry A., Park, Peter, Prather, Heidi, Hunt, Devyani M.·2023·JBJS Open Access

Abstract

Background: There is growing awareness among orthopaedic clinicians that mental health directly impacts clinical musculoskeletal outcomes. The Patient-Reported Outcomes Measurement Information System (PROMIS) is increasingly used for mental health screening in this context, but proper interpretation of patient scores remains unclear. The purpose of the present study was to compare musculoskeletal patients’ PROMIS Depression and Anxiety scores with a board-certified clinical psychologist’s assessment of their depression and/or anxiety diagnoses, as defined by Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) criteria. Methods: In this cross-sectional analysis, existing medical records were reviewed for 50 patients who presented to an interdisciplinary program within a tertiary care orthopaedic department for the treatment of ≥1 musculoskeletal condition. All patients completed PROMIS Depression and Anxiety measures and were evaluated by a board-certified clinical psychologist. Receiver operating characteristic (ROC) curve analyses were performed to assess the diagnostic accuracy of PROMIS Depression and Anxiety scores as compared with the psychologist’s diagnosis of a DSM-5 depressive or anxiety disorder. Results: Twenty-eight patients (56%) were diagnosed by the psychologist with a DSM-5 depressive disorder, and 15 (30%) were diagnosed with a DSM-5 anxiety disorder. The ROC analysis for PROMIS Depression had an area under the curve (AUC) of 0.82. The optimal score cutoff to predict a diagnosis of a DSM-5 depressive disorder was ≥53 (sensitivity, 79% [95% CI, 63% to 94%]; specificity, 86% [72% to 100%]; positive predictive value [PPV], 88% [75% to 100%]; negative predictive value [NPV], 76% [59% to 93%]). The ROC analysis for PROMIS Anxiety had an AUC of 0.67. The optimal score cutoff to predict a diagnosis of a DSM-5 anxiety disorder was ≥59 (sensitivity, 60% [95% CI, 35% to 85%]; specificity, 74% [60% to 89%]; PPV, 50% [27% to 73%]; and NPV, 81% [68% to 95%]). Conclusions: Modestly elevated PROMIS Depression scores were suggestive of the presence of a DSM-5 depressive disorder, whereas elevations in PROMIS Anxiety scores seemed to have less association with DSM-5 anxiety disorders. Nevertheless, neither PROMIS measure demonstrated adequate discriminant ability to definitively identify patients who met DSM-5 criteria. Level of Evidence: Prognostic Level III . See Instructions for Authors for a complete description of levels of evidence.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2106/jbjs.oa.22.00110

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • T-scores of 60 or more on PROMIS indicate moderate depression/anxiety in need for further psychological evaluation.

    “T-scores of 60 or more indicate moderate depression/anxiety in need for further psychological evaluation.31, 32, 33”

    From Multisite Randomized Controlled Trial of CareSTEPS: A Supportive Care Intervention for the Family Caregivers of Patients With Advanced Lung Cancer (2024) · cites this paper as [33]

    The Outcome Measures section says a PROMIS Depression or Anxiety score of 60 is unfavorable, and the Conclusions recommend using the measures to identify patients who may benefit from further mental health evaluation. But the paper does not define ≥60 as the threshold for moderate depression or anxiety or say that everyone at that score needs evaluation; its optimal screening cutoffs in these musculoskeletal patients were ≥53 for depression and ≥59 for anxiety. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 27

  1. [2]Cheng AL Schwabe M Doering MM Colditz GA Prather H. The Effect of Psychological Impairment on Outcomes in Patients With Prearthritic Hip Disorders: A Systematic Review and Meta-analysis. Am J Sports Med. 2020 Aug; 48(10): 2563- 71. 31829034
  2. [3]Edwards RR Klick B Buenaver L Max MB Haythornthwaite JA Keller RB Atlas SJ. Symptoms of distress as prospective predictors of pain-related sciatica treatment outcomes. Pain. 2007 Jul; 130(1): 47- 55. 17156925
  3. [6]Rasouli MR Menendez ME Sayadipour A Purtill JJ Parvizi J. Direct Cost and Complications Associated With Total Joint Arthroplasty in Patients With Preoperative Anxiety and Depression. The Journal of Arthroplasty. 2016 Feb; 31(2): 533- 6. 26481408
  4. [7]Walid MS Zaytseva NV. Prevalence of mood-altering and opioid medication use among spine surgery candidates and relationship with hospital cost. Journal of Clinical Neuroscience. 2010 May; 17(5): 597- 600. 20202848
  5. [8]Bot AG Menendez ME Neuhaus V Ring D. The influence of psychiatric comorbidity on perioperative outcomes after shoulder arthroplasty. Journal of Shoulder and Elbow Surgery. 2014 Apr; 23(4): 519- 27. 24630546
  6. [9]Browne JA Sandberg BF D’Apuzzo MR Novicoff WM. Depression is associated with early postoperative outcomes following total joint arthroplasty: a nationwide database study. The Journal of Arthroplasty. 2014 Mar; 29(3): 481- 3. 24090662
  7. [10]Khatib Y Madan A Naylor JM Harris IA. Do Psychological Factors Predict Poor Outcome in Patients Undergoing TKA? A Systematic Review. Clinical Orthopaedics & Related Research. 2015 Aug; 473(8): 2630- 8. 25791440 PMC4488213
  8. [11]Klement MR Nickel BT Penrose CT Bala A Green CL Wellman SS Bolognesi MP Seyler TM. Psychiatric disorders increase complication rate after primary total knee arthroplasty. The Knee. 2016 Oct; 23(5): 883- 6. 27288068
  9. [12]Vranceanu AM Beks RB Guitton TG Janssen SJ Ring D. How do Orthopaedic Surgeons Address Psychological Aspects of Illness? Arch Bone Jt Surg. 2017 Jan; 5(1): 2- 9. 28271080 PMC5339350
  10. [13]Young AK Young BK Riley LH 3rd Skolasky RL. Assessment of presurgical psychological screening in patients undergoing spine surgery: use and clinical impact. Journal of Spinal Disorders & Techniques. 2014 Apr; 27(2): 76- 9. 23197256 PMC3629008
  11. [15]Cella D Yount S Rothrock N Gershon R Cook K Reeve B Ader D Fries JF Bruce B Rose M; PROMIS Cooperative Group. The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years. Medical Care. 2007 May; 45(5)(Suppl 1): S3- 11. PMC2829758 17443116
  12. [18]Pilkonis PA Choi SW Reise SP Stover AM Riley WT Cella D; PROMIS Cooperative Group. Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): depression, anxiety, and anger. Assessment. 2011 Sep; 18(3): 263- 83. 21697139 PMC3153635
  13. [19]Beleckas CM Guattery J Chamberlain AM Khan T Kelly MP Calfee RP. Using Patient-Reported Outcomes Measurement Information System Measures to Understand the Relationship Between Improvement in Physical Function and Depressive Symptoms. Journal of the American Academy of Orthopaedic Surgeons. 2018 Dec 15; 26(24): e511- 8. 30216242 PMC6289818
  14. [20]Beleckas CM Prather H Guattery J Wright M Kelly M Calfee RP. Anxiety in the orthopedic patient: using PROMIS to assess mental health. Qual Life Res. 2018 Sep; 27(9): 2275- 82. 29740783 PMC6222016
  15. [21]Bodendorfer BM DeFroda SF Clapp IM Newhouse A Nwachukwu BU Nho SJ. Defining Clinically Significant Improvement on the Patient-Reported Outcomes Measurement Information System Test at 1-Year Follow-up for Patients Undergoing Hip Arthroscopy for the Treatment of Femoroacetabular Impingement Syndrome. Am J Sports Med. 2021 Jul; 49(9): 2457- 65. 34097552
  16. [22]Fabricant PD. Editorial Commentary: We PROMIS…One More Patient-Reported Outcome Questionnaire!, One More Patient-Reported Outcome Questionnaire! Arthroscopy: The Journal of Arthroscopic & Related Surgery. 2018 Apr; 34(4): 1118- 20. 29622248
  17. [23]Nayfe R Chansard M Hynan LS Mortensen EM Annaswamy T Fraenkel L Makris UE. Comparison of Patient-Reported Outcomes Measurement Information System and legacy instruments in multiple domains among older veterans with chronic back pain. BMC Musculoskelet Disord. 2020 Sep 8; 21(1): 598. 32900386 PMC7487821
  18. [24]Purvis TE Neuman BJ Riley LH Skolasky RL. Comparison of PROMIS Anxiety and Depression, PHQ-8, and GAD-7 to screen for anxiety and depression among patients presenting for spine surgery. J Neurosurg Spine. 2019 Jan 18: 1- 8. 30660113
  19. [26]Schalet BD Cook KF Choi SW Cella D. Establishing a common metric for self-reported anxiety: linking the MASQ, PANAS, and GAD-7 to PROMIS Anxiety. Journal of Anxiety Disorders. 2014 Jan; 28(1): 88- 96. 24508596 PMC4046852
  20. [28]Spitzer RL Kroenke K Williams JBW Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006 May 22; 166(10): 1092- 7. 16717171
  21. [29]Clover K Lambert SD Oldmeadow C Britton B King MT Mitchell AJ Carter G. PROMIS depression measures perform similarly to legacy measures relative to a structured diagnostic interview for depression in cancer patients. Qual Life Res. 2018 May; 27(5): 1357- 67. 29423755
  22. [30]Prather H Fogarty AE Cheng AL Wahl G Hong B Hunt D. Feasibility of an intensive interprofessional lifestyle medicine program for patients with musculoskeletal conditions in the setting of lifestyle-related chronic disease. PM R. 2021 Oct 28. PMC9046467 34713577
  23. [32]Kind AJH Jencks S Brock J Yu M Bartels C Ehlenbach W Greenberg C Smith M. Neighborhood socioeconomic disadvantage and 30-day rehospitalization: a retrospective cohort study. Ann Intern Med. 2014 Dec 2; 161(11): 765- 74. 25437404 PMC4251560
  24. [33]Singh GK. Area deprivation and widening inequalities in US mortality, 1969-1998. Am J Public Health. 2003 Jul; 93(7): 1137- 43. 12835199 PMC1447923
  25. [34]Recklitis CJ Blackmon JE Chang G. Screening young adult cancer survivors with the PROMIS Depression Short Form (PROMIS-D-SF): Comparison with a structured clinical diagnostic interview. Cancer. 2020 Apr 1; 126(7): 1568- 75. 31913510 PMC7360134
  26. [35]Harris PA Taylor R Thielke R Payne J Gonzalez N Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics. 2009 Apr; 42(2): 377- 81. 18929686 PMC2700030
  27. [36]Guattery JM Dardas AZ Kelly M Chamberlain A McAndrew C Calfee RP. Floor Effect of PROMIS Depression CAT Associated With Hasty Completion in Orthopaedic Surgery Patients. Clin Orthop Relat Res. 2018 Apr; 476(4): 696- 703. 29419628 PMC6260068

Cited by

Sorted by citations

Authors
Cheng, A. L., Downs, D. L., Brady, B. K., Hong, B. A., Park, P., Prather, H., & Hunt, D. M.
Affiliations
  • Washington University in St. Louis (US)
  • Hospital for Special Surgery (US)
Corresponding author
Cheng, Abby L.
Venue
JBJS Open Access
Published
2023-01
Volume
8
Issue
1
ISSN
2472-7245 (ISSN-L)
OpenAlex
W4318164961
Cited by
22
References
6
Citations by year
2026: 4 · 2025: 7 · 2024: 9 · 2023: 2
FWCI
5.69
Type
journal article
Language
en
Open access
Locations
  • JBJS Open Access (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
National Institute of Arthritis and Musculoskeletal and Skin Diseases (K23AR074520)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
  • Health Sciences › Medicine › Pharmacology › Musculoskeletal pain and rehabilitation
Keywords
PROMIS, depression, anxiety, musculoskeletal disorders, DSM-5 diagnostic criteria, patient-reported outcomes, mental health screening, diagnostic accuracy, orthopedic patients, multidisciplinary care, psychological assessment, anxiety screening, psychometric properties, psychometric validation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review