Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments: Reliability and Validity in Veterans Following Orthopedic Surgery.
Open accessAbstract
The patient-reported outcomes measurement information system (PROMIS) offers standardized assessment measures of clinically relevant patient-reported outcomes. This study evaluated the reliability and validity of select PROMIS measures with U.S. military veterans following orthopedic surgery. Data for the current study were collected as part of a pilot randomized control trial assessing the efficacy of a 1-day Acceptance and Commitment Therapy workshop on persistent postsurgical pain in at-risk veterans undergoing orthopedic surgery. Sixty-seven participants completed surveys 3 months after surgery. Participants completed the following PROMIS instruments: PROMIS Anxiety Short Form 8a, PROMIS Depression Short Form 8b, and PROMIS Pain Interference Short Form 8a. PROMIS measures were compared to the Generalized Anxiety Disorder 7-Item Scale, the Patient Health Questionnaire 9-Item Scale, and the Brief Pain Inventory Pain Interference subscale, respectively. All three PROMIS measures demonstrated excellent internal consistency (Cronbach's αs ranged from .93 to .96) and each loaded onto a single factor. The PROMIS measures were moderately correlated with their respective comparison measures (r = .69 to .76). The PROMIS anxiety and PROMIS depression measures were highly correlated to one another (r = .91). Findings highlight the potential utility of these PROMIS measures in veterans following orthopedic surgery and the overlap between the PROMIS depression and anxiety measures in this sample.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
6 of 19 cited sources checked · 3 supported · 0 flagged · accuracy not yet measured
- Premisecitation
The PROMIS depression measure has demonstrated validity and reliability in patients with knee osteoarthritis, multiple sclerosis, and lumbar degenerative disease.
“Validity and reliability of this measure have been demonstrated in patients with knee osteoarthritis (Driban et al., 2015), multiple sclerosis (Marrie et al., 2018), and lumbar degenerative disease (Purvis et al., 2018)”
Quote in the paperSubstantial claim1 of 3 sources checked- cites Driban et al., 2015 source
The Results > PROMIS depression section (page not provided) reports strong correlations with depression and stress measures in participants with symptomatic knee osteoarthritis, supporting construct validity. The paper does not report a reliability assessment for this measure, so it does not support the reliability part of the claim. The multiple-sclerosis and lumbar-degenerative-disease portions are attributed to other citations, not Driban et al. (LLM, conf=0.88)
Experimental — accuracy not yet measured - cites Marrie et al., 2018 source
- cites Purvis et al., 2018 source
- Premisecitation
Pain, depression, and anxiety affect orthopedic surgery outcomes.
“Mounting evidence indicates that pain, depression, and anxiety impact orthopedic surgery outcomes (Lewis, Rice, McNair, & Kluger, 2015; Noiseux et al., 2014).”
Quote in the paperSubstantial claim1 of 2 sources checked - Findingown data
The PROMIS anxiety measure had a Cronbach's alpha of 0.93.
“PROMIS anxiety Cronbach’s α was 0.93.”
Quote in the paperSubstantial claim - Findingown data
The PROMIS depression measure had a Cronbach's alpha of 0.95.
“PROMIS depression Cronbach’s α was 0.95”
Quote in the paperSubstantial claim - Findingown data
For the PROMIS pain interference measure, a one-factor solution explained 85% of the total variance (eigenvalue = 6.83).
“For the PROMIS pain interference measure, a one-factor solution was also indicated (eigenvalue = 6.83), accounting for 85% of total variance”
Quote in the paperSubstantial claim
- Findingown data
The PROMIS anxiety measure had a moderate correlation with the PHQ-9 (r = .63, p < .01, 95% CI 0.46-0.76).
“The PROMIS anxiety measure correlated moderately with the PHQ-9 (r = .63, p < .01, 95% CI: 0.46 – 0.76)”
Quote in the paperSubstantial claim - Findingown data
For the PROMIS anxiety measure, a one-factor solution explained 79% of the total variance (eigenvalue = 6.29).
“For the PROMIS anxiety measure, a one-factor solution was indicated (eigenvalue = 6.29), accounting for 79% of total variance”
Quote in the paperSubstantial claim - Findingown data
The PROMIS depression measure had a moderate correlation with the PHQ-9 (r = .69, p < .01, 95% CI 0.54-0.80).
“the PROMIS depression measure correlated moderately with the PHQ-9 (r = .69, p < .01, 95% CI: 0.54 – 0.80)”
Quote in the paperSubstantial claim - Findingown data
The PROMIS anxiety measure had a moderate correlation with the GAD-7 (r = .69, p < .01, 95% CI 0.53-0.79).
“The PROMIS anxiety measure correlated moderately with the GAD-7 (r = .69, p < .01, 95% CI: 0.53 – 0.79)”
Quote in the paperSubstantial claim - Findingown data
The mean GAD-7 score was 3.61.
“GAD-7 mean: 3.61”
Quote in the paperNot a substantial claim - Findingown data
The PROMIS pain interference measure had a strong correlation with the BPI pain interference subscale (r = .76, p < .01, 95% CI 0.64-0.85).
“The PROMIS pain interference measure correlated strongly with the BPI pain interference subscale (r = .76, p < .01, 95% CI: 0.64 – 0.85)”
Quote in the paperSubstantial claim - Findingown data
The PROMIS anxiety and PROMIS depression measures were highly correlated with each other (r = .91, p < .01, 95% CI 0.85-0.94).
“The PROMIS anxiety and PROMIS depression measures were highly correlated to one another (r = .91)”
- Also stated in: § Results · plain
“The PROMIS depression and PROMIS anxiety measures were highly correlated (r = .91, p < .01, 95% CI: 0.85 – 0.94)”
Quote in the paperNot a substantial claim - Also stated in: § Results · plain
- Findingown data
The PROMIS depression measure had a moderate correlation with the GAD-7 (r = .69, p < .01, 95% CI 0.53-0.80).
“The PROMIS depression measure correlated moderately with the GAD-7 (r = .69, p < .01, 95% CI: 0.53 – 0.80)”
Quote in the paperSubstantial claim - Findingown data
The mean PROMIS anxiety score was 49.83.
“For anxiety, the mean PROMIS score was 49.83”
Quote in the paperNot a substantial claim - Findingown data
The PROMIS depression measure had a moderate correlation with the BPI pain interference subscale (r = .60, p < .01, 95% CI 0.42-0.73).
“and the BPI pain interference subscale (r = .60, p < .01, 95% CI: 0.42 – 0.73)”
Quote in the paperSubstantial claim - Findingown data
Each of the three PROMIS measures (anxiety, depression, and pain interference) loaded onto a single factor in this sample.
“each loaded onto a single factor”
- Also stated in: § Discussion · boosted
“Factor analyses confirmed single structure models for all three measures”
Quote in the paperSubstantial claim - Also stated in: § Discussion · boosted
- Findingown data
The mean PROMIS depression score was 49.30.
“for depression it was 49.30”
Quote in the paperNot a substantial claim - Findingown data
The mean BPI pain interference score was 3.18 on a 0-10 scale.
“the mean score on the index pain interference measure (BPI-PI) was only 3.18 on a 0–10 scale”
Quote in the paperNot a substantial claim - Findingown data
The mean PROMIS pain interference score was 58.34.
“and for pain interference it was 58.34”
Quote in the paperNot a substantial claim - Findingown data
The PROMIS pain interference measure had a Cronbach's alpha of 0.96.
“PROMIS pain interference Cronbach’s α was 0.96”
Quote in the paperSubstantial claim - Findingown data
The PROMIS anxiety measure had a moderate correlation with the BPI pain interference subscale (r = .57, p < .01, 95% CI 0.38-0.71).
“and the BPI pain interference subscale (r = .57, p < .01, 95% CI: 0.38 – 0.71)”
Quote in the paperSubstantial claim - Findingown data
The mean PHQ-9 score was 6.15.
“PHQ-9 mean: 6.15”
Quote in the paperNot a substantial claim - Findingown data
For the PROMIS depression measure, a one-factor solution explained 85% of the total variance (eigenvalue = 6.80).
“For the PROMIS depression measure, a one-factor solution was indicated (eigenvalue = 6.80), accounting for 85% of total variance”
Quote in the paperSubstantial claim - Interpretationown data
The study demonstrated preliminary validity of three PROMIS measures (anxiety, depression, and pain interference) in 67 Veterans three months after orthopedic surgery.
“this study uniquely demonstrated preliminary validity of three PROMIS measures (anxiety, depression and pain interference) with 67 Veterans three months following orthopedic surgery.”
Quote in the paperSubstantial claim- Rests on an assumption: PROMIS short-form measures have not been validated in orthopedic patients who have undergone surgeries that carry a risk for persistent postsurgical pain.
- Study design and conductnone given
The relatively small sample size prevented more extensive modeling to explore the overlap of anxiety and depressive symptoms.
“The relatively small sample size precluded doing more extensive modeling to explore the overlap of anxiety and depressive symptoms.”
Quote in the paperNot a substantial claim - Interpretationown data
The PROMIS measures did not show strong discriminant validity between anxiety and depression in this sample.
“the PROMIS measures did not demonstrate strong discriminant validity between anxiety and depression”
Quote in the paperSubstantial claim - Interpretationown data
The current findings suggest potential utility of these PROMIS measures with postoperative orthopedic patients.
“Overall, the current findings suggest potential utility of these PROMIS measures with postoperative orthopedic patients”
Quote in the paperSubstantial claim- Rests on an assumption: Brief, comparable, standardized measures of pain, anxiety, and depression are needed in medical settings to maximize comparability of findings across studies and patient populations.
- Interpretationown data
The PROMIS depression and anxiety measures both appear to measure an underlying construct of distress in this sample.
“suggesting that they are both measuring an underlying construct of distress in the current sample.”
Quote in the paperSubstantial claim - Interpretationreasoning
The PROMIS depression short-form may function slightly differently from the PHQ-9.
“these findings suggest that the PROMIS depression short-form may function slightly differently than the PHQ-9.”
Quote in the paperSubstantial claim - Interpretationreasoning
The moderate correlation between the PROMIS depression measure and the PHQ-9 may reflect subtle differences in how the two instruments measure depression.
“The moderate correlations may reflect subtle differences in the ways that depression is measured by the PROMIS measure compared to the PHQ-9.”
Quote in the paperNot a substantial claim - Premisecitation
The PROMIS anxiety measure has demonstrated validity and reliability in patients with knee osteoarthritis, multiple sclerosis, and lumbar degenerative disease.
“Validity and reliability of this measure have been demonstrated in patients with knee osteoarthritis (Driban, Morgan, Price, Cook, & Wang, 2015), multiple sclerosis (Marrie et al., 2018), and lumbar degenerative disease (Purvis, Neuman, Riley, & Skolasky, 2018).”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Driban, Morgan, Price, Cook, & Wang, 2015
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Marrie et al., 2018
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Purvis, Neuman, Riley, & Skolasky, 2018 source
- Interpretationcitation
The generalizability of the results might be affected by the fact that participants agreed to take part in the parent study.
“the generalizability of results might be impacted by the fact that the participants in this study agreed to participate in the parent study”
Quote in the paperNot a substantial claim - Interpretationown data
The current findings suggest a high degree of overlap between the PROMIS depression and anxiety measures.
“suggest a high degree of overlap between the PROMIS depression and anxiety measures”
Quote in the paperSubstantial claim - Interpretationown data
The PROMIS depression and anxiety measures appeared to be largely measuring the same construct in this sample.
“they appeared to be largely measuring the same construct”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 15
- May combine two claims. 9
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe PHQ-9 is a reliable (Cronbach's alpha = 0.89) and valid measure of depression severity in medical patients.
“A validity study including 6,000 medical patients demonstrated that this is a reliable (Cronbach’s α of 0.89) and valid measure of depression severity”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Kroenke et al., 2001 source
The Results report excellent PHQ-9 reliability, but Cronbach’s α was 0.89 in the primary-care sample and 0.86 in the obstetrics-gynecology sample—not 0.89 across all 6,000 patients. The Discussion supports its validity as a depression-severity measure across the two samples. (LLM, conf=0.85)
Experimental — accuracy not yet measured
Classified as probably not a substantial claim.
PremisecitationPreoperative pain, depression, and anxiety indicate risk for persistent post-surgical pain.
“Preoperative risk criteria were defined based on findings that preoperative pain, depression, and anxiety infer risk for persistent post-surgical pain (Lewis et al., 2015; Noiseux et al., 2014).”
Quote in the paperSubstantial claim1 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationIn surgical cardiac patients, the BPI pain interference subscale demonstrated good internal consistency before surgery (Cronbach's alpha = 0.91) and six months after surgery (Cronbach's alpha = 0.94), and it showed responsiveness between pre- and post-surgical time points.
“In surgical cardiac patients, this measure demonstrated good internal consistency both prior to surgery (Cronbach’s α = 0.91) and six months following surgery (Cronbach’s α = 0.94) and demonstrated responsiveness between pre- and post-surgical time points (Gjeilo, Stenseth, Wahba, Lydersen, & Klepstad, 2007).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Gjeilo, Stenseth, Wahba, Lydersen, & Klepstad, 2007 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationVeterans have a heightened risk for distress-based conditions, including depressive and anxious disorders.
“Veterans have a heightened risk for distress-based conditions, including depressive and anxious disorders, (Pickett et al., 2015)”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Pickett et al., 2015 source
The Incidence, Prevalence, and Base Rates section reports depressive and anxiety disorders among OEF/OIF/OND veterans receiving VA care and associates prolonged deployment with a greater likelihood of a mental health condition. It does not establish a heightened risk of depressive and anxiety disorders for veterans generally or specify a comparison group for those disorders. (LLM, conf=0.83)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe mean age of the sample was 63.7 years (SD 8.9).
“the mean age was 63.7 years (SD: 8.9)”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe sample reported relatively low levels of depression, anxiety, and pain interference.
“The sample reported relatively low levels of depression, anxiety, and pain interference.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataIn the sample of 67 Veterans assessed three months after orthopedic surgery, all three PROMIS measures (anxiety, depression, and pain interference) showed excellent internal consistency, with Cronbach's alpha values between .93 and .96.
“All three PROMIS measures demonstrated excellent internal consistency (Cronbach’s alphas ranged from .93 - .96)”
- Also stated in: § Results · plain
“All PROMIS measures demonstrated good internal consistency.”
Quote in the paperSubstantial claim- Also stated in: § Results · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe sample was 93% male.
“The sample was 93% male”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe study included 67 participants who completed self-report questionnaires three months after orthopedic surgery.
“This study included 67 participants who had completed self-report questionnaires three months following orthopedic surgery”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningPolychoric correlations were used to improve the robustness and accuracy of the factor analysis results.
“polychoric correlations were used to maximize the robustness and accuracy of the factor analysis findings.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe study was approved by the local institutional review board.
“This study was approved by the local institutional review board.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenParticipants completed the study measures three months after surgery with a blinded assessor.
“Participants completed the measures for this study three months after surgery with a blinded assessor.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenIndividuals with missing data on a measure were excluded from analyses involving that measure.
“Individuals with missing data on a measure were excluded from analyses with that measure.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe BPI pain interference subscale has demonstrated good reliability and validity.
“This widely used measure has demonstrated good reliability and validity (Cleeland, 1991).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Cleeland, 1991
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe GAD-7 has good reliability (Cronbach's alpha = .92; test-retest intraclass correlation = 0.83) and both criterion and construct validity in a large multisite primary care sample.
“A large, multisite study including 2,740 adult patients in primary care settings demonstrated that this measure has good reliability (Cronbach α = .92 and test-re-test intraclass correlation = 0.83) and both criterion and construct validity”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Spitzer et al., 2006 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationPROMIS measures have been used in multiple studies of surgical care, including orthopedic surgeries.
“PROMIS measures have been used in multiple studies about surgical care including orthopedic surgeries (Jones & Stukenborg, 2016).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Jones & Stukenborg, 2016
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationThe PROMIS pain interference short-form has demonstrated concurrent validity and comparative responsiveness in patients undergoing cervical and lumbar spine surgeries.
“The PROMIS pain interference short-form has demonstrated concurrent validity and comparative responsiveness in patients undergoing cervical and lumbar spine surgeries (Sharma, Ugiliweneza, Beswick, & Boakye, 2018)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sharma, Ugiliweneza, Beswick, & Boakye, 2018 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationPROMIS measures were designed to standardize measurement of patient outcomes across a range of chronic conditions.
“These measures were designed to standardize measurement of patient outcomes across a range of chronic conditions (NIH, 2018).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites NIH, 2018
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationChronic pain is prevalent among Veterans.
“chronic pain is prevalent in Veterans (Haskell, Heapy, Reid, Papas, & Kerns, 2006)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Haskell, Heapy, Reid, Papas, & Kerns, 2006 source
The paper relies on this without support.
PROMIS short-form measures have not been validated in orthopedic patients who have undergone surgeries that carry a risk for persistent postsurgical pain.
“However, PROMIS short-form measures have not been validated in orthopedic patients having undergone surgeries that pose a risk for persistent postsurgical pain.”
The paper relies on this without support.
Brief, comparable, standardized measures of pain, anxiety, and depression are needed in medical settings to maximize comparability of findings across studies and patient populations.
“Brief, comparable, standardized measures of pain, anxiety, and depression are needed in medical settings, to maximize comparability of findings across studies and patient populations.”
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · cited 11× · see citing works
“Concurrent Validity The PROMIS anxiety measure correlated moderately with the GAD-7 (r ¼ .69, p .01, 95% CI [.53, .79]), and the PROMIS depression measure correlated moderately with the PHQ-9 (r¼ .69, p .01, 95% CI [.54, .80]).”
BackgroundResultInfluentialHamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817 · cited 1× · see citing works
“The specific criteria for inclusion in the parent study were severe preoperative pain ( 7 on a 0–10 scale) or greater than mild pain ( 3 on a 0–10 scale) with elevated anxiety or depression (assessed with the Hamilton Anxiety and Depression Scales: Hamilton, 1959, 1960).”
BackgroundA Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 2× · see citing works
“Both of the index anxiety and depression measures demonstrated means (GAD-7 mean: 3.61, PHQ-9 mean: 6.15) below the recommended cutoff score of 10 indicating at least moderate symptoms (Kroenke et al., 2001; Spitzer et al., 2006).”
BackgroundMethodInfluentialThe assessment of anxiety states by rating
HAMILTON, M. (1959) · British Journal of Medical Psychology · doi:10.1111/j.2044-8341.1959.tb00467.x · Cited by 11,455 · cited 1× · see citing works
“The specific criteria for inclusion in the parent study were severe preoperative pain ( 7 on a 0–10 scale) or greater than mild pain ( 3 on a 0–10 scale) with elevated anxiety or depression (assessed with the Hamilton Anxiety and Depression Scales: Hamilton, 1959, 1960).”
BackgroundBeck, A. T., Steer, R. A., & Brown, G. (2011) · PsycTESTS Dataset · doi:10.1037/t00742-000 · Cited by 7,535 · see citing works
Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., Ader, D., Fries, J. F., Bruce, B., & Rose, M. (2007) · Medical Care · doi:10.1097/01.mlr.0000258615.42478.55 · Cited by 3,118 · see citing works
Predictors of persistent pain after total knee arthroplasty: a systematic review and meta-analysis
Lewis, G. N., Rice, D. A., McNair, P. J., & Kluger, M. (2015) · British Journal of Anaesthesia · doi:10.1093/bja/aeu441 · Cited by 587 · see citing works
The Brief Pain Inventory User Guide
Cleeland, C. S. (2009) · Cited by 464 · see citing works
Neuroticism as a common dimension in the internalizing disorders
Griffith, J. W., Zinbarg, R. E., Craske, M. G., Mineka, S., Rose, R. D., Waters, A. M., & Sutton, J. M. (2010) · Psychological Medicine · doi:10.1017/s0033291709991449 · Cited by 440 · cited 1× · see citing works
“This could also reflect the shared variance of negative affect between anxiety and depression (Griffith et al., 2010).”
BackgroundBritish Journal of Mathematical and Statistical Psychology
British Psychological Society (2010) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/(issn)2044-8317 · Cited by 389 · see citing works
Tully, P. J., & Robert, A. B. (2012) · 老年心脏病学杂志：英文版 · doi:10.3724/sp.j.1263.2011.12221 · Cited by 298 · cited 1× · see citing works
“This measure has been recommended to assess anxiety following surgery (in coronary artery bypass patients: Tully & Baker, 2012).”
BackgroundMarrie, R. A., Zhang, L., Lix, L. M., Graff, L. A., Walker, J. R., Fisk, J. D., Patten, S. B., Hitchon, C. A., Bolton, J. M., Sareen, J., et al. (2018) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2017.12.007 · Cited by 169 · cited 4× · see citing works
“Validity and reliability of this measure have been demonstrated in patients with knee osteoarthritis (OA; Driban, Morgan, Price, Cook, & Wang, 2015), multiple sclerosis (Marrie et al., 2018), and lumbar degenerative disease (Purvis, Neuman, Riley, & Skolasky, 2018).”
InfluentialBroderick, J. E., Schneider, S., Junghaenel, D. U., Schwartz, J. E., & Stone, A. A. (2013) · Arthritis Care & Research · doi:10.1002/acr.22025 · Cited by 158 · cited 1× · see citing works
“In that study, participants with OA scored above the 80th percentile on average on the PROMIS pain interference measure (Broderick et al., 2013).”
BackgroundJournal of the American college of surgeons
(1994) · Journal of the American Dietetic Association · doi:10.1016/0002-8223(94)92565-8 · Cited by 146 · see citing works
Dindo, L., Zimmerman, M. B., Hadlandsmyth, K., StMarie, B., Embree, J., Marchman, J., Tripp-Reimer, T., & Rakel, B. (2018) · The Journal of Pain · doi:10.1016/j.jpain.2018.04.016 · Cited by 121 · cited 1× · see citing works
“Data for the current study were collected as part of a pilot randomized control trial assessing the efficacy of a 1-day Acceptance and Commitment Therapy workshop on persistent postsurgical pain in at-risk orthopedic patients (Dindo et al., 2018).”
MethodSelf-citationPreoperative predictors of pain following total knee arthroplasty
Noiseux, N. O., Callaghan, J. J., Clark, C. R., Zimmerman, M. B., Sluka, K. A., & Rakel, B. A. (2014) · The Journal of Arthroplasty · doi:10.1016/j.arth.2014.01.034 · Cited by 109 · cited 2× · see citing works
“Mounting evidence indicates that pain, depression, and anxiety impact orthopedic surgery outcomes (Lewis, Rice, McNair, & Kluger, 2015; Noiseux et al., 2014).”
BackgroundSelf-citationDriban, J. B., Morgan, N., Price, L. L., Cook, K. F., & Wang, C. (2015) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-015-0715-y · Cited by 102 · cited 4× · see citing works
“Validity and reliability of this measure have been demonstrated in patients with knee OA (Driban et al., 2015), multiple sclerosis (Marrie et al., 2018), and lumbar degenerative disease (Purvis et al., 2018).”
BackgroundResultInfluentialValidation of the Brief Pain Inventory in Patients Six Months After Cardiac Surgery
Gjeilo, K. H., Stenseth, R., Wahba, A., Lydersen, S., & Klepstad, P. (2007) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2007.01.010 · Cited by 100 · see citing works
What is the best screening test for depression in chronic spinal pain patients?
Choi, Y., Mayer, T. G., Williams, M. J., & Gatchel, R. J. (2013) · The Spine Journal · doi:10.1016/j.spinee.2013.10.037 · Cited by 97 · see citing works
Purvis, T. E., Neuman, B. J., Riley, L. H., & Skolasky, R. L. (2018) · Spine · doi:10.1097/brs.0000000000002661 · Cited by 91 · cited 4× · see citing works
“These measures have also demonstrated moderate correlations in a sample of preoperative patients with lumbar degenerative disease (r ¼ .71; Purvis et al., 2018).”
BackgroundMethodInfluentialHaskell, S. G., Heapy, A., Reid, M. C., Papas, R. K., & Kerns, R. D. (2006) · Journal of Women's Health · doi:10.1089/jwh.2006.15.862 · Cited by 79 · see citing works
Jones, S. R., & Stukenborg, G. J. (2017) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2016.11.015 · Cited by 76 · cited 1× · see citing works
“PROMIS measures have been used in multiple studies about surgical care including orthopedic surgeries (Jones & Stukenborg, 2016).”
MethodXie, J., Bi, Q., li, W., Shang, W., Yan, M., Yang, Y., Miao, D., & Zhang, H. (2012) · PLoS ONE · doi:10.1371/journal.pone.0047577 · Cited by 50 · cited 1× · see citing works
“Depression and anxiety measures are often highly correlated, arguably measuring in part an underlying construct of distress (Driban et al., 2015; Purvis et al., 2018; Xie et al., 2012).”
BackgroundSharma, M., Ugiliweneza, B., Beswick, J., & Boakye, M. (2018) · World Neurosurgery · doi:10.1016/j.wneu.2018.04.131 · Cited by 40 · see citing works
Mental Health Among Military Personnel and Veterans
Pickett, T., Rothman, D., Crawford, E. F., Brancu, M., Fairbank, J. A., & Kudler, H. S. (2015) · North Carolina Medical Journal · doi:10.18043/ncm.76.5.299 · Cited by 27 · cited 1× · see citing works
“Veterans have a heightened risk of distress-based conditions including depressive and anxious disorders (Pickett et al., 2015), and chronic pain is prevalent in veterans (Haskell, Heapy, Reid, Papas, & Kerns, 2006).”
Background
Flagged first, then by citations
Research works printed but not linked: 1
- 10.1016/j.jpain.2018.04.016 · DOI · Paper page
Cited by
Sorted by citations
Gulledge, C. M., Smith, D. G., Ziedas, A. C., Muh, S. J., Moutzouros, V., & Makhni, E. C. (2019) · JBJS Open Access · doi:10.2106/jbjs.oa.19.00015 · Cited by 119 · see citing works
Belter, L. T., Cruz, R. E., & Jarecki, J. (2020) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-020-01498-2 · Cited by 56 · see citing works
Addiction Medicine Practice-Based Research Network (AMNet): Assessment Tools and Quality Measures
Clarke, D. E., Ibrahim, A., Doty, B., Patel, S., Gibson, D., Pagano, A., Thompson, L. R., Goldstein, A. B., Vocci, F. J., & Schwartz, R. P. (2021) · Substance Abuse and Rehabilitation · doi:10.2147/sar.s305972 · Cited by 18 · see citing works
Item Response Theory Analysis: PROMIS® Anxiety Form and Generalized Anxiety Disorder Scale
Liu, W., Dindo, L. N., Hadlandsmyth, K., Unick, G. J., Zimmerman, M. B., Marie, B. S., Embree, J. L., Tripp‐Reimer, T., & Rakel, B. A. (2021) · Western Journal of Nursing Research · doi:10.1177/01939459211015985 · Cited by 14 · see citing works
Self-citationThe accumulated impact of critical incident exposure on correctional officers’ mental health
Schwartz, J. A., Valgardson, B. A., Jodis, C. A., Mears, D. P., & Steiner, B. (2024) · Criminology · doi:10.1111/1745-9125.12379 · Cited by 10 · see citing works
Cesa, K. T., Cunningham, C. A., Noll, R. B., & Kim, S. C. (2022) · Crohn s & Colitis 360 · doi:10.1093/crocol/otac019 · Cited by 8 · see citing works
Gillespie, K. M., Kemps, E., White, M. J., & Bartlett, S. E. (2025) · Frontiers in Nutrition · doi:10.3389/fnut.2025.1546564 · Cited by 7 · see citing works
Wyngaarden, J. J. V., Noehren, B. W., Pennings, J. S., Jacobs, C. A., Matuszewski, P. E., & Archer, K. R. (2020) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2020.08.023 · Cited by 5 · see citing works
Danilkowicz, R. M., Hurley, E. T., Hinton, Z. W., Meyer, L. E., Cheah, J. W., Hutyra, C. A., Poehlein, E., Green, C. L., & Mather, R. C. “. (2023) · Journal of ISAKOS Joint Disorders & Orthopaedic Sports Medicine · doi:10.1016/j.jisako.2023.12.003 · Cited by 5 · see citing works
A domain-oriented approach to characterizing movement-evoked pain
Crow, J. A., Joseph, V. W., Miao, G., Goodin, B. R., Sibille, K. T., Cardoso, J. S., Bartley, E. J., Staud, R. M., Fillingim, R. B., & Booker, S. Q. (2024) · PAIN Reports · doi:10.1097/pr9.0000000000001158 · Cited by 5 · see citing works
“4,15,33,34 The anxiety & depression scale asks how often specific feelings have been experienced over the previous 7 days using a 5-point Likert scale ( never , rarely , sometimes , often, always ).”
MethodTang, C., Sookochoff, M., Rhea, L., Carrier, J. D., Prather, H., & Guan, L. (2022) · Acupuncture in Medicine · doi:10.1177/09645284221118589 · Cited by 4 · see citing works
Measures of Anxiety in Rheumatic Diseases
Kwan, A., Bingham, K. S., & Touma, Z. (2020) · Arthritis Care & Research · doi:10.1002/acr.24351 · Cited by 3 · see citing works
El-Gabalawy, R. M., Crooks, M., Smith, M. S. D., Hammond, E., Gross, P., Roznik, M., Perrin, D., Reynolds, K., Logan, G. S., Pankratz, L., et al. (2025) · JMIR Research Protocols · doi:10.2196/68008 · Cited by 3 · see citing works
Lu, A., Li, J., Liu, Y., Du, X., Wang, Y., & Wang, X. (2023) · Nutrition Research · doi:10.1016/j.nutres.2023.07.008 · Cited by 1 · see citing works
High Prevalence of Sleep Disturbance Is Associated with Femoroacetabular Impingement Syndrome
Cheah, J. W., Danilkowicz, R. M., Hutyra, C. A., Lewis, B. D., Olson, S., Poehlein, E., Green, C. L., & Mather, R. C. “. (2022) · Arthroscopy Sports Medicine and Rehabilitation · doi:10.1016/j.asmr.2021.11.008
“Introduction he Patient-Reported Outcomes Measurement InTformation System (PROMIS) surveys provide an objective, validated, and standardized assessment of clinical outcome data for providers to use on both the individual patient and population levels.(1-3) One subset of PROMIS surveys, the adult short-form sleep distu…”
Enrolling high-acuity emergency general surgery patients in a prospective longitudinal cohort study
Baselice, H. E., Kellett, W. F., McCarty, A., et al. (2024) · American Journal of Epidemiology · doi:10.1093/aje/kwae201
Jensen, M. P., Ciol, M. A., Gertz, K. J., Ehde, D. M., Hakimian, S., Day, M. A., Pettet, M. W., Turner, A. P., Sarabosing, C. G., & Williams, R. M. (2026) · Journal of Pain · doi:10.1016/j.jpain.2025.106176
- Authors
- Hadlandsmyth, K., Dindo, L. N., St. Marie, B. J., Wajid, R., Embree, J. L., Noiseux, N. O., Tripp-Reimer, T., Zimmerman, M. B., & Rakel, B. A.
- Affiliations
- University of Iowa (US)
- Baylor College of Medicine (US)
- College of Nursing, University of Iowa, Iowa City, IA, USA
- Corresponding author
- Hadlandsmyth, Katherine
- Venue
- Evaluation & the Health Professions
- Publisher
- SAGE Publications
- Published
- 2019-06-13
- Volume
- 43
- Issue
- 4
- Pages
- 207-212
- ISSN
- 0163-2787 (ISSN-L)
- 1552-3918
- PMC
- PMC6908780
- OpenAlex
- W2952357041
- Semantic Scholar
- 2275030aee8f0868039f5fabfb6a8f62f6fface1
- Cited by
- 17
- References
- 24
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 3 · 2023: 2 · 2022: 3 · 2021: 2 · 2020: 3 · 2019: 1
- FWCI
- 1.61
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Evaluation & the Health Professions (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health, NINDS (T32 NS045549)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Health Sciences › Medicine › Oncology › Cancer survivorship and care
- Social Sciences › Education › Health Education and Validation
- Keywords
- PROMIS, patient-reported outcomes, veterans, orthopedic surgery, anxiety, depression, pain interference, reliability statistics, validity, internal consistency, chronic postoperative pain, acceptance and commitment therapy, GAD-7, PHQ-9, Brief Pain Inventory
- MeSH terms
- Patient Reported Outcome Measures, Humans, Information Systems, Surveys and Questionnaires, Veterans, Reproducibility of Results, Orthopedic Procedures, Acceptance and Commitment Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read under definition version 3 (extract-v3) on 2026-09-28.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
