Assessing the reliability of the short form 12 (SF-12) health survey in adults with mental health conditions: a report from the wellness incentive and navigation (WIN) study
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Although Short Form (SF)-12 × 2® has been extensively studied and used as a valid measure of health-related quality of life in a variety of population groups, no systematic studies have described the reliability of the measure in patients with behavioral conditions or serious mental illness (SMI). METHODS AND RESULTS: We assessed the internal consistency, split-half reliability and annual test-retest correlations in a sample of 1587 participants with either a combination of physical and behavioral conditions or SMI. The Mosier's alpha was 0.70 for the Physical Composite Scale (PCS) and 0.69 for the Mental Health Composite Scale (MCS), indicating good internal consistency. We observed strong correlations between physical functioning, physical role and body pain scales (r = 0.55-0.56), and between social functioning, emotional role, and mental health (r = 0.53-0.58). We calculated split-half reliabilities to be 0.74 for physical functioning, 0.75 for physical role, 0.73 for emotional role and 0.65 for mental health respectively. We assessed the annual test-retest correlation using intraclass correlation (ICC) and found an ICC of 0.61 for PCS and 0.57 for MCS composite scores, adjusting for age, sex, race/ethnicity, and CRG. We found no decline in the correlations between baseline and the following study years until year 3. CONCLUSIONS: Our results encourage using SF-12v2® to assess health-related quality of life in the Medicaid population with combined physical and behavioral conditions or similar cohorts. TRIAL REGISTRATION: The WIN study was registered with clinicaltrials.gov on April 22, 2015. TRIAL REGISTRATION NUMBER: NCT02440906 . Retrospectively registered.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
WARE, J. E., KOSINSKI, M., & KELLER, S. D. (1996) · Medical Care · doi:10.1097/00005650-199603000-00003 · Cited by 17,392 · cited 4×
“Abbreviations BP: Body Pain; COPD: Chronic Obstructive Pulmonary Disease; CRG: Clinical risk group; GH: General Health; HRQOL: Health-Related Quality Of Life; ICC: Intraclass Correlation; MCS: Mental Composite Score; MH: Mental Health; MI: Motivational Interviewing; MOS: Medical Outcomes Study; PCS: Physical Composite…”
MethodInfluentialThe reliability of a two-item scale: Pearson, Cronbach, or spearman-brown?
Eisinga, R., Grotenhuis, M. T., & Pelzer, B. (2013) · International Journal of Public Health · doi:10.1007/s00038-012-0416-3 · Cited by 2,695 · cited 1×
“For the scales measured by two items, we tested split-half reliability using ICCs followed by the Spearman-Brown correction in all the respondents [20].”
MethodRusso, J., Trujillo, C. A., Wingerson, D., Decker, K., Ries, R., Wetzler, H., & Roy-Byrne, P. (1998) · Medical Care · doi:10.1097/00005650-199805000-00015 · Cited by 1,308 · cited 1×
“For example, studies have reported good reliability of SF-36 in patients with schizophrenia [7] and bipolar disorder [8].”
ResultDE HERT, M., COHEN, D., BOBES, J., CETKOVICH‐BAKMAS, M., LEUCHT, S., NDETEI, D. M., NEWCOMER, J. W., UWAKWE, R., ASAI, I., MÖLLER, H., et al. (2011) · World Psychiatry · doi:10.1002/j.2051-5545.2011.tb00036.x · Cited by 870
Schwartz, C. E., Andresen, E. M., Nosek, M. A., & Krahn, G. L. (2007) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2006.12.032 · Cited by 402
Reliability and validity of the SF-12 health survey among people with severe mental illness
Salyers, M. P., Bosworth, H. B., Swanson, J. W., Lamb-Pagone, J., & Osher, F. C. (2000) · Medical Care · doi:10.1097/00005650-200011000-00008 · Cited by 390 · cited 4×
“Salyers et al. previously computed test-retest reliability for patients with SMI within a week and reported ICC = 0.73 for PCS and 0.80 for MCS in SF-12v1 [9], which filled in the gap to a certain extent.”
BackgroundResultInfluentialReliability and validity of the SF-12v2 in the medical expenditure panel survey
Cheak-Zamora, N. C., Wyrwich, K. W., & McBride, T. D. (2009) · Quality of Life Research · doi:10.1007/s11136-009-9483-1 · Cited by 353 · cited 2×
“Discussion Although SF-12v2® reliability has been previously reported in a few other studies [9, 16], our study is the first to demonstrate the good reliability of SF-12v2® to assess HRQOL in a population with behavioral conditions or SMI whose conditions are severe enough to qualify for supplemental security income.”
MethodResultHughes, J. S., Averill, R. F., Eisenhandler, J., Goldfield, N. I., Muldoon, J., Neff, J. M., & Gay, J. C. (2004) · Medical Care · doi:10.1097/01.mlr.0000102367.93252.70 · Cited by 289 · cited 1×
“The 3 M CRG is a classification system that uses standard claims data to group individuals into one of 9 health status categories, from healthy to catastrophic conditions [18].”
On the Reliability of a Weighted Composite
Mosier, C. I. (1943) · Psychometrika · doi:10.1007/bf02288700 · Cited by 261 · cited 1×
“We assessed internal consistency of physical and mental composite scores (PCS and MCS) using Mosier’s formula [19] as well as Pearson’s correlations between the eight scales in all patients.”
MethodLeidy, N. K. (1998) · Journal of Affective Disorders · doi:10.1016/s0165-0327(97)00147-x · Cited by 104 · cited 1×
“For example, studies have reported good reliability of SF-36 in patients with schizophrenia [7] and bipolar disorder [8].”
ResultMcNamee, L., Mead, G. E., MacGillivray, S. A., & Lawrie, S. M. (2013) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.112.125070 · Cited by 82
Chariyalertsak, S., Wansom, T., Kawichai, S., Ruangyuttikarna, C., Kemerer, V., & Wu, A. W. (2011) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-9-15 · Cited by 51
Test–retest reliability of short form (SF)-12 component scores of patients with stroke
Bohannon, R. W., Maljanian, R., & Landes, M. (2004) · International Journal of Rehabilitation Research · doi:10.1097/01.mrr.0000127350.25287.08 · Cited by 47
Sullivan, I. O., Orbell, S., Rakow, T., & Parker, R. (2004) · Journal of Health Psychology · doi:10.1177/1359105304042345 · Cited by 45 · cited 1×
“In order to evaluate the presence or lack of Hawthorne effect [11, 12], as well as to increase generalizability based on the comparison between the control and comparison groups, a random sample of 404 enrollees in STAR+PLUS Medicaid Managed Care program residing were recruited from the Nueces and Bexar service areas…”
MethodCernin, P. A., Cresci, K., Jankowski, T. B., & Lichtenberg, P. A. (2010) · Journal of Nursing Measurement · doi:10.1891/1061-3749.18.1.49 · Cited by 40
POWERLIB:SAS/IMLSoftware for Computing Power in Multivariate Linear Models
Johnson, J. L., Muller, K. E., Slaughter, J. C., Gurka, M. J., Gribbin, M., & Simpson, S. L. (2009) · Journal of Statistical Software · doi:10.18637/jss.v030.i05 · Cited by 34
Self-citationPoor mental health in diabetes: still a neglected comorbidity
Endocrinology, T. L. D. (2015) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(15)00144-8 · Cited by 22
The wellness incentives and navigation project: design and methods
Shenkman, E. A., Muller, K. E., Vogel, B., Nixon, S. J., Wagenaar, A. C., Case, K., Guo, Y. M., Wegman, M. P., Aric, J., & Stoner, D. (2015) · BMC Health Services Research · doi:10.1186/s12913-015-1245-x · Cited by 8 · cited 3×
“The detailed diagnostic criteria with detailed ICD-9 codes for all included/excluded co-morbidities for individuals in the WIN study was published previously [4].”
BackgroundMethodSelf-citation
Cited by
Maisto, S. A., Hallgren, K. A., Roos, C. R., Swan, J. E., & Witkiewitz, K. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000615 · Cited by 21
Metadata
- Authors
- Huo, T., Guo, Y., Shenkman, E., & Muller, K.
- Venue
- Health and Quality of Life Outcomes
- Published
- 2018-02-13
- Volume
- 16
- Issue
- 1
- Pages
- 34-34
- ISSN
- 1477-7525 (ISSN-L)
- OpenAlex
- W2797827880
- Cited by
- 252
- References
- 18
- FWCI
- 33.85
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.