Better assessment of physical function: item improvement is neglected but essential
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Introduction: Physical function is a key component of patient-reported outcome (PRO) assessment in rheumatology. Modern psychometric methods, such as Item Response Theory (IRT) and Computerized Adaptive Testing, can materially improve measurement precision at the item level. We present the qualitative and quantitative item-evaluation process for developing the Patient Reported Outcomes Measurement Information System (PROMIS) Physical Function item bank. Methods: The process was stepwise: we searched extensively to identify extant Physical Function items and then classified and selectively reduced the item pool. We evaluated retained items for content, clarity, relevance and comprehension, reading level, and translation ease by experts and patient surveys, focus groups, and cognitive interviews. We then assessed items by using classic test theory and IRT, used confirmatory factor analyses to estimate item parameters, and graded response modeling for parameter estimation. We retained the 20 Legacy (original) Health Assessment Questionnaire Disability Index (HAQ-DI) and the 10 SF-36's PF-10 items for comparison. Subjects were from rheumatoid arthritis, osteoarthritis, and healthy aging cohorts (n = 1,100) and a national Internet sample of 21,133 subjects. Results: We identified 1,860 items. After qualitative and quantitative evaluation, 124 newly developed PROMIS items composed the PROMIS item bank, which included revised Legacy items with good fit that met IRT model assumptions. Results showed that the clearest and best-understood items were simple, in the present tense, and straightforward. Basic tasks (like dressing) were more relevant and important versus complex ones (like dancing). Revised HAQ-DI and PF-10 items with five response options had higher item-information content than did comparable original Legacy items with fewer response options. IRT analyses showed that the Physical Function domain satisfied general criteria for unidimensionality with one-, two-, three-, and four-factor models having comparable model fits. Correlations between factors in the test data sets were > 0.90. Conclusions: Item improvement must underlie attempts to improve outcome assessment. The clear, personally important and relevant, ability-framed items in the PROMIS Physical Function item bank perform well in PRO assessment. They will benefit from further study and application in a wider variety of rheumatic diseases in diverse clinical groups, including those at the extremes of physical functioning, and in different administration modes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., Ader, D., Fries, J. F., Bruce, B., & Rose, M. (2007) · Medical Care · doi:10.1097/01.mlr.0000258615.42478.55 · Cited by 3,118 · cited 1×
“The National Institutes of Health Roadmap Initiative, the Patient Reported Outcomes Measurement Information System (PROMIS) [ 10 ], is directed at improving PROs and promoting their use by the public and private sectors.”
BackgroundSelf-citationEvaluation of Item Candidates: The PROMIS Qualitative Item Review
DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A. (2007) · Medical Care · doi:10.1097/01.mlr.0000254567.79743.e2 · Cited by 719 · cited 1×
“Materials and methods We followed systematic PROMIS Network-wide item-evaluation protocols [13].”
Method
Cited by
Core outcome measurement instruments for clinical trials in nonspecific low back pain
Chiarotto, A., Boers, M., Deyo, R. A., Buchbinder, R., Corbin, T. P., Costa, L. O. P., Foster, N. E., Grotle, M., Koes, B. W., Kovacs, F. M., et al. (2018) · Pain · doi:10.1097/j.pain.0000000000001117 · Cited by 461
Rose, M., Bjorner, J. B., Gandek, B., Bruce, B., Fries, J. F., & Ware, J. E. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.10.024 · Cited by 442
Self-citationLifestyle change and mobility in obese adults with type 2 diabetes
Rejeski, W. J., Ip, E. H., Bertoni, A. G., Bray, G. A., Evans, G., Gregg, E. W., & Zhang, Q. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1110294 · Cited by 301
Validity of PROMIS physical function measured in diverse clinical samples
Schalet, B. D., Hays, R. D., Jensen, S. E., Beaumont, J. L., Fries, J. F., & Cella, D. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.039 · Cited by 256
Self-citationJensen, R. E., Potosky, A. L., Reeve, B. B., Hahn, E., Cella, D., Fries, J., Smith, A. W., Keegan, T. H. M., Wu, X.-C., Paddock, L., et al. (2015) · Quality of Life Research · doi:10.1007/s11136-015-0992-9 · Cited by 237
“This physical function domain was developed to measure a full range of function on one common standardized scale, minimizing ceiling and floor effects where the score is higher or lower than the survey can identify [12, 13], and has demonstrated conceptual validity and reliability [8, 14].”
Self-citation
Metadata
- Authors
- Bruce, B., Fries, J. F., Ambrosini, D., Lingala, B., Gandek, B., Rose, M., & Ware, J. E.
- Venue
- Arthritis Research & Therapy
- Published
- 2009-12-16
- Volume
- 11
- Issue
- 6
- Pages
- R191-R191
- ISSN
- 1478-6354 (ISSN-L)
- OpenAlex
- W2140491343
- Cited by
- 120
- References
- 2
- FWCI
- 8.12
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.