Patient-reported outcomes measurement information system (PROMIS) domain names and definitions revisions: further evaluation of content validity in IRT-derived item banks
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
PurposeContent validity of patient-reported outcomes (PROs) is evaluated primarily during item development, but subsequent psychometric analyses, particularly for item response theory (IRT)-derived scales, often result in considerable item pruning and potential loss of content. After selecting items for the PROMIS banks based on psychometric and content considerations, we invited external content expert reviews of the degree to which the initial domain names and definitions represented the calibrated item bank content.MethodsA minimum of four content experts reviewed each item bank and recommended a domain name and definition based on item content. Domain names and definitions then were revealed to the experts who rated how well these names and definitions fit the bank content and provided recommendations for definition revisions.ResultsThese reviews indicated that the PROMIS domain names and definitions remained generally representative of bank content following item pruning, but modifications to two domain names and minor to moderate revisions of all domain definitions were needed to optimize fit with the item bank content.ConclusionsThis reevaluation of domain names and definitions following psychometric item pruning, although not previously documented in the literature, appears to be an important procedure for refining conceptual frameworks and further supporting content validity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2022) · doi:10.1176/appi.books.9780890425787 · Cited by 23,476
Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., et al. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.011 · Cited by 5,128
Self-citationCella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., Ader, D., Fries, J. F., Bruce, B., & Rose, M. (2007) · Medical Care · doi:10.1097/01.mlr.0000258615.42478.55 · Cited by 3,118 · cited 2×
“definitions resulted from extensive literature review, archival data analyses, and a modified Delphi process with content experts [6, 7 ]. Patient feedback from numerous focus groups refined these conceptual definitions, generated content for new items, and documented saturation of the construct [8, 9]. Cognitive inte…”
MethodSelf-citationU.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research, & U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health (2006) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-4-79 · Cited by 2,856
Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., Cella, D., & PROMIS Cooperative Group (2011) · Assessment · doi:10.1177/1073191111411667 · Cited by 2,132
Self-citationHays, R. D., Bjorner, J. B., Revicki, D. A., Spritzer, K. L., & Cella, D. (2009) · Quality of Life Research · doi:10.1007/s11136-009-9496-9 · Cited by 1,957 · cited 1×
“To balance burden and utilize expertise across similar areas, content experts reviewed either one large item bank or multiple smaller item banks as follows: Bank A Physical Function (124 items) Bank B Fatigue (95 items) Banks C & D Pain Behavior (39 items), Pain Impact (41 items) Banks E, F, & G Depression (28 items),…”
BackgroundSelf-citationRethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM-V.
Watson, D. (2005) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.114.4.522 · Cited by 1,332 · cited 1×
“For example, [ 18 ] proposed a hierarchical structure with firstorder factors of anxiety, depression, and anger subsumed under a second-order, nonspecific factor reflecting high levels of negative affect or ‘‘general distress’’.”
BackgroundDevelopment of a PROMIS item bank to measure pain interference
Amtmann, D., Cook, K. F., Jensen, M. P., Chen, W.-H., Choi, S., Revicki, D., Cella, D., Rothrock, N., Keefe, F., Callahan, L., et al. (2010) · Pain · doi:10.1016/j.pain.2010.04.025 · Cited by 1,199
Self-citationEvaluation of Item Candidates: The PROMIS Qualitative Item Review
DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A. (2007) · Medical Care · doi:10.1097/01.mlr.0000254567.79743.e2 · Cited by 719 · cited 2×
“Patient feedback from numerous focus groups refined these conceptual definitions, generated content for new items, and documented saturation of the construct [8, 9].”
BackgroundWhat Is Sufficient Evidence for the Reliability and Validity of Patient-Reported Outcome Measures?
Frost, M. H., Reeve, B. B., Liepa, A. M., Stauffer, J. W., & Hays, R. D. (2007) · Value in Health · doi:10.1111/j.1524-4733.2007.00272.x · Cited by 572
Cited by
Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., Cella, D., & PROMIS Cooperative Group (2011) · Assessment · doi:10.1177/1073191111411667 · Cited by 2,132
“…of the original labels (depression, anxiety, and anger), and their mean ratings of the fit between our domain names and definitions and the final content of the banks ranged from 4.3 to 4.9, using a 5-point scale where 4 = quite a bit and 5 = very much (see Riley et al., 2010, for details).”
MethodInfluentialSelf-citationPROMIS® Adult Health Profiles: Efficient Short-Form Measures of Seven Health Domains
Cella, D., Choi, S. W., Condon, D. M., Schalet, B., Hays, R. D., Rothrock, N. E., Yount, S., Cook, K. F., Gershon, R. C., Amtmann, D., et al. (2019) · Value in Health · doi:10.1016/j.jval.2019.02.004 · Cited by 665
Self-citationThe assessment of fatigue: Psychometric qualities and norms for the Checklist individual strength
Worm-Smeitink, M., Gielissen, M., Bloot, L., van Laarhoven, H. W. M., van Engelen, B. G. M., van Riel, P., Bleijenberg, G., Nikolaus, S., & Knoop, H. (2017) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2017.05.007 · Cited by 360
The neuroimmune basis of fatigue
Dantzer, R., Heijnen, C. J., Kavelaars, A., Laye, S., & Capuron, L. (2014) · Trends in Neurosciences · doi:10.1016/j.tins.2013.10.003 · Cited by 346
Association of Physician Burnout With Suicidal Ideation and Medical Errors
Menon, N. K., Shanafelt, T. D., Sinsky, C. A., Linzer, M., Carlasare, L., Brady, K. J. S., Stillman, M. J., & Trockel, M. T. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.28780 · Cited by 340
Metadata
- Authors
- Riley, W. T., Rothrock, N., Bruce, B., Christodolou, C., Cook, K., Hahn, E. A., & Cella, D.
- Venue
- Quality of Life Research
- Published
- 2010-07-01
- Volume
- 19
- Issue
- 9
- Pages
- 1311-1321
- ISSN
- 0962-9343 (ISSN-L)
- 1573-2649
- OpenAlex
- W2010135818
- Cited by
- 192
- References
- 10
- FWCI
- 10.90
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Patient-reported outcomes measurement information system (PROMIS) domain names and definitions revisions: further evaluation of content validity in IRT-derived item banks. https://app.cochat.ai/papers/10.1007/s11136-010-9694-5
- The paper
- Riley, W. T., Rothrock, N., Bruce, B., Christodolou, C., Cook, K., Hahn, E. A., & Cella, D. (2010). Patient-reported outcomes measurement information system (PROMIS) domain names and definitions revisions: further evaluation of content validity in IRT-derived item banks. Quality of Life Research. https://doi.org/10.1007/s11136-010-9694-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.