Method of administration of PROMIS scales did not significantly impact score level, reliability, or validity
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Objective To test the impact of method of administration (MOA) on score level, reliability, and validity of scales developed in the Patient Reported Outcomes Measurement Information System (PROMIS). Study Design and Setting Two non-overlapping parallel forms each containing 8 items from each of three PROMIS item banks (Physical Function, Fatigue and Depression) were completed by 923 adults with COPD, depression, or rheumatoid arthritis. In a randomized cross-over design, subjects answered one form by interactive voice response (IVR) technology, paper questionnaire (PQ), personal digital assistant (PDA), or personal computer (PC) and a second form by PC, in the same administration. Method equivalence was evaluated through analyses of difference scores, intraclass correlations (ICC), and convergent/discriminant validity. Results In difference score analyses, no significant mode differences were found and all confidence intervals were within the pre-specified MID of 0.2 SD. Parallel forms reliabilities were very high (ICC=0.85-0.93). Only one across mode ICC was significantly lower than the same mode ICC. Tests of validity showed no differential effect by MOA. Participants preferred screen interface over PQ and IVR. Conclusion We found no statistically or clinically significant differences in score levels or psychometric properties of IVR, PQ or PDA administration as compared to PC.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., et al. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.011 · Cited by 5,128
Self-citationCella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., Ader, D., Fries, J. F., Bruce, B., & Rose, M. (2007) · Medical Care · doi:10.1097/01.mlr.0000258615.42478.55 · Cited by 3,118 · cited 1×
“Using patient input through focus groups and cognitive interviews, PROMIS has created large item banks to measure many domains, including physical function, fatigue, pain, social role, and emotional distress [9].”
Self-citationHays, R. D., Bjorner, J. B., Revicki, D. A., Spritzer, K. L., & Cella, D. (2009) · Quality of Life Research · doi:10.1007/s11136-009-9496-9 · Cited by 1,957 · cited 2×
“Other measures Other measures included (1) PROMIS global items measuring general health, physical function, fatigue, and emotional distress [12]; (2) number of restricted-activity days and days off from work in the past 4 weeks for health reasons; and (3) demographics, health-care utilization, previous computer use, a…”
Gwaltney, C. J., Shields, A. L., & Shiffman, S. (2008) · Value in Health · doi:10.1111/j.1524-4733.2007.00231.x · Cited by 623 · cited 1×
“Thus, in line with the rather substantial number of studies comparing PQ with PC or PDA [3] and with the more limited number of studies comparing IVR and PQ [18], our results provide strong support for the equivalence of scores from PC, PQ, IVR, and PDA MOA.”
Rush, A. J., Bernstein, I. H., Trivedi, M. H., Carmody, T. J., Wisniewski, S., Mundt, J. C., Shores-Wilson, K., Biggs, M. M., Woo, A., Nierenberg, A. A., et al. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.08.022 · Cited by 385 · cited 1×
“Fewer studies have assessed IVR technology for health outcomes measurement; these have found only nonsignificant [6] or small score differences [7,8].”
Cited by
Taylor, A. M., Phillips, K., Patel, K. V., Turk, D. C., Dworkin, R. H., Beaton, D., Clauw, D. J., Gignac, M. A. M., Markman, J. D., Williams, D. A., et al. (2016) · Pain · doi:10.1097/j.pain.0000000000000577 · Cited by 208
Stone, A. A., Broderick, J. E., Junghaenel, D. U., Schneider, S., & Schwartz, J. E. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.029 · Cited by 207
Self-citationKean, J., Monahan, P. O., Kroenke, K., Wu, J., Yu, Z., Stump, T. E., & Krebs, E. E. (2016) · Medical Care · doi:10.1097/mlr.0000000000000497 · Cited by 116
“Although the pain measures in SCOPE were not self-administered bur rather completed by interviewer administration, the available evidence suggests that mode of administration has minimal, if any, effect on the psychometric properties of PROMIS measures.(28) Another potential explanation for differences in sensitivity…”
BackgroundHadlandsmyth, K., Dailey, D. L., Rakel, B. A., Zimmerman, M. B., Vance, C. G., Merriwether, E. N., Chimenti, R. L., Geasland, K. M., Crofford, L. J., & Sluka, K. A. (2020) · Journal of Health Psychology · doi:10.1177/1359105317736577 · Cited by 48
“95) as well as convergent and discriminant validity (Bjorner et al., 2014).”
BackgroundInfluentialDistress and Type 2 Diabetes Self-Care: Putting the Pieces Together
Hoogendoorn, C. J., Schechter, C. B., Llabre, M. M., Walker, E. A., & Gonzalez, J. S. (2021) · Annals of Behavioral Medicine · doi:10.1093/abm/kaaa070 · Cited by 28
Metadata
- Authors
- Bjorner, J. B., Rose, M., Gandek, B., Stone, A. A., Junghaenel, D. U., & Ware, J. E.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2014-01
- Volume
- 67
- Issue
- 1
- Pages
- 108-113
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W1982811083
- Cited by
- 116
- References
- 5
- FWCI
- 17.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Method of administration of PROMIS scales did not significantly impact score level, reliability, or validity. https://app.cochat.ai/papers/10.1016/j.jclinepi.2013.07.016
- The paper
- Bjorner, J. B., Rose, M., Gandek, B., Stone, A. A., Junghaenel, D. U., & Ware, J. E. (2014). Method of administration of PROMIS scales did not significantly impact score level, reliability, or validity. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2013.07.016
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.