Measure once, cut twice—adding patient-reported outcome measures to the electronic health record for comparative effectiveness research
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: This article presents the current state of patient-reported outcome measures and explains new opportunities for leveraging the recent adoption of electronic health records to expand the application of patient-reported outcomes in both clinical care and comparative effectiveness research. STUDY DESIGN AND SETTING: Historic developments of patient-reported outcome, electronic health record, and comparative effectiveness research are analyzed in two dimensions: patient centeredness and digitization. We pose the question, "What needs to be standardized around the collection of patient-reported outcomes in electronic health records for comparative effectiveness research?" RESULTS: We identified three converging trends: the progression of patient-reported outcomes toward greater patient centeredness and electronic adaptation; the evolution of electronic health records into personalized and fully digitized solutions; and the shift toward patient-oriented comparative effectiveness research. Related to this convergence, we propose an architecture for patient-reported outcome standardization that could serve as a first step toward a more comprehensive integration of patient-reported outcomes with electronic health record for both practice and research. CONCLUSION: The science of patient-reported outcome measurement has matured sufficiently to be integrated routinely into electronic health records and other electronic health solutions to collect data on an ongoing basis for clinical care and comparative effectiveness research. Further efforts and ideally coordinated efforts from various stakeholders are needed to refine the details of the proposed framework for standardization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · cited 2×
“Some electronic health record systems incorporate a predefined set of standardized measures into their routine workflow, such as the 36-Item Short Form Health Survey (SF-36), Patient Health Questionnaire (PHQ-9), and brief static PROMIS questionnaires [10,31,32].”
Method(1992) · PubMed · Cited by 33,716
The MOS 36-ltem Short-Form Health Survey (SF-36): I. Conceptual Framework and Item Selection
Ware, J. E., & Sherbourne, C. D. (1992) · Medical Care · doi:10.1097/00005650-199206000-00002 · Cited by 30,033 · cited 2×
“Some electronic health record systems incorporate a predefined set of standardized measures into their routine workflow, such as the 36-Item Short Form Health Survey (SF-36), Patient Health Questionnaire (PHQ-9), and brief static PROMIS questionnaires [10,31,32].”
MethodCella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., et al. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.011 · Cited by 5,128
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.006 · Cited by 4,465
Progress in Development of the Index of ADL
Katz, S., Downs, T. D., Cash, H. R., & Grotz, R. C. (1970) · The Gerontologist · doi:10.1093/geront/10.1_part_1.20 · Cited by 4,118 · cited 1×
“Initial measures of health status were often measured from the point of view of a clinician or caregiver such as theKarnofsky Performance Status Scale [5] andKatz Activities of Daily Living [6].”
MethodAssessing health status and quality-of-life instruments: Attributes and review criteria
Lohr, K. N. (2002) · Quality of Life Research · doi:10.1023/a:1015291021312 · Cited by 2,269
Karnofsky, D. A., Abelmann, W. H., Craver, L. F., & Burchenal, J. H. (1948) · Cancer · doi:10.1002/1097-0142(194811)1:4<634::aid-cncr2820010410>3.0.co;2-l · Cited by 2,248
Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., Thissen, D., Revicki, D. A., Weiss, D. J., Hambleton, R. K., et al. (2007) · Medical Care · doi:10.1097/01.mlr.0000250483.85507.04 · Cited by 1,491
The RAND-36 measure of health-related quality of life
Hays, R. D., & Morales, L. S. (2001) · Annals of Medicine · doi:10.3109/07853890109002089 · Cited by 1,460 · cited 1×
“One commercially available electronic health record is using the publicly available RAND-36 [50] and PHQ-9 [32] in their first version of patient-reported outcome”
Method
Cited by
Sanli, O., Dobruch, J., Knowles, M. A., Burger, M., Alemozaffar, M., Nielsen, M. E., & Lotan, Y. (2017) · Nature Reviews Disease Primers · doi:10.1038/nrdp.2017.22 · Cited by 814
Patient-Reported Outcomes — Harnessing Patients’ Voices to Improve Clinical Care
Basch, E. (2017) · New England Journal of Medicine · doi:10.1056/nejmp1611252 · Cited by 634
Toussaint, A., Hüsing, P., Gumz, A., Wingenfeld, K., Härter, M., Schramm, E., & Löwe, B. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.01.032 · Cited by 641
Menstruation: science and society
Critchley, H. O. D., Babayev, E., Bulun, S. E., Clark, S., Garcia-Grau, I., Gregersen, P. K., Kilcoyne, A., Kim, J.-Y. J., Lavender, M., Marsh, E. E., et al. (2020) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2020.06.004 · Cited by 448
Maximising the impact of patient reported outcome assessment for patients and society
Calvert, M., Kyte, D., Price, G., Valderas, J. M., & Hjollund, N. H. (2019) · BMJ · doi:10.1136/bmj.k5267 · Cited by 328
Digital health technologies: opportunities and challenges in rheumatology
Solomon, D. H., & Rudin, R. S. (2020) · Nature Reviews Rheumatology · doi:10.1038/s41584-020-0461-x · Cited by 228
Basch, E., Stover, A. M., Schrag, D., Chung, A., Jansen, J., Henson, S., Carr, P., Ginos, B., Deal, A., Spears, P. A., et al. (2020) · JCO Clinical Cancer Informatics · doi:10.1200/cci.20.00081 · Cited by 194
Self-citationDoes personality affect health-related quality of life?A systematic review
Huang, I.-C., Lee, J. L., Ketheeswaran, P., Jones, C. M., Revicki, D. A., & Wu, A. W. (2017) · PLOS ONE · doi:10.1371/journal.pone.0173806 · Cited by 159
Self-citationKharrazi, H., Gonzalez, C. P., Lowe, K. B., Huerta, T. R., & Ford, E. W. (2018) · Journal of Medical Internet Research · doi:10.2196/10458 · Cited by 84
“As the adoption of a basic EHR became commonplace, researchers began to frame EHR adoption in terms of its ability to support specific tasks (eg, integrating clinical decision support [CDS] into clinical workflow; automating the collection of patient-reported outcomes; capturing high-quality data for clinical trials;…”
MethodSelf-citationOptimizing telehealth pain care after COVID-19
Tauben, D. J., Langford, D. J., Sturgeon, J. A., Rundell, S. D., Towle, C., Bockman, C., & Nicholas, M. (2020) · Pain · doi:10.1097/j.pain.0000000000002048 · Cited by 75
Makhni, E. C., Makhni, S., & Ramkumar, P. N. (2021) · Journal of the American Academy of Orthopaedic Surgeons · doi:10.5435/jaaos-d-20-00846 · Cited by 72
Putting patient-reported outcomes on the ‘Big Data Road Map’.
Calvert, M., Thwaites, R., Kyte, D., & Devlin, N. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076815579896 · Cited by 52
“This will necessitate a coordinated approach, guided by input from a range of stakeholders, to ensure a clear rationale for PRO assessment utilising optimal instruments, aimed at facilitating high-quality data capture and appropriate governance.(16) Adding PROs to the heart of the big data agenda will open up an impor…”
Background
Metadata
- Authors
- Wu, A. W., Kharrazi, H., Boulware, L. E., & Snyder, C. F.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2013-08
- Volume
- 66
- Issue
- 8
- Pages
- S12-S20
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2021825713
- Cited by
- 188
- References
- 37
- FWCI
- 31.53
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.