The Use of Patient-reported Outcomes (PRO) Within Comparative Effectiveness Research: Implications for Clinical Practice and Health Care Policy
The DOI matches its Crossref record; 110 of the 112 references it cites were found in a registry or an index.
Abstract
Background The goal of comparative effectiveness research (CER) is to explain the differential benefits and harms of alternate methods to prevent, diagnose, treat, and monitor a clinical condition or to improve the delivery of care. To inform decision making, information from the patient's perspective that reflects outcomes that patients care about are needed and can be collected rigorously using appropriate patient-reported outcomes (PRO). It can be challenging to select the most appropriate PRO measure given the proliferation of such questionnaires over the past 20 years. Objective In this paper, we discuss the value of PROs within CER, types of measures that are likely to be useful in the CER context, PRO instrument selection, and key challenges associated with using PROs in CER. Methods We delineate important considerations for defining the CER context, selecting the appropriate measures, and for the analysis and interpretation of PRO data. Emerging changes that may facilitate CER using PROs as an outcome are also reviewed including implementation of electronic and personal health records, hospital and population-based registries, and the use of PROs in national monitoring initiatives. The potential benefits of linking the information derived from PRO endpoints in CER to decision making is also reviewed. Conclusions The recommendations presented for incorporating PROs in CER are intended to provide a guide to researchers, clinicians, and policy makers to ensure that infor…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Many clinical hepatology studies are based on clinician-reported adverse events or improvements, which do not correlate well with patient-reported harms or improvements [14, 15].”
In the citing paper
“PROs, such as PROMIS, allow patients to quantify aspects of their orthopedic condition in a standardized fashion [6,7].”
In the citing paper
“Patient-reported outcomes (PROs) allow patients to quantify aspects of their orthopedic condition in a standardized fashion [6,7].”
In the citing paper
“Here, criteria are outlined, which an instrument has to fulfill in order to be acknowledged for claims regarding treatment-related QoL improvements in clinical trials.”
From Quality of life as patient-reported outcomes: principles of assessment (2014) · cites this paper as [69]
In the citing paper
“Recently, regulators, in line with the American Federal Drug Administration, have provided recommendations regarding the development of patient reported outcomes, especially health-related QoL.67-69”
From Quality of life as patient-reported outcomes: principles of assessment (2014) · cites this paper as [69]
Citations
Cites
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
(1992) · PubMed · Cited by 33,716
The MOS 36-ltem Short-Form Health Survey (SF-36): I. Conceptual Framework and Item Selection
Ware, J. E., & Sherbourne, C. D. (1992) · Medical Care · doi:10.1097/00005650-199206000-00002 · Cited by 30,033
Aaronson, N. K., Ahmedzai, S., Bergman, B., Bullinger, M., Cull, A., Duez, N. J., Filiberti, A., Flechtner, H., Fleishman, S. B., Haes, J. C. J. M. D., et al. (1993) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/85.5.365 · Cited by 16,005
SF-36 health survey: Manual and interpretation guide
Ware, J. (2003) · Medical Entomology and Zoology · Cited by 11,424
The McGill Pain Questionnaire: Major properties and scoring methods
Melzack, R. (1975) · Pain · doi:10.1016/0304-3959(75)90044-5 · Cited by 6,845
A Multigene Assay to Predict Recurrence of Tamoxifen-Treated, Node-Negative Breast Cancer
Paik, S., Shak, S., Tang, G., Kim, C., Baker, J., Cronin, M., Baehner, F. L., Walker, M. G., Watson, D., Park, T., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa041588 · Cited by 6,277
Pain assessment: global use of the Brief Pain Inventory.
Cs, C., & Km, R. (1994) · PubMed · Cited by 6,104
The functional assessment of cancer therapy scale: development and validation of the general measure
Cella, D. F., Tulsky, D. S., Gray, G., Sarafian, B., Linn, E., Bonomi, A., Silberman, M., Yellen, S. B., Winicour, P., & Brannon, J. (1993) · Journal of Clinical Oncology · doi:10.1200/jco.1993.11.3.570 · Cited by 6,020
EuroQol: the current state of play
Brooks, R. (1996) · Health Policy · doi:10.1016/0168-8510(96)00822-6 · Cited by 5,815
Research works printed but not linked: 1
- Swain, 1999, The National Population Health Surveyits longitudinal nature., Health Reports, 10, 69
Cited by
Reeve, B. B., Wyrwich, K. W., Wu, A. W., Velikova, G., Terwee, C. B., Snyder, C. F., Schwartz, C., Revicki, D. A., Moinpour, C. M., McLeod, L. D., et al. (2013) · Quality of Life Research · doi:10.1007/s11136-012-0344-y · Cited by 845
Self-citationEvidence-Based Cognitive Rehabilitation: Systematic Review of the Literature From 2009 Through 2014
Cicerone, K. D., Goldin, Y., Ganci, K., Rosenbaum, A., Wethe, J. V., Langenbahn, D. M., Malec, J. F., Bergquist, T. F., Kingsley, K., Nagele, D., et al. (2019) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2019.02.011 · Cited by 669
“The use of subjective patient-reported outcomes should provide a directmeasure of meaningful changes in patients everyday functioning, including symptoms, functional status, and health-related quality of life.(168) Unfortunately, reliance on subjective outcomes is typically downgraded from a methodological perspective…”
BackgroundPROMIS® Adult Health Profiles: Efficient Short-Form Measures of Seven Health Domains
Cella, D., Choi, S. W., Condon, D. M., Schalet, B., Hays, R. D., Rothrock, N. E., Yount, S., Cook, K. F., Gershon, R. C., Amtmann, D., et al. (2019) · Value in Health · doi:10.1016/j.jval.2019.02.004 · Cited by 665
Self-citationKolotkin, R. L., & Andersen, J. R. (2017) · Clinical Obesity · doi:10.1111/cob.12203 · Cited by 590
Anker, S. D., Agewall, S., Borggrefe, M., Calvert, M., Jaime Caro, J., Cowie, M. R., Ford, I., Paty, J. A., Riley, J. P., Swedberg, K., et al. (2014) · European Heart Journal · doi:10.1093/eurheartj/ehu205 · Cited by 362
“pared with those of existing interventions and aim to quantify the effect of a therapy from all perspectives.(14) Efficacy on a primary clinical endpoint is important but not sufficient; the patient’s well-being, functional status, or productivity are also considered.”
BackgroundRecommended Patient-Reported Core Set of Symptoms to Measure in Adult Cancer Treatment Trials
Reeve, B. B., Mitchell, S. A., Dueck, A. C., Basch, E., Cella, D., Reilly, C. M., Minasian, L. M., Denicoff, A. M., O'Mara, A. M., Fisch, M. J., et al. (2014) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/dju129 · Cited by 350
“Several national organizations, including the Center for Medical Technology Policy (17), the Food and Drug Administration (18), the Patient-Centered Outcomes Research Institute (19), the National Quality Forum (20), the American Society of Clinical Oncology (21), and the International Society for Quality of Life Resea…”
BackgroundSelf-citationPatient-Reported Outcomes In Performance Measurement
Cella, D., Hahn, E., Jensen, S., Butt, Z., Nowinski, C., Rothrock, N., & Lohr, K. (2015) · doi:10.3768/rtipress.2015.bk.0014.1509 · Cited by 299
Mohammed, M. A., Moles, R. J., & Chen, T. F. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010035 · Cited by 250
“There is also increasing interest and experience of using evidence from patient-reported outcome measures (PROMs) data to improve healthcare quality.(4) 11–13 The use of patients’ experiences and reports are now valued and considered essential to improve healthcare safety and patient outcomes.”
BackgroundSnyder, C. F., Jensen, R. E., Segal, J. B., & Wu, A. W. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1d84 · Cited by 258
“Looking ahead, research and policy initiatives are needed to facilitate the routine use of PROs in policy, research, and practice, and to enable the linkage of PRO data with other clinical data to enable PCOR.(46) In doing so, it will be important to address the ethical, methodologic, and governance considerations tha…”
MethodSelf-citationVAN DER WEES, P. J., NIJHUIS‐VAN DER SANDEN, M. W. G., AYANIAN, J. Z., BLACK, N., WESTERT, G. P., & SCHNEIDER, E. C. (2014) · The Milbank Quarterly · doi:10.1111/1468-0009.12091 · Cited by 242
Training clinicians in how to use patient-reported outcome measures in routine clinical practice
Santana, M. J., Haverman, L., Absolom, K., Takeuchi, E., Feeny, D., Grootenhuis, M., & Velikova, G. (2015) · Quality of Life Research · doi:10.1007/s11136-014-0903-5 · Cited by 231
Damluji, A. A., Forman, D. E., van Diepen, S., Alexander, K. P., Page, R. L., Hummel, S. L., Menon, V., Katz, J. N., Albert, N. M., Afilalo, J., et al. (2020) · Circulation · doi:10.1161/cir.0000000000000741 · Cited by 190
Desai, A. D., Zhou, C., Stanford, S., Haaland, W., Varni, J. W., & Mangione-Smith, R. M. (2014) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2014.1600 · Cited by 185
Ishaque, S., Karnon, J., Chen, G., Nair, R., & Salter, A. B. (2019) · Quality of Life Research · doi:10.1007/s11136-018-2016-z · Cited by 179
Orthopaedic registries with patient-reported outcome measures
Wilson, I., Bohm, E., Lübbeke, A., Lyman, S., Overgaard, S., Rolfson, O., W-Dahl, A., Wilkinson, M., & Dunbar, M. (2019) · EFORT Open Reviews · doi:10.1302/2058-5241.4.180080 · Cited by 177
Orthopaedics1, O. C. C. (2019) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.18.00767 · Cited by 162
Quality of life as patient-reported outcomes: principles of assessment
Bullinger, M., & Quitmann, J. (2014) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2014.16.2/mbullinger · Cited by 158
A history of health-related quality of life outcomes in psychiatry
Revicki, D. A., Kleinman, L., & Cella, D. F. (2014) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2014.16.2/drevicki · Cited by 174
Self-citationSchiele, F., Gale, C. P., Bonnefoy, E., Capuano, F., Claeys, M. J., Danchin, N., Fox, K. A., Huber, K., Iakobishvili, Z., Lettino, M., et al. (2017) · European Heart Journal: Acute Cardiovascular Care · doi:10.1177/2048872616643053 · Cited by 132
Francis, D. O., Daniero, J. J., Hovis, K. L., Sathe, N., Jacobson, B., Penson, D. F., Feurer, I. D., & McPheeters, M. L. (2017) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2016_jslhr-s-16-0022 · Cited by 125
“Food and Drug Administration (FDA) recommends the use of PRO measures as part of the approval process for pharmacological products and devices (Ahmed et al., 2012).”
BackgroundPatel, D. A., Sharda, R., Hovis, K. L., Nichols, E. E., Sathe, N. A., Penson, D. F., Feurer, I. D., McPheeters, M. L., Vaezi, M. F., & Francis, D. O. (2017) · Diseases of the Esophagus · doi:10.1093/dote/dow028 · Cited by 129
“Each study meeting criteria was evaluated using an 18-item checklist developed a priori that assessed multiple domains: (1) conceptual model, (2) content validity, (3) reliability, (4) construct validity, (6) scoring and interpretation, and (7) burden and presentation.”
MethodOh, the Places We’ll Go: Patient-Reported Outcomes and Electronic Health Records
PRO-EHR Users’ Guide Steering Group, Gensheimer, S. G., PRO-EHR Users’ Guide Working Group, Wu, A. W., & Snyder, C. F. (2018) · Patient · doi:10.1007/s40271-018-0321-9 · Cited by 125
Self-citationNoonan, V. K., Lyddiatt, A., Ware, P., Jaglal, S. B., Riopelle, R. J., Bingham, C. O., Figueiredo, S. M., Sawatzky, R. G., Santana, M., Bartlett, S. J., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.04.017 · Cited by 130
Self-citationSystematic Evaluation of Patient-Reported Outcome Protocol Content and Reporting in Cancer Trials
Kyte, D. G., Retzer, A., Ahmed, K., Keeley, T., Armes, J., Brown, J. M., Calman, L. A., Gavin, A., Glaser, A., Greenfield, D., et al. (2019) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djz038 · Cited by 125
“2% adjusted for denominator variation) and 10 (4) of 33 (range1⁄4 2–19) PRO protocol checklist items (31.”
BackgroundInfluentialA Closer Look at the BREAST-Q©
Cano, S., Klassen, A. F., Scott, A., & Pusic, A. L. (2013) · Clinics in Plastic Surgery · doi:10.1016/j.cps.2012.12.002 · Cited by 128
Easpaig, B. N. G., Tran, Y., Bierbaum, M., Arnolda, G., Delaney, G. P., Liauw, W., Ward, R. L., Olver, I., Currow, D. C., Girgis, A., et al. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-4939-7 · Cited by 123
“Ahmed and colleagues [11] propose that PROMs are useful for comparing treatments and can also be used to evaluate quality improvement activities.”
BackgroundSchalet, B. D., Rothrock, N. E., Hays, R. D., Kazis, L. E., Cook, K. F., Rutsohn, J. P., & Cella, D. F. (2015) · Journal of General Internal Medicine · doi:10.1007/s11606-015-3453-9 · Cited by 121
“Inclusion of global health is particularly important in comparative effectiveness research (CER) studies of patients with multiple chronic conditions.(3) Examples of these measures include the Patient Reported Outcomes Measurement Information System Global Health Scale (PROMIS Global Health)(4) and the Veterans RAND 1…”
BackgroundChecklist to operationalize measurement characteristics of patient-reported outcome measures
Francis, D. O., McPheeters, M. L., Noud, M., Penson, D. F., & Feurer, I. D. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0307-4 · Cited by 104
“Methodological experts in PRO measures and survey design have disseminated several consensus statements to guide appropriate development and implementation of these measures [5, 8, 10, 43, 89].”
BackgroundAyers, D. C., Zheng, H., & Franklin, P. D. (2013) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-013-3143-z · Cited by 110
Segawa, E., Schalet, B. D., & Cella, D. F. (2019) · Quality of Life Research · doi:10.1007/s11136-019-02312-8 · Cited by 109
Reducing Barriers to Patient-Reported Outcome Measures for People With Cognitive Impairments
Kramer, J. M., & Schwartz, A. (2017) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2017.03.011 · Cited by 102
Patient satisfaction with treatments for moderate-to-severe plaque psoriasis in clinical practice
Duffin, K. C., Yeung, H., Takeshita, J., Krueger, G. G., Robertson, A. D., Troxel, A. B., Shin, D. B., Voorhees, A. S. V., & Gelfand, J. M. (2013) · British Journal of Dermatology · doi:10.1111/bjd.12745 · Cited by 101
Rosenblat, J. D., Simon, G. E., Sachs, G. S., Deetz, I., Doederlein, A., DePeralta, D., Dean, M. M., & McIntyre, R. S. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.09.027 · Cited by 92
Review of response rates over time in registry-based studies using patient-reported outcome measures
Wang, K., Eftang, C. N., Jakobsen, R. B., & Årøen, A. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-030808 · Cited by 91
Prodinger, B., & Taylor, P. M. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-2898-z · Cited by 94
Ashley, L., Jones, H., Thomas, J., Newsham, A., Downing, A., Morris, E. J. A., Brown, J. M., Velikova, G., Forman, D., & Wright, P. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2764 · Cited by 95
Systematic Review of Patient-Reported Outcome Measures in Clinical Vestibular Research
Fong, E., Li, C. Y., Aslakson, R. A., & Agrawal, Y. (2014) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2014.09.017 · Cited by 86
Horn, M. E., Reinke, E. K., Mather, R. C. “., O'Donnell, J. D., & George, S. Z. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-06626-7 · Cited by 88
“ment decisions; in value-based health care [3]; and in patient-centered comparative effectiveness trials [4, 5].”
BackgroundDas Konzept der Lebensqualität in der Medizin – Entwicklung und heutiger Stellenwert
Bullinger, M. (2014) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2014.02.006 · Cited by 119
Systematic Evaluation of the Patient-Reported Outcome (PRO) Content of Clinical Trial Protocols
Kyte, D., Duffy, H., Fletcher, B., Gheorghe, A., Mercieca-Bebber, R., King, M., Draper, H., Ives, J., Brundage, M., Blazeby, J., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0110229 · Cited by 82
“The value of assessing patient-reported outcomes (PROs) in clinical trials has been emphasized by major international healthpolicy and regulatory authorities, and by patients [1–3].”
BackgroundThe History and Applications of the Veterans RAND 12-Item Health Survey (VR-12)
Selim, A. J., Rothendler, J. A., Qian, S. X., Bailey, H. M., & Kazis, L. E. (2022) · Journal of Ambulatory Care Management · doi:10.1097/jac.0000000000000420 · Cited by 79
Patient Engagement and Reported Outcomes in Surgical Recovery: Effectiveness of an e-Health Platform
Cook, D. J., Manning, D. M., Holland, D. E., Prinsen, S. K., Rudzik, S. D., Roger, V. L., & Deschamps, C. C. (2013) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2013.05.003 · Cited by 76
Health-related quality of life measurement in oncology: Advances and opportunities.
Cella, D. F., & Stone, A. A. (2015) · American Psychologist · doi:10.1037/a0037821 · Cited by 87
Schalet, B. D., Lim, S., Cella, D. F., & Choi, S. W. (2021) · Psychometrika · doi:10.1007/s11336-021-09776-z · Cited by 75
“The multiplicity of these measures and the absence of a dominant standard instrument for any given health domain is a major impediment to scientific progress (Ahmed et al. 2012).”
BackgroundEvolution of Patient-Reported Outcomes and Their Role in Multiple Sclerosis Clinical Trials
Nowinski, C. J., Miller, D. M., & Cella, D. F. (2017) · Neurotherapeutics · doi:10.1007/s13311-017-0571-6 · Cited by 75
A Review of HIV-Specific Patient-Reported Outcome Measures
Engler, K., Lessard, D., & Lebouché, B. (2016) · Patient · doi:10.1007/s40271-016-0195-7 · Cited by 68
Anthony, C. A., Rojas, E. O., Keffala, V., Glass, N. A., Shah, A. S., Miller, B. J., Hogue, M., Willey, M. C., Karam, M., & Marsh, J. L. (2020) · doi:10.2196/preprints.17750 · Cited by 64
“Patient-reported outcomes (PROs) allow patients to quantify aspects of their orthopedic condition in a standardized fashion [6,7].”
Dür, M., Steiner, G., Fialka-Moser, V., Kautzky-Willer, A., Dejaco, C., Prodinger, B., Stoffer, M. A., Binder, A., Smolen, J., & Stamm, T. A. (2014) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-12-45 · Cited by 59
Socioeconomic disparities in health-related quality of life among colorectal cancer survivors
McDougall, J. A., Blair, C. K., Wiggins, C. L., Goodwin, M. B., Chiu, V. K., Rajput, A., & Kinney, A. Y. (2019) · Journal of Cancer Survivorship · doi:10.1007/s11764-019-00767-9 · Cited by 63
Barritt, A. S., Gitlin, N., Klein, S., Lok, A. S.-F., Loomba, R. S., Malahias, L., Powell, M., Vos, M. B., Weiss, L. M., Cusi, K. J., et al. (2017) · Contemporary Clinical Trials · doi:10.1016/j.cct.2017.07.015 · Cited by 56
Haywood, K. L., Brett, J., Tutton, E., & Staniszewska, S. H. (2016) · Quality of Life Research · doi:10.1007/s11136-016-1424-1 · Cited by 60
“Citation lists of included articles and earlier reviews of measures used in hip pathologies or hip fracture [5, 6, 10] were reviewed.”
BackgroundOutcomes Measures and Risk Adjustment
Lane-Fall, M. B., & Neuman, M. D. (2013) · International Anesthesiology Clinics · doi:10.1097/aia.0b013e3182a70a52 · Cited by 53
“However, there has been an increasing emphasis on so-called patient-reported outcomes that may not be apparent to providers, such as symptoms, function, and quality of life.(5,6)”
BackgroundPatient-Reported Outcomes and Survivorship in Radiation Oncology: Overcoming the Cons
Siddiqui, F., Liu, A. K., Bruner, D. W., & Movsas, B. (2014) · Journal of Clinical Oncology · doi:10.1200/jco.2014.55.0707 · Cited by 52
Marcellin, F., Roux, P., Protopopescu, C., Duracinský, M., Spire, B., & Carrieri, P. (2017) · Expert Review of Gastroenterology & Hepatology · doi:10.1080/17474124.2017.1285227 · Cited by 51
“objective clinical markers but which are useful from both a clinical and public health perspective, such as perceived stigma, access to and satisfaction with care [5,6], or work productivity [7].”
BackgroundDellenmark‐Blom, M., Chaplin, J. E., Gatzinsky, V., Jönsson, L., & ABRAHAMSON, K. (2015) · Quality of Life Research · doi:10.1007/s11136-015-0975-x · Cited by 53
Oak, S. R., O’Rourke, C., Strnad, G. J., Andrish, J. T., Parker, R. D., Saluan, P. M., Jones, M. H., Stegmeier, N., & Spindler, K. P. (2015) · The American Journal of Sports Medicine · doi:10.1177/0363546515589108 · Cited by 52
“Additionally, PROs have shown value in comparative effectiveness research, comparing quality of institutions and providers, providing patient-centered treatment decisions, and potentially deciding healthcare reimbursements.(1,4) PROs in knee conditions have been extensively developed, because patients’ symptoms, pain,…”
BackgroundAyis, S. A., Wellwood, I., Rudd, A. G., McKevitt, C., Parkin, D., & Wolfe, C. D. A. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-007101 · Cited by 51
Falchook, A. D., Tracton, G., Stravers, L., Fleming, M. E., Snavely, A. C., Noe, J. F., Hayes, D. N., Grilley-Olson, J. E., Weiss, J. M., Reeve, B. B., et al. (2016) · Advances in Radiation Oncology · doi:10.1016/j.adro.2016.02.001 · Cited by 46
Self-citationOak, S. R., Strnad, G. J., Bena, J., Farrow, L. D., Parker, R. D., Jones, M. H., & Spindler, K. P. (2016) · Orthopaedic Journal of Sports Medicine · doi:10.1177/2325967116674714 · Cited by 50
The Concept of a Toolbox of Outcome Measures for Children With Cerebral Palsy
Wright, F. V., & Majnemer, A. (2014) · Journal of Child Neurology · doi:10.1177/0883073814533423 · Cited by 48
“These questionnaires, also known as patient-reported outcomes, provide the clinician with the individual’s perspectives on symptoms, functional status, participation, health perception, quality of life, environmental factors, or satisfaction with services.(18) A user’s guide for implementing patient-reported outcome a…”
BackgroundEvans, J. P., Smith, C., Fine, N., Porter, I. H., Gangannagaripalli, J., Goodwin, V. A., & Valderas, J. M. (2018) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2017.12.027 · Cited by 48
Howell, M., Wong, G., Turner, R. M., Tan, H. T., Tong, A., Craig, J. C., & Howard, K. (2015) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2015.11.006 · Cited by 48
Hancock, S., Ryan, O., Marion, V., Kramer, S. F., Kelly, P., Breen, S. J., & Cadilhac, D. A.-M. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038190 · Cited by 49
Systematic review of the use of translated patient-reported outcome measures in cancer trials
Slade, A. L., Retzer, A., Ahmed, K., Kyte, D. G., Keeley, T., Armes, J., Brown, J. M., Calman, L. A., Gavin, A., Glaser, A., et al. (2021) · Trials · doi:10.1186/s13063-021-05255-z · Cited by 46
the International Society for Quality of Life Research (ISOQOL), Mercieca-Bebber, R., Williams, D., Tait, M.-A., Roydhouse, J., Busija, L., Sundaram, C. S., Wilson, M., Langford, A., Rutherford, C., et al. (2018) · Quality of Life Research · doi:10.1007/s11136-018-1921-5 · Cited by 41
Measuring the effects of exercise in neuromuscular disorders: a systematic review and meta-analyses
Stefanetti, R. J., Blain, A. P., Jimenez‐Moreno, C., Errington, L., Ng, Y. S., McFarland, R., Turnbull, D. M., Newman, J. H., & Gorman, G. S. (2020) · Wellcome Open Research · doi:10.12688/wellcomeopenres.15825.1 · Cited by 48
Data monitoring committees for pragmatic clinical trials
Ellenberg, S. S., Culbertson, R., Gillen, D. L., Goodman, S. N., Schrandt, S., & Zirkle, M. (2015) · Clinical Trials · doi:10.1177/1740774515597697 · Cited by 43
“PCTs are partly characterized by their focus on patientcentered outcomes that often incorporate multiple measures of quality of life.(19) Although some explanatory trials include quality of life measures, their primary focus is more typically on objective clinical or biological measures such as mortality, progression…”
BackgroundIdentification, description and appraisal of generic PROMs for primary care: a systematic review
Murphy, M., Hollinghurst, S. P., & Salisbury, C. (2018) · BMC Family Practice · doi:10.1186/s12875-018-0722-9 · Cited by 45
“External aspects of empowerment are less extensively covered, perhaps because these are traditionally seen as measures of patient experience, not outcome [54], and because we did not include measures which exclusively capture patient experience in our review.”
BackgroundSawatzky, R. G., Chan, E. K. H., Zumbo, B. D., Ahmed, S., Bartlett, S. J., Bingham, C. O., Gardner, W. P., Jutai, J. W., Kuspinar, A., Sajobi, T. T., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.12.002 · Cited by 41
Self-citationRutherford, C., Brown, J. M., Smith, I. L., McGinnis, E., Wilson, L., Gilberts, R. M., Brown, S. T., Coleman, S. B., Collier, H., & Nixon, J. (2018) · Health and Quality of Life Outcomes · doi:10.1186/s12955-018-1049-x · Cited by 38
Tetreault, L. A., Garwood, P., Gharooni, A.-A., Touzet, A. Y., Lohkamp, L., Martin, A. R., Wilson, J. R., Harrop, J. S., Guest, J. D., Kwon, B. K., et al. (2021) · Global Spine Journal · doi:10.1177/21925682211063854 · Cited by 39
Jagsi, R., Chiang, A. C., Polite, B. N., Medeiros, B. C., McNiff, K. K., Abernethy, A. P., Zon, R. T., & Loehrer, P. J. (2013) · Journal of Oncology Practice · doi:10.1200/jop.2012.000823 · Cited by 37
Smith, T. G., Castro, K. M., Troeschel, A. N., Arora, N. K., Lipscomb, J., Jones, S. M., Treiman, K. A., Hobbs, C., McCabe, R. M., & Clauser, S. B. (2016) · Cancer · doi:10.1002/cncr.29767 · Cited by 36
Toward a better understanding of patient-reported outcomes in clinical practice.
Bitton, A., Onega, T., Tosteson, A. N. A., & Haas, J. S. (2014) · PubMed · Cited by 37
Muñoz, R. T., Hellman, C. M., Buster, B. E., Robbins, A., Carroll, C., Kabbani, M., Cassody, L., Brahm, N. C., & Fox, M. D. (2016) · International Journal of Applied Positive Psychology · doi:10.1007/s41042-017-0005-z · Cited by 38
“Health Related Quality of Life (HRQoL) HRQoL is as a multi-dimensional psychological construct said to capture subjective perceptions of health (Ahmed et al. 2012).”
BackgroundQuality of life: Guidelines for the care of people with spina bifida
Sawin, K. J., Brei, T. J., & Houtrow, A. J. (2020) · Journal of Pediatric Rehabilitation Medicine · doi:10.3233/prm-200732 · Cited by 40
Person‐reported outcomes in diabetes care: What are they and why are they so important?
Hermanns, N., Kulzer, B., & Ehrmann, D. (2024) · Diabetes Obesity and Metabolism · doi:10.1111/dom.15471 · Cited by 36
“145 Furthermore, there are some threats to the sensitivity to change within PROMs and PREMs.”
BackgroundPlate, S., Emilsson, L., Söderberg, M., Brandberg, Y., & Wärnberg, F. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-2925-0 · Cited by 35
“Different definitions of health-related quality of life (HRQoL) exist [15, 16].”
BackgroundBanierink, H., ten Duis, K., Wendt, K. W., Heineman, E., IJpma, F. F. A., & Reininga, I. H. F. (2020) · PLoS ONE · doi:10.1371/journal.pone.0233226 · Cited by 34
Ziemek, J., Man, A., Hinchcliff, M., Varga, J., Simms, R. W., & Lafyatis, R. (2016) · Rheumatology · doi:10.1093/rheumatology/kew003 · Cited by 33
Young Athletes' Concerns About Sport-Related Concussion: The Patient's Perspective
Stein, C. J., MacDougall, R. D., Quatman‐Yates, C. C., Myer, G. D., Sugimoto, D., Dennison, R. J., & Meehan, W. P., III (2015) · Clinical Journal of Sport Medicine · doi:10.1097/jsm.0000000000000268 · Cited by 33
Ballard, D. P., Abramowitz, J. M., Sukato, D. C., Bentsianov, B. L., & Rosenfeld, R. M. (2018) · Otolaryngology · doi:10.1177/0194599818780207 · Cited by 33
How Comprehensive and Efficient Are Patient-Reported Outcomes for Rotator Cuff Tears?
Makhni, E. C., Hamamoto, J. T., Higgins, J. D. D., Patterson, T., Griffin, J. W., Romeo, A. A., & Verma, N. N. (2017) · Orthopaedic Journal of Sports Medicine · doi:10.1177/2325967117693223 · Cited by 32
“Moreover, these scores have been targeted for inclusion in many new health care policies for incorporation into the measure of value affecting all orthopaedic practitioners and patients.(1,2) Unfortunately, practical implementation of PROs on a widespread scale presents several limitations.”
BackgroundJepsen, R., Dogisso, T. W., Dysvik, E., Andersen, J. R., & Natvig, G. K. (2014) · PeerJ · doi:10.7717/peerj.609 · Cited by 34
Clinician's Checklist for Reading and Using an Article About Patient-Reported Outcomes
Wu, A. W., Bradford, A. N., Velanovich, V., Sprangers, M. A. G., Brundage, M., & Snyder, C. F. (2014) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2014.01.017 · Cited by 33
Self-citationNew paradigms in planning cancer rehabilitation and survivorship
Dalton, S. O., & Johansen, C. (2013) · Acta Oncologica · doi:10.3109/0284186x.2012.748216 · Cited by 32
Ahmed, S., Ware, P., Gardner, W. P., Witter, J. P., Bingham, C. O., Kairy, D., & Bartlett, S. J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.04.011 · Cited by 30
Self-citationImprovements in Health-Related Quality of Life With Electroconvulsive Therapy: A Meta-analysis
Giacobbe, P., Rakita, U., Penner-Goeke, K., Feffer, K., Flint, A. J., Kennedy, S. H., & Downar, J. H. (2018) · Journal of Ect · doi:10.1097/yct.0000000000000486 · Cited by 34
Ensari, I., Pichon, A., Gorman, S. L., Henry, S. B., & Elhadad, N. (2020) · Applied Clinical Informatics · doi:10.1055/s-0040-1718755 · Cited by 36
Lounsbury, D. W., Hirsch, G. B., Vega, C., & Schwartz, C. E. (2013) · Quality of Life Research · doi:10.1007/s11136-013-0532-4 · Cited by 31
“In addition to its long-standing application to outcome research, QOL tools and methods are increasingly used in comparative effectiveness research [1] and health policy decision-making [2].”
MethodCancer patient-reported outcomes assessment using wireless touch screen tablet computers
Stukenborg, G. J., Blackhall, L. J., Harrison, J., Barclay, J. S., Dillon, P. M., Davis, M., Mallory, M. J., & Read, P. (2013) · Quality of Life Research · doi:10.1007/s11136-013-0595-2 · Cited by 29
“The integration of PROs into the care delivery process represents an important step for better informed clinical decision-making, incorporating the patient’s perspective, and thereby improving the quality of care delivered to cancer patients in the palliative care setting [13–15].”
BackgroundAsher, A. L., McGirt, M. J., Glassman, S. D., Groman, R. F., Resnick, D. K., Mehrlich, M., Spivey, E., & McCormick, P. C. (2013) · Neurosurgical FOCUS · doi:10.3171/2012.10.focus12300 · Cited by 29
Liegl, G., Gandek, B., Fischer, F. H., Bjørner, J. B., Ware, J. E., Rose, M., Fries, J. F., & Nolte, S. (2017) · Arthritis Research & Therapy · doi:10.1186/s13075-017-1273-5 · Cited by 29
Patient-reported outcomes in stroke clinical trials 2002–2016: a systematic review
Price‐Haywood, E. G., Harden-Barrios, J., Carr, C., Reddy, L., Bazzano, L., & van Driel, M. (2018) · Quality of Life Research · doi:10.1007/s11136-018-2053-7 · Cited by 32
Distilling the essence of appraisal: a mixed methods study of people with multiple sclerosis
Rapkin, B. D., & Schwartz, C. E. (2015) · Quality of Life Research · doi:10.1007/s11136-015-1119-z · Cited by 28
Changing Patterns of Alpha Agonist Medication Use in Children and Adolescents 2009–2011
Fiks, A. G., Mayne, S. L., Song, L., Steffes, J., Liu, W., McCarn, B., Margolis, B., Grimes, A., Gotlieb, E. M., Localio, R., et al. (2015) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2014.0122 · Cited by 29
“This work may be advanced as EHRs increasingly incorporate outcome data reported by children, parents, or teachers (Wu et al. 2010; Ahmed et al. 2012).”
BackgroundOlson, R. A., Howard, A. F., Lapointe, V., Schellenberg, D. D., Nichol, A., Bowering, G., Curtis, S., Walter, A., Brown, S., Thompson, C., et al. (2017) · Healthcare Management Forum · doi:10.1177/0840470417715478 · Cited by 27
Stegemann, S. (2018) · Expert Opinion on Drug Delivery · doi:10.1080/17425247.2018.1472571 · Cited by 32
Shaw, J. D., McEntarfer, R. A., Ferrel, J. R., Greene, N., Presson, A. P., Zhang, C., Lawrence, B. D., Spiker, W. R., Spina, N., & Brodke, D. S. (2020) · Global Spine Journal · doi:10.1177/2192568220958670 · Cited by 26
Retzer, A., Calvert, M., Ahmed, K., Keeley, T., Armes, J., Brown, J. M., Calman, L. A., Gavin, A., Glaser, A., Greenfield, D., et al. (2021) · Cancer Medicine · doi:10.1002/cam4.4111 · Cited by 27
Metadata
- Authors
- Ahmed, S., Berzon, R. A., Revicki, D. A., Lenderking, W. R., Moinpour, C. M., Basch, E., Reeve, B. B., & Wu, A. W.
- Affiliations
- McGill University Health Centre (CA)
- National Institutes of Health (US)
- Fred Hutch Cancer Center (US)
- Memorial Sloan Kettering Cancer Center (US)
- UNC Lineberger Comprehensive Cancer Center (US)
- Corresponding author
- Ahmed, Sara
- Wu, Albert W.
- ORCID
- Venue
- Medical Care
- Published
- 2012-12
- Volume
- 50
- Issue
- 12
- Pages
- 1060-1070
- ISSN
- 0025-7079 (ISSN-L)
- OpenAlex
- W2314261856
- Cited by
- 272
- References
- 112
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 12 · 2023: 12 · 2022: 14 · 2021: 20 · 2020: 23 · 2019: 27 · 2018: 30 · 2017: 23 · 2016: 25 · 2015: 20 · 2014: 33 · 2013: 17 · 2012: 2
- FWCI
- 54.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Care (publishedVersion)
- PubMed (publishedVersion)
- eScholarship@McGill (McGill) (submittedVersion)
- Funders
- H2020 European Research Council
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Health Professions › General Health Professions › Patient Satisfaction in Healthcare
- Keywords
- patient-reported outcomes, comparative effectiveness research, electronic health records, health registries, healthcare decision-making, patient-centered outcomes
- MeSH terms
- Activities of Daily Living, Health Policy, Health Status, Humans, Quality of Life, Research Design, Health Behavior, Patient Satisfaction, Outcome Assessment, Health Care, Patient-Centered Care, Comparative Effectiveness Research, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.