The impact of patient-reported outcome (PRO) data from clinical trials: a systematic review and critical analysis
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Background: Patient-reported outcomes (PROs) are commonly collected in clinical trials and should provide impactful evidence on the effect of interventions on patient symptoms and quality of life. However, it is unclear how PRO impact is currently realised in practice. In addition, the different types of impact associated with PRO trial results, their barriers and facilitators, and appropriate impact metrics are not well defined. Therefore, our objectives were: i) to determine the range of potential impacts from PRO clinical trial data, ii) identify potential PRO impact metrics and iii) identify barriers/facilitators to maximising PRO impact; and iv) to examine real-world evidence of PRO trial data impact based on Research Excellence Framework (REF) impact case studies. Methods: Two independent investigators searched MEDLINE, EMBASE, CINAHL+, HMIC databases from inception until December 2018. Articles were eligible if they discussed research impact in the context of PRO clinical trial data. In addition, the REF 2014 database was systematically searched. REF impact case studies were included if they incorporated PRO data in a clinical trial. Results: Thirty-nine publications of eleven thousand four hundred eighty screened met the inclusion criteria. Nine types of PRO trial impact were identified; the most frequent of which centred around PRO data informing clinical decision-making. The included publications identified several barriers and facilitators around PRO trial design, conduct, analysis and report that can hinder or promote the impact of PRO trial data. Sixty-nine out of two hundred nine screened REF 2014 case studies were included. 12 (17%) REF case studies led to demonstrable impact including changes to international guidelines; national guidelines; influencing cost-effectiveness analysis; and influencing drug approvals. Conclusions: PRO trial data may potentially lead to a range of benefits for patients and society, which can be measured through appropriate impact metrics. However, in practice there is relatively limited evidence demonstrating directly attributable and indirect real world PRO-related research impact. In part, this is due to the wider challenges of measuring the impact of research and PRO-specific issues around design, conduct, analysis and reporting. Adherence to guidelines and multi-stakeholder collaboration is essential to maximise the use of PRO trial data, facilitate impact and minimise research waste. Trial registration: Systematic Review registration PROSPERO CRD42017067799.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601
The COMET Handbook: version 1.0
Williamson, P. R., Altman, D. G., Bagley, H., Barnes, K. L., Blazeby, J. M., Brookes, S. T., Clarke, M., Gargon, E., Gorst, S., Harman, N., et al. (2017) · Trials · doi:10.1186/s13063-017-1978-4 · Cited by 2,011
Calvert, M., Kyte, D., Mercieca-Bebber, R., Slade, A., Chan, A.-W., King, M. T., and the SPIRIT-PRO Group, Hunn, A., Bottomley, A., Regnault, A., et al. (2018) · JAMA · doi:10.1001/jama.2017.21903 · Cited by 814 · cited 1×
“These include: the SPIRIT-PRO Extension to improve the completeness of trial protocols [3]; The ongoing work of the SISAQOL Consortium to standardise the analysis and interpretation of PRO and quality of life from oncology clinical trials [88]; CONSORT-PRO Extension to facilitate optimal reporting guidance of trials t…”
MethodSelf-citationPatient-Reported Outcomes to Support Medical Product Labeling Claims: FDA Perspective
Patrick, D. L., Burke, L. B., Powers, J. H., Scott, J. A., Rock, E. P., Dawisha, S., O'Neill, R., & Kennedy, D. L. (2007) · Value in Health · doi:10.1111/j.1524-4733.2007.00275.x · Cited by 726 · cited 4×
“(2016) [71] Clinical Therapeutics Commentary PRO oncology clinical trials Informing reimbursement decisions Informing pricing decisions Informing clinical decisionmaking”
BackgroundMethodInfluentialMercieca-Bebber, R., King, M. T., Calvert, M. J., Stockler, M. R., & Friedlander, M. (2018) · Patient Related Outcome Measures · doi:10.2147/prom.s156279 · Cited by 659 · cited 15×
“metrics were drew upon the ‘pathways to research impact’ framework [6] Rivera et al.”
BackgroundMethodInfluentialSelf-citationAnker, S. D., Agewall, S., Borggrefe, M., Calvert, M., Jaime Caro, J., Cowie, M. R., Ford, I., Paty, J. A., Riley, J. P., Swedberg, K., et al. (2014) · European Heart Journal · doi:10.1093/eurheartj/ehu205 · Cited by 362 · cited 10×
“Failure to report mode of administration of the PRO instrument [44, 47, 48, 50, 54, 58, 62, 63, 75, 76] ●CONSORT-PRO Ext ●SPIRIT-PRO Ext”
BackgroundMethodInfluentialSelf-citationMaximising the impact of patient reported outcome assessment for patients and society
Calvert, M., Kyte, D., Price, G., Valderas, J. M., & Hjollund, N. H. (2019) · BMJ · doi:10.1136/bmj.k5267 · Cited by 328 · cited 4×
“Stakeholder-driven, evidencebased standards for presenting PROs in clinical practice [87].”
BackgroundMethodInfluentialSelf-citationPatient reported outcomes: looking beyond the label claim
Doward, L. C., Gnanasakthy, A., & Baker, M. G. (2010) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-8-89 · Cited by 162 · cited 7×
“Hence, interventions with reduced toxicity and added PRO benefit may influence payer decisionmakers [72].”
BackgroundInfluential
Cited by
Wearable sensor data and self-reported symptoms for COVID-19 detection
Quer, G., Radin, J. M., Gadaleta, M., Baca-Motes, K., Ariniello, L., Ramos, E., Kheterpal, V., Topol, E. J., & Steinhubl, S. R. (2021) · Nature Medicine · doi:10.1038/s41591-020-1123-x · Cited by 447
Calvert, M., King, M., Mercieca-Bebber, R., Aiyegbusi, O., Kyte, D., Slade, A., Chan, A.-W., Basch, E., Bell, J., Bennett, A., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-045105 · Cited by 144
Self-citationAssessing the societal influence of academic research with ChatGPT: Impact case study evaluations
Kousha, K., & Thelwall, M. (2025) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.25021 · Cited by 7
Anxiety in Polish adult patients with inborn errors of immunity: a cross-sectional study
Grochowalska, K., Ziętkiewicz, M., Nowicka-Sauer, K., Topolski, M., Więsik-Szewczyk, E., Matyja-Bednarczyk, A., Napiórkowska-Baran, K., & Zdrojewski, Z. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1293935 · Cited by 1
Metadata
- Authors
- Rivera, S. C., Kyte, D. G., Aiyegbusi, O. L., Slade, A. L., McMullan, C., & Calvert, M. J.
- Venue
- Health and Quality of Life Outcomes
- Published
- 2019-10-16
- Volume
- 17
- Issue
- 1
- Pages
- 156-156
- ISSN
- 1477-7525 (ISSN-L)
- OpenAlex
- W2980562085
- Cited by
- 192
- References
- 8
- FWCI
- 8.18
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The impact of patient-reported outcome (PRO) data from clinical trials: a systematic review and critical analysis. https://app.cochat.ai/papers/10.1186/s12955-019-1220-z
- The paper
- Rivera, S. C., Kyte, D. G., Aiyegbusi, O. L., Slade, A. L., McMullan, C., & Calvert, M. J. (2019). The impact of patient-reported outcome (PRO) data from clinical trials: a systematic review and critical analysis. Health and Quality of Life Outcomes. https://doi.org/10.1186/s12955-019-1220-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.