CoChat

Design, implementation and reporting strategies to reduce the instance and impact of missing patient-reported outcome (PRO) data: a systematic review

Mercieca-Bebber, Rebecca, Palmer, Michael J, Brundage, Michael, Calvert, Melanie, Stockler, Martin R, King, Madeleine T · 2016 · BMJ Open
Cited by 121

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Abstract

Objectives: Patient-reported outcomes (PROs) provide important information about the impact of treatment from the patients' perspective. However, missing PRO data may compromise the interpretability and value of the findings. We aimed to report: (1) a non-technical summary of problems caused by missing PRO data; and (2) a systematic review by collating strategies to: (A) minimise rates of missing PRO data, and (B) facilitate transparent interpretation and reporting of missing PRO data in clinical research. Our systematic review does not address statistical handling of missing PRO data. Data sources: MEDLINE and Cumulative Index to Nursing and Allied Health Literature (CINAHL) databases (inception to 31 March 2015), and citing articles and reference lists from relevant sources. Eligibility criteria: English articles providing recommendations for reducing missing PRO data rates, or strategies to facilitate transparent interpretation and reporting of missing PRO data were included. Methods: 2 reviewers independently screened articles against eligibility criteria. Discrepancies were resolved with the research team. Recommendations were extracted and coded according to framework synthesis. Results: 117 sources (55% discussion papers, 26% original research) met the eligibility criteria. Design and methodological strategies for reducing rates of missing PRO data included: incorporating PRO-specific information into the protocol; carefully designing PRO assessment schedules and defining termination rules; minimising patient burden; appointing a PRO coordinator; PRO-specific training for staff; ensuring PRO studies are adequately resourced; and continuous quality assurance. Strategies for transparent interpretation and reporting of missing PRO data include utilising auxiliary data to inform analysis; transparently reporting baseline PRO scores, rates and reasons for missing data; and methods for handling missing PRO data. Conclusions: The instance of missing PRO data and its potential to bias clinical research can be minimised by implementing thoughtful design, rigorous methodology and transparent reporting strategies. All members of the research team have a responsibility in implementing such strategies.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/bmjopen-2015-010938

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 PRISMA flow diagram. PRO, patient-reported outcome.
Figure 1 PRISMA flow diagram. PRO, patient-reported outcome.CC BY-NC · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Research works printed but not linked: 55

  1. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<517::AID-SIM799>3.0.CO;2-S · DOI · Paper page
  2. 10.1007/BF00540022 · DOI · Paper page
  3. Bernhard, 1998, Preface, Stat Med, 17, 511, 10.1002/(SICI)1097-0258(19980315/15)17:5/7<511::AID-SIM798>3.0.CO;2-C · doi:10.1002/(sici)1097-0258(19980315/15)17:5/7<511::aid-sim798>3.0.co;2-c
  4. 10.1093/annonc/mdu489 · DOI
  5. 10.1002/cncr.29489 · DOI
  6. 10.1186/1745-6215-9-51 · DOI · Paper page
  7. 10.1093/annonc/mdw080 · DOI
  8. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<781::AID-SIM821>3.0.CO;2-O · DOI · Paper page
  9. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<667::AID-SIM813>3.0.CO;2-6 · DOI · Paper page
  10. 10.1177/0962280213476378 · DOI · Paper page
  11. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<739::AID-SIM818>3.0.CO;2-M · doi:10.1002/(sici)1097-0258(19980315/15)17:5/7<739::aid-sim818>3.0.co;2-m
  12. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<697::AID-SIM815>3.0.CO;2-Y · doi:10.1002/(sici)1097-0258(19980315/15)17:5/7<697::aid-sim815>3.0.co;2-y
  13. 10.1186/1477-7525-7-57 · DOI
  14. 10.1371/journal.pmed.1000097 · DOI · Paper page
  15. 10.1186/1471-2288-9-59 · DOI · Paper page
  16. 10.1200/JCO.2007.12.1749 · DOI
  17. Cella, 1994, Data collection strategies for patient-reported information, Qual Manag Health Care, 2, 28, 10.1097/00019514-199402040-00006 · DOI
  18. Fallowfield, 2005, Health-related quality of life in patients undergoing drug therapy for advanced non-small-cell lung cancer, Lung Cancer, 48, 365, 10.1016/j.lungcan.2004.11.018 · DOI
  19. 10.1002/sim.5519 · DOI · Paper page
  20. 10.1023/A:1023900802254 · DOI
  21. 10.1634/theoncologist.2009-0291 · DOI · Paper page
  22. Aaronson, 1990, Quality of life research in cancer clinical trials: a need for common rules and language, Oncology (Williston Park, NY), 4, 59
  23. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<541::AID-SIM801>3.0.CO;2-# · doi:10.1002/(sici)1097-0258(19980315/15)17:5/7<541::aid-sim801>3.0.co;2-#
  24. 10.1177/1740774512449532 · DOI
  25. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<633::AID-SIM810>3.0.CO;2-U · doi:10.1002/(sici)1097-0258(19980315/15)17:5/7<633::aid-sim810>3.0.co;2-u
  26. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<613::AID-SIM808>3.0.CO;2-9 · doi:10.1002/(sici)1097-0258(19980315/15)17:5/7<613::aid-sim808>3.0.co;2-9
  27. 10.1016/j.biopsych.2006.01.017 · DOI
  28. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<587::AID-SIM806>3.0.CO;2-# · doi:10.1002/(sici)1097-0258(19980315/15)17:5/7<587::aid-sim806>3.0.co;2-#
  29. 10.1002/(SICI)1097-0258(19980315/15)17:5/7<547::AID-SIM802>3.0.CO;2-F · doi:10.1002/(sici)1097-0258(19980315/15)17:5/7<547::aid-sim802>3.0.co;2-f
  30. 10.1007/BF00343916 · DOI
  31. 10.1016/S0197-2456(00)00130-6 · DOI
  32. 10.1002/(SICI)1099-1611(199905/06)8:3<260::AID-PON383>3.0.CO;2-Z · doi:10.1002/(sici)1099-1611(199905/06)8:3<260::aid-pon383>3.0.co;2-z
  33. 10.1136/jech.55.5.348 · DOI
  34. Revicki D , Fairclough D . Preventing missing data. In: Fayers P , Hays R, eds . Assessing quality of life in clinical trials: analysis and interpretation. 2nd edn. Oxford University Press, 2005:209–222. · doi:10.1093/oso/9780198527695.003.0011
  35. 10.1191/1740774504cn008xx · doi:10.1191/1740774504cn008xx
  36. Hayden, 1993, Pitfalls in quality-of-life assessment: lessons from a Southwest Oncology Group breast cancer clinical trial, Oncol Nurs Forum, 20, 1415
  37. 10.1007/s11136-014-0871-9 · DOI
  38. 10.1001/jama.2013.879 · DOI · Paper page
  39. 10.1007/s11136-010-9793-3 · DOI
  40. Mercieca-Bebber, 2016, Patient-reported outcomes in head and neck and thyroid cancer randomised controlled trials: a systematic review of completeness of reporting and impact on interpretation, Eur J Cancer, 56, 144, 10.1016/j.ejca.2015.12.025 · DOI
  41. 10.1093/annonc/mdv283 · DOI
  42. 10.1016/S0140-6736(13)62228-X · DOI · Paper page
  43. Palmer, 2015, A framework for classifying root causes of missing data for patient reported outcomes in prospective studies, Qual Life Res, 24, a2016
  44. Fairclough D . Design and analysis of quality of life studies in clinical trials. New York: Chapman & Hall, 2010. · DOI · Paper page
  45. 10.1586/erp.11.9 · DOI · Paper page
  46. 10.1097/00005650-199905000-00006 · DOI · Paper page
  47. 10.1371/journal.pone.0110216 · DOI · Paper page
  48. Calvert, 2015, Putting patients at the heart of health-care research, Lancet, 385, 1073, 10.1016/S0140-6736(15)60599-2 · DOI
  49. 10.1081/CNV-120005928 · DOI · Paper page
  50. Gheorghe, 2015, Evaluating the generalisability of trial results: introducing a centre- and trial-level generalisability index, Pharmacoeconomics, 33, 1195, 10.1007/s40273-015-0298-3 · DOI
  51. Rutherford, 2015, Mode of administration does not cause bias in patient-reported outcome results: a meta-analysis, Qual Life Res, 3, 3
  52. 10.1111/j.1365-2648.2007.04448.x · DOI · Paper page
  53. Edwards P , Roberts I , Clarke M , et al . Methods to increase response rates to postal questionnaires. Cochrane Database Syst Rev 2007;(2):MR000008. doi:10.1002/14651858.MR000008.pub3 · DOI · Paper page
  54. 10.1111/j.1524-4733.2007.00278.x · DOI
  55. 10.1016/j.ejca.2004.10.017 · DOI · Paper page

Cited by

See all 121

Metadata

Authors
Mercieca-Bebber, R., Palmer, M. J., Brundage, M., Calvert, M., Stockler, M. R., & King, M. T.
Venue
BMJ Open
Publisher
BMJ
Published
2016-06
Volume
6
Issue
6
Pages
e010938
ISSN
2044-6055
Cited by
121
References
11
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Design, implementation and reporting strategies to reduce the instance and impact of missing patient-reported outcome (PRO) data: a systematic review. https://app.cochat.ai/papers/10.1136/bmjopen-2015-010938
The paper
Mercieca-Bebber, R., Palmer, M. J., Brundage, M., Calvert, M., Stockler, M. R., & King, M. T. (2016). Design, implementation and reporting strategies to reduce the instance and impact of missing patient-reported outcome (PRO) data: a systematic review. BMJ Open. https://doi.org/10.1136/bmjopen-2015-010938

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.