Patient-reported outcomes in meta-analyses – Part 1: assessing risk of bias and combining outcomes
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Systematic reviews and meta-analyses of randomized trials that include patient-reported outcomes (PROs) often provide crucial information for patients and clinicians facing challenging health care decisions. Based on emerging methods, guidance on combining PROs in meta-analysis is likely to enhance their usefulness.The objectives of this paper are: i) to describe PROs and why they are important for health care decision-making, ii) illustrate the key risk of bias issues that systematic reviewers should consider and, iii) address outcome characteristics of PROs and provide guidance for combining outcomes.We suggest a step-by-step approach to addressing issues of PROs in meta-analyses. Systematic reviewers should begin by asking themselves if trials have addressed all the important effects of treatment on patients' quality of life. If the trials have addressed PROs, have investigators chosen the appropriate instruments? In particular, does evidence suggest the PROs used are valid and responsive, and is the review free of outcome reporting bias? Systematic reviewers must then decide how to categorize PROs and when to pool results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What is ‘quality of evidence’ and why is it important to clinicians?
Guyatt, G. H., Oxman, A. D., Kunz, R., Vist, G. E., Falck-Ytter, Y., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39490.551019.be · Cited by 3,250 · cited 14×
“Suspicion about lack of ability to measure change is another potential reason for rating down the quality of evidence from a series of RCTs [9].”
BackgroundMethodInfluentialSelf-citationGRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798
Self-citationGRADE guidelines: 2. Framing the question and deciding on important outcomes
Guyatt, G. H., Oxman, A. D., Kunz, R., Atkins, D., Brozek, J., Vist, G., Alderson, P., Glasziou, P., Falck-Ytter, Y., & Schünemann, H. J. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.09.012 · Cited by 1,911 · cited 1×
“One of the recommendations from GRADE and from the GRADE-associated Cochrane Applicability and Recommendations Methods group is that reviewers should begin the review process by defining and listing all patient-important outcomes [10,12] that are relevant to their question, which will include PROs.”
MethodSelf-citationChan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 1×
“Methodologists have long suspected the existence of outcome reporting bias [21,22], and systematic investigations comparing RCT protocols and their subsequent publications have provided estimates of its magnitude [23-25].”
BackgroundKirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133 · cited 1×
“Methodologists have long suspected the existence of outcome reporting bias [21,22], and systematic investigations comparing RCT protocols and their subsequent publications have provided estimates of its magnitude [23-25].”
BackgroundPatrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., & Ring, L. (2011) · Value in Health · doi:10.1016/j.jval.2011.06.014 · Cited by 1,095 · cited 1×
“Content validity assessment involves patient and clinician evaluation of the importance and completeness of the content contained in the measures, usually obtained through qualitative research [18,19].”
BackgroundSelf-citationCognitive behavioural therapy for tinnitus
Martinez-Devesa, P., Perera, R., Theodoulou, M., & Waddell, A. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005233.pub3 · Cited by 477
Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research
Chan, A.-W. (2004) · Canadian Medical Association Journal · doi:10.1503/cmaj.1041086 · Cited by 444
Puhan, M. A., Soesilo, I., Guyatt, G. H., & Schünemann, H. J. (2006) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-4-94 · Cited by 101
Self-citationBusse, J. W., Montori, V. M., Krasnik, C., Patelis-Siotis, I., & Guyatt, G. H. (2009) · Psychotherapy and Psychosomatics · doi:10.1159/000162296 · Cited by 96
Self-citation
Cited by
Cannabis as a substitute for prescription drugs – a cross-sectional study
Corroon, J., Mischley, L., & Sexton, M. (2017) · Journal of Pain Research · doi:10.2147/jpr.s134330 · Cited by 208
“In addition, PROs are subject to reporting bias.(47,48) Another limitation of this study was the method by which prescription drug information was collected.”
Schuch, F. B., Vasconcelos-Moreno, M. P., Borowsky, C., Zimmermann, A. B., Rocha, N. S., & Fleck, M. P. (2015) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2014.11.005 · Cited by 130
Whitehead, L., Perkins, G. D., Clarey, A., & Haywood, K. L. (2015) · Resuscitation · doi:10.1016/j.resuscitation.2014.11.013 · Cited by 95
Wu, Y. (., McInnes, N., & Leong, Y. (2018) · Female Pelvic Medicine & Reconstructive Surgery · doi:10.1097/spv.0000000000000513 · Cited by 71
Dür, M., Steiner, G., Fialka-Moser, V., Kautzky-Willer, A., Dejaco, C., Prodinger, B., Stoffer, M. A., Binder, A., Smolen, J., & Stamm, T. A. (2014) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-12-45 · Cited by 59
“Background The use of self-reported outcome instruments in health care research has become increasingly important over the last decades, because the perspective of patients is an essential part regarding the effectiveness or non-effectiveness of a treatment [1-3].”
Background
Metadata
- Authors
- Johnston, B. C., Patrick, D. L., Busse, J. W., Schünemann, H. J., Agarwal, A., & Guyatt, G. H.
- Venue
- Health and Quality of Life Outcomes
- Published
- 2013
- Volume
- 11
- Issue
- 1
- Pages
- 109
- ISSN
- 1477-7525 (ISSN-L)
- OpenAlex
- W2142269413
- Cited by
- 93
- References
- 11
- FWCI
- 7.53
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Patient-reported outcomes in meta-analyses – Part 1: assessing risk of bias and combining outcomes. https://app.cochat.ai/papers/10.1186/1477-7525-11-109
- The paper
- Johnston, B. C., Patrick, D. L., Busse, J. W., Schünemann, H. J., Agarwal, A., & Guyatt, G. H. (2013). Patient-reported outcomes in meta-analyses – Part 1: assessing risk of bias and combining outcomes. Health and Quality of Life Outcomes. https://doi.org/10.1186/1477-7525-11-109
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.