CoChat

Study protocol for developing, piloting and disseminating the PRISMA-COSMIN guideline: a new reporting guideline for systematic reviews of outcome measurement instruments

Open access
Elsman, Ellen B. M., Butcher, Nancy J., Mokkink, Lidwine B., Terwee, Caroline B., Tricco, Andrea, Gagnier, Joel J., Aiyegbusi, Olalekan Lee, Barnett, Carolina, Smith, Maureen, Moher, David, Offringa, Martin · 2022 · Systematic Reviews
Cited by 68

The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.

Abstract

Background: Systematic reviews of outcome measurement instruments are important tools in the evidence-based selection of these instruments. COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) has developed a comprehensive and widespread guideline to conduct systematic reviews of outcome measurement instruments, but key information is often missing in published reviews. This hinders the appraisal of the quality of outcome measurement instruments, impacts the decisions of knowledge users regarding their appropriateness, and compromises reproducibility and interpretability of the reviews’ findings. To facilitate sufficient, transparent, and consistent reporting of systematic reviews of outcome measurement instruments, an extension of the PRISMA (Preferred Reporting of Items for Systematic reviews and Meta-Analyses) 2020 guideline will be developed: the PRISMA-COSMIN guideline. Methods: The PRISMA-COSMIN guideline will be developed in accordance with recommendations for reporting guideline development from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network. First, a candidate reporting item list will be created through an environmental literature scan and expert consultations. Second, an international Delphi study will be conducted with systematic review authors, biostatisticians, epidemiologists, psychometricians/clinimetricians, reporting guideline developers, journal editors as well as patients, caregivers, and members of the public. Delphi panelists will rate candidate items for inclusion on a 5-point scale, suggest additional candidate items, and give feedback on item wording and comprehensibility. Third, the draft PRISMA-COSMIN guideline and user manual will be iteratively piloted by applying it to systematic reviews in several disease areas to assess its relevance, comprehensiveness, and comprehensibility, along with usability and user satisfaction. Fourth, a consensus meeting will be held to finalize the PRISMA-COSMIN guideline through roundtable discussions and voting. Last, a user manual will be developed and the final PRISMA-COSMIN guideline will be disseminated through publications, conferences, newsletters, and relevant websites. Additionally, relevant journals and organizations will be invited to endorse and implement PRISMA-COSMIN. Throughout the project, evaluations will take place to identify barriers and facilitators of involving patient/public partners and employing a virtual process. Discussion: The PRISMA-COSMIN guideline will ensure that the reports of systematic reviews of outcome measurement instruments are complete and informative, enhancing their reproducibility, ease of use, and uptake.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13643-022-01994-5

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 21 references

Research works printed but not linked: 39

  1. Nelson EC, Eftimovska E, Lind C, Hager A, Wasson JH, Lindblad S. Patient reported outcome measures in practice. BMJ. 2015;350:g7818. · DOI · Paper page
  2. Mew EJ, Monsour A, Saeed L, Santos L, Patel S, Courtney DB, et al. Systematic scoping review identifies heterogeneity in outcomes measured in adolescent depression clinical trials. J Clin Epidemiol. 2020;126:71–9. · DOI
  3. Ardestani SK, Karkhaneh M, Yu HC, Hydrie MZI, Vohra S. Primary outcomes reporting in trials of paediatric type 1 diabetes mellitus: a systematic review. BMJ Open. 2017;7(12):e014610. · DOI
  4. Webbe JWH, Ali S, Sakonidou S, Webbe T, Duffy JM, Brunton G, et al. Inconsistent outcome reporting in large neonatal trials: a systematic review. Arch Dis Child Fetal Neonatal Ed. 2020;105(1):69–75. · DOI
  5. Page MJ, McKenzie JE, Green SE, Beaton DE, Jain NB, Lenza M, et al. Core domain and outcome measurement sets for shoulder pain trials are needed: systematic review of physical therapy trials. J Clin Epidemiol. 2015;68(11):1270–81. · DOI
  6. Terwee CB, Prinsen CA, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, et al. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual Life Res. 2018;27(5):1159–70. · DOI · Paper page
  7. Lorente S, Viladrich C, Vives J, Losilla J-M. Tools to assess the measurement properties of quality of life instruments: a meta-review. BMJ Open. 2020;10(8):e036038. · DOI
  8. Terwee CB, Prinsen C, Garotti MR, Suman A, De Vet H, Mokkink LB. The quality of systematic reviews of health-related outcome measurement instruments. Qual Life Res. 2016;25(4):767–79. · DOI · Paper page
  9. Kottner J, Audigé L, Brorson S, Donner A, Gajewski BJ, Hróbjartsson A, et al. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Int J Nurs Stud. 2011;48(6):661–71. · DOI · Paper page
  10. Staquet M, Berzon R, Osoba D, Machin D. Guidelines for reporting results of quality of life assessments in clinical trials. Qual Life Res. 1996;5(5):496–502. · DOI · Paper page
  11. Revicki DA, Erickson PA, Sloan JA, Dueck A, Guess H, Santanello NC, et al. Interpreting and reporting results based on patient-reported outcomes. Value Health. 2007;10:S116–S24. · DOI
  12. Calvert M, Blazeby J, Altman DG, Revicki DA, Moher D, Brundage MD, et al. Reporting of patient-reported outcomes in randomized trials: the CONSORT PRO extension. JAMA. 2013;309(8):814–22. · DOI · Paper page
  13. FDA. Guidance for Industry - patient-reported outcome measures: use in medical product development to support labeling claims: U.S. Department of Health and Human Services Food and Drug Administration; 2009.
  14. Reeve BB, Wyrwich KW, Wu AW, Velikova G, Terwee CB, Snyder CF, et al. ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Qual Life Res. 2013;22(8):1889–905. · DOI · Paper page
  15. OMERACT. The OMERACT handbook for establishing and implementing core outcomes in clinical trials across the spectrum of rheumatologic conditions. Ottawa: OMERACT; 2021.
  16. NQF. Guidance for Measure Testing and Evaluating Scientific Acceptability of Measure Properties. Washington DC: National Quality Forum; 2011.
  17. Lohr KN. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11(3):193–205. · DOI · Paper page
  18. Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349. https://doi.org/10.1136/bmj.g7647. · DOI · Paper page
  19. Morton S, Berg A, Levit L, Eden J. Standards for Reporting Systematic Reviews. Finding what works in health care: standards for systematic reviews. Washington DC: Institute of Medicine; 2011.
  20. PCORI. Draft final research report: instructions for awardee. Washington DC: Patient-centered Outcomes Research Institute; 2021.
  21. AHRQ. Methods guide for effectiveness and comparative effectiveness reviews. Rockville: Agency for Healthcare Research and Quality; 2019. Contract No.: 10(14)-EHC063-EF
  22. CRD. CRD’s guidance for undertaking reviews in health care. York: Centre for Reviews and Dissemination; 2009.
  23. Higgins J, Lasserson T, Chandles J, Tovey D, Flemyng E, Churchill R. Methodological expectations of cochrane intervention reviews. London: Cochrane; 2021.
  24. Stephenson M, Riitano D, Wilson S, Leonardi-Bee J, Mabire C, Cooper K, et al. Chapter 12: Systematic reviews of measurement properties. In: Aromataris E, Munn Z, editors. JBI Manual for Evidence Synthesis. Adelaide: JBI; 2020. · doi:10.46658/jbirm-19-03
  25. Gagnier JJ, Lai J, Mokkink LB, Terwee CB. COSMIN reporting guideline for studies on measurement properties of patient-reported outcome measures. Qual Life Res. 2021;30(8):2197–219. https://doi.org/10.1007/s11136-021-02822-4. · DOI · Paper page
  26. Moher D, Schulz KF, Simera I, Altman DG. Guidance for developers of health research reporting guidelines. PLoS Med. 2010;7(2):e1000217. · DOI · Paper page
  27. Butcher NJ, Mew EJ, Monsour A, Chan A-W, Moher D, Offringa M. Outcome reporting recommendations for clinical trial protocols and reports: a scoping review. Trials. 2020;21(1):1–17. · DOI · Paper page
  28. Elsman EB, Mokkink LB, Langendoen-Gort M, Rutters F, Beulens JW, Elders P et al. Systematic review on the measurement properties of diabetes-specific patient-reported outcome measures (PROMs) for measuring physical functioning in people with type 2 diabetes 2021.
  29. Abma IL, Butje BJ, Peter M, van der Wees PJ. Measurement properties of the Dutch–Flemish patient-reported outcomes measurement information system (PROMIS) physical function item bank and instruments: a systematic review. Health Qual Life Outcomes. 2021;19(1):1–22. · DOI
  30. Mehdipour A, Wiley E, Richardson J, Beauchamp M, Kuspinar A. The performance of digital monitoring devices for oxygen saturation and respiratory rate in COPD: A Systematic Review. COPD. 2021;18(4):469–75. · DOI
  31. Powell C. The Delphi technique: myths and realities. J Adv Nurs. 2003;41(4):376–82. · DOI · Paper page
  32. Moore CM. Group techniques for idea building. Newbury Park: Sage Publications, Inc; 1987.
  33. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81. · DOI · Paper page
  34. Bavelaar L, van Tol LS, Caljouw MA, van der Steen JT. Nederlandse vertaling en eerste stappen in validatie van de PPEET om burger-en patiëntenparticipatie te evalueren. Tijdschrift voor Gezondheidswetenschappen. 2021;99:146–53. https://doi.org/10.1007/s12508-021-00316-9. · DOI
  35. Abelson J, Li K, Wilson G, Shields K, Schneider C, Boesveld S. Supporting quality public and patient engagement in health system organizations: development and usability testing of the P ublic and P atient E ngagement E valuation T ool. Health Expect. 2016;19(4):817–27. · DOI · Paper page
  36. Hamilton CB, Hoens AM, McQuitty S, McKinnon AM, English K, Backman CL, et al. Development and pre-testing of the Patient Engagement In Research Scale (PEIRS) to assess the quality of engagement from a patient perspective. PLoS One. 2018;13(11):e0206588. · DOI
  37. Tariman JD, Berry DL, Halpenny B, Wolpin S, Schepp K. Validation and testing of the Acceptability E-scale for web-based patient-reported outcomes in cancer care. Appl Nurs Res. 2011;24(1):53–8. · DOI · Paper page
  38. Wiercioch W, Akl EA, Santesso N, Zhang Y, Morgan RL, Yepes-Nuñez JJ, et al. Assessing the process and outcome of the development of practice guidelines and recommendations: PANELVIEW instrument development. CMAJ. 2020;192(40):E1138–E45. · DOI
  39. Korbel JO, Stegle O. Effects of the COVID-19 pandemic on life scientists. Genome Biol. 2020;21:113. https://doi.org/10.1186/s13059-020-02031-1. · DOI

Cited by

See all 68

Metadata

Authors
Elsman, E. B. M., Butcher, N. J., Mokkink, L. B., Terwee, C. B., Tricco, A., Gagnier, J. J., Aiyegbusi, O. L., Barnett, C., Smith, M., Moher, D., & Offringa, M.
Venue
Systematic Reviews
Published
2022-06-13
Volume
11
Issue
1
Pages
121-121
ISSN
2046-4053 (ISSN-L)
OpenAlex
W4282575515
Cited by
68
References
21
FWCI
6.31
Type
journal article
Language
en
Open access
gold
Licence
Funders
Canadian Institutes of Health Research (452145)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Study protocol for developing, piloting and disseminating the PRISMA-COSMIN guideline: a new reporting guideline for systematic reviews of outcome measurement instruments. https://app.cochat.ai/papers/10.1186/s13643-022-01994-5
The paper
Elsman, E. B. M., Butcher, N. J., Mokkink, L. B., Terwee, C. B., Tricco, A., Gagnier, J. J., Aiyegbusi, O. L., Barnett, C., Smith, M., Moher, D., & Offringa, M. (2022). Study protocol for developing, piloting and disseminating the PRISMA-COSMIN guideline: a new reporting guideline for systematic reviews of outcome measurement instruments. Systematic Reviews. https://doi.org/10.1186/s13643-022-01994-5

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.