Choosing important health outcomes for comparative effectiveness research: 5th annual update to a systematic review of core outcome sets for research
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
BACKGROUND: A systematic review of core outcome sets (COS) for research is updated annually to populate an online database. It is a resource intensive review to do annually but automation techniques have potential to aid the process. The production of guidance and standards in COS development means that there is now an expectation that COS are being developed and reported to a higher standard. This is the fifth update to the systematic review and will explore these issues. METHODS: Searches were carried out to identify studies published or indexed in 2018. Automated screening methods were used to rank the citations in order of relevance. The cut-off for screening was set to the top 25% in ranked priority order, following development and validation of the algorithm. Studies were eligible for inclusion if they reported the development of a COS, regardless of any restrictions by age, health condition or setting. COS were assessed against each of the Core Outcome Set-STAndards for Development (COS-STAD). RESULTS: Thirty studies describing the development of 44 COS were included in this update. Six COS (20%) were deemed to have met all 12 criteria representing the 11 minimum standards for COS development (range = 4 to 12 criteria, median = 10 criteria). All 30 COS studies met all four minimum standards for scope. Twenty-one (70%) COS met all three minimum standards for stakeholders. Twenty-three studies (77%) included patients with the condition or their representatives. The number of countries involved in the development of COS ranged from 1 to 39 (median = 10). Six studies (20%) met all four minimum standards [five criteria] for the consensus process. CONCLUSION: Automated ranking was successfully used to assist the screening process and reduce the workload of this systematic review update. With the provision of guidelines, COS are better reported and being developed to a higher standard.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The COMET Handbook: version 1.0
Williamson, P. R., Altman, D. G., Bagley, H., Barnes, K. L., Blazeby, J. M., Brookes, S. T., Clarke, M., Gargon, E., Gorst, S., Harman, N., et al. (2017) · Trials · doi:10.1186/s13063-017-1978-4 · Cited by 2,011 · cited 1×
“These sets represent the minimum that should be measured and reported in all clinical trials of a specific condition, and are suitable for use in clinical audit or research other than randomised trials [1].”
MethodSelf-citationCore Outcome Set-STAndards for Development: The COS-STAD recommendations
Kirkham, J. J., Davis, K., Altman, D. G., Blazeby, J. M., Clarke, M., Tunis, S., & Williamson, P. R. (2017) · PLOS Medicine · doi:10.1371/journal.pmed.1002447 · Cited by 792 · cited 2×
“The recently published standards for COS protocol items (COS-STAP) [9], combined with the standards for development [7] and reporting [8], should help facilitate this much needed improvement.”
MethodSelf-citationCore outcome set–STAndards for reporting: the COS-STAR statement
Kirkham, J. J., Gorst, S., Altman, D. G., Blazeby, J. M., Clarke, M., Devane, D., Gargon, E., Moher, D., Schmitt, J., Tugwell, P., et al. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002148 · Cited by 650 · cited 2×
“The recently published standards for COS protocol items (COS-STAP) [9], combined with the standards for development [7] and reporting [8], should help facilitate this much needed improvement.”
BackgroundSelf-citationGorst, S. L., Gargon, E., Clarke, M., Smith, V., & Williamson, P. R. (2016) · PLOS ONE · doi:10.1371/journal.pone.0168403 · Cited by 85
Self-citation
Cited by
Guidelines for Reporting Outcomes in Trial Protocols: The SPIRIT-Outcomes 2022 Extension
Butcher, N. J., Monsour, A., Mew, E. J., Chan, A.-W., Moher, D., Mayo-Wilson, E., Terwee, C. B., Chee-A-Tow, A., Baba, A., Gavin, F., et al. (2022) · JAMA · doi:10.1001/jama.2022.21243 · Cited by 288
Self-citationGarritty, C., Hamel, C., Trivella, M., Gartlehner, G., Nussbaumer-Streit, B., Devane, D., Kamel, C., Griebler, U., & King, V. J. (2024) · BMJ · doi:10.1136/bmj-2023-076335 · Cited by 260
Chevance, A., Ravaud, P., Tomlinson, A., Le Berre, C., Teufer, B., Touboul, S., Fried, E. I., Gartlehner, G., Cipriani, A., & Tran, V. T. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30191-7 · Cited by 193
A systematic review finds Core Outcome Set uptake varies widely across different areas of health
Hughes, K. L., Clarke, M., & Williamson, P. R. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.09.029 · Cited by 125
Self-citationCharacterizing the literature surrounding transportation of young dairy calves: A scoping review
Goetz, H. M., Winder, C. B., Costa, J. H. C., Creutzinger, K. C., Uyama, T., Kelton, D. F., Dunn, J., & Renaud, D. L. (2022) · Journal of Dairy Science · doi:10.3168/jds.2021-21211 · Cited by 32
Franzoi, D., Bockting, C. L., Bennett, K. F., Odom, A., Lucassen, P. J., Pathania, A., Lee, A., Brouwer, M. E., van de Schoot, R., Wiers, R. W., et al. (2024) · SSM - Population Health · doi:10.1016/j.ssmph.2023.101575 · Cited by 21
Analysis of responder-based endpoints: improving power through utilising continuous components
Wason, J., McMenamin, M., & Dodd, S. (2020) · Trials · doi:10.1186/s13063-020-04353-8 · Cited by 16
Byrne, F., Hofstee, L., Teijema, J., De Bruin, J., & van de Schoot, R. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02587-0 · Cited by 9
Metadata
- Authors
- Gargon, E., Gorst, S. L., & Williamson, P. R.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-12-12
- Volume
- 14
- Issue
- 12
- Pages
- e0225980
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2996342914
- Cited by
- 143
- References
- 4
- FWCI
- 7.16
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.