Core Outcome Set–STAndards for Reporting: The COS-STAR Statement
Open accessThe DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Core outcome sets (COS) can enhance the relevance of research by ensuring that outcomes of importance to health service users and other people making choices about health care in a particular topic area are measured routinely. Over 200 COS to date have been developed, but the clarity of these reports is suboptimal. COS studies will not achieve their goal if reports of COS are not complete and transparent. METHODS AND FINDINGS: In recognition of these issues, an international group that included experienced COS developers, methodologists, journal editors, potential users of COS (clinical trialists, systematic reviewers, and clinical guideline developers), and patient representatives developed the Core Outcome Set-STAndards for Reporting (COS-STAR) Statement as a reporting guideline for COS studies. The developmental process consisted of an initial reporting item generation stage and a two-round Delphi survey involving nearly 200 participants representing key stakeholder groups, followed by a consensus meeting. The COS-STAR Statement consists of a checklist of 18 items considered essential for transparent and complete reporting in all COS studies. The checklist items focus on the introduction, methods, results, and discussion section of a manuscript describing the development of a particular COS. A limitation of the COS-STAR Statement is that it was developed without representative views of low- and middle-income countries. COS have equal relevance to studies conducted in these areas, and, subsequently, this guideline may need to evolve over time to encompass any additional challenges from developing COS in these areas. CONCLUSIONS: With many ongoing COS studies underway, the COS-STAR Statement should be a helpful resource to improve the reporting of COS studies for the benefit of all COS users.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“The protocol followed the COS-STAP statement (Kirkham et al., 2019), and the process followed modifications of the COS-STAD guidelines (Kirkham et al., 2016) and the COMET and OMERACT handbooks (Beaton et al., 2021;Williamson et al., 2017).”
From Relevant domains, core outcome sets and measurements for implant dentistry clinical trials: The Implant Dentistry Core Outcome Set and Measurement ( ID‐COSM) international consensus report (2023) · cites this paper as Kirkham et al., 2016
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The study protocol was published a priori 19 , along with the registration of VAPAIN in the Core Outcome Measures in Effectiveness Trials (COMET) database 7 .”
From Developing a core outcome domain set to assessing effectiveness of interdisciplinary multimodal pain therapy: the VAPAIN consensus statement on core outcome domains (2018) · cites this paper as [19]
Experimental — accuracy not yet measuredIn the citing paper
“1. IMPT patients have protracted, and ongoing, pain. Pain interferes with most life domains, thus changes in biopsychosocial aspects need to be considered when assessing therapies.”
In the citing paper
“2. The primary aim of IMPT is not reduction of pain in the first instance, but focusing on general improvements in physical, psychological, and social aspects according to patients' experience.”
In the citing paper
“The development process of this COS has been reported according to the Core Outcome Set – Standards for Reporting Statement (COS-STAR) (14).”
From Development of a Core Outcome Set for Studies Assessing Interventions for Diabetes-Related Foot Ulceration (2024) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“It follows a similar format to that used in other explanatory documents [10,11].”
MethodSelf-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Self-citationCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Self-citationCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Self-citationMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Self-citationCONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000251 · Cited by 2,296
Self-citationReddel, H. K., Taylor, D. R., Bateman, E. D., Boulet, L.-P., Boushey, H. A., Busse, W. W., Casale, T. B., Chanez, P., Enright, P. L., Gibson, P. G., et al. (2009) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200801-060st · Cited by 1,918
Developing core outcome sets for clinical trials: issues to consider
Williamson, P. R., Altman, D. G., Blazeby, J. M., Clarke, M., Devane, D., Gargon, E., & Tugwell, P. (2012) · Trials · doi:10.1186/1745-6215-13-132 · Cited by 1,661
Self-citationGuidance for Developers of Health Research Reporting Guidelines
Moher, D., Schulz, K. F., Simera, I., & Altman, D. G. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000217 · Cited by 1,437
Self-citation
Cited by
The COMET Handbook: version 1.0
Williamson, P. R., Altman, D. G., Bagley, H., Barnes, K. L., Blazeby, J. M., Brookes, S. T., Clarke, M., Gargon, E., Gorst, S., Harman, N., et al. (2017) · Trials · doi:10.1186/s13063-017-1978-4 · Cited by 2,011
“Until this is available it is recommended that reporting details of the process undertaken follows the recommended guidelines [142].”
MethodSelf-citationRegistries for Evaluating Patient Outcomes: A User’s Guide
(2020) · doi:10.23970/ahrqepcregistries4 · Cited by 960
Core Outcome Set-STAndards for Development: The COS-STAD recommendations
Kirkham, J. J., Davis, K., Altman, D. G., Blazeby, J. M., Clarke, M., Tunis, S., & Williamson, P. R. (2017) · PLOS Medicine · doi:10.1371/journal.pmed.1002447 · Cited by 792
“Participants were sent a personalised email outlining the project, together with a link to the survey, a copy of the COS-STAR reporting guideline [7], and the first update of a systematic review of COS studies [3].”
BackgroundMethodInfluentialSelf-citationGattrell, W. T., Logullo, P., van Zuuren, E. J., Price, A., Hughes, E. L., Blazey, P., Winchester, C. C., Tovey, D., Goldman, K., Hungin, A. P., et al. (2024) · PLOS Medicine · doi:10.1371/journal.pmed.1004326 · Cited by 701
“COS-STAR includes only 3 items around the definition of consensus and a “description of how the consensus process was undertaken” [28].”
MethodInterventions to improve the appropriate use of polypharmacy for older people
Rankin, A., Cadogan, C. A., Patterson, S. M., Kerse, N., Cardwell, C. R., Bradley, M. C., Ryan, C., & Hughes, C. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008165.pub4 · Cited by 511
Needham, D. M., Sepulveda, K. A., Dinglas, V. D., Chessare, C. M., Friedman, L. A., Bingham, C. O., & Turnbull, A. E. (2017) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201702-0372oc · Cited by 464
Core outcome measurement instruments for clinical trials in nonspecific low back pain
Chiarotto, A., Boers, M., Deyo, R. A., Buchbinder, R., Corbin, T. P., Costa, L. O. P., Foster, N. E., Grotle, M., Koes, B. W., Kovacs, F. M., et al. (2018) · Pain · doi:10.1097/j.pain.0000000000001117 · Cited by 461
Oram, S., Fisher, H. L., Minnis, H., Seedat, S., Walby, S., Hegarty, K., Rouf, K., Angénieux, C., Callard, F., Chandra, P. S., et al. (2022) · The Lancet Psychiatry · doi:10.1016/s2215-0366(22)00008-6 · Cited by 331
Core Outcome Set-STAndardised Protocol Items: the COS-STAP Statement
for the COS-STAP Group, Kirkham, J. J., Gorst, S., Altman, D. G., Blazeby, J. M., Clarke, M., Tunis, S., & Williamson, P. R. (2019) · Trials · doi:10.1186/s13063-019-3230-x · Cited by 264
Self-citationCore outcomes in neonatology: development of a core outcome set for neonatal research
Webbe, J. W. H., Duffy, J. M. N., Afonso, E., Al-Muzaffar, I., Brunton, G., Greenough, A., Hall, N. J., Knight, M., Latour, J. M., Lee-Davey, C., et al. (2020) · Archives of Disease in Childhood - Fetal and Neonatal Edition · doi:10.1136/archdischild-2019-317501 · Cited by 235
“The results of this core outcome set development are reported using COS-STAR reporting guidelines (44).”
MethodA Core Outcome Set for Multimorbidity Research (COSmm)
Smith, S. M., Wallace, E., Salisbury, C., Sasseville, M., Bayliss, E., & Fortin, M. (2018) · The Annals of Family Medicine · doi:10.1370/afm.2178 · Cited by 219
“We had 3 specific objectives: (1) to identify outcomes and outcome metrics that had previously been used in intervention studies for multimorbidity; (2) to develop a consensus-based set of core outcomes for intervention studies in multimorbidity; and (3) to describe related outcome metrics used for outcomes for multim…”
BackgroundA core domain set for hidradenitis suppurativa trial outcomes: an international Delphi process
Thorlacius, L., Ingram, J. R., Villumsen, B., Esmann, S., Kirby, J. S., Gottlieb, A. B., Merola, J. F., Dellavalle, R., Nielsen, S. M., Christensen, R., et al. (2018) · British Journal of Dermatology · doi:10.1111/bjd.16672 · Cited by 180
Interventions to improve the appropriate use of polypharmacy for older people
Cole, J. A., Gonçalves, D. C., Alqahtani, M., Barry, H. E., Cadogan, C. A., Rankin, A., Patterson, S. M., Kerse, N. M., Cardwell, C. R., Ryan, C. A., et al. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008165.pub5 · Cited by 229
Core outcome sets in women's and newborn health: a systematic review
Duffy, J., Rolph, R., Gale, C., Hirsch, M., Khan, K., Ziebland, S., McManus, R., & On behalf of the International Collaboration to Harmonise Outcomes in Pre‐eclampsia (iHOPE) (2017) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.14694 · Cited by 166
“Outcome Set-STAndards for Reporting: the COS-STAR statement, has recently 144 been published.(10) Two authors independently assessed reporting quality of each 145 each core outcome set using the statement’s 18 item checklist.”
BackgroundMethodInfluentialKim, A. H., Roberts, C. J., Feagan, B. G., Banerjee, R., Bemelman, W. A., Bodger, K., Derieppe, M., Dignass, A. U., Driscoll, R., Fitzpatrick, R. M., et al. (2017) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjx161 · Cited by 169
Kirkham, J. J., Clarke, M., & Williamson, P. R. (2017) · BMJ · doi:10.1136/bmj.j2262 · Cited by 146
Self-citationSpies, C., Krampe, H., Paul, N., Denke, C., Kiselev, J., Piper, S. K., Kruppa, J., Grunow, J. J., Steinecke, K., Gülmez, T., et al. (2020) · Journal of the Intensive Care Society · doi:10.1177/1751143720923597 · Cited by 152
Tong, A., Gill, J., Budde, K., Marson, L., Reese, P. P., Rosenbloom, D., Rostaing, L. P. E., Wong, G., Josephson, M. A., Pruett, T. L., et al. (2017) · Transplantation · doi:10.1097/tp.0000000000001774 · Cited by 151
“A core outcome set that reflects the priorities of patients and health professionals has been demonstrated to improve the relevance and reliability of clinical trials.(21-26) A core outcome set is a consensus-based standardized set of outcomes that should be reported, as a minimum, in all clinical trials in a specific…”
BackgroundGargon, E., Gorst, S. L., & Williamson, P. R. (2019) · PLOS ONE · doi:10.1371/journal.pone.0225980 · Cited by 143
“The recently published standards for COS protocol items (COS-STAP) [9], combined with the standards for development [7] and reporting [8], should help facilitate this much needed improvement.”
BackgroundSelf-citationBeuscart, J., Knol, W., Cullinan, S., Schneider, C., Dalleur, O., Boland, B. B., Thevelin, S., Jansen, P. A. F., O’Mahony, D., Rodondi, N., et al. (2018) · BMC Medicine · doi:10.1186/s12916-018-1007-9 · Cited by 144
“results according to COS-STAR guidelines [30].”
Kaiser, U., Kopkow, C., Deckert, S., Neustadt, K., Jacobi, L., Cameron, P., De Angelis, V., Apfelbacher, C., Arnold, B., Birch, J., et al. (2018) · Pain · doi:10.1097/j.pain.0000000000001129 · Cited by 119
Self-citationMeher, S., Cuthbert, A., Kirkham, J. J., Williamson, P. R., Abalos, E. J., Aflaifel, N. B., Bhutta, Z. A., Bishop, A., Blum, J., Collins, P. W., et al. (2018) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.15335 · Cited by 131
“10 ACKNOWLEDGEMENTS We would like to acknowledge (1) participants of the Delphi survey ( Appendix S2); (2) participants at the consensus meeting not in the authorship: Jim Neilson (chair), Joao Paulo Sou za, Halima Shakur, Beverely Hunt, Julie Nycyk, Steven Lane, Michelle Beacock, Helen Castledine, Carolyn Markham; (3…”
BackgroundSelf-citationRankin, A., Cadogan, C. A., Ryan, C. A., Clyne, B., Smith, S. M., & Hughes, C. M. (2018) · Journal of the American Geriatrics Society · doi:10.1111/jgs.15245 · Cited by 117
“The completed COS-STAR checklist is included in Table S2.(10)”
BackgroundMethodInfluentialGargon, E., Gorst, S. L., Harman, N. L., Smith, V., Matvienko-Sikar, K., & Williamson, P. R. (2018) · PLOS ONE · doi:10.1371/journal.pone.0209869 · Cited by 111
Self-citationTaillie, L. S., Rivera, J. A., Popkin, B. M., & Batis, C. (2017) · Preventive Medicine · doi:10.1016/j.ypmed.2017.07.009 · Cited by 108
A Core Outcome Set for Critical Care Ventilation Trials
Blackwood, B., Ringrow, S., Clarke, M. J., Marshall, J. C., Connolly, B. A., Rose, L., & McAuley, D. F. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003904 · Cited by 116
“Findings are reported according to accepted standards for reporting COS development (17).”
BackgroundSelf-citationTonetti, M. S., Sanz, M., Avila‐Ortiz, G., Berglundh, T., Cairo, F., Derks, J., Figuero, E., Graziani, F., Guerra, F., Heitz‐Mayfield, L., et al. (2023) · Journal of Clinical Periodontology · doi:10.1111/jcpe.13808 · Cited by 107
Core outcome sets for research and clinical practice
Chiarotto, A., Ostelo, R. W., Turk, D. C., Buchbinder, R., & Boers, M. (2017) · Brazilian Journal of Physical Therapy · doi:10.1016/j.bjpt.2017.03.001 · Cited by 108
Core Outcome Set for Clinical Trials on Coronavirus Disease 2019 (COS-COVID)
Jin, X., Pang, B., Zhang, J., Liu, Q., Yang, Z., Feng, J., Liu, X., Zhang, L., Wang, B., Huang, Y., et al. (2020) · Engineering · doi:10.1016/j.eng.2020.03.002 · Cited by 127
“This study was conducted and reported following the COMET Handbook, COS-STAD, and COS-STAR.”
InfluentialViecelli, A. K., Tong, A., O’Lone, E., Ju, A., Hanson, C. S., Sautenet, B., Craig, J. C., Manns, B., Howell, M., Chemla, E. S., et al. (2018) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2017.12.003 · Cited by 111
Self-citationTurnbull, A. E., Sepulveda, K. A., Dinglas, V. D., Chessare, C. M., Bingham, C. O., & Needham, D. M. (2017) · Critical Care Medicine · doi:10.1097/ccm.0000000000002435 · Cited by 100
Core Domain Set Selection According to OMERACT Filter 2.1: The OMERACT Methodology
Maxwell, L. J., Beaton, D. E., Shea, B. J., Wells, G. A., Boers, M., Grosskleg, S., Bingham, C. O., Conaghan, P. G., D’Agostino, M. A., de Wit, M., et al. (2019) · The Journal of Rheumatology · doi:10.3899/jrheum.181097 · Cited by 100
Self-citationReilly, S., Harding, A. J. E., Morbey, H., Ahmed, F., Williamson, P. R., Swarbrick, C., Leroi, I., Davies, L. M., Reeves, D., Holland, F., et al. (2020) · Age and Ageing · doi:10.1093/ageing/afaa015 · Cited by 108
“The reporting in this paper adheres to the COS reporting standards recommended [24].”
MethodSelf-citationPfinder, M., Heise, T. L., Boon, M. H., Pega, F., Fenton, C., Griebler, U., Gartlehner, G., Sommer, I., Katikireddi, S. V., & Lhachimi, S. K. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012333.pub2 · Cited by 107
Developing a core outcome set for fistulising perianal Crohn’s disease
Sahnan, K., Tozer, P. J., Adegbola, S. O., Lee, M. J., Heywood, N., McNair, A., Hind, D., Yassin, N., Lobo, A., Brown, S. R., et al. (2018) · Gut · doi:10.1136/gutjnl-2017-315503 · Cited by 101
Coulman, K. D., Hopkins, J. C. A., Brookes, S. T., Chalmers, K. A., Main, B., Owen‐Smith, A., Andrews, R. C., Byrne, J. P., Donovan, J., Mazza, G., et al. (2016) · PLoS Medicine · doi:10.1371/journal.pmed.1002187 · Cited by 106
“Item wording used for patient and professional consensus meetings is provided as supporting information (S3 Table).”
MethodInfluentialSelf-citationSantos, F. D., Drymiotou, S., Antequera, A., Mol, B. W., Gale, C. P., Devane, D., Hooft, J. V. ’., Johnson, M. J., Hogg, M., & Thangaratinam, S. (2018) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.15397 · Cited by 109
Self-citationKenny, K. P., Day, P. F., Sharif, M. O., Parashos, P., Lauridsen, E., Feldens, C. A., Cohenca, N., Skapetis, T., Levin, L., Kenny, D. J., et al. (2018) · Dental Traumatology · doi:10.1111/edt.12367 · Cited by 90
Tonetti, M. S., Sanz, M., Avila‐Ortiz, G., Berglundh, T., Cairo, F., Derks, J., Figuero, E., Graziani, F., Guerra, F., Heitz‐Mayfield, L., et al. (2023) · Clinical Oral Implants Research · doi:10.1111/clr.14074 · Cited by 89
“The protocol followed the COS-STAP statement (Kirkham et al., 2019), and the process followed modifications of the COS-STAD guidelines (Kirkham et al., 2016) and the COMET and OMERACT handbooks (Beaton et al., 2021; Williamson et al., 2017).”
Dodd, S., Gorst, S. L., Young, A., Lucas, S. W., & Williamson, P. R. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.03.022 · Cited by 81
Self-citationGorst, S. L., Gargon, E., Clarke, M., Smith, V., & Williamson, P. R. (2016) · PLOS ONE · doi:10.1371/journal.pone.0168403 · Cited by 85
“A reporting guideline including a checklist of 18 items has recently been developed to facilitate improved reporting of COS [10].”
MethodSelf-citationHopkins, C. L., Hettige, R., Soni‐Jaiswal, A., Lakhani, R., Carrie, S., Cervin, A., Douglas, R. G., Fokkens, W. J., Harvey, R. J., Hellings, P. W., et al. (2017) · Rhinology Journal · doi:10.4193/rhino17.247 · Cited by 92
Developing, implementing and disseminating a core outcome set for neonatal medicine
Webbe, J., Brunton, G., Ali, S., Duffy, J. M., Modi, N., & Gale, C. (2017) · BMJ Paediatrics Open · doi:10.1136/bmjpo-2017-000048 · Cited by 87
“The core outcome set will be reported in line with reporting guidelines.(27)”
MethodByrne, M., O’Connell, A., Egan, A. M., Dinneen, S. F., Hynes, L., O’Hara, M. C., Holt, R. I. G., Willaing, I., Vallis, M., Hendrieckx, C., et al. (2017) · Trials · doi:10.1186/s13063-017-2364-y · Cited by 82
“Within clinical trials research, there is growing awareness that insufficient attention has been paid to what outcome measures are selected [8].”
BackgroundResultHall, D. A., Smith, H. L., Hibbert, A., Colley, V., Haider, H. F., Horobin, A. J., Londero, A., Mazurek, B., Thacker, B., Fackrell, K., et al. (2018) · Trends in Hearing · doi:10.1177/2331216518814384 · Cited by 95
“The Core Outcome Domain Set has been developed using robust methodology in accordance with recommendations from the COMET initiative (Kirkham et al., 2016).”
MethodPogatzki-Zahn, E. M., Liedgens, H., Hummelshøj, L., Meißner, W., Weinmann, C., Treede, R., Vincent, K., Zahn, P. K., panel, T. I.-P. P. C., & Kaiser, U. (2021) · Pain · doi:10.1097/j.pain.0000000000002254 · Cited by 85
Davies, T. W., van Gassel, R. J. J., van de Poll, M., Gunst, J., Casaer, M. P., Christopher, K. B., Preiser, J. C., Hill, A., Gundogan, K., Reintam-Blaser, A., et al. (2022) · Critical Care · doi:10.1186/s13054-022-04113-x · Cited by 80
Use of core outcome sets was low in clinical trials published in major medical journals
Matvienko‐Sikar, K., AVERY, K. N. L., Blazeby, J. M., Devane, D., Dodd, S. R., Egan, A. M., Gorst, S. L., Hughes, K., Jacobsen, P. C., Kirkham, J. J., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.10.012 · Cited by 88
Self-citationYoung, A. E., Brookes, S. T., Avery, K. N. L., Davies, A., Metcalfe, C., & Blazeby, J. M. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.06.016 · Cited by 77
Self-citationGargon, E., Gorst, S. L., Matvienko‐Sikar, K., & Williamson, P. R. (2021) · PLoS ONE · doi:10.1371/journal.pone.0244878 · Cited by 78
“The reporting guideline for COS studies [19] was referenced in 39% of studies, less than the 60% in the previous update [6].”
MethodSelf-citationEhlers, L., Askling, J., Bijlsma, J. W. J., Cid, M. C., Cutolo, M., Dasgupta, B., Dejaco, C., Dixon, W. G., Feltelius, N., Finckh, A., et al. (2019) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2018-214755 · Cited by 76
Development of a core outcome set for use in routine orthodontic clinical trials
Tsichlaki, A., O'Brien, K., Benson, P. E., Marshman, Z., Johal, A., Colonio-Salazar, F. B., Harman, N. L., & Fleming, P. S. (2020) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2020.05.010 · Cited by 73
Moons, P., Norekvål, T. M., Arbelo, E., Borregaard, B., Casadei, B., Cosyns, B., Cowie, M., Fitzsimons, D., Fraser, A. G., Jaarsma, T., et al. (2023) · European Heart Journal · doi:10.1093/eurheartj/ehad514 · Cited by 80
Fish, R., Sanders, C., Adams, R., Brewer, J., Brookes, S. T., DeNardo, J., Kochhar, R., Saunders, M. P., Sebag‐Montefiore, D., Williamson, P. R., et al. (2018) · The Lancet. Gastroenterology & hepatology · doi:10.1016/s2468-1253(18)30264-4 · Cited by 81
Self-citationWomen’s experiences of maternity care in England: preliminary development of a standard measure
Redshaw, M., Martin, C. R., Savage-McGlynn, E., & Harrison, S. (2019) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-019-2284-9 · Cited by 72
Logullo, P., van Zuuren, E. J., Winchester, C., Tovey, D. I., Gattrell, W. T., Price, A. I., Harrison, N., Goldman, K., Chisholm, A., Walters, K., et al. (2024) · PLoS Medicine · doi:10.1371/journal.pmed.1004390 · Cited by 85
König, C., Matt, B., Kortgen, A., Turnbull, A. E., & Hartog, C. S. (2019) · Quality of Life Research · doi:10.1007/s11136-018-2028-8 · Cited by 71
Horbach, S. E. R., van der Horst, C. M. A. M., Blei, F., van der Vleuten, C. J. M., Frieden, I. J., Richter, G. T., Tan, S. T., Muir, T., Penington, A., Boon, L. M., et al. (2018) · British Journal of Dermatology · doi:10.1111/bjd.16029 · Cited by 76
A core outcome set for localised prostate cancer effectiveness trials
MacLennan, S., Williamson, P. R., Bekema, H., Campbell, M., Ramsay, C. R., N’Dow, J., MacLennan, S. J., Vale, L. D., Dahm, P., Mottet, N., et al. (2017) · British Journal of Urology · doi:10.1111/bju.13854 · Cited by 76
Self-citationOlivry, T., Bensignor, E. J., Favrot, C., Griffin, C. E., Hill, P. B., Mueller, R. S., Plant, J. D., & Williams, H. C. (2018) · BMC Veterinary Research · doi:10.1186/s12917-018-1569-y · Cited by 67
Williamson, P. R., Oliveira, R. D. Á., Clarke, M. J., Gorst, S. L., Hughes, K., Kirkham, J. J., Li, T., Saldanha, I. J., & Schmitt, J. M. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-036562 · Cited by 78
Self-citationRose, L., Burry, L. D., Agar, M. R., Campbell, N. L., Clarke, M. J., Lee, J. S., Marshall, J. C., Devlin, J. W., Blackwood, B., Needham, D. M., et al. (2021) · Critical Care Medicine · doi:10.1097/ccm.0000000000005028 · Cited by 69
“Symptoms such as pain and fatigue 3 (13)”
BackgroundMethodSelf-citationPatient participation in Delphi surveys to develop core outcome sets: systematic review
Barrington, H., Young, B., & Williamson, P. R. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-051066 · Cited by 66
Self-citationManera, K., Tong, A., Craig, J. C., Brown, E. A., Brunier, G., Dong, J., Dunning, T., Mehrotra, R., Naicker, S., Pecoits‐Filho, R., et al. (2017) · Peritoneal Dialysis International · doi:10.3747/pdi.2017.00022 · Cited by 72
“Kirkham JJ, Gorst S, Altman DG, Blazeby J, Clarke M, Devane D, et al. COS-STAR: a reporting guideline for studies developing core outcome sets (protocol).”
MethodInfluentialDavis, K., Gorst, S. L., Harman, N., Smith, V., Gargon, E., Altman, D. G., Blazeby, J. M., Clarke, M., Tunis, S., & Williamson, P. R. (2018) · PLOS ONE · doi:10.1371/journal.pone.0190695 · Cited by 65
Self-citationRadner, H., Chatzidionysiou, K., Nikiphorou, E., Gossec, L., Hyrich, K. L., Zabalan, C., van Eijk‐Hustings, Y., Williamson, P. R., Balanescu, A. R., Burmester, G. R., et al. (2018) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2017-212256 · Cited by 65
Self-citationMackenzie, R. M., Ells, L. J., Simpson, S. A., & Logue, J. (2019) · Obesity Reviews · doi:10.1111/obr.12961 · Cited by 66
Koot, M. H., Boelig, R. C., Hooft, J. V. ’., Limpens, J., Roseboom, T. J., Painter, R. C., & Grooten, I. J. (2018) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.15272 · Cited by 64
“domain: symptom severity Weight loss 9 (26) Weight loss(no further specification)49,58 9 (26) ≥3kg weight loss41 1 (3) ≥5 pound weight loss compared to pre-pregnancy weight51 1 (3) >5% of prepregnancy weight loss31,33,48,50,59 5 (15) Chapter 8”
BackgroundInfluentialAVERY, K. N. L., Chalmers, K. A., Brookes, S. T., Blencowe, N., Coulman, K. D., Whale, K., Metcalfe, C., & Blazeby, J. M. (2017) · Annals of Surgery · doi:10.1097/sla.0000000000002204 · Cited by 67
“Details of the COS development process are reported in accordance with recommendations of the Core Outcome Set-STAndards for Reporting (COS-STAR) checklist[14].”
MethodSelf-citationTong, A., Baumgart, A., Evangelidis, N., Viecelli, A. K., Carter, S. A., Azevedo, L. C. P., Cooper, T. E., Bersten, A. D., Cervantes, L., Chew, D. P., et al. (2021) · Critical Care Medicine · doi:10.1097/ccm.0000000000004817 · Cited by 72
Self-citationBiggane, A. M., Brading, L., Ravaud, P., Young, B., & Williamson, P. R. (2018) · Trials · doi:10.1186/s13063-018-2493-y · Cited by 74
“Full and accurate reporting of COS projects, including details of patient participation, should continue to improve if developers use the recently published COS-STAR reporting guideline [10].”
BackgroundMethodSelf-citationA roadmap to advance delirium research: Recommendations from the NIDUS Scientific Think Tank
Oh, E. S., Akeju, O., Avidan, M. S., Cunningham, C. M., Hayden, K. M., Jones, R. N., Khachaturian, A. S., Khan, B. A., Marcantonio, E. R., Needham, D. M., et al. (2020) · Alzheimer s & Dementia · doi:10.1002/alz.12076 · Cited by 65
Al Wattar, B. H., Teede, H., Garad, R., Franks, S., Balen, A., Bhide, P., Piltonen, T., Romualdi, D., Laven, J., Thondan, M., et al. (2020) · Human Reproduction · doi:10.1093/humrep/dez272 · Cited by 60
Vascular Access Outcomes Reported in Maintenance Hemodialysis Trials: A Systematic Review
Viecelli, A. K., O’Lone, E., Sautenet, B., Craig, J. C., Tong, A., Chemla, E. S., Hooi, L. S., Lee, T. C., Lok, C. E., Polkinghorne, K. R., et al. (2017) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2017.09.018 · Cited by 68
Navigating the landscape of core outcome set development in dermatology
Prinsen, C. A. C., Spuls, P. I., Kottner, J., Thomas, K. S., Apfelbacher, C., Chalmers, J. R., Deckert, S., Furue, M., Gerbens, L. A. A., Kirkham, J. J., et al. (2019) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2019.03.009 · Cited by 67
“20,21,23,25,33,38,39 Based on the HOME roadmap, the CS-COUSIN methods group has developed guidance on how to develop COS for skin disease 40 , including a flow diagram for the domain development process and one for the outcome measurement instrument selection/development process (Figures 1 and 2).”
Self-citationEgan, A. M., Galjaard, S., Maresh, M., Loeken, M. R., Napoli, A., Anastasiou, E., Noctor, E., de Valk, H. W., van Poppel, M. N. M., Todd, M., et al. (2017) · Diabetologia · doi:10.1007/s00125-017-4277-4 · Cited by 62
Self-citationComposing a new song for trials: the Standardized Outcomes in Nephrology (SONG) initiative
Tong, A., Craig, J. C., Nagler, E. V., Biesen, W. V., Manns, B., Hemmelgarn, B. R., Wheeler, D. C., Gill, J., Tugwell, P., Pecoits‐Filho, R., et al. (2017) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfx288 · Cited by 64
Self-citationButcher, N. J., Monsour, A., Mew, E. J., Szatmari, P., Pierro, A., Kelly, L. E., Farid-Kapadia, M., Chee-a-tow, A., Saeed, L., Monga, S., et al. (2019) · Trials · doi:10.1186/s13063-019-3248-0 · Cited by 57
Self-citationHarding, A. J. E., Morbey, H., Ahmed, F., Opdebeeck, C., Lasrado, R., Williamson, P. R., Swarbrick, C., Leroi, I., Challis, D., Hellström, I., et al. (2019) · BMC Geriatrics · doi:10.1186/s12877-019-1103-5 · Cited by 69
“The clarity and transparency of COS reporting is described in a recent review as suboptimal [25] and the important initial phase of developing the ‘long-list’ often goes under reported.”
BackgroundSelf-citationHealy, P., Gordijn, S. J., Ganzevoort, W., Beune, I. M., Baschat, A., Khalil, A. A., Kenny, L. C., Bloomfield, F. H., Daly, M. C., Kirkham, J. J., et al. (2019) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2019.05.039 · Cited by 67
Self-citationHarman, N., Wilding, J. P. H., Curry, D., Harris, J., Logue, J., Pemberton, R., Perreault, L., Thompson, G., Tunis, S., & Williamson, P. R. (2019) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2019-000700 · Cited by 61
“39”
Self-citationRamsey, I., Eckert, M. C., Hutchinson, A. D., Marker, J., & Corsini, N. (2020) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-020-00244-3 · Cited by 60
“Members of the COMET and OMERACT teams led the development of standards for COS study design (COSSTAD) [9], protocol items (COS-STAP) [10], and reporting (COS-STAR) [9], and guidelines for selecting instruments for a COS (the latter in collaboration with the Consensus-based Standards for the Selection of Measurement I…”
BackgroundMethodInfluentialMathioudakis, A. G., Abroug, F., Agustí, A. G. N., Ananth, S., Bakke, P. S., Bartziokas, Κ., Beghé, B., Bikov, A., Bradbury, T., Brusselle, G., et al. (2021) · European Respiratory Journal · doi:10.1183/13993003.02006-2021 · Cited by 63
Self-citationA core outcome set for hyperemesis gravidarum research: an international consensus study
Jansen, L., Koot, M. H., Hooft, J. V. ’., Dean, C., Duffy, J. M., Ganzevoort, W., Gauw, N., van der Goes, B. Y., Rodenburg, J., Roseboom, T. J., et al. (2020) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.16172 · Cited by 61
A survey of knowledge, perceptions and use of core outcome sets among clinical trialists
Bellucci, C., Hughes, K., Toomey, E. C., Williamson, P. R., & Matvienko‐Sikar, K. (2021) · Trials · doi:10.1186/s13063-021-05891-5 · Cited by 63
“Published guidelines further support COS development and reporting, including the COMET Handbook (Version 1) [1], the Core Outcome Set-STAndards for Development (COS-STAD) [11], the Core Outcome Set STAndardised Protocol Statement (COS-STAP) [19], and the Core Outcome Set STAndards for Reporting (COS-STAR) [20].”
MethodInfluentialSelf-citationBova, G., Domenichiello, A., Letzen, J. E., Rosenberger, D. C., Siddons, A., Kaiser, U., Anicich, A., Baron, R., Birch, J., Bouhassira, D., et al. (2023) · eClinicalMedicine · doi:10.1016/j.eclinm.2023.102340 · Cited by 56
Self-citationBrown, V., Moodie, M., Sultana, M., Hunter, K. E., Byrne, R., Seidler, A. L., Golley, R. K., Taylor, R. W., Hesketh, K. D., & Matvienko‐Sikar, K. (2022) · International Journal of Obesity · doi:10.1038/s41366-022-01198-w · Cited by 57
“Reporting of the COS follows the Core Outcome SetSTAndards for Reporting (COS-STAR Statement; Supplementary Table S1) [13].”
MethodAmbler, G. K., Brookes‐Howell, L., Jones, J. A. R., Verma, N., Bosanquet, D. C., Thomas‐Jones, E., Edwards, A., & Twine, C. P. (2020) · European Journal of Vascular and Endovascular Surgery · doi:10.1016/j.ejvs.2020.06.021 · Cited by 58
“We followed the COS-STAR checklist for reporting.(11)”
Wang, J., Alli, A. S., Clark, S. N., Hughes, A., Ezzati, M., Beddows, A. V., Vallarino, J., Nimo, J., Moses, J. B., Baah, S., et al. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.149931 · Cited by 54
Sultan, P., George, R., Weiniger, C. F., El-Boghdadly, K., Pandal, P., Carvalho, B., & CRADLE Study Investigators (2022) · Anesthesiology · doi:10.1097/aln.0000000000004263 · Cited by 52
“org/ Studies/Details/1728) and follows the Core Outcome Set-Standards for Development and Core Outcome Set-Standards for Reporting recommendations.(11,12) This study received institutional review board exemption from Stanford University (Stanford, California; No.”
MethodConnolly, B. A., Denehy, L., Hart, N., Pattison, N. A., Williamson, P. R., & Blackwood, B. (2018) · Trials · doi:10.1186/s13063-018-2678-4 · Cited by 55
“(DOCX 13 kb) Abbreviations COMET: Core Outcome Measures in Effectiveness Trials; COS: Core outcome set; COSMIN: COnsensus-based Standards for the selection of health Measurement INstruments; COS-STAD: Core Outcome Set – STAndards for Development; COS-STAR: Core Outcome Set – STAndards for Reporting; GRADE: Grading of…”
MethodSelf-citationLee, E. S., Koh, H. L., Ho, E. Q.-Y., Teo, S. H., Wong, F. Y., Ryan, B. L., Fortin, M., & Stewart, M. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-041219 · Cited by 65
MacLennan, S., Kirkham, J. J., Lam, T. B. L., & Williamson, P. R. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.09.024 · Cited by 59
Self-citationAlli, A. S., Clark, S. N., Hughes, A., Nimo, J., Moses, J. B., Baah, S., Wang, J., Vallarino, J., Agyemang, E., Barratt, B., et al. (2021) · Environmental Research Letters · doi:10.1088/1748-9326/ac074a · Cited by 55
Hodgson, C. L., Burrell, A. J. C., Engeler, D. M., Pellegrino, V. A., Brodie, D., & Fan, E. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003954 · Cited by 51
“None of the above 7 (19) 0 (0) 0 (0) 0 (0) 1 (25) 6 (100)”
MethodInfluentialCore Outcome Set for Actinic Keratosis Clinical Trials
Reynolds, K. A., Schlessinger, D. I., Vasić, J., Iyengar, S., Qaseem, Y., Behshad, R., DeHoratius, D. M., Denes, P., Drucker, A. M., DZUBOW, L. M., et al. (2020) · JAMA Dermatology · doi:10.1001/jamadermatol.2019.4212 · Cited by 49
Self-citationPellis, L., Cauchemez, S., Ferguson, N. M., & Fraser, C. (2020) · Nature Communications · doi:10.1038/s41467-019-14229-4 · Cited by 61
McCann, L. J., Pilkington, C., Huber, A. M., Ravelli, A., Appelbe, D. E., Kirkham, J. J., Williamson, P. R., Aggarwal, A., Christopher‐Stine, L., Constantin, T., et al. (2017) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2017-212141 · Cited by 48
Self-citationAirway management research: a systematic review
Ahmad, I., Onwochei, D. N., Muldoon, S., Keane, O., & El‐Boghdadly, K. (2018) · Anaesthesia · doi:10.1111/anae.14471 · Cited by 54
Crudgington, H., Rogers, M., Bray, L., Carter, B., Currier, J., Dunkley, C., Gibbon, F. M., Hughes, D. A., Lyle, S., Roberts, D., et al. (2019) · Epilepsia · doi:10.1111/epi.14735 · Cited by 50
Metadata
- Authors
- Kirkham, J. J., Gorst, S., Altman, D. G., Blazeby, J. M., Clarke, M., Devane, D., Gargon, E., Moher, D., Schmitt, J., Tugwell, P., Tunis, S., & Williamson, P. R.
- Affiliations
- University of Liverpool (GB)
- University of Oxford (GB)
- University of Bristol (GB)
- Queen's University Belfast (GB)
- Ollscoil na Gaillimhe – University of Galway (IE)
- Ottawa Hospital Research Institute (CA)
- Zentrum für Evidenzbasierte Gesundheitsversorgung (DE)
- University of Ottawa (CA)
- Center for Medical Technology Policy (US)
- Corresponding author
- Williamson, Paula R.
- ORCID
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-10-18
- Volume
- 13
- Issue
- 10
- Pages
- e1002148
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC5068732
- OpenAlex
- W2534322213
- Cited by
- 650
- References
- 25
- Citations by year
- 2026: 63 · 2025: 89 · 2024: 75 · 2023: 63 · 2022: 83 · 2021: 71 · 2020: 69 · 2019: 50 · 2018: 47 · 2017: 38 · 2016: 2
- FWCI
- 130.58
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Research Explorer (The University of Manchester) (submittedVersion, other-oa)
- Research Portal (Queen's University Belfast) (submittedVersion, cc-by)
- Bristol Research (University of Bristol) (submittedVersion, cc-by)
- Explore Bristol Research (submittedVersion, cc-by)
- Funders
- Cincinnati Children's Hospital Medical Center
- University of Minnesota
- Loyola University Chicago
- University of Washington
- McGill University
- Shandong University
- National Institute for Health and Care Excellence
- Health Research Board (TMRN-2014-1)
- Sidra Medicine
- Cancer Research UK (16895)
- National Institute for Health and Care Research (NF-SI-0513-10025)
- University of Warwick
- University of Bath
- University of Bristol
- Trinity College Dublin
- Universitat de València
- Tampereen Yliopisto
- Universidad de Chile
- Université François-Rabelais
- Université de Versailles Saint-Quentin-en-Yvelines
- Medical Research Council (MR/L004933/1, MR/L004933/2, MR/K025635/1)
- Topics
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- core outcome set, reporting guidelines, reporting transparency, outcome measurement, stakeholder engagement, Delphi consensus, low- and middle-income countries, healthcare decision-making
- MeSH terms
- Consensus Development Conferences as Topic, Consensus Statements as Topic, Review Literature as Topic, Outcome Assessment, Health Care, Guidelines as Topic, Biomedical Research, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.