A systematic scoping review of adherence to reporting guidelines in health care literature
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Reporting guidelines have been available for the past 17 years since the inception of the Consolidated Standards of Reporting Trials statement in 1996. These guidelines were developed to improve the quality of reporting of studies in medical literature. Despite the widespread availability of these guidelines, the quality of reporting of medical literature remained suboptimal. In this study, we assess the current adherence practice to reporting guidelines; determine key factors associated with better adherence to these guidelines; and provide recommendations to enhance adherence to reporting guidelines for future studies. METHODS: We undertook a systematic scoping review of systematic reviews of adherence to reporting guidelines across different clinical areas and study designs. We searched four electronic databases (Cumulative Index to Nursing and Allied Health Literature, Web of Science, Embase, and Medline) from January 1996 to September 2012. Studies were included if they addressed adherence to one of the following guidelines: Consolidated Standards of Reporting Trials (CONSORT), Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), Quality of Reporting of Meta-analysis (QUOROM), Transparent Reporting of Evaluations with Nonrandomized Designs (TREND), Meta-analysis Of Observational Studies in Epidemiology (MOOSE) and Strengthening the Reporting of Observational Studies in Epidemiology (STROBE). A protocol for this study was devised. A literature search, data extraction, and quality assessment were performed independently by two authors in duplicate. This study reporting follows the PRISMA guidelines. RESULTS: Our search retrieved 5159 titles, of which 50 were eligible. Overall, 86.0% of studies reported suboptimal levels of adherence to reporting guidelines. Factors associated with better adherence included journal impact factor and endorsement of guidelines, publication date, funding source, multisite studies, pharmacological interventions and larger studies. CONCLUSION: Reporting guidelines in the clinical literature are important to improve the standards of reporting of clinical studies; however, adherence to these guidelines remains suboptimal. Action is therefore needed to enhance the adherence to these standards. Strategies to enhance adherence include journal editorial policies endorsing these guidelines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Italian Journal of Public Health · doi:10.2427/5768 · Cited by 3,374
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000251 · Cited by 2,296
Cited by
Page, M. J., & Moher, D. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0663-8 · Cited by 769
“the extent to which SRs comply with each item in the statement) [35, 36].”
BackgroundMethodGuidelines for reporting meta-epidemiological methodology research
Murad, M. H., & Wang, Z. (2017) · Evidence Based Medicine · doi:10.1136/ebmed-2017-110713 · Cited by 515
“Adherence across all reporting guidelines was estimated to be 86% in another study.(19) Evaluation of the instructions given to authors shows that PRISMA guidance was referenced only in 13% of gastroenterology and hepatology journals.”
MethodThabane, L., Hopewell, S., Lancaster, G. A., Bond, C. M., Coleman, C. L., Campbell, M. J., & Eldridge, S. M. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0065-z · Cited by 216
“It has been shown that formal endorsement of a guideline by journals is a strong determinant of its adoption and subsequent adherence to it [27].”
BackgroundSelf-citationDechartres, A., Trinquart, L., Atal, I., Moher, D., Dickersin, K., Boutron, I., Perrodeau, E., Altman, D. G., & Ravaud, P. (2017) · BMJ · doi:10.1136/bmj.j2490 · Cited by 171
Reporting guidelines in medical artificial intelligence: a systematic review and meta-analysis
Kolbinger, F. R., Veldhuizen, G. P., Zhu, J., Truhn, D., & Kather, J. N. (2024) · Communications Medicine · doi:10.1038/s43856-024-00492-0 · Cited by 160
Scoping review on interventions to improve adherence to reporting guidelines in health research
Blanco, D., Altman, D., Moher, D., Boutron, I., Kirkham, J. J., & Cobo, E. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026589 · Cited by 154
“Later on, research ethics boards may require that protocols submitted for ethical approval clearly state which RGs the study will be using based on the study design, and that RG checklists are part of the application for ethics approval.(11) Funders Figure 2 Typology of interventions to improve adherence to RGs accord…”
BackgroundMethodJin, Y., Sanger, N., Shams, I., Luo, C., Shahid, H., Li, G., Bhatt, M., Zielinski, L., Bantoto, B., Wang, M., et al. (2018) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s155103 · Cited by 134
“availability of the primary studies’ characteristics similar to a previously reported study.(7) Items 5 and 6 were evaluated”
InfluentialSelf-citationTricco, A. C., Zarin, W., Ghassemi, M., Nincic, V., Lillie, E., Page, M. J., Shamseer, L., Antony, J., Rios, P., Hwee, J., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.014 · Cited by 122
Testosterone suppression in opioid users: A systematic review and meta-analysis
Bawor, M., Bami, H., Dennis, B. B., Plater, C., Worster, A., Varenbut, M., Daiter, J., Marsh, D. C., Steiner, M., Anglin, R., et al. (2015) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.01.038 · Cited by 123
“After the introduction of the Consolidated Standards of Reporting Trials (CONSORT) statement and later its multiple extensions in 1996, as well as the gradual uptake of these statements by journals, reporting standards have improved (Samaan et al., 2013).”
MethodSelf-citationKorevaar, D. A., van Enst, W. A., Spijker, R., Bossuyt, P. M. M., & Hooft, L. (2014) · Evidence Based Medicine · doi:10.1136/eb-2013-101637 · Cited by 119
Reporting Diagnostic Accuracy Studies: Some Improvements after 10 Years of STARD
Korevaar, D. A., Wang, J., van Enst, W. A., Leeflang, M. M., Hooft, L., Smidt, N., & Bossuyt, P. M. M. (2015) · Radiology · doi:10.1148/radiol.14141160 · Cited by 110
Empirical evaluation of which trial characteristics are associated with treatment effect estimates
Dechartres, A., Trinquart, L., Faber, T., & Ravaud, P. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.005 · Cited by 85
“Although this focus does not give a representative view of clinical research, this choice may be explained by these reviews being more likely to address important questions for readers and to have better methodological quality [94,95] and reporting [96], which facilitates the ME process.”
BackgroundMbuagbaw, L., Thabane, M., Vanniyasingam, T., Debono, V. B., Kosa, S., Zhang, S., Ye, C., Parpia, S., Dennis, B. B., & Thabane, L. (2014) · Contemporary Clinical Trials · doi:10.1016/j.cct.2014.05.012 · Cited by 77
Self-citationWalsh, S., Jones, M., Bressington, D., McKenna, L., Brown, E., Terhaag, S., Shrestha, M., Al-Ghareeb, A., & Gray, R. (2020) · International Journal of Qualitative Methods · doi:10.1177/1609406920982145 · Cited by 70
“Enhanced reporting of clinical trials, observational studies and systematic reviews has been shown to improve if journals endorse reporting guidelines (Samaan et al., 2013).”
BackgroundMbuagbaw, L., Kosa, S. D., Lawson, D. O., Stalteri, R., Olaiya, O. R., Alotaibi, A., & Thabane, L. (2019) · Pilot and Feasibility Studies · doi:10.1186/s40814-019-0500-z · Cited by 57
Self-citationAssessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review
Hooley, C., Amano, T., Markovitz, L., Yaeger, L., & Proctor, E. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00965-8 · Cited by 42
Bigna, J. J. R., Um, L. N., & Nansseu, J. R. N. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0356-8 · Cited by 51
Speich, B., Mann, E., Schönenberger, C. M., Mellor, K., Griessbach, A. N., Dhiman, P., Gandhi, P., Lohner, S., Agarwal, A., Odutayo, A., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.17651 · Cited by 41
Minozzi, S., Gonzalez-Lorenzo, M., Cinquini, M., Berardinelli, D., Cagnazzo, C., Ciardullo, S., De Nardi, P., Gammone, M., Iovino, P., Lando, A., et al. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.09.003 · Cited by 41
Tan, Z. W., Tan, A. C., Li, T., Harris, I., Naylor, J. M., Siebelt, M., van Tiel, J., Pinheiro, M., Harris, L., Chamberlain, K., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038283 · Cited by 37
Toward assessing clinical trial publications for reporting transparency
Kilicoglu, H., Rosemblat, G., Hoang, L., Wadhwa, S., Peng, Z., Malički, M., Schneider, J., & ter Riet, G. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103717 · Cited by 34
Methodology reporting improved over time in 176,469 randomized controlled trials
Kilicoglu, H., Jiang, L., Hoang, L., Mayo-Wilson, E., Vinkers, C. H., & Otte, W. M. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.08.004 · Cited by 19
Quality of abstracts of randomized control trials in five top pain journals: A systematic survey
Sriganesh, K., Bharadwaj, S., Wang, M., Abbade, L. P. F., Jin, Y., Philip, M., Couban, R., Mbuagbaw, L., & Thabane, L. (2017) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2017.06.001 · Cited by 18
“Previous studies have demonstrated that RCTs from journals that endorse CONSORT statement [14], multi-centric studies [11], studies with larger sample size [3], studies involving pharmacological intervention [13], studies reporting significant results for their primary outcome [8] and industry sponsored studies [8] ar…”
Self-citation(2024) · doi:10.1101/2024.03.31.24305138 · Cited by 18
Jiang, L., Lan, M., Menke, J. D., Vorland, C. J., & Kilicoglu, H. (2024) · Scientific Reports · doi:10.1038/s41598-024-72130-7 · Cited by 18
GPT for RCTs?: Using AI to determine adherence to reporting guidelines
Wrightson, J. G., Blazey, P., Moher, D., Khan, K. M., & Ardern, C. L. (2023) · doi:10.1101/2023.12.14.23299971 · Cited by 24
Spiero, I., Leeuwenberg, A. M., Moons, K. G. M., Hooft, L., & Damen, J. A. A. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111987 · Cited by 3
Metadata
- Authors
- Thabane, L., Samaan, Mbuagbaw, L., Kosa, S., Debono, B., Dillenburg, Zhang, Fruci, V., Dennis, & Bawor
- Venue
- Journal of Multidisciplinary Healthcare
- Publisher
- Informa UK Limited
- Published
- 2013-05
- Volume
- 6
- Pages
- 169
- ISSN
- 1178-2390 (ISSN-L)
- OpenAlex
- W2132012869
- Cited by
- 192
- References
- 25
- FWCI
- 11.83
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.