A systematic scoping review of adherence to reporting guidelines in health care literature
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Reporting guidelines have been available for the past 17 years since the inception of the Consolidated Standards of Reporting Trials statement in 1996. These guidelines were developed to improve the quality of reporting of studies in medical literature. Despite the widespread availability of these guidelines, the quality of reporting of medical literature remained suboptimal. In this study, we assess the current adherence practice to reporting guidelines; determine key factors associated with better adherence to these guidelines; and provide recommendations to enhance adherence to reporting guidelines for future studies. METHODS: We undertook a systematic scoping review of systematic reviews of adherence to reporting guidelines across different clinical areas and study designs. We searched four electronic databases (Cumulative Index to Nursing and Allied Health Literature, Web of Science, Embase, and Medline) from January 1996 to September 2012. Studies were included if they addressed adherence to one of the following guidelines: Consolidated Standards of Reporting Trials (CONSORT), Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), Quality of Reporting of Meta-analysis (QUOROM), Transparent Reporting of Evaluations with Nonrandomized Designs (TREND), Meta-analysis Of Observational Studies in Epidemiology (MOOSE) and Strengthening the Reporting of Observational Studies in Epidemiology (STROBE). A protocol for this study was devised. A literature search, data extraction, and quality assessment were performed independently by two authors in duplicate. This study reporting follows the PRISMA guidelines. RESULTS: Our search retrieved 5159 titles, of which 50 were eligible. Overall, 86.0% of studies reported suboptimal levels of adherence to reporting guidelines. Factors associated with better adherence included journal impact factor and endorsement of guidelines, publication date, funding source, multisite studies, pharmacological interventions and larger studies. CONCLUSION: Reporting guidelines in the clinical literature are important to improve the standards of reporting of clinical studies; however, adherence to these guidelines remains suboptimal. Action is therefore needed to enhance the adherence to these standards. Strategies to enhance adherence include journal editorial policies endorsing these guidelines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Italian Journal of Public Health · doi:10.2427/5768 · Cited by 3,374
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000251 · Cited by 2,296
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755 · cited 8×
“In brief, the CON-SORT Statement provides a 25-item checklist describing the required criteria for inclusion when reporting RCTs.”
InfluentialMethodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227
The IMAGE Study Group, Greaves, C. J., Sheppard, K. E., Abraham, C., Hardeman, W., Roden, M., Evans, P. H., & Schwarz, P. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-119 · Cited by 1,163
Plint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872
Simera, I., Moher, D., Hirst, A., Hoey, J., Schulz, K. F., & Altman, D. G. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-24 · Cited by 590
External Validation of a Measurement Tool to Assess Systematic Reviews (AMSTAR)
Shea, B. J., Bouter, L. M., Peterson, J., Boers, M., Andersson, N., Ortiz, Z., Ramsay, T., Bai, A., Shukla, V. K., & Grimshaw, J. M. (2007) · PLoS ONE · doi:10.1371/journal.pone.0001350 · Cited by 569
Optimal search strategies for retrieving systematic reviews from Medline: analytical survey
Montori, V. M., Wilczynski, N. L., Morgan, D., & Haynes, R. B. (2005) · BMJ · doi:10.1136/bmj.38336.804167.47 · Cited by 422
Overview of a formal scoping review on health system report cards
Brien, S. E., Lorenzetti, D. L., Lewis, S., Kennedy, J., & Ghali, W. A. (2010) · Implementation Science · doi:10.1186/1748-5908-5-2 · Cited by 290 · cited 1×
“This framework was further operationalized, and five stages were proposed to be followed when conducting a scoping review, including: (1) the identification of a research question; (2) finding the relevant studies; (3) the selection of studies to be included in the review; (4) data extraction from the included studies…”
Guidelines for Reporting Health Research: The EQUATOR Network's Survey of Guideline Authors
Simera, I., Altman, D. G., Moher, D., Schulz, K. F., & Hoey, J. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050139 · Cited by 220 · cited 1×
“Furthermore, poorly reported research can cause harm to patients and lead to the use of scarce resources on ineffective treatments.(13) To address the concern over the quality of reported studies and ensure transparency in reporting clinical studies, the Consolidated Standards of Reporting Trials (CONSORT)(14) stateme…”
Prady, S. L., Richmond, S. J., Morton, V. M., & MacPherson, H. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001577 · Cited by 145 · cited 1×
“91 Studies have shown that the use of these guidelines was associated with better reporting of studies of acupuncture trials, 92 and only minimal improvement in the adherence to reporting guidelines of studies that investigated diagnostic accuracy.”
Uetani, K., Nakayama, T., Ikai, H., Yonemoto, N., & Moher, D. (2009) · Internal Medicine · doi:10.2169/internalmedicine.48.1358 · Cited by 59
Ma, B., Guo, J., Qi, G., Li, H., Peng, J., Zhang, Y., Ding, Y., & Yang, K. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020185 · Cited by 56 · cited 2×
“Ma et al 74 and Willis et al 88 used the 27-item PRISMA checklist to assess the level of adherence.”
Junhua, Z., Hongcai, S., Xiumei, G., Boli, Z., Yaozu, X., Hongbo, C., & Ming, R. (2007) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2007.7195 · Cited by 48
Froud, R., Eldridge, S., Diaz Ordaz, K., Marinho, V. C. C., & Donner, A. (2012) · Community Dentistry and Oral Epidemiology · doi:10.1111/j.1600-0528.2011.00660.x · Cited by 29
Quality assessment of meta-analyses of RCTs of pharmacotherapy in major depressive disorder.
Hemels, M. E. H., Vicente, C., Sadri, H., Masson, M. J., & Einarson, T. R. (2004) · Current Medical Research and Opinion · doi:10.1185/030079904125003197 · Cited by 23 · cited 1×
“Hemels et al 68 used only the QUOROM checklist and they concluded that the quality of meta-analyses in studies on major depressive disorder was marginally acceptable.”
Cited by
Page, M. J., & Moher, D. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0663-8 · Cited by 769
“the extent to which SRs comply with each item in the statement) [35, 36].”
BackgroundMethodGuidelines for reporting meta-epidemiological methodology research
Murad, M. H., & Wang, Z. (2017) · Evidence Based Medicine · doi:10.1136/ebmed-2017-110713 · Cited by 515
“Adherence across all reporting guidelines was estimated to be 86% in another study.(19) Evaluation of the instructions given to authors shows that PRISMA guidance was referenced only in 13% of gastroenterology and hepatology journals.”
MethodThabane, L., Hopewell, S., Lancaster, G. A., Bond, C. M., Coleman, C. L., Campbell, M. J., & Eldridge, S. M. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0065-z · Cited by 216
“It has been shown that formal endorsement of a guideline by journals is a strong determinant of its adoption and subsequent adherence to it [27].”
BackgroundSelf-citationDechartres, A., Trinquart, L., Atal, I., Moher, D., Dickersin, K., Boutron, I., Perrodeau, E., Altman, D. G., & Ravaud, P. (2017) · BMJ · doi:10.1136/bmj.j2490 · Cited by 171
Reporting guidelines in medical artificial intelligence: a systematic review and meta-analysis
Kolbinger, F. R., Veldhuizen, G. P., Zhu, J., Truhn, D., & Kather, J. N. (2024) · Communications Medicine · doi:10.1038/s43856-024-00492-0 · Cited by 160
Metadata
- Authors
- Thabane, L., Samaan, Mbuagbaw, L., Kosa, S., Debono, B., Dillenburg, Zhang, Fruci, V., Dennis, & Bawor
- Venue
- Journal of Multidisciplinary Healthcare
- Publisher
- Informa UK Limited
- Published
- 2013-05
- Volume
- 6
- Pages
- 169
- ISSN
- 1178-2390 (ISSN-L)
- OpenAlex
- W2132012869
- Cited by
- 192
- References
- 25
- FWCI
- 11.83
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.