From QUOROM to PRISMA: A Survey of High-Impact Medical Journals' Instructions to Authors and a Review of Systematic Reviews in Anesthesia Literature
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The PRISMA (Preferred Reporting Items of Systematic reviews and Meta-Analyses) Statement was published to help authors improve how they report systematic reviews. It is unknown how many journals mention PRISMA in their instructions to authors, or whether stronger journal language regarding use of PRISMA improves author compliance. METHODOLOGY/PRINCIPAL FINDINGS: An Internet-based investigation examined the extent to which 146 leading medical journals have incorporated the PRISMA Statement into their instructions to authors. Results were analyzed using descriptive statistics. Also, systematic reviews published in the leading anesthesiology journals and the QUOROM (QUality Of Reporting Of Meta-analyses) Statement were used to explore the hypothesis that indicating compliance with the QUOROM Statement in the manuscript is associated with improved compliance with the reporting guideline. In a sample of 146 journals publishing systematic reviews, the PRISMA Statement was referred to in the instructions to authors for 27% (40/146) of journals; more often in general and internal medicine journals (7/14; 50%) than in specialty medicine journals (33/132; 25%). In the second part of the study, 13 systematic reviews published in the leading anesthesiology journals in 2008 were included for appraisal. Mention of the QUOROM Statement in the manuscript was associated with higher compliance with the QUOROM checklist (P = 0.022). CONCLUSIONS/SIGNIFICANCE: Most of the leading medical journals used ambiguous language regarding what was expected of authors. Further improvement on quality of reporting of systematic reviews may entail journals clearly informing authors of their requirements. Stronger directions, such as requiring an indication of adherence to a research quality of reporting statement in the manuscript, may improve reporting and utility of systematic reviews.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Currently, around 30% of medical journals publishing systematic reviews have endorsed PRISMA statement in their author's guidelines [9].”
From Evaluation of the endorsement of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement on the quality of published systematic review and meta-analyses (2013) · cites this paper as [9]
Experimental — accuracy not yet measuredIn the citing paper
“Findings on association between manuscript length and quality of systematic reviews and meta-analyses have been contradictory so far [9], [19].”
In the citing paper
“Instead of, they addressed adherence of published manuscripts to the QUORUM statement, reporting insufficient adherence to several QUORUM items such as “Identifying title” and “Structured abstract” [9].”
In the citing paper
“It has been reported that in 2011, among 146 high-impact medical journals, more than half of general and internal medicine publications, and a quarter of other specialty journals referred to the PRISMA in the instructions for authors [9].”
In the citing paper
“Further, it has been previously reported that mentioning the QUORUM in the manuscript is associated with higher compliance to the QUORUM checklist [9].”
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Self-citationPreferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 2×
“In the form of a checklist, the PRISMA group provides advice on how to report research methods and findings, and the checklist specifies a minimum set of items required for a clear and transparent reporting of systematic reviews [8].”
BackgroundMethodSelf-citationPreferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“The quality of reporting of systematic reviews is not optimal, yet the clarity of reporting greatly affects the value of systematic review [22,23].”
BackgroundSelf-citationWang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Self-citationMoher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Italian Journal of Public Health · doi:10.2427/5768 · Cited by 3,374
Self-citationThe Effects of Mild Perioperative Hypothermia on Blood Loss and Transfusion Requirement
Rajagopalan, S., Mascha, E., Na, J., & Sessler, D. I. (2008) · Anesthesiology · doi:10.1097/01.anes.0000296719.73450.52 · Cited by 905
Simera, I., Moher, D., Hirst, A., Hoey, J., Schulz, K. F., & Altman, D. G. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-24 · Cited by 590
Self-citationFowler, S. J., Symons, J., Sabato, S., & Myles, P. S. (2008) · British Journal of Anaesthesia · doi:10.1093/bja/aem373 · Cited by 507
Sun, Y., Gan, T. J., Dubose, J. W., & Habib, A. S. (2008) · British Journal of Anaesthesia · doi:10.1093/bja/aen146 · Cited by 303
Schulz, K. (2010) · Journal of Chinese Integrative Medicine · doi:10.3736/jcim20100702 · Cited by 248
Hopewell, S., Altman, D. G., Moher, D., & Schulz, K. F. (2008) · Trials · doi:10.1186/1745-6215-9-20 · Cited by 241 · cited 2×
“found that CONSORT was endorsed in instructions to authors by 38% of 165 high-impact factor medical journals [24].”
BackgroundSelf-citationKuratani, N., & Oi, Y. (2008) · Anesthesiology · doi:10.1097/aln.0b013e31817f5c18 · Cited by 179
Altman, D. G. (2005) · BMJ · doi:10.1136/bmj.330.7499.1056 · Cited by 178 · cited 2×
“Moreover, just as found presently for the PRISMA Statement, the proportion of journals endorsing the CONSORT Statement was lower in specialty medicine journals than in general and internal medicine journals [5].”
BackgroundMethodTaking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy.
Shojania, K. G., & Bero, L. A. (2001) · PubMed · Cited by 176
Nefopam for the prevention of postoperative pain: quantitative systematic review
Evans, M. S., Lysakowski, C., & Tramèr, M. R. (2008) · British Journal of Anaesthesia · doi:10.1093/bja/aen267 · Cited by 172
Biondi-Zoccai, G. G. L., Lotrionte, M., Abbate, A., Testa, L., Remigi, E., Burzotta, F., Valgimigli, M., Romagnoli, E., Crea, F., & Agostoni, P. (2006) · BMJ · doi:10.1136/bmj.38693.516782.7c · Cited by 149 · cited 1×
“. Many journal editors and authors, including those involved in the Cochrane Collaboration, then pursued compliance with the QUOROM checklist to ensure that authors reported transparently what they did (methods) and found (results)”
MethodDesmopressin Reduces Transfusion Needs after Surgery
Crescenzi, G., Landoni, G., Biondi‐Zoccai, G., Pappalardo, F., Nuzzi, M., Bignami, E. G., Fochi, O., Maj, G., Calabró, M. G., Ranucci, M., et al. (2008) · Anesthesiology · doi:10.1097/aln.0b013e31818db18b · Cited by 146
A systematic evaluation of the quality of meta-analyses in the critical care literature
Delaney, A., Bagshaw, S. M., Ferland, A., Manns, B., Laupland, K. B., & Doig, C. J. (2005) · Critical Care · doi:10.1186/cc3803 · Cited by 142 · cited 2×
“Systematic reviews of this specialty have been considered to be higher quality than reviews published in other specialty medicine journals [28], so the conclusion of this study should be treated cautiously.”
BackgroundPlacebo response in the prophylaxis of migraine: A meta‐analysis
Macedo, A., Baños, J., & Farré, M. (2008) · European Journal of Pain · doi:10.1016/j.ejpain.2007.03.002 · Cited by 124
Psoas compartment block for lower extremity surgery: a meta-analysis
Touray, S., de Leeuw, M. A., Zuurmond, W. W. A., & Perez, R. S. G. M. (2008) · British Journal of Anaesthesia · doi:10.1093/bja/aen298 · Cited by 107
Bonnet, M., Marret, E., Josserand, J., & Mercier, F. J. (2008) · British Journal of Anaesthesia · doi:10.1093/bja/aen202 · Cited by 100
Closed tracheal suction systems for prevention of ventilator-associated pneumonia
Siempos, I. Ι., Vardakas, K. Z., & Falagas, M. E. (2008) · British Journal of Anaesthesia · doi:10.1093/bja/aem403 · Cited by 99
Acute pain: combination treatments and how we measure their efficacy
McQuay, H. J., Poon, K. H., Derry, S., & Moore, R. A. (2008) · British Journal of Anaesthesia · doi:10.1093/bja/aen108 · Cited by 61
Moher, D. (2010) · Journal of Chinese Integrative Medicine · doi:10.3736/jcim20100801 · Cited by 57
Self-citationFollowing 411 Cochrane Protocols to Completion: A Retrospective Cohort Study
Tricco, A. C., Brehaut, J., Chen, M. H., & Moher, D. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003684 · Cited by 54 · cited 1×
“Since the PRISMA Statement was released just two years previously and preparation of a systematic review may be a lengthy process [4], it was conceivable that few reviews may indicate compliance with the PRISMA Statement.”
BackgroundSelf-citationBiccard, B. M., Sear, J. W., & Foëx, P. (2007) · British Journal of Anaesthesia · doi:10.1093/bja/aem331 · Cited by 47
How Much Does Pharmacologic Prophylaxis Reduce Postoperative Vomiting in Children?
Engelman, E. E., Salengros, J.-C., & Barvais, L. (2008) · Anesthesiology · doi:10.1097/aln.0b013e31818d6b26 · Cited by 40
Gerber, S., Tallon, D., Trelle, S., Schneider, M., Jüni, P., & Egger, M. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.10.022 · Cited by 30 · cited 1×
“methodology of meta-analyses published in general medicine journals was superior to those published in specialty medicine journals [26].”
MethodSun, Y., Gan, T. J., Dubose, J., Habib, A. S., & Fleckenstein, J. (2008) · Deutsche Zeitschrift für Akupunktur · doi:10.1016/j.dza.2008.10.010 · Cited by 21
Reports of randomized trials: ensure they are transparent, accurate, and complete
Moher, D. (2010) · Journal of Chinese Integrative Medicine · doi:10.3736/jcim20100701 · Cited by 4
Self-citation
Cited by
Panic, N., Leoncini, E., de Belvis, G., Ricciardi, W., & Boccia, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0083138 · Cited by 883
“Currently, around 30% of medical journals publishing systematic reviews have endorsed PRISMA statement in their author’s guidelines [9].”
BackgroundMethodResultInfluentialPage, M. J., & Moher, D. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0663-8 · Cited by 769
Self-citationCarotenoids from microalgae: A review of recent developments
Gong, M., & Bassi, A. (2016) · Biotechnology Advances · doi:10.1016/j.biotechadv.2016.10.005 · Cited by 723
Cooper, C., Booth, A., Varley-Campbell, J., Britten, N., & Garside, R. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0545-3 · Cited by 561
A Framework for Enhancing the Value of Research for Dissemination and Implementation
Neta, G., Glasgow, R. E., Carpenter, C. R., Grimshaw, J. M., Rabin, B. A., Fernandez, M. E., & Brownson, R. C. (2015) · American Journal of Public Health · doi:10.2105/ajph.2014.302206 · Cited by 205
Metadata
- Authors
- Tao, K.-M., Li, X.-Q., Zhou, Q.-H., Moher, D., Ling, C.-Q., & Yu, W.-F.
- Affiliations
- Second Military Medical University (CN)
- Ottawa Hospital Research Institute (CA)
- Corresponding author
- Zhou, Qing-hui
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-11-16
- Volume
- 6
- Issue
- 11
- Pages
- e27611
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3217994
- OpenAlex
- W1983573532
- Cited by
- 101
- References
- 34
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 4 · 2023: 6 · 2022: 11 · 2021: 7 · 2020: 8 · 2019: 6 · 2018: 4 · 2017: 16 · 2016: 11 · 2015: 8 · 2014: 3 · 2013: 9
- FWCI
- 0.94
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Ottawa Hospital Research Institute
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- PRISMA statement, reporting guidelines, author guidelines, medical journals, systematic reviews, anesthesiology journals, meta-analysis reporting quality
- MeSH terms
- Systematic Reviews as Topic, Anesthesia, Authorship, Data Collection, Guidelines as Topic, Journalism, Medical, Guideline Adherence, Journal Impact Factor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.