The DOI matches its Crossref record; 47 of the 50 references it cites were found in a registry or an index.
Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement
Abstract
Background The Quality of Reporting of Meta-analyses (QUOROM) conference was convened to address standards for improving the quality of reporting of meta-analyses of clinical randomised controlled trials (RCTs).Methods The QUOROM group consisted of 30 clinical epidemiologists, clinicians, statisticians, editors, and researchers. In conference, the group was asked to identify items they thought should be included in a checklist of standards. Whenever possible, checklist items were guided by research evidence suggesting that failure to adhere to the item proposed could lead to biased results. A modified Delphi technique was used in assessing candidate items.Findings The conference resulted in the QUOROM statement, a checklist, and a flow diagram. The checklist describes our preferred way to present the abstract, introduction, methods, results, and discussion sections of a report of a meta-analysis. It is organised into 21 headings and subheadings regarding searches, selection, validity assessment, data abstraction, study characteristics, and quantitative data synthesis, and in the results with "trial flow", study characteristics, and quantitative data synthesis; research documentation was identified for eight of the 18 items. The flow diagram provides information about both the numbers of RCTs identified, included, and excluded and the reasons for exclusion of trials.Interpretation We hope this report will generate further thought about ways to improve the quality of reports of meta-analyses of RCTs and that interested readers, reviewers, researchers, and editors will use the QUOROM statement and generate ideas for its improvement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similar initiatives have followed for other research areas—e.g., for the reporting of meta-analyses of randomised trials [16] or diagnostic studies [17].”
From The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies (2007) · cites this paper as [16]
In the citing paper
“Meta-analysis was performed according to the QUORUM guidelines (quality of reporting meta-analyses).”
From Comparative Efficacy and Harms of Duloxetine, Milnacipran, and Pregabalin in Fibromyalgia Syndrome (2010) · cites this paper as [47]
In the citing paper
“Mobile technology is also increasingly used to promote health and prevent disease (11, 13–17).”
From Text messaging as a tool for behavior change in disease prevention and management (2010) · cites this paper as [17]
In the citing paper
“Reporting guidelines have been demonstrated to improve reporting of research, thereby allowing for consumers of the research to be aware of the strengths, limitations, and accuracy of conclusions [12,82–84].”
From The Reporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) statement. (2015) · cites this paper as [83]
In the citing paper
“Similar initiatives have followed for other research areas d e.g., for the reporting of meta-analyses of randomised trials [16] or diagnostic studies [17].”
From The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for reporting observational studies (2014) · cites this paper as [16]
In the citing paper
“Examination of changes in reporting quality of MAs published in Medline, Embase and the Cochrane Database of Systematic Reviews, suggested that quality had improved after the release of the QUORUM reporting guidelines [18], [19].”
From Epidemiology, Quality and Reporting Characteristics of Systematic Reviews of Traditional Chinese Medicine Interventions Published in Chinese Journals (2011) · cites this paper as [18]
In the citing paper
“The QUOROM Statement, developed in 1996 and published in 1999 [8], was conceived as a reporting guidance for authors reporting a meta-analysis of randomized trials.”
From The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration (2009) · cites this paper as [8]
In the citing paper
“In 1996, to address the suboptimal reporting of meta-analyses, an international group developed a guidance called the QUOROM Statement (QUality Of Reporting Of Meta-analyses), which focused on the reporting of meta-analyses of randomized controlled trials [8].”
From Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement (2009) · cites this paper as [8]
Citations
Cites
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Self-citationImproving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Systematic Reviews: Identifying relevant studies for systematic reviews
Dickersin, K., Scherer, R. W., & Lefebvre, C. (1994) · BMJ · doi:10.1136/bmj.309.6964.1286 · Cited by 2,255
Systematic Reviews: Synthesis of Best Evidence for Clinical Decisions
Cook, D. J., Mulrow, C. D., & Haynes, R. B. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-126-5-199703010-00006 · Cited by 2,184
Self-citationMeta-Analysis in Clinical Research
L'ABBÉ, K. A., DETSKY, A. S., & O'ROURKE, K. (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-107-2-224 · Cited by 1,267
Meta-Analyses of Randomized Controlled Trials
Sacks, H. S., Berrier, J., Reitman, D., Ancona-Berk, V. A., & Chalmers, T. C. (1987) · New England Journal of Medicine · doi:10.1056/nejm198702193160806 · Cited by 1,257
Discrepancies between Meta-Analyses and Subsequent Large Randomized, Controlled Trials
LeLorier, J., Grégoire, G., Benhaddad, A. A., Lapierre, J., & Derderian, F. (1997) · New England Journal of Medicine · doi:10.1056/nejm199708213370806 · Cited by 1,164
Language bias in randomised controlled trials published in English and German
Egger, M., Zellweger-Zähner, T., Schneider, M., Junker, C., Lengeler, C., & Antes, G. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02419-7 · Cited by 1,028
Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated
Thompson, S. G. (1994) · BMJ · doi:10.1136/bmj.309.6965.1351 · Cited by 1,017
Users' Guides to the Medical Literature
Oxman, A. D. (1994) · JAMA · doi:10.1001/jama.1994.03520170077040 · Cited by 925
Bero, L. A. (1995) · JAMA · doi:10.1001/jama.274.24.1935 · Cited by 870
The Medical Review Article: State of the Science
MULROW, C. D. (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-106-3-485 · Cited by 856
Users' Guides to the Medical Literature: IX. A Method for Grading Health Care Recommendations
Guyatt, G. H. (1995) · JAMA · doi:10.1001/jama.1995.03530220066035 · Cited by 846
Leucht, S., Pitschel‐Walz, G., Abraham, D., & Kissling, W. (1999) · Schizophrenia Research · doi:10.1016/s0920-9964(98)00105-4 · Cited by 795
Publication bias: the case for an international registry of clinical trials.
Simes, R. J. (1986) · Journal of Clinical Oncology · doi:10.1200/jco.1986.4.10.1529 · Cited by 747
Impact of covert duplicate publication on meta-analysis: a case study
Tramèr, M. R., Reynolds, D. J. M., Moore, R. A., & McQuay, H. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.635 · Cited by 702
Do Certain Countries Produce Only Positive Results? A Systematic Review of Controlled Trials
Vickers, A. J., Goyal, N., Harland, R., & Rees, R. W. (1998) · Controlled Clinical Trials · doi:10.1016/s0197-2456(97)00150-5 · Cited by 684
Cook, D. J., Sackett, D. L., & Spitzer, W. O. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00172-m · Cited by 573
Self-citationCHALMERS, I. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26345.x · Cited by 561
Moher, D., Fortin, P. R., Jadad, A. R., Jüni, P., Klassen, T. P., LeLorier, J., Liberati, A., Penna, A., & Linde, K. (1996) · The Lancet · doi:10.1016/s0140-6736(96)90538-3 · Cited by 539
Self-citationOxman, A. D. (1994) · JAMA · doi:10.1001/jama.272.17.1367 · Cited by 486
Does blinding of readers affect the results of meta-analyses?
Berlin, J. A. (1997) · The Lancet · doi:10.1016/s0140-6736(05)62352-5 · Cited by 478
Sterling, T. D., Rosenbaum, W. L., & Weinkam, J. J. (1995) · The American Statistician · doi:10.1080/00031305.1995.10476125 · Cited by 453
Why review articles on the health effects of passive smoking reach different conclusions
Barnes, D. E. (1998) · JAMA · doi:10.1001/jama.279.19.1566 · Cited by 442
Cochrane Collaboration Handbook
Mulrow, C. (1996) · Medical Entomology and Zoology · Cited by 403
Cochrane Collaboration helping unravel tangled web woven by international research.
Huston, P. (1996) · PubMed · Cited by 398
A guide to interpreting discordant systematic reviews.
Jadad, A., Cook, D. J., & Browman, G. P. (1997) · Europe PMC (PubMed Central) · Cited by 393
Self-citationA Proposal for Structured Reporting of Randomized Controlled Trials
Andrew, E. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520240054041 · Cited by 309
NIH clinical trials and publication bias.
Dickersin, K., & Min, Y. (1993) · PubMed · Cited by 295
Should Unpublished Data Be Included in Meta-analyses?: Current Convictions and Controversies
Cook, D. J. (1993) · JAMA · doi:10.1001/jama.1993.03500210049030 · Cited by 259
Self-citationPublication bias and meta-analysis
Smith, M. L. (1980) · Evaluation in Education · doi:10.1016/0191-765x(80)90004-x · Cited by 209
Taddio, A., the CIHR Team in Children’s Pain, Fassos, F. F., Boon, H., Ilersich, A. L. T., & Einarson, T. R. (1994) · Europe PMC (PubMed Central) · Cited by 203
Guides for reading and interpreting systematic reviews: I. Getting started.
Klassen, T. P., Jadad, A. R., & Moher, D. (1998) · PubMed · Cited by 170
Self-citationChalmers, I., & Haynes, B. R. (1994) · BMJ · doi:10.1136/bmj.309.6958.862 · Cited by 169
Statistical and theoretical considerations in meta-analysis
Olkin, I. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00136-e · Cited by 135
Self-citationSacks, H. S., Reitman, D., Pagano, D., & Kupelnick, B. (1996) · PubMed · Cited by 122
Invited Commentary: Re: “A Critical Look at Some Popular Meta-Analytic Methods”
Olkin, I. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117249 · Cited by 115
Self-citationKhan, K. S., Daya, S., Collins, J. A., & Walter, S. D. (1996) · Fertility and Sterility · doi:10.1016/s0015-0282(16)58265-x · Cited by 114
Risperidone versus haloperidol: I. meta-analysis of efficacy and safety
Davies, A., ADENA, M. A., Keks, N. A., Catts, S. V., Lambert, T. J. R., & Schweitzer, I. (1998) · Clinical Therapeutics · doi:10.1016/s0149-2918(98)80034-9 · Cited by 61
Checklist of Information for Inclusion in Reports of Clinical Trials
The Asilomar Working Group on Recommendations for Reporting of Clinical Trials in the Biomedical Literature (1996) · Annals of Internal Medicine · doi:10.7326/0003-4819-124-8-199604150-00007 · Cited by 48
The Delphi Technique as an Alternative for Committee Meetings
Whitman, N. I. (1990) · Journal of Nursing Education · doi:10.3928/0148-4834-19901001-13 · Cited by 39
Identification of meta-analyses
Dickersin, K., Higgins, K., & Meinert, C. L. (1990) · Controlled Clinical Trials · doi:10.1016/0197-2456(90)90032-w · Cited by 38
Guides for Reading and Interpreting Systematic Reviews
Klassen, T. P., Jadad, A. R., & Moher, D. (1998) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.152.7.700 · Cited by 16
Self-citationThe influence of 'grey' literature on meta-analysis.
McAuley, L. (1999) · Library and Archives Canada (Government of Canada) · doi:10.20381/ruor-7548 · Cited by 9
Research works printed but not linked: 3
- Olkin, 1984, A critical look at some popular meta-analytic methods, Am J Epidemiol, 140, 287
- Shea B, Dubé C, Moher D. Assessing the quality of reports of meta-analyses: a systematic review of scales and checklists. In: Egger M, Davey Smith G, Altman DG. Systematic reviews, 2nd edn. London: BMJ Publishing Group (in press).
- Moher, 1998, Does the quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?, Lancet, 352, 609, 10.1016/S0140-6736(98)01085-X · DOI · Paper page
Cited by
Sorted by citations
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Self-citationPreferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Self-citationPreferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Self-citationTong, A., Sainsbury, P., & Craig, J. (2007) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzm042 · Cited by 42,509
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Self-citation
Metadata
- Authors
- Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F.
- Affiliations
- University of Ottawa (CA)
- McMaster University (CA)
- University of California, San Francisco (US)
- Stanford University (US)
- Centers for Disease Control and Prevention (US)
- Corresponding author
- Moher, David
- Venue
- The Lancet
- Publisher
- Elsevier BV
- Published
- 1999-11
- Volume
- 354
- Issue
- 9193
- Pages
- 1896-1900
- ISSN
- 0099-5355 (ISSN-L)
- 0140-6736
- OpenAlex
- W2000442546
- Cited by
- 4,826
- References
- 50
- Citations by year
- 2026: 24 · 2025: 50 · 2024: 64 · 2023: 75 · 2022: 81 · 2021: 88 · 2020: 100 · 2019: 91 · 2018: 104 · 2017: 136 · 2016: 139 · 2015: 181 · 2014: 232 · 2013: 253 · 2012: 256
- FWCI
- 131.65
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Lancet (publishedVersion)
- PubMed (publishedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- Funders
- Abbott Laboratories
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- reporting quality, meta-analysis, randomized controlled trials, reporting guidelines, checklists, flowcharts, trial selection, data synthesis, research documentation
- MeSH terms
- Authorship, Humans, Software Design, Meta-Analysis as Topic, Randomized Controlled Trials as Topic, Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review