New evidence pyramid
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
A pyramid has expressed the idea of hierarchy of medical evidence for so long, that not all evidence is the same. Systematic reviews and meta-analyses have been placed at the top of this pyramid for several good reasons. However, there are several counterarguments to this placement. We suggest another way of looking at the evidence-based medicine pyramid and explain how systematic reviews and meta-analyses are tools for consuming evidence—that is, appraising, synthesising and applying evidence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“synthesised evidence from randomised controlled trials is considered the highest level in the evidence pyramid, and such evidence has been widely adopted to inform clinical practice guidelines and health technology assessments.”
From Investigating the impact of trial retractions on the healthcare evidence ecosystem (VITALITY Study I): retrospective cohort study (2025) · cites this paper as [6]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Robust SLRs are essential for reducing bias, ensuring reliable results and supporting informed decision-making in healthcare [1, 3, 11].”
From Automated Mass Extraction of Over 680,000 PICOs from Clinical Study Abstracts Using Generative AI: A Proof-of-Concept Study. (2024) · cites this paper as [1]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Recent advancements in generative artificial intelligence (GenAI), particularly large language models (LLMs), have demonstrated the potential of this technology to automate key tasks involved in conducting systematic literature reviews (SLRs)”
From Automated Mass Extraction of Over 680,000 PICOs from Clinical Study Abstracts Using Generative AI: A Proof-of-Concept Study. (2024) · cites this paper as [1]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Effect of Rosiglitazone on the Risk of Myocardial Infarction and Death from Cardiovascular Causes
Nissen, S. E., & Wolski, K. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa072761 · Cited by 4,675 · cited 1×
“A limitation of considering systematic review and meta-analyses as tools to consume evidence may undermine their role in new discovery (eg, identifying a new side effect that was not demonstrated in individual studies 13 ).”
BackgroundGRADE guidelines: 9. Rating up the quality of evidence
Guyatt, G. H., Oxman, A. D., Sultan, S., Glasziou, P., Akl, E. A., Alonso-Coello, P., Atkins, D., Kunz, R., Brozek, J., Montori, V., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.06.004 · Cited by 1,336 · cited 1×
“quality of this evidence is rated up despite the study design (non-randomised observational studies).(10) Therefore, the first modification to the pyramid is to change the straight lines separating study designs in the pyramid to wavy lines (going up and down to reflect the GRADE approach of rating up and down based o…”
MethodSelf-citationMurad, M. H., Montori, V. M., Ioannidis, J. P. A., Jaeschke, R., Devereaux, P. J., Prasad, K., Neumann, I., Carrasco-Labra, A., Agoritsas, T., Hatala, R., et al. (2014) · JAMA · doi:10.1001/jama.2014.5559 · Cited by 454
Self-citationAssociation Between Analytic Strategy and Estimates of Treatment Outcomes in Meta-analyses
Dechartres, A., Altman, D. G., Trinquart, L., Boutron, I., & Ravaud, P. (2014) · JAMA · doi:10.1001/jama.2014.8166 · Cited by 233 · cited 2×
“One evaluation of 163 meta-analyses demonstrated that the estimation of treatment outcomes differed substantially depending on the analytical strategy being used.(7) Therefore, we suggest, in this perspective, two visual modifications to the pyramid to illustrate two contemporary methodological principles (figure 1).”
BackgroundMethodGlycemic Control in Non-Critically Ill Hospitalized Patients: A Systematic Review and Meta-Analysis
Murad, M. H., Coburn, J. A., Coto-Yglesias, F., Dzyubak, S., Hazem, A., Lane, M. A., Prokop, L. J., & Montori, V. M. (2012) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2011-2100 · Cited by 192
Self-citationMeta-analysis as Evidence: Building a Better Pyramid
Berlin, J. A., & Golub, R. M. (2014) · JAMA · doi:10.1001/jama.2014.8167 · Cited by 160
Research Pyramid: A New Evidence-Based Practice Model for Occupational Therapy
Tomlin, G., & Borgetto, B. (2011) · The American Journal of Occupational Therapy · doi:10.5014/ajot.2011.000828 · Cited by 159
Systematic review or meta-analysis? Their place in the evidence hierarchy
Paul, M., & Leibovici, L. (2013) · Clinical Microbiology and Infection · doi:10.1111/1469-0691.12489 · Cited by 76
Vandenbroucke, J. P. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00025-0 · Cited by 51
Cited by
Methodological quality and synthesis of case series and case reports
Murad, M. H., Sultan, S., Haffar, S., & Bazerbachi, F. (2018) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2017-110853 · Cited by 2,242
“24 25 It is paramount to recognise that a systematic review and meta-analysis of case reports/series should not be placed at the top of the hierarchy in a pyramid that depicts validity.(26) The certainty of evidence derived from a meta-analysis is contingent on the design of included studies, their risk of bias, as we…”
BackgroundSelf-citationProject AIM: Autism intervention meta-analysis for studies of young children.
Sandbank, M., Bottema-Beutel, K., Crowley, S., Cassidy, M., Dunham, K., Feldman, J. I., Crank, J., Albarran, S. A., Raj, S., Mahbub, P., et al. (2020) · Psychological Bulletin · doi:10.1037/bul0000215 · Cited by 606
Post-stroke depression: A 2020 updated review
Medeiros, G. C., Roy, D., Kontos, N., & Beach, S. R. (2020) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2020.06.011 · Cited by 587
Owen, R. K., Bradbury, N., Xin, Y., Cooper, N., & Sutton, A. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1373 · Cited by 427
Systematic Literature Reviews: An Introduction
Lame, G. (2019) · Proceedings of the Design Society: International Conference on Engineering Design · doi:10.1017/dsi.2019.169 · Cited by 414
Metadata
- Authors
- Murad, M. H., Asi, N., Alsawas, M., & Alahdab, F.
- Affiliations
- Mayo Clinic (US)
- Corresponding author
- Murad, M Hassan
- Venue
- Evidence Based Medicine
- Publisher
- BMJ
- Published
- 2016-06-23
- Volume
- 21
- Issue
- 4
- Pages
- 125-127
- ISSN
- 1356-5524 (ISSN-L)
- 1473-6810
- PMC
- PMC4975798
- OpenAlex
- W2475260156
- Cited by
- 1,388
- References
- 12
- Citations by year
- 2026: 119 · 2025: 148 · 2024: 218 · 2023: 196 · 2022: 200 · 2021: 177 · 2020: 174 · 2019: 80 · 2018: 47 · 2017: 20 · 2016: 7
- FWCI
- 47.90
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Evidence-Based Medicine (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- evidence pyramid, evidence hierarchy, systematic reviews, meta-analysis, evidence-based medicine, evidence appraisal, evidence synthesis
- MeSH terms
- Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: New evidence pyramid. https://app.cochat.ai/papers/10.1136/ebmed-2016-110401
- The paper
- Murad, M. H., Asi, N., Alsawas, M., & Alahdab, F. (2016). New evidence pyramid. Evidence Based Medicine. https://doi.org/10.1136/ebmed-2016-110401
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.