Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Systematic reviews (SRs) can help decision makers interpret the deluge of published biomedical literature. However, a SR may be of limited use if the methods used to conduct the SR are flawed, and reporting of the SR is incomplete. To our knowledge, since 2004 there has been no cross-sectional study of the prevalence, focus, and completeness of reporting of SRs across different specialties. Therefore, the aim of our study was to investigate the epidemiological and reporting characteristics of a more recent cross-section of SRs. METHODS AND FINDINGS: We searched MEDLINE to identify potentially eligible SRs indexed during the month of February 2014. Citations were screened using prespecified eligibility criteria. Epidemiological and reporting characteristics of a random sample of 300 SRs were extracted by one reviewer, with a 10% sample extracted in duplicate. We compared characteristics of Cochrane versus non-Cochrane reviews, and the 2014 sample of SRs versus a 2004 sample of SRs. We identified 682 SRs, suggesting that more than 8,000 SRs are being indexed in MEDLINE annually, corresponding to a 3-fold increase over the last decade. The majority of SRs addressed a therapeutic question and were conducted by authors based in China, the UK, or the US; they included a median of 15 studies involving 2,072 participants. Meta-analysis was performed in 63% of SRs, mostly using standard pairwise methods. Study risk of bias/quality assessment was performed in 70% of SRs but was rarely incorporated into the analysis (16%). Few SRs (7%) searched sources of unpublished data, and the risk of publication bias was considered in less than half of SRs. Reporting quality was highly variable; at least a third of SRs did not report use of a SR protocol, eligibility criteria relating to publication status, years of coverage of the search, a full Boolean search logic for at least one database, methods for data extraction, methods for study risk of bias assessment, a primary outcome, an abstract conclusion that incorporated study limitations, or the funding source of the SR. Cochrane SRs, which accounted for 15% of the sample, had more complete reporting than all other types of SRs. Reporting has generally improved since 2004, but remains suboptimal for many characteristics. CONCLUSIONS: An increasing number of SRs are being published, and many are poorly conducted and reported. Strategies are needed to help reduce this avoidable waste in research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Many systematic review reports include narrative summaries of the characteristics and risk of bias across all included studies.36”
From PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews (2021) · cites this paper as [36]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even for those studies which explicitly reference PRISMA, there is only slight, statistically non-significant evidence of improved reporting, as found by Page et al. [15].”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The studies included in a systematic review will generally vary with respect to design, study populations, and risk of bias [1].”
From COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology (2019) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“in a survey of 300 systematic reviews, 64% of the reviews included observational studies [7].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Although few published evaluations exist, evidence suggests that the endorsement of PRISMA by journals is associated with more complete reporting of systematic reviews than in journals not endorsing the reporting guideline.50 51 52”
From Reporting guideline for overviews of reviews of healthcare interventions: development of the PRIOR statement. (2022) · cites this paper as [51]
Experimental — accuracy not yet measured
23 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Self-citationPreferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Self-citationPreferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Self-citationThe Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationPRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Self-citation
Research works printed but not linked: 2
- Agency for Healthcare Research and Quality. Methods guide for effectiveness and comparative effectiveness reviews. AHRQ Publication No. 10(14)-EHC063-EF. 2014 Jan [cited 21 Apr 2016]. Available: https://www.effectivehealthcare.ahrq.gov/ehc/products/60/318/CER-Methods-Guide-140109.pdf. 21433403
- Nordic Cochrane Centre. Review Manager (RevMan), version 5.1. Copenhagen: Nordic Cochrane Centre; 2011.
Cited by
Items 301–400 of 793
Whaley, P., Blaauboer, B. J., Brozek, J., Hubal, E. A. C., Hair, K., Kacew, S., Knudsen, T. B., Kwiatkowski, C. F., Mellor, D. T., Olshan, A. F., et al. (2021) · ALTEX · doi:10.14573/altex.2106111 · Cited by 20
“Indirect evidence from reviews of biomedical systematic reviews also suggests there may be room for improvement (Ioannidis, 2016; Page et al., 2016).”
BackgroundKermansaravi, M., Valizadeh, R., Farazmand, B., Mousavimaleki, A., Taherzadeh, M., Wiggins, T., & Singhal, R. (2022) · Obesity Surgery · doi:10.1007/s11695-022-06226-2 · Cited by 18
“Meta-regression was not applicable due to the small number of studies [17].”
BackgroundSewell, K. B., Schellinger, J., & Bloss, J. (2023) · PLoS ONE · doi:10.1371/journal.pone.0295864 · Cited by 18
http://cejpaediatrics.com/index.php/pt/article/view/282/pdf
Mahmić-Kaknjo, M. (2017) · The Central European Journal of Paediatrics · doi:10.5457/p2005-114.168 · Cited by 16
“The Cochrane review is a more complete report than others (21, 22).”
BackgroundNeilson, C. J. (2021) · Health Information & Libraries Journal · doi:10.1111/hir.12367 · Cited by 16
Levack, W., & Thornton, K. (2017) · British Journal of Occupational Therapy · doi:10.1177/0308022617722736 · Cited by 16
“One criticism of many systematic reviews (both quantitative and qualitative) is that they do not incorporate critical appraisal of included studies into the analysis and synthesis of review findings (Page et al., 2016).”
BackgroundMapping the characteristics of meta-analyses of pharmacy services: a systematic review
Bonetti, A. D. F., Rocca, A. M. D., Lucchetta, R. C., Tonin, F. S., Fernández-Llimós, F., & Pontarolo, R. (2020) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-020-01058-5 · Cited by 18
Gates, M., Gates, A., Pieper, D., Fernandes, R. J., Tricco, A. C., Moher, D., Brennan, S., Li, T., Pollock, M., Lunny, C., et al. (2022) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/82wau · Cited by 16
Self-citationLiang, J., Zhao, Y., Chen, Y. C., Jiang, N., Zhang, S. X., Huang, S., Kakaer, A., & Chen, Y. J. (2022) · BMC Medicine · doi:10.1186/s12916-022-02462-6 · Cited by 17
“If the value of SUCRA is higher, it is more probable that the provided treatment ranks or takes effect at the top; on the contrary, the SUCRA value is zero, the treatment has the worst result [39].”
BackgroundBoussageon, R., Blanchard, C., Charuel, É., Ménini, T., Pereira, B., Naudet, F., Kassaï, B., Gueyffier, F., Cucherat, M., & Vaillant-Roussel, H. (2022) · Therapies · doi:10.1016/j.therap.2022.10.008 · Cited by 22
Mei, F., Yao, M., Wang, Y., Huan, J., Ma, Y., Li, G., Zou, K., Li, L., & Sun, X. (2024) · BMC Medicine · doi:10.1186/s12916-024-03778-1 · Cited by 17
Self-citationXu, C., Liu, T.-Z., Jia, P., Liu, Y., Li, L., Cheng, L.-L., & Sun, X. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0623-6 · Cited by 15
Self-citationPatella tendinopathy Zoobiquity — What can we learn from dogs?
Dan, M. J., Crowley, J. D., Broe, D., Cross, M. J., Tan, C., & Walsh, W. R. (2018) · The Knee · doi:10.1016/j.knee.2018.11.010 · Cited by 15
Recommendations to conduct and report systematic reviews in medical literature: a scoping review
Penedones, A., Alves, C., & Marques, F. B. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0870-1 · Cited by 17
“In MEDLINE, one of the largest databases of medical literature, more than 8 million articles were indexed in 23 years [12].”
BackgroundInfluentialFolb, B. L., Klem, M. L., Youk, A. O., Dahm, J. J., He, M., Ketchum, A., Wessel, C. B., & Hartman, L. M. (2020) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2020.492 · Cited by 15
“Systematic reviews are an increasingly prevalent type of research project [6] and represent an opportunity for medical or health sciences libraries to promote and expand the services that they offer to their communities [7].”
BackgroundCho, S.-H., & Shin, I. (2021) · Healthcare · doi:10.3390/healthcare9101368 · Cited by 16
Declining Quality of Systematic Reviews in Orthopaedic Sports Medicine: An Updated Systematic Review
Lee, D., Paul, R. W., Lencer, A. J., Tjoumakaris, F. P., & Freedman, K. B. (2022) · Arthroscopy Sports Medicine and Rehabilitation · doi:10.1016/j.asmr.2021.11.013 · Cited by 16
“A recent assessment suggests that more than 8,000 systematic reviews are indexed in MEDLINE annually, indicating a need for more regular evaluations.(9) In sports medicine alone, queries in MEDLINE reveal that the number of systematic reviews related to sports medicine have exploded from fewer than 10 per year in 2012…”
BackgroundCrawford, F., Nicolson, D. J., Amanna, A. E., & Smith, M. C. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01738-y · Cited by 15
“This mirrors the pattern observed more widely in the biomedical literature by researchers who have recommended certified training for journal editors in how to implement PRISMA and facilitate its use by peer reviewers as one way to improve the value of systematic reviews [9].”
BackgroundMethodInfluentialInverse publication reporting bias favouring null, negative results
Ioannidis, J. P. A. (2023) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2023-112292 · Cited by 18
Luhnen, M., Prediger, B., Neugebauer, E. A. M., & Mathes, T. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0639-8 · Cited by 15
“[13] which provides an overview of epidemiology and reporting characteristics of systematic reviews of biomedical research.”
BackgroundSandau, N., Aagaard, T. V., Hróbjartsson, A., Harris, I. A., & Brorson, S. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.02.002 · Cited by 19
López-Valverde, N., & Rueda, J. A. B. (2024) · Healthcare · doi:10.3390/healthcare12181844 · Cited by 19
“[24] Cao et al. [25] It has been reported that approximately SRs appear [40] and that the synthesis of such a large amount of the of methodological tools capable of handling such a volume same time, improving access to information with the aim by healthcare professionals [41].”
BackgroundBedenlier, S., Buntins, K., Bond, M., Händel, M., & Marín, V. I. (2025) · Review of Education · doi:10.1002/rev3.70022 · Cited by 16
“In a study of 300 epidemiological systematic reviews (Page et al., 2016), only 43% stated that they considered all languages, 31% explicitly included English-only studies, 10% de-clared that English and at least one language other than English was included, and 16% did not report any language…”
Hu, K., Zhao, L., Zhou, Q., Mei, F., Gao, Q., Chen, F., Jiang, M., Zhao, B., Zhang, W., Kwong, J. S. W., et al. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1476 · Cited by 16
“Therefore, it is impossible to meet the increasing number of non-Cochrane SRs.(23) PROSPERO is an open-access platform for SR registration, apart from peer-review, all potential advantages of publishing SR protocols could be achieved through registering the SR with PROSPERO (provided that information is presented in t…”
BackgroundSandau, N., Buxbom, P., Hróbjartsson, A., Harris, I. A., & Brorson, S. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.10.014 · Cited by 14
Melendez-Araújo, M. S., Berber, L. C. L., de Sousa, K. M. Q., Figueiredo, A. C. M. G., Lamarca, F., Dutra, E. S., & de Carvalho, K. M. B. (2022) · Obesity Surgery · doi:10.1007/s11695-022-06269-5 · Cited by 14
“Research Question The research question was elaborated using the Population, Exposure, and Comparison Outcome (PECO) strategy, as recommended by the PRISMA protocol [29, 30], as follows: “Do socioeconomic factors influence weight loss 12 months after bariatric surgery?”.”
MethodSystematic reviews in restorative dentistry: discussing relevant aspects
Sarkis‐Onofre, R., Pereira‐Cenci, T., Tricco, A. C., Demarco, F. F., Moher, D., & Cenci, M. S. (2019) · Journal of Esthetic and Restorative Dentistry · doi:10.1111/jerd.12463 · Cited by 17
Self-citationOverall bias and sample sizes were unchanged in ICU trials over time: a meta-epidemiological study
Anthon, C. T., Granholm, A., Perner, A., Laake, J. H., & Møller, M. H. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.05.021 · Cited by 16
Polus, S., Mathes, T., Klingler, C., Messer, M., Gerhardus, A., Stegbauer, C., Willms, G., Ehrenreich, H., Marckmann, G., & Pieper, D. (2019) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462319000515 · Cited by 16
Partially systematic thoughts on the history of systematic reviews
Clarke, M. J. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0833-3 · Cited by 15
Luhnen, M., Prediger, B., Neugebauer, E. A. M., & Mathes, T. (2018) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462318000624 · Cited by 13
“(12), which provides a similar overview of epidemiology and reporting characteristics of systematic reviews of biomedical research.”
van Zwieten, A., Blyth, F., Wong, G., & Khalatbari‐Soltani, S. (2023) · International Journal of Epidemiology · doi:10.1093/ije/dyad174 · Cited by 15
Miura, T., Yamamoto, N., Shiroshita, A., Tsuge, T., Saitsu, A., Yoshitani, J., Nakao, S., & Takami, K. (2024) · JBJS Reviews · doi:10.2106/jbjs.rvw.24.00120 · Cited by 13
Updating Perspectives on Meta-Analyses in the Field of Radiation Oncology
Shin, I., & Rim, C. H. (2021) · Medicina · doi:10.3390/medicina57020117 · Cited by 14
“therapeutics were based on the same [25].”
BackgroundSystematic review and meta-analysis: Which pitfalls to avoid during this process
Granados-Duque, V., & García‐Perdomo, H. A. (2021) · International braz j urol · doi:10.1590/s1677-5538.ibju.2020.0746 · Cited by 14
“Searches should be motivated directly by the eligibility criteria for the review, and, significantly, all types of eligible studies are considered when planning the search (11).”
BackgroundRethlefsen, M. L., Schroter, S., Bouter, L. M., Moher, D., Ayala, A. P., Kirkham, J. J., & Zeegers, M. P. (2021) · Trials · doi:10.1186/s13063-021-05738-z · Cited by 17
“We identified four key items from the PRISMA-S checklist that are essential for reporting searches from bibliographic databases, such as MEDLINE, Embase, and Cochrane CENTRAL, the type of information source used in nearly all of systematic reviews [9, 14].”
BackgroundMethodSelf-citationMei, F., Chen, F., Hu, K., Gao, Q., Zhao, L., Shang, Y., Zhao, B. Q., & Ma, B. (2022) · Journal of Surgical Research · doi:10.1016/j.jss.2022.04.026 · Cited by 13
Liu, Z., Li, Y., Wang, J., Wu, G.-H., & Shi, P. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.1032253 · Cited by 14
Micronutrient perspective on COVID-19: Umbrella review and reanalysis of meta-analyses
Xie, Y., Xu, J., Zhou, D., Guo, M., Zhang, M., Gao, Y., Liu, M., Shi, J., Yang, K., Zheng, Q., et al. (2023) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2023.2174948 · Cited by 15
“As the number of published systematic reviews increases (Page et al. 2016), the assessment associations in reviews that address an identical or similar research question is overlapping, as evidenced by the inclusion of many of the same underlying original studies.”
ResultSearch strategies (filters) to identify systematic reviews in MEDLINE and Embase
Liquitay, C. M. E., Garegnani, L., Garrote, V., Solà, I., & Franco, J. V. A. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000054.pub2 · Cited by 24
Wang, J., Jin-hui, T., Han, L., Ma, Y., & Zhang, J. (2019) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12414 · Cited by 14
Quality of Literature Searches Published in Leading Neurosurgical Journals: A Review of Reviews
O’Donohoe, T. J., Bridson, T. L., Shafik, C. G., Wynne, D., Dhillon, R., & Tee, J. (2021) · Neurosurgery · doi:10.1093/neuros/nyaa573 · Cited by 15
Designing experiments informed by observational studies
Rosenman, E. T. R., & Owen, A. B. (2021) · Journal of Causal Inference · doi:10.1515/jci-2021-0010 · Cited by 19
Mathes, T., & Kuß, O. (2021) · Research Methods in Medicine & Health Sciences · doi:10.1177/2632084321996225 · Cited by 13
“, who analysed 119 non-Cochrane systematic reviews of randomized controlled trials and observational studies.(7,8) For all other design factors we used the review of Turner et al.”
MethodHu, K., Mei, F., Gao, Q., Zhao, L., Chen, F., Liu, Q., Suo, L., Ma, Y., Zhang, T., Zhang, W., et al. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.04.14.040865 · Cited by 14
Koçak, B., Keleş, A., & Köse, F. (2024) · Diagnostic and Interventional Radiology · doi:10.4274/dir.2024.232604 · Cited by 12
Andrić, A., Peričić, T. P., Tokalić, R., Marušić, A., & Puljak, L. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111870 · Cited by 13
Tierney, J. F., Vale, C. L., Parelukar, W. R., Rydzewska, L. H. M., & Halabi, S. (2019) · European Urology Focus · doi:10.1016/j.euf.2019.01.005 · Cited by 12
Zheng, Q., Lai, F., Ли, Б., Xu, J., Long, J., Peng, S., Li, Y., Liu, Y., & Xiao, H. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.639652 · Cited by 14
O’Hearn, K., MacDonald, C., Tsampalieros, A. K., Kadota, L., Sandarage, R. V., Jayawarden, S. K., Datko, M., Reynolds, J. M., Bui, T., Sultan, S. A., et al. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01335-5 · Cited by 13
“, [30] using very similar methodology and SR definitions, identified 682 systematic reviews indexed in MEDLINE during a single month in 2014; these numbers would suggest an approximate three-fold increase in a five-year period.”
BackgroundMethodSelf-citationRouleau, G., Hong, Q. N., Kaur, N., Gagnon, M., Côté, J., Bouix‐Picasso, J., & Pluye, P. (2021) · Journal of Mixed Methods Research · doi:10.1177/15586898211054243 · Cited by 15
“…of published systematic reviews increasing each and every day, researchers are now interested in combining many systematic reviews into one single document, i.e. systematic reviews of systematic reviews (SRSRs) (Hartling et al., 2012; Page et al., 2016; Pieper et al., 2012; Pollock et al., 2016).”
Backgroundde Lima, D. F., Lima, L. A., Sampaio, A. A., & Stobäus, C. D. (2022) · Perspectivas em Diálogo revista de educação e sociedade · doi:10.55028/pdres.v9i19.12978 · Cited by 12
Chen, Z., He, L., Liu, S., Liu, H., Yu, J., & Li, Y. (2022) · Journal of Tissue Viability · doi:10.1016/j.jtv.2022.06.005 · Cited by 13
Wei, X.-M., Liu, Z., Lv, L.-C., Wu, G.-H., Sun, P.-Y., Gu, C.-P., & Shi, P. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2023.1159216 · Cited by 14
Meta-analyses in environmental and occupational health
Ioannidis, J. P. A. (2018) · Occupational and Environmental Medicine · doi:10.1136/oemed-2016-104128 · Cited by 12
Page, M. J., Bero, L. A., Kroeger, C. M., Dai, Z., McDonald, S., Forbes, A. B., & McKenzie, J. E. (2019) · F1000Research · doi:10.12688/f1000research.20726.2 · Cited by 14
“…. to identify articles as SRs with meta-analysis, i.e. we will include articles with explicitly stated methods of study identification (e.g. a search strategy), explicitly stated methods of study selection (e.g. eligibility criteria and selection process), and a meta-analysis of study results 17 .”
Self-citationWayant, C., Puljak, L., Bibens, M. E., & Vassar, M. B. (2020) · Journal of General Internal Medicine · doi:10.1007/s11606-020-05639-y · Cited by 12
Al-Akkawi, A., Khabsa, J., Noubani, A., Jamali, S., Sibai, A. M., & Lotfi, T. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-00924-0 · Cited by 12
“Worldwide, publication rates of systematic reviews have accelerated steadily in recent years, with one recent report counting a three-fold increase over the last decade [25].”
BackgroundMethodological quality and risk of bias of meta-analyses of pharmacy services: A systematic review
Bonetti, A. D. F., Tonin, F. S., Rocca, A. M. D., Lucchetta, R. C., Fernández-Llimós, F., & Pontarolo, R. (2020) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2020.12.011 · Cited by 15
Oliveira, N. L., Botton, C. E., Nardi, A. T. D., & Umpierre, D. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01845-9 · Cited by 13
“Additionally, systematic reviews with meta-analysis (SRMAs) are used to inform clinical decision-making, development of clinical practice guidelines and health policies [2, 8].”
BackgroundMethodMethods for Combining Observational and Experimental Causal Estimates: A Review
Rosenman, E. T. R. (2025) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.70027 · Cited by 17
“Page et al. (2016) found in a 2014 survey that of 300 such reviews, just 36% were limited to experimental and quasi-experimental data.”
The role of ecoacoustics in monitoring ecosystem degradation and restoration
Gitau, C., Kettel, E. F., Abrahams, C., Webala, P. W., & Uzal, A. O. (2025) · Restoration Ecology · doi:10.1111/rec.70168 · Cited by 13
“We structured the eligibility criteria reporting following the Population Intervention Comparison Outcome (PICO) framework (Page et al. 2016).”
Search strategies (filters) to identify systematic reviews in MEDLINE and Embase
Franco, J. V. A., Garrote, V., Vietto, V., Liquitay, C. M. E., & Solà, I. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000054 · Cited by 11
Most Cochrane reviews have not been updated for more than 5 years
Hoffmeyer, B., Andersen, M. Z., Fonnes, S., & Rosenberg, J. (2021) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12447 · Cited by 11
Zeraatkar, D., Kohut, A., Bhasin, A. A., Morassut, R. E., Churchill, I. F., Gupta, A. A., Lawson, D. O., Miroshnychenko, A., Sirotich, E., Aryal, K., et al. (2021) · BMJ Nutrition Prevention & Health · doi:10.1136/bmjnph-2021-000248 · Cited by 17
Guidance to best tools and practices for systematic reviews
Kolaski, K., Logan, L. R., & Ioannidis, J. P. A. (2023) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.14295 · Cited by 11
Yao, M., Wang, Y., Busse, J. W., Briel, M., Mei, F., Li, G., Zou, K., Li, L., & Sun, X. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-073232 · Cited by 12
Self-citationBougioukas, K. I., Karakasis, P., Pamporis, K., Bouras, E., & Haidich, A. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1705 · Cited by 11
Tsuge, T., Yamamoto, N., Tomita, Y., Hagiyama, A., Shiratsuchi, D., Kato, Y., Taito, S., & Yorifuji, T. (2025) · Physical Therapy · doi:10.1093/ptj/pzaf032 · Cited by 11
Cochrane overviews: how can we optimize their impact on evidence-based rehabilitation?
Pollock, A., & van Wijck, F. (2019) · European Journal of Physical and Rehabilitation Medicine · doi:10.23736/s1973-9087.19.05780-0 · Cited by 11
Ivermectin and the Integrity of Healthcare Evidence During COVID-19
O’Mathúna, D. P. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.788972 · Cited by 12
Conducting separate reviews of benefits and harms could improve systematic reviews and meta-analyses
Mayo-Wilson, E., Qureshı, R., & Li, T. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02234-0 · Cited by 11
Pérez-Palma, L., Manzanares‐Céspedes, M. C., & de Veciana, E. G. (2018) · Journal of the American Podiatric Medical Association · doi:10.7547/17-102 · Cited by 11
Ruano, J., Gay-Mimbrera, J., Aguilar-Luque, M., Gómez-García, F. J., Parra-Peralbo, E., & Isla-Tejera, B. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-02114-0 · Cited by 13
Yang, Q., Xian, H., Xianzong, C., Wu, X., Meng, J., Chen, W., & Zeng, Z. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02622-0 · Cited by 10
“High-quality SRs could make causal references and clinical treatment assessments, which has become increasingly important in clinical decision-making and informing clinical guidelines and preventive interventions [9, 10].”
BackgroundTackling Adolescent Anemia: A Systematic Review of Integrated Interventions
Marisa, D. E., Dioso, R. I., Elengoe, A., Kamasturyani, Y., & Iyos, R. (2025) · Al-Rafidain Journal of Medical Sciences · doi:10.54133/ajms.v8i1.1601 · Cited by 14
Kim, W., Kim, J. H., Ki, Y., Chong, S., & Kim, T. J. (2022) · Academic Radiology · doi:10.1016/j.acra.2022.03.028 · Cited by 13
Minh, L. H. N., Le, H., Tawfik, G. M., Makram, O. M., Tieu, T. M., Thang, T. L. L., Hung, D. T., Tran, V. P., Shahin, K. M., Abozaid, A. A., et al. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02210-8 · Cited by 10
Khademi, A., Iranmanesh, P., Mosayebi, N., Heydari, M., & Bagherieh, S. (2023) · Dental Research Journal · doi:10.4103/1735-3327.379632 · Cited by 10
“Does premedication (I) improve the success rate of IANB (O) compared to placebo (C) in adult patients (P) diagnosed with irreversible pulpitis in molar teeth?”
BackgroundInfluentialMethodological quality and reporting of systematic reviews in hand and wrist pathology
Wasiak, J., Shen, A. Y., Ware, R. S., O’Donohoe, T. J., & Faggion, C. M. (2017) · Journal of Hand Surgery (European Volume) · doi:10.1177/1753193417712660 · Cited by 10
“Although systematic literature examination has been demonstrated to be reliable and valid for a range of health care enquiries, they may be of limited value when the methods employed to conduct the review are flawed or the reporting incomplete (Page et al., 2016).”
BackgroundMethodInfluentialSharp, M. K., Tyner, B., Baki, D. A. B. A., Farrell, C., Devane, D., Mahtani, K. R., Smith, S. M., O’Neill, M., Ryan, M., & Clyne, B. (2021) · HRB Open Research · doi:10.12688/hrbopenres.13325.1 · Cited by 11
Farid‐Kapadia, M., Joachim, K. C., Balasingham, C., Clyburne-Sherin, A., & Offringa, M. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0423-9 · Cited by 10
“A recent evaluation of the quality of reporting of SRs identified that while the number of published SRs has increased threefold since 2004, the overall quality of reporting have not improved substantially [39].”
BackgroundChauvin, A., Moher, D., Altman, D. G., Schriger, D. L., Alam, S., Hopewell, S., Shanahan, D. R., Recchioni, A., Ravaud, P., & Boutron, I. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-017462 · Cited by 11
Self-citationXu, C., Liu, Y., Zhang, C., Kwong, J. S. W., Zhou, J., Ge, L., Huang, J., & Liu, T.-Z. (2019) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-019-02869-4 · Cited by 10
Jesus, T. S., Castellini, G., & Gianola, S. (2021) · The International Journal of Health Planning and Management · doi:10.1002/hpm.3401 · Cited by 10
Dewidar, O., Rader, T., Waddington, H. S., Nicholls, S. G., Little, J., Hardy, B.-J., Horsley, T., Young, T., Cuervo, L. G., Sharp, M. K., et al. (2022) · F1000Research · doi:10.12688/f1000research.122185.1 · Cited by 11
Publication trends of study protocols in rehabilitation
Jesus, T. S., & Colquhoun, H. L. (2018) · European Journal of Physical and Rehabilitation Medicine · doi:10.23736/s1973-9087.17.04858-4 · Cited by 11
Introduction to Systematic Reviews
Li, T., Saldanha, I. J., & Robinson, K. A. (2022) · Springer eBooks · doi:10.1007/978-3-319-52636-2_194 · Cited by 10
Pieper, D., & Mathes, T. (2017) · BMJ Evidence-Based Medicine · doi:10.1136/ebmed-2016-110609 · Cited by 10
“First, we chose a list of journals that were included in a survey of systematic reviews to make sure that these journals were publishing systematic reviews (n=185).(11) This list was augmented by a search of journals that published updates of systematic reviews in the first three quarters of 2016 because we recognised…”
MethodRotta, I., Diniz, J. A., & Fernández-Llimós, F. (2024) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2024.11.002 · Cited by 10
Understanding client violence through social learning theory: A scoping review
Pretorius, L., & Herbst, A. G. (2025) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2025.101513 · Cited by 9
Declaração PRISMA 2020: uma Diretriz Atualizada para Publicação de Revisões Sistemáticas
Page, M., McKenzie, J., Bossuyt, P. M., Boutron, I., Hoffman, T., Mulrow, C. D., Shamseer, L., Tetzlaff, L., Akl, E., Brennan, S., et al. (2024) · Germinare — Revista Científica do Instituto Piaget · doi:10.5281/zenodo.13271468 · Cited by 32
Self-citationKolaski, K., Clarke, M. J., & Logan, L. R. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111460 · Cited by 10
Surgical Outcome Reporting. Moving From a Comic to a Tragic Opera?
Abbassi, F., Pfister, M., Domenghino, A., Puhan, M. A., & Clavien, P. (2024) · Annals of Surgery · doi:10.1097/sla.0000000000006226 · Cited by 9
Pieper, D., Waltering, A., Holstiege, J., & Büchter, R. B. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0722-9 · Cited by 9
Updating systematic reviews can improve the precision of outcomes: a comparative study
Gao, Y., Yang, K., Cai, Y., Shi, S., Liu, M., Zhang, J., Wu, J., Tian, J., & Song, F. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.05.019 · Cited by 9
“It was estimated that more than 8,000 SRs were indexed in Medline annually, which is equivalent to a threefold increase over the past de cade [4, 5].”
BackgroundEnsuring the rigor in systematic reviews: Part 1, the overview
Brackett, A. L., & Batten, J. (2020) · Heart & Lung · doi:10.1016/j.hrtlng.2020.03.015 · Cited by 11
Banno, M., Tsujimoto, Y., & Kataoka, Y. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01083-y · Cited by 9
Barčot, O., Borić, M., Došenović, S., & Puljak, L. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01339-1 · Cited by 10
“reviews do not report on RoB [20, 21], when they do, their reporting is sub-optimal [1, 22], and their authors also use Cochrane RoB tool inadequately [22].”
MethodAlSaleh, E., Dutta, A., Dummer, P. M. H., FARNELL, D. J. J., & Vianna, M. E. (2021) · Journal of Dentistry · doi:10.1016/j.jdent.2021.103813 · Cited by 9
Metadata
- Authors
- Page, M. J., Shamseer, L., Altman, D. G., Tetzlaff, J., Sampson, M., Tricco, A. C., Catalá-López, F., Li, L., Reid, E. K., Sarkis-Onofre, R., & Moher, D.
- Affiliations
- University of Bristol (GB)
- University of Ottawa (CA)
- University of Oxford (GB)
- Ottawa Hospital Research Institute (CA)
- Children's Hospital of Eastern Ontario (CA)
- St. Michael's Hospital (CA)
- Universitat de València (ES)
- Lanzhou University (CN)
- Vancouver General Hospital (CA)
- Corresponding author
- Moher, David
- ORCID
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-05-24
- Volume
- 13
- Issue
- 5
- Pages
- e1002028
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC4878797
- OpenAlex
- W2396846174
- Semantic Scholar
- 363d54e2baf229adfd585079bfd7c18ae8feed26
- Cited by
- 768
- References
- 41
- Citations by year
- 2026: 25 · 2025: 43 · 2024: 85 · 2023: 73 · 2022: 85 · 2021: 146 · 2020: 95 · 2019: 83 · 2018: 58 · 2017: 60 · 2016: 15
- FWCI
- 24.71
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Explore Bristol Research (publishedVersion, other-oa)
- Monash University Research Portal (Monash University) (acceptedVersion, other-oa)
- Lanzhou University Institutional Repository (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Bristol Research (University of Bristol) (submittedVersion, other-oa)
- Funders
- National Institute for Health and Care Research
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
- Governo Brasil
- Generalitat Valenciana (PROMETEOII/2015/021)
- Canadian Institutes of Health Research (1088535)
- Medical Research Council (MR/J00488X/1)
- National Health and Medical Research Council (1088535)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- systematic reviews, reporting quality, meta-analysis, risk of bias assessment, publication bias, research funding disclosure, biomedical literature, research quality improvement, research integrity, research transparency, research accountability, research reproducibility, research credibility, research trustworthiness
- MeSH terms
- Cross-Sectional Studies, Epidemiologic Methods, Humans, Research Design, Review Literature as Topic, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.