Overlapping meta-analyses on the same topic: survey of published studies
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To assess how common it is to have multiple overlapping meta-analyses of randomized trials published on the same topic. DESIGN: Survey of published meta-analyses. DATA SOURCES: PubMed. STUDY SELECTION AND METHODS: Meta-analyses published in 2010 were identified, and 5% of them were randomly selected. We further selected those that included randomized trials and examined effectiveness of any medical intervention. For eligible meta-analyses, we searched for other meta-analyses on the same topic (covering the same comparisons, indications/settings, and outcomes or overlapping subsets of them) published until February 2013. RESULTS: Of 73 eligible meta-analyses published in 2010, 49 (67%) had at least one other overlapping meta-analysis (median two meta-analyses per topic, interquartile range 1-4, maximum 13). In 17 topics at least one author was involved in at least two of the overlapping meta-analyses. No characteristics of the index meta-analyses were associated with the potential for overlapping meta-analyses. Among pairs of overlapping meta-analyses in 20 randomly selected topics, 13 of the more recent meta-analyses did not include any additional outcomes. In three of the four topics with eight or more published meta-analyses, many meta-analyses examined only a subset of the eligible interventions or indications/settings covered by the index meta-analysis. Conversely, for statins in the prevention of atrial fibrillation after cardiac surgery, 11 meta-analyses were published with similar eligibility criteria for interventions and setting: there was still variability on which studies were included, but the results were always similar or even identical across meta-analyses. CONCLUSIONS: While some independent replication of meta-analyses by different teams is possibly useful, the overall picture suggests that there is a waste of efforts with many topics covered by multiple overlapping meta-analyses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188
Epidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891
Ioannidis, J. P. A. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.081086 · Cited by 716
Self-citationAn international registry of systematic-review protocols
Booth, A., Clarke, M., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2011) · The Lancet · doi:10.1016/s0140-6736(10)60903-8 · Cited by 512
Cited by
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120
The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483
Self-citationPage, M. J., Shamseer, L., Altman, D. G., Tetzlaff, J., Sampson, M., Tricco, A. C., Catalá-López, F., Li, L., Reid, E. K., Sarkis-Onofre, R., et al. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002028 · Cited by 768
“This has resulted in a large number of overlapping SRs (one estimate suggests 67% of meta-analyses have at least one overlapping meta-analysis within a 3-y period) [33].”
BackgroundHow to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760
Self-citationTen simple rules for conducting umbrella reviews
Fusar-Poli, P., & Radua, J. (2018) · Evidence Based Mental Health · doi:10.1136/ebmental-2018-300014 · Cited by 724
“17 Larger databases can increase the statistical power and therefore improve accurateness of the estimates and interpretability of the results.”
BackgroundWhat causes psychosis? An umbrella review of risk and protective factors
Radua, J., Ramella‐Cravaro, V., Ioannidis, J. P. A., Reichenberg, A., Phiphopthatsanee, N., Amir, T., Yenn Thoo, H., Oliver, D., Davies, C., Morgan, C., et al. (2018) · World Psychiatry · doi:10.1002/wps.20490 · Cited by 553
Self-citationPrevention of Psychosis: Advances in Detection, Prognosis, and Intervention
Fusar-Poli, P., Salazar de Pablo, G., Correll, C. U., Meyer-Lindenberg, A., Millan, M. J., Borgwardt, S., Galderisi, S., Bechdolf, A., Pfennig, A., Kessing, L. V., et al. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.4779 · Cited by 476
Sideri, S., Papageorgiou, S. N., & Eliades, T. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.01.003 · Cited by 388
“Furthermore, a large number of systematic reviews seem to have overlap in terms of eligible interventions, settings, and types of studies [10]—something that is deemed as unnecessary duplication or research waste and can be theoretically prevented by the a priori registration of the systematic reviews’ protocol in an…”
BackgroundBelbasis, L., Bellou, V., & Ioannidis, J. P. A. (2022) · BMJ Medicine · doi:10.1136/bmjmed-2021-000071 · Cited by 325
Self-citationHoffmann, F., Allers, K., Rombey, T., Helbach, J., Hoffmann, A., Mathes, T., & Pieper, D. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.05.022 · Cited by 278
Bougioukas, K. I., Liakos, A., Tsapas, A., Ntzani, E., & Haidich, A.-B. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.002 · Cited by 251
Pelsser, L. M., Frankena, K., Toorman, J., & Rodrigues Pereira, R. (2017) · PLOS ONE · doi:10.1371/journal.pone.0169277 · Cited by 145
How to reduce unnecessary duplication: use PROSPERO
Moher, D., Booth, A., & Stewart, L. (2014) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.12657 · Cited by 113
Ebrahim, S., Bance, S., Athale, A., Malachowski, C., & Ioannidis, J. P. A. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.021 · Cited by 107
Self-citationUseem, J., Brennan, A., LaValley, M., Vickery, M., Ameli, O., Reinen, N., & Gill, C. J. (2015) · PLOS ONE · doi:10.1371/journal.pone.0144980 · Cited by 105
Replication, Duplication, and Waste in a Quarter Million Systematic Reviews and Meta-Analyses
Siontis, K. C., & Ioannidis, J. P. A. (2018) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.118.005212 · Cited by 73
Self-citationBarbateskovic, M., Krauss, S. R., Collet, M. O., Larsen, L. K., Jakobsen, J. C., Perner, A., & Wetterslev, J. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024562 · Cited by 54
Identification of problems in search strategies in Cochrane Reviews
Franco, J. V. A., Garrote, V. L., Escobar Liquitay, C. M., & Vietto, V. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1302 · Cited by 48
“These exclusion criteria were taken from a previous methodological study that evaluated SRs of interventions.(20)”
MethodDifferences in Overlapping Meta-Analyses of Vitamin D Supplements and Falls
Bolland, M. J., Grey, A., & Reid, I. R. (2014) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2014-2562 · Cited by 49
Solanes, A., Albajes-Eizagirre, A., Fullana, M. A., Fortea, L., Fusar-Poli, P., Torrent, C., Solé, B., Bonnín, C. M., Shin, J. I., Vieta, E., et al. (2021) · Revista de Psiquiatría y Salud Mental · doi:10.1016/j.rpsm.2020.08.002 · Cited by 19
Bowker, J. (2015) · doi:10.1017/cbo9781316048023 · Cited by 11
Metadata
- Authors
- Siontis, K. C., Hernandez-Boussard, T., & Ioannidis, J. P. A.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2013-07-19
- Volume
- 347
- Issue
- jul19 1
- Pages
- f4501-f4501
- ISSN
- 1756-1833 (ISSN-L)
- OpenAlex
- W2152545213
- Cited by
- 248
- References
- 4
- FWCI
- 20.08
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.