The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Accumulating Research: A Systematic Account of How Cumulative Meta-Analyses Would Have Provided Knowledge, Improved Health, Reduced Harm and Saved Resources
Open accessAbstract
BACKGROUND: "Cumulative meta-analysis" describes a statistical procedure to calculate, retrospectively, summary estimates from the results of similar trials every time the results of a further trial in the series had become available. In the early 1990 s, comparisons of cumulative meta-analyses of treatments for myocardial infarction with advice promulgated through medical textbooks showed that research had continued long after robust estimates of treatment effects had accumulated, and that medical textbooks had overlooked strong, existing evidence from trials. Cumulative meta-analyses have subsequently been used to assess what could have been known had new studies been informed by systematic reviews of relevant existing evidence and how waste might have been reduced. METHODS AND FINDINGS: We used a systematic approach to identify and summarise the findings of cumulative meta-analyses of studies of the effects of clinical interventions, published from 1992 to 2012. Searches were done of PubMed, MEDLINE, EMBASE, the Cochrane Methodology Register and Science Citation Index. A total of 50 eligible reports were identified, including more than 1,500 cumulative meta-analyses. A variety of themes are illustrated with specific examples. The studies showed that initially positive results became null or negative in meta-analyses as more trials were done; that early null or negative results were over-turned; that stable results (beneficial, harmful and neutral) would have been seen had a meta-analysis been done before the new trial; and that additional trials had been much too small to resolve the remaining uncertainties. CONCLUSIONS: This large, unique collection of cumulative meta-analyses highlights how a review of the existing evidence might have helped researchers, practitioners, patients and funders make more informed decisions and choices about new trials over decades of research. This would have led to earlier uptake of effective interventions in practice, less exposure of trial participants to less effective treatments, and reduced waste resulting from unjustified research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This evidence can also help researchers to optimise the usefulness of the new trial by informing design aspects such as outcome definition and sample size.143 144 145”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [144]
In the citing paper
“or to trial participants being deprived of effective interventions or exposed to harmful interventions.144 149 150 151”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [144]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
OARSI recommendations for the management of hip and knee osteoarthritis
Zhang, W., Nuki, G., Moskowitz, R. W., Abramson, S. B., Altman, R. D., Arden, N., Bierma‐Zeinstra, S., Brandt, K. D., Croft, P. R., Doherty, M., et al. (2010) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2010.01.013 · Cited by 1,726
How to increase value and reduce waste when research priorities are set
Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62229-1 · Cited by 1,436
Self-citationCollaborative Care for Depression: A Cumulative Meta-analysis and Review of Longer-term Outcomes
Gilbody, S. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.21.2314 · Cited by 1,340
Cumulative Meta-Analysis of Therapeutic Trials for Myocardial Infarction
Lau, J., Antman, E. M., Jimenez-Silva, J., Kupelnick, B., Mosteller, F., & Chalmers, T. C. (1992) · New England Journal of Medicine · doi:10.1056/nejm199207233270406 · Cited by 1,140
Kirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133
Effects of Augmented Exercise Therapy Time After Stroke: A Meta-Analysis
Kwakkel, G., van Peppen, R., Wagenaar, R. C., Wood Dauphinee, S., Richards, C., Ashburn, A., Miller, K., Lincoln, N., Partridge, C., Wellwood, I., et al. (2004) · Stroke · doi:10.1161/01.str.0000143153.76460.7d · Cited by 1,081
Effect of tranexamic acid on surgical bleeding: systematic review and cumulative meta-analysis
Ker, K., Edwards, P. J., Perel, P., Shakur‐Still, H., & Roberts, I. (2012) · BMJ · doi:10.1136/bmj.e3054 · Cited by 997
Publication bias in clinical trials due to statistical significance or direction of trial results
Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006.pub3 · Cited by 898
Self-citationIncreasing value and reducing waste: addressing inaccessible research
Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62296-5 · Cited by 887
Flagged first, then by citations
Research works printed but not linked: 2
- G Deshpande, 2010, Trial sequential analysis of updated meta-analysis of probiotics for preventing necrotising enterocolitis in preterm VLBW neonates: are the results conclusive? Journal of Paediatrics and Child Health, Conference: 14th Annual Congress of the Perinatal Society of Australia and New Zealand, PSANZ 2010 Wellington New Zealand, 46, 65
- S Palmer, 2010, Erythropoiesis-stimulating agents in people with chronic kidney disease: a cumulative meta-analysis, NDT Plus, Conference: 17th ERA-EDTA Congress - II DGfN Congress Munich Germany, 3, iii80
Cited by
Sorted by citations
Items 101–121 of 121
The applicability and utilization of systematic reviews for clinical practice
Lindsley, K. B. (2022) · Utrecht University Repository (Utrecht University) · doi:10.33540/1513
Jia, Y., Liang, J., Wang, W., Wei, X., Xiao, S., & Robinson, K. A. (2023) · BMC Medicine · doi:10.1186/s12916-023-02749-2 · Cited by 1
Ringsten, M., Färnqvist, K., Bruschettini, M., & Johansson, M. (2024) · medRxiv · doi:10.1101/2024.06.11.24307851
Crombie, I. (2021) · Wiley eBooks · doi:10.1002/9781394322183.ch3
Widantara, H., Nuraini, D. M., Romadhona, E. I., Sutanti, S., & Andityas, M. (2025) · Journal of Fish Diseases · doi:10.1111/jfd.14140 · Cited by 2
Kabić, T., Munitić, M. Š., Weerasekara, I., Bała, M. M., Zając, J., Briel, M., Pieper, D., & Puljak, L. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.112008
Das, A., Kumar, S., & Bhadoria, A. S. (2025) · Indian Journal of Community Medicine · doi:10.4103/ijcm.ijcm_713_24
Jia, Y., Liang, J., Wang, W., Wei, X., Xiao, S., & Robinson, K. A. (2023) · Figshare · doi:10.6084/m9.figshare.22602646
Jia, Y., Liang, J., Wang, W., Wei, X., Xiao, S., & Robinson, K. A. (2023) · Figshare · doi:10.6084/m9.figshare.22602634
Jia, Y., Liang, J., Wang, W., Wei, X., Xiao, S., & Robinson, K. A. (2023) · Figshare · doi:10.6084/m9.figshare.22602649
Jia, Y., Liang, J., Wang, W., Wei, X., Xiao, S., & Robinson, K. A. (2023) · Figshare · doi:10.6084/m9.figshare.22602643
Duffy, M., Lynch, A., Reddin, C., Judge, C. S., O'Donnell, M. J., & Murphy, R. (2023) · Figshare · doi:10.6084/m9.figshare.24439346
Jia, Y., Liang, J., Wang, W., Wei, X., Xiao, S., & Robinson, K. A. (2023) · Figshare · doi:10.6084/m9.figshare.22602652
Jia, Y., Liang, J., Wang, W., Wei, X., Xiao, S., & Robinson, K. A. (2023) · Figshare · doi:10.6084/m9.figshare.22602640
Jia, Y., Liang, J., Wang, W., Wei, X., Xiao, S., & Robinson, K. A. (2023) · Figshare · doi:10.6084/m9.figshare.22602637
Tavernier, E. (2016) · theses.fr (ABES) · doi:10.70675/dc94d400ze0b4z4d1fzbb24z29bfd936144b
Le gaspillage évitable de la recherche dans les essais cliniques
Yordanov, Y. (2019) · theses.fr (ABES) · doi:10.70675/130e8831z862fz47f2z8000z2f04c8541788
Jiang, M., Ma, Z., Chen, G., & Shu, S. (2026) · PeerJ · doi:10.7717/peerj.21551
Hawas, Y., Abdelmageed, A., Messak, M., Ziada, A., Gamal, M., Ghanem, T. I. E., Abdelwahab, M. M., Meshref, M., & Kashbour, M. O. (2026) · Neuroepidemiology · doi:10.1159/ned/adwag050
Metadata
- Authors
- Clarke, M., Brice, A., & Chalmers, I.
- Affiliations
- Queen's University Belfast (GB)
- Corresponding author
- Clarke, Mike
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-07-28
- Volume
- 9
- Issue
- 7
- Pages
- e102670
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4113310
- OpenAlex
- W2087358018
- Cited by
- 120
- References
- 74
- Citations by year
- 2026: 5 · 2025: 12 · 2024: 11 · 2023: 15 · 2022: 9 · 2021: 11 · 2020: 9 · 2019: 7 · 2018: 6 · 2017: 10 · 2016: 13 · 2015: 9 · 2014: 3
- FWCI
- 11.42
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Portal (Queen's University Belfast) (submittedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- cumulative meta-analysis, research waste, clinical trial design, treatment effect heterogeneity, negative results, research funding allocation, evidence-based decision making, myocardial infarction treatment, medical textbooks
- MeSH terms
- Health Status, Humans, Harm Reduction, Resource Allocation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review