The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Next-generation systematic reviews: prospective meta-analysis, individual-level data, networks and umbrella reviews
Abstract
Systematic reviews and meta-analyses have reached a critical point. Their success is solid and dreadful at the same time. They are widely considered the highest level of evidence. There are tens of thousands of systematic reviews already published, but their production is still increasing geometrically. The problem is that the majority of systematic reviews are flawed, misleading, redundant, useless or all of the above,1 and this applies to almost all medical fields, including sports and exercise medicine. Part of the problem with systematic reviews stems from the poor, misleading primary evidence2 that authors try to synthesise and make sense of. However, if this were the only major problem, systematic reviews and meta-analyses would still be extremely useful. They could focus exactly on showing how flawed, misleading and useless this evidence is. This could lead to suggestions on how to improve research in the field. Instead, systematic reviews often sanctify results from poor studies, by making these seem even more statistically significant and (spuriously) conclusive. They can also compound the problems seen in the primary studies, if they are driven by reviewers and sponsors with conflicts of interest, financial or academic. There are four types of ‘next-generation’ systematic reviews that may raise the bar and help shape a new generation of more reliable evidence synthesis: prospective meta-analysis, individual-level data, network meta-analyses and umbrella reviews. They are not necessarily brand new ideas, but in the current circumstances of uncontrollable overproduction and unchecked quality, they have a fresh opportunity for impact. This large-scale impact would have been unimaginable in the past due to constrains in access to data, limited availability of sophisticated methods and fewer opportunities for their application. None of these next-generation tools are bullet proof, but they hold promise and some distinct advantages. Their disadvantages also need to be …
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Association of Leisure-Time Physical Activity With Risk of 26 Types of Cancer in 1.44 Million Adults
Moore, S. C., Lee, I.-M., Weiderpass, E., Campbell, P. T., Sampson, J. N., Kitahara, C. M., Keadle, S. K., Arem, H., Berrington de Gonzalez, A., Hartge, P., et al. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.1548 · Cited by 1,487
The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483
Self-citationEvaluation of networks of randomized trials
Salanti, G., Higgins, J. P., Ades, A., & Ioannidis, J. P. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280207080643 · Cited by 1,078
Self-citationIoannidis, J. P. A. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.081086 · Cited by 716
Self-citationNaci, H., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f5577 · Cited by 630
Self-citationEbrahim, S., Bance, S., Athale, A., Malachowski, C., & Ioannidis, J. P. A. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.021 · Cited by 107
Self-citation
Cited by
Flouris, A. D., Dinas, P. C., Ioannou, L. G., Nybo, L., Havenith, G., Kenny, G. P., & Kjellstrom, T. (2018) · The Lancet Planetary Health · doi:10.1016/s2542-5196(18)30237-7 · Cited by 579
“154 While this approach allowed us to form a meaningful conclusion instead of narrowing down our research question, it resulted in large heterogeneity in our meta-analyses.”
Ardern, C. L., Büttner, F., Andrade, R., Weir, A., Ashe, M. C., Holden, S., Impellizzeri, F. M., Delahunt, E., Dijkstra, H. P., Mathieson, S., et al. (2022) · British Journal of Sports Medicine · doi:10.1136/bjsports-2021-103987 · Cited by 458
Ekelund, U., Brown, W. J., Steene-Johannessen, J., Fagerland, M. W., Owen, N., Powell, K. E., Bauman, A. E., & Lee, I.-M. (2019) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-098963 · Cited by 448
Askie, L. M., Darlow, B. A., Finer, N., Schmidt, B., Stenson, B., Tarnow-Mordi, W., Davis, P. G., Carlo, W. A., Brocklehurst, P., Davies, L. C., et al. (2018) · JAMA · doi:10.1001/jama.2018.5725 · Cited by 430
Carnicelli, A. P., Hong, H., Connolly, S. J., Eikelboom, J., Giugliano, R. P., Morrow, D. A., Patel, M. R., Wallentin, L., Alexander, J. H., Cecilia Bahit, M., et al. (2022) · Circulation · doi:10.1161/circulationaha.121.056355 · Cited by 386
Metadata
- Authors
- Ioannidis, J.
- Venue
- British Journal of Sports Medicine
- Publisher
- BMJ
- Published
- 2017-02-21
- Volume
- 51
- Issue
- 20
- Pages
- 1456-1458
- ISSN
- 0306-3674 (ISSN-L)
- 1473-0480
- OpenAlex
- W2589903002
- Cited by
- 188
- References
- 6
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Next-generation systematic reviews: prospective meta-analysis, individual-level data, networks and umbrella reviews. https://app.cochat.ai/papers/10.1136/bjsports-2017-097621
- The paper
- Ioannidis, J. (2017). Next-generation systematic reviews: prospective meta-analysis, individual-level data, networks and umbrella reviews. British Journal of Sports Medicine. https://doi.org/10.1136/bjsports-2017-097621
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.