The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Evaluation of networks of randomized trials
Abstract
Randomized trials may be designed and interpreted as single experiments or they may be seen in the context of other similar or relevant evidence. The amount and complexity of available randomized evidence vary for different topics. Systematic reviews may be useful in identifying gaps in the existing randomized evidence, pointing to discrepancies between trials, and planning future trials. A new, promising, but also very much debated extension of systematic reviews, mixed treatment comparison (MTC) meta-analysis, has become increasingly popular recently. MTC meta-analysis may have value in interpreting the available randomized evidence from networks of trials and can rank many different treatments, going beyond focusing on simple pairwise-comparisons. Nevertheless, the evaluation of networks also presents special challenges and caveats. In this article, we review the statistical methodology for MTC meta-analysis. We discuss the concept of inconsistency and methods that have been proposed to evaluate it as well as the methodological gaps that remain. We introduce the concepts of network geometry and asymmetry, and propose metrics for the evaluation of the asymmetry. Finally, we discuss the implications of inconsistency, network geometry and asymmetry in informing the planning of future trials.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Network meta-analysis results usually give a more precise estimate, compared with results from standard, pairwise analyses, [48, 49]”
From Efficacy of psychological therapies for irritable bowel syndrome: systematic review and network meta-analysis (2020) · cites this paper as [48]
In the citing paper
“network meta-analysis offers a methodological solution to provide more precise pooled head-to-head effect estimates than may otherwise be achieved 19, 20 .”
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Self-citationQuantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Self-citationProceedings of the National Academy of Sciences of the United States of America
Dowling, J. E., & Wald, G. (2009) · Nutrition Reviews · doi:10.1111/j.1753-4887.1981.tb06752.x · Cited by 17,893
Ecological Diversity and Its Measurement
Magurran, A. E. (1988) · Springer eBooks · doi:10.1007/978-94-015-7358-0 · Cited by 10,879
Keeley, E. C., Boura, J. A., & Grines, C. L. (2003) · The Lancet · doi:10.1016/s0140-6736(03)12113-7 · Cited by 4,361
Assessing heterogeneity in meta-analysis: Q statistic or I² index?
Huedo-Medina, T. B., Sánchez-Meca, J., Marín-Martínez, F., & Botella, J. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.2.193 · Cited by 4,256
The Nonconcept of Species Diversity: A Critique and Alternative Parameters
Hurlbert, S. H. (1971) · Ecology · doi:10.2307/1934145 · Cited by 4,183
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
How should meta‐regression analyses be undertaken and interpreted?
Thompson, S. G., & Higgins, J. P. T. (2002) · Statistics in Medicine · doi:10.1002/sim.1187 · Cited by 3,026
Self-citationHammer, S. M., Squires, K. E., Hughes, M. D., Grimes, J. M., Demeter, L. M., Currier, J. S., Eron, J. J., Feinberg, J. E., Balfour, H. H., Deyton, L. R., et al. (1997) · New England Journal of Medicine · doi:10.1056/nejm199709113371101 · Cited by 2,640
Research works printed but not linked: 4
- Piantadosi S., 1997, Clinical trials: A methodological approach
- Gray JAM., 2001, Evidence-based healthcare
- Berger VW, 2006, Journal of Rheumatology, 33, 1710
- 2005, EcoSim [computer program]. Version 7.72 Kelsey-Bear
Cited by
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
“Network meta-analyses, also known as multiple treatments meta-analyses, can be used to analyze data from comparisons of many different treatments [176,177].”
MethodSelf-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
“Network meta-analyses, also known as multiple treatments meta-analyses, can be used to analyze data from comparisons of many different treatments [176,177].”
MethodSelf-citationHutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269
Self-citation
Metadata
- Authors
- Salanti, G., Higgins, J. P., Ades, A., & Ioannidis, J. P.
- Affiliations
- University of Ioannina (GR)
- MRC Biostatistics Unit (GB)
- MRC Health Services Collaboration, Bristol, UK
- Tufts University (US)
- Corresponding author
- Ioannidis, John PA
- Venue
- Statistical Methods in Medical Research
- Publisher
- SAGE Publications
- Published
- 2007-10-09
- Volume
- 17
- Issue
- 3
- Pages
- 279-301
- ISSN
- 0962-2802 (ISSN-L)
- 1477-0334
- OpenAlex
- W2105669432
- Cited by
- 1,078
- References
- 69
- Citations by year
- 2026: 26 · 2025: 39 · 2024: 43 · 2023: 55 · 2022: 67 · 2021: 68 · 2020: 77 · 2019: 95 · 2018: 82 · 2017: 79 · 2016: 71 · 2015: 79 · 2014: 74 · 2013: 63 · 2012: 66
- FWCI
- 17.76
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Statistical Methods in Medical Research (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- inconsistency, network geometry, network asymmetry, treatment ranking, trial planning, statistical methodology
- MeSH terms
- Network Meta-Analysis as Topic, Humans, Research Design, Meta-Analysis as Topic, Models, Statistical, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation of networks of randomized trials. https://app.cochat.ai/papers/10.1177/0962280207080643
- The paper
- Salanti, G., Higgins, J. P., Ades, A., & Ioannidis, J. P. (2008). Evaluation of networks of randomized trials. Statistical Methods in Medical Research. https://doi.org/10.1177/0962280207080643
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.