The DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index.
Indirect comparisons of competing interventions
Open accessAbstract
OBJECTIVES: To survey the frequency of use of indirect comparisons in systematic reviews and evaluate the methods used in their analysis and interpretation. Also to identify alternative statistical approaches for the analysis of indirect comparisons, to assess the properties of different statistical methods used for performing indirect comparisons and to compare direct and indirect estimates of the same effects within reviews. DATA SOURCES: Electronic databases. REVIEW METHODS: The Database of Abstracts of Reviews of Effects (DARE) was searched for systematic reviews involving meta-analysis of randomised controlled trials (RCTs) that reported both direct and indirect comparisons, or indirect comparisons alone. A systematic review of MEDLINE and other databases was carried out to identify published methods for analysing indirect comparisons. Study designs were created using data from the International Stroke Trial. Random samples of patients receiving aspirin, heparin or placebo in 16 centres were used to create meta-analyses, with half of the trials comparing aspirin and placebo and half heparin and placebo. Methods for indirect comparisons were used to estimate the contrast between aspirin and heparin. The whole process was repeated 1000 times and the results were compared with direct comparisons and also theoretical results. Further detailed case studies comparing the results from both direct and indirect comparisons of the same effects were undertaken. RESULTS: Of the reviews identified through DARE, 31/327 (9.5%) included indirect comparisons. A further five reviews including indirect comparisons were identified through electronic searching. Few reviews carried out a formal analysis and some based analysis on the naive addition of data from the treatment arms of interest. Few methodological papers were identified. Some valid approaches for aggregate data that could be applied using standard software were found: the adjusted indirect comparison, meta-regression and, for binary data only, multiple logistic regression (fixed effect models only). Simulation studies showed that the naive method is liable to bias and also produces over-precise answers. Several methods provide correct answers if strong but unverifiable assumptions are fulfilled. Four times as many similarly sized trials are needed for the indirect approach to have the same power as directly randomised comparisons. Detailed case studies comparing direct and indirect comparisons of the same effect show considerable statistical discrepancies, but the direction of such discrepancy is unpredictable. CONCLUSIONS: Direct evidence from good-quality RCTs should be used wherever possible. Without this evidence, it may be necessary to look for indirect comparisons from RCTs. However, the results may be susceptible to bias. When making indirect comparisons within a systematic review, an adjusted indirect comparison method should ideally be used employing the random effects model. If both direct and indirect comparisons are possible within a review, it is recommended that these be done separately before considering whether to pool data. There is a need to evaluate methods for the analysis of indirect comparisons for continuous data and for empirical research into how different methods of indirect comparison perform in cases where there is a large treatment effect. Further study is needed into when it is appropriate to look at indirect comparisons and when to combine both direct and indirect comparisons. Research into how evidence from indirect comparisons compares to that from non-randomised studies may also be warranted. Investigations using individual patient data from a meta-analysis of several RCTs using different protocols and an evaluation of the impact of choosing different binary effect measures for the inverse variance method would also be useful.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
How should meta‐regression analyses be undertaken and interpreted?
Thompson, S. G., & Higgins, J. P. T. (2002) · Statistics in Medicine · doi:10.1002/sim.1187 · Cited by 3,026
Clinical Trials: A Practical Approach.
Hill, I. D., & Pocock, S. J. (1984) · Biometrics · doi:10.2307/2531186 · Cited by 2,930
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907
Self-citationFibrinolytic Therapy Trialists' (FTT) Collaborative Group (1994) · The Lancet · doi:10.1016/s0140-6736(94)91161-4 · Cited by 2,744
Deeks, J. J., Altman, D. G., & Bradburn, M. J. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch15 · Cited by 2,163
Self-citationBucher, H. C., Guyatt, G. H., Griffith, L. E., & Walter, S. D. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00049-8 · Cited by 2,052
(2000) · Queen Mary Research Online (Queen Mary University of London) · Cited by 1,795
Cited by
GRADE guidelines: 8. Rating the quality of evidence—indirectness
Guyatt, G. H., Oxman, A. D., Kunz, R., Woodcock, J., Brozek, J., Helfand, M., Alonso-Coello, P., Falck-Ytter, Y., Jaeschke, R., Vist, G., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.04.014 · Cited by 1,843
Simultaneous comparison of multiple treatments: Combining direct and indirect evidence.
Caldwell, D. M., Ades, A. E., & Higgins, J. P. T. (2005) · BMJ · doi:10.1136/bmj.331.7521.897 · Cited by 1,600
Dias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Evaluation of networks of randomized trials
Salanti, G., Higgins, J. P., Ades, A., & Ioannidis, J. P. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280207080643 · Cited by 1,078
Fu, R., Gartlehner, G., Grant, M., Shamliyan, T., Sedrakyan, A., Wilt, T. J., Griffith, L., Oremus, M., Raina, P., Ismaila, A., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.08.010 · Cited by 730
Ioannidis, J. P. A. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.081086 · Cited by 716
Hobart, J., & Cano, S. (2009) · Health Technology Assessment · doi:10.3310/hta13120 · Cited by 621
Nowak, C., & Heinrichs, N. (2008) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-008-0033-0 · Cited by 621
Reasons or excuses for avoiding meta-analysis in forest plots
Ioannidis, J. P. A., Patsopoulos, N. A., & Rothstein, H. R. (2008) · BMJ · doi:10.1136/bmj.a117 · Cited by 457
GetReal in network meta-analysis: a review of the methodology
Efthimiou, O., Debray, T. P. A., van Valkenhoef, G., Trelle, S., Panayidou, K., Moons, K. G. M., Reitsma, J. B., Shang, A., Salanti, G., & on behalf of GetReal Methods Review Group (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1195 · Cited by 401
Inhaled steroids and risk of pneumonia for chronic obstructive pulmonary disease
Kew, K. M., & Seniukovich, A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010115.pub2 · Cited by 398
Signorovitch, J. E., Wu, E. Q., Yu, A. P., Gerrits, C. M., Kantor, E., Bao, Y., Gupta, S. R., & Mulani, P. M. (2010) · PharmacoEconomics · doi:10.2165/11538370-000000000-00000 · Cited by 377
Network meta-analysis-highly attractive but more methodological research is needed
Li, T., Puhan, M. A., Vedula, S. S., Singh, S., Dickersin, K., & The Ad Hoc Network Meta-analysis Methods Meeting Working Group (2011) · BMC Medicine · doi:10.1186/1741-7015-9-79 · Cited by 361
Germani, G., Pleguezuelo, M., Gurusamy, K., Meyer, T., Isgrò, G., & Burroughs, A. K. (2010) · Journal of Hepatology · doi:10.1016/j.jhep.2009.12.004 · Cited by 304
Greaves, C. J., & Farbus, L. (2006) · Journal of the Royal Society for the Promotion of Health · doi:10.1177/1466424006064303 · Cited by 284
Self-monitoring of blood glucose in type 2 diabetes: systematic review
Clar, C., Barnard, K., Cummins, E., Royle, P., & Waugh, N. (2010) · Health Technology Assessment · doi:10.3310/hta14120 · Cited by 274
Single dose oral analgesics for acute postoperative pain in adults - an overview of Cochrane reviews
Moore, R. A., Derry, S., Aldington, D., & Wiffen, P. J. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008659.pub3 · Cited by 258
Freedland, K. E., King, A. C., Ambrosius, W. T., Mayo-Wilson, E., Mohr, D. C., Czajkowski, S. M., Thabane, L., Collins, L. M., Rebok, G. W., Treweek, S. P., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.02.011 · Cited by 218
Becker, L. A., & Oxman, A. D. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch22 · Cited by 218
Single dose oral analgesics for acute postoperative pain in adults
Moore, R. A., Derry, S., McQuay, H. J., & Wiffen, P. J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008659.pub2 · Cited by 198
Sample size and power considerations in network meta-analysis
Thorlund, K., & Mills, E. J. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-41 · Cited by 197
Kyrgiou, M., Salanti, G., Pavlidis, N., Paraskevaidis, E., & Ioannidis, J. P. A. (2006) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djj443 · Cited by 187
Empirical evidence of the importance of comparative studies of diagnostic test accuracy
Takwoingi, Y., Leeflang, M. M. G., & Deeks, J. J. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-7-201304020-00006 · Cited by 187
Self-citationNon-prescription (OTC) oral analgesics for acute pain - an overview of Cochrane reviews
Moore, R. A., Wiffen, P. J., Derry, S., Maguire, T., Roy, Y. M., & Tyrrell, L. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010794.pub2 · Cited by 174
Conde-Agudelo, A., Romero, R., Da Fonseca, E., O’Brien, J. M., Cetingoz, E., Creasy, G. W., Hassan, S. S., Erez, O., Pacora, P., & Nicolaides, K. H. (2018) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2018.03.028 · Cited by 168
Pompoli, A., Furukawa, T. A., Imai, H., Tajika, A., Efthimiou, O., & Salanti, G. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011004.pub2 · Cited by 142
Little, P., Turner, S., Rumsby, K., Warner, G., Moore, M., Lowes, J., Smith, H., Hawke, C., Turner, D., Leydon, G., et al. (2009) · Health Technology Assessment · doi:10.3310/hta13190 · Cited by 137
Bisphosphonates in multiple myeloma: a network meta-analysis
Mhaskar, R., Redzepovic, J., Wheatley, K., Clark, O. A. C., Miladinovic, B., Glasmacher, A., Kumar, A., & Djulbegovic, B. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003188.pub3 · Cited by 130
Evolution and Translation of Research Findings: From Bench to Where
Ioannidis, J. P. A. (2006) · PLoS Clinical Trials · doi:10.1371/journal.pctr.0010036 · Cited by 129
Yildiz, A., Nikodem, M., Vieta, E., Correll, C. U., & Baldessarini, R. J. (2015) · Psychological Medicine · doi:10.1017/s0033291714001305 · Cited by 128
Vitamin K to prevent fractures in older women: systematic review and economic evaluation
Stevenson, M., Lloyd-Jones, M., & Papaioannou, D. (2009) · Health Technology Assessment · doi:10.3310/hta13450 · Cited by 90
Wagner, G., Schultes, M.-T., Titscher, V., Teufer, B., Klerings, I., & Gartlehner, G. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.11.056 · Cited by 61
Chou, R., Carson, S., & Chan, B. K. S. (2009) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0877-5 · Cited by 57
Ruifrok, A. E., Rogozinska, E., van Poppel, M. N., Rayanagoudar, G., Kerry, S., de Groot, C. J., Yeo, S., Molyneaux, E., McAuliffe, F. M., Poston, L., et al. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-131 · Cited by 33
Brignone, M., Diamand, F., Painchault, C., & Takyar, S. (2016) · Current Medical Research and Opinion · doi:10.1185/03007995.2015.1128404 · Cited by 30
Salanti, G., & Higgins, J. P. T. (2022) · Systematic Reviews in Health Research · doi:10.1002/9781119099369.ch13
Metadata
- Authors
- Glenny, A., Altman, D., Song, F., Sakarovitch, C., Deeks, J., D'Amico, R., Bradburn, M., & Eastwood, A.
- Venue
- Health Technology Assessment
- Published
- 2005-07
- Volume
- 9
- Issue
- 26
- Pages
- 1-134, iii
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2099326967
- Cited by
- 677
- References
- 101
- FWCI
- 26.18
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.