A scoping review of indirect comparison methods and applications using individual patient data
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Several indirect comparison methods, including network meta-analyses (NMAs), using individual patient data (IPD) have been developed to synthesize evidence from a network of trials. Although IPD indirect comparisons are published with increasing frequency in health care literature, there is no guidance on selecting the appropriate methodology and on reporting the methods and results. METHODS: In this paper we examine the methods and reporting of indirect comparison methods using IPD. We searched MEDLINE, Embase, the Cochrane Library, and CINAHL from inception until October 2014. We included published and unpublished studies reporting a method, application, or review of indirect comparisons using IPD and at least three interventions. RESULTS: We identified 37 papers, including a total of 33 empirical networks. Of these, only 9 (27 %) IPD-NMAs reported the existence of a study protocol, whereas 3 (9 %) studies mentioned that protocols existed without providing a reference. The 33 empirical networks included 24 (73 %) IPD-NMAs and 9 (27 %) matching adjusted indirect comparisons (MAICs). Of the 21 (64 %) networks with at least one closed loop, 19 (90 %) were IPD-NMAs, 13 (68 %) of which evaluated the prerequisite consistency assumption, and only 5 (38 %) of the 13 IPD-NMAs used statistical approaches. The median number of trials included per network was 10 (IQR 4-19) (IPD-NMA: 15 [IQR 8-20]; MAIC: 2 [IQR 3-5]), and the median number of IPD trials included in a network was 3 (IQR 1-9) (IPD-NMA: 6 [IQR 2-11]; MAIC: 2 [IQR 1-2]). Half of the networks (17; 52 %) applied Bayesian hierarchical models (14 one-stage, 1 two-stage, 1 used IPD as an informative prior, 1 unclear-stage), including either IPD alone or with aggregated data (AD). Models for dichotomous and continuous outcomes were available (IPD alone or combined with AD), as were models for time-to-event data (IPD combined with AD). CONCLUSIONS: One in three indirect comparison methods modeling IPD adjusted results from different trials to estimate effects as if they had come from the same, randomized, population. Key methodological and reporting elements (e.g., evaluation of consistency, existence of study protocol) were often missing from an indirect comparison paper.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269 · cited 3×
“For IPD alone or in Table 5 Suggested information to report in an individual patient data indirect comparison to supplement ISPOR, PRISMA-IPD and PRISMA-NMA • Rationale for the IPD indirect comparison method selected.”
MethodSelf-citationGuidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472
Checking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521 · cited 2×
“Node-splitting [78] 1 (100) 0 (0) 1 (8)”
Stewart, L. A., Clarke, M., Rovers, M., Riley, R. D., Simmonds, M., Stewart, G., & Tierney, J. F. (2015) · JAMA · doi:10.1001/jama.2015.3656 · Cited by 2,134
Salanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1037 · Cited by 1,729
Meta-analysis of individual participant data: rationale, conduct, and reporting
Riley, R. D., Lambert, P. C., & Abo-Zaid, G. (2010) · BMJ · doi:10.1136/bmj.c221 · Cited by 1,701 · cited 1×
“Although IPD meta-analyses may be more time consuming and expensive than conventional meta-analyses using aggregated data, they are considered the gold standard approach for systematic reviews of interventions and are being published with increasing frequency [1, 2].”
MethodNetwork meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206 · cited 1×
“An approach to simultaneously compare multiple treatments in a single analysis is by using a meta-regression model [70].”
MethodEvaluation of inconsistency in networks of interventions
Veroniki, A. A., Vasiliadis, H. S., Higgins, J. P., & Salanti, G. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dys222 · Cited by 576 · cited 2×
“Loop-specific approach [68, 77] 1 (100) 0 (0) 1 (8)”
Self-citationCooper, H., & Patall, E. A. (2009) · Psychological Methods · doi:10.1037/a0015565 · Cited by 339 · cited 1×
“Although NMA is commonly performed with aggregated data, the inclusion of IPD can increase confidence in the results [5, 6], identify interactions that are otherwise undetectable [1, 7–9], and reduce variation in treatment effects both between studies within pairwise comparisons (heterogeneity) and between pairwise co…”
BackgroundJansen, J. P., Trikalinos, T., Cappelleri, J. C., Daw, J., Andes, S., Eldessouki, R., & Salanti, G. (2014) · Value in Health · doi:10.1016/j.jval.2014.01.004 · Cited by 319 · cited 2×
“An IPD indirect comparison review should be clearly reported in line with the International Society for Pharmacoeconomics and Outcomes Research (ISPOR), PRISMA-IPD and PRISMA-NMA tools [58–60].”
BackgroundResult
Cited by
Veroniki, A. A., Cogo, E., Rios, P., Straus, S. E., Finkelstein, Y., Kealey, R., Reynen, E., Soobiah, C., Thavorn, K., Hutton, B., et al. (2017) · BMC Medicine · doi:10.1186/s12916-017-0845-1 · Cited by 339
“This would also aid decision-making to allow tailoring management to individual patient characteristics [47].”
Self-citationVeroniki, A. A., Rios, P., Cogo, E., Straus, S. E., Finkelstein, Y., Kealey, R., Reynen, E., Soobiah, C., Thavorn, K., Hutton, B., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-017248 · Cited by 222
Self-citationNetwork meta‐analysis of multicomponent interventions
Rücker, G., Petropoulou, M., & Schwarzer, G. (2020) · Biometrical Journal · doi:10.1002/bimj.201800167 · Cited by 195
Petropoulou, M., Rücker, G., Weibel, S., Kranke, P., & Schwarzer, G. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-01959-9 · Cited by 12
Metadata
- Authors
- Veroniki, A. A., Straus, S. E., Soobiah, C., Elliott, M. J., & Tricco, A. C.
- Venue
- BMC Medical Research Methodology
- Published
- 2016-04-27
- Volume
- 16
- Issue
- 1
- Pages
- 47-47
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W2343727684
- Cited by
- 64
- References
- 11
- FWCI
- 4.89
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A scoping review of indirect comparison methods and applications using individual patient data. https://app.cochat.ai/papers/10.1186/s12874-016-0146-y
- The paper
- Veroniki, A. A., Straus, S. E., Soobiah, C., Elliott, M. J., & Tricco, A. C. (2016). A scoping review of indirect comparison methods and applications using individual patient data. BMC Medical Research Methodology. https://doi.org/10.1186/s12874-016-0146-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.