Empirical comparison of subgroup effects in conventional and individual patient data meta-analyses
The DOI matches its Crossref record.
Abstract
Objectives: Individual patient data (IPD) meta-analyses have been proposed as a major improvement in meta-analytic methods to study subgroup effects. Subgroup effects of conventional and IPD meta-analyses using identical data have not been compared. Our objective is to compare such subgroup effects using the data of six trials (n = 1,643) on the effectiveness of antibiotics in children with acute otitis media (AOM). Methods: Effects (relative risks, risk differences [RD], and their confidence intervals [CI]) of antibiotics in subgroups of children with AOM resulting from (i) conventional meta-analysis using summary statistics derived from published data (CMA), (ii) two-stage approach to IPD meta-analysis using summary statistics derived from IPD (IPDMA-2), and (iii) one-stage approach to IPD meta-analysis where IPD is pooled into a single data set (IPDMA-1) were compared. Results: In the conventional meta-analysis, only two of the six studies were included, because only these reported on relevant subgroup effects. The conventional meta-analysis showed larger (age < 2 years) or smaller (age ≥ 2 years) subgroup effects and wider CIs than both IPD meta-analyses (age < 2 years: RD CMA -21 percent, RD IPDMA-1 -16 percent, RD IPDMA-2 -15 percent; age ≥2 years: RD CMA -5 percent, RD IPDMA-1 -11 percent, RD IPDMA-2 -11 percent). The most important reason for these discrepant results is that the two studies included in the conventional meta-analysis reported outcomes that were different both from each other and from the IPD meta-analyses. Conclusions: This empirical example shows that conventional meta-analyses do not allow proper subgroup analyses, whereas IPD meta-analyses produce more accurate subgroup effects. We also found no differences between the one- and two-stage meta-analytic approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Schandelmaier, S., Briel, M., Varadhan, R., Schmid, C. H., Devasenapathy, N., Hayward, R. A., Gagnier, J., Borenstein, M., van der Heijden, G. J. M. G., Dahabreh, I. J., et al. (2020) · Canadian Medical Association Journal · doi:10.1503/cmaj.200077 · Cited by 749
Kotecha, D., Holmes, J., Krum, H., Altman, D. G., Manzano, L., Cleland, J. G. F., Lip, G. Y. H., Coats, A. J. S., Andersson, B., Kirchhof, P., et al. (2014) · The Lancet · doi:10.1016/s0140-6736(14)61373-8 · Cited by 579
Burke, D. L., Ensor, J., & Riley, R. D. (2017) · Statistics in Medicine · doi:10.1002/sim.7141 · Cited by 538
Tierney, J. F., Vale, C., Riley, R., Smith, C. T., Stewart, L., Clarke, M., & Rovers, M. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001855 · Cited by 361
Self-citationGet real in individual participant data (IPD) meta‐analysis: a review of the methodology
Debray, T. P. A., Moons, K. G. M., van Valkenhoef, G., Efthimiou, O., Hummel, N., Groenwold, R. H. H., Reitsma, J. B., & on behalf of the GetReal methods review group (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1160 · Cited by 348
“It is conventionally believed that the one-stage and two-stage approaches yield similar estimates of treatment effects (Stewart et al., 2012; Koopman et al., 2008b; Tudur Smith and Williamson, 2007; Steinberg et al., 1997).”
Background
Metadata
- Authors
- Koopman, L., van der Heijden, G. J. M. G., Hoes, A. W., Grobbee, D. E., & Rovers, M. M.
- Venue
- International Journal of Technology Assessment in Health Care
- Publisher
- Cambridge University Press (CUP)
- Published
- 2008-07
- Volume
- 24
- Issue
- 3
- Pages
- 358-361
- ISSN
- 0266-4623 (ISSN-L)
- 1471-6348
- OpenAlex
- W2092961885
- Cited by
- 48
- References
- 0
- FWCI
- 2.62
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Empirical comparison of subgroup effects in conventional and individual patient data meta-analyses. https://app.cochat.ai/papers/10.1017/s0266462308080471
- The paper
- Koopman, L., van der Heijden, G. J. M. G., Hoes, A. W., Grobbee, D. E., & Rovers, M. M. (2008). Empirical comparison of subgroup effects in conventional and individual patient data meta-analyses. International Journal of Technology Assessment in Health Care. https://doi.org/10.1017/s0266462308080471
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.