CoChat

Individual participant data meta-analyses should not ignore clustering

Open access
Abo-Zaid, Ghada, Guo, Boliang, Deeks, Jonathan J., Debray, Thomas P.A., Steyerberg, Ewout W., Moons, Karel G.M., Riley, Richard David · 2013 · Journal of Clinical Epidemiology
Cited by 130

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Abstract

OBJECTIVES: Individual participant data (IPD) meta-analyses often analyze their IPD as if coming from a single study. We compare this approach with analyses that rather account for clustering of patients within studies. STUDY DESIGN AND SETTING: Comparison of effect estimates from logistic regression models in real and simulated examples. RESULTS: The estimated prognostic effect of age in patients with traumatic brain injury is similar, regardless of whether clustering is accounted for. However, a family history of thrombophilia is found to be a diagnostic marker of deep vein thrombosis [odds ratio, 1.30; 95% confidence interval (CI): 1.00, 1.70; P = 0.05] when clustering is accounted for but not when it is ignored (odds ratio, 1.06; 95% CI: 0.83, 1.37; P = 0.64). Similarly, the treatment effect of nicotine gum on smoking cessation is severely attenuated when clustering is ignored (odds ratio, 1.40; 95% CI: 1.02, 1.92) rather than accounted for (odds ratio, 1.80; 95% CI: 1.29, 2.52). Simulations show models accounting for clustering perform consistently well, but downwardly biased effect estimates and low coverage can occur when ignoring clustering. CONCLUSION: Researchers must routinely account for clustering in IPD meta-analyses; otherwise, misleading effect estimates and conclusions may arise.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.jclinepi.2012.12.017

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 8 references

Research works printed but not linked: 37

  1. Stewart, 1993, Meta-analysis of the literature or of individual patient data: is there a difference?, Lancet, 341, 418, 10.1016/0140-6736(93)93004-K · DOI · Paper page
  2. Stewart, 2002, To IPD or not to IPD? Advantages and disadvantages of systematic reviews using individual patient data, Eval Health Prof, 25, 76, 10.1177/0163278702025001006 · DOI · Paper page
  3. Simmonds, 2005, Meta-analysis of individual patient data from randomized trials: a review of methods used in practice, Clin Trials, 2, 209, 10.1191/1740774505cn087oa · DOI · Paper page
  4. Higgins, 2001, Meta-analysis of continuous outcome data from individual patients, Stat Med, 20, 2219, 10.1002/sim.918 · DOI · Paper page
  5. Whitehead, 2001, Meta-analysis of ordinal outcomes using individual patient data, Stat Med, 20, 2243, 10.1002/sim.919 · DOI · Paper page
  6. Tudur-Smith, 2005, Investigating heterogeneity in an individual patient data meta-analysis of time to event outcomes, Stat Med, 24, 1307, 10.1002/sim.2050 · DOI · Paper page
  7. Jones, 2009, Meta-analysis of individual patient data versus aggregate data from longitudinal clinical trials, Clin Trials, 6, 16, 10.1177/1740774508100984 · DOI · Paper page
  8. Riley, 2008, Meta-analysis of continuous outcomes combining individual patient data and aggregate data, Stat Med, 27, 1870, 10.1002/sim.3165 · DOI · Paper page
  9. Riley, 2008, Meta-analysis of diagnostic test studies using individual patient data and aggregate data, Stat Med, 27, 6111, 10.1002/sim.3441 · DOI · Paper page
  10. Olkin, 1998, Comparison of meta-analysis versus analysis of variance of individual patient data, Biometrics, 54, 317, 10.2307/2534018 · DOI · Paper page
  11. Mathew, 1999, On the equivalence of meta-analysis using literature and using individual patient data, Biometrics, 55, 1221, 10.1111/j.0006-341X.1999.01221.x · DOI · Paper page
  12. Tudur Smith, 2007, A comparison of methods for fixed effects meta-analysis of individual patient data with time to event outcomes, Clin Trials, 4, 621, 10.1177/1740774507085276 · DOI · Paper page
  13. Matthew, 2010, Comparison of one-step and two-step meta-analysis models using individual patient data, Biometrical J, 52, 271, 10.1002/bimj.200900143 · DOI · Paper page
  14. Hamza, 2008, The binomial distribution of meta-analysis was preferred to model within-study variability, J Clin Epidemiol, 61, 41, 10.1016/j.jclinepi.2007.03.016 · DOI · Paper page
  15. Abo-Zaid, 2012, Individual participant data meta-analysis of prognostic factor studies: state of the art?, BMC Med Res Methodol, 12, 56, 10.1186/1471-2288-12-56 · DOI · Paper page
  16. DerSimonian, 1986, Meta-analysis in clinical trials, Control Clin Trials, 7, 177, 10.1016/0197-2456(86)90046-2 · DOI · Paper page
  17. Carlsson, 1968, Factors affecting the clinical course of patients with severe head injuries. 1. Influence of biological factors. 2. Significance of posttraumatic coma, J Neurosurg, 29, 242, 10.3171/jns.1968.29.3.0242 · DOI · Paper page
  18. Kraaijenhagen, 2002, Simplification of the diagnostic management of suspected deep vein thrombosis, Arch Intern Med, 162, 907, 10.1001/archinte.162.8.907 · DOI · Paper page
  19. Toll, 2006, Excluding deep vein thrombosis safely in primary care, J Fam Pract, 55, 613
  20. Anderson, 2003, Combined use of clinical assessment and d-dimer to improve the management of patients presenting to the emergency department with suspected deep vein thrombosis (the EDITED Study), J Thromb Haemost, 1, 645, 10.1046/j.1538-7836.2003.00131.x · doi:10.1046/j.1538-7836.2003.00131.x
  21. Stevens, 2004, Withholding anticoagulation after a negative result on duplex ultrasonography for suspected symptomatic deep venous thrombosis, Ann Intern Med, 140, 985, 10.7326/0003-4819-140-12-200406150-00007 · DOI
  22. Wells, 2003, Evaluation of D-dimer in the diagnosis of suspected deep-vein thrombosis, N Engl J Med, 349, 1227, 10.1056/NEJMoa023153 · DOI · Paper page
  23. Toll, 2008, A new diagnostic rule for deep vein thrombosis: safety and efficiency in clinically relevant subgroups, Fam Pract, 25, 3, 10.1093/fampra/cmm075 · DOI
  24. Rice, 2001, Nursing interventions for smoking cessation, Cochrane Database Syst Rev (Complete Reviews), CD001188
  25. Altman, 2002, Meta-analysis, Simpson's paradox, and the number needed to treat, BMC Med Res Methodol, 2, 3, 10.1186/1471-2288-2-3 · DOI · Paper page
  26. Peters, 2003, Comparison of methods for analysing cluster randomized trials: an example involving a factorial design, Int J Epidemiol, 32, 840, 10.1093/ije/dyg228 · DOI · Paper page
  27. Bland, 2004, Cluster randomised trials in the medical literature: two bibliometric surveys, BMC Med Res Methodol, 4, 21, 10.1186/1471-2288-4-21 · DOI · Paper page
  28. Lee, 2005, The use of random effects models to allow for clustering in individually randomized trials, Clin Trials, 2, 163, 10.1191/1740774505cn082oa · DOI · Paper page
  29. Steyerberg, 2000, Clinical trials in acute myocardial infarction: should we adjust for baseline characteristics?, Am Heart J, 139, 745, 10.1016/S0002-8703(00)90001-2 · DOI
  30. Hernández, 2004, Covariate adjustment in randomized controlled trials with dichotomous outcomes increases statistical power and reduces sample size requirements, J Clin Epidemiol, 57, 454, 10.1016/j.jclinepi.2003.09.014 · DOI · Paper page
  31. Turner, 2012, Covariate adjustment increased power in randomized controlled trials: an example in traumatic brain injury, J Clin Epidemiol, 65, 474, 10.1016/j.jclinepi.2011.08.012 · DOI · Paper page
  32. Robinson, 1991, Some surprising results about covariate adjustment in logistic regression models, Int Stat Rev, 58, 227, 10.2307/1403444 · DOI · Paper page
  33. Gail, 1984, Biased estimates of treatment effect in randomized experiments with nonlinear regressions and omitted covariates, Biometrika, 71, 431, 10.1093/biomet/71.3.431 · DOI · Paper page
  34. Mantel, 1959, Statistical aspects of the analysis of data from retrospective studies of disease, J Natl Cancer Inst, 22, 719
  35. Chu, 2006, Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach, J Clin Epidemiol, 59, 1331, 10.1016/j.jclinepi.2006.06.011 · DOI · Paper page
  36. Riley, 2007, Evidence synthesis combining individual patient data and aggregate data: a systematic review identified current practice and possible methods, J Clin Epidemiol, 60, 431, 10.1016/j.jclinepi.2006.09.009 · DOI · Paper page
  37. Jackson, 2009, Systematically missing confounders in individual participant data meta-analysis of observational cohort studies, Stat Med, 28, 1218, 10.1002/sim.3540 · DOI · Paper page

Cited by

See all 130

Metadata

Authors
Abo-Zaid, G., Guo, B., Deeks, J. J., Debray, T. P. A., Steyerberg, E. W., Moons, K. G. M., & Riley, R. D.
Venue
Journal of Clinical Epidemiology
Publisher
Elsevier BV
Published
2013-08
Volume
66
Issue
8
Pages
865-873.e4
ISSN
0895-4356 (ISSN-L)
OpenAlex
W2110032017
Cited by
130
References
8
FWCI
10.04
Type
journal article
Language
en
Open access
hybrid
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Individual participant data meta-analyses should not ignore clustering. https://app.cochat.ai/papers/10.1016/j.jclinepi.2012.12.017
The paper
Abo-Zaid, G., Guo, B., Deeks, J. J., Debray, T. P. A., Steyerberg, E. W., Moons, K. G. M., & Riley, R. D. (2013). Individual participant data meta-analyses should not ignore clustering. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2012.12.017

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.