The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Meta-analysis of individual patient data from randomized trials: a review of methods used in practice
Abstract
Background Meta-analyses based on individual patient data (IPD) are regarded as the gold standard for systematic reviews. However, the methods used for analysing and presenting results from IPD meta-analyses have received little discussion. Methods We review 44 IPD meta-analyses published during the years 1999–2001. We summarize whether they obtained all the data they sought, what types of approaches were used in the analysis, including assumptions of common or random effects, and how they examined the effects of covariates. Results Twenty-four out of 44 analyses focused on time-to-event outcomes, and most analyses (28) estimated treatment effects within each trial and then combined the results assuming a common treatment effect across trials. Three analyses failed to stratify by trial, analysing the data is if they came from a single mega-trial. Only nine analyses used random effects methods. Covariate-treatment interactions were generally investigated by subgrouping patients. Seven of the meta-analyses included data from less than 80% of the randomized patients sought, but did not address the resulting potential biases. Conclusions Although IPD meta-analyses have many advantages in assessing the effects of health care, there are several aspects that could be further developed to make fuller use of the potential of these time-consuming projects. In particular, IPD could be used to more fully investigate the influence of covariates on heterogeneity of treatment effects, both within and between trials. The impact of heterogeneity, or use of random effects, are seldom discussed. There is thus considerable scope for enhancing the methods of analysis and presentation of IPD meta-analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Self-citationMeta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Statistical Aspects of the Analysis of Data From Retrospective Studies of Disease
(1959) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/22.4.719 · Cited by 14,689
Beta blockade during and after myocardial infarction: An overview of the randomized trials
Yusuf, S., Peto, R., Lewis, J., Collins, R., & Sleight, P. (1985) · Progress in Cardiovascular Diseases · doi:10.1016/s0033-0620(85)80003-7 · Cited by 3,205
Meta-analysis: Principles and procedures
Egger, M., Smith, G. D., & Phillips, A. N. (1997) · BMJ · doi:10.1136/bmj.315.7121.1533 · Cited by 2,415
The Existence of Publication Bias and Risk Factors for Its Occurrence
Dickersin, K. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100097014 · Cited by 1,417
Controlling the risk of spurious findings from meta-regression
Higgins, J. P. T., & Thompson, S. G. (2004) · Statistics in Medicine · doi:10.1002/sim.1752 · Cited by 1,267 · cited 1×
“Without justification (and prespecification) of outcomes and covariates chosen there is the possibility of selection bias or data dredging problems [64].”
BackgroundSelf-citationEntsuah, A. R., Huang, H., & Thase, M. E. (2001) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v62n1106 · Cited by 245
Can meta-analysis help target interventions at individuals most likely to benefit?
Thompson, S. G., & Higgins, J. P. (2005) · The Lancet · doi:10.1016/s0140-6736(05)70200-2 · Cited by 174
Self-citationA meta‐analysis comparing buprenorphine to methadone for treatment of opiate dependence
Barnett, P. G., Rodgers, J. H., & Bloch, D. A. (2001) · Addiction · doi:10.1046/j.1360-0443.2001.9656834.x · Cited by 150 · cited 2×
“The 44 published during 1999-2001 were the subject of further study [15-58].”
Background
Cited by
Stewart, L. A., Clarke, M., Rovers, M., Riley, R. D., Simmonds, M., Stewart, G., & Tierney, J. F. (2015) · JAMA · doi:10.1001/jama.2015.3656 · Cited by 2,134
Self-citationMeta-analysis of individual participant data: rationale, conduct, and reporting
Riley, R. D., Lambert, P. C., & Abo-Zaid, G. (2010) · BMJ · doi:10.1136/bmj.c221 · Cited by 1,701
Briel, M., Meade, M., Mercat, A., Brower, R. G., Talmor, D., Walter, S. D., Slutsky, A. S., Pullenayegum, E., Zhou, Q., Cook, D., et al. (2010) · JAMA · doi:10.1001/jama.2010.218 · Cited by 1,467
Subclinical Hypothyroidism and the Risk of Coronary Heart Disease and Mortality
Rodondi, N., den Elzen, W. P. J., Bauer, D. C., Cappola, A. R., Razvi, S., Walsh, J. P., Åsvold, B. O., Iervasi, G., Imaizumi, M., Collet, T.-H., et al. (2010) · JAMA · doi:10.1001/jama.2010.1361 · Cited by 1,216
Multivariate meta-analysis for non-linear and other multi-parameter associations
Gasparrini, A., Armstrong, B., & Kenward, M. G. (2012) · Statistics in Medicine · doi:10.1002/sim.5471 · Cited by 772
Interpretation of tests of heterogeneity and bias in meta-analysis
Ioannidis, J. P. A. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.00986.x · Cited by 696
Subclinical hyperthyroidism and the risk of coronary heart disease and mortality
Collet, T.-H., Gussekloo, J., Bauer, D. C., den Elzen, W. P. J., Cappola, A. R., Balmer, P., Iervasi, G., Åsvold, B. O., Sgarbi, J. A., Völzke, H., et al. (2012) · Archives of Internal Medicine · doi:10.1001/archinternmed.2012.402 · Cited by 572
Burke, D. L., Ensor, J., & Riley, R. D. (2017) · Statistics in Medicine · doi:10.1002/sim.7141 · Cited by 538
Syn, N. L., Cummings, D. E., Wang, L. Z., Lin, D. J., Zhao, J. J., Loh, M., Koh, Z. J., Chew, C. A., Loo, Y. E., Tai, B. C., et al. (2021) · The Lancet · doi:10.1016/s0140-6736(21)00591-2 · Cited by 521
Gencer, B., Collet, T.-H., Virgini, V., Bauer, D. C., Gussekloo, J., Cappola, A. R., Nanchen, D., den Elzen, W. P. J., Balmer, P., Luben, R. N., et al. (2012) · Circulation · doi:10.1161/circulationaha.112.096024 · Cited by 517
Reasons or excuses for avoiding meta-analysis in forest plots
Ioannidis, J. P. A., Patsopoulos, N. A., & Rothstein, H. R. (2008) · BMJ · doi:10.1136/bmj.a117 · Cited by 457
Brunoni, A. R., Moffa, A. H., Fregni, F., Palm, U., Padberg, F., Blumberger, D. M., Daskalakis, Z. J., Bennabi, D., Haffen, E., Alonzo, A., et al. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.164715 · Cited by 414
Ahmed, I., Sutton, A. J., & Riley, R. D. (2012) · BMJ · doi:10.1136/bmj.d7762 · Cited by 404
Get real in individual participant data (IPD) meta‐analysis: a review of the methodology
Debray, T. P. A., Moons, K. G. M., van Valkenhoef, G., Efthimiou, O., Hummel, N., Groenwold, R. H. H., Reitsma, J. B., & on behalf of the GetReal methods review group (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1160 · Cited by 348
Cooper, H., & Patall, E. A. (2009) · Psychological Methods · doi:10.1037/a0015565 · Cited by 339
Subclinical Thyroid Dysfunction and Fracture Risk: A Meta-analysis
Blum, M. R., Bauer, D. C., Collet, T.-H., Fink, H. A., Cappola, A. R., da Costa, B. R., Wirth, C. D., Peeters, R. P., Åsvold, B. O., den Elzen, W. P. J., et al. (2015) · JAMA · doi:10.1001/jama.2015.5161 · Cited by 343
Body mass index, hormone replacement therapy, and endometrial cancer risk: A meta-analysis
Crosbie, E. J., Zwahlen, M., Kitchener, H. C., Egger, M., & Renehan, A. G. (2010) · Cancer Epidemiology, Biomarkers & Prevention · doi:10.1158/1055-9965.epi-10-0832 · Cited by 321
Timmermans, A., Opmeer, B. C., Khan, K. S., Bachmann, L. M., Epstein, E., Clark, T. J., Gupta, J. K., Bakour, S. H., van den Bosch, T., van Doorn, H. C., et al. (2010) · Obstetrics & Gynecology · doi:10.1097/aog.0b013e3181e3e7e8 · Cited by 312
Mintjens, S., Menting, M. D., Daams, J. G., van Poppel, M. N. M., Roseboom, T. J., & Gemke, R. J. B. J. (2018) · Sports Medicine · doi:10.1007/s40279-018-0974-5 · Cited by 278
Gagnier, J. J., Moher, D., Boon, H., Beyene, J., & Bombardier, C. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-111 · Cited by 222
Farmer, A. J., Perera, R., Ward, A., Heneghan, C., Oke, J., Barnett, A. H., Davidson, M. B., Guerci, B., Coates, V., Schwedes, U., et al. (2012) · BMJ · doi:10.1136/bmj.e486 · Cited by 156
Rozental, A., Magnusson, K., Boettcher, J., Andersson, G., & Carlbring, P. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000158 · Cited by 137
Iseger, T. A., van Bueren, N. E. R., Kenemans, J. L., Gevirtz, R., & Arns, M. (2020) · Brain Stimulation · doi:10.1016/j.brs.2019.10.006 · Cited by 142
“Since all studies were conducted in the same manner, we pooled the data as if one mega-trial, as a one-stage analysis [86].”
Hua, H., Burke, D. L., Crowther, M. J., Ensor, J., Tudur Smith, C., & Riley, R. D. (2017) · Statistics in Medicine · doi:10.1002/sim.7171 · Cited by 113
Bennett, K., Manassis, K., Walter, S. D., Cheung, A., Wilansky-Traynor, P., Diaz-Granados, N., Duda, S., Rice, M., Baer, S., Barrett, P., et al. (2013) · Depression and Anxiety · doi:10.1002/da.22099 · Cited by 104
Panagioti, M., Bower, P., Kontopantelis, E., Lovell, K., Gilbody, S., Waheed, W., Dickens, C., Archer, J., Simon, G., Ell, K., et al. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.1794 · Cited by 94
Segna, D., Bauer, D. C., Feller, M., Schneider, C., Fink, H. A., Aubert, C. E., Collet, T. ‐., da Costa, B. R., Fischer, K., Peeters, R. P., et al. (2018) · Journal of Internal Medicine · doi:10.1111/joim.12688 · Cited by 87
The effect of treatment as usual on major depressive disorder: A meta-analysis
Kolovos, S., van Tulder, M. W., Cuijpers, P., Prigent, A., Chevreul, K., Riper, H., & Bosmans, J. E. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.12.013 · Cited by 79
Malaria, malnutrition, and birthweight: A meta-analysis using individual participant data
Cates, J. E., Unger, H. W., Briand, V., Fievet, N., Valea, I., Tinto, H., D’Alessandro, U., Landis, S. H., Adu-Afarwuah, S., Dewey, K. G., et al. (2017) · PLOS Medicine · doi:10.1371/journal.pmed.1002373 · Cited by 74
Rozental, A., Andersson, G., & Carlbring, P. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00589 · Cited by 74
“The current study consequently conducted an individual patient data metaanalysis, which is a powerful approach of combining the raw scores from each patient variable across studies instead of only relying on group means and standard deviations (Simmonds et al., 2005).”
BackgroundMethodInfluentialCollet, T.-H., Bauer, D. C., Cappola, A. R., Åsvold, B. O., Weiler, S., Vittinghoff, E., Gussekloo, J., Bremner, A., den Elzen, W. P. J., Maciel, R. M. B., et al. (2014) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2014-1250 · Cited by 71
Andersson, G., Carlbring, P., & Rozental, A. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00749 · Cited by 71
“Sofie 1 (75) General population SCID-I Social anxiety disorder Guided CBT (32) Wait-list (32) 9 modules/9 weeks LSAS-SR SIAS, SPS, SPSQ, BAI, MADRS-S, QOLI 22 (75.”
MethodJonkman, N., Westland, H., Trappenburg, J. C., Groenwold, R. H., Bischoff, E. W., Bourbeau, J., Bucknall, C. E., Coultas, D., Effing, T. W., Epton, M., et al. (2016) · International Journal of Chronic Obstructive Pulmonary Disease · doi:10.2147/copd.s107884 · Cited by 71
Heerdink, M. W., van Kleef, G. A., Homan, A. C., & Fischer, A. H. (2015) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2014.09.004 · Cited by 69
Ida, S., Kaneko, R., & Murata, K. (2019) · Cardiovascular Diabetology · doi:10.1186/s12933-019-0845-x · Cited by 61
Protect us from poor-quality medical research
ESHRE Capri Workshop Group, Ioannidis, J. P. A., Bhattacharya, S., Evers, J. L. H., der Veen, F. V., Somigliana, E., Barratt, C. L. R., Bontempi, G., Baird, D. T., Crosignani, P., et al. (2018) · Human Reproduction · doi:10.1093/humrep/dey056 · Cited by 59
Claus, B. B., Stahlschmidt, L., Dunford, E., Major, J., Harbeck-Weber, C., Bhandari, R. P., Baerveldt, A., Neß, V., Grochowska, K., Hübner-Möhler, B., et al. (2022) · Pain · doi:10.1097/j.pain.0000000000002636 · Cited by 59
Siervo, M., Lara, J., Jajja, A., Sutyarjoko, A., Ashor, A. W., Brandt, K., Qadir, O., Mathers, J. C., Benjamin, N., Winyard, P. G., et al. (2015) · Nitric Oxide · doi:10.1016/j.niox.2015.04.007 · Cited by 52
Zazula, R., Husain, M. I., Mohebbi, M., Walker, A. J., Chaudhry, I. B., Khoso, A. B., Ashton, M. M., Agustini, B., Husain, N., Deakin, J., et al. (2021) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867420965697 · Cited by 31
Kaufmann, E., Reips, U.-D., & Maag Merki, K. (2016) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000251 · Cited by 31
Lin, J., Scott, W., Carpenter, L., Norton, S., Domhardt, M., Baumeister, H., & McCracken, L. M. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1044-2 · Cited by 30
Metadata
- Authors
- Simmonds, M. C., Higginsa, J. P. T., Stewartb, L. A., Tierneyb, J. F., Clarke, M. J., & Thompson, S. G.
- Venue
- Clinical Trials
- Publisher
- SAGE Publications
- Published
- 2005-06
- Volume
- 2
- Issue
- 3
- Pages
- 209-217
- ISSN
- 1740-7745 (ISSN-L)
- 1740-7753
- OpenAlex
- W2113178124
- Cited by
- 555
- References
- 10
- FWCI
- 3.64
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
