The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Individual Participant Data (IPD) Meta-analyses of Randomised Controlled Trials: Guidance on Their Use
Open accessAbstract
Points• Systematic reviews are most commonly based on aggregate data extracted from publications or obtained from trial investigators.• Systematic reviews involving the central collection and analysis of individual participant data (IPD) usually are larger-scale, international, collaborative projects that can bring about substantial improvements to the quantity and quality of data, give greater scope in the analyses, and provide more detailed and robust results.• The process of collecting, checking, and analysing IPD is more complex than for aggregate data, and not all IPD meta-analyses are done to the same standard, making it difficult for researchers, clinicians, patients, policy makers, funders, and publishers to judge their quality.• Following our step-by-step guide will help reviewers and users of IPD meta-analyses to understand them better and recognise those that are well designed and conducted and so help ensure that policy, practice, and research are informed by robust evidence about the effects of interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Statistical Aspects of the Analysis of Data From Retrospective Studies of Disease
(1959) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/22.4.719 · Cited by 14,689 · cited 1×
“, Peto, MantelHaenszel, and inverse-variance [44,45]) and random effects methods (e.”
MethodSterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709 · cited 1×
“Funnel plots may also help indicate the potential impact of both known and unknown missing trials on the results [25] but would not be appropriate in a meta-analysis including less than ten trials [25] or few trials with statistically significant results or one in which heterogeneity has been observed [26].”
Tamoxifen for early breast cancer: an overview of the randomised trials
(1998) · The Lancet · doi:10.1016/s0140-6736(97)11423-4 · Cited by 4,085
Assessing Risk of Bias in Included Studies
Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch8 · Cited by 3,396
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · cited 1×
“If patients drop out or are excluded from the analysis of a trial in considerable numbers and/or disproportionately by arm, this can cause attrition bias (Table 2, [36]), particularly if the reasons are related to the intervention and outcome.”
BackgroundBeta blockade during and after myocardial infarction: An overview of the randomized trials
Yusuf, S., Peto, R., Lewis, J., Collins, R., & Sleight, P. (1985) · Progress in Cardiovascular Diseases · doi:10.1016/s0033-0620(85)80003-7 · Cited by 3,205 · cited 1×
“, Peto, MantelHaenszel, and inverse-variance [44,45]) and random effects methods (e.”
MethodPublication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
Stewart, L. A., Clarke, M., Rovers, M., Riley, R. D., Simmonds, M., Stewart, G., & Tierney, J. F. (2015) · JAMA · doi:10.1001/jama.2015.3656 · Cited by 2,134
Self-citationAnalysing Data and Undertaking Meta‐Analyses
Deeks, J. J., Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch9 · Cited by 1,800
Meta-analysis of individual participant data: rationale, conduct, and reporting
Riley, R. D., Lambert, P. C., & Abo-Zaid, G. (2010) · BMJ · doi:10.1136/bmj.c221 · Cited by 1,701 · cited 2×
“However, the process of collecting, checking, and analysing IPD is more complex than for aggregate data, and recent evidence suggests that not all IPD meta-analyses are done or reported to the same standard [11,12].”
BackgroundSelf-citationThe nuts and bolts of PROSPERO: an international prospective register of systematic reviews
Booth, A., Clarke, M., Dooley, G., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-2 · Cited by 1,433
Self-citationViechtbauer, W. (2007) · Psychometrika · doi:10.1007/s11336-006-1450-y · Cited by 1,250
Kirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133
The appropriateness of asymmetry tests for publication bias in meta-analyses: A large survey
Ioannidis, J. P. A., & Trikalinos, T. A. (2007) · Canadian Medical Association Journal · doi:10.1503/cmaj.060410 · Cited by 1,052 · cited 1×
“Funnel plots may also help indicate the potential impact of both known and unknown missing trials on the results [25] but would not be appropriate in a meta-analysis including less than ten trials [25] or few trials with statistically significant results or one in which heterogeneity has been observed [26].”
(1997) · The Lancet · doi:10.1016/s0140-6736(97)08165-8 · Cited by 1,044
(2008) · Journal of Clinical Oncology · doi:10.1200/jco.2008.16.4368 · Cited by 971
Howell, A. (1998) · PubMed · Cited by 901
Meta-analysis of the literature or of individual patient data: is there a difference?
Stewart, L. A., & Parmar, M. K. B. (1993) · The Lancet · doi:10.1016/0140-6736(93)93004-k · Cited by 769
Self-citationStijnen, T., Hamza, T. H., & Özdemir, P. (2010) · Statistics in Medicine · doi:10.1002/sim.4040 · Cited by 757
青儀, 健. (2006) · Mebio oncology · Cited by 683
Statistical Considerations in the Intent-to-Treat Principle
Lachin, J. M. (2000) · Controlled Clinical Trials · doi:10.1016/s0197-2456(00)00046-5 · Cited by 652
Sterne, J. A., Egger, M., & Moher, D. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch10 · Cited by 651
Sample size slippages in randomised trials: exclusions and the lost and wayward.
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07882-0 · Cited by 642
Stewart, L. A., & Tierney, J. F. (2002) · Evaluation & the Health Professions · doi:10.1177/0163278702025001006 · Cited by 571
Self-citationCHALMERS, I. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26345.x · Cited by 561
Simmonds, M. C., Higginsa, J. P. T., Stewartb, L. A., Tierneyb, J. F., Clarke, M. J., & Thompson, S. G. (2005) · Clinical Trials · doi:10.1191/1740774505cn087oa · Cited by 555
Self-citationAn international registry of systematic-review protocols
Booth, A., Clarke, M., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2011) · The Lancet · doi:10.1016/s0140-6736(10)60903-8 · Cited by 512
Self-citationPractical methodology of meta‐analyses (overviews) using updated individual patient data
Stewart, L. A., & Cochrane Working Group On Meta‐Analysis Using Individual Patient Data (1995) · Statistics in Medicine · doi:10.1002/sim.4780141902 · Cited by 492
Self-citationBerlin, J. A., Santanna, J., Schmid, C. H., Szczech, L. A., & Feldman, H. I. (2002) · Statistics in Medicine · doi:10.1002/sim.1023 · Cited by 468
Ahmed, I., Sutton, A. J., & Riley, R. D. (2012) · BMJ · doi:10.1136/bmj.d7762 · Cited by 404
Self-citationPublication Bias: Recognizing the Problem, Understanding Its Origins and Scope, and Preventing Harm
Dickersin, K. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch2 · Cited by 291
Meta‐analysis of continuous outcomes combining individual patient data and aggregate data
Riley, R. D., Lambert, P. C., Staessen, J. A., Wang, J., Gueyffier, F., Thijs, L., & Boutitie, F. (2008) · Statistics in Medicine · doi:10.1002/sim.3165 · Cited by 279
Self-citationChemotherapy in advanced ovarian cancer: An overview of randomised clinical trials
Stewart, L. A., Aabo, K., Adnitt, P. I., Adams, M., Alberts, D. S., Barley, V., Bell, D. R., Bianchi, U., Blessing, J. A., Buyse, M. E., et al. (1991) · Cited by 270
Self-citationMeta‐analysis of continuous outcome data from individual patients
Higgins, J. P. T., Whitehead, A., Turner, R. M., Omar, R. Z., & Thompson, S. G. (2001) · Statistics in Medicine · doi:10.1002/sim.918 · Cited by 265
A multilevel model framework for meta-analysis of clinical trials with binary outcomes
Turner, R. M., Omar, R. Z., Yang, M., Goldstein, H., & Thompson, S. G. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20001230)19:24<3417::aid-sim614>3.0.co;2-l · Cited by 265
Stewart, G. B., Altman, D. G., Askie, L. M., Duley, L., Simmonds, M. C., & Stewart, L. A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0046042 · Cited by 232
Self-citationInvestigating patient exclusion bias in meta-analysis
Tierney, J. F. (2004) · International Journal of Epidemiology · doi:10.1093/ije/dyh300 · Cited by 221
Self-citationDebray, T. P. A., Moons, K. G. M., Ahmed, I., Koffijberg, H., & Riley, R. D. (2013) · Statistics in Medicine · doi:10.1002/sim.5732 · Cited by 212
Self-citationRiley, R. D., Simmonds, M. C., & Look, M. P. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.09.009 · Cited by 195
Self-citationFisher, D. J., Copas, A. J., Tierney, J. F., & Parmar, M. K. B. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.11.016 · Cited by 182
Self-citationInvestigating heterogeneity in an individual patient data meta-analysis of time to event outcomes
Smith, C. T., Williamson, P. R., & Marson, A. G. (2005) · Statistics in Medicine · doi:10.1002/sim.2050 · Cited by 173
Self-citationAltman, D. G. (1991) · BMJ · doi:10.1136/bmj.302.6791.1481 · Cited by 172
De Luca, G., Gibson, C. M., Bellandi, F., Murphy, S., Maioli, M., Noc, M., Zeymer, U., Dudek, D., Arntz, H.-R., Zorman, S., et al. (2008) · Heart · doi:10.1136/hrt.2008.141648 · Cited by 170
Jeng, G. T. (1995) · JAMA · doi:10.1001/jama.274.10.830 · Cited by 150
Comparison of Meta-Analysis Versus Analysis of Variance of Individual Patient Data
Olkin, I., & Sampson, A. R. (1998) · Biometrics · doi:10.2307/2534018 · Cited by 138
Individual participant data meta-analyses should not ignore clustering
Abo-Zaid, G., Guo, B., Deeks, J. J., Debray, T. P. A., Steyerberg, E. W., Moons, K. G. M., & Riley, R. D. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.12.017 · Cited by 136
Self-citationMultivariate meta‐analysis using individual participant data
Riley, R. D., Price, M. J., Jackson, D., Wardle, M., Gueyffier, F., Wang, J., Staessen, J. A., & White, I. R. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1129 · Cited by 110
Self-citationMeta‐analysis of ordinal outcomes using individual patient data
Whitehead, A., Omar, R., Higgins, J. P. T., Savaluny, E., Turner, R., & Thompson, S. G. (2001) · Statistics in Medicine · doi:10.1002/sim.919 · Cited by 105
Mhaskar, R., Djulbegovic, B., Magazin, A., Soares, H. P., & Kumar, A. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.10.016 · Cited by 102
Meta‐analysis of diagnostic test studies using individual patient data and aggregate data
Riley, R. D., Dodd, S. R., Craig, J. V., Thompson, J. R., & Williamson, P. R. (2008) · Statistics in Medicine · doi:10.1002/sim.3441 · Cited by 97
Self-citationGreb, A., Bohlius, J., Schiefer, D., Schwarzer, G., Schulz, H., & Engert, A. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004024.pub2 · Cited by 95
Individual participant data meta-analysis of prognostic factor studies: state of the art?
Abo-Zaid, G., Sauerbrei, W., & Riley, R. D. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-56 · Cited by 83
Self-citationVale, C. L., Rydzewska, L. H. M., Rovers, M. M., Emberson, J., Gueyffier, F., Stewart, L. A., & on behalf of the Cochrane IPD Meta-analysis Methods Group (2015) · BMJ · doi:10.1136/bmj.h1088 · Cited by 74
Self-citationSakamoto, J., Hamada, C., Yoshida, S., Kodaira, S., Yasutomi, M., Kato, T., Oba, K., Nakazato, H., Saji, S., & Ohashi, Y. (2007) · British Journal of Cancer · doi:10.1038/sj.bjc.6603686 · Cited by 68
PUBLICATION BIAS AND META-ANALYSES: A Practical Example
Burdett, S., Stewart, L. A., & Tierney, J. F. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000126 · Cited by 67
Self-citationBowden, J., Tierney, J. F., Simmonds, M. C., Copas, A. J., & Higgins, J. P. T. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.45 · Cited by 67
Self-citationOn the Equivalence of Meta‐Analysis Using Literature and Using Individual Patient Data
Mathew, T., & Nordström, K. (1999) · Biometrics · doi:10.1111/j.0006-341x.1999.01221.x · Cited by 64
Reviews of Individual Patient Data
Stewart, L. A., Tierney, J. F., & Clarke, M. J. (2008) · Wiley eBooks · doi:10.1002/9780470712184.ch18 · Cited by 57
Self-citationComparison of One‐Step and Two‐Step Meta‐Analysis Models Using Individual Patient Data
Mathew, T., & Nordström, K. (2010) · Biometrical Journal · doi:10.1002/bimj.200900143 · Cited by 57
How individual participant data meta-analyses have influenced trial design, conduct, and analysis
Tierney, J. F., Pignon, J., Gueffyier, F., Clarke, M. J., Askie, L. M., Vale, C. L., Burdett, S., Alderson, P., Askie, L. M., Bennett, D., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.05.024 · Cited by 57
Self-citationSmith, C. T., & Williamson, P. R. (2007) · Clinical Trials · doi:10.1177/1740774507085276 · Cited by 53
Self-citationVale, C. L., Tierney, J. F., & Burdett, S. (2013) · BMJ · doi:10.1136/bmj.f1798 · Cited by 50
Self-citationEmpirical comparison of subgroup effects in conventional and individual patient data meta-analyses
Koopman, L., van der Heijden, G. J. M. G., Hoes, A. W., Grobbee, D. E., & Rovers, M. M. (2008) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462308080471 · Cited by 47
Self-citationIndividual Patient- versus Literature-Based Meta-analysis of Survival Data
Duchateau, L., Pignon, J., Bijnens, L., Bertin, S., Bourhis, J., & Sylvester, R. J. (2001) · Controlled Clinical Trials · doi:10.1016/s0197-2456(01)00152-0 · Cited by 44
Confounding of Subgroup Analyses in Randomized Data
Groenwold, R. H. H., Donders, A. R. T., van der Heijden, G. J. M. G., Hoes, A. W., & Rovers, M. M. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.250 · Cited by 41
Self-citationValue of updating a systematic review in surgery using individual patient data
McCormack, K., Grant, A., & SCOTT, N. W. (2004) · British journal of surgery · doi:10.1002/bjs.4467 · Cited by 28
Stewart, L. A., Tierney, J. F., & Burdett, S. (2005) · doi:10.1002/0470870168.ch14 · Cited by 23
Self-citation
Cited by
Buffart, L. M., Kalter, J., Sweegers, M. G., Courneya, K. S., Newton, R. U., Aaronson, N. K., Jacobsen, P. B., May, A. M., Galvão, D. A., Chinapaw, M. J., et al. (2017) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2016.11.010 · Cited by 595
Riley, R. D., Ensor, J., Snell, K. I. E., Debray, T. P. A., Altman, D. G., Moons, K. G. M., & Collins, G. S. (2016) · BMJ · doi:10.1136/bmj.i3140 · Cited by 585
Self-citationBurke, D. L., Ensor, J., & Riley, R. D. (2017) · Statistics in Medicine · doi:10.1002/sim.7141 · Cited by 538
Self-citationRomero, R., Conde-Agudelo, A., Da Fonseca, E., O’Brien, J. M., Cetingoz, E., Creasy, G. W., Hassan, S. S., & Nicolaides, K. H. (2018) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2017.11.576 · Cited by 522
ECMO for severe ARDS: systematic review and individual patient data meta-analysis
Combes, A., Peek, G. J., Hajage, D., Hardy, P., Abrams, D., Schmidt, M., Dechartres, A., & Elbourne, D. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-06248-3 · Cited by 428
Metadata
- Authors
- Tierney, J. F., Vale, C., Riley, R., Smith, C. T., Stewart, L., Clarke, M., & Rovers, M.
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-07-21
- Volume
- 12
- Issue
- 7
- Pages
- e1001855
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- OpenAlex
- W1923600032
- Cited by
- 361
- References
- 73
- FWCI
- 19.14
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.