To IPD or not to IPD?: Advantages and Disadvantages of Systematic Reviews Using Individual Patient Data
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Systematic reviews and meta-analyses that obtain original research data on individual participants enrolled in trials have been described as the gold standard of review. However, they may take longer and be more resource intensive than other types of review. The authors describe potential advantages and disadvantages of the individual patient data (IPD) approach, including benefits from improved data quality, benefits afforded by the type of analyses that can be done, and advantages in achieving consensus around results and interpretation by an international multi disciplinary team. Disadvantages and barriers relating to resource and expertise, negotiating collaboration, and software requirements are also discussed. At the outset, reviewers should consider the methodological factors likely to influence results in their particular review setting, together with time and resource constraints, so that an active decision can be made about whether to extract data frompublished reports, collect addi tional or replacement summary data from trialists, or collect IPD.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Parmar, M. K. B., Torri, V., & Stewart, L. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19981230)17:24<2815::aid-sim110>3.0.co;2-8 · Cited by 4,802
Self-citationTamoxifen for early breast cancer: an overview of the randomised trials
(1998) · The Lancet · doi:10.1016/s0140-6736(97)11423-4 · Cited by 4,085
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Non-small Cell Lung Cancer Collaborative Group (1995) · BMJ · doi:10.1136/bmj.311.7010.899 · Cited by 2,850
Systemic treatment of early breast cancer by hormonal, cytotoxic, or immune therapy
Early Breast Cancer Trialist's Collaborative Group (1992) · The Lancet · doi:10.1016/0140-6736(92)90997-h · Cited by 2,182
The Existence of Publication Bias and Risk Factors for Its Occurrence
Dickersin, K. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100097014 · Cited by 1,417 · cited 1×
“It is widely appreciated that trials with positive results are more likely to be published than those with negative results (Dickersin, 1990; Dickersin, Min, & Meinert, 1992; Easterbrook, Berlin, Gopalan, & Matthews, 1991; Stern & Simes, 1997).”
Background(1997) · The Lancet · doi:10.1016/s0140-6736(97)08165-8 · Cited by 1,044
Effects of Adjuvant Tamoxifen and of Cytotoxic Therapy on Mortality in Early Breast Cancer
Early Breast Cancer Trialists' Collaborative Group (1988) · New England Journal of Medicine · doi:10.1056/nejm198812293192601 · Cited by 933
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias: evidence of delayed publication in a cohort study of clinical research projects
Stern, J. M., & Simes, R. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.640 · Cited by 818 · cited 2×
“It is often said that IPD reviews are much more time consuming and expensive than other forms of systematic review (Stern & Simes, 1997).”
BackgroundImpact of covert duplicate publication on meta-analysis: a case study
Tramèr, M. R., Reynolds, D. J. M., Moore, R. A., & McQuay, H. J. (1997) · BMJ · doi:10.1136/bmj.315.7109.635 · Cited by 702
Summing up evidence: one answer is not always enough
Lau, J., Ioannidis, J. P., & Schmid, C. H. (1998) · The Lancet · doi:10.1016/s0140-6736(97)08468-7 · Cited by 655
CHALMERS, I. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26345.x · Cited by 561
Randomisation and baseline comparisons in clinical trials
Altman, D. G., & Doré, C. J. (1990) · The Lancet · doi:10.1016/0140-6736(90)90014-v · Cited by 508
Practical methodology of meta‐analyses (overviews) using updated individual patient data
Stewart, L. A., & Cochrane Working Group On Meta‐Analysis Using Individual Patient Data (1995) · Statistics in Medicine · doi:10.1002/sim.4780141902 · Cited by 492
Self-citationEU Hernia Trialists Collaboration, & Grant, A. (2000) · Journal of British Surgery · doi:10.1046/j.1365-2168.2000.01539.x · Cited by 368
EU Hernia Trialists Collaboration, & Grant, A. (2000) · Journal of British Surgery · doi:10.1046/j.1365-2168.2000.01540.x · Cited by 328
Chemotherapy in advanced ovarian cancer: An overview of randomised clinical trials
Stewart, L. A., Aabo, K., Adnitt, P. I., Adams, M., Alberts, D. S., Barley, V., Bell, D. R., Bianchi, U., Blessing, J. A., Buyse, M. E., et al. (1991) · Cited by 270
Self-citationAdvanced Ovarian Cancer Trialists' Group, Aabo, K., Adams, M., Adnitt, P., Alberts, D., Athanazziou, A., Barley, V, Bell, D., Bianchi, U., Bolis, G., et al. (1998) · British Journal of Cancer · doi:10.1038/bjc.1998.710 · Cited by 234
Self-citationDroller, M. J. (2000) · PubMed · Cited by 207
Non-random Reflections on Health Services Research
Clarke, M. (1998) · BMJ · doi:10.1136/bmj.316.7143.1543 · Cited by 175
Cholinesterase Inhibition for Alzheimer Disease: A Meta-analysis of the Tacrine Trials
Qizilbash, N., Whitehead, A., Higgins, J., Wilcock, G., Schneider, L., Farlow, M., & for the Dementia Trialists' Collaboration (1998) · JAMA · doi:10.1001/jama.280.20.1777 · Cited by 161 · cited 2×
“More recently, IPD has also been used in systematic reviews in a number of other fields, including Alzheimer’s disease (Qizilbash et al., 1998), dyspepsia, epilepsy (Marson, Williamson, Hutton, Clough, & Chadwick, 2000), malaria, HIV infection (HIV Trialists Collaborative Group, 1999), and hernia…”
MethodIndividual patient data meta-analysis in cancer
Clarke, M. J., Stewart, L. A., Pignon, J., & Bijnens, L. (1998) · British Journal of Cancer · doi:10.1038/bjc.1998.339 · Cited by 52
Self-citationAbrams, D., Allan, D., Antunes, F., Breckenridge, A., Bruun, J., Cameron, W., Carbon, C., Chalmers, I., Chang, H., Chodakewitz, J., et al. (1999) · The Lancet · doi:10.1016/s0140-6736(98)12263-8 · Cited by 50
Meta-analyses of randomised trials: when the whole is more than just the sum of the parts
Parmar, M., Stewart, L. A., & Altman, D. G. (1996) · British Journal of Cancer · doi:10.1038/bjc.1996.392 · Cited by 23
Self-citation
Cited by
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Guyot, P., Ades, A., Ouwens, M. J., & Welton, N. J. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-9 · Cited by 2,526
Stewart, L. A., Clarke, M., Rovers, M., Riley, R. D., Simmonds, M., Stewart, G., & Tierney, J. F. (2015) · JAMA · doi:10.1001/jama.2015.3656 · Cited by 2,134
Self-citationMeta-analysis of individual participant data: rationale, conduct, and reporting
Riley, R. D., Lambert, P. C., & Abo-Zaid, G. (2010) · BMJ · doi:10.1136/bmj.c221 · Cited by 1,701
Fan, E., Del Sorbo, L., Goligher, E. C., Hodgson, C. L., Munshi, L., Walkey, A. J., Adhikari, N. K. J., Amato, M. B. P., Branson, R., Brower, R. G., et al. (2017) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201703-0548st · Cited by 1,630
Metadata
- Authors
- Stewart, L. A., & Tierney, J. F.
- Venue
- Evaluation & the Health Professions
- Publisher
- SAGE Publications
- Published
- 2002-03
- Volume
- 25
- Issue
- 1
- Pages
- 76-97
- ISSN
- 0163-2787 (ISSN-L)
- 1552-3918
- OpenAlex
- W2150683078
- Cited by
- 571
- References
- 31
- FWCI
- 6.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.