Attention should be given to multiplicity issues in systematic reviews
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As many studies reported on several parameters, multivariate meta-analysis was used, enabling simultaneous estimation of summary effect sizes across all immune parameters, and reducing risk of false positives due to multiple comparisons (Bender et al., 2008).”
From Inflammatory markers in depression: a meta-analysis of mean differences and variability in 5,166 patients and 5,083 controls (2020) · cites this paper as Bender et al., 2008
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.013 · Cited by 1,881
Self-citationWhat to add to nothing? Use and avoidance of continuity corrections in meta‐analysis of sparse data
J. Sweeting, M., J. Sutton, A., & C. Lambert, P. (2004) · Statistics in Medicine · doi:10.1002/sim.1761 · Cited by 1,734 · cited 1×
“However, the RevMan analysis adds a continuity correction of 0.5 if there are no events in one group, which might be too high for the data in this review [ 24 ].”
InfluentialCumulative Meta-Analysis of Therapeutic Trials for Myocardial Infarction
Lau, J., Antman, E. M., Jimenez-Silva, J., Kupelnick, B., Mosteller, F., & Chalmers, T. C. (1992) · New England Journal of Medicine · doi:10.1056/nejm199207233270406 · Cited by 1,140 · cited 2×
“Furthermore, to strengthen inferences some reviewers might choose to conduct cumulative meta-analyses (which involve repeated calculations of the overall statistics) after every publication time point of the included trials [ 31 , 32].”
BackgroundMethodPocock, S. J., Assmann, S. E., Enos, L. E., & Kasten, L. E. (2002) · Statistics in Medicine · doi:10.1002/sim.1296 · Cited by 1,077
Risk of cardiovascular events and rofecoxib: cumulative meta-analysis
Jüni, P., Nartey, L., Reichenbach, S., Sterchi, R., Dieppe, P. A., & Egger, M. (2004) · The Lancet · doi:10.1016/s0140-6736(04)17514-4 · Cited by 846
Brookes, S. T., Whitley, E., Peters, T. J., Mulheran, P. A., Egger, M., & Davey Smith, G. (2001) · Health Technology Assessment · doi:10.3310/hta5330 · Cited by 580
Pogue, J. M., & Yusuf, S. (1997) · Controlled Clinical Trials · doi:10.1016/s0197-2456(97)00051-2 · Cited by 415
Research works printed but not linked: 27
- Bauer, 1991, Multiple testing in clinical trials, Stat Med, 10, 871, 10.1002/sim.4780100609 · DOI · Paper page
- Ottenbacher, 1998, Quantitative evaluation of multiplicity in epidemiology and public health research, Am J Epidemiol, 147, 615, 10.1093/oxfordjournals.aje.a009501 · DOI · Paper page
- Biester K, Lange S. The multiplicity problem in systematic reviews [Abstract]. XIII Cochrane Colloquium, Melbourne, 22–26 October 2005. Program and Abstracts; 2005: 153. Available at http://www.cochrane.org/colloquia/abstracts/melbourne/P-155.htm. Accessed May 13, 2008.
- Bender, 2001, Adjusting for multiple testing—when and how?, J Clin Epidemiol, 54, 343, 10.1016/S0895-4356(00)00314-0 · DOI · Paper page
- Bland, 1995, Multiple significance tests: the Bonferroni method, BMJ, 310, 170, 10.1136/bmj.310.6973.170 · DOI · Paper page
- Rabiu, 2006, Interventions for Mooren's ulcer (Protocol), Cochrane Database Syst Rev, 3, 10.1002/14651858.CD006131 · doi:10.1002/14651858.cd006131
- Rolim de Moura, 2002, Laser trabeculoplasty for open angle glaucoma (Protocol), Cochrane Database Syst Rev, 4, 10.1002/14651858.CD003919 · doi:10.1002/14651858.cd003919
- van Houwelingen, 2002, Advanced methods in meta-analysis: multivariate approach and meta-regression, Stat Med, 21, 589, 10.1002/sim.1040 · DOI · Paper page
- Arends, 2003, Combining multiple outcome measures in a meta-analysis: an application, Stat Med, 22, 1335, 10.1002/sim.1370 · DOI · Paper page
- Riley, 2007, Bivariate random-effects meta-analysis and the estimation of between-study correlation, BMC Med Res Methodol, 7, 3, 10.1186/1471-2288-7-3 · DOI · Paper page
- Ishak, 2008, Impact of approximating or ignoring within-study covariances in multivariate meta-analyses, Stat Med, 27, 670, 10.1002/sim.2913 · DOI · Paper page
- Ong, 2005, The efficacy of preemptive analgesia for acute postoperative pain management: a meta-analysis, Anesth Analg, 100, 757, 10.1213/01.ANE.0000144428.98767.0E · DOI · Paper page
- Hasselblad, 1998, Meta-analysis of multitreatment studies, Med Decis Making, 18, 37, 10.1177/0272989X9801800110 · DOI · Paper page
- Riley, 2007, An evaluation of bivariate random-effects meta-analysis for the joint synthesis of two correlated outcomes, Stat Med, 26, 78, 10.1002/sim.2524 · DOI · Paper page
- Bouza, 2006, Systematic review and meta-analysis of transurethral needle ablation in symptomatic benign prostatic hyperplasia, BMC Urol, 6, 14, 10.1186/1471-2490-6-14 · DOI
- Parmar, 1998, Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints, Stat Med, 17, 2815, 10.1002/(SICI)1097-0258(19981230)17:24<2815::AID-SIM110>3.0.CO;2-8 · DOI · Paper page
- Dear, 1994, Iterative generalized least squares for meta-analysis of survival data at multiple times, Biometrics, 50, 989, 10.2307/2533438 · DOI · Paper page
- Clarke, 2006, Compression stockings for preventing deep vein thrombosis in airline passengers, Cochrane Database Syst Rev, 2, 10.1002/14651858.CD004002.pub2 · DOI · Paper page
- Austin, 2006, Testing multiple statistical hypotheses resulted in spurious associations: a study of astrological signs and health, J Clin Epidemiol, 59, 964, 10.1016/j.jclinepi.2006.01.012 · DOI
- Roberts, 2006, Antenatal corticosteroids for accelerating fetal lung maturation for women at risk of preterm birth, Cochrane Database Syst Rev, 3, 10.1002/14651858.CD004454.pub2 · DOI · Paper page
- Lau, 1995, Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care, J Clin Epidemiol, 48, 45, 10.1016/0895-4356(94)00106-Z · DOI · Paper page
- McPherson, 1974, Statistics: The problem of examining accumulating data more than once, N Engl J Med, 290, 501, 10.1056/NEJM197402282900907 · DOI · Paper page
- Devereaux, 2005, How strong is the evidence for the use of perioperative beta blockers in non-cardiac surgery? Systematic review and meta-analysis of randomised controlled trials, BMJ, 331, 313, 10.1136/bmj.38503.623646.8F · DOI · Paper page
- Whitehead, 1997, A prospectively planned cumulative meta-analysis applied to a series of concurrent clinical trials, Stat Med, 16, 2901, 10.1002/(SICI)1097-0258(19971230)16:24<2901::AID-SIM700>3.0.CO;2-5 · DOI · Paper page
- Lan, 2003, Applying the law of iterated logarithm to cumulative meta-analysis of a continuous endpoint, Statistica Sinica, 13, 1135
- Hu, 2007, Applying the law of iterated logarithm to control type I error in cumulative meta-analysis of binary outcomes, Clin Trials, 4, 329, 10.1177/1740774507081219 · DOI
- Ioannidis, 1999, Recursive cumulative meta-analysis: a diagnostic for the evolution of total randomized evidence from group and individual patient data, J Clin Epidemiol, 52, 281, 10.1016/S0895-4356(98)00159-0 · DOI
Cited by
Osimo, E. F., Pillinger, T., Rodriguez, I. M., Khandaker, G. M., Pariante, C. M., & Howes, O. D. (2020) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2020.02.010 · Cited by 937
“parameters, multivariate meta-analysis was used, enabling simultaneous estimation of summary effect sizes across all immune parameters, and reducing risk of false positives due to multiple comparisons (Bender et al., 2008).”
Jakobsen, J. C., Wetterslev, J., Winkel, P., Lange, T., & Gluud, C. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-120 · Cited by 704
“There is an extensive statistical literature about problems with multiplicity in observational studies and randomised clinical trials [29], but problems with multiplicity in systematic reviews have received limited attention [29,31].”
BackgroundMethodInfluentialBaldwin, C., Spiro, A., Ahern, R., & Emery, P. W. (2012) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djr556 · Cited by 400
Heterogeneity and Homogeneity of Regional Brain Structure in Schizophrenia: A Meta-analysis
Brugger, S. P., & Howes, O. D. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.2663 · Cited by 332
Dealing with effect size multiplicity in systematic reviews and meta‐analyses
López‐López, J. A., Page, M. J., Lipsey, M. W., & Higgins, J. P. T. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1310 · Cited by 294
Metadata
- Authors
- Bender, R., Bunce, C., Clarke, M., Gates, S., Lange, S., Pace, N. L., & Thorlund, K.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2008-09
- Volume
- 61
- Issue
- 9
- Pages
- 857-865
- ISSN
- 0895-4356
- Cited by
- 121
- References
- 7
- Language
- en
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Attention should be given to multiplicity issues in systematic reviews. https://app.cochat.ai/papers/10.1016/j.jclinepi.2008.03.004
- The paper
- Bender, R., Bunce, C., Clarke, M., Gates, S., Lange, S., Pace, N. L., & Thorlund, K. (2008). Attention should be given to multiplicity issues in systematic reviews. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2008.03.004
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.