The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Impact of including or excluding both-armed zero-event studies on using standard meta-analysis methods for rare event outcome: a simulation study
Open accessAbstract
Objectives: There is no consensus on whether studies with no observed events in the treatment and control arms, the so-called both-armed zero-event studies, should be included in a meta-analysis of randomised controlled trials (RCTs). Current analytic approaches handled them differently depending on the choice of effect measures and authors' discretion. Our objective is to evaluate the impact of including or excluding both-armed zero-event (BA0E) studies in meta-analysis of RCTs with rare outcome events through a simulation study. Method: We simulated 2500 data sets for different scenarios varying the parameters of baseline event rate, treatment effect and number of patients in each trial, and between-study variance. We evaluated the performance of commonly used pooling methods in classical meta-analysis—namely, Peto, Mantel-Haenszel with fixed-effects and random-effects models, and inverse variance method with fixed-effects and random-effects models—using bias, root mean square error, length of 95% CI and coverage. Results: The overall performance of the approaches of including or excluding BA0E studies in meta-analysis varied according to the magnitude of true treatment effect. Including BA0E studies introduced very little bias, decreased mean square error, narrowed the 95% CI and increased the coverage when no true treatment effect existed. However, when a true treatment effect existed, the estimates from the approach of excluding BA0E studies led to smaller bias than including them. Among all evaluated methods, the Peto method excluding BA0E studies gave the least biased results when a true treatment effect existed. Conclusions: We recommend including BA0E studies when treatment effects are unlikely, but excluding them when there is a decisive treatment effect. Providing results of including and excluding BA0E studies to assess the robustness of the pooled estimated effect is a sensible way to communicate the results of a meta-analysis when the treatment effects are unclear.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reprint—Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & and the PRISMA Group (2009) · Physical Therapy · doi:10.1093/ptj/89.9.873 · Cited by 2,486
Meta-analysis: Principles and procedures
Egger, M., Smith, G. D., & Phillips, A. N. (1997) · BMJ · doi:10.1136/bmj.315.7121.1533 · Cited by 2,415
What to add to nothing? Use and avoidance of continuity corrections in meta‐analysis of sparse data
J. Sweeting, M., J. Sutton, A., & C. Lambert, P. (2004) · Statistics in Medicine · doi:10.1002/sim.1761 · Cited by 1,734
Metan: fixed- and random-effects meta-analysis
Harris, R. J., Deeks, J. J., Altman, D. G., Bradburn, M. J., Harbord, R. M., & Sterne, J. A. C. (2008) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0800800102 · Cited by 1,027
Hierarchy of evidence: a framework for ranking evidence evaluating healthcare interventions
Evans, D. (2003) · Journal of Clinical Nursing · doi:10.1046/j.1365-2702.2003.00662.x · Cited by 993
Much ado about nothing: a comparison of the performance of meta-analytical methods with rare events
Bradburn, M. J., Deeks, J. J., Berlin, J. A., & Russell Localio, A. (2007) · Statistics in Medicine · doi:10.1002/sim.2528 · Cited by 938
Small study effects in meta-analyses of osteoarthritis trials: meta-epidemiological study
Nuesch, E., Trelle, S., Reichenbach, S., Rutjes, A. W. S., Tschannen, B., Altman, D. G., Egger, M., & Juni, P. (2010) · BMJ · doi:10.1136/bmj.c3515 · Cited by 559 · cited 1×
“Some studies have showed that the treatment effect tends to be overestimates when the trials were underpowered.(24) 25 On the other hand, when the result of a meta-analysis is regarding the safety measures such as serious adverse event, the conservative result means underestimating the harm, which could lead to expose…”
BackgroundDavey, J., Turner, R. M., Clarke, M. J., & Higgins, J. P. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-160 · Cited by 404
Zhang, Z., Xu, X., & Ni, H. (2013) · Critical Care · doi:10.1186/cc11919 · Cited by 295
Research works printed but not linked: 14
- 10.7326/0003-4819-126-5-199703010-00006 · DOI · Paper page
- Marodin, 2009, Confusions and ambiguities in the classification of adverse events in the clinical research, Rev Esc Enferm USP, 43, 690, 10.1590/S0080-62342009000300027 · doi:10.1590/s0080-62342009000300027
- Drazen JM, Rainey J, Begg H, et al. Adverse Drug Event Reporting: The Roles of Consumers and Health-care Professionals: Workshop Summary (2007). Washington D.C.: The National Academies Press, 2007.
- 10.1186/1471-2288-12-64 · DOI
- 10.1038/ajg.2008.22 · DOI
- 10.1186/1471-2288-7-5 · DOI · Paper page
- 10.1177/1740774508090212 · DOI
- Spittal, 2015, Meta-analysis of incidence rate data in the presence of zero events, BMC Med Res Methodol, 15, 42, 10.1186/s12874-015-0031-0 · DOI
- Kuss, 2015, Statistical methods for meta-analyses including information from studies without any events-add nothing to nothing and succeed nevertheless, Stat Med, 34, 1097, 10.1002/sim.6383 · DOI · Paper page
- 10.1097/01.AOG.0000297304.32187.5d · DOI · Paper page
- 10.1016/j.cct.2005.08.003 · DOI · Paper page
- 10.1002/sim.2673 · DOI · Paper page
- 10.1377/hlthaff.24.6.1571 · DOI
- Miller, 2005, A new way to evaluate randomized controlled trials? New approach does more harm than good, BCMJ, 47, 241
Cited by
Worldwide prevalence of oral lichen planus: A systematic review and meta‐analysis
González‐Moles, M. Á., Warnakulasuriya, S., González‐Ruiz, I., González‐Ruiz, L., Ayén, Á., Lenouvel, D., Ruiz‐Ávila, I., & Ramos‐García, P. (2021) · Oral Diseases · doi:10.1111/odi.13323 · Cited by 463
Fodor, L. A., Coteț, C. D., Cuijpers, P., Szamoskozi, Ș., David, D., & Cristea, I. A. (2018) · Scientific Reports · doi:10.1038/s41598-018-28113-6 · Cited by 284
O Murchu, E., Marshall, L., Teljeur, C., Harrington, P., Hayes, C., Moran, P., & Ryan, M. (2022) · BMJ Open · doi:10.1136/bmjopen-2020-048478 · Cited by 263
Henderson, J. T., Vesco, K. K., Senger, C. A., Thomas, R. G., & Redmond, N. (2021) · JAMA · doi:10.1001/jama.2021.8551 · Cited by 227
Nury, E., Schmucker, C., Nagavci, B., Motschall, E., Nitschke, K., Schulte, E., Wegwarth, O., & Meerpohl, J. J. (2022) · Pain · doi:10.1097/j.pain.0000000000002423 · Cited by 85
Metadata
- Authors
- Cheng, J., Pullenayegum, E., Marshall, J. K., Iorio, A., & Thabane, L.
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2016-08
- Volume
- 6
- Issue
- 8
- Pages
- e010983
- ISSN
- 2044-6055 (ISSN-L)
- OpenAlex
- W2508934593
- Cited by
- 162
- References
- 9
- FWCI
- 12.53
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Impact of including or excluding both-armed zero-event studies on using standard meta-analysis methods for rare event outcome: a simulation study. https://app.cochat.ai/papers/10.1136/bmjopen-2015-010983
- The paper
- Cheng, J., Pullenayegum, E., Marshall, J. K., Iorio, A., & Thabane, L. (2016). Impact of including or excluding both-armed zero-event studies on using standard meta-analysis methods for rare event outcome: a simulation study. BMJ Open. https://doi.org/10.1136/bmjopen-2015-010983
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.