Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 162

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Impact of including or excluding both-armed zero-event studies on using standard meta-analysis methods for rare event outcome: a simulation study

Open access
Cheng, Ji, Pullenayegum, Eleanor, Marshall, John K, Iorio, Alfonso, Thabane, Lehana·2016·BMJ Open

Abstract

Objectives: There is no consensus on whether studies with no observed events in the treatment and control arms, the so-called both-armed zero-event studies, should be included in a meta-analysis of randomised controlled trials (RCTs). Current analytic approaches handled them differently depending on the choice of effect measures and authors' discretion. Our objective is to evaluate the impact of including or excluding both-armed zero-event (BA0E) studies in meta-analysis of RCTs with rare outcome events through a simulation study. Method: We simulated 2500 data sets for different scenarios varying the parameters of baseline event rate, treatment effect and number of patients in each trial, and between-study variance. We evaluated the performance of commonly used pooling methods in classical meta-analysis—namely, Peto, Mantel-Haenszel with fixed-effects and random-effects models, and inverse variance method with fixed-effects and random-effects models—using bias, root mean square error, length of 95% CI and coverage. Results: The overall performance of the approaches of including or excluding BA0E studies in meta-analysis varied according to the magnitude of true treatment effect. Including BA0E studies introduced very little bias, decreased mean square error, narrowed the 95% CI and increased the coverage when no true treatment effect existed. However, when a true treatment effect existed, the estimates from the approach of excluding BA0E studies led to smaller bias than including them. Among all evaluated methods, the Peto method excluding BA0E studies gave the least biased results when a true treatment effect existed. Conclusions: We recommend including BA0E studies when treatment effects are unlikely, but excluding them when there is a decisive treatment effect. Providing results of including and excluding BA0E studies to assess the robustness of the pooled estimated effect is a sensible way to communicate the results of a meta-analysis when the treatment effects are unclear.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/bmjopen-2015-010983

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 14

  1. 10.7326/0003-4819-126-5-199703010-00006 · DOI · Paper page
  2. Marodin, 2009, Confusions and ambiguities in the classification of adverse events in the clinical research, Rev Esc Enferm USP, 43, 690, 10.1590/S0080-62342009000300027 · doi:10.1590/s0080-62342009000300027
  3. Drazen JM, Rainey J, Begg H, et al. Adverse Drug Event Reporting: The Roles of Consumers and Health-care Professionals: Workshop Summary (2007). Washington D.C.: The National Academies Press, 2007.
  4. 10.1186/1471-2288-12-64 · DOI
  5. 10.1038/ajg.2008.22 · DOI
  6. 10.1186/1471-2288-7-5 · DOI · Paper page
  7. 10.1177/1740774508090212 · DOI
  8. Spittal, 2015, Meta-analysis of incidence rate data in the presence of zero events, BMC Med Res Methodol, 15, 42, 10.1186/s12874-015-0031-0 · DOI
  9. Kuss, 2015, Statistical methods for meta-analyses including information from studies without any events-add nothing to nothing and succeed nevertheless, Stat Med, 34, 1097, 10.1002/sim.6383 · DOI · Paper page
  10. 10.1097/01.AOG.0000297304.32187.5d · DOI · Paper page
  11. 10.1016/j.cct.2005.08.003 · DOI · Paper page
  12. 10.1002/sim.2673 · DOI · Paper page
  13. 10.1377/hlthaff.24.6.1571 · DOI
  14. Miller, 2005, A new way to evaluate randomized controlled trials? New approach does more harm than good, BCMJ, 47, 241

Cited by

See all 162

Metadata

Authors
Cheng, J., Pullenayegum, E., Marshall, J. K., Iorio, A., & Thabane, L.
Venue
BMJ Open
Publisher
BMJ
Published
2016-08
Volume
6
Issue
8
Pages
e010983
ISSN
2044-6055 (ISSN-L)
OpenAlex
W2508934593
Cited by
162
References
9
FWCI
12.53
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Impact of including or excluding both-armed zero-event studies on using standard meta-analysis methods for rare event outcome: a simulation study. https://app.cochat.ai/papers/10.1136/bmjopen-2015-010983
The paper
Cheng, J., Pullenayegum, E., Marshall, J. K., Iorio, A., & Thabane, L. (2016). Impact of including or excluding both-armed zero-event studies on using standard meta-analysis methods for rare event outcome: a simulation study. BMJ Open. https://doi.org/10.1136/bmjopen-2015-010983

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.