Meta-analysis of incidence rate data in the presence of zero events
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
BACKGROUND: When summary results from studies of counts of events in time contain zeros, the study-specific incidence rate ratio (IRR) and its standard error cannot be calculated because the log of zero is undefined. This poses problems for the widely used inverse-variance method that weights the study-specific IRRs to generate a pooled estimate. METHODS: We conducted a simulation study to compare the inverse-variance method of conducting a meta-analysis (with and without the continuity correction) with alternative methods based on either Poisson regression with fixed interventions effects or Poisson regression with random intervention effects. We manipulated the percentage of zeros in the intervention group (from no zeros to approximately 80 percent zeros), the levels of baseline variability and heterogeneity in the intervention effect, and the number of studies that comprise each meta-analysis. We applied these methods to an example from our own work in suicide prevention and to a recent meta-analysis of the effectiveness of condoms in preventing HIV transmission. RESULTS: As the percentage of zeros in the data increased, the inverse-variance method of pooling data shows increased bias and reduced coverage. Estimates from Poisson regression with fixed interventions effects also display evidence of bias and poor coverage, due to their inability to account for heterogeneity. Pooled IRRs from Poisson regression with random intervention effects were unaffected by the percentage of zeros in the data or the amount of heterogeneity. CONCLUSION: Inverse-variance methods perform poorly when the data contains zeros in either the control or intervention arms. Methods based on Poisson regression with random effect terms for the variance components are very flexible offer substantial improvement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression Analysis of Count Data
Cameron, A. C., & Trivedi, P. K. (2013) · doi:10.1017/cbo9781139013567 · Cited by 6,640
Gelman, A. (2006) · Bayesian Analysis · doi:10.1214/06-ba117a · Cited by 4,050
Suicide Prevention Strategies: A Systematic Review
Mann, J. J., Apter, A., Bertolote, J., Beautrais, A., Currier, D., Haas, A., Hegerl, U., Lonnqvist, J., Malone, K., Marusic, A., et al. (2005) · JAMA · doi:10.1001/jama.294.16.2064 · Cited by 2,852
What to add to nothing? Use and avoidance of continuity corrections in meta‐analysis of sparse data
J. Sweeting, M., J. Sutton, A., & C. Lambert, P. (2004) · Statistics in Medicine · doi:10.1002/sim.1761 · Cited by 1,734 · cited 2×
“5 to the counts from both groups of the study [6] although other values have been proposed in the context of pooling odds ratios [9-11].”
BackgroundMetan: fixed- and random-effects meta-analysis
Harris, R. J., Deeks, J. J., Altman, D. G., Bradburn, M. J., Harbord, R. M., & Sterne, J. A. C. (2008) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0800800102 · Cited by 1,027
Much ado about nothing: a comparison of the performance of meta-analytical methods with rare events
Bradburn, M. J., Deeks, J. J., Berlin, J. A., & Russell Localio, A. (2007) · Statistics in Medicine · doi:10.1002/sim.2528 · Cited by 938
Condom effectiveness in reducing heterosexual HIV transmission.
Weller, S. C., & Davis-Beaty, K. (2002) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003255 · Cited by 846
Stijnen, T., Hamza, T. H., & Özdemir, P. (2010) · Statistics in Medicine · doi:10.1002/sim.4040 · Cited by 757 · cited 2×
“First, we evaluated only six methods of analysing incidence rate data, but a number of different methods have been proposed, for example, theMantel Haenszel method [45], Peto’s method [46], the Binomial-Normal method [7].”
BackgroundMethodLambert, P. C., Sutton, A. J., Burton, P. R., Abrams, K. R., & Jones, D. R. (2005) · Statistics in Medicine · doi:10.1002/sim.2112 · Cited by 511
Effectiveness of Barriers at Suicide Jumping Sites: A Case Study
Beautrais, A. L. (2001) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/0004867010060501 · Cited by 118 · cited 1×
“A number of studies have investigated the effectiveness of structural interventions – such as barriers, fences or safety nets – on reducing suicide by jumping at these sites [31-39].”
Background
Cited by
Analysing data and undertaking meta‐analyses
Deeks, J. J., Higgins, J. P., Altman, D. G., & on behalf of the Cochrane Statistical Methods Group (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch10 · Cited by 2,672
Analysing Data and Undertaking Meta‐Analyses
Deeks, J. J., Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch9 · Cited by 1,800
Schreiber, P. W., Sax, H., Wolfensberger, A., Clack, L., Kuster, S. P., & Swissnoso (2018) · Infection Control & Hospital Epidemiology · doi:10.1017/ice.2018.183 · Cited by 325
Shah, S. C., Khalili, H., Gower-Rousseau, C., Olen, O., Benchimol, E. I., Lynge, E., Nielsen, K. R., Brassard, P., Vutcovici, M., Bitton, A., et al. (2018) · Gastroenterology · doi:10.1053/j.gastro.2018.06.043 · Cited by 286
Interventions to reduce suicides at suicide hotspots: a systematic review and meta-analysis
Pirkis, J., Too, L. S., Spittal, M. J., Krysinska, K., Robinson, J., & Cheung, Y. T. D. (2015) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00266-7 · Cited by 191
Self-citation
Metadata
- Authors
- Spittal, M. J., Pirkis, J., & Gurrin, L. C.
- Venue
- BMC Medical Research Methodology
- Published
- 2015-04-30
- Volume
- 15
- Issue
- 1
- Pages
- 42-42
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W2074950349
- Cited by
- 110
- References
- 15
- FWCI
- 1.04
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Meta-analysis of incidence rate data in the presence of zero events. https://app.cochat.ai/papers/10.1186/s12874-015-0031-0
- The paper
- Spittal, M. J., Pirkis, J., & Gurrin, L. C. (2015). Meta-analysis of incidence rate data in the presence of zero events. BMC Medical Research Methodology. https://doi.org/10.1186/s12874-015-0031-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.