The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Arcsine test for publication bias in meta‐analyses with binary outcomes
Abstract
In meta‐analyses, it sometimes happens that smaller trials show different, often larger, treatment effects. One possible reason for such ‘small study effects’ is publication bias. This is said to occur when the chance of a smaller study being published is increased if it shows a stronger effect. Assuming no other small study effects, under the null hypothesis of no publication bias, there should be no association between effect size and effect precision (e.g. inverse standard error) among the trials in a meta‐analysis. A number of tests for small study effects/publication bias have been developed. These use either a non‐parametric test or a regression test for association between effect size and precision. However, when the outcome is binary, the effect is summarized by the log‐risk ratio or log‐odds ratio (log OR). Unfortunately, these measures are not independent of their estimated standard error. Consequently, established tests reject the null hypothesis too frequently. We propose new tests based on the arcsine transformation, which stabilizes the variance of binomial random variables. We report results of a simulation study under the Copas model (on the log OR scale) for publication bias, which evaluates tests so far proposed in the literature. This shows that: (i) the size of one of the new tests is comparable to those of the best existing tests, including those recently published; and (ii) among such tests it has slightly greater power, especially when the effect size is small and heterogeneity is present. Arcsine tests have additional advantages that they can include trials with zero events in both arms and that they can be very easily performed using the existing software for regression tests. Copyright © 2007 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Drugs for preventing postoperative nausea and vomiting
Carlisle, J., & Stevenson, C. A. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004125.pub2 · Cited by 264
RetractedBias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
Comparison of two methods to detect publication bias in meta-analysis.
Peters, J. L. (2006) · JAMA · doi:10.1001/jama.295.6.676 · Cited by 2,278
A modified test for small‐study effects in meta‐analyses of controlled trials with binary endpoints
Harbord, R. M., Egger, M., & Sterne, J. A. C. (2006) · Statistics in Medicine · doi:10.1002/sim.2380 · Cited by 2,267
Cited by
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709
Self-citationAccelerating extinction risk from climate change
Urban, M. C. (2015) · Science · doi:10.1126/science.aaa4984 · Cited by 2,436
Quantifying publication bias in meta-analysis
Lin, L., & Chu, H. (2018) · Biometrics · doi:10.1111/biom.12817 · Cited by 1,674
Dissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039
Lim, S. S., Davies, M. J., Norman, R. J., & Moran, L. J. (2012) · Human Reproduction Update · doi:10.1093/humupd/dms030 · Cited by 939
Strunz, E. C., Addiss, D. G., Stocks, M. E., Ogden, S., Utzinger, J., & Freeman, M. C. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001620 · Cited by 795
Cupp, M. A., Cariolou, M., Tzoulaki, I., Aune, D., Evangelou, E., & Berlanga-Taylor, A. J. (2020) · BMC Medicine · doi:10.1186/s12916-020-01817-1 · Cited by 697
“The arcsine-Thompson has greater power than similar tests of small study effects when heterogeneity is present; however, it may be overly conservative when no heterogeneity is present [27].”
The association between breastfeeding and childhood obesity: a meta-analysis
Yan, J., Liu, L., Zhu, Y., Huang, G., & Wang, P. P. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-1267 · Cited by 685
Chaimani, A., & Salanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.57 · Cited by 521
de Menthon, M., LaValley, M. P., Maldini, C., Guillevin, L., & Mahr, A. (2009) · Arthritis Care & Research · doi:10.1002/art.24642 · Cited by 462
Cultural competence education for health professionals
Horvat, L., Horey, D., Romios, P., & Kis-Rigo, J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009405.pub2 · Cited by 430
Weibel, S., Jelting, Y., Pace, N. L., Helf, A., Eberhart, L. H., Hahnenkamp, K., Hollmann, M. W., Poepping, D. M., Schnabel, A., & Kranke, P. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009642.pub3 · Cited by 404
Methods for testing publication bias in ecological and evolutionary meta‐analyses
Nakagawa, S., Lagisz, M., Jennions, M. D., Koricheva, J., Noble, D. W. A., Parker, T. H., Sánchez‐Tójar, A., Yang, Y., & O'Dea, R. E. (2022) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13724 · Cited by 399
Elke, G., van Zanten, A. R. H., Lemieux, M., McCall, M., Jeejeebhoy, K. N., Kott, M., Jiang, X., Day, A. G., & Heyland, D. K. (2016) · Critical Care · doi:10.1186/s13054-016-1298-1 · Cited by 378
Moreno, S. G., Sutton, A. J., Ades, A., Stanley, T. D., Abrams, K. R., Peters, J. L., & Cooper, N. J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-2 · Cited by 373
Gili, M., Castellví, P., Vives, M., de la Torre-Luque, A., Almenara, J., Blasco, M. J., Cebrià, A. I., Gabilondo, A., Pérez-Ara, M. A., A, M.-M., et al. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.10.115 · Cited by 365
Prevention of pain on injection of propofol: systematic review and meta-analysis
Jalota, L., Kalira, V., George, E., Shi, Y.-Y., Hornuss, C., Radke, O., Pace, N. L., Apfel, C. C., & Core, O. B. O. T. P. C. R. (2011) · BMJ · doi:10.1136/bmj.d1110 · Cited by 354
Tomasson, G., Grayson, P. C., Mahr, A. D., LaValley, M., & Merkel, P. A. (2012) · Rheumatology · doi:10.1093/rheumatology/ker280 · Cited by 353
Perioperative Use of Arginine-supplemented Diets: A Systematic Review of the Evidence
Drover, J. W., Dhaliwal, R., Weitzel, L., Wischmeyer, P. E., Ochoa, J. B., & Heyland, D. K. (2011) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2010.10.016 · Cited by 350
Afshari, A., Wikkelsø, A., Brok, J., Møller, A. M., & Wetterslev, J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007871.pub2 · Cited by 323
Updated tests for small-study effects in meta-analyses
Harbord, R. M., Harris, R. J., & Sterne, J. A. C. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900202 · Cited by 307
Inhaled nitric oxide for acute respiratory distress syndrome (ARDS) in children and adults
Gebistorf, F., Karam, O., Wetterslev, J., & Afshari, A. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002787.pub3 · Cited by 298
Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis
Rucker, G., Schwarzer, G., Carpenter, J. R., Binder, H., & Schumacher, M. (2011) · Biostatistics · doi:10.1093/biostatistics/kxq046 · Cited by 286
Self-citationGrading the strength of a body of evidence when assessing health care interventions: an EPC update
Berkman, N. D., Lohr, K. N., Ansari, M. T., Balk, E. M., Kane, R., McDonagh, M., Morton, S. C., Viswanathan, M., Bass, E. B., Butler, M., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.11.023 · Cited by 279
Mass media interventions for reducing mental health-related stigma
Clement, S., Lassman, F., Barley, E., Evans-Lacko, S., Williams, P., Yamaguchi, S., Slade, M., Rüsch, N., & Thornicroft, G. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009453.pub2 · Cited by 284
Home safety education and provision of safety equipment for injury prevention
Kendrick, D., Young, B., Mason-Jones, A. J., Ilyas, N., Achana, F. A., Cooper, N. J., Hubbard, S. J., Sutton, A. J., Smith, S., Wynn, P., et al. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005014.pub3 · Cited by 270
Rao, G., Lopez-Jimenez, F., Boyd, J., D’Amico, F., Durant, N. H., Hlatky, M. A., Howard, G., Kirley, K., Masi, C., Powell-Wiley, T. M., et al. (2017) · Circulation · doi:10.1161/cir.0000000000000523 · Cited by 269
Antibiotics to prevent complications following tooth extractions
Lodi, G., Figini, L., Sardella, A., Carrassi, A., Del Fabbro, M., & Furness, S. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003811.pub2 · Cited by 266
O Murchu, E., Marshall, L., Teljeur, C., Harrington, P., Hayes, C., Moran, P., & Ryan, M. (2022) · BMJ Open · doi:10.1136/bmjopen-2020-048478 · Cited by 263
Efficacy and safety of tigecycline for the treatment of infectious diseases: a meta-analysis
Tasina, E., Haidich, A.-B., Kokkali, S., & Arvanitidou, M. (2011) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(11)70177-3 · Cited by 260
Statistical methods for dealing with publication bias in meta‐analysis
Jin, Z., Zhou, X., & He, J. (2015) · Statistics in Medicine · doi:10.1002/sim.6342 · Cited by 252
Rücker, G., Schwarzer, G., Carpenter, J., & Olkin, I. (2009) · Statistics in Medicine · doi:10.1002/sim.3511 · Cited by 252
Self-citationEstimating the Difference Between Published and Unpublished Effect Sizes: A Meta-Review
Polanin, J. R., Tanner-Smith, E. E., & Hennessy, E. A. (2016) · Review of Educational Research · doi:10.3102/0034654315582067 · Cited by 234
Vasopressors for hypotensive shock
Gamper, G., Havel, C., Arrich, J., Losert, H., Pace, N. L., Müllner, M., & Herkner, H. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003709.pub4 · Cited by 239
Antioxidant micronutrients in the critically ill: a systematic review and meta-analysis
Manzanares, W., Dhaliwal, R., Jiang, X., Murch, L., & Heyland, D. K. (2012) · Critical Care · doi:10.1186/cc11316 · Cited by 234
Debray, T. P. A., Moons, K. G. M., & Riley, R. D. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1266 · Cited by 212
Meerwijk, E. L., Parekh, A., Oquendo, M. A., Allen, I. E., Franck, L. S., & Lee, K. A. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)00064-x · Cited by 181
Moreno, S. G., Sutton, A. J., Turner, E. H., Abrams, K. R., Cooper, N. J., Palmer, T. M., & Ades, A. E. (2009) · BMJ · doi:10.1136/bmj.b2981 · Cited by 184
Parenteral glutamine supplementation in critical illness: a systematic review
Wischmeyer, P. E., Dhaliwal, R., McCall, M., Ziegler, T. R., & Heyland, D. K. (2014) · Critical Care · doi:10.1186/cc13836 · Cited by 175
A historical review of publication bias
Marks‐Anglin, A., & Chen, Y. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1452 · Cited by 165
Fan, J., Song, Y., Wang, Y., Hui, R., & Zhang, W. (2012) · PLoS ONE · doi:10.1371/journal.pone.0052182 · Cited by 148
Detecting and adjusting for small‐study effects in meta‐analysis
Rücker, G., Carpenter, J. R., & Schwarzer, G. (2011) · Biometrical Journal · doi:10.1002/bimj.201000151 · Cited by 132
Self-citationEnteral glutamine supplementation in critically ill patients: a systematic review and meta-analysis
van Zanten, A. R. H., Dhaliwal, R., Garrel, D., & Heyland, D. K. (2015) · Critical Care · doi:10.1186/s13054-015-1002-x · Cited by 130
Adjustment for reporting bias in network meta-analysis of antidepressant trials
Trinquart, L., Chatellier, G., & Ravaud, P. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-150 · Cited by 122
Manzanares, W., Langlois, P. L., Dhaliwal, R., Lemieux, M., & Heyland, D. K. (2015) · Critical Care · doi:10.1186/s13054-015-0888-7 · Cited by 116
de Winter, J. C., & Dodou, D. (2015) · PeerJ · doi:10.7717/peerj.733 · Cited by 78
Mueller, K. F., Meerpohl, J. J., Briel, M., Antes, G., von Elm, E., Lang, B., Motschall, E., Schwarzer, G., & Bassler, D. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.015 · Cited by 48
Self-citationLuo, B., Cai, Y., Chen, D., Wang, C., Huang, H., Chen, L., Gao, Y., & Ran, X. (2022) · Journal of Diabetes Research · doi:10.1155/2022/9742665 · Cited by 27
Tak, L. M., Meijer, A., Manoharan, A., de Jonge, P., & Rosmalen, J. G. M. (2010) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3181d714e1 · Cited by 23
Worthington, H. V., Lewis, S. R., Glenny, A.-M., Huang, S. S., Innes, N. P., O'Malley, L., Riley, P., Walsh, T., Wong, M. C. M., Clarkson, J. E., et al. (2024) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012718.pub2 · Cited by 17
Metadata
- Authors
- Rücker, G., Schwarzer, G., & Carpenter, J.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2007-06-26
- Volume
- 27
- Issue
- 5
- Pages
- 746-763
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2157508850
- Cited by
- 444
- References
- 26
- FWCI
- 18.35
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.