The DOI matches its Crossref record; 25 of the 28 references it cites were found in a registry or an index.
Exact Power of Conditional and Unconditional Tests: Going Beyond the 2 × 2 Contingency Table
Abstract
The controversial question of whether one should condition on both margins of a contingency table for exact inference is examined from a fresh, computational perspective. The conditional test is believed to be less powerful than the unconditional test. However, in all previous work the actual hard evidence for this alleged power loss has always been provided by the single 2 × 2 table. In this setting the discreteness of the test statistic confounds the issue since the loss in power is offset by a corresponding reduction in Type 1 error. Although one could overcome discreteness through an auxiliary randomization experiment, this would not resolve the controversy, because such post hoc randomization is unacceptable to the practicing statistician. We overcome the discreteness more naturally by extending the power computations to 2 × 3 contingency tables. In doing so we find that the power advantage of the unconditional test rapidly vanishes. The article also discusses computational difficulties we would encounter if we attempted to extend the unconditional test beyond the 2 × 2 table.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Nonparametrics: Statistical Methods Based on Ranks
Mergenthaler, M. J., & Lehmann, E. L. (1979) · Technometrics · doi:10.1080/00401706.1979.10489764 · Cited by 3,390
Nonparametrics: Statistical Methods Based on Ranks.
Beaver, R. J., & Lehmann, E. L. (1976) · Biometrics · doi:10.2307/2529529 · Cited by 2,047
Journal of the Royal Statistical Society.
(1921) · The Economic Journal · doi:10.1093/ej/31.121.133 · Cited by 1,465
Statistical Methods and Scientific Inference.
Bartlett, M. S., & Fisher, R. A. (1957) · Biometrika · doi:10.2307/2333276 · Cited by 1,278
A Network Algorithm for Performing Fisher's Exact Test in r × c Contingency Tables
Mehta, C. R., & Patel, N. R. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477989 · Cited by 898
Self-citationToutenburg, H. (1977) · ZAMM - Journal of Applied Mathematics and Mechanics / Zeitschrift für Angewandte Mathematik und Mechanik · doi:10.1002/zamm.19770570922 · Cited by 787
Statistical Methods and Scientific Inference.
Jowett, G. H., & Fisher, R. A. (1957) · Applied Statistics · doi:10.2307/2985611 · Cited by 703
Upton, G. J. G. (1992) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982890 · Cited by 606
Test of Significance for 2 × 2 Contingency Tables
Yates, F. (1984) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981577 · Cited by 364
Cited by
A Survey of Exact Inference for Contingency Tables
Agresti, A. (1992) · Statistical Science · doi:10.1214/ss/1177011454 · Cited by 1,097
Differential Growth of the Mouse Preimplantation Embryo in Chemically Defined Media1
Erbach, G. T., Lawitts, J. A., Papaioannou, V. E., & Biggers, J. D. (1994) · Biology of Reproduction · doi:10.1095/biolreprod50.5.1027 · Cited by 369
Dagianti, A., Penco, M., Agati, L., Sciomer, S., Dagianti, A., Rosanio, S., & Fedele, F. (1995) · Journal of the American College of Cardiology · doi:10.1016/0735-1097(95)00121-f · Cited by 181
Exact inference for categorical data: recent advances and continuing controversies
Agresti, A. (2001) · Statistics in Medicine · doi:10.1002/sim.738 · Cited by 162
Mehrotra, D. V., Chan, I. S. F., & Berger, R. L. (2003) · Biometrics · doi:10.1111/1541-0420.00051 · Cited by 138
Good practice in testing for an association in contingency tables
Ruxton, G. D., & Neuhäuser, M. (2010) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-010-1014-0 · Cited by 86
Gibb, H. J., Haver, C. E., Gaylor, D. W., Ramasamy, S., Lee, J. S., Lobdell, D. T., Wade, T. J., Chen, C., White, P., & Sams, R. L. (2010) · Environmental Health Perspectives · doi:10.1289/ehp.1002427 · Cited by 84
Statistical evaluation of rough set dependency analysis
Düntsch, I., & Gediga, G. (1997) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1996.0105 · Cited by 82
Methods for the analysis of multiple endpoints in small populations: A review
Ristl, R., Urach, S., Rosenkranz, G., & Posch, M. (2018) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2018.1489402 · Cited by 77
Infrared pupillometry to detect the light reflex during cardiopulmonary resuscitation: A case series
Behrends, M., Niemann, C. U., & Larson, M. D. (2012) · Resuscitation · doi:10.1016/j.resuscitation.2012.05.013 · Cited by 67
Power and Sample Size Calculations for Exact Conditional Tests with Ordered Categorical Data
Hilton, J. F., & Mehta, C. R. (1993) · Biometrics · doi:10.2307/2532573 · Cited by 61
Self-citationSurvey of the current status of sustainable concrete production in the U.S.
Jin, R., Chen, Q., & Soboyejo, A. B. O. (2015) · Resources Conservation and Recycling · doi:10.1016/j.resconrec.2015.10.011 · Cited by 49
Exact Inference for Categorical Data
Corcoran, C. D., Senchaudhuri, P., Mehta, C. R., & Patel, N. R. (2014) · Wiley eBooks · doi:10.1002/9781118445112.stat04864 · Cited by 49
Self-citationChoice of test for association in small sample unordered r × c tables
Lydersen, S., Pradhan, V., Senchaudhuri, P., & Laake, P. (2007) · Statistics in Medicine · doi:10.1002/sim.2839 · Cited by 48
Papagregoriou, G., Erguler, K., Dweep, H., Voskarides, K., Koupepidou, P., Athanasiou, Y., Pierides, A., Gretz, N., Felekkis, K. N., & Deltas, C. C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0031021 · Cited by 51
Conditional versus Unconditional Exact Tests for Comparing Two Binomials
Mehta, C. R., & Senchaudhuri, P. (2003) · Cited by 46
Self-citationUnconditional Versions of Several Tests Commonly Used in the Analysis of Contingency Tables
Freidlin, B., & Gastwirth, J. L. (1999) · Biometrics · doi:10.1111/j.0006-341x.1999.00264.x · Cited by 36
The analysis of 2 × 1 and 2 × 2 contingency tables: an historical review
Richardson, J. T. E. (1994) · Statistical Methods in Medical Research · doi:10.1177/096228029400300202 · Cited by 34
Is Fisher's exact test very conservative?
Andrés, A. M., & Tejedor, I. H. (1995) · Computational Statistics & Data Analysis · doi:10.1016/0167-9473(94)00013-9 · Cited by 32
Lam, G. K., Hopoate-Sitake, M., Adair, C. D., Buckalew, V. M., Johnson, D., Lewis, D. F., Robinson, C., Saade, G. R., & Graves, S. W. (2013) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2013.04.010 · Cited by 29
Olesen, S. W., & Gerardin, Y. (2020) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjaa170 · Cited by 29
Admissibility of exact conditional tests of stochastic order
Berger, V. W. (1998) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(97)00078-5 · Cited by 28
Do the Chi-Square Test and Fisher’s Exact Test Agree in Determining Extreme for 2 × 2 Tables?
Chen, Y.-P. (2011) · The American Statistician · doi:10.1198/tas.2011.10115 · Cited by 26
Improving Tests for Superior Treatment in Contingency Tables
Berger, V. W., & Sackrowitz, H. B. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474022 · Cited by 25
The Choice Between Pearson's χ 2 Test and Fisher's Exact Test for 2 × 2 Tables
Neuhäuser, M., & Ruxton, G. D. (2025) · Pharmaceutical Statistics · doi:10.1002/pst.70012 · Cited by 24
Accurate confidence intervals for proportion in studies with clustered binary outcome
Shan, G. (2020) · Statistical Methods in Medical Research · doi:10.1177/0962280220913971 · Cited by 22
Responsible Reporting: Neuroimaging News in the Age of Responsible Research and Innovation
de Jong, I. M., Kupper, F., Arentshorst, M. E., & Broerse, J. E. W. (2015) · Science and Engineering Ethics · doi:10.1007/s11948-015-9684-7 · Cited by 22
Exact tests based on the Baumgartner-Weiß-Schindler statistic—A survey
Neuhäuser, M. (2005) · Statistical Papers · doi:10.1007/bf02762032 · Cited by 21
The function of loud calls (Hoot Series) in wild western gorillas ( G orilla gorilla)
Salmi, R., & Doran‐Sheehy, D. M. (2014) · American Journal of Physical Anthropology · doi:10.1002/ajpa.22575 · Cited by 21
A discussion on significance indices for contingency tables under small sample sizes
Oliveira, N. L., Pereira, C. A. D. B., Diniz, M. A., & Polpo, A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0199102 · Cited by 20
Kang, S., & Ahn, C. W. (2007) · Statistics in Medicine · doi:10.1002/sim.3055 · Cited by 19
Androstenetriol improves survival in a rodent model of traumatic shock
Marcu, A. C., Kielar, N. D., Paccione, K. E., Barbee, R. W., Carter, H., Ivatury, R. R., Diegelmann, R. F., Ward, K. R., & Loria, R. M. (2006) · Resuscitation · doi:10.1016/j.resuscitation.2006.03.020 · Cited by 19
Exact Inference for Categorical Data
Corcoran, C. D., Senchaudhuri, P., Mehta, C. R., & Patel, N. R. (2005) · Wiley eBooks · doi:10.1002/0470011815.b2a10019 · Cited by 18
Self-citationEndocannabinoid system protects against cryptogenic seizures
van Rijn, C. M., Perescis Martin, F. J., Vinogradova, L. V., & van, L. G. (2011) · Pharmacological Reports · doi:10.1016/s1734-1140(11)70411-x · Cited by 18
Contemporary Frequentist Views of the $2\times2$ Binomial Trial
Ripamonti, E., Lloyd, C. J., & Quatto, P. (2017) · Statistical Science · doi:10.1214/17-sts627 · Cited by 17
Tovar, M. A., Pilkington, R. A., Goodwin, T. L., & Root, J. M. (2022) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x22000747 · Cited by 16
Dextromethorphan Abuse Among Opioid-Dependent Patients
Windhab, L. G., Gastberger, S., Hulka, L. M., Baumgartner, M. R., Soyka, M., Müller, T., Seifritz, E., & Mutschler, J. (2020) · Clinical Neuropharmacology · doi:10.1097/wnf.0000000000000403 · Cited by 16
Trend Tests for Dichotomous Endpoints with Application to Carcinogenicity Studies
Neuhäuser, M., & Hothorn, L. A. (1997) · Drug Information Journal · doi:10.1177/009286159703100217 · Cited by 16
Shan, G., Moonie, S. A., & Shen, J. J. (2014) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2014.1000545 · Cited by 14
On Exact Unconditional Test for Linear Trend in Dose-Response Studies
Tang, M., Chan, P. S., & Chan, W. (2000) · Biometrical Journal · doi:10.1002/1521-4036(200011)42:7<795::aid-bimj795>3.0.co;2-g · Cited by 15
Optimal exact tests for multiple binary endpoints
Ristl, R., Xi, D., Glimm, E., & Posch, M. (2018) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2018.01.001 · Cited by 14
Tests of Independence in Contingency Tables with Small Samples: A Comparison of Statistical Power
Parshall, C. G., & Kromrey, J. D. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056001002 · Cited by 14
Optimal Unconditional Tables for Comparing Two Independent Proportions
Andrés, A. M., & Mato, A. S. (1995) · Biometrical Journal · doi:10.1002/bimj.4710370706 · Cited by 14
Difference of two dependent sensitivities and specificities: Comparison of various approaches
Wenzel, D., & Zapf, A. (2013) · Biometrical Journal · doi:10.1002/bimj.201200186 · Cited by 13
Effects of Abstraction on Selecting Relevant Biological Phenomena for Biomimetic Design
Feng, T., Cheong, H., & Shu, L. H. (2014) · Journal of Mechanical Design · doi:10.1115/1.4028173 · Cited by 13
A more powerful unconditional exact test of homogeneity for 2 × c contingency table analysis
Ehwerhemuepha, L., Sok, H., & Rakovski, C. S. (2019) · Journal of Applied Statistics · doi:10.1080/02664763.2019.1601689 · Cited by 12
May the Odds Be in Your Favor: Why Many Attempts to Reoperate Dams for the Environment Stall
Owusu, A. G., Mul, M., van der Zaag, P., & Slinger, J. H. (2022) · Journal of Water Resources Planning and Management · doi:10.1061/(asce)wr.1943-5452.0001521 · Cited by 11
Exact inference for fixed‐effects meta‐analysis of proportions
Hansen, S. L., & Rice, K. M. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1526 · Cited by 11
Exact approaches for testing hypotheses based on the intra‐class kappa coefficient
Wilding, G. E., Consiglio, J. D., & Shan, G. (2014) · Statistics in Medicine · doi:10.1002/sim.6135 · Cited by 11
Exact power computation for dose—response studies
Tang, M., Hirji, K. F., & Vollset, S. E. (1995) · Statistics in Medicine · doi:10.1002/sim.4780142009 · Cited by 10
Neuhäuser, M. (2006) · Journal of Applied Statistics · doi:10.1080/02664760500389756 · Cited by 9
Optimal testing strategies for large, sparse multinomial models
Maiste, P. J., & Weir, B. S. (2004) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2003.08.002 · Cited by 8
Cannabinoid antagonist SLV326 induces convulsive seizures and changes in the interictal EEG in rats
Perescis, M. F. J., de Bruin, N. M. W. J., Heijink, L., Kruse, C. G., Vinogradova, L. V., Lüttjohann, A., van Luijtelaar, G., & van Rijn, C. M. (2017) · PLoS ONE · doi:10.1371/journal.pone.0165363 · Cited by 10
Roost site selection of western long‐eared myotis in a western juniper woodland
Anthony, C. R., & Sanchez, D. M. (2018) · Journal of Wildlife Management · doi:10.1002/jwmg.21416 · Cited by 8
Exact Cochran–Armitage trend tests: comparisons under different models
Tang, M., Ng, H. K. T., Guo, J., Chan, W., & Chan, P. S. (2006) · Journal of Statistical Computation and Simulation · doi:10.1080/10629360600569519 · Cited by 7
An Introduction to Binary Response Regression and Associated Trend Analyses
Piegorsch, W. W. (1998) · Journal of Quality Technology · doi:10.1080/00224065.1998.11979855 · Cited by 7
Conditional tests for homogeneity of zero-inflated Poisson and Poisson-hurdle distributions
Bedrick, E. J., & Hossain, A. (2012) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2012.11.009 · Cited by 6
Levin, B. L., & Chen, X. (1999) · The American Statistician · doi:10.1080/00031305.1999.10474431 · Cited by 6
Langaas, M., & Bakke, Ø. (2014) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2013-0084 · Cited by 6
Telling tales from the tails: High‐dimensional tail interdependence
Polanski, A., Stoja, E., & Windmeijer, F. (2019) · Journal of Applied Econometrics · doi:10.1002/jae.2708 · Cited by 6
On a Comparison of Tests of Homogeneity of Binomial Proportions
Klein, M., & Linton, P. (2013) · Journal of Statistical Theory and Applications · doi:10.2991/jsta.2013.12.3.1 · Cited by 6
Tang, M. (2000) · Journal of Applied Statistics · doi:10.1080/02664760050120551 · Cited by 5
DETERMINATION OF VIRULENCE FACTORS IN Haemophilus parasuis ISOLATES
Pavelko, V. I., Babin, Y. Y., Sprygin, A. V., Pruntova, O. V., СПРЫГИН, А. В., животных», Ф. «. Ц. О. З., ПРУНТОВА, О. В., & животных», Ф. «. Ц. О. З. (2016) · Sel skokhozyaistvennaya Biologiya · doi:10.15389/agrobiology.2016.4.491eng · Cited by 4
The Analysis of Stratified 2 × 2 Contingency Tables
Berger, V. W., Ştefănescu, C., & Zhou, Y. (2006) · Biometrical Journal · doi:10.1002/bimj.200610277 · Cited by 4
Which Exact Test is More Powerful in Testing the Hardy–Weinberg Law?
Kang, S. H. (2007) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610910701420065 · Cited by 4
Parshall, C. G., Kromrey, J. D., & Dailey, R. (1999) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610919908813548 · Cited by 3
A Two-Sample Test for Reliability Comparison
Şirvanci, M. (2004) · Quality Engineering · doi:10.1081/qen-120038015 · Cited by 3
Accurate unconditional p-values for a two-arm study with binary endpoints
Shan, G., Kang, L., Xiao, M., Zhang, H., & Jiang, T. (2018) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2018.1425690 · Cited by 3
Coppens, A. D. (2015) · eScholarship (California Digital Library) · Cited by 5
Teknisk-Naturvitenskapelige, N., Langaas, M., & Bakke, Ø. (2013) · Cited by 2
Polanski, A., Stoja, E., & Chiu, C. (2019) · International Journal of Finance & Economics · doi:10.1002/ijfe.2077 · Cited by 2
Kong, S.-H. (2009) · Drug Information Journal · doi:10.1177/009286150904300504 · Cited by 2
Statistical inference in population genetics using microsatellites
Csilléry, K. (2009) · ERA · Cited by 2
Fisher's Exact and Barnard's Tests
Andrés, A. M. (2014) · Wiley eBooks · doi:10.1002/9781118445112.stat01500 · Cited by 2
Fisher's Exact and Barnard's Tests
Andrés, A. M. (2005) · Wiley eBooks · doi:10.1002/0471667196.ess0642.pub2 · Cited by 2
Dormann, C. F. (2020) · Springer eBooks · doi:10.1007/978-3-030-55020-2_5 · Cited by 1
Deftereos, S. (2017) · Spinal Cord Series and Cases · doi:10.1038/scsandc.2017.9 · Cited by 1
Ganju, J. (2010) · Wiley eBooks · doi:10.1002/9780470571224.pse239 · Cited by 1
Exact power computation for stratified dose-response studies
Tang, M. (2001) · Statistics and Computing · doi:10.1023/a:1008971130958 · Cited by 1
Matsuo, A. (1999) · Journal of the Japanese Society of Computational Statistics · doi:10.5183/jjscs1988.12.1 · Cited by 1
Almendra‐Arao, F. (2014) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2014.919929
Probability and scientific research (Probabilidad e investigación cientifica)
Castillo, J., Foroughbakhch, R., & Cortez, K. (2007)
2次元統計量を用いた線形ロジスティックモデルの条件付正確検定
Matsuo, A. (2000) · Ouyou toukeigaku · doi:10.5023/jappstat.29.1
Animal models of Takotsubo syndrome: a multi-level experimental approach
Tranter, M. H. (2016) · Spiral (Imperial College London) · doi:10.25560/39275
Agresti, A. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10473791
(2005) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420036190.bmatt
Neuhauser, M. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b11427-16
Hollander, M., Wolfe, D. A., & Chicken, E. (2015) · Wiley series in probability and statistics · doi:10.1002/9781119196037.biblio
Fisher's Exact and Barnard's Tests
Andrés, A. M. (2004) · Wiley eBooks · doi:10.1002/0471667196.ess0642
Barnett, V. (1999) · Wiley series in probability and statistics · doi:10.1002/9780470316955.refs
da Silva, D. M. (2024) · Lume (Universidade Federal do Rio Grande do Sul)
Pairwise Comparisons of k Binomial Responses
Boos, D. D., & Schmidt, J. (2026) · Statistics in Medicine · doi:10.1002/sim.70479
Metadata
- Authors
- Mehta, C. R., & Hilton, J. F.
- Affiliations
- Harvard University (US)
- University of California, San Francisco (US)
- Venue
- The American Statistician
- Publisher
- JSTOR
- Published
- 1993-05
- Volume
- 47
- Issue
- 2
- Pages
- 91
- ISSN
- 0003-1305 (ISSN-L)
- OpenAlex
- W1991523480
- Cited by
- 87
- References
- 28
- Citations by year
- 2025: 1 · 2022: 1 · 2021: 1 · 2020: 4 · 2019: 3 · 2018: 5 · 2017: 3 · 2016: 1 · 2015: 4 · 2014: 7 · 2013: 4 · 2012: 3
- FWCI
- 4.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The American Statistician (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- exact tests, conditional inference, statistical power, 2x2 contingency tables, type I error
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.