Exact Power of Conditional and Unconditional Tests: Going Beyond the 2 × 2 Contingency Table
The DOI matches its Crossref record; 25 of the 28 references it cites were found in a registry or an index.
Abstract
The controversial question of whether one should condition on both margins of a contingency table for exact inference is examined from a fresh, computational perspective. The conditional test is believed to be less powerful than the unconditional test. However, in all previous work the actual hard evidence for this alleged power loss has always been provided by the single 2 × 2 table. In this setting the discreteness of the test statistic confounds the issue since the loss in power is offset by a corresponding reduction in Type 1 error. Although one could overcome discreteness through an auxiliary randomization experiment, this would not resolve the controversy, because such post hoc randomization is unacceptable to the practicing statistician. We overcome the discreteness more naturally by extending the power computations to 2 × 3 contingency tables. In doing so we find that the power advantage of the unconditional test rapidly vanishes. The article also discusses computational difficulties we would encounter if we attempted to extend the unconditional test beyond the 2 × 2 table.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Nonparametrics: Statistical Methods Based on Ranks.
Beaver, R. J., & Lehmann, E. L. (1976) · Biometrics · doi:10.2307/2529529 · Cited by 2,047
Journal of the Royal Statistical Society.
(1921) · The Economic Journal · doi:10.1093/ej/31.121.133 · Cited by 1,465
Statistical Methods and Scientific Inference.
Bartlett, M. S., & Fisher, R. A. (1957) · Biometrika · doi:10.2307/2333276 · Cited by 1,278
A Network Algorithm for Performing Fisher's Exact Test in r × c Contingency Tables
Mehta, C. R., & Patel, N. R. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477989 · Cited by 898
Self-citationToutenburg, H. (1977) · ZAMM - Journal of Applied Mathematics and Mechanics / Zeitschrift für Angewandte Mathematik und Mechanik · doi:10.1002/zamm.19770570922 · Cited by 787
Statistical Methods and Scientific Inference.
Jowett, G. H., & Fisher, R. A. (1957) · Applied Statistics · doi:10.2307/2985611 · Cited by 703
Upton, G. J. G. (1992) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982890 · Cited by 606
Test of Significance for 2 × 2 Contingency Tables
Yates, F. (1984) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981577 · Cited by 364
Exact Significance Testing to Establish Treatment Equivalence with Ordered Categorical Data
Mehta, C. R., Patel, N. R., & Tsiatis, A. A. (1984) · Biometrics · doi:10.2307/2530927 · Cited by 328
Self-citation
Cited by
A Survey of Exact Inference for Contingency Tables
Agresti, A. (1992) · Statistical Science · doi:10.1214/ss/1177011454 · Cited by 1,097
Differential Growth of the Mouse Preimplantation Embryo in Chemically Defined Media1
Erbach, G. T., Lawitts, J. A., Papaioannou, V. E., & Biggers, J. D. (1994) · Biology of Reproduction · doi:10.1095/biolreprod50.5.1027 · Cited by 369
Dagianti, A., Penco, M., Agati, L., Sciomer, S., Dagianti, A., Rosanio, S., & Fedele, F. (1995) · Journal of the American College of Cardiology · doi:10.1016/0735-1097(95)00121-f · Cited by 181
Exact inference for categorical data: recent advances and continuing controversies
Agresti, A. (2001) · Statistics in Medicine · doi:10.1002/sim.738 · Cited by 162
Mehrotra, D. V., Chan, I. S. F., & Berger, R. L. (2003) · Biometrics · doi:10.1111/1541-0420.00051 · Cited by 149
Metadata
- Authors
- Mehta, C. R., & Hilton, J. F.
- Affiliations
- Harvard University (US)
- University of California, San Francisco (US)
- Venue
- The American Statistician
- Publisher
- JSTOR
- Published
- 1993-05
- Volume
- 47
- Issue
- 2
- Pages
- 91
- ISSN
- 0003-1305 (ISSN-L)
- OpenAlex
- W1991523480
- Cited by
- 87
- References
- 28
- Citations by year
- 2025: 1 · 2022: 1 · 2021: 1 · 2020: 4 · 2019: 3 · 2018: 5 · 2017: 3 · 2016: 1 · 2015: 4 · 2014: 7 · 2013: 4 · 2012: 3
- FWCI
- 4.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The American Statistician (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- exact tests, conditional inference, statistical power, 2x2 contingency tables, type I error
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Exact Power of Conditional and Unconditional Tests: Going Beyond the 2 × 2 Contingency Table. https://app.cochat.ai/papers/10.2307/2685184
- The paper
- Mehta, C. R., & Hilton, J. F. (1993). Exact Power of Conditional and Unconditional Tests: Going Beyond the 2 × 2 Contingency Table. The American Statistician. https://doi.org/10.2307/2685184
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.