The DOI matches its Crossref record; 25 of the 28 references it cites were found in a registry or an index.
Exact Power of Conditional and Unconditional Tests: Going Beyond the 2 × 2 Contingency Table
Abstract
The controversial question of whether one should condition on both margins of a contingency table for exact inference is examined from a fresh, computational perspective. The conditional test is believed to be less powerful than the unconditional test. However, in all previous work the actual hard evidence for this alleged power loss has always been provided by the single 2 × 2 table. In this setting the discreteness of the test statistic confounds the issue since the loss in power is offset by a corresponding reduction in Type 1 error. Although one could overcome discreteness through an auxiliary randomization experiment, this would not resolve the controversy, because such post hoc randomization is unacceptable to the practicing statistician. We overcome the discreteness more naturally by extending the power computations to 2 × 3 contingency tables. In doing so we find that the power advantage of the unconditional test rapidly vanishes. The article also discusses computational difficulties we would encounter if we attempted to extend the unconditional test beyond the 2 × 2 table.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Nonparametrics: Statistical Methods Based on Ranks
Mergenthaler, M. J., & Lehmann, E. L. (1979) · Technometrics · doi:10.1080/00401706.1979.10489764 · Cited by 3,393
Nonparametrics: Statistical Methods Based on Ranks.
Beaver, R. J., & Lehmann, E. L. (1976) · Biometrics · doi:10.2307/2529529 · Cited by 2,047
Journal of the Royal Statistical Society.
(1921) · The Economic Journal · doi:10.1093/ej/31.121.133 · Cited by 1,465
Statistical Methods and Scientific Inference.
Bartlett, M. S., & Fisher, R. A. (1957) · Biometrika · doi:10.2307/2333276 · Cited by 1,278
A Network Algorithm for Performing Fisher's Exact Test in r × c Contingency Tables
Mehta, C. R., & Patel, N. R. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477989 · Cited by 898
Self-citationToutenburg, H. (1977) · ZAMM - Journal of Applied Mathematics and Mechanics / Zeitschrift für Angewandte Mathematik und Mechanik · doi:10.1002/zamm.19770570922 · Cited by 787
Statistical Methods and Scientific Inference.
Jowett, G. H., & Fisher, R. A. (1957) · Applied Statistics · doi:10.2307/2985611 · Cited by 703
Upton, G. J. G. (1992) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982890 · Cited by 606
Test of Significance for 2 × 2 Contingency Tables
Yates, F. (1984) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981577 · Cited by 364
Exact Significance Testing to Establish Treatment Equivalence with Ordered Categorical Data
Mehta, C. R., Patel, N. R., & Tsiatis, A. A. (1984) · Biometrics · doi:10.2307/2530927 · Cited by 328
Self-citationBARNARD, G. A. (1945) · Nature · doi:10.1038/156177a0 · Cited by 284
Significance Tests in Discrete Distributions
Lancaster, H. O. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482105 · Cited by 272
Barnard, G. A. (1949) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1949.tb00028.x · Cited by 238
Exact Unconditional Sample Sizes for the 2 × 2 Binomial Trial
Suissa, S., & Shuster, J. J. (1985) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981892 · Cited by 234
D'agostino, R. B., Chase, W., & Belanger, A. (1988) · The American Statistician · doi:10.1080/00031305.1988.10475563 · Cited by 202
EXTENSION OF THE NEYMAN-PEARSON THEORY OF TESTS TO DISCONTINUOUS VARIATES
Tocher, K. D. (1950) · Biometrika · doi:10.1093/biomet/37.1-2.130 · Cited by 194
A Comparison of Alternative Tests for the 2 × 2 Comparative Trial
Upton, G. J. G. (1982) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981423 · Cited by 187
Testing the Equality of Two Independent Binomial Proportions
Little, R. (1989) · The American Statistician · doi:10.1080/00031305.1989.10475676 · Cited by 144
In dispraise of the exact test
Berkson, J. (1978) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(78)90019-8 · Cited by 122
On alleged gains in power from lowerP‐values
Barnard, G. A. (1989) · Statistics in Medicine · doi:10.1002/sim.4780081206 · Cited by 91
Constructing Exact Significance Tests with Restricted Randomization Rules
Mehta, C. R., Patel, N. R., & Wei, L. (1988) · Biometrika · doi:10.1093/biomet/75.2.295 · Cited by 64
Self-citationBarnard, G. A. (1945) · Nature · doi:10.1038/156783b0 · Cited by 51
In dispraise of the exact test: reactions
Kempthorne, O. (1979) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(79)90012-0 · Cited by 46
StatXact: A Statistical Package for Exact Nonparametric Inference
Mehta, C. R. (1991) · The American Statistician · doi:10.2307/2685246 · Cited by 39
Self-citation
Cited by
A Survey of Exact Inference for Contingency Tables
Agresti, A. (1992) · Statistical Science · doi:10.1214/ss/1177011454 · Cited by 1,097
Differential Growth of the Mouse Preimplantation Embryo in Chemically Defined Media1
Erbach, G. T., Lawitts, J. A., Papaioannou, V. E., & Biggers, J. D. (1994) · Biology of Reproduction · doi:10.1095/biolreprod50.5.1027 · Cited by 369
Dagianti, A., Penco, M., Agati, L., Sciomer, S., Dagianti, A., Rosanio, S., & Fedele, F. (1995) · Journal of the American College of Cardiology · doi:10.1016/0735-1097(95)00121-f · Cited by 181
Exact inference for categorical data: recent advances and continuing controversies
Agresti, A. (2001) · Statistics in Medicine · doi:10.1002/sim.738 · Cited by 162
Mehrotra, D., Chan, I., & Berger, R. L. (2003) · Biometrics · doi:10.1111/1541-0420.00051 · Cited by 133
Metadata
- Authors
- Mehta, C. R., & Hilton, J. F.
- Affiliations
- Harvard University (US)
- University of California, San Francisco (US)
- Venue
- The American Statistician
- Publisher
- JSTOR
- Published
- 1993-05
- Volume
- 47
- Issue
- 2
- Pages
- 91
- ISSN
- 0003-1305 (ISSN-L)
- OpenAlex
- W1991523480
- Cited by
- 87
- References
- 28
- Citations by year
- 2025: 1 · 2022: 1 · 2021: 1 · 2020: 4 · 2019: 3 · 2018: 5 · 2017: 3 · 2016: 1 · 2015: 4 · 2014: 7 · 2013: 4 · 2012: 3
- FWCI
- 4.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The American Statistician (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- exact tests, conditional inference, statistical power, 2x2 contingency tables, type I error
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.