A Warning on the Use of Chi-Squared Statistics with Frequency Tables with Small Expected Cell Counts
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
When applied to frequency tables with small expected cell counts, Pearson chi-squared test statistics may be asymptotically inconsistent even in cases in which a satisfactory chi-squared approximation exists for the distribution under the null hypothesis. This problem is particularly important in cases in which the number of cells is large and the expected cell counts are quite variable. To illustrate this bias of the chi-squared test, this article considers the Pearson chi-squared test of the hypothesis that the cell probabilities for a multinomial frequency table have specified values. In this case, the expected value and variance of the Pearson chi-square may be evaluated under both the null and alternative hypotheses. When the number of cells is large, normal approximations and discrete Edgeworth expansions may also be used to assess the size and power of the Pearson chi-squared test. These analyses show that unless all cell probabilities are equal, it is possible to select a significance level and cell probabilities under the alternative hypothesis such that the power is less than the size of the test. As shown by exact calculations, the difference may be substantial even in cases in which all expected cell sizes are at least 5 under the null hypothesis. The use of moments shows that given any minimum expected cell size under the null hypothesis and given any significance level, it is possible to make the power arbitrarily close to 0 by the selection of a large enough number of cells in the table and suitable cell probabilities for the null and alternative hypotheses. The normal approximations for the distribution of the Pearson chi-squared statistic permit the size of this bias to be assessed in less-extreme cases involving tables with many cells. These results imply that caution must be exercised in the application of Pearson chi-squared statistics to sparse contingency tables with many cells. An alternative to the Pearson chi-square, proposed by Zelterman (1986), avoids some of the problems. Exact calculation, however, shows that the alternative statistic does not eliminate all problems of bias. The problems described in this article clearly extend to more general applications of the Pearson chi-squared statistic.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Anderson, T. W., & Darling, D. A. (1954) · Journal of the American Statistical Association · doi:10.1080/01621459.1954.10501232 · Cited by 2,450
Cited by
A Survey of Exact Inference for Contingency Tables
Agresti, A. (1992) · Statistical Science · doi:10.1214/ss/1177011454 · Cited by 1,097
The statistics of word cooccurrences : word pairs and collocations
Evert, S. (2005) · OPUS Publication Server of the University of Stuttgart (University of Stuttgart) · doi:10.18419/opus-2556 · Cited by 636
Lyketsos, C. G., Sheppard, J. E., Steinberg, M., Tschanz, J. A. T., Norton, M. C., Steffens, D. C., & Breitner, J. C. S. (2001) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.448 · Cited by 275
Latent class analysis in medical research
Formann, A. K., & Kohlmann, T. (1996) · Statistical Methods in Medical Research · doi:10.1177/096228029600500205 · Cited by 166
Exact inference for categorical data: recent advances and continuing controversies
Agresti, A. (2001) · Statistics in Medicine · doi:10.1002/sim.738 · Cited by 162
“Di5culties can occur when the table contains a mixture of relatively large counts and relatively small ones or when an asymptotic framework applies in which the number of cells (and hence the number of parameters) grows with the sample size [6].”
Background
Metadata
- Authors
- Haberman, S. J.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 1988-06
- Volume
- 83
- Issue
- 402
- Pages
- 555-560
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2092545905
- Cited by
- 106
- References
- 1
- FWCI
- 4.38
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Warning on the Use of Chi-Squared Statistics with Frequency Tables with Small Expected Cell Counts. https://app.cochat.ai/papers/10.1080/01621459.1988.10478632
- The paper
- Haberman, S. J. (1988). A Warning on the Use of Chi-Squared Statistics with Frequency Tables with Small Expected Cell Counts. Journal of the American Statistical Association. https://doi.org/10.1080/01621459.1988.10478632
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.