Small-sample study of the use of mid-p power divergence goodness-of-fit tests
Abstract
Asymptotic goodness-of-fit tests based on large sample theory have been shown to be unreliable in small sample designs and sparse data structures. In these situations, it is widely believed that exact version tests are dependable. However, exact goodness-of-fit tests that are based on discrete probabilities are conservative and the calculation of the exact distribution may be computationally intractable. In this article, we present a method, which is based on recursive polynomial multiplication, for performing exact analysis of goodness-of-fit tests. This method has been shown to be more efficient and accurate than an existing fast Fourier transform method. To overcome the conservativeness problem, we suggest the use of mid–P version goodness–of–fit tests. The small sample properties of the asymptotic, the exact, and the mid–P version goodness–of–fit tests are examined via the recursive polynomial multiplication method. Four commonly used power divergence statistics and six null hypotheses ranging from the equiprobable to the extremely skew are considered. The actual significance level behaviors under various null hypotheses suggest that as an anti–conservative test, the mid–P version tests behave fairly well. Nevertheless, it is not the case for the asymptotic and the exact tests. Among the four statistics considered, the exact power comparisons under a specific alternative to various null hypotheses show that the power divergence statistic with λ= 2/3 and the Pearson’s chi–squared statistic (λ = 1) are generally the most preferable.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Similar results were reported for multinomial goodness-of-fit tests.
“Similar results were reported by Tang [19] for multinomial goodness-of-fit tests.”
From Choice of test for association in small sample unordered <i>r</i> × <i>c</i> tables (2007) · cites this paper as [19]
Cites
Journal of The American Statistical Association
Fienberg, S. E. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,289 · see citing works
Multinomial Goodness-Of-Fit Tests
Cressie, N., & Read, T. R. C. (1984) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1984.tb01318.x · Cited by 1,361 · see citing works
Goodness-of-Fit Statistics for Discrete Multivariate Data
Read, T. R. C., & Cressie, N. (1988) · Springer series in statistics · doi:10.1007/978-1-4612-4578-0 · Cited by 778 · see citing works
Goodness-of-fit statistics for discrete multivariate data
Read, T. R. C., & Cressie, N. (1989) · Choice Reviews Online · doi:10.5860/choice.26-2740 · Cited by 745 · see citing works
Significance Tests in Discrete Distributions
Lancaster, H. O. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482105 · Cited by 257 · see citing works
Small-Sample Comparisons of Exact Levels for Chi-Squared Goodness-of-Fit Statistics
Larntz, K. (1978) · Journal of the American Statistical Association · doi:10.2307/2286650 · Cited by 238 · see citing works
Mid-P Confidence Intervals: A Brief Review
Berry, G., & Armitage, P. (1995) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348891 · Cited by 145 · see citing works
A Warning on the Use of Chi-Squared Statistics with Frequency Tables with Small Expected Cell Counts
Haberman, S. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478632 · Cited by 106 · see citing works
On alleged gains in power from lowerP‐values
Barnard, G. A. (1989) · Statistics in Medicine · doi:10.1002/sim.4780081206 · Cited by 93 · see citing works
Goodness-of-Fit Tests for Large Sparse Multinomial Distributions
Zelterman, D. A. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478475 · Cited by 79 · see citing works
A comparison of the chi2and likelihood ratio tests for composite alternatives1
West, E. N., & Kempthorne, O. (1972) · Journal of Statistical Computation and Simulation · doi:10.1080/00949657208810001 · Cited by 77 · see citing works
Small-Sample Comparisons for the Power Divergence Goodness-of-Fit Statistics
Read, T. R. C. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477113 · Cited by 67 · see citing works
Good, I. J., Gover, T. N., & Mitchell, G. J. (1970) · Journal of the American Statistical Association · doi:10.1080/01621459.1970.10481078 · Cited by 59 · see citing works
Significance Tests in Discrete Distributions
Lancaster, H. O. (1961) · Journal of the American Statistical Association · doi:10.2307/2282247 · Cited by 59 · see citing works
Statistical control of counting experiments
Lancaster, H. O. (1952) · Biometrika · doi:10.1093/biomet/39.3-4.419 · Cited by 55 · see citing works
Methods for Exact Goodness-of-Fit Tests
Baglivo, J. A., Olivier, D., & Pagano, M. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10475227 · Cited by 46 · see citing works
Lawal, H. B. (1984) · Biometrika · doi:10.1093/biomet/71.2.415 · Cited by 28 · see citing works
Small-Sample Comparisons for the Power Divergence Goodness-of-Fit Statistics
Read, T. R. C. (1984) · Journal of the American Statistical Association · doi:10.2307/2288726 · Cited by 27 · see citing works
Good, I. J., Gover, T. N., & Mitchell, G. J. (1970) · Journal of the American Statistical Association · doi:10.2307/2283591 · Cited by 25 · see citing works
Goodness-of-Fit Tests for Large Sparse Multinomial Distributions
Zelterman, D. A. (1987) · Journal of the American Statistical Association · doi:10.2307/2289474 · Cited by 22 · see citing works
A Warning on the Use of Chi-Squared Statistics With Frequency Tables With Small Expected Cell Counts
Haberman, S. J. (1988) · Journal of the American Statistical Association · doi:10.2307/2288877 · Cited by 19 · see citing works
Good, I. J. (1981) · Journal of Statistical Computation and Simulation · doi:10.1080/00949658108810526 · Cited by 18 · see citing works
Methods for Exact Goodness-of-Fit Tests
Baglivo, J. A., Olivier, D., & Pagano, M. (1992) · Journal of the American Statistical Association · doi:10.2307/2290278 · Cited by 18 · see citing works
A comparison of algorithms for exact analysis of unordered 2 × K contingency tables
Hirji, K. F., & Johnson, T. D. (1996) · Computational Statistics & Data Analysis · doi:10.1016/0167-9473(94)00021-2 · Cited by 16 · see citing works
Good, I. J. (1982) · Journal of Statistical Computation and Simulation · doi:10.1080/00949658208810599 · Cited by 13 · see citing works
Good, I. J. (1983) · Journal of Statistical Computation and Simulation · doi:10.1080/00949658308810661 · Cited by 11 · see citing works
Analysis of discrete data: Rerandomization methods and complexity
Baglivo, J. A., Olivier, D., & Pagano, M. (1993) · Computational Statistics & Data Analysis · doi:10.1016/0167-9473(93)90112-7 · Cited by 11 · see citing works
Hirji, K. F. (1997) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(97)00008-x · Cited by 8 · see citing works
Comparing Power Behaviours for Some Goodness‐of‐Fit Test Statistics in Sparse Multinomials
Lawal, H. B. (1989) · Biometrical Journal · doi:10.1002/bimj.4710310306 · Cited by 7 · see citing works
Anton, F. K. (1995) · Journal of Statistical Computation and Simulation · doi:10.1080/00949659508811644 · Cited by 4 · see citing works
Comparisons of Some Chi‐Squared Goodness‐of‐Fit Test Statistics in Sparse One‐Way Multinomials
Lawal, H. B. (1993) · Biometrical Journal · doi:10.1002/bimj.4710350508 · Cited by 2 · see citing works
A modifiedX2test when some cells have small expectations in the multionmial distribution
Lawal, B. H. (1992) · Journal of Statistical Computation and Simulation · doi:10.1080/00949659208811362 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Choice of test for association in small sample unordered <i>r</i> × <i>c</i> tables
Lydersen, S., Pradhan, V., Senchaudhuri, P., & Laake, P. (2007) · Statistics in Medicine · doi:10.1002/sim.2839 · Cited by 48 · see citing works
Optimal testing strategies for large, sparse multinomial models
Maiste, P. J., & Weir, B. S. (2004) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2003.08.002 · Cited by 8 · see citing works
- Authors
- Tang, M.-L.
- Affiliations
- Chinese University of Hong Kong (HK)
- Corresponding author
- Tang, Man-Lai.
- ORCID
- Tang, Man-Lai.
- Venue
- Journal of Statistical Computation and Simulation
- Publisher
- Informa UK Limited
- Published
- 1998-12
- Volume
- 62
- Issue
- 1-2
- Pages
- 137-180
- ISSN
- 0094-9655 (ISSN-L)
- 1563-5163
- OpenAlex
- W2068630299
- Cited by
- 6
- References
- 32
- FWCI
- 0.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Statistical Computation and Simulation (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Distribution Estimation and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- goodness-of-fit tests, power divergence statistics, small sample inference, Pearson chi-squared statistic, data sparsity, power comparison
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review