Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 236

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

Exact and asymptotically robust permutation tests

Open access
Chung, EunYi, Romano, Joseph P. · 2013 · The Annals of Statistics

Abstract

Given independent samples from $P$ and $Q$, two-sample permutation tests allow one to construct exact level tests when the null hypothesis is $P=Q$. On the other hand, when comparing or testing particular parameters $\theta$ of $P$ and $Q$, such as their means or medians, permutation tests need not be level $\alpha$, or even approximately level $\alpha$ in large samples. Under very weak assumptions for comparing estimators, we provide a general test procedure whereby the asymptotic validity of the permutation test holds while retaining the exact rejection probability $\alpha$ in finite samples when the underlying distributions are identical. The ideas are broadly applicable and special attention is given to the $k$-sample problem of comparing general parameters, whereby a permutation test is constructed which is exact level $\alpha$ under the hypothesis of identical distributions, but has asymptotic rejection probability $\alpha$ under the more general null hypothesis of equality of parameters. A Monte Carlo simulation study is performed as well. A quite general theory is possible based on a coupling construction, as well as a key contiguity argument for the multinomial and multivariate hypergeometric distributions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1214/13-aos1090

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 2 references

Research works printed but not linked: 19

  1. [2] Chung, E. and Romano, P. J. (2013). Supplement to “Exact and asymptotically robust permutation tests.” DOI:10.1214/13-AOS1090SUPP. · doi:10.1214/13-aos1090supp
  2. [3] Delaigle, A., Hall, P. and Jin, J. (2011). Robustness and accuracy of methods for high dimensional data analysis based on Student’s $t$-statistic. J. R. Stat. Soc. Ser. B Stat. Methodol. 73 283–301. · DOI
  3. [6] Hall, P., DiCiccio, T. J. and Romano, J. P. (1989). On smoothing and the bootstrap. Ann. Statist. 17 692–704. · doi:10.1214/aos/1176347135
  4. [8] Hoeffding, W. (1952). The large-sample power of tests based on permutations of observations. Ann. Math. Statist. 23 169–192. · DOI · Paper page
  5. [10] Janssen, A. (1999). Testing nonparametric statistical functionals with applications to rank tests. J. Statist. Plann. Inference 81 71–93. · doi:10.1016/s0378-3758(99)00009-9
  6. [11] Janssen, A. (2005). Resampling Student’s $t$-type statistics. Ann. Inst. Statist. Math. 57 507–529. · DOI
  7. [12] Janssen, A. and Pauls, T. (2003). How do bootstrap and permutation tests work? Ann. Statist. 31 768–806. · DOI
  8. [13] Janssen, A. and Pauls, T. (2005). A Monte Carlo comparison of studentized bootstrap and permutation tests for heteroscedastic two-sample problems. Comput. Statist. 20 369–383. · doi:10.1007/bf02741303
  9. [15] Krishnamoorthy, K., Lu, F. and Mathew, T. (2007). A parametric bootstrap approach for ANOVA with unequal variances: Fixed and random models. Comput. Statist. Data Anal. 51 5731–5742. · DOI · Paper page
  10. [17] Neubert, K. and Brunner, E. (2007). A studentized permutation test for the non-parametric Behrens–Fisher problem. Comput. Statist. Data Anal. 51 5192–5204. · DOI · Paper page
  11. [18] Neuhaus, G. (1993). Conditional rank tests for the two-sample problem under random censorship. Ann. Statist. 21 1760–1779. · DOI
  12. [19] Omelka, M. and Pauly, M. (2012). Testing equality of correlation coefficients in a potentially unbalanced two-sample problem via permutation methods. J. Statist. Plann. Inference 142 1396–1406. · DOI
  13. [20] Pauly, M. (2011). Discussion about the quality of F-ratio resampling tests for comparing variances. TEST 20 163–179. · DOI
  14. [21] Rice, W. R. and Gaines, S. D. (1989). One-way analysis of variance with unequal variances. Proc. Natl. Acad. Sci. USA 86 8183–8184. · doi:10.1073/pnas.86.21.8183
  15. [22] Romano, J. P. (1989). Bootstrap and randomization tests of some nonparametric hypotheses. Ann. Statist. 17 141–159. · DOI · Paper page
  16. [23] Romano, J. P. (1990). On the behavior of randomization tests without a group invariance assumption. J. Amer. Statist. Assoc. 85 686–692. · DOI · Paper page
  17. [4] Devroye, L. P. and Wagner, T. J. (1980). The strong uniform consistency of kernel density estimates. In Multivariate Analysis, V (Proc. Fifth Internat. Sympos., Univ. Pittsburgh, Pittsburgh, Pa., 1978) 59–77. North-Holland, Amsterdam.
  18. [16] Lehmann, E. L. and Romano, J. P. (2005). Testing Statistical Hypotheses, 3rd ed. Springer, New York.
  19. [24] Serfling, R. J. (1980). Approximation Theorems of Mathematical Statistics. Wiley, New York. · DOI · Paper page

Cited by

See all 236

Metadata

Authors
Chung, E., & Romano, J. P.
Venue
The Annals of Statistics
Published
2013-04-01
Volume
41
Issue
2
Pages
484-507
ISSN
0090-5364 (ISSN-L)
OpenAlex
W2059679882
Cited by
236
References
2
FWCI
8.03
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Exact and asymptotically robust permutation tests. https://app.cochat.ai/papers/10.1214/13-aos1090
The paper
Chung, E., & Romano, J. P. (2013). Exact and asymptotically robust permutation tests. The Annals of Statistics. https://doi.org/10.1214/13-aos1090

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.