The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Exact and asymptotically robust permutation tests
Open accessAbstract
Given independent samples from $P$ and $Q$, two-sample permutation tests allow one to construct exact level tests when the null hypothesis is $P=Q$. On the other hand, when comparing or testing particular parameters $\theta$ of $P$ and $Q$, such as their means or medians, permutation tests need not be level $\alpha$, or even approximately level $\alpha$ in large samples. Under very weak assumptions for comparing estimators, we provide a general test procedure whereby the asymptotic validity of the permutation test holds while retaining the exact rejection probability $\alpha$ in finite samples when the underlying distributions are identical. The ideas are broadly applicable and special attention is given to the $k$-sample problem of comparing general parameters, whereby a permutation test is constructed which is exact level $\alpha$ under the hypothesis of identical distributions, but has asymptotic rejection probability $\alpha$ under the more general null hypothesis of equality of parameters. A Monte Carlo simulation study is performed as well. A quite general theory is possible based on a coupling construction, as well as a key contiguity argument for the multinomial and multivariate hypergeometric distributions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Two Guidelines for Bootstrap Hypothesis Testing
Hall, P., & Wilson, S. R. (1991) · Biometrics · doi:10.2307/2532163 · Cited by 471
Research works printed but not linked: 19
- [2] Chung, E. and Romano, P. J. (2013). Supplement to “Exact and asymptotically robust permutation tests.” DOI:10.1214/13-AOS1090SUPP. · doi:10.1214/13-aos1090supp
- [3] Delaigle, A., Hall, P. and Jin, J. (2011). Robustness and accuracy of methods for high dimensional data analysis based on Student’s $t$-statistic. J. R. Stat. Soc. Ser. B Stat. Methodol. 73 283–301. · DOI
- [6] Hall, P., DiCiccio, T. J. and Romano, J. P. (1989). On smoothing and the bootstrap. Ann. Statist. 17 692–704. · doi:10.1214/aos/1176347135
- [8] Hoeffding, W. (1952). The large-sample power of tests based on permutations of observations. Ann. Math. Statist. 23 169–192. · DOI · Paper page
- [10] Janssen, A. (1999). Testing nonparametric statistical functionals with applications to rank tests. J. Statist. Plann. Inference 81 71–93. · doi:10.1016/s0378-3758(99)00009-9
- [11] Janssen, A. (2005). Resampling Student’s $t$-type statistics. Ann. Inst. Statist. Math. 57 507–529. · DOI
- [12] Janssen, A. and Pauls, T. (2003). How do bootstrap and permutation tests work? Ann. Statist. 31 768–806. · DOI
- [13] Janssen, A. and Pauls, T. (2005). A Monte Carlo comparison of studentized bootstrap and permutation tests for heteroscedastic two-sample problems. Comput. Statist. 20 369–383. · doi:10.1007/bf02741303
- [15] Krishnamoorthy, K., Lu, F. and Mathew, T. (2007). A parametric bootstrap approach for ANOVA with unequal variances: Fixed and random models. Comput. Statist. Data Anal. 51 5731–5742. · DOI · Paper page
- [17] Neubert, K. and Brunner, E. (2007). A studentized permutation test for the non-parametric Behrens–Fisher problem. Comput. Statist. Data Anal. 51 5192–5204. · DOI · Paper page
- [18] Neuhaus, G. (1993). Conditional rank tests for the two-sample problem under random censorship. Ann. Statist. 21 1760–1779. · DOI
- [19] Omelka, M. and Pauly, M. (2012). Testing equality of correlation coefficients in a potentially unbalanced two-sample problem via permutation methods. J. Statist. Plann. Inference 142 1396–1406. · DOI
- [20] Pauly, M. (2011). Discussion about the quality of F-ratio resampling tests for comparing variances. TEST 20 163–179. · DOI
- [21] Rice, W. R. and Gaines, S. D. (1989). One-way analysis of variance with unequal variances. Proc. Natl. Acad. Sci. USA 86 8183–8184. · doi:10.1073/pnas.86.21.8183
- [22] Romano, J. P. (1989). Bootstrap and randomization tests of some nonparametric hypotheses. Ann. Statist. 17 141–159. · DOI · Paper page
- [23] Romano, J. P. (1990). On the behavior of randomization tests without a group invariance assumption. J. Amer. Statist. Assoc. 85 686–692. · DOI · Paper page
- [4] Devroye, L. P. and Wagner, T. J. (1980). The strong uniform consistency of kernel density estimates. In Multivariate Analysis, V (Proc. Fifth Internat. Sympos., Univ. Pittsburgh, Pittsburgh, Pa., 1978) 59–77. North-Holland, Amsterdam.
- [16] Lehmann, E. L. and Romano, J. P. (2005). Testing Statistical Hypotheses, 3rd ed. Springer, New York.
- [24] Serfling, R. J. (1980). Approximation Theorems of Mathematical Statistics. Wiley, New York. · DOI · Paper page
Cited by
Robust statistical methods in R using the WRS2 package
Mair, P., & Wilcox, R. (2020) · Behavior Research Methods · doi:10.3758/s13428-019-01246-w · Cited by 1,082
Conformal Prediction: A Gentle Introduction
Angelopoulos, A. N., & Bates, S. (2023) · Foundations and Trends in Machine Learning · doi:10.1561/2200000101 · Cited by 740
Agnostic notes on regression adjustments to experimental data: Reexamining Freedman’s critique
Lin, W. (2013) · The Annals of Applied Statistics · doi:10.1214/12-aoas583 · Cited by 641
Young, A. (2019) · The Quarterly Journal of Economics · doi:10.1093/qje/qjy029 · Cited by 631
Controlling the false discovery rate via knockoffs
Barber, R. F., & Candès, E. J. (2015) · The Annals of Statistics · doi:10.1214/15-aos1337 · Cited by 548
Metadata
- Authors
- Chung, E., & Romano, J. P.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2013-04-01
- Volume
- 41
- Issue
- 2
- Pages
- 484-507
- ISSN
- 0090-5364 (ISSN-L)
- OpenAlex
- W2059679882
- Cited by
- 236
- References
- 2
- FWCI
- 8.03
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Exact and asymptotically robust permutation tests. https://app.cochat.ai/papers/10.1214/13-aos1090
- The paper
- Chung, E., & Romano, J. P. (2013). Exact and asymptotically robust permutation tests. The Annals of Statistics. https://doi.org/10.1214/13-aos1090
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.