A High Dimensional Two Sample Significance Test
Open accessThe DOI matches its Crossref record.
Abstract
The classical multivariate 2 sample significance test based on Hotelling's $T^2$ is undefined when the number $k$ of variables exceeds the number of within sample degrees of freedom available for estimation of variances and covariances. Addition of an a priori Euclidean metric to the affine $k$-space assumed by the classical method leads to an alternative approach to the same problem. A test statistic $F$ which is the ratio of 2 mean square distances is proposed and 3 methods of attaching a significance level to $F$ are described. The third method is considered in detail and leads to a "non-exact" significance test where the null hypothesis distribution of $F$ depends, in approximation, on a single unknown parameter $r$ for which an estimate must be substituted. Approximate distribution theory leads to 2 independent estimates of $r$ based on nearly sufficient statistics and these may be combined to yield a single estimate. A test of $F$ nominally at the 5% level but based on an estimate of $r$ rather than $r$ itself has a true significance level which is a function of $r$. This function is investigated and shown to be quite near 5%. The sensitivity of the test to a parameter measuring statistical distance between population means is discussed and it is shown that arbitrarily small differences in each individual variable can result in a detectable overall difference provided the number of variables (or, more precisely, $r$) can be made sufficiently large. This sensitivity discussion has stated implications for the a priori choice of metric in $k$-space. Finally a geometrical description of the case of large $r$ is presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Tukey, J. W. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704711 · Cited by 1,860
On Some Invariant Criteria for Grouping Data
Friedman, H. P., & Rubin, J. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10500923 · Cited by 613
Ledoit, O., & Wolf, M. (2002) · The Annals of Statistics · doi:10.1214/aos/1031689018 · Cited by 399
Improving gene set analysis of microarray data by SAM-GS
Dinu, I., Potter, J. D., Mueller, T., Liu, Q., Adewale, A. J., Jhangri, G. S., Einecke, G., Famulski, K. S., Halloran, P., & Yasui, Y. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-242 · Cited by 262
Similarity-based multimodal regression
Chen, A. A., Weinstein, S. M., Adebimpe, A., Gur, R. C., Gur, R. E., Merikangas, K. R., Satterthwaite, T. D., Shinohara, R. T., & Shou, H. (2024) · Biostatistics · doi:10.1093/biostatistics/kxad033 · Cited by 6
Metadata
- Authors
- Dempster, A. P.
- Venue
- The Annals of Mathematical Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 1958-12
- Volume
- 29
- Issue
- 4
- Pages
- 995-1010
- ISSN
- 0003-4851 (ISSN-L)
- OpenAlex
- W1965019479
- Cited by
- 177
- References
- 0
- FWCI
- 2.20
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A High Dimensional Two Sample Significance Test. https://app.cochat.ai/papers/10.1214/aoms/1177706437
- The paper
- Dempster, A. P. (1958). A High Dimensional Two Sample Significance Test. The Annals of Mathematical Statistics. https://doi.org/10.1214/aoms/1177706437
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.