The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Sample Eigenvalue Based Detection of High-Dimensional Signals in White Noise Using Relatively Few Samples
Abstract
The detection and estimation of signals in noisy, limited data is a problem of interest to many scientific and engineering communities. We present a mathematically justifiable, computationally simple, sample-eigenvalue-based procedure for estimating the number of high-dimensional signals in white noise using relatively few samples. The main motivation for considering a sample-eigenvalue-based scheme is the computational simplicity and the robustness to eigenvector modelling errors which can adversely impact the performance of estimators that exploit information in the sample eigenvectors. There is, however, a price we pay by discarding the information in the sample eigenvectors; we highlight a fundamental asymptotic limit of sample-eigenvalue-based detection of weak or closely spaced high-dimensional signals from a limited sample size. This motivates our heuristic definition of the effective number of identifiable signals which is equal to the number of ldquosignalrdquo eigenvalues of the population covariance matrix which exceed the noise variance by a factor strictly greater than . The fundamental asymptotic limit brings into sharp focus why, when there are too few samples available so that the effective number of signals is less than the actual number of signals, underestimation of the model order is unavoidable (in an asymptotic sense) when using any sample-eigenvalue-based detection scheme, including the one proposed herein. The analysis reveals why adding more sensors can only exacerbate the situation. Numerical simulations are used to demonstrate that the proposed estimator, like Wax and Kailath's MDL-based estimator, consistently estimates the true number of signals in the dimension fixed, large sample size limit and the effective number of identifiable signals, unlike Wax and Kailath's MDL-based estimator, in the large dimension, (relatively) large sample size limit.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
Modeling by shortest data description
Rissanen, J. (1978) · Automatica · doi:10.1016/0005-1098(78)90005-5 · Cited by 6,011
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Optimum Array Processing: Part IV of Detection, Estimation, and Modulation Theory
Van Trees, H. L. (2002) · Wiley eBooks · doi:10.1002/0471221104 · Cited by 5,188
Determining the Number of Factors in Approximate Factor Models
Bai, J., & Ng, S. (2002) · Econometrica · doi:10.1111/1468-0262.00273 · Cited by 4,099
Detection of signals by information theoretic criteria
Wax, M., & Kailath, T. (1985) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1985.1164557 · Cited by 3,426
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_38 · Cited by 3,028 · cited 5×
“[18] H. Akaike, “Information theory and an extension of the maximum likelihood principle,” inSecond International Symposium on Inform.”
BackgroundInfluentialA Note on the Multiplying Factors for Various χ2 Approximations
Bartlett, M. S. (1954) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1954.tb00174.x · Cited by 2,875
A sparse signal reconstruction perspective for source localization with sensor arrays
Malioutov, D., Cetin, M., & Willsky, A. S. (2005) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2005.850882 · Cited by 2,638 · cited 2×
“This helps identify scenarios where algorithms that exploit any structure in the eigenvectors of the signals, such as the MUSIC and the Capon-MVDR algorithms in sensor array processing [4], particle filter-based techniques [36] or sparsity (in a known basis) exploiting techniques [37]–[39], might be better able to tea…”
BackgroundOn the distribution of the largest eigenvalue in principal components analysis
Johnstone, I. M. (2001) · The Annals of Statistics · doi:10.1214/aos/1009210544 · Cited by 1,949
Uncertainty principles and ideal atomic decomposition
Donoho, D. L., & Huo, X. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.959265 · Cited by 1,949
Level-spacing distributions and the Airy kernel
Tracy, C. A., & Widom, H. (1994) · Communications in Mathematical Physics · doi:10.1007/bf02100489 · Cited by 1,828
THE GENERALISED PRODUCT MOMENT DISTRIBUTION IN SAMPLES FROM A NORMAL MULTIVARIATE POPULATION
WISHART, J. (1928) · Biometrika · doi:10.1093/biomet/20a.1-2.32 · Cited by 1,207
Asymptotic Theory for Principal Component Analysis
Anderson, T. W. (1963) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704248 · Cited by 1,150
Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices
Baik, J., Ben Arous, G., & Péché, S. (2005) · The Annals of Probability · doi:10.1214/009117905000000233 · Cited by 967
Estimation of Number of Spectrally Distinct Signal Sources in Hyperspectral Imagery
Chang, C.-I., & Du, Q. (2004) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2003.819189 · Cited by 936
On orthogonal and symplectic matrix ensembles
Tracy, C. A., & Widom, H. (1996) · Communications in Mathematical Physics · doi:10.1007/bf02099545 · Cited by 786
On Orthogonal and Symplectic Matrix Ensembles
Tracy, C. A., & Widom, H. (1995) · Cited by 728
Eigenvalues of large sample covariance matrices of spiked population models
Baik, J., & Silverstein, J. W. (2006) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2005.08.003 · Cited by 701
ASYMPTOTICS OF SAMPLE EIGENSTRUCTURE FOR A LARGE DIMENSIONAL SPIKED COVARIANCE MODEL
Paul, D. (2007) · Cited by 577
On fluctuations of eigenvalues of random Hermitian matrices
Johansson, K. (1998) · Duke Mathematical Journal · doi:10.1215/s0012-7094-98-09108-6 · Cited by 576
Strong Convergence of the Empirical Distribution of Eigenvalues of Large Dimensional Random Matrices
Silverstein, J. W. (1995) · Journal of Multivariate Analysis · doi:10.1006/jmva.1995.1083 · Cited by 560
Edelman, A., & Rao, N. R. (2005) · Acta Numerica · doi:10.1017/s0962492904000236 · Cited by 526
Self-citationTESTS OF SIGNIFICANCE FOR THE LATENT ROOTS OF COVARIANCE AND CORRELATION MATRICES
LAWLEY, D. N. (1956) · Biometrika · doi:10.1093/biomet/43.1-2.128 · Cited by 375
Some limit theorems for the eigenvalues of a sample covariance matrix
Jonsson, D. (1982) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(82)90080-x · Cited by 371
On the limit of the largest eigenvalue of the large dimensional sample covariance matrix
Yin, Y. Q., Bai, Z. D., & Krishnaiah, P. R. (1988) · Probability Theory and Related Fields · doi:10.1007/bf00353874 · Cited by 341
On detection of the number of signals in presence of white noise
Zhao, L. C., Krishnaiah, P. R., & Bai, Z. D. (1986) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(86)90017-5 · Cited by 337
Quaternion-MUSIC for vector-sensor array processing
Miron, S., Le Bihan, N., & Mars, J. I. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.870630 · Cited by 329
The Strong Limits of Random Matrix Spectra for Sample Matrices of Independent Elements
Wachter, K. W. (1978) · The Annals of Probability · doi:10.1214/aop/1176995607 · Cited by 288
Analysis of the Limiting Spectral Distribution of Large Dimensional Random Matrices
Silverstein, J. W., & Choi, S. I. (1995) · Journal of Multivariate Analysis · doi:10.1006/jmva.1995.1058 · Cited by 285
High dimensional statistical inference and random matrices
Johnstone, I. M. (2007) · Proceedings of the International Congress of Mathematicians Madrid, August 22–30, 2006 · doi:10.4171/022-1/13 · Cited by 229
Tracy–Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices
El Karoui, N. (2007) · The Annals of Probability · doi:10.1214/009117906000000917 · Cited by 168
High Dimensional Statistical Inference and Random MatricesPreprint
Johnstone, I. M. (2006) · arXiv (Cornell University) · doi:10.48550/arxiv.math/0611589 · Cited by 154
On detection of the number of signals when the noise covariance matrix is arbitrary
Zhao, L. C., Krishnaiah, P. R., & Bai, Z. (1986) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(86)90018-7 · Cited by 114
Estimation of the number of sources in unbalanced arrays via information theoretic criteria
Fishler, E., & Poor, H. V. (2005) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2005.853099 · Cited by 101
Particle filters for tracking an unknown number of sources
Larocque, J.-R., Reilly, J. P., & Ng, W. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2002.805251 · Cited by 82
Andersen, E. B. (1991) · Springer eBooks · doi:10.1007/978-3-642-97353-6_3 · Cited by 78
Applied stochastic eigen-analysis
Nadakuditi, R. R. (2007) · Open Access Server of the Woods Hole Scientific Community (Woods Hole Scientific Community) · doi:10.1575/1912/1647 · Cited by 24
Self-citationA resampling method for estimating the signal subspace of spatio-temporal eeg/meg data
Maris, E. (2003) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2003.814293 · Cited by 22
Cited by
Non-Parametric Detection of the Number of Signals: Hypothesis Testing and Random Matrix Theory
Kritchman, S., & Nadler, B. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2022897 · Cited by 306
Metadata
- Authors
- Nadakuditi, R. R., & Edelman, A.
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2008-07
- Volume
- 56
- Issue
- 7
- Pages
- 2625-2638
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W2155421090
- Cited by
- 287
- References
- 41
- FWCI
- 20.20
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.