The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Statistical challenges of high-dimensional data
Open accessAbstract
Modern applications of statistical theory and methods can involve extremely large datasets, often with huge numbers of measurements on each of a comparatively small number of experimental units. New methodology and accompanying theory have emerged in response: the goal of this Theme Issue is to illustrate a number of these recent developments. This overview article introduces the difficulties that arise with high-dimensional data in the context of the very familiar linear statistical model: we give a taste of what can nevertheless be achieved when the parameter vector of interest is sparse, that is, contains many zero elements. We describe other ways of identifying low-dimensional subspaces of the data space that contain all useful information. The topic of classification is then reviewed along with the problem of identifying, from within a very large set, the variables that help to classify observations. Brief mention is made of the visualization of high-dimensional data and ways to handle computational problems in Bayesian analysis are described. At appropriate points, reference is made to the other papers in the issue.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Nonlinear Dimensionality Reduction by Locally Linear Embedding
Roweis, S. T., & Saul, L. K. (2000) · Science · doi:10.1126/science.290.5500.2323 · Cited by 14,965
Jolliffe, I. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa501 · Cited by 14,310
A Global Geometric Framework for Nonlinear Dimensionality Reduction
Tenenbaum, J. B., Silva, V. D., & Langford, J. C. (2000) · Science · doi:10.1126/science.290.5500.2319 · Cited by 13,585
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
Brown, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Biometrics · doi:10.2307/2532174 · Cited by 8,176
Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
Belkin, M., & Niyogi, P. (2003) · Neural Computation · doi:10.1162/089976603321780317 · Cited by 7,621
Koyak, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Journal of the American Statistical Association · doi:10.2307/2290538 · Cited by 7,596
Decoding by Linear Programming
Candes, E. J., & Tao, T. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.858979 · Cited by 7,121
Huber, P. J. (1981) · Wiley Series in Probability and Statistics · doi:10.1002/0471725250 · Cited by 7,066
Pattern Recognition and Machine Learning
Neal, R. M. (2007) · Technometrics · doi:10.1198/tech.2007.s518 · Cited by 4,571
Sure Independence Screening for Ultrahigh Dimensional Feature Space
Fan, J., & Lv, J. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2008.00674.x · Cited by 2,711
Donoho, D. L. (2006) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20132 · Cited by 2,490
Simultaneous analysis of Lasso and Dantzig selector
Bickel, P. J., Ritov, Y., & Tsybakov, A. B. (2009) · The Annals of Statistics · doi:10.1214/08-aos620 · Cited by 2,396
The Dantzig selector: Statistical estimation when p is much larger than n
Candes, E., & Tao, T. (2007) · The Annals of Statistics · doi:10.1214/009053606000001523 · Cited by 1,747
Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data
Donoho, D. L., & Grimes, C. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1031596100 · Cited by 1,661
(2002) · Wiley Series in Probability and Statistics · doi:10.1002/0471271357.ch12 · Cited by 1,656
BART: Bayesian additive regression trees
Chipman, H. A., George, E. I., & McCulloch, R. E. (2010) · The Annals of Applied Statistics · doi:10.1214/09-aoas285 · Cited by 1,542
Generalized additive models for medical research
Hastie, T., & Tibshirani, R. (1995) · Statistical Methods in Medical Research · doi:10.1177/096228029500400302 · Cited by 1,266
Covariance regularization by thresholding
Bickel, P. J., & Levina, E. (2007) · Cited by 1,118
Covariance regularization by thresholding
Bickel, P. J., & Levina, E. (2008) · The Annals of Statistics · doi:10.1214/08-aos600 · Cited by 893
On Consistency and Sparsity for Principal Components Analysis in High Dimensions
Johnstone, I. M., & Lu, A. Y. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0121 · Cited by 847
Self-citationRidge Regression: Biased Estimation for Nonorthogonal Problems
Hoerl, A. E., & Kennard, R. W. (2000) · Technometrics · doi:10.1080/00401706.2000.10485983 · Cited by 808
BagBoosting for tumor classification with gene expression data
Dettling, M. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth447 · Cited by 542
Donoho, D., & Tanner, J. (2009) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2009.0152 · Cited by 436
Natural and political observations made upon the bills of mortality
Graunt, J., & Willcox, W. F. (1939) · Medical Entomology and Zoology · Cited by 402
Operator norm consistent estimation of large-dimensional sparse covariance matricesPreprint
Karoui, N. E. (2012) · Cited by 342
FINITE SAMPLE APPROXIMATION RESULTS FOR PRINCIPAL COMPONENT ANALYSIS: A MATRIX PERTURBATION APPROACH
Nadler, B. (2008) · Cited by 295
Fisher Lecture: Dimension Reduction in Regression
Cook, R. D. (2007) · Statistical Science · doi:10.1214/088342306000000682 · Cited by 283
Operator norm consistent estimation of large-dimensional sparse covariance matrices
El Karoui, N. (2008) · The Annals of Statistics · doi:10.1214/07-aos559 · Cited by 244
Finite sample approximation results for principal component analysis: A matrix perturbation approach
Nadler, B. (2008) · The Annals of Statistics · doi:10.1214/08-aos618 · Cited by 210
High dimensional statistical inference and random matrices
Johnstone, I. M. (2007) · Proceedings of the International Congress of Mathematicians Madrid, August 22–30, 2006 · doi:10.4171/022-1/13 · Cited by 209
Self-citationHigher criticism thresholding: Optimal feature selection when useful features are rare and weak
Donoho, D., & Jin, J. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0807471105 · Cited by 200
Properties of Diagnostic Data Distributions
Dawid, A. P. (1976) · Biometrics · doi:10.2307/2529753 · Cited by 180
Selective inference in complex research
Benjamini, Y., Heller, R., & Yekutieli, D. (2009) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2009.0127 · Cited by 168
Statistical inference for exploratory data analysis and model diagnostics
Buja, A., Cook, D., Hofmann, H., Lawrence, M., Lee, E.-K., Swayne, D. F., & Wickham, H. (2009) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2009.0120 · Cited by 163
Bayesian Methods for Neural Networks and Related Models
Titterington, D. M. (2004) · Statistical Science · doi:10.1214/088342304000000099 · Cited by 162 · cited 1×
“Its recent application to many implementations of the Bayesian approach has mainly developed in machine learning, see Bishop (2006) and references therein, rather than in the mainstream statistics literature, although not exclusively so (Titterington 2004; Beal & Ghahramani 2006).”
BackgroundHigh Dimensional Statistical Inference and Random MatricesPreprint
Johnstone, I. M. (2006) · arXiv (Cornell University) · doi:10.48550/arxiv.math/0611589 · Cited by 154
Self-citationVariational Bayesian learning of directed graphical models with hidden variables
Beal, M. J., & Ghahramani, Z. (2006) · Bayesian Analysis · doi:10.1214/06-ba126 · Cited by 121
Sufficient dimension reduction and prediction in regression
Adragni, K. P., & Cook, R. D. (2009) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2009.0110 · Cited by 117
A Report on the Future of Statistics
Lindsay, B. G., Kettenring, J. R., & Siegmund, D. (2004) · Statistical Science · doi:10.1214/088342304000000404 · Cited by 64
An overview of recent developments in genomics and associated statistical methods
Bickel, P. J., Brown, J. B., Huang, H., & Li, Q. (2009) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2009.0164 · Cited by 54
Computational Methods for High-Dimensional Rotations in Data Visualization
Buja, A., Cook, D., Asimov, D., & Hurley, C. (2005) · Handbook of statistics · doi:10.1016/s0169-7161(04)24014-7 · Cited by 51
Impossibility of successful classification when useful features are rare and weak
Jin, J. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903931106 · Cited by 50
Cherry-picking for complex data: robust structure discovery
Banks, D. L., House, L., & Killourhy, K. S. (2009) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2009.0119 · Cited by 8
Cited by
Multivariate Analysis in Metabolomics
Worley, B., & Powers, R. (2012) · Current Metabolomics · doi:10.2174/2213235x11301010092 · Cited by 1,348
Methods of integrating data to uncover genotype-phenotype interactions
Ritchie, M. D., Holzinger, E. R., Li, R., Pendergrass, S. A., & Kim, D. (2015) · Nature Reviews Genetics · doi:10.1038/nrg3868 · Cited by 1,085
An overview of variable selection methods in multivariate analysis of near-infrared spectra
Yun, Y.-H., Li, H.-D., Deng, B.-C., & Cao, D.-S. (2019) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2019.01.018 · Cited by 564
Computational principles and challenges in single-cell data integration
Argelaguet, R., Cuomo, A. S. E., Stegle, O., & Marioni, J. C. (2021) · Nature Biotechnology · doi:10.1038/s41587-021-00895-7 · Cited by 472
The singular values and vectors of low rank perturbations of large rectangular random matrices
Benaych-Georges, F., & Nadakuditi, R. R. (2012) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2012.04.019 · Cited by 301
Metadata
- Authors
- Johnstone, I. M., & Titterington, D. M.
- Venue
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
- Publisher
- The Royal Society
- Published
- 2009-11-13
- Volume
- 367
- Issue
- 1906
- Pages
- 4237-4253
- ISSN
- 1364-503X (ISSN-L)
- 1471-2962
- OpenAlex
- W2153491803
- Cited by
- 417
- References
- 51
- FWCI
- 5.19
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.