The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Statistical challenges with high dimensionality: feature selection in knowledge discovery
Open accessAbstract
Technological innovations have revolutionized the process of scientific research and knowledge discovery. The availability of massive data and challenges from frontiers of research and development have reshaped statistical thinking, data analysis and theoretical studies. The challenges of high-dimensionality arise in diverse fields of sciences and the humanities, ranging from computational biology and health studies to financial engineering and risk management. In all of these fields, variable selection and feature extraction are crucial for knowledge discovery. We first give a comprehensive overview of statistical challenges with high dimensionality in these diverse disciplines. We then approach the problem of variable selection and feature extraction using a unified framework: penalized likelihood methods. Issues relevant to the choice of penalty functions are addressed. We demonstrate that for a host of statistical problems, as long as the dimensionality is not excessively large, we can estimate the model parameters as well as if the best model is known in advance. The persistence property in risk minimization is also addressed. The applicability of such a theory and method to diverse statistical problems is demonstrated. Other related problems with high-dimensionality are also discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
A theory for multiresolution signal decomposition: the wavelet representation
Mallat, S. G. (1989) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.192463 · Cited by 21,372
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Daubechies, I. (1992) · doi:10.1137/1.9781611970104 · Cited by 15,979
Daubechies, I., & Heil, C. (1992) · Computers in Physics · doi:10.1063/1.4823127 · Cited by 15,631
de Boor, C. (1978) · Applied Mathematical Sciences · doi:10.1007/978-1-4612-6333-3 · Cited by 11,944
In silico prediction of protein-protein interactions in human macrophages
Souiai, O., Guerfali, F., Ben Miled, S., Brun, C., & Benkahla, A. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-157 · Cited by 10,803
Significance analysis of microarrays applied to the ionizing radiation response
Tusher, V. G., Tibshirani, R., & Chu, G. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.091062498 · Cited by 10,568
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
Self-citationIdeal spatial adaptation by wavelet shrinkage
Donoho, D. L., & Johnstone, I. M. (1994) · Biometrika · doi:10.1093/biomet/81.3.425 · Cited by 8,760
The adaptive lasso and its oracle properties
Zou, H. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000735 · Cited by 7,470
The arbitrage theory of capital asset pricing
Ross, S. A. (1976) · Journal of Economic Theory · doi:10.1016/0022-0531(76)90046-6 · Cited by 7,009
The Econometrics of Financial Markets
Campbell, J. Y., Lo, A. W., & MacKinlay, A. C. (2012) · Princeton University Press eBooks · doi:10.2307/j.ctt7skm5 · Cited by 5,875
Flexible smoothing with B-splines and penalties
Eilers, P. H. C., & Marx, B. D. (1996) · Statistical Science · doi:10.1214/ss/1038425655 · Cited by 3,666
Craven, P., & Wahba, G. (1978) · Numerische Mathematik · doi:10.1007/bf01404567 · Cited by 3,388
Entropy-based algorithms for best basis selection
Coifman, R. R., & Wickerhauser, M. V. (1992) · IEEE Transactions on Information Theory · doi:10.1109/18.119732 · Cited by 3,188
Local Polynomial Modelling and its Applications
Fan, J., & Gijbels, I. (1994) · Springer eBooks · doi:10.1007/978-1-4899-3150-4 · Cited by 2,849
Self-citationHand, D. J., Mannila, H., & Smyth, P. (2001) · Cited by 2,581
High dimensional graphs and variable selection with the Lasso
Meinshausen, N., & Bühlmann, P. (2006) · Cited by 2,539
High-dimensional graphs and variable selection with the Lasso
Meinshausen, N., & Bühlmann, P. (2006) · The Annals of Statistics · doi:10.1214/009053606000000281 · Cited by 2,521
The Nature of Statistical Learning
Vapnik, V. N. (1995) · Medical Entomology and Zoology · Cited by 2,295
A Statistical View of Some Chemometrics Regression Tools
Frank, L. E., & Friedman, J. H. (1993) · Technometrics · doi:10.1080/00401706.1993.10485033 · Cited by 2,213
On the distribution of the largest eigenvalue in principal components analysis
Johnstone, I. M. (2001) · The Annals of Statistics · doi:10.1214/aos/1009210544 · Cited by 1,949
Wavelet Shrinkage: Asymptopia?
Donoho, D. L., Johnstone, I. M., Kerkyacharian, G., & Picard, D. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02032.x · Cited by 1,749
Dudoit, S., Yang, J. Y. H., Callow, M. J., & Speed, T. P. (2002) · UC Berkeley · Cited by 1,576
Subset Selection in Regression
(2003) · Technometrics · doi:10.1198/tech.2003.s144 · Cited by 1,463
Storey, J. D., Taylor, J. E., & Siegmund, D. (2004) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2004.00439.x · Cited by 1,388
Multiple Hypothesis Testing in Microarray Experiments
Dudoit, S., Shaffer, J. P., & Boldrick, J. C. (2003) · Statistical Science · doi:10.1214/ss/1056397487 · Cited by 1,075
Better Subset Regression Using the Nonnegative Garrote
Breiman, L. (1995) · Technometrics · doi:10.1080/00401706.1995.10484371 · Cited by 1,043
Large-Scale Simultaneous Hypothesis Testing: The Choice of a Null Hypothesis
Efron, B. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000089 · Cited by 1,005
Nonconcave penalized likelihood with a diverging number of parameters
Fan, J., & Peng, H. (2004) · The Annals of Statistics · doi:10.1214/009053604000000256 · Cited by 1,002
Self-citationArbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets
Chamberlain, G., & Rothschild, M. (1982) · National Bureau of Economic Research · doi:10.3386/w0996 · Cited by 975
1-norm Support Vector Machines
Zhu, J., Rosset, S., Tibshirani, R. J., & Hastie, T. J. (2003) · Cited by 797
Higher criticism for detecting sparse heterogeneous mixtures
Donoho, D., & Jin, J. (2004) · The Annals of Statistics · doi:10.1214/009053604000000265 · Cited by 721
Variable Selection for Cox's proportional Hazards Model and Frailty Model
Fan, J., & Li, R. (2002) · The Annals of Statistics · doi:10.1214/aos/1015362185 · Cited by 602
Self-citationBickel, P. J., & Levina, E. (2004) · Bernoulli · doi:10.3150/bj/1106314847 · Cited by 548
Class Prediction by Nearest Shrunken Centroids, with Applications to DNA Microarrays
Tibshirani, R., Hastie, T., Narasimhan, B., & Chu, G. (2003) · Statistical Science · doi:10.1214/ss/1056397488 · Cited by 410
A Gradient Algorithm Locally Equivalent to the Em Algorithm
Lange, K. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02037.x · Cited by 376
Variable selection using MM algorithmsPreprint
Hunter, D. R., & Li, R. (2005) · Cited by 375
Self-citationModels for Intensive Longitudinal Data
(2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195173444.001.0001 · Cited by 364
A stochastic process approach to false discovery controlPreprint
Genovese, C. R., & Wasserman, L. (2004) · Cited by 323
Local Strong Homogeneity of a Regularized Estimator
Nikolova, M. (2000) · SIAM Journal on Applied Mathematics · doi:10.1137/s0036139997327794 · Cited by 291
A multivariate empirical Bayes statistic for replicated microarray time course dataPreprint
Tai, Y. C., & Speed, T. P. (2004) · Cited by 186
Self-normalized Cramér-type large deviations for independent random variables
Jing, B.-Y., Shao, Q.-M., & Wang, Q. (2003) · The Annals of Probability · doi:10.1214/aop/1068646382 · Cited by 175
Toric Ideals of Phylogenetic Invariants
Sturmfels, B., & Sullivant, S. (2005) · Journal of Computational Biology · doi:10.1089/cmb.2005.12.457 · Cited by 135
Variable selection for multivariate failure time data
Cai, J., Fan, J., Li, R., & Zhou, H. (2005) · Biometrika · doi:10.1093/biomet/92.2.303 · Cited by 102
Self-citationFan, J., Tam, P., Woude, G. V., & Ren, Y. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307557100 · Cited by 84
Self-citationGreenshtein, E. (2006) · Cited by 80
Parametric inference for biological sequence analysis
Pachter, L. S., & Sturmfels, B. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0406011101 · Cited by 73
Friedman, J. H., Hastie, T. J., Rosset, S., Tibshirani, R. J., & Zhu, J. (2003) · Cited by 46
On Optimality of Stepdown and Stepup Multiple Test Procedures
Lehmann, E. L., Romano, J. P., & Shaffer, J. P. (2011) · Springer eBooks · doi:10.1007/978-1-4614-1412-4_56 · Cited by 39
Statistical Approach to DNA Chip Analysis
Svrakic, N. M. (2003) · Recent Progress in Hormone Research · doi:10.1210/rp.58.1.75 · Cited by 30
A Local Linear Estimation Procedure for Functional Multilevel Modeling
Li, R., Root, T. L., & Shiffman, S. S. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195173444.003.0003 · Cited by 22
Self-citation
Cited by
Sure Independence Screening for Ultrahigh Dimensional Feature Space
Fan, J., & Lv, J. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2008.00674.x · Cited by 2,711
Self-citationOn the “degrees of freedom” of the lasso
Zou, H., Hastie, T., & Tibshirani, R. (2007) · The Annals of Statistics · doi:10.1214/009053607000000127 · Cited by 947
On the adaptive elastic-net with a diverging number of parameters
Zou, H., & Zhang, H. H. (2009) · The Annals of Statistics · doi:10.1214/08-aos625 · Cited by 847
High dimensional covariance matrix estimation using a factor model
Fan, J., Fan, Y., & Lv, J. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2008.09.017 · Cited by 685
Self-citationOne-step sparse estimates in nonconcave penalized likelihood models
Zou, H., & Li, R. (2008) · The Annals of Statistics · doi:10.1214/009053607000000802 · Cited by 683
Self-citation
Metadata
- Authors
- Fan, J., & Li, R.
- Venue
- Proceedings of the International Congress of Mathematicians Madrid, August 22–30, 2006
- Publisher
- EMS Press
- Published
- 2007-05-15
- Pages
- 595-622
- OpenAlex
- W2949417153
- Cited by
- 348
- References
- 55
- FWCI
- 76.28
- Type
- book chapter
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.