The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Variance Estimation Using Refitted Cross-Validation in Ultrahigh Dimensional Regression
Open accessAbstract
Summary: Variance estimation is a fundamental problem in statistical modelling. In ultrahigh dimensional linear regression where the dimensionality is much larger than the sample size, traditional variance estimation techniques are not applicable. Recent advances in variable selection in ultrahigh dimensional linear regression make this problem accessible. One of the major problems in ultrahigh dimensional regression is the high spurious correlation between the unobserved realized noise and some of the predictors. As a result, the realized noises are actually predicted when extra irrelevant variables are selected, leading to a serious underestimate of the level of noise. We propose a two-stage refitted procedure via a data splitting technique, called refitted cross-validation, to attenuate the influence of irrelevant variables with high spurious correlations. Our asymptotic results show that the resulting procedure performs as well as the oracle estimator, which knows in advance the mean regression function. The simulation studies lend further support to our theoretical claims. The naive two-stage estimator and the plug-in one-stage estimators using the lasso and smoothly clipped absolute deviation are also studied and compared. Their performances can be improved by the refitted cross-validation method proposed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
Self-citationThe adaptive lasso and its oracle properties
Zou, H. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000735 · Cited by 7,470
Weak Convergence and Empirical Processes
van der Vaart, A. W., & Wellner, J. A. (1996) · Springer Series in Statistics · doi:10.1007/978-1-4757-2545-2 · Cited by 5,014
Park, T., & Casella, G. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000337 · Cited by 2,934
Sure Independence Screening for Ultrahigh Dimensional Feature Space
Fan, J., & Lv, J. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2008.00674.x · Cited by 2,711
Self-citationSimultaneous analysis of Lasso and Dantzig selector
Bickel, P. J., Ritov, Y., & Tsybakov, A. B. (2009) · The Annals of Statistics · doi:10.1214/08-aos620 · Cited by 2,396
The Group Lasso for Logistic Regression
Meier, L., Van De Geer, S., & Bühlmann, P. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00627.x · Cited by 1,674
Asymptotics for lasso-type estimators
Fu, W., & Knight, K. (2000) · The Annals of Statistics · doi:10.1214/aos/1015957397 · Cited by 1,276
Fan, J., & Lv, J. (2009) · PubMed · doi:10.48550/arxiv.0910.1122 · Cited by 1,037
Self-citationNonconcave penalized likelihood with a diverging number of parameters
Fan, J., & Peng, H. (2004) · The Annals of Statistics · doi:10.1214/009053604000000256 · Cited by 1,002
Self-citationOn Model Selection Consistency of Lasso
ZhaoPeng, & Yubin, Y. (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248637 · Cited by 996
On the “degrees of freedom” of the lasso
Zou, H., Hastie, T., & Tibshirani, R. (2007) · The Annals of Statistics · doi:10.1214/009053607000000127 · Cited by 947
One-step sparse estimates in nonconcave penalized likelihood modelsPreprint
Zou, H., & Li, R. (2008) · Cited by 919
Lasso-type recovery of sparse representations for high-dimensional data
Meinshausen, N., & Yu, B. (2006) · Cited by 744
One-step sparse estimates in nonconcave penalized likelihood models
Zou, H., & Li, R. (2008) · The Annals of Statistics · doi:10.1214/009053607000000802 · Cited by 683
Sure independence screening in generalized linear models with NP-dimensionality
Fan, J., & Song, R. (2010) · The Annals of Statistics · doi:10.1214/10-aos798 · Cited by 630
Self-citationPenalized regression, standard errors, and Bayesian lassos
Casella, G., Ghosh, M., Gill, J., & Kyung, M. (2010) · Bayesian Analysis · doi:10.1214/10-ba607 · Cited by 567
Ultrahigh dimensional variable selection: beyond the linear model
Fan, J., Samworth, R. J., & Wu, Y. (2008) · PubMed · doi:10.48550/arxiv.0812.3201 · Cited by 521
Self-citationOn Measuring and Correcting the Effects of Data Mining and Model Selection
Ye, J. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10474094 · Cited by 518
The sparsity and bias of the Lasso selection in high-dimensional linear regression
Zhang, C.-H., & Huang, J. (2008) · The Annals of Statistics · doi:10.1214/07-aos520 · Cited by 506
High-dimensional variable selectionPreprint
Wasserman, L., & Roeder, K. (2009) · Cited by 501
Lasso-type recovery of sparse representations for high-dimensional data
Meinshausen, N., & Yu, B. (2009) · The Annals of Statistics · doi:10.1214/07-aos582 · Cited by 489
p-Values for High-Dimensional Regression
Meinshausen, N., Meier, L., & Bühlmann, P. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.tm08647 · Cited by 442
Nonconcave Penalized Likelihood With NP-Dimensionality
Fan, J., & Lv, J. (2011) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2158486 · Cited by 427
Self-citationSparsity oracle inequalities for the Lasso
Bunea, F., Tsybakov, A. B., & Wegkamp, M. H. (2007) · HAL · Cited by 389
High-dimensional variable selection
Wasserman, L., & Roeder, K. (2009) · The Annals of Statistics · doi:10.1214/08-aos646 · Cited by 373
Persistence in high-dimensional linear predictor selection and the virtue of overparametrization
Greenshtein, E., & Ritov, Y. (2004) · Bernoulli · doi:10.3150/bj/1106314846 · Cited by 362
Bootstrapping Lasso Estimators
Chatterjee, A., & Lahiri, S. N. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm10159 · Cited by 293
Smoothly Clipped Absolute Deviation on High Dimensions
Kim, Y., Choi, H., & Oh, H.-S. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000001066 · Cited by 261
A unified approach to model selection and sparse recovery using regularized least squaresPreprint
Lv, J., & Fan, Y. (2009) · Cited by 256
Sparsity oracle inequalities for the Lasso
Bunea, F., Tsybakov, A., & Wegkamp, M. (2007) · Electronic Journal of Statistics · doi:10.1214/07-ejs008 · Cited by 253
A unified approach to model selection and sparse recovery using regularized least squares
Lv, J., & Fan, Y. (2009) · The Annals of Statistics · doi:10.1214/09-aos683 · Cited by 252
Principled sure independence screening for Cox models with ultra-high-dimensional covariates
Zhao, S. D., & Li, Y. (2012) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2011.08.002 · Cited by 239
Estimating False Discovery Proportion Under Arbitrary Covariance Dependence
Fan, J., Han, X., & Gu, W. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.720478 · Cited by 227
Ultrahigh Dimensional Feature Selection: Beyond The Linear Model
FanJianqing, SamworthRichard, & WuYichao (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1755853 · Cited by 210
Control of the False Discovery Rate Under Arbitrary Covariance DependencePreprint
Han, X., Gu, W., & Fan, J. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.4397 · Cited by 13
Self-citation
Cited by
Double/debiased machine learning for treatment and structural parameters
Chernozhukov, V., Chetverikov, D., Demirer, M., Duflo, E., Hansen, C., Newey, W., & Robins, J. (2018) · The Econometrics Journal · doi:10.1111/ectj.12097 · Cited by 2,946
Challenges of Big Data analysis
Fan, J., Han, F., & Liu, H. (2014) · National Science Review · doi:10.1093/nsr/nwt032 · Cited by 1,482
Self-citationConfidence Intervals and Hypothesis Testing for High-Dimensional Regression
Javanmard, A., & Andrea Montanari, A. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.3171 · Cited by 635
A significance test for the lasso
Lockhart, R., Taylor, J., Tibshirani, R. J., & Tibshirani, R. (2014) · The Annals of Statistics · doi:10.1214/13-aos1175 · Cited by 541
Double/Debiased Machine Learning for Treatment and Structural Parameters
Chernozhukov, V., Chetverikov, D., Demirer, M., Duflo, E., Hansen, C., Newey, W., & Robins, J. (2017) · National Bureau of Economic Research · doi:10.3386/w23564 · Cited by 535
Metadata
- Authors
- Fan, J., Guo, S., & Hao, N.
- Venue
- Journal of the Royal Statistical Society Series B: Statistical Methodology
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-10-10
- Volume
- 74
- Issue
- 1
- Pages
- 37-65
- ISSN
- 1369-7412 (ISSN-L)
- 1467-9868
- OpenAlex
- W2111162388
- Cited by
- 259
- References
- 37
- FWCI
- 9.74
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.