The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Outlier Detection Using Nonconvex Penalized Regression
Open accessAbstract
This article studies the outlier detection problem from the standpoint of penalized regression. In the regression model, we add one mean shift parameter for each of the n data points. We then apply a regularization favoring a sparse vector of mean shift parameters. The usual L1 penalty yields a convex criterion, but fails to deliver a robust estimator. The L1 penalty corresponds to soft thresholding. We introduce a thresholding (denoted by Θ) based iterative procedure for outlier detection (Θ–IPOD). A version based on hard thresholding correctly identifies outliers on some hard test problems. We describe the connection between Θ–IPOD and M-estimators. Our proposed method has one tuning parameter with which to both identify outliers and estimate regression coefficients. A data-dependent choice can be made based on the Bayes information criterion. The tuned Θ–IPOD shows outstanding performance in identifying outliers in various situations compared with other existing approaches. In addition, Θ–IPOD is much faster than iteratively reweighted least squares for large data, because each iteration costs at most O(np) (and sometimes much less), avoiding an O(np2) least squares estimate. This methodology can be extended to high-dimensional modeling with p ≫ n if both the coefficient vector and the outlier pattern are sparse.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Ideal spatial adaptation by wavelet shrinkage
Donoho, D. L., & Johnstone, I. M. (1994) · Biometrika · doi:10.1093/biomet/81.3.425 · Cited by 8,760
Robust Regression and Outlier Detection
Piepel, G. F. (1989) · Technometrics · doi:10.1080/00401706.1989.10488524 · Cited by 6,144
Robust Statistics: The Approach Based on Influence Functions
Ruppert, D. (1987) · Technometrics · doi:10.2307/1269782 · Cited by 3,880
Least Median of Squares Regression
Rousseeuw, P. J. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477105 · Cited by 3,835
Sure Independence Screening for Ultrahigh Dimensional Feature Space
Fan, J., & Lv, J. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2008.00674.x · Cited by 2,711
Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
Šidák, Z. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10482935 · Cited by 2,639
Introduction to Robust Estimation and Hypothesis Testing
(2012) · Elsevier eBooks · doi:10.1016/c2010-0-67044-1 · Cited by 2,055
Extended Bayesian information criteria for model selection with large model spaces
Chen, J., & Chen, Z. (2008) · Biometrika · doi:10.1093/biomet/asn034 · Cited by 2,011
Robust Statistics: Theory and Methods
Maronna, R. A., Martin, R. D., & Yohai, V. J. (2006) · Cited by 1,715
High Breakdown-Point and High Efficiency Robust Estimates for Regression
Yohai, V. J. (1987) · The Annals of Statistics · doi:10.1214/aos/1176350366 · Cited by 1,644
On Model Selection Consistency of Lasso
ZhaoPeng, & Yubin, Y. (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248637 · Cited by 996
Bulletin of the International Statistical Institute
Leckie, G. (2013) · Cited by 958
Robust Regression by Means of S-Estimators
Rousseeuw, P., & Yohai, V. (1984) · Lecture Notes in Statistics · doi:10.1007/978-1-4615-7821-5_15 · Cited by 950
Computing LTS Regression for Large Data Sets
ROUSSEEUW, P. J., & VAN DRIESSEN, K. (2006) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-005-0024-4 · Cited by 606
Applied Linear Regression (2nd ed.).
Miller, R. B., & Weisberg, S. (1986) · Journal of the American Statistical Association · doi:10.2307/2289035 · Cited by 562
The sparsity and bias of the Lasso selection in high-dimensional linear regression
Zhang, C.-H., & Huang, J. (2008) · The Annals of Statistics · doi:10.1214/07-aos520 · Cited by 506
Regularization of Wavelet Approximations
Antoniadis, A., & Fan, J. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753208942 · Cited by 498
Robust Diagnostic Regression Analysis
Atkinson, A., & Riani, M. (2000) · Springer Series in Statistics · doi:10.1007/978-1-4612-1160-0 · Cited by 424
Multivariate Bayesian Variable Selection and Prediction
Brown, P. J., Vannucci, M., & Fearn, T. (1998) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00144 · Cited by 369
Procedures for the Identification of Multiple Outliers in Linear Models
Hadi, A. S., & Simonoff, J. S. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476407 · Cited by 367
Location of Several Outliers in Multiple-Regression Data Using Elemental Sets
Hawkins, D. M., Bradu, D., & Kass, G. V. (1984) · Technometrics · doi:10.1080/00401706.1984.10487956 · Cited by 312
Measurement, Regression, and Calibration
Gleser, L. J., & Brown, P. J. (1996) · Technometrics · doi:10.2307/1268905 · Cited by 308
A Fast Algorithm for S-Regression Estimates
Salibian-Barrera, M., & Yohai, V. J. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x113629 · Cited by 238
Wavelet methods in statistics: some recent developments and their applications
Antoniadis, A. (2007) · Statistics Surveys · doi:10.1214/07-ss014 · Cited by 164
Thresholding-based iterative selection procedures for model selection and shrinkage
She, Y. (2009) · Electronic Journal of Statistics · doi:10.1214/08-ejs348 · Cited by 154
Self-citationA Comparative analysis of multiple outlier detection procedures in the linear regression model
Wisnowski, J. W., Montgomery, D. C., & Simpson, J. R. (2001) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(00)00042-6 · Cited by 88
Regularization of Wavelets Approximations
Antoniadis, A., & Fan, J. (2011) · eScholarship (California Digital Library) · Cited by 49
Outlier detection and least trimmed squares approximation using semi-definite programming
Nguyen, T.-D., & Welsch, R. E. (2009) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2009.09.037 · Cited by 49
Cited by
Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation
Zhou, X., Yang, C., & Yu, W. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.132 · Cited by 648
The solution path of the generalized lasso
Tibshirani, R. J., & Taylor, J. (2011) · The Annals of Statistics · doi:10.1214/11-aos878 · Cited by 553
Scaled sparse linear regression
Sun, T., & Zhang, C.-H. (2012) · Biometrika · doi:10.1093/biomet/ass043 · Cited by 444
Non-convex Optimization for Machine Learning
Jain, P., & Kar, P. (2017) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000058 · Cited by 364
Robust linear regression: A review and comparison
Yu, C., & Yao, W. (2017) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610918.2016.1202271 · Cited by 273
Metadata
- Authors
- She, Y., & Owen, A. B.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2011-06
- Volume
- 106
- Issue
- 494
- Pages
- 626-639
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W1969515697
- Cited by
- 310
- References
- 31
- FWCI
- 11.13
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.