Valid Post-Selection and Post-Regularization Inference: An Elementary, General Approach
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
We present an expository, general analysis of valid post-selection or post-regularization inference about a low-dimensional target parameter in the presence of a very high-dimensional nuisance parameter that is estimated using selection or regularization methods. Our analysis provides a set of high-level conditions under which inference for the low-dimensional parameter based on testing or point estimation methods will be regular despite selection or regularization biases occurring in the estimation of the high-dimensional nuisance parameter. A key element is the use of so-called immunized or orthogonal estimating equations that are locally insensitive to small mistakes in the estimation of the high-dimensional nuisance parameter. As an illustration, we analyze affine-quadratic models and specialize these results to a linear instrumental variables model with many regressors and many instruments. We conclude with a review of other developments in post-selection inference and note that many can be viewed as special cases of the general encompassing framework of orthogonal estimating equations provided in this article.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaart, A. W. V. D. (1998) · doi:10.1017/cbo9780511802256 · Cited by 4,159
A significance test for the lasso
Lockhart, R., Taylor, J., Tibshirani, R. J., & Tibshirani, R. (2014) · The Annals of Statistics · doi:10.1214/13-aos1175 · Cited by 541
Estimation of semiparametric models when the criterion function is not smooth
Chen, X., Linton, O., & Van Keilegom, I. (2003) · Econometrica · doi:10.1111/1468-0262.00461 · Cited by 411
Program evaluation and causal inference with high-dimensional data
Belloni, A., Chernozhukov, V., Fern�ndez-Val, I., & Hansen, C. (2017) · Econometrica · doi:10.3982/ecta12723 · Cited by 317
Self-citation
Cited by
Double/debiased machine learning for treatment and structural parameters
Chernozhukov, V., Chetverikov, D., Demirer, M., Duflo, E., Hansen, C., Newey, W., & Robins, J. (2018) · The Econometrics Journal · doi:10.1111/ectj.12097 · Cited by 2,946
Self-citationEstimation and Inference of Heterogeneous Treatment Effects using Random Forests
Wager, S., & Athey, S. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1319839 · Cited by 2,917
“In general, the challenge in using adaptive methods as the basis for valid statistical inference is that selection bias can be difficult to quantify; see Berk et al. (2013), Chernozhukov, Hansen, and Spindler (2015), Taylor and Tibshirani (2015), and references therein for recent advances.”
MethodPrinciples of confounder selection
VanderWeele, T. J. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00494-6 · Cited by 1,535
Taming the Factor Zoo: A Test of New Factors
FENG, G., GIGLIO, S., & XIU, D. (2020) · The Journal of Finance · doi:10.1111/jofi.12883 · Cited by 707
Double/debiased machine learning for treatment and structural parameters
Newey, W. K., Hansen, C., Duflo, E., Robins, J., Chernozhukov, V., Demirer, M., & Chetverikov, D. (2017) · doi:10.1920/wp.cem.2017.2817 · Cited by 486
Self-citation
Metadata
- Authors
- Chernozhukov, V., Hansen, C., & Spindler, M.
- Venue
- Annual Review of Economics
- Publisher
- Annual Reviews
- Published
- 2015-08-01
- Volume
- 7
- Issue
- 1
- Pages
- 649-688
- ISSN
- 1941-1383 (ISSN-L)
- 1941-1391
- OpenAlex
- W2949148940
- Cited by
- 149
- References
- 4
- FWCI
- 2.24
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Valid Post-Selection and Post-Regularization Inference: An Elementary, General Approach. https://app.cochat.ai/papers/10.1146/annurev-economics-012315-015826
- The paper
- Chernozhukov, V., Hansen, C., & Spindler, M. (2015). Valid Post-Selection and Post-Regularization Inference: An Elementary, General Approach. Annual Review of Economics. https://doi.org/10.1146/annurev-economics-012315-015826
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.