The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Panning for Gold: ‘Model-X’ Knockoffs for High Dimensional Controlled Variable Selection
Abstract
Summary: Many contemporary large-scale applications involve building interpretable models linking a large set of potential covariates to a response in a non-linear fashion, such as when the response is binary. Although this modelling problem has been extensively studied, it remains unclear how to control the fraction of false discoveries effectively even in high dimensional logistic regression, not to mention general high dimensional non-linear models. To address such a practical problem, we propose a new framework of ‘model-X’ knockoffs, which reads from a different perspective the knockoff procedure that was originally designed for controlling the false discovery rate in linear models. Whereas the knockoffs procedure is constrained to homoscedastic linear models with n⩾p, the key innovation here is that model-X knockoffs provide valid inference from finite samples in settings in which the conditional distribution of the response is arbitrary and completely unknown. Furthermore, this holds no matter the number of covariates. Correct inference in such a broad setting is achieved by constructing knockoff variables probabilistically instead of geometrically. To do this, our approach requires that the covariates are random (independent and identically distributed rows) with a distribution that is known, although we provide preliminary experimental evidence that our procedure is robust to unknown or estimated distributions. To our knowledge, no other procedure solves the controlled variable selection problem in such generality but, in the restricted settings where competitors exist, we demonstrate the superior power of knockoffs through simulations. Finally, we apply our procedure to data from a case–control study of Crohn's disease in the UK, making twice as many discoveries as the original analysis of the same data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Multiplex Genome Engineering Using CRISPR/Cas Systems
Cong, L., Ran, F. A., Cox, D., Lin, S., Barretto, R., Habib, N., Hsu, P. D., Wu, X., Jiang, W., Marraffini, L. A., et al. (2013) · Science · doi:10.1126/science.1231143 · Cited by 15,339
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls
The Wellcome Trust Case Control Consortium, Management Committee, Burton, P. R., Clayton, D. G., Cardon, L. R., Craddock, N., Deloukas, P., Duncanson, A., Kwiatkowski, D. P., McCarthy, M. I., et al. (2007) · Nature · doi:10.1038/nature05911 · Cited by 9,442
Global Sensitivity Analysis. The Primer
Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., & Tarantola, S. (2007) · doi:10.1002/9780470725184 · Cited by 6,430
Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
Wager, S., & Athey, S. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1319839 · Cited by 2,917
Franke, A., McGovern, D. P. B., Barrett, J. C., Wang, K., Radford-Smith, G. L., Ahmad, T., Lees, C. W., Balschun, T., Lee, J., Roberts, R., et al. (2010) · Nature Genetics · doi:10.1038/ng.717 · Cited by 2,520
(1997) · Cited by 1,193
On Model Selection Consistency of Lasso
ZhaoPeng, & Yubin, Y. (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248637 · Cited by 996
Introduction to Graphical Modelling
Edwards, D. (2000) · Springer Texts in Statistics · doi:10.1007/978-1-4612-0493-0 · Cited by 825
On asymptotically optimal confidence regions and tests for high-dimensional models
van de Geer, S., Bühlmann, P., Ritov, Y., & Dezeure, R. (2014) · The Annals of Statistics · doi:10.1214/14-aos1221 · Cited by 822
Genome-wide association analysis by lasso penalized logistic regression
Wu, T. T., Chen, Y. F., Hastie, T., Sobel, E., & Lange, K. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp041 · Cited by 785 · cited 2×
“to improve power in genomewide association studies by using both penalized (Wu et al., 2009; He and Lin, 2011) and Bayesian regression (Guan and Stephens, 2011; Li et al.”
BackgroundMethodA Comprehensive, CRISPR-based Functional Analysis of Essential Genes in Bacteria
Peters, J. M., Colavin, A., Shi, H., Czarny, T. L., Larson, M. H., Wong, S., Hawkins, J. S., Lu, C. H. S., Koo, B.-M., Marta, E., et al. (2016) · Cell · doi:10.1016/j.cell.2016.05.003 · Cited by 714
Discovering the False Discovery Rate
Benjamini, Y. (2010) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00746.x · Cited by 629
Valid post-selection inference
Berk, R., Brown, L., Buja, A., Zhang, K., & Zhao, L. (2013) · The Annals of Statistics · doi:10.1214/12-aos1077 · Cited by 599
Macrophage Polarisation: an Immunohistochemical Approach for Identifying M1 and M2 Macrophages
Barros, M. H. M., Hauck, F., Dreyer, J. H., Kempkes, B., & Niedobitek, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0080908 · Cited by 594
Controlling the false discovery rate via knockoffs
Barber, R. F., & Candès, E. J. (2015) · The Annals of Statistics · doi:10.1214/15-aos1337 · Cited by 548
Self-citationA significance test for the lasso
Lockhart, R., Taylor, J., Tibshirani, R. J., & Tibshirani, R. (2014) · The Annals of Statistics · doi:10.1214/13-aos1175 · Cited by 541
Exact post-selection inference, with application to the lasso
Lee, J. D., Sun, D. L., Sun, Y., & Taylor, J. E. (2016) · The Annals of Statistics · doi:10.1214/15-aos1371 · Cited by 501
Near-ideal model selection by ℓ1 minimization
Candès, E. J., & Plan, Y. (2008) · Cited by 469
Self-citationHaldane, J. B. S., & Waddington, C. H. (1931) · Genetics · doi:10.1093/genetics/16.4.357 · Cited by 318
Guan, Y., & Stephens, M. (2011) · The Annals of Applied Statistics · doi:10.1214/11-aoas455 · Cited by 302
Near-ideal model selection by ℓ1 minimization
Candès, E. J., & Plan, Y. (2009) · The Annals of Statistics · doi:10.1214/08-aos653 · Cited by 302
Self-citationReconstructing Genetic Ancestry Blocks in Admixed Individuals
Tang, H., Coram, M., Wang, P., Zhu, X., & Risch, N. (2006) · The American Journal of Human Genetics · doi:10.1086/504302 · Cited by 279
SLOPE—Adaptive variable selection via convex optimization
Bogdan, M., van den Berg, E., Sabatti, C., Su, W., & Candès, E. J. (2015) · The Annals of Applied Statistics · doi:10.1214/15-aoas842 · Cited by 277
Self-citationThe Bayesian lasso for genome-wide association studies
Li, J., Das, K., Fu, G., Li, R., & Wu, R. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btq688 · Cited by 222
High-Dimensional Inference: Confidence Intervals, $p$-Values and R-Software hdi
Dezeure, R., Bühlmann, P., Meier, L., & Meinshausen, N. (2015) · Statistical Science · doi:10.1214/15-sts527 · Cited by 178
A variable selection method for genome-wide association studies
He, Q., & Lin, D. Y. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq600 · Cited by 139
Multiple Testing with Minimal Assumptions
Westfall, P. H., & Troendle, J. F. (2008) · Biometrical Journal · doi:10.1002/bimj.200710456 · Cited by 117
Using linear predictors to impute allele frequencies from summary or pooled genotype data
Wen, X., & Stephens, M. (2010) · The Annals of Applied Statistics · doi:10.1214/10-aoas338 · Cited by 70
KLF6 contributes to myeloid cell plasticity in the pathogenesis of intestinal inflammation
Goodman, W. A., Omenetti, S., Date, D. A., Martino, L. D., Salvo, C. D., Kim, G. D., Chowdhry, S., Bamias, G., Cominelli, F., Pizarro, T. T., et al. (2016) · Mucosal Immunology · doi:10.1038/mi.2016.1 · Cited by 57
A simple forward selection procedure based on false discovery rate control
Benjamini, Y., & Gavrilov, Y. (2009) · The Annals of Applied Statistics · doi:10.1214/08-aoas194 · Cited by 50
Familywise error rate control via knockoffs
Janson, L., & Su, W. (2016) · Electronic Journal of Statistics · doi:10.1214/16-ejs1129 · Cited by 45
Self-citationA SIMPLE FORWARD SELECTION PROCEDURE BASED ON FALSE DISCOVERY RATE CONTROL 1Preprint
Benjamini, Y., & Gavrilov, Y. (n.d.) · Cited by 44
Cited by
Human microglial state dynamics in Alzheimer’s disease progression
Sun, N., Victor, M. B., Park, Y. P., Xiong, X., Scannail, A. N., Leary, N., Prosper, S., Viswanathan, S., Luna, X., Boix, C. A., et al. (2023) · Cell · doi:10.1016/j.cell.2023.08.037 · Cited by 462
Hooker, G., Mentch, L., & Zhou, S. (2021) · Statistics and Computing · doi:10.1007/s11222-021-10057-z · Cited by 264
General Pitfalls of Model-Agnostic Interpretation Methods for Machine Learning Models
Molnar, C., König, G., Herbinger, J., Freiesleben, T., Dandl, S., Scholbeck, C. A., Casalicchio, G., Grosse-Wentrup, M., & Bischl, B. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-04083-2_4 · Cited by 211
Epigenomic dissection of Alzheimer’s disease pinpoints causal variants and reveals epigenome erosion
Xiong, X., James, B. T., Boix, C. A., Park, Y. P., Galani, K., Victor, M. B., Sun, N., Hou, L., Ho, L.-L., Mantero, J., et al. (2023) · Cell · doi:10.1016/j.cell.2023.08.040 · Cited by 205
SCEPTRE improves calibration and sensitivity in single-cell CRISPR screen analysis
Barry, T., Wang, X., Morris, J. A., Roeder, K., & Katsevich, E. (2021) · Genome Biology · doi:10.1186/s13059-021-02545-2 · Cited by 86
Metadata
- Authors
- Candès, E., Fan, Y., Janson, L., & Lv, J.
- Venue
- Journal of the Royal Statistical Society Series B: Statistical Methodology
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-01-08
- Volume
- 80
- Issue
- 3
- Pages
- 551-577
- ISSN
- 1369-7412 (ISSN-L)
- 1467-9868
- OpenAlex
- W2963371845
- Cited by
- 632
- References
- 34
- FWCI
- 42.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
