The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
A general framework for multiple testing dependence
Open accessAbstract
We develop a general framework for performing large-scale significance testing in the presence of arbitrarily strong dependence. We derive a low-dimensional set of random vectors, called a dependence kernel, that fully captures the dependence structure in an observed high-dimensional dataset. This result shows a surprising reversal of the “curse of dimensionality” in the high-dimensional hypothesis testing setting. We show theoretically that conditioning on a dependence kernel is sufficient to render statistical tests independent regardless of the level of dependence in the observed data. This framework for multiple testing dependence has implications in a variety of common multiple testing problems, such as in gene expression studies, brain imaging, and spatial epidemiology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
In silico prediction of protein-protein interactions in human macrophages
Souiai, O., Guerfali, F., Ben Miled, S., Brun, C., & Benkahla, A. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-157 · Cited by 10,803
Significance analysis of microarrays applied to the ionizing radiation response
Tusher, V. G., Tibshirani, R., & Chu, G. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.091062498 · Cited by 10,568
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Principal components analysis corrects for stratification in genome-wide association studies
Price, A. L., Patterson, N. J., Plenge, R. M., Weinblatt, M. E., Shadick, N. A., & Reich, D. (2006) · Nature Genetics · doi:10.1038/ng1847 · Cited by 10,248
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692 · cited 1×
“[1]”
Self-citationA Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
Self-citationThresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923
Genomic Control for Association Studies
Devlin, B., & Roeder, K. (1999) · Biometrics · doi:10.1111/j.0006-341x.1999.00997.x · Cited by 3,162 · cited 1×
“The second open problem is concerned with the fact that latent structure among the tests can distort what would usually be the correct null distribution of the test statistics (11, 25–27).”
BackgroundMathematical Statistics and Data Analysis
Rabinowitz, L. (1989) · Technometrics · doi:10.1080/00401706.1989.10488573 · Cited by 3,116
Adaptive Control Processes: A Guided Tour
Bellman, R. E. (1961) · doi:10.1515/9781400874668 · Cited by 2,802
Adaptive Control Processes: A Guided Tour.
Page, E. S., & Bellman, R. (1962) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2343225 · Cited by 2,185
Shaffer, J. P. (1995) · Annual Review of Psychology · doi:10.1146/annurev.ps.46.020195.003021 · Cited by 1,960
Capturing Heterogeneity in Gene Expression Studies by Surrogate Variable Analysis
Leek, J. T., & Storey, J. D. (2007) · PLoS Genetics · doi:10.1371/journal.pgen.0030161 · Cited by 1,930
Self-citationNonparametric Regression and Generalized Linear Models
Green, P. J., & Silverman, B. W. (1994) · Springer eBooks · doi:10.1007/978-1-4899-4473-3 · Cited by 1,925
Storey, J. D., Taylor, J. E., & Siegmund, D. (2004) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2004.00439.x · Cited by 1,388
Self-citationUse of Unlinked Genetic Markers to Detect Population Stratification in Association Studies
Pritchard, J. K., & Rosenberg, N. A. (1999) · The American Journal of Human Genetics · doi:10.1086/302449 · Cited by 1,198 · cited 1×
“Failing to include all relevant factors is a common issue in genomics leading to latent structure (2,3).”
BackgroundMultiple Hypothesis Testing in Microarray Experiments
Dudoit, S., Shaffer, J. P., & Boldrick, J. C. (2003) · Statistical Science · doi:10.1214/ss/1056397487 · Cited by 1,075
Large-Scale Simultaneous Hypothesis Testing: The Choice of a Null Hypothesis
Efron, B. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000089 · Cited by 1,005
Mathematical Statistics and Data Analysis
Ziegel, E. R., & Rice, J. (1995) · Technometrics · doi:10.2307/1269179 · Cited by 842
Yekutieli, D., & Benjamini, Y. (1999) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(99)00041-5 · Cited by 753
Spatial epidemiology: methods and applications
(2001) · Spatial Epidemiology · doi:10.1093/acprof:oso/9780198515326.003.0001 · Cited by 742
Detecting differential gene expression with a semiparametric hierarchical mixture method
Newton, M. A. (2004) · Biostatistics · doi:10.1093/biostatistics/5.2.155 · Cited by 564
Controlling the False-Discovery Rate in Astrophysical Data Analysis
Miller, C. J., Genovese, C. R., Nichol, R. C., Wasserman, L., Connolly, A. J., Reichart, D., Hopkins, A., Schneider, J., & Moore, A. (2001) · The Astronomical Journal · doi:10.1086/324109 · Cited by 186
Variance of the Number of False Discoveries
Owen, A. B. (2005) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2005.00509.x · Cited by 152
Statistical "Discoveries" and Effect-Size Estimation
Sorić, B. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478811 · Cited by 148
Qiu, X., Klebanov, L. B., & Yakovlev, A. (2005) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1157 · Cited by 121
Detecting activation in fMRI data
Worsley, K. J. (2003) · Statistical Methods in Medical Research · doi:10.1191/0962280203sm340ra · Cited by 110
Weak lensing mass reconstruction using wavelets
Starck, J., Pires, S., & Refregier, A. R. (2006) · Astronomy and Astrophysics · doi:10.1051/0004-6361:20052997 · Cited by 90
False discovery rate analysis of brain diffusion direction maps
Schwartzman, A., Dougherty, R. F., & Taylor, J. (2008) · The Annals of Applied Statistics · doi:10.1214/07-aoas133 · Cited by 88
(2001) · doi:10.1093/acprof:oso/9780198515326.001.0001 · Cited by 77
A reanalysis of a published Affymetrix GeneChip control dataset.
Dabney, A. R., & Storey, J. D. (2006) · Genome biology · doi:10.1186/gb-2006-7-3-401 · Cited by 61
Self-citationStatistical "Discoveries" and Effect-Size Estimation
Soric, B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289950 · Cited by 47
A New Type of Stochastic Dependence Revealed in Gene Expression Data
Klebanov, L. B., Jordan, C. T., & Yakovlev, A. (2006) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1189 · Cited by 45
Worsley (1996) · doi:10.1002/(sici)1097-0193(1996)4:1
Cited by
Leek, J. T., Johnson, W. E., Parker, H. S., Jaffe, A. E., & Storey, J. D. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts034 · Cited by 6,231
“This is true regardless of whether the surrogate variables are estimated with principal components, singular vectors (Leek and Storey, 2007, 2008) or independent components (Teschendorff et al., 2011).”
Self-citationDNA methylation-based classification of central nervous system tumours
Capper, D., Jones, D. T. W., Sill, M., Hovestadt, V., Schrimpf, D., Sturm, D., Koelsche, C., Sahm, F., Chavez, L., Reuss, D. E., et al. (2018) · Nature · doi:10.1038/nature26000 · Cited by 3,033
Harmonization of multi-site diffusion tensor imaging data
Fortin, J.-P., Parker, D., Tunç, B., Watanabe, T., Elliott, M. A., Ruparel, K., Roalf, D. R., Satterthwaite, T. D., Gur, R. C., Gur, R. E., et al. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.08.047 · Cited by 1,261
Landscape of X chromosome inactivation across human tissues
GTEx Consortium, Tukiainen, T., Villani, A.-C., Yen, A., Rivas, M. A., Marshall, J. L., Satija, R., Aguirre, M., Gauthier, L., Fleharty, M., et al. (2017) · Nature · doi:10.1038/nature24265 · Cited by 1,138
“…were adjusted for age, three principal components inferred from genotype data using EIGENSTRAT 42 , sample ischemic time, surrogate variables 43,44 built using the sva R package 45 , and the cause of death classified into five categories based on the 4-point Hardy scale (Supplementary Methods).”
Large Covariance Estimation by Thresholding Principal Orthogonal Complements
Fan, J., Liao, Y., & Mincheva, M. (2013) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12016 · Cited by 909
Metadata
- Authors
- Leek, J. T., & Storey, J. D.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2008-12-02
- Volume
- 105
- Issue
- 48
- Pages
- 18718-18723
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2024103316
- Cited by
- 374
- References
- 36
- FWCI
- 14.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.