Confounder adjustment in multiple hypothesis testing
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
We consider large-scale studies in which thousands of significance tests are performed simultaneously. In some of these studies, the multiple testing procedure can be severely biased by latent confounding factors such as batch effects and unmeasured covariates that correlate with both primary variable(s) of interest (e.g., treatment variable, phenotype) and the outcome. Over the past decade, many statistical methods have been proposed to adjust for the confounders in hypothesis testing. We unify these methods in the same framework, generalize them to include multiple primary variables and multiple nuisance variables, and analyze their statistical properties. In particular, we provide theoretical guarantees for RUV-4 [Gagnon-Bartsch, Jacob and Speed (2013)] and LEAPP [Ann. Appl. Stat. 6 (2012) 1664–1688], which correspond to two different identification conditions in the framework: the first requires a set of “negative controls” that are known a priori to follow the null distribution; the second requires the true nonnulls to be sparse. Two different estimators which are based on RUV-4 and LEAPP are then applied to these two scenarios. We show that if the confounding factors are strong, the resulting estimators can be asymptotically as powerful as the oracle estimator which observes the latent confounding factors. For hypothesis testing, we show the asymptotic $z$-tests based on the estimators can control the type I error. Numerical experiments show that the false discovery rate is also controlled by the Benjamini–Hochberg procedure when the sample size is reasonably large.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
General Diagnostic Tests for Cross Section Dependence in Panels
Pesaran, M. H. (2004) · doi:10.2139/ssrn.572504 · Cited by 8,738
Genomic Expression Programs in the Response of Yeast Cells to Environmental Changes
Gasch, A. P., Spellman, P. T., Kao, C. M., Carmel-Harel, O., Eisen, M. B., Storz, G., Botstein, D., & Brown, P. O. (2000) · Molecular Biology of the Cell · doi:10.1091/mbc.11.12.4241 · Cited by 4,815
Tackling the widespread and critical impact of batch effects in high-throughput data
Leek, J. T., Scharpf, R. B., Bravo, H. C., Simcha, D., Langmead, B., Johnson, W. E., Geman, D., Baggerly, K., & Irizarry, R. A. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2825 · Cited by 2,196
Capturing Heterogeneity in Gene Expression Studies by Surrogate Variable Analysis
Leek, J. T., & Storey, J. D. (2007) · PLoS Genetics · doi:10.1371/journal.pgen.0030161 · Cited by 1,930
Blalock, E. M., Geddes, J. W., Chen, K. C., Porter, N. M., Markesbery, W. R., & Landfield, P. W. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0308512100 · Cited by 1,025
Confounding and Collapsibility in Causal Inference
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Statistical Science · doi:10.1214/ss/1009211805 · Cited by 933 · cited 1×
“We use the meaning from [29]: “a mixing of effects of extraneous factors (called confounders) with the effect of interest”.”
MethodUsing control genes to correct for unwanted variation in microarray data
Gagnon-Bartsch, J. A., & Speed, T. P. (2012) · Biostatistics · doi:10.1093/biostatistics/kxr034 · Cited by 442 · cited 26×
“We discuss in more detail how previous methods of confounder adjustment, namely SVA [38, 39], RUV-4 [26, 27] and LEAPP [60], fit in the framework (2.”
BackgroundMethodInfluential
Cited by
the BIOS Consortium, van Iterson, M., van Zwet, E. W., & Heijmans, B. T. (2017) · Genome biology · doi:10.1186/s13059-016-1131-9 · Cited by 421
“[17] to generate data with confounding factors.”
BackgroundMethodInfluentialLFMM 2: Fast and Accurate Inference of Gene-Environment Associations in Genome-Wide Studies
Caye, K., Jumentier, B., Lepeule, J., & François, O. (2019) · Molecular Biology and Evolution · doi:10.1093/molbev/msz008 · Cited by 404
Chen, W., Zhang, S., Williams, J., Ju, B., Shaner, B., Easton, J., Wu, G., & Chen, X. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.03.026 · Cited by 44
Johnson, N. D., Wu, X., Still, C. D., Chu, X., Petrick, A. T., Gerhard, G. S., Conneely, K. N., & DiStefano, J. K. (2021) · Clinical Epigenetics · doi:10.1186/s13148-021-01129-y · Cited by 43
Genome-scale transcriptome augmentation during Arabidopsis thaliana photomorphogenesis
Schivre, G., Wolff, L., Mirasole, F. M., Vidal, A., Davidson, M. L. H., Armanet, E., Dardalhon-Cuménal, D., Dumont, M., Bourge, M., Baroux, C., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-66359-7 · Cited by 6
Metadata
- Authors
- Wang, J., Zhao, Q., Hastie, T., & Owen, A. B.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2017-10-01
- Volume
- 45
- Issue
- 5
- Pages
- 1863-1894
- ISSN
- 0090-5364 (ISSN-L)
- OpenAlex
- W2963539537
- Cited by
- 119
- References
- 14
- FWCI
- 9.80
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Confounder adjustment in multiple hypothesis testing. https://app.cochat.ai/papers/10.1214/16-aos1511
- The paper
- Wang, J., Zhao, Q., Hastie, T., & Owen, A. B. (2017). Confounder adjustment in multiple hypothesis testing. The Annals of Statistics. https://doi.org/10.1214/16-aos1511
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.