The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Tackling the widespread and critical impact of batch effects in high-throughput data
Open accessAbstract
High-throughput technologies are widely used, for example to assay genetic variants, gene and protein expression, and epigenetic modifications. One often overlooked complication with such studies is batch effects, which occur because measurements are affected by laboratory conditions, reagent lots and personnel differences. This becomes a major problem when batch effects are correlated with an outcome of interest and lead to incorrect conclusions. Using both published studies and our own analyses, we argue that batch effects (as well as other technical and biological artefacts) are widespread and critical to address. We review experimental and computational approaches for doing so.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“These batch effects make it difficult to draw conclusions from data across experimental batches (Leek et al., 2010; Parker and Leek, 2012; Soneson et al., 2014; Nygaard et al., 2016; Caicedo et al., 2017).”
From WILDS: A Benchmark of in-the-Wild Distribution Shifts (2020) · cites this paper as Leek et al., 2010
The cited source says what the claim attributes to it.
In the citing paper
“Several methods have been suggested to adjust for batch effects, including recommendations for experimental designs and statistical approaches (see for example Leek et al., 2010).”
From The applied implications of epigenetics in anxiety, affective and stress-related disorders - A review and synthesis on psychosocial stress, psychotherapy and prevention (2020) · cites this paper as Leek et al., 2010
The cited source says what the claim attributes to it.
In the citing paper
“Despite attempts to carefully control experimental variables such as temperature, humidity, and reagent concentration, measurements from these screens are confounded by technical artifacts that arise from differences in the execution of each batch.”
From WILDS: A Benchmark of in-the-Wild Distribution Shifts (2020) · cites this paper as Leek et al., 2010
In the citing paper
“Batch effects and technical variation due to unknown (unmodeled) confounders are common in both scRNA-seq and bulk RNA-seq.”
From Revealing the vectors of cellular identity with single-cell genomics (2016) · cites this paper as [45]
In the citing paper
“Notably, edges are susceptible to ascertainment biases52,214,215 and confounding factors that can induce spurious relationships178 (FIG. 2b).”
From Systems biology and gene networks in neurodevelopmental and neurodegenerative disorders (2015) · cites this paper as [178]
In the citing paper
“Optimal methodological choices and study designs ensure that the biological signals from the main factors are not confounded by variation from unwanted factors178.”
From Systems biology and gene networks in neurodevelopmental and neurodegenerative disorders (2015) · cites this paper as [178]
In the citing paper
“there are no batch normalization approaches for microbiome data, unlike in transcriptional or genetic meta-analyses26.”
From Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium (2017) · cites this paper as [26]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploration, normalization, and summaries of high density oligonucleotide array probe level data
Irizarry, R. A. (2003) · Biostatistics · doi:10.1093/biostatistics/4.2.249 · Cited by 10,603
Self-citationAdjusting batch effects in microarray expression data using empirical Bayes methods
Johnson, W. E., Li, C., & Rabinovic, A. (2007) · Biostatistics · doi:10.1093/biostatistics/kxj037 · Cited by 8,658
Self-citationBolstad, B. M., Irizarry, R. A., Åstrand, M., & Speed, T. P. (2003) · Bioinformatics · doi:10.1093/bioinformatics/19.2.185 · Cited by 8,328
Self-citationComprehensive genomic characterization defines human glioblastoma genes and core pathways
The Cancer Genome Atlas Research Network (2008) · Nature · doi:10.1038/nature07385 · Cited by 7,735
The International HapMap Project
†The International HapMap Consortium, Genotyping centres: Baylor College of Medicine and ParAllele BioScience, Gibbs, R. A., Belmont, J. W., Hardenbol, P., Willis, T. D., Yu, F., Chinese HapMap Consortium, Yang, H., Ch'ang, L.-Y., et al. (2003) · Nature · doi:10.1038/nature02168 · Cited by 6,057
Use of proteomic patterns in serum to identify ovarian cancer
Petricoin, E. F., Ardekani, A. M., Hitt, B. A., Levine, P. J., Fusaro, V. A., Steinberg, S. M., Mills, G. B., Simone, C., Fishman, D. A., Kohn, E. C., et al. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07746-2 · Cited by 3,236
Principles of Numerical Taxonomy
Eysenck, H. J., & Eysenck, S. B. G. (2013) · Routledge eBooks · doi:10.4324/9780203766804-11 · Cited by 3,001
Singular value decomposition for genome-wide expression data processing and modeling
Alter, O., Brown, P. O., & Botstein, D. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.18.10101 · Cited by 1,989
Capturing Heterogeneity in Gene Expression Studies by Surrogate Variable Analysis
Leek, J. T., & Storey, J. D. (2007) · PLoS Genetics · doi:10.1371/journal.pgen.0030161 · Cited by 1,930
Self-citationMicroarray data analysis: from disarray to consolidation and consensus
Allison, D. B., Cui, X., Page, G. P., & Sabripour, M. (2006) · Nature Reviews Genetics · doi:10.1038/nrg1749 · Cited by 1,339
Flagged first, then by citations
Cited by
Sorted by citations
Items 301–400 of 1,004
Human age reversal: Fact or fiction?
Johnson, A. A., English, B. W., Shokhirev, M. N., Sinclair, D. A., & Cuellar, T. L. (2022) · Aging Cell · doi:10.1111/acel.13664 · Cited by 85
Dillon, L. A. L., Okrah, K., Hughitt, V. K., Suresh, R., Li, Y., Fernandes, M. C., Belew, A. T., Bravo, H. C., Mosser, D. M., & El-Sayed, N. M. (2015) · Nucleic Acids Research · doi:10.1093/nar/gkv656 · Cited by 80
Self-citationGallo, V., Egger, M., McCormack, V., Farmer, P. B., Ioannidis, J. P. A., Kirsch‐Volders, M., Matullo, G., Phillips, D. H., Schoket, B., Strömberg, U., et al. (2011) · European Journal of Clinical Investigation · doi:10.1111/j.1365-2362.2011.02561.x · Cited by 79
Harper, K. N., Peters, B. A., & Gamble, M. V. (2013) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-13-0114 · Cited by 77
Learning from our GWAS mistakes: from experimental design to scientific method
Lambert, C. G., & Black, L. J. (2012) · Biostatistics · doi:10.1093/biostatistics/kxr055 · Cited by 79
Crowdsourced MRI quality metrics and expert quality annotations for training of humans and machines
Estéban, O., Blair, R. W., Nielson, D. M., Varada, J. C., Marrett, S., Thomas, A. G., Poldrack, R. A., & Gorgolewski, K. J. (2019) · Scientific Data · doi:10.1038/s41597-019-0035-4 · Cited by 86
Batch Effect Confounding Leads to Strong Bias in Performance Estimates Obtained by Cross-Validation
Soneson, C., Gerster, S., & Delorenzi, M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100335 · Cited by 84
Li, Q. S., Sun, Y., & Wang, T. (2020) · Clinical Epigenetics · doi:10.1186/s13148-020-00944-z · Cited by 84
Giacomini, E., Scotti, G. M., Vanni, V. S., Lazarević, D., Makieva, S., Privitera, L., Signorelli, S., Cantone, L., Bollati, V., Murdica, V., et al. (2021) · Human Reproduction · doi:10.1093/humrep/deab123 · Cited by 79
Binder, A. M., LaRocca, J. L., Lesseur, C., Marsit, C. J., & Michels, K. B. (2015) · Clinical Epigenetics · doi:10.1186/s13148-015-0116-y · Cited by 80
On the Accuracy of Influence Functions for Measuring Group EffectsPreprint
Koh, P. W., Ang, K.-S., Teo, H. H. K., & Liang, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13289 · Cited by 96
Adding function to the genome of African Salmonella Typhimurium ST313 strain D23580
Canals, R., Hammarlöf, D. L., Kröger, C., Owen, S. V., Fong, W. Y., Lacharme‐Lora, L., Zhu, X., Wenner, N., Carden, S., Honeycutt, J. D., et al. (2019) · PLoS Biology · doi:10.1371/journal.pbio.3000059 · Cited by 78
HIF3A Association with Adiposity: The Story Begins Before Birth
Pan, H., Lin, X., Wu, Y., Chen, L., Teh, A. L., Soh, S., Lee, Y. S., Tint, M. T., MacIsaac, J. L., Morin, A. M., et al. (2015) · Epigenomics · doi:10.2217/epi.15.45 · Cited by 76
Epigenomics and human adaptation to high altitude
Julian, C. G. (2017) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00351.2017 · Cited by 78
Laber, E. B., & Shedden, K. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1311265 · Cited by 76
Aghababazadeh, F. A., Li, Q., & Fridley, B. L. (2018) · PLoS ONE · doi:10.1371/journal.pone.0206312 · Cited by 83
Kinaret, P., Serra, A., Federico, A., Kohonen, P. J., Nymark, P. E. H., Liampa, I., Ha, M. K., Choi, J., Jagiełło, K., Sanabria, N. M., et al. (2020) · Nanomaterials · doi:10.3390/nano10040750 · Cited by 79
Enhancing precision in human neuroscience
Nebe, S., Reutter, M., Baker, D. H., Bölte, J., Domes, G., Gamer, M., Gärtner, A., Gießing, C., Gurr, C., Hilger, K., et al. (2023) · eLife · doi:10.7554/elife.85980 · Cited by 81
Monitoring of Technical Variation in Quantitative High-Throughput Datasets
Lauss, M., Visne, I., Kriegner, A., Ringnér, M., Jönsson, G., & Höglund, M. (2013) · Cancer Informatics · doi:10.4137/cin.s12862 · Cited by 74
illuminaio: An open source IDAT parsing tool for Illumina microarrays
Smith, M. L., Baggerly, K., Bengtsson, H. L., Ritchie, M. E., & Hansen, K. D. (2013) · F1000Research · doi:10.12688/f1000research.2-264.v1 · Cited by 72
Self-citationTranscriptomic Biomarkers of Cardiovascular Disease
Pedrotty, D. M., Morley, M. P., & Cappola, T. P. (2012) · Progress in Cardiovascular Diseases · doi:10.1016/j.pcad.2012.06.003 · Cited by 74
Impact of demographics on human gut microbial diversity in a US Midwest population
Chen, J., Ryu, E., Hathcock, M. A., Ballman, K. V., Chia, N., Olson, J. E., & Nelson, H. (2016) · PeerJ · doi:10.7717/peerj.1514 · Cited by 76
Automated in situ chromatin profiling efficiently resolves cell types and gene regulatory programs
Janssens, D. H., Wu, S. J., Sarthy, J. F., Meers, M. P., Myers, C. H., Olson, J. M., Ahmad, K., & Henikoff, S. (2018) · Epigenetics & Chromatin · doi:10.1186/s13072-018-0243-8 · Cited by 73
Fernandez-Ricaud, L., Kourtchenko, O., Zackrisson, M., Warringer, J., & Blomberg, A. (2016) · BMC Bioinformatics · doi:10.1186/s12859-016-1134-2 · Cited by 79
Immunological effects of shift work in healthcare workers
Loef, B., Nanlohy, N. M., Jacobi, R. H. J., van de Ven, C., Mariman, R., van der Beek, A. J., Proper, K. I., & van Baarle, D. (2019) · Scientific Reports · doi:10.1038/s41598-019-54816-5 · Cited by 75
The Gene Expression Barcode 3.0: improved data processing and mining tools
McCall, M. N., Jaffee, H. A., Zelisko, S., Sinha, N., Hooiveld, G. J. E. J., Irizarry, R. A., & Zilliox, M. J. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt1204 · Cited by 70
Self-citationNueda, M. J., Ferrer, A., & Conesa, A. (2012) · Biostatistics · doi:10.1093/biostatistics/kxr042 · Cited by 72
Genetic influences on brain gene expression in rats selected for tameness and aggression
Heyne, H. O., Lautenschläger, S., Nelson, R., Besnier, F., Rotival, M., Cagan, A., Kozhemyakina, R., Plyusnina, I. Z., Trut, L., Carlborg, Ö., et al. (2014) · Genetics · doi:10.1534/genetics.114.168948 · Cited by 72
A Monte Carlo-based framework for risk-return analysis in mineral prospectivity mapping
Wang, Z., Yin, Z., Caers, J., & Zuo, R. (2020) · Geoscience Frontiers · doi:10.1016/j.gsf.2020.02.010 · Cited by 72
Tayo, B. O., Teil, M., Tong, L., Qin, H., Khitrov, G., Zhang, W., Song, Q., Gottesman, O., Zhu, X., Pereira, A. C., et al. (2011) · PLoS ONE · doi:10.1371/journal.pone.0019166 · Cited by 70
Long-Term Performance and Stability of Molecular Shotgun Lipidomic Analysis of Human Plasma Samples
Heiskanen, L., Suoniemi, M., Ta, H. X., Tarassov, K., & Ekroos, K. (2013) · Analytical Chemistry · doi:10.1021/ac401857a · Cited by 72
Hu, Y., Yang, X., Lu, N., & Zhu, B. (2014) · Gut Microbes · doi:10.4161/gmic.27916 · Cited by 70
Accommodating site variation in neuroimaging data using normative and hierarchical Bayesian models
Bayer, J., Dinga, R., Kia, S. M., Kottaram, A., Wolfers, T., Lv, J., Zalesky, A., Schmaal, L., & Marquand, A. F. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119699 · Cited by 76
Brain aerobic glycolysis and resilience in Alzheimer disease
Goyal, M. S., Blazey, T., Metcalf, N. V., McAvoy, M. P., Strain, J. F., Rahmani, M., Durbin, T. J., Xiong, C., Benzinger, T. L. S., Morris, J. C., et al. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2212256120 · Cited by 75
Survival-Associated Metabolic Genes in Human Papillomavirus-Positive Head and Neck Cancers
Prusinkiewicz, M. A., Gameiro, S. F., Ghasemi, F., Dodge, M. J., Zeng, P. Y., Maekebay, H., Barrett, J. W., Nichols, A. C., & Mymryk, J. S. (2020) · Cancers · doi:10.3390/cancers12010253 · Cited by 70
Biomarkers in pharmacology and drug discovery
Anderson, D. C., & Kodukula, K. (2013) · Biochemical Pharmacology · doi:10.1016/j.bcp.2013.08.026 · Cited by 72
Vandenbon, A., Dinh, V. H., Mikami, N., Kitagawa, Y., Teraguchi, S., Ohkura, N., & Sakaguchi, S. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1604351113 · Cited by 69
Cao, K., Yang, K., Wang, C., Guo, J. C., Tao, L., Liu, Q., Mahara, G., Zhang, Y., & Guo, X. (2016) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph13050469 · Cited by 70
Thompson, E. E., Nicodemus‐Johnson, J., Kim, K. W., Gern, J. E., Jackson, D. J., Lemanske, R. F., & Ober, C. (2018) · Clinical Epigenetics · doi:10.1186/s13148-018-0491-2 · Cited by 72
Long, X., Hou, H., Wang, X., Liu, S., Diao, T., Lai, S., Hu, M., Zhang, S., Liu, M., & Zhang, H. (2020) · Cell Death and Disease · doi:10.1038/s41419-020-02973-1 · Cited by 69
Spatio-Temporal Metabolite Profiling of the Barley Germination Process by MALDI MS Imaging
Gorzolka, K., Kölling, J., Nattkemper, T. W., & Niehaus, K. (2016) · PLoS ONE · doi:10.1371/journal.pone.0150208 · Cited by 72
Using Big Data to Discover Diagnostics and Therapeutics for Gastrointestinal and Liver Diseases
Wooden, B., Goossens, N., Hoshida, Y., & Friedman, S. L. (2016) · Gastroenterology · doi:10.1053/j.gastro.2016.09.065 · Cited by 69
Transcriptome sequencing of the choroid plexus in schizophrenia
Kim, S., Hwang, Y., Lee, D., & Webster, M. J. (2016) · Translational Psychiatry · doi:10.1038/tp.2016.229 · Cited by 70
How Hosts Taxonomy, Trophy, and Endosymbionts Shape Microbiome Diversity in Beetles
Kolasa, M. R., Ścibior, R., Mazur, M. A., Kubisz, D., Dudek, K., & Kajtoch, Ł. (2019) · Microbial Ecology · doi:10.1007/s00248-019-01358-y · Cited by 68
shinyMethyl: interactive quality control of Illumina 450k DNA methylation arrays in R
Fortin, J., Fertig, E. J., & Hansen, K. D. (2014) · F1000Research · doi:10.12688/f1000research.4680.1 · Cited by 69
Multi-study inference of regulatory networks for more accurate models of gene regulation
Castro, D. M., Veaux, N. D., Miraldi, E. R., & Bonneau, R. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006591 · Cited by 67
Suprun, M., Getts, R. C., Raghunathan, R. R., Grishina, G. T., Witmer, M. V., Giménez, G., Sampson, H. A., & Suárez‐Fariñas, M. (2019) · Scientific Reports · doi:10.1038/s41598-019-54868-7 · Cited by 69
Genomics of coloration in natural animal populations
San‐Jose, L. M., & Roulin, A. (2017) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2016.0337 · Cited by 66
Moana: A robust and scalable cell type classification framework for single-cell RNA-Seq dataPreprint
Wagner, F., & Yanai, I. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/456129 · Cited by 73
Phillips, J. W., Pan, Y., Tsai, B. L., Xie, Z., Demirdjian, L., Xiao, W., Yang, H. T., Zhang, Y., Lin, C. H., Cheng, D., et al. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1915975117 · Cited by 65
An automated approach to prepare tissue-derived spatially barcoded RNA-sequencing libraries
Jemt, A., Salmén, F., Lundmark, A., Mollbrink, A., Navarro, J. F., Ståhl, P. L., Yucel‐Lindberg, T., & Lundeberg, J. (2016) · Scientific Reports · doi:10.1038/srep37137 · Cited by 67
Single-Cell Genomics: Approaches and Utility in Immunology
Neu, K. E., Tang, Q., Wilson, P. C., & Khan, A. A. (2017) · Trends in Immunology · doi:10.1016/j.it.2016.12.001 · Cited by 73
Data Science in Radiology: A Path Forward
Aerts, H. J. W. L. (2017) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-17-2804 · Cited by 70
Measuring growth rate in high-throughput growth phenotyping
Blomberg, A. (2010) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2010.10.013 · Cited by 65
Taminau, J., Lazar, C., Meganck, S., & Nowé, A. (2014) · ISRN Bioinformatics · doi:10.1155/2014/345106 · Cited by 66
Data Lakes, Clouds, and Commons: A Review of Platforms for Analyzing and Sharing Genomic Data
Grossman, R. L. (2019) · Trends in Genetics · doi:10.1016/j.tig.2018.12.006 · Cited by 66
Nguyen, L. N., Commault, A. S., Kahlke, T., Ralph, P. J., Semblante, G. U., Johir, M. A. H., & Nghiem, L. D. (2019) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2019.135279 · Cited by 66
Jones, B. M., Kingwell, C. J., Wcislo, W. T., & Robinson, G. E. (2017) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2016.2228 · Cited by 63
Identification of a novel gene pairs signature in the prognosis of gastric cancer
Peng, P., Zhou, X., Guo-Dong, Y. I., Chen, P., Wang, F., & Dong, W. (2017) · Cancer Medicine · doi:10.1002/cam4.1303 · Cited by 65
Li, Q. S., & Muynck, L. D. (2021) · Brain Behavior & Immunity - Health · doi:10.1016/j.bbih.2021.100227 · Cited by 60
High-Throughput Routes to Biomaterials Discovery
Soheilmoghaddam, M., Rumble, M., & Cooper-White, J. J. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.0c01026 · Cited by 68
Lou, R. N., & Therkildsen, N. O. (2021) · Molecular Ecology Resources · doi:10.1111/1755-0998.13559 · Cited by 72
Extracellular vesicles from lung tissue drive bone marrow neutrophil recruitment in inflammation
Liu, B., Jin, Y., Yang, J., Han, Y., Shan, H., Qiu, M., Zhao, X., Liu, A., Jin, Y., & Yin, Y. (2022) · Journal of Extracellular Vesicles · doi:10.1002/jev2.12223 · Cited by 66
Eleven quick tips for data cleaning and feature engineering
Chicco, D., Oneto, L., & Tavazzi, E. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010718 · Cited by 86
Large-scale non-targeted metabolomic profiling in three human population-based studies
Ganna, A., Fall, T., Salihović, S., Lee, W., Broeckling, C. D., Kumar, J., Hägg, S., Stenemo, M., Magnusson, P. K. E., Prenni, J. E., et al. (2015) · Metabolomics · doi:10.1007/s11306-015-0893-5 · Cited by 68
Mendoza, M. L. Z., Bohmann, K., Baez, A. C., & Gilbert, M. T. P. (2016) · BMC Research Notes · doi:10.1186/s13104-016-2064-9 · Cited by 66
BatchQC: interactive software for evaluating sample and batch effects in genomic data
Manimaran, S., Selby, H. M., Okrah, K., Ruberman, C., Leek, J. T., Quackenbush, J. F., Haibe‐Kains, B., Bravo, H. C., & Johnson, W. E. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw538 · Cited by 69
Self-citationA signature of 14 immune-related gene pairs predicts overall survival in gastric cancer
Zhao, E., Zhou, C., & Chen, S. (2020) · Clinical & Translational Oncology · doi:10.1007/s12094-020-02414-7 · Cited by 64
Development of Alzheimer’s Disease Biomarkers: From CSF- to Blood-Based Biomarkers
Mankhong, S., Kim, S., Lee, S., Kwak, H., Park, D., Joa, K., & Kang, J. (2022) · Biomedicines · doi:10.3390/biomedicines10040850 · Cited by 72
Lee, H., Burkhardt, B. R., McLeod, W., Smith, S. E., Eberhard, C., Lynch, K. F., Hadley, D., Rewers, M., Simell, O., She, J., et al. (2013) · Diabetes/Metabolism Research and Reviews · doi:10.1002/dmrr.2510 · Cited by 64
Clinical trials in the era of personalized oncology
Maitland, M. L., & Schilsky, R. L. (2011) · CA A Cancer Journal for Clinicians · doi:10.3322/caac.20135 · Cited by 65
Cell and tissue type independent age-associated DNA methylation changes are not rare but common
Zhu, T., Zheng, S., Paul, D. S., Horvath, S., & Teschendorff, A. E. (2018) · Aging · doi:10.18632/aging.101666 · Cited by 66
Zhou, T., Xie, X., Li, M., Shi, J., Zhou, J., Knox, K. S., Wang, T., Chen, Q., & Gu, W. (2018) · RNA · doi:10.1261/rna.067132.118 · Cited by 63
Flexible expressed region analysis for RNA-seq with derfinder
Collado‐Torres, L., Nellore, A., Frazee, A. C., Wilks, C., Love, M. I., Langmead, B., Irizarry, R. A., Leek, J. T., & Jaffe, A. E. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkw852 · Cited by 58
Self-citationAddressing cellular heterogeneity in tumor and circulation for refined prognostication
Lim, S. B., Yeo, T., Lee, W. D., Bhagat, A. A. S., Tan, S. J., Tan, D. S. W., Lim, W., & Lim, C. T. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1907904116 · Cited by 62
Ilan, Y. (2020) · Frontiers in Digital Health · doi:10.3389/fdgth.2020.569178 · Cited by 68
Evaluating the Utilities of Foundation Models in Single‐Cell Data Analysis
Liu, T., Li, K., Wang, Y., Li, H., & Zhao, H. (2026) · Advanced Science · doi:10.1002/advs.202514490 · Cited by 91
Jaffe, A. E., Hyde, T. M., Kleinman, J. E., Weinbergern, D. R., Chenoweth, J. G., McKay, R. D. G., Leek, J. T., & Colantuoni, C. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0808-5 · Cited by 60
Self-citationEvaluating the Utilities of Foundation Models in Single-cell Data Analysis
Liu, T., Li, K., Wang, Y., Li, H., & Zhao, H. (2023) · doi:10.1101/2023.09.08.555192 · Cited by 62
The 10,000 Immunomes Project: Building a Resource for Human Immunology
Zalocusky, K. A., Kan, M. J., Hu, Z., Dunn, P., Thomson, E., Wiser, J. A., Bhattacharya, S., & Butte, A. J. (2018) · Cell Reports · doi:10.1016/j.celrep.2018.09.021 · Cited by 61
Paradis, E. G., Pinilla, L. T., Holder, B. P., Abed, Y., Boivin, G., & Beauchemin, C. A. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0126115 · Cited by 61
Whitmore, S. S., Braun, T. A., Skeie, J. M., Haas, C. M., Sohn, E. H., Stone, E. M., Scheetz, T. E., & Mullins, R. F. (2013) · Europe PMC (PubMed Central) · Cited by 61
Host-Pathogen Transcriptomics by Dual RNA-Seq
Westermann, A. J., & Vogel, J. (2018) · Methods in molecular biology · doi:10.1007/978-1-4939-7634-8_4 · Cited by 61
Whole blood transcriptome analysis in amyotrophic lateral sclerosis: A biomarker study
van Rheenen, W., Diekstra, F. P., Harschnitz, O., Westeneng, H., van Eijk, K. R., Saris, C. G. J., Groen, E. J. N., van Es, M. A., Blauw, H. M., van Vught, P. W. J., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0198874 · Cited by 61
On Graphical Models via Univariate Exponential Family DistributionsPreprint
Yang, E., Ravikumar, P., Allen, G. I., & Liu, Z. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.4183 · Cited by 68
Liu, L., Xie, Y., Yang, H., Lin, A., Dong, M., Wang, H., Zhang, C., Liu, Z., Cheng, Q., Zhang, J., et al. (2023) · iMeta · doi:10.1002/imt2.130 · Cited by 62
Transcriptomic Insight Into the Polygenic Mechanisms Underlying Psychiatric Disorders
Hernandez, L. M., Kim, M., Hoftman, G. D., Haney, J. R., de la Torre-Ubieta, L., Paşaniuc, B., & Gandal, M. J. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.06.005 · Cited by 59
Context Specific and Differential Gene Co-expression Networks via Bayesian Biclustering
Gao, C., McDowell, I. C., Zhao, S., Brown, C. D., & Engelhardt, B. E. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004791 · Cited by 66
Lee, H. J., Georgiadou, A., Otto, T. D., Levin, M., Coin, L., Conway, D. J., & Cunnington, A. J. (2018) · Microbiology and Molecular Biology Reviews · doi:10.1128/mmbr.00071-17 · Cited by 61
Espín-Pérez, A., Krauskopf, J., Chadeau‐Hyam, M., van Veldhoven, K., Chung, K. F., Cullinan, P., Piepers, J. A. F., van Herwijnen, M. H. M., Kubesch, N. J., Carrasco‐Turigas, G., et al. (2018) · Environmental Pollution · doi:10.1016/j.envpol.2018.06.051 · Cited by 60
Phylogenomics and Plastome Evolution of the Chloridoid Grasses (Chloridoideae: Poaceae)
Duvall, M. R., Fisher, A. E., Columbus, J. T., Ingram, A. L., Wysocki, W. P., Burke, S. V., Clark, L. G., & Kelchner, S. A. (2016) · International Journal of Plant Sciences · doi:10.1086/684526 · Cited by 59
OSAT: a tool for sample-to-batch allocations in genomics experiments
Yan, L., Ma, C., Wang, D., Hu, Q., Qin, M., Conroy, J. M., Sucheston, L. E., Ambrosone, C. B., Johnson, C. S., Wang, J., et al. (2012) · BMC Genomics · doi:10.1186/1471-2164-13-689 · Cited by 59
Extensive rewiring of epithelial-stromal co-expression networks in breast cancer
Oh, E.-Y., Christensen, S. M., Ghanta, S., Jeong, J. C., Bucur, O., Glass, B., Montaser‐Kouhsari, L., Knoblauch, N., Bertos, N., Saleh, S. M. I., et al. (2015) · Genome biology · doi:10.1186/s13059-015-0675-4 · Cited by 60
Agreement in DNA methylation levels from the Illumina 450K array across batches, tissues, and time
Forest, M., O’Donnell, K. J., Voisin, G., Gaudreau, H., MacIsaac, J. L., McEwen, L. M., Silveira, P. P., Steiner, M. S., Kobor, M. S., Meaney, M. J., et al. (2018) · Epigenetics · doi:10.1080/15592294.2017.1411443 · Cited by 57
iMAP: integration of multiple single-cell datasets by adversarial paired transfer networks
Wang, D., Hou, S., Zhang, L., Wang, X., Liu, B., & Zhang, Z. (2021) · Genome biology · doi:10.1186/s13059-021-02280-8 · Cited by 58
Covariate Powered Cross-Weighted Multiple Testing
Ignatiadis, N., & Huber, W. K. (2021) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12411 · Cited by 75
Schizophrenia genomics: genetic complexity and functional insights
Sullivan, P. F., Yao, S., & Hjerling‐Leffler, J. (2024) · Nature reviews. Neuroscience · doi:10.1038/s41583-024-00837-7 · Cited by 64
Domain adaptation in small-scale and heterogeneous biological datasets
Orouji, S., Liu, M. C., Korem, T., & Peters, M. A. K. (2024) · Science Advances · doi:10.1126/sciadv.adp6040 · Cited by 61
Holtman, I. R., Noback, M. A., Bijlsma, M., Duong, K. N., van der Geest, M. A., Ketelaars, P. T., Brouwer, N., Vainchtein, I. D., Eggen, B. J. L., & Boddeke, H. W. G. M. (2015) · Glia · doi:10.1002/glia.22810 · Cited by 57
Metadata
- Authors
- Leek, J. T., Scharpf, R. B., Bravo, H. C., Simcha, D., Langmead, B., Johnson, W. E., Geman, D., Baggerly, K., & Irizarry, R. A.
- Affiliations
- Johns Hopkins University (US)
- Brigham Young University (US)
- The University of Texas MD Anderson Cancer Center (US)
- Corresponding author
- Irizarry, Rafael A.
- Venue
- Nature Reviews Genetics
- Published
- 2010-09-14
- Volume
- 11
- Issue
- 10
- Pages
- 733-739
- ISSN
- 1471-0056 (ISSN-L)
- 1471-0064
- PMC
- PMC3880143
- OpenAlex
- W2096192437
- Cited by
- 2,196
- References
- 30
- Citations by year
- 2026: 235 · 2025: 166 · 2024: 159 · 2023: 125 · 2022: 178 · 2021: 178 · 2020: 167 · 2019: 138 · 2018: 152 · 2017: 130 · 2016: 133 · 2015: 107 · 2014: 100 · 2013: 95 · 2012: 70
- FWCI
- 6.29
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Reviews Genetics (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Juvenile Diabetes Research Foundation International
- Wellcome Trust
- National Institute for Health and Care Research
- National Institutes of Health (5u41hg004059-15)
- Cambridge Institute for Medical Research, University of Cambridge (079895)
- NIHR Cambridge Biomedical Research Centre
- National Human Genome Research Institute (HG005220, U41-HG004059, HG004059, R00HG005015, R01HG005220, P41HG004059, U24HG004059)
- National Institute of General Medical Sciences (GM0083084, R01GM083084)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Keywords
- batch effects, high-throughput omics data, confounding, gene expression, protein expression, epigenetic modifications, laboratory conditions
- MeSH terms
- Biotechnology, Periodicals as Topic, Research Design, Sequence Analysis, DNA, Computational Biology, Oligonucleotide Array Sequence Analysis, Genomics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
