The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Removing Batch Effects in Analysis of Expression Microarray Data: An Evaluation of Six Batch Adjustment Methods
Open accessAbstract
The expression microarray is a frequently used approach to study gene expression on a genome-wide scale. However, the data produced by the thousands of microarray studies published annually are confounded by "batch effects," the systematic error introduced when samples are processed in multiple batches. Although batch effects can be reduced by careful experimental design, they cannot be eliminated unless the whole study is done in a single batch. A number of programs are now available to adjust microarray data for batch effects prior to analysis. We systematically evaluated six of these programs using multiple measures of precision, accuracy and overall performance. ComBat, an Empirical Bayes method, outperformed the other five programs by most metrics. We also showed that it is essential to standardize expression data at the probe level when testing for correlation of expression profiles, due to a sizeable probe effect in microarray data that can inflate the correlation among replicates and unrelated samples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Biometry: The Principles and Practice of Statistics in Biological Research
Sokal, R. R., & Rohlf, F. J. (1969) · Cited by 20,963
Gene Expression Omnibus: NCBI gene expression and hybridization array data repository
Edgar, R. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.1.207 · Cited by 13,288
Bioconductor: open software development for computational biology and bioinformatics
Gentleman, R. C., Carey, V. J., Bates, D. M., Bolstad, B., Dettling, M., Dudoit, S., Ellis, B., Gautier, L., Ge, Y., Gentry, J., et al. (2004) · Genome Biology · doi:10.1186/gb-2004-5-10-r80 · Cited by 12,172
Exploration, normalization, and summaries of high density oligonucleotide array probe level data
Irizarry, R. A. (2003) · Biostatistics · doi:10.1093/biostatistics/4.2.249 · Cited by 10,603
Quantitative Monitoring of Gene Expression Patterns with a Complementary DNA Microarray
Schena, M., Shalon, D., Davis, R. W., & Brown, P. O. (1995) · Science · doi:10.1126/science.270.5235.467 · Cited by 9,609
Biometry. The Principles and Practice of Statistics in Biological Research
Fienberg, S. E., Sokal, R. R., Rohlf, F. J., Rohlf, F. J., & Sokal, R. R. (1970) · Biometrics · doi:10.2307/2529087 · Cited by 9,364
Adjusting batch effects in microarray expression data using empirical Bayes methods
Johnson, W. E., Li, C., & Rabinovic, A. (2007) · Biostatistics · doi:10.1093/biostatistics/kxj037 · Cited by 8,658
Hanley, J. A., & McNeil, B. J. (1983) · Radiology · doi:10.1148/radiology.148.3.6878708 · Cited by 7,016
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903
Lamb, J., Crawford, E. D., Peck, D., Modell, J. W., Blat, I. C., Wrobel, M. J., Lerner, J., Brunet, J.-P., Subramanian, A., Ross, K. N., et al. (2006) · Science · doi:10.1126/science.1132939 · Cited by 5,257
Cited by
Genetic Drivers of Epigenetic and Transcriptional Variation in Human Immune Cells
Chen, L., Ge, B., Casale, F. P., Vasquez, L., Kwan, T., Garrido-Martín, D., Watt, S., Yan, Y., Kundu, K., Ecker, S., et al. (2016) · Cell · doi:10.1016/j.cell.2016.10.026 · Cited by 679
Castel, D., Philippe, C., Calmon, R., Le Dret, L., Truffaux, N., Boddaert, N., Pagès, M., Taylor, K. R., Saulnier, P., Lacroix, L., et al. (2015) · Acta Neuropathologica · doi:10.1007/s00401-015-1478-0 · Cited by 664
Assessment of Variability in the SOMAscan Assay
Candia, J., Cheung, F., Kotliarov, Y., Fantoni, G., Sellers, B., Griesman, T., Huang, J., Stuccio, S., Zingone, A., Ryan, B. M., et al. (2017) · Scientific Reports · doi:10.1038/s41598-017-14755-5 · Cited by 393
Nygaard, V., Rødland, E. A., & Hovig, E. (2016) · Biostatistics · doi:10.1093/biostatistics/kxv027 · Cited by 376
A Guide to ComBat Harmonization of Imaging Biomarkers in Multicenter Studies
Orlhac, F., Eertink, J. J., Cottereau, A.-S., Zijlstra, J. M., Thieblemont, C., Meignan, M., Boellaard, R., & Buvat, I. (2022) · Journal of Nuclear Medicine · doi:10.2967/jnumed.121.262464 · Cited by 348
Batch effect removal methods for microarray gene expression data integration: a survey
Lazar, C., Meganck, S., Taminau, J., Steenhoff, D., Coletta, A., Molter, C., Weiss-Solis, D. Y., Duque, R., Bersini, H., & Nowe, A. (2013) · Briefings in Bioinformatics · doi:10.1093/bib/bbs037 · Cited by 333
“As a consequence, batch effects are ‘almost inevitable’, but there are only few researchers who address this problem in their analysis flow (see [16] for some concluding figures on the number of articles published from 1 January 2010 to 1 July 2010, which addressed this problem).”
BackgroundInfluentialLi, L., Ning, Z., Zhang, X., Mayne, J., Cheng, K., Stintzi, A., & Figeys, D. (2020) · Microbiome · doi:10.1186/s40168-020-00806-z · Cited by 328
“” Then, LFQ protein group intensities were processed by a ComBat process [58, 59] using iMetalab.”
MethodRNA-Seq identifies novel myocardial gene expression signatures of heart failure
Liu, Y., Morley, M., Brandimarto, J., Hannenhalli, S., Hu, Y., Ashley, E. A., Tang, W. H. W., Moravec, C. S., Margulies, K. B., Cappola, T. P., et al. (2015) · Genomics · doi:10.1016/j.ygeno.2014.12.002 · Cited by 314
Xu, M., Zhang, D., Luo, R., Wu, Y., Zhou, H., Kong, L., Bi, R., & Yao, Y. (2018) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2017.08.012 · Cited by 296
Self-citationTan, T. Z., Miow, Q. H., Huang, R. Y., Wong, M. K., Ye, J., Lau, J. A., Wu, M. C., Bin Abdul Hadi, L. H., Soong, R., Choolani, M., et al. (2013) · EMBO Molecular Medicine · doi:10.1002/emmm.201201823 · Cited by 281
Xu, H., Ding, J., Porter, C. B. M., Wallrapp, A., Tabaka, M., Ma, S., Fu, S., Guo, X., Riesenfeld, S. J., Su, C., et al. (2019) · Immunity · doi:10.1016/j.immuni.2019.09.004 · Cited by 273
Woetzel, D., Huber, R., Kupfer, P., Pohlers, D., Pfaff, M., Driesch, D., Häupl, T., Koczan, D., Stiehl, P., Guthke, R., et al. (2014) · Arthritis Research & Therapy · doi:10.1186/ar4526 · Cited by 276
Suárez-Fariñas, M., Ungar, B., Noda, S., Shroff, A., Mansouri, Y., Fuentes-Duculan, J., Czernik, A., Zheng, X., Estrada, Y. D., Xu, H., et al. (2015) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2015.06.032 · Cited by 262
Sørensen, K. P., Thomassen, M., Tan, Q., Bak, M., Cold, S., Burton, M., Larsen, M. J., & Kruse, T. A. (2013) · Breast Cancer Research and Treatment · doi:10.1007/s10549-013-2776-7 · Cited by 260
Pathology imaging informatics for quantitative analysis of whole-slide images
Kothari, S., Phan, J. H., Stokes, T. H., & Wang, M. D. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001540 · Cited by 257
Brunner, P. M., Israel, A., Zhang, N., Leonard, A., Wen, H.-C., Huynh, T., Tran, G., Lyon, S., Rodriguez, G., Immaneni, S., et al. (2018) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2018.02.040 · Cited by 256
Two gene co-expression modules differentiate psychotics and controls
Chen, C., Cheng, L., Grennan, K., Pibiri, F., Zhang, C., Badner, J. A., Members of the Bipolar Disorder Genome Study (BiGS) Consortium, Gershon, E. S., & Liu, C. (2013) · Molecular Psychiatry · doi:10.1038/mp.2012.146 · Cited by 157
Self-citationBatch effect correction for genome-wide methylation data with Illumina Infinium platform
Sun, Z., Chai, H. S., Wu, Y., White, W. M., Donkena, K. V., Klein, C. J., Garovic, V. D., Therneau, T. M., & Kocher, J.-P. A. (2011) · BMC Medical Genomics · doi:10.1186/1755-8794-4-84 · Cited by 108
Chen, C., Zhang, C., Cheng, L., Reilly, J. L., Bishop, J. R., Sweeney, J. A., Chen, H., Gershon, E. S., & Liu, C. (2014) · Bipolar Disorders · doi:10.1111/bdi.12255 · Cited by 105
Self-citationBose, M., Wu, C., Pankow, J. S., Demerath, E. W., Bressler, J., Fornage, M., Grove, M. L., Mosley, T. H., Hicks, C., North, K., et al. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-312 · Cited by 86
“Although many statistical methods have been proposed to correct for batch effects [12-17], no approach has been generally accepted.”
Batch Effect Confounding Leads to Strong Bias in Performance Estimates Obtained by Cross-Validation
Soneson, C., Gerster, S., & Delorenzi, M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100335 · Cited by 84
Xia, Y., Dai, R., Wang, K., Jiao, C., Zhang, C., Xu, Y., Li, H., Jing, X., Chen, Y., Jiang, Y., et al. (2021) · Molecular Psychiatry · doi:10.1038/s41380-019-0416-2 · Cited by 80
Self-citationMonitoring of Technical Variation in Quantitative High-Throughput Datasets
Lauss, M., Visne, I., Kriegner, A., Ringnér, M., Jönsson, G., & Höglund, M. (2013) · Cancer Informatics · doi:10.4137/cin.s12862 · Cited by 74
“11,12 It is worth noting that batch correction changes the data substantially and may be incomplete or may introduce new bias to the data.”
BackgroundZhou, J., Li, M., Wang, X., He, Y., Xia, Y., Sweeney, J. A., Kopp, R. F., Liu, C., & Chen, C. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.674273 · Cited by 56
Self-citationPapiez, A., Marczyk, M., Polanska, J., & Polanski, A. (2019) · Bioinformatics · doi:10.1093/bioinformatics/bty900 · Cited by 26
Liu, M., Luo, M., Sun, H., Ni, B., & Shao, Y. (2017) · The Tohoku Journal of Experimental Medicine · doi:10.1620/tjem.243.263 · Cited by 20
“Because three batches existed among these two datasets, the R language package ComBat (Kupfer et al. 2012) was used to adjust for batch effects (Chen et al. 2011).”
MethodPan-cancer analysis of systematic batch effects on somatic sequence variations
Choi, J.-H., Hong, S.-E., & Woo, H. G. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1627-7 · Cited by 14
Unleashing the potential of cell painting assays for compound activities and hazards prediction
Odje, F., Meijer, D., von Coburg, E., van der Hooft, J. J. J., Dunst, S., Medema, M. H., & Volkamer, A. (2024) · Frontiers in Toxicology · doi:10.3389/ftox.2024.1401036 · Cited by 11
“One can leverage noise mitigation tools developed for similar data types, such as microarray data (Chen et al., 2011).”
MethodMulti-cohort machine learning identifies predictors of cognitive impairment in Parkinson’s disease
Loo, R. T. J., Pavelka, L., Mangone, G., Khoury, F., Vidailhet, M., Corvol, J.-C., Glaab, E., On behalf of the NCER-PD Consortium, Acharya, G., Aguayo, G., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01862-1 · Cited by 9
“…included variable aggregation (Supplementary Table 15), missing value imputation for baseline features 60,61 , cross-study normalization (mean centering 62 , standardization, quantile normalization 63,64 , ComBat 65,66 , Ratio-A 67 , and M-ComBat 68 ), undersampling 69 , and feature selection 70 .”
Metadata
- Authors
- Chen, C., Grennan, K., Badner, J., Zhang, D., Gershon, E., Jin, L., & Liu, C.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-02-28
- Volume
- 6
- Issue
- 2
- Pages
- e17238
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W1986849266
- Cited by
- 542
- References
- 36
- FWCI
- 10.46
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.