BatchI: Batch effect Identification in high-throughput screening data using a dynamic programming algorithm
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Motivation: In contemporary biological experiments, bias, which interferes with the measurements, requires attentive processing. Important sources of bias in high-throughput biological experiments are batch effects and diverse methods towards removal of batch effects have been established. These include various normalization techniques, yet many require knowledge on the number of batches and assignment of samples to batches. Only few can deal with the problem of identification of batch effect of unknown structure. For this reason, an original batch identification algorithm through dynamical programming is introduced for omics data that may be sorted on a timescale. Results: BatchI algorithm is based on partitioning a series of high-throughput experiment samples into sub-series corresponding to estimated batches. The dynamic programming method is used for splitting data with maximal dispersion between batches, while maintaining minimal within batch dispersion. The procedure has been tested on a number of available datasets with and without prior information about batch partitioning. Datasets with a priori identified batches have been split accordingly, measured with weighted average Dice Index. Batch effect correction is justified by higher intra-group correlation. In the blank datasets, identified batch divisions lead to improvement of parameters and quality of biological information, shown by literature study and Information Content. The outcome of the algorithm serves as a starting point for correction methods. It has been demonstrated that omitting the essential step of batch effect control may lead to waste of valuable potential discoveries. Availability and implementation: The implementation is available within the BatchI R package at http://zaed.aei.polsl.pl/index.php/pl/111-software. Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The existence of systematic bias is well-known in the bioinformatics field, and often occurs in the high-throughput processing of microbiological specimens for testing (the so-called “batch effect”), due to small systematic differences in the machines or environmental conditions (Papiez et al., 2019).”
From Addressing Fairness, Bias, and Appropriate Use of Artificial Intelligence and Machine Learning in Global Health (2021) · cites this paper as Papiez et al., 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STAR: ultrafast universal RNA-seq aligner
Dobin, A., Davis, C. A., Schlesinger, F., Drenkow, J., Zaleski, C., Jha, S., Batut, P., Chaisson, M., & Gingeras, T. R. (2013) · Bioinformatics · doi:10.1093/bioinformatics/bts635 · Cited by 51,709
Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012
Ferlay, J., Soerjomataram, I., Dikshit, R., Eser, S., Mathers, C., Rebelo, M., Parkin, D. M., Forman, D., & Bray, F. (2015) · International Journal of Cancer · doi:10.1002/ijc.29210 · Cited by 28,766
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874
Exploration, normalization, and summaries of high density oligonucleotide array probe level data
Irizarry, R. A. (2003) · Biostatistics · doi:10.1093/biostatistics/4.2.249 · Cited by 10,603
Adjusting batch effects in microarray expression data using empirical Bayes methods
Johnson, W. E., Li, C., & Rabinovic, A. (2007) · Biostatistics · doi:10.1093/biostatistics/kxj037 · Cited by 8,658
Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer
Wang, Y., Klijn, J. G., Zhang, Y., Sieuwerts, A. M., Look, M. P., Yang, F., Talantov, D., Timmermans, M., Meijer-van Gelder, M. E., Yu, J., et al. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17947-1 · Cited by 2,846
Orthogonal projections to latent structures (O‐PLS)
Trygg, J., & Wold, S. (2002) · Journal of Chemometrics · doi:10.1002/cem.695 · Cited by 2,447
Tackling the widespread and critical impact of batch effects in high-throughput data
Leek, J. T., Scharpf, R. B., Bravo, H. C., Simcha, D., Langmead, B., Johnson, W. E., Geman, D., Baggerly, K., & Irizarry, R. A. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2825 · Cited by 2,196
Colorectal Cancer Epidemiology: Incidence, Mortality, Survival, and Risk Factors
Haggar, F., & Boushey, R. (2009) · Clinics in Colon and Rectal Surgery · doi:10.1055/s-0029-1242458 · Cited by 2,011
Singular value decomposition for genome-wide expression data processing and modeling
Alter, O., Brown, P. O., & Botstein, D. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.18.10101 · Cited by 1,971
Capturing Heterogeneity in Gene Expression Studies by Surrogate Variable Analysis
Leek, J. T., & Storey, J. D. (2007) · PLoS Genetics · doi:10.1371/journal.pgen.0030161 · Cited by 1,930
ArrayExpress update—simplifying data submissions
Kolesnikov, N., Hastings, E., Keays, M., Melnichuk, O., Tang, Y. A., Williams, E., Dylag, M., Kurbatova, N., Brandizi, M., Burdett, T., et al. (2015) · Nucleic Acids Research · doi:10.1093/nar/gku1057 · Cited by 698
Chen, C., Grennan, K., Badner, J., Zhang, D., Gershon, E., Jin, L., & Liu, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0017238 · Cited by 542
On the approximation of curves by line segments using dynamic programming
Bellman, R. (1961) · Communications of the ACM · doi:10.1145/366573.366611 · Cited by 444
Using control genes to correct for unwanted variation in microarray data
Gagnon-Bartsch, J. A., & Speed, T. P. (2012) · Biostatistics · doi:10.1093/biostatistics/kxr034 · Cited by 442 · cited 1×
“The case of gene expression data in microarray experiments enabled the creation of a family of RUV (Remove Unwanted Variation) methods, specifically for the purpose of handling these data, based on applying negative control genes for batch effect adjustment (Gagnon-Bartsch and Speed, 2012).”
MethodAdjustment of systematic microarray data biases
Benito, M., Parker, J., Du, Q., Wu, J., Xiang, D., Perou, C. M., & Marron, J. S. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg385 · Cited by 426
An algorithm for optimal partitioning of data on an interval
Jackson, B., Scargle, J. D., Barnes, D., Arabhi, S., Alt, A., Gioumousis, P., Gwin, E., San, P., Tan, L., & Tsai, T. T. (2005) · IEEE Signal Processing Letters · doi:10.1109/lsp.2001.838216 · Cited by 422
Molecular classification and prognostication of adrenocortical tumors by transcriptome profiling
Giordano, T. J., Kuick, R., Else, T., Gauger, P. G., Vinco, M., Bauersfeld, J., Sanders, D., Thomas, D. G., Doherty, G., & Hammer, G. (2009) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-08-1067 · Cited by 401
Statistical Design and Analysis of RNA Sequencing Data
Auer, P. L., & Doerge, R. W. (2010) · Genetics · doi:10.1534/genetics.110.114983 · Cited by 393
Kerkhofs, T. M. A., Verhoeven, R. H. A., Van der Zwan, J. M., Dieleman, J., Kerstens, M. N., Links, T. P., Van de Poll-Franse, L. V., & Haak, H. R. (2013) · European Journal of Cancer · doi:10.1016/j.ejca.2013.02.034 · Cited by 341
Luo, J., Schumacher, M., Scherer, A., Sanoudou, D., Megherbi, D., Davison, T., Shi, T., Tong, W., Shi, L., Hong, H., et al. (2010) · The Pharmacogenomics Journal · doi:10.1038/tpj.2010.57 · Cited by 331
Sims, A. H., Smethurst, G. J., Hey, Y., Okoniewski, M. J., Pepper, S. D., Howell, A., Miller, C. J., & Clarke, R. B. (2008) · BMC Medical Genomics · doi:10.1186/1755-8794-1-42 · Cited by 159
Reese, S. E., Archer, K. J., Therneau, T. M., Atkinson, E. J., Vachon, C. M., de Andrade, M., Kocher, J.-P. A., & Eckel-Passow, J. E. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt480 · Cited by 143
Galamb, O., Györffy, B., Sipos, F., Spisák, S., Németh, A. M., Miheller, P., Tulassay, Z., Dinya, E., & Molnár, B. (2008) · Disease Markers · doi:10.1155/2008/586721 · Cited by 120
Gene expression in cardiac tissues from infants with idiopathic conotruncal defects
Bittel, D. C., Butler, M. G., Kibiryeva, N., Marshall, J. A., Chen, J., Lofland, G. K., & O'Brien, J. E. (2011) · BMC Medical Genomics · doi:10.1186/1755-8794-4-1 · Cited by 117
Batch Effects and Noise in Microarray Experiments: Sources and Solutions
(2009) · Wiley series in probability and statistics · doi:10.1002/9780470685983 · Cited by 115
Batch effect correction for genome-wide methylation data with Illumina Infinium platform
Sun, Z., Chai, H. S., Wu, Y., White, W. M., Donkena, K. V., Klein, C. J., Garovic, V. D., Therneau, T. M., & Kocher, J.-P. A. (2011) · BMC Medical Genomics · doi:10.1186/1755-8794-4-84 · Cited by 108
Removing batch effects for prediction problems with frozen surrogate variable analysis
Parker, H. S., Bravo, H. C., & Leek, J. T. (2014) · PeerJ · doi:10.7717/peerj.561 · Cited by 94
Transcriptional profiling in facioscapulohumeral muscular dystrophy to identify candidate biomarkers
Rahimov, F., King, O. D., Leung, D. G., Bibat, G., Emerson, C. P., Kunkel, L. M., & Wagner, K. R. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1209508109 · Cited by 93
Orthogonal projections to latent structures as a strategy for microarray data normalization
Bylesjö, M., Eriksson, D., Sjödin, A., Jansson, S., Moritz, T., & Trygg, J. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-207 · Cited by 84
BatchQC: interactive software for evaluating sample and batch effects in genomic data
Manimaran, S., Selby, H. M., Okrah, K., Ruberman, C., Leek, J. T., Quackenbush, J., Haibe-Kains, B., Bravo, H. C., & Johnson, W. E. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw538 · Cited by 65
McDonnell, T. J., Chari, N. S., Cho‐Vega, J. H., Troncoso, P., Wang, X., Bueso-Ramos, C., Coombes, K. R., Brisbay, S. M., Lopez, R., Prendergast, G. C., et al. (2008) · BMC Medical Genomics · doi:10.1186/1755-8794-1-1 · Cited by 58
Signal Partitioning Algorithm for Highly Efficient Gaussian Mixture Modeling in Mass Spectrometry
Polański, A., Marczyk, M., Pietrowska, M., Widłak, P., & Polańska, J. (2015) · PLoS ONE · doi:10.1371/journal.pone.0134256 · Cited by 41
Self-citationDetecting hidden batch factors through data-adaptive adjustment for biological effects
Yi, H., Raman, A. T., Zhang, H., Allen, G. I., & Liu, Z. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx635 · Cited by 28
Widłak, P. (2011) · International Journal of Oncology · doi:10.3892/ijo.2011.1186 · Cited by 25
Expression profiling in peripheral blood reveals signature for penetrance in DYT1 dystonia
Walter, M., Bonin, M., Saunders-Pullman, R. J., Valente, E. M., Loi, M., Gambarin, M., Raymond, D., Tinazzi, M., Kamm, C., Glöckle, N., et al. (2010) · Neurobiology of Disease · doi:10.1016/j.nbd.2009.12.019 · Cited by 21
Cited by
Fletcher, R. R., Nakeshimana, A., & Olubeko, O. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.561802 · Cited by 305
“Examples of Bias in Machine Learning The existence of systematic bias is well-known in the bioinformatics field, and often occurs in the high-throughput processing of microbiological specimens for testing (the so-called “batch effect”), due to small systematic differences in the machines or environmental conditions (P…”
Sahu, M., Gupta, R., Ambasta, R. K., & Kumar, P. (2022) · Progress in Molecular Biology and Translational Science · doi:10.1016/bs.pmbts.2022.03.002 · Cited by 188
Translational precision medicine: an industry perspective
Hartl, D., Luca, V. D., Kostikova, A., Laramie, J. M., Kennedy, S., Ferrero, E., Siegel, R. W., Fink, M., Ahmed, S., Millholland, J. M., et al. (2021) · Journal of Translational Medicine · doi:10.1186/s12967-021-02910-6 · Cited by 186
Gawade, S. D., Bhansali, A., Patil, K., & Shaikh, D. (2023) · Healthcare Analytics · doi:10.1016/j.health.2023.100153 · Cited by 77
Are batch effects still relevant in the age of big data?
Goh, W. W. B., Yong, C. H., & Wong, L. (2022) · Trends in biotechnology · doi:10.1016/j.tibtech.2022.02.005 · Cited by 63
Metadata
- Authors
- Papiez, A., Marczyk, M., Polanska, J., & Polanski, A.
- Affiliations
- Institute of Automatic Control, Silesian University of Technology, Gliwice, Poland
- Institute of Informatics, Silesian University of Technology, Gliwice, Poland
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-10-24
- Volume
- 35
- Issue
- 11
- Pages
- 1885-1892
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- PMC
- PMC6546123
- OpenAlex
- W2905285619
- Cited by
- 26
- References
- 37
- Citations by year
- 2026: 4 · 2025: 1 · 2024: 3 · 2023: 2 · 2022: 5 · 2021: 4 · 2020: 5 · 2019: 1
- FWCI
- 0.89
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Bioinformatics (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- Silesian University of Technology (BK-200/RAU1/2018/8)
- National Science Center (2015/19/B/ST6/01736)
- Harmonia (DEC-2013/08/M/ST6/00924)
- OPUS (2016/21/B/ST6/02153)
- GeCONiI computational infrastructure (POIG.02.03.01-24-099/13)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Keywords
- batch effect correction, high-throughput screening data, omics data, dynamic programming, sample partitioning, data normalization
- MeSH terms
- Algorithms, Research Design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.