The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
A systematic comparison and evaluation of biclustering methods for gene expression data
Open accessAbstract
Motivation: In recent years, there have been various efforts to overcome the limitations of standard clustering approaches for the analysis of gene expression data by grouping genes and samples simultaneously. The underlying concept, which is often referred to as biclustering, allows to identify sets of genes sharing compatible expression patterns across subsets of samples, and its usefulness has been demonstrated for different organisms and datasets. Several biclustering methods have been proposed in the literature; however, it is not clear how the different techniques compare with each other with respect to the biological relevance of the clusters as well as with other characteristics such as robustness and sensitivity to noise. Accordingly, no guidelines concerning the choice of the biclustering method are currently available. Results: First, this paper provides a methodology for comparing and validating biclustering methods that includes a simple binary reference model. Although this model captures the essential features of most biclustering approaches, it is still simple enough to exactly determine all optimal groupings; to this end, we propose a fast divide-and-conquer algorithm (Bimax). Second, we evaluate the performance of five salient biclustering algorithms together with the reference model and a hierarchical clustering method on various synthetic and real datasets for Saccharomyces cerevisiae and Arabidopsis thaliana. The comparison reveals that (1) biclustering in general has advantages over a conventional hierarchical clustering approach, (2) there are considerable performance differences between the tested methods and (3) already the simple reference model delivers relevant patterns within all considered settings. Availability: The datasets used, the outcomes of the biclustering algorithms and the Bimax implementation for the reference model are available at Contact: bleuler@tik.ee.ethz.ch Supplementary information: Supplementary data are available at
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gene Ontology: tool for the unification of biology
Ashburner, M., Ball, C. A., Blake, J. A., Botstein, D., Butler, H., Cherry, J. M., Davis, A. P., Dolinski, K., Dwight, S. S., Eppig, J. T., et al. (2000) · Nature Genetics · doi:10.1038/75556 · Cited by 43,206
Algorithm AS 136: A K-Means Clustering Algorithm
Hartigan, J. A., & Wong, M. A. (1979) · Applied Statistics · doi:10.2307/2346830 · Cited by 14,523
Pattern Recognition with Fuzzy Objective Function Algorithms
Bezdek, J. C. (1981) · doi:10.1007/978-1-4757-0450-1 · Cited by 9,881
(1975) · CERN Document Server (European Organization for Nuclear Research) · Cited by 5,958
Genomic Expression Programs in the Response of Yeast Cells to Environmental Changes
Gasch, A. P., Spellman, P. T., Kao, C. M., Carmel-Harel, O., Eisen, M. B., Storz, G., Botstein, D., & Brown, P. O. (2000) · Molecular Biology of the Cell · doi:10.1091/mbc.11.12.4241 · Cited by 4,815
A Statistical Method for Evaluating Systematic Relationships
Sokal, R. R., & Michener, C. D. (1958) · Biodiversity Heritage Library (Smithsonian Institution) · doi:10.5281/zenodo.16435756 · Cited by 4,416
On Clustering Validation Techniques
Halkidi, M., Batistakis, Y., & Vazirgiannis, M. (2001) · Journal of Intelligent Information Systems · doi:10.1023/a:1012801612483 · Cited by 2,646
The Database of Interacting Proteins: 2004 update
Salwinski, L. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh086 · Cited by 2,271
Biclustering of expression data.
Cheng, Y., & Church, G. M. (2000) · PubMed · Cited by 2,098
Biclustering algorithms for biological data analysis: a survey
Madeira, S. C., & Oliveira, A. L. (2004) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2004.2 · Cited by 2,049
Xenarios, I. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.1.303 · Cited by 1,741
Discovering regulatory and signalling circuits in molecular interaction networks
Ideker, T., Ozier, O., Schwikowski, B., & Siegel, A. F. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.suppl_1.s233 · Cited by 1,197
Direct Clustering of a Data Matrix
Hartigan, J. A. (1972) · Journal of the American Statistical Association · doi:10.1080/01621459.1972.10481214 · Cited by 1,165
Resampling-Based Multiple Testing.
Booth, J. G., Westfall, P. H., & Young, S. S. (1994) · Journal of the American Statistical Association · doi:10.2307/2291234 · Cited by 906
Computational cluster validation in post-genomic data analysis
Handl, J., Knowles, J., & Kell, D. B. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti517 · Cited by 898
Discovering statistically significant biclusters in gene expression data
Tanay, A., Sharan, R., & Shamir, R. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.suppl_1.s136 · Cited by 855
Coupled two-way clustering analysis of gene microarray data
Getz, G., Levine, E., & Domany, E. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.210134797 · Cited by 813
Spectral Biclustering of Microarray Data: Coclustering Genes and Conditions
Kluger, Y., Basri, R., Chang, J. T., & Gerstein, M. (2003) · Genome Research · doi:10.1101/gr.648603 · Cited by 726
Validating clustering for gene expression data
Yeung, K. Y., Haynor, D. R., & Ruzzo, W. L. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.4.309 · Cited by 711
Revealing modular organization in the yeast transcriptional network
Ihmels, J., Friedlander, G., Bergmann, S., Sarig, O., Ziv, Y., & Barkai, N. (2002) · Nature Genetics · doi:10.1038/ng941 · Cited by 690
Discovering Local Structure in Gene Expression Data: The Order-Preserving Submatrix Problem
Ben-Dor, A., Chor, B., Karp, R., & Yakhini, Z. (2003) · Journal of Computational Biology · doi:10.1089/10665270360688075 · Cited by 540
Bootstrapping cluster analysis: Assessing the reliability of conclusions from microarray experiments
Kerr, M. K., & Churchill, G. A. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.161273698 · Cited by 474
Characterizing gene sets with FuncAssociate
Berriz, G. F., King, O. D., Bryant, B., Sander, C., & Roth, F. P. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg363 · Cited by 473
Iterative signature algorithm for the analysis of large-scale gene expression data
Bergmann, S., Ihmels, J., & Barkai, N. (2003) · Physical Review E · doi:10.1103/physreve.67.031902 · Cited by 419
Comparisons and validation of statistical clustering techniques for microarray gene expression data
Datta, S., & Datta, S. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg025 · Cited by 401
CLICK: a clustering algorithm with applications to gene expression analysis.
Sharan, R., & Ron Shamir, A. (2000) · PubMed · Cited by 395
Tanay, A., Sharan, R., Kupiec, M., & Shamir, R. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0308661100 · Cited by 381
Sparse graphical Gaussian modeling of the isoprenoid gene network in Arabidopsis thaliana
Wille, A., Zimmermann, P., Vranová, E., Fürholz, A., Laule, O., Bleuler, S., Hennig, L., Prelić, A., von Rohr, P., Thiele, L., et al. (2004) · Genome Biology · doi:10.1186/gb-2004-5-11-r92 · Cited by 380
Self-citationEXTRACTING CONSERVED GENE EXPRESSION MOTIFS FROM GENE EXPRESSION DATA
MURALI, T. M., & KASIF, S. (2002) · Biocomputing 2003 · doi:10.1142/9789812776303_0008 · Cited by 379
CLICK and EXPANDER: a system for clustering and visualizing gene expression data
Sharan, R., Maron-Katz, A., & Shamir, R. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg232 · Cited by 370
Defining transcription modules using large-scale gene expression data
Ihmels, J., Bergmann, S., & Barkai, N. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth166 · Cited by 338
δ-clusters: capturing subspace correlation in a large data set
Yang, J., Wang, W., Wang, H., & Yu, P. (2003) · Proceedings 18th International Conference on Data Engineering · doi:10.1109/icde.2002.994771 · Cited by 300
Enhanced biclustering on expression data
Yang, J., Wang, H., Wang, W., & Yu, P. (2003) · Third IEEE Symposium on Bioinformatics and Bioengineering, 2003. Proceedings. · doi:10.1109/bibe.2003.1188969 · Cited by 299
Discovering local structure in gene expression data: the order-preserving submatrix problem
Ben-Dor, A., Chor, B., Karp, R., & Yakhini, Z. (2002) · Proceedings of the sixth annual international conference on Computational biology · doi:10.1145/565196.565203 · Cited by 200
OP-cluster: clustering by tendency in high dimensional space
Liu, J., & Wang, W. (2004) · Third IEEE International Conference on Data Mining · doi:10.1109/icdm.2003.1250919 · Cited by 199
Consensus algorithms for the generation of all maximal bicliques
Alexe, G., Alexe, S., Crama, Y., Foldes, S., Hammer, P. L., & Simeone, B. (2004) · Discrete Applied Mathematics · doi:10.1016/j.dam.2003.09.004 · Cited by 190
Analysis of gene expression data with pathway scores.
Zien, A., Küffner, R., Zimmer, R., & Lengauer, T. (2000) · PubMed · Cited by 121
A cluster validity framework for genome expression data
Azuaje, F. J. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.2.319 · Cited by 99
Scoring clustering solutions by their biological relevance
Gat‐Viks, I., Sharan, R., & Ron Shamir, A. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg330 · Cited by 83
Coupled two-way clustering analysis of breast cancer and colon cancer gene expression data
Getz, G. A., Gal, H., Kela, I., Notterman, D. A., & Domany, E. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btf876 · Cited by 81
A statistical framework for combining and interpreting proteomic datasets
Gilchrist, M. A., Kubatko, L. S., & Wagner, A. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg469 · Cited by 62
Cited by
Tumour evolution inferred by single-cell sequencing
Navin, N., Kendall, J., Troge, J., Andrews, P., Rodgers, L., McIndoo, J., Cook, K., Stepansky, A., Levy, D., Esposito, D., et al. (2011) · Nature · doi:10.1038/nature09807 · Cited by 2,598
Genevestigator V3: A Reference Expression Database for the Meta‐Analysis of Transcriptomes
Hruz, T., Laule, O., Szabo, G., Wessendorp, F., Bleuler, S., Oertle, L., Widmayer, P., Gruissem, W., & Zimmermann, P. (2008) · Advances in Bioinformatics · doi:10.1155/2008/420747 · Cited by 1,910
Self-citationKriegel, H.-P., Kröger, P., & Zimek, A. (2009) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/1497577.1497578 · Cited by 1,093
Network‐based prediction of protein function
Sharan, R., Ulitsky, I., & Shamir, R. (2007) · Molecular Systems Biology · doi:10.1038/msb4100129 · Cited by 1,074
CSI: A Hybrid Deep Model for Fake News Detection
Ruchansky, N., Seo, S., & Liu, Y. (2017) · Proceedings of the 2017 ACM on Conference on Information and Knowledge Management · doi:10.1145/3132847.3132877 · Cited by 1,039
Metadata
- Authors
- Prelić, A., Bleuler, S., Zimmermann, P., Wille, A., Bühlmann, P., Gruissem, W., Hennig, L., Thiele, L., & Zitzler, E.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-02-24
- Volume
- 22
- Issue
- 9
- Pages
- 1122-1129
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2105883975
- Cited by
- 910
- References
- 41
- FWCI
- 18.30
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.