The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Deep learning-based clustering approaches for bioinformatics
Open accessAbstract
Clustering is central to many data-driven bioinformatics research and serves a powerful computational method. In particular, clustering helps at analyzing unstructured and high-dimensional data in the form of sequences, expressions, texts and images. Further, clustering is used to gain insights into biological processes in the genomics level, e.g. clustering of gene expressions provides insights on the natural structure inherent in the data, understanding gene functions, cellular processes, subtypes of cells and understanding gene regulations. Subsequently, clustering approaches, including hierarchical, centroid-based, distribution-based, density-based and self-organizing maps, have long been studied and used in classical machine learning settings. In contrast, deep learning (DL)-based representation and feature learning for clustering have not been reviewed and employed extensively. Since the quality of clustering is not only dependent on the distribution of data points but also on the learned representation, deep neural networks can be effective means to transform mappings from a high-dimensional data space into a lower-dimensional feature space, leading to improved clustering results. In this paper, we review state-of-the-art DL-based approaches for cluster analysis that are based on representation learning, which we hope to be useful, particularly for bioinformatics research. Further, we explore in detail the training procedures of DL-based clustering algorithms, point out different clustering quality metrics and evaluate several DL-based approaches on three bioinformatics use cases, including bioimaging, cancer genomics and biomedical text mining. We believe this review and the evaluation results will provide valuable insights and serve a starting point for researchers wanting to apply DL-based unsupervised methods to solve emerging bioinformatics research problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
(2014) · Cited by 33,419
(2008) · Journal of Machine Learning Research · Cited by 33,051
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Cluster analysis and display of genome-wide expression patterns
Eisen, M. B., Spellman, P. T., Brown, P. O., & Botstein, D. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.25.14863 · Cited by 16,184
The Hungarian method for the assignment problem
Kuhn, H. W. (1955) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800020109 · Cited by 13,120
Wold, S., Esbensen, K., & Geladi, P. (1987) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(87)80084-9 · Cited by 11,606
Sørlie, T., Perou, C. M., Tibshirani, R., Aas, T., Geisler, S., Johnsen, H., Hastie, T., Eisen, M. B., van de Rijn, M., Jeffrey, S. S., et al. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.191367098 · Cited by 10,938
The cancer genome atlas pan-cancer analysis project
The Cancer Genome Atlas Research Network, Weinstein, J. N., Collisson, E. A., Mills, G. B., Shaw, K. R. M., Ozenberger, B. A., Ellrott, K., Shmulevich, I., Sander, C., & Stuart, J. M. (2013) · Nature Genetics · doi:10.1038/ng.2764 · Cited by 9,092
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
Hubert, L., & Arabie, P. (1985) · Journal of Classification · doi:10.1007/bf01908075 · Cited by 8,219
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Objective Criteria for the Evaluation of Clustering Methods
Rand, W. M. (1971) · Journal of the American Statistical Association · doi:10.1080/01621459.1971.10482356 · Cited by 6,566
Estimating the Number of Clusters in a Data Set Via the Gap Statistic
Tibshirani, R., Walther, G., & Hastie, T. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00293 · Cited by 6,205
International Conference on Artificial Neural Networks
(1990) · Neural Networks · doi:10.1016/0893-6080(90)90065-s · Cited by 2,088
Kohonen, T. (1998) · Neurocomputing · doi:10.1016/s0925-2312(98)00030-7 · Cited by 1,968
Unsupervised Learning of Video Representations using LSTMs
Srivastava, N., Mansimov, E., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1502.04681 · Cited by 1,861
Vinh, N. X., Epps, J., & Bailey, J. (2010) · Minerva Access (University of Melbourne) · doi:10.5555/1756006.1953024 · Cited by 1,781
Kernel methods in machine learning
Hofmann, T., Schölkopf, B., & Smola, A. J. (2008) · The Annals of Statistics · doi:10.1214/009053607000000677 · Cited by 1,651
Data Clustering: Theory, Algorithms, and Applications
Gan, G., Ma, C., & Wu, J. (2007) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898718348 · Cited by 1,562
Unsupervised Data Augmentation for Consistency Training
Xie, Q., Dai, Z., Hovy, E., Luong, M.-T., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1904.12848 · Cited by 1,517
Deep learning in bioinformatics
Min, S., Lee, B., & Yoon, S. (2016) · Briefings in Bioinformatics · doi:10.1093/bib/bbw068 · Cited by 1,465
KERNEL METHODS IN MACHINE LEARNING
Hofmann, T., Schölkopf, B., & Smola, A. J. (2008) · Cited by 1,408
Principal component analysis for clustering gene expression data
Yeung, K. Y., & Ruzzo, W. L. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.9.763 · Cited by 1,268
Cluster analysis for gene expression data: a survey
Jiang, D., Tang, C., & Zhang, A. (2004) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2004.68 · Cited by 1,235
Natural Scales in Geographical Patterns
Menezes, T., & Roth, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.01036 · Cited by 1,120
A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder
Park, D., Hoshi, Y., & Kemp, C. C. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2801475 · Cited by 1,115
Single-cell RNA-seq denoising using a deep count autoencoder
Eraslan, G., Simon, L. M., Mircea, M., Mueller, N. S., & Theis, F. J. (2019) · Nature Communications · doi:10.1038/s41467-018-07931-2 · Cited by 1,084
Model-based clustering and data transformations for gene expression data
Yeung, K. Y., Fraley, C., Murua, A., Raftery, A. E., & Ruzzo, W. L. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.10.977 · Cited by 869
Partitioning Around Medoids (Program PAM)
(1990) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316801.ch2 · Cited by 718
BACH: Grand challenge on breast cancer histology images
Aresta, G., Araújo, T., Kwok, S., Chennamsetty, S. S., Safwan, M., Alex, V., Marami, B., Prastawa, M., Chan, M., Donovan, M., et al. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.05.010 · Cited by 703
Koehn, P., & Hoang, H. T. (2007) · The Association for Computational Linguistics · Cited by 673
Why so many clustering algorithms: a position paper
Estivill-Castro, V. (2002) · ACM SIGKDD Explorations Newsletter · doi:10.1145/568574.568575 · Cited by 600
Deep Clustering via Joint Convolutional Autoencoder Embedding and Relative Entropy Minimization
Dizaji, K. G., Herandi, A., Deng, C., Cai, W., & Huang, H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.612 · Cited by 579
2004 IEEE International Joint Conference on Neural Networks
(2004) · 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat No 04CH37541) IJCNN-04 · doi:10.1109/ijcnn.2004.1381025 · Cited by 574
A Survey of Clustering With Deep Learning: From the Perspective of Network Architecture
Min, E., Guo, X., Liu, Q., Zhang, G., Cui, J., & Long, J. (2018) · IEEE Access · doi:10.1109/access.2018.2855437 · Cited by 553
Deep Adaptive Image Clustering
Chang, J., Wang, L., Meng, G., Xiang, S., & Pan, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.626 · Cited by 535
Cruz-Roa, A., Gilmore, H., Basavanhally, A., Feldman, M., Ganesan, S., Shih, N. N. C., Tomaszewski, J., González, F. A., & Madabhushi, A. (2017) · Scientific Reports · doi:10.1038/srep46450 · Cited by 532
Deep Clustering with Convolutional Autoencoders
Guo, X., Liu, X., Zhu, E., & Yin, J. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70096-0_39 · Cited by 523
Clustering cancer gene expression data: a comparative study
de Souto, M. C., Costa, I. G., de Araujo, D. S., Ludermir, T. B., & Schliep, A. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-497 · Cited by 444
Self-citationBasal Breast Cancer: A Complex and Deadly Molecular Subtype
Bertucci, F., Finetti, P., & Birnbaum, D. (2012) · Current Molecular Medicine · doi:10.2174/156652412798376134 · Cited by 394
2014 22nd International Conference on Pattern Recognition
(2014) · doi:10.1109/icpr33632.2014 · Cited by 372
Evaluation and comparison of gene clustering methods in microarray analysis
Thalamuthu, A., Mukhopadhyay, I., Zheng, X., & Tseng, G. C. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl406 · Cited by 301
Discriminatively boosted image clustering with fully convolutional auto-encoders
Li, F., Qiao, H., & Zhang, B. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.05.019 · Cited by 272
Convolutional neural network models for cancer type prediction based on gene expression
Mostavi, M., Chiu, Y.-C., Huang, Y., & Chen, Y. (2020) · BMC Medical Genomics · doi:10.1186/s12920-020-0677-2 · Cited by 264
Learning a better representation of speech soundwaves using restricted boltzmann machines
Jaitly, N., & Hinton, G. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947700 · Cited by 231 · cited 2×
“NMMC and UMMC) DBN is employed as the feature extractor in which Restricted Boltzmann Machines (RBM) [60] formed the basic building block.”
MethodClustering Algorithms: Their Application to Gene Expression Data
Oyelade, J., Isewon, I., Oladipupo, F., Aromolaran, O., Uwoghiren, E., Ameh, F., Achas, M., & Adebiyi, E. (2016) · Bioinformatics and Biology Insights · doi:10.4137/bbi.s38316 · Cited by 220
TRICLUSTER: an effective algorithm for mining coherent clusters in 3D microarray data
Zhao, L., & Zaki, M. J. (2005) · Proceedings of the 2005 ACM SIGMOD international conference on Management of data · doi:10.1145/1066157.1066236 · Cited by 209
Aspect-Based Sentiment Analysis of Drug Reviews Applying Cross-Domain and Cross-Data Learning
Gräßer, F., Kallumadi, S. T., Malberg, H., et al. (2018) · International Conference on Digital Health · doi:10.1145/3194658.3194677 · Cited by 183
Shah, S. A., & Koltun, V. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1700770114 · Cited by 181
Clustering with Deep Learning: Taxonomy and New Methods
Aljalbout, E., Golkov, V., Siddiqui, Y., Strobel, M., & Cremers, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.07648 · Cited by 179
Proceedings of the 17 th International Conference on Pattern Recognition
(2004) · Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. · doi:10.1109/icpr.2004.1333675 · Cited by 178
Drug-Drug Interaction Prediction Based on Knowledge Graph Embeddings and Convolutional-LSTM Network
Karim, M. R., Cochez, M., Jares, J., Uddin, M., Beyan, O., & Decker, S. (2019) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3307339.3342161 · Cited by 167
Self-citationJaques, N., Taylor, S., Sano, A., & Picard, R. W. (2017) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2017.8273601 · Cited by 165
"The Right to Explanation, Explained"
Kaminski, M. E. (2019) · btlj · doi:10.15779/z38td9n83h · Cited by 146
Hsu, C., & Lin, C. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2745702 · Cited by 143
The Right to Explanation, Explained
Kaminski, M. (2018) · doi:10.31228/osf.io/rgeus · Cited by 104
Neural network-based clustering using pairwise constraintsPreprint
Hsu, Y.-C., & Kira, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06321 · Cited by 79
Jaskowiak, P. A., Campello, R. J. G. B., & Costa, I. G. (2013) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2013.9 · Cited by 61
Self-citationText Mining in Biomedical Domain with Emphasis on Document Clustering
Renganathan, V. (2017) · Healthcare Informatics Research · doi:10.4258/hir.2017.23.3.141 · Cited by 49
Variational Deep Embedding: A Generative Approach to Clustering.Preprint
Jiang, Z., Zheng, Y., Tan, H., Tang, B., & Zhou, H. (2016) · arXiv (Cornell University) · Cited by 36
Karim, M. R., Wicaksono, G., Costa, I. G., Decker, S., & Beyan, O. (2019) · IEEE Access · doi:10.1109/access.2019.2941796 · Cited by 34
Self-citationA snapshot neural ensemble method for cancer-type prediction based on copy number variations
Karim, M. R., Rahman, M. A., Jares, J., Decker, S., & Beyan, O. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04616-9 · Cited by 29
Self-citationOncoNetExplainer: Explainable Predictions of Cancer Types Based on Gene Expression Data
Karim, M. R., Cochez, M., Beyan, O., Decker, S., & Lange, C. (2019) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe.2019.00081 · Cited by 26
Self-citationClustering of RNA-Seq samples: Comparison study on cancer data
Jaskowiak, P. A., Costa, I. G., & Campello, R. J. G. B. (2017) · Methods · doi:10.1016/j.ymeth.2017.07.023 · Cited by 24
Self-citationChiu, C., Malhotra, R., Tan, S. M., Lim, J. M., Chan, A. W.-M., Teoh, K. H., Gan, S. T., & Saito, Y. (2016) · Gerodontology · doi:10.1111/ger.12218 · Cited by 16
Cited by
Artificial Intelligence in Pharmaceutical Technology and Drug Delivery Design
Vora, L. K., Gholap, A. D., Jetha, K., Thakur, R. R. S., Solanki, H. K., & Chavda, V. P. (2023) · Pharmaceutics · doi:10.3390/pharmaceutics15071916 · Cited by 1,061
Montemurro, A., Schuster, V., Povlsen, H. R., Bentzen, A. K., Jurtz, V., Chronister, W. D., Crinklaw, A., Hadrup, S. R., Winther, O., Peters, B., et al. (2021) · Communications Biology · doi:10.1038/s42003-021-02610-3 · Cited by 258
Biomedical data, computational methods and tools for evaluating disease–disease associations
Xiang, J., Zhang, J., Zhao, Y., Wu, F.-X., & Li, M. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac006 · Cited by 49
Metadata
- Authors
- Karim, M. R., Beyan, O., Zappa, A., Costa, I. G., Rebholz-Schuhmann, D., Cochez, M., & Decker, S.
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-02-01
- Volume
- 22
- Issue
- 1
- Pages
- 393-415
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W3003753408
- Cited by
- 297
- References
- 67
- FWCI
- 10.71
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.