Clustering and variable selection evaluation of 13 unsupervised methods for multi-omics data integration
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Recent advances in NGS sequencing, microarrays and mass spectrometry for omics data production have enabled the generation and collection of different modalities of high-dimensional molecular data. The integration of multiple omics datasets is a statistical challenge, due to the limited number of individuals, the high number of variables and the heterogeneity of the datasets to integrate. Recently, a lot of tools have been developed to solve the problem of integrating omics data including canonical correlation analysis, matrix factorization and SM. These commonly used techniques aim to analyze simultaneously two or more types of omics. In this article, we compare a panel of 13 unsupervised methods based on these different approaches to integrate various types of multi-omics datasets: iClusterPlus, regularized generalized canonical correlation analysis, sparse generalized canonical correlation analysis, multiple co-inertia analysis (MCIA), integrative-NMF (intNMF), SNF, MoCluster, mixKernel, CIMLR, LRAcluster, ConsensusClustering, PINSPlus and multi-omics factor analysis (MOFA). We evaluate the ability of the methods to recover the subgroups and the variables that drive the clustering on eight benchmarks of simulation. MOFA does not provide any results on these benchmarks. For clustering, SNF, MoCluster, CIMLR, LRAcluster, ConsensusClustering and intNMF provide the best results. For variable selection, MoCluster outperforms the others. However, the performance of the methods seems to depend on the heterogeneity of the datasets (especially for MCIA, intNMF and iClusterPlus). Finally, we apply the methods on three real studies with heterogeneous data and various phenotypes. We conclude that MoCluster is the best method to analyze these omics data. Availability: An R package named CrIMMix is available on GitHub at https://github.com/CNRGH/crimmix to reproduce all the results of this article.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The cancer genome atlas pan-cancer analysis project
The Cancer Genome Atlas Research Network, Weinstein, J. N., Collisson, E. A., Mills, G. B., Shaw, K. R. M., Ozenberger, B. A., Ellrott, K., Shmulevich, I., Sander, C., & Stuart, J. M. (2013) · Nature Genetics · doi:10.1038/ng.2764 · Cited by 9,092 · cited 3×
“In addition, we selected a dataset from TCGA with CNV, mutation, DNA methylation, RNA datasets from liver tumors, and we tried to discriminate the stages (I to IV) of disease.”
BackgroundGenomic analyses identify molecular subtypes of pancreatic cancer
Bailey, P., Chang, D. K., Nones, K., Johns, A. L., Patch, A.-M., Gingras, M.-C., Miller, D. K., Christ, A. N., Bruxner, T. J. C., Quinn, M. C., et al. (2016) · Nature · doi:10.1038/nature16965 · Cited by 3,621 · cited 1×
“For instance, it has been used in cancer subtype discovery from gene expression data [19, 41].”
MethodNbClust : An R Package for Determining the Relevant Number of Clusters in a Data Set
Charrad, M., Ghazzali, N., Boiteau, V., & Niknafs, A. (2014) · Journal of Statistical Software · doi:10.18637/jss.v061.i06 · Cited by 3,396
Multi-omics approaches to disease
Hasin, Y., Seldin, M., & Lusis, A. (2017) · Genome Biology · doi:10.1186/s13059-017-1215-1 · Cited by 2,953
Monti, S., Tamayo, P., Mesirov, J., & Golub, T. (2003) · Machine Learning · doi:10.1023/a:1023949509487 · Cited by 2,116 · cited 2×
“The selected unsupervised methods include regularized and sparse generalized canonical correlation analysis [27, 28], integrative non-negative matrix factorization [29], multiple co-inertia analysis [30], similarity network fusion [18], two multiple kernel learning methods [31, 32], multi-omics factor analysis (MOFA)…”
MethodSimilarity network fusion for aggregating data types on a genomic scale
Wang, B., Mezlini, A. M., Demir, F., Fiume, M., Tu, Z., Brudno, M., Haibe-Kains, B., & Goldenberg, A. (2014) · Nature Methods · doi:10.1038/nmeth.2810 · Cited by 2,036
Methods of integrating data to uncover genotype-phenotype interactions
Ritchie, M. D., Holzinger, E. R., Li, R., Pendergrass, S. A., & Kim, D. (2015) · Nature Reviews Genetics · doi:10.1038/nrg3868 · Cited by 1,085
Pattern discovery and cancer gene identification in integrated cancer genomic data
Mo, Q., Wang, S., Seshan, V. E., Olshen, A. B., Schultz, N., Sander, C., Powers, R. S., Ladanyi, M., & Shen, R. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1208949110 · Cited by 474 · cited 3×
“In the second article [26], the authors compared iCluster [38], MoCluster [39], JIVE [56], multiple dataset integration [58], integrative NMF from [59] and Bayesian consensus clustering [60].”
BackgroundMethodSun, Y. V., & Hu, Y.-J. (2016) · Advances in Genetics · doi:10.1016/bs.adgen.2015.11.004 · Cited by 459
Methods for the integration of multi-omics data: mathematical aspects
Bersanelli, M., Mosca, E., Remondini, D., Giampieri, E., Sala, C., Castellani, G., & Milanesi, L. (2016) · BMC Bioinformatics · doi:10.1186/s12859-015-0857-9 · Cited by 449
Cited by
Integration strategies of multi-omics data for machine learning analysis
Picard, M., Scott-Boyer, M.-P., Bodein, A., Périn, O., & Droit, A. (2021) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2021.06.030 · Cited by 696
Applications of multi‐omics analysis in human diseases
Chen, C., Wang, J., Pan, D., Wang, X., Xu, Y., Yan, J., Wang, L., Yang, X., Yang, M., & Liu, G. (2023) · MedComm · doi:10.1002/mco2.315 · Cited by 545
Evaluation and comparison of multi-omics data integration methods for cancer subtyping
Duan, R., Gao, L., Gao, Y., Hu, Y., Xu, H., Huang, M., Song, K., Wang, H., Dong, Y., Jiang, C., et al. (2021) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1009224 · Cited by 122
“To the best of our knowledge, only two studies [34,35] considered the second problem on the significance of the selection and combination of the data types.”
BackgroundPIntMF: Penalized Integrative Matrix Factorization method for multi-omics data
Pierre-Jean, M., Mauger, F., Deleuze, J.-F., & Le Floch, E. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btab786 · Cited by 20
“, 2016) under two different diets already used in two previous comparison articles (Pierre-Jean et al., 2020; Tini et al., 2019), and the objective is to recover the diets of the mice (fat diet or chow diet). The second one is a glioblastoma dataset from TCGA used by Shen et al. (2012) and the goal is to find the tumo…”
BackgroundSelf-citation
Metadata
- Authors
- Pierre-Jean, M., Deleuze, J.-F., Le Floch, E., & Mauger, F.
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-12-03
- Volume
- 21
- Issue
- 6
- Pages
- 2011-2030
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W2994283242
- Cited by
- 100
- References
- 17
- FWCI
- 3.08
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.