The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Benchmarking joint multi-omics dimensionality reduction approaches for the study of cancer
Open accessPublished version of a preprint
Abstract
High-dimensional multi-omics data are now standard in biology. They can greatly enhance our understanding of biological systems when effectively integrated. To achieve proper integration, joint Dimensionality Reduction (jDR) methods are among the most efficient approaches. However, several jDR methods are available, urging the need for a comprehensive benchmark with practical guidelines. We perform a systematic evaluation of nine representative jDR methods using three complementary benchmarks. First, we evaluate their performances in retrieving ground-truth sample clustering from simulated multi-omics datasets. Second, we use TCGA cancer data to assess their strengths in predicting survival, clinical annotations and known pathways/biological processes. Finally, we assess their classification of multi-omics single-cell data. From these in-depth comparisons, we observe that intNMF performs best in clustering, while MCIA offers an effective behavior across many contexts. The code developed for this benchmark study is implemented in a Jupyter notebook—multi-omics mix (momix)—to foster reproducibility, and support users and future developers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Comprehensive Integration of Single-Cell Data
Stuart, T., Butler, A., Hoffman, P., Hafemeister, C., Papalexi, E., Mauck, W. M., Hao, Y., Stoeckius, M., Smibert, P., & Satija, R. (2019) · Cell · doi:10.1016/j.cell.2019.05.031 · Cited by 15,453
Algorithm AS 136: A K-Means Clustering Algorithm
Hartigan, J. A., & Wong, M. A. (1979) · Applied Statistics · doi:10.2307/2346830 · Cited by 14,523
The Molecular Signatures Database Hallmark Gene Set Collection
Liberzon, A., Birger, C., Thorvaldsdóttir, H., Ghandi, M., Mesirov, J. P., & Tamayo, P. (2015) · Cell Systems · doi:10.1016/j.cels.2015.12.004 · Cited by 13,807
Integrating single-cell transcriptomic data across different conditions, technologies, and species
Butler, A., Hoffman, P., Smibert, P., Papalexi, E., & Satija, R. (2018) · Nature Biotechnology · doi:10.1038/nbt.4096 · Cited by 13,174
Comprehensive molecular portraits of human breast tumours
The Cancer Genome Atlas Network (2012) · Nature · doi:10.1038/nature11412 · Cited by 12,129
The cancer genome atlas pan-cancer analysis project
The Cancer Genome Atlas Research Network, Weinstein, J. N., Collisson, E. A., Mills, G. B., Shaw, K. R. M., Ozenberger, B. A., Ellrott, K., Shmulevich, I., Sander, C., & Stuart, J. M. (2013) · Nature Genetics · doi:10.1038/ng.2764 · Cited by 9,092 · cited 1×
“Pierre-Jean et al.13, Rappoport et al.11, and Tini et al.14 selected one method from each of the aforementioned three categories, while Chauvel et al.12 focused on Bayesian and DR approaches.”
MethodMolecular signatures database (MSigDB) 3.0
Liberzon, A., Subramanian, A., Pinchback, R., Thorvaldsdóttir, H., Tamayo, P., & Mesirov, J. P. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr260 · Cited by 7,111
Similarity network fusion for aggregating data types on a genomic scale
Wang, B., Mezlini, A. M., Demir, F., Fiume, M., Tu, Z., Brudno, M., Haibe-Kains, B., & Goldenberg, A. (2014) · Nature Methods · doi:10.1038/nmeth.2810 · Cited by 2,036
MOFA+: a statistical framework for comprehensive integration of multi-modal single-cell data
Argelaguet, R., Arnol, D., Bredikhin, D., Deloro, Y., Velten, B., Marioni, J. C., & Stegle, O. (2020) · Genome Biology · doi:10.1186/s13059-020-02015-1 · Cited by 1,091
Shen, R., Olshen, A. B., & Ladanyi, M. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp543 · Cited by 849
Research works printed but not linked: 27
- Stuart, T. & Satija, R. Integrative single-cell analysis. Nat. Rev. Genet. 20, 257–272 (2019). · DOI · Paper page
- Gligorijević, V. & Pržulj, N. Methods for biological data integration: perspectives and challenges. J. R. Soc. Interface 12, 20150571 (2015). · DOI · Paper page
- Kristensen, V. N. et al. Principles and methods of integrative genomic analyses in cancer. Nat. Rev. Cancer 14, 299–313 (2014). · DOI · Paper page
- Huang, S., Chaudhary, K. & Garmire, L. X. More is better: recent progress in multi-omics data integration methods. Front. Genet. 8, 84 (2017). · DOI · Paper page
- Lock, E. F. & Dunson, D. B. Bayesian consensus clustering. Bioinformatics 29, 2610–2616 (2013). · DOI · Paper page
- Meng, C. et al. Dimension reduction techniques for the integrative analysis of multi-omics data. Brief Bioinform. 17, 628–641 (2016). · DOI · Paper page
- Stein-O’Brien, G. L. et al. Enter the matrix: factorization uncovers knowledge from omics. Trends Genet. 34, 790–805 (2018). · DOI · Paper page
- Rappoport, N. & Shamir, R. Multi-omic and multi-view clustering algorithms: review and cancer benchmark. Nucleic Acids Res. 46, 10546–10562 (2018). · DOI · Paper page
- Chauvel, C., Novoloaca, A., Veyre, P., Reynier, F. & Becker, J. Evaluation of integrative clustering methods for the analysis of multi-omics data. Brief Bioinform. 21, 541–552 (2020). · DOI
- Pierre-Jean, M., Deleuze, J.-F., Le Floch, E. & Mauger, F. Clustering and variable selection evaluation of 13 unsupervised methods for multi-omics data integration. Brief Bioinform. 21, 2011–2030 (2020). · DOI
- Tini, G., Marchetti, L., Priami, C. & Scott-Boyer, M.-P. Multi-omics integration-a comparison of unsupervised clustering methodologies. Brief Bioinform. 20, 1269–1279 (2019). · DOI
- Argelaguet, R. et al. Multi-omics factor analysis-a framework for unsupervised integration of multi-omics data sets. Mol. Syst. Biol. 14, e8124 (2018). · DOI · Paper page
- Chalise, P. & Fridley, B. L. Integrative clustering of multi-level ‘omic data based on non-negative matrix factorization algorithm. PLoS ONE 12, e0176278 (2017). · DOI · Paper page
- Lock, E. F., Hoadley, K. A., Marron, J. S. & Nobel, A. B. Joint and individual variation explained (JIVE) for integrated analysis of multiple data types. Ann. Appl. Stat. 7, 523–542 (2013). · DOI · Paper page
- Bady, P., Dolédec, S., Dumont, B. & Fruget, J.-F. Multiple co-inertia analysis: a tool for assessing synchrony in the temporal variability of aquatic communities. C. R. Biol. 327, 29–36 (2004). · doi:10.1016/j.crvi.2003.10.007
- De Vito, R., Bellio, R., Trippa, L. & Parmigiani, G. Multi‐study factor analysis. Biometrics 75, 337–346 (2019). · DOI
- Tenenhaus, M., Tenenhaus, A. & Groenen, P. J. F. Regularized generalized canonical correlation analysis: a framework for sequential multiblock component methods. Psychometrika 82, 737–777 (2017). · DOI · Paper page
- Žitnik, M. & Zupan, B. Data fusion by matrix factorization. IEEE Trans. Pattern Anal. Mach. Intell. 37, 41–53 (2015). · DOI · Paper page
- Teschendorff, A. E., Jing, H., Paul, D. S., Virta, J. & Nordhausen, K. Tensorial blind source separation for improved analysis of multi-omic data. Genome Biol. 19, 76 (2018). · DOI
- Chalise, P., Raghavan, R. & Fridley, B. L. InterSIM: simulation tool for multiple integrative ‘omic datasets’. Comput. Methods Prog. Biomed. 128, 69–74 (2016). · DOI
- Fulford, L. G. et al. Specific morphological features predictive for the basal phenotype in grade 3 invasive ductal carcinoma of breast. Histopathology 49, 22–34 (2006). · DOI · Paper page
- Parker, J. S. et al. Supervised risk predictor of breast cancer based on intrinsic subtypes. J. Clin. Oncol. 27, 1160–1167 (2009). · DOI · Paper page
- Bismeijer, T., Canisius, S. & Wessels, L. F. A. Molecular characterization of breast and lung tumors by integration of multiple data types with functional sparse-factor analysis. PLoS Comput. Biol. 14, e1006520 (2018). · DOI
- Ma, A., McDermaid, A., Xu, J., Chang, Y. & Ma, Q. Integrative methods and practical challenges for single-cell multi-omics. Trends Biotechnol. 38, P1007–1022 (2020). · DOI · Paper page
- Hu, Y. et al. Single cell multi-omics technology: methodology and application. Front. Cell Dev. Biol. 6, 28 (2018). · DOI · Paper page
- Welch, J. D. et al. Single-cell multi-omic integration compares and contrasts features of brain cell identity. Cell 177, 1873–1887 (2019). · DOI · Paper page
- Everitt, B. S., Landau, S., Leese, M. & Stahl, D. Cluster Analysis: Everitt/Cluster Analysis (John Wiley & Sons, Ltd, 2011). · DOI · Paper page
Cited by
Integration strategies of multi-omics data for machine learning analysis
Picard, M., Scott-Boyer, M.-P., Bodein, A., Périn, O., & Droit, A. (2021) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2021.06.030 · Cited by 696
Harnessing multimodal data integration to advance precision oncology
Boehm, K. M., Khosravi, P., Vanguri, R., Gao, J., & Shah, S. P. (2022) · Nature Reviews Cancer · doi:10.1038/s41568-021-00408-3 · Cited by 662
Computational principles and challenges in single-cell data integration
Argelaguet, R., Cuomo, A. S. E., Stegle, O., & Marioni, J. C. (2021) · Nature Biotechnology · doi:10.1038/s41587-021-00895-7 · Cited by 472
State of the field in multi-omics research: from computational needs to data mining and sharing
Krassowski, M., Das, V., Sahu, S. K., & Misra, B. B. (2020) · Frontiers in Genetics · doi:10.3389/fgene.2020.610798 · Cited by 351
Evolution and impact of high content imaging.
Way, G. P., Sailem, H., Shave, S., Kasprowicz, R., & Carragher, N. O. (2023) · SLAS Discovery · doi:10.1016/j.slasd.2023.08.009 · Cited by 67
Metadata
- Authors
- Cantini, L., Zakeri, P., Hernandez, C., Naldi, A., Thieffry, D., Remy, E., & Baudot, A.
- Venue
- Nature Communications
- Published
- 2021-01-05
- Volume
- 12
- Issue
- 1
- Pages
- 124-124
- ISSN
- 2041-1723 (ISSN-L)
- OpenAlex
- W3120515035
- Cited by
- 226
- References
- 12
- FWCI
- 9.93
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Benchmarking joint multi-omics dimensionality reduction approaches for the study of cancer. https://app.cochat.ai/papers/10.1038/s41467-020-20430-7
- The paper
- Cantini, L., Zakeri, P., Hernandez, C., Naldi, A., Thieffry, D., Remy, E., & Baudot, A. (2021). Benchmarking joint multi-omics dimensionality reduction approaches for the study of cancer. Nature Communications. https://doi.org/10.1038/s41467-020-20430-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.