A Variational Information Bottleneck Approach to Multi-Omics Data Integration
Open accessAbstract
Integration of data from multiple omics techniques is becoming increasingly important in biomedical research. Due to non-uniformity and technical limitations in omics platforms, such integrative analyses on multiple omics, which we refer to as views, involve learning from incomplete observations with various view-missing patterns. This is challenging because i) complex interactions within and across observed views need to be properly addressed for optimal predictive power and ii) observations with various view-missing patterns need to be flexibly integrated. To address such challenges, we propose a deep variational information bottleneck (IB) approach for incomplete multi-view observations. Our method applies the IB framework on marginal and joint representations of the observed views to focus on intra-view and inter-view interactions that are relevant for the target. Most importantly, by modeling the joint representations as a product of marginal representations, we can efficiently learn from observed views with various view-missing patterns. Experiments on real-world datasets show that our method consistently achieves gain from data integration and outperforms state-of-the-art benchmarks.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Robustness to missing modalities can be achieved in homogeneous intermediate fusion.
“Robustness to missing modalities can also be achieved in homogeneous intermediate fusion, as shown by [63].”
From Multimodal deep learning for biomedical data fusion: a review (2022) · cites this paper as [63]
Different approaches have been proposed for missing modalities, such as multi-task learning, generative models and multimodal dropout.
“Different approaches have been proposed, such as multi-task learning [70], generative models [63] and multimodal dropout [78, 101].”
From Multimodal deep learning for biomedical data fusion: a review (2022) · cites this paper as [63]
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
(2014) · Cited by 33,419 · see citing works
(2010) · Cited by 14,134 · see citing works
Deep Canonical Correlation Analysis
Andrew, G., Arora, R., Bilmes, J., & Livescu, K. (2013) · Cited by 1,603 · see citing works
Multi-Omics Factor Analysis—a framework for unsupervised integration of multi-omics data sets
Argelaguet, R., Velten, B., Arnol, D., Dietrich, S., Zenz, T., Marioni, J. C., Buettner, F., Huber, W., & Stegle, O. (2018) · Molecular Systems Biology · doi:10.15252/msb.20178124 · Cited by 1,510 · see citing works
Canonical analysis of several sets of variables
Kettenring, J. R. (1971) · Biometrika · doi:10.1093/biomet/58.3.433 · Cited by 798 · see citing works
On Deep Multi-View Representation Learning
Wang, W., Livescu, K., & Bilmes, J. (2015) · Cited by 751 · see citing works
CPM-Nets: Cross Partial Multi-View Networks
Zhang, C., Han, Z., Cui, Y., Fu, H., Zhou, J. T., & Hu, Q. (2019) · neural information processing systems · Cited by 114 · see citing works
Multimodal Generative Models for Scalable Weakly-Supervised Learning
Wu, M., & Goodman, N. D. (2018) · neural information processing systems · Cited by 83 · see citing works
Shiokawa, Y., Date, Y., & Kikuchi, J. (2018) · Scientific Reports · doi:10.1038/s41598-018-20121-w · Cited by 57 · see citing works
Flagged first, then by citations
1 of the 11 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Multimodal deep learning for biomedical data fusion: a review
Stahlschmidt, S. R., Ulfenborg, B., & Synnergren, J. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbab569 · Cited by 766 · see citing works
“Robustness to missing modalities can also be achieved in homogeneous intermediate fusion, as shown by [63].”
BackgroundMethodDeep multimodal fusion of image and non-image data in disease diagnosis and prognosis: a review
Cui, C., Yang, H., Wang, Y., Zhao, S., Asad, Z., Coburn, L. A., Wilson, K. T., Landman, B. A., & Huo, Y. (2023) · Progress in Biomedical Engineering · doi:10.1088/2516-1091/acc2fe · Cited by 239 · see citing works
Multimodal Dynamics: Dynamical Fusion for Trustworthy Multimodal Classification
Han, Z., Yang, F., Huang, J., Zhang, C., & Yao, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.02005 · Cited by 202 · see citing works
Mai, S., Zeng, Y., & Hu, H. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3171679 · Cited by 182 · see citing works
A Survey on Information Bottleneck
Hu, S., Lou, Z., Yan, X., & Ye, Y. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3366349 · Cited by 114 · see citing works
Disentanglement Translation Network for multimodal sentiment analysis
Zeng, Y., Yan, W., Mai, S., & Hu, H. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102031 · Cited by 84 · see citing works
Excavating multimodal correlation for representation learning
Mai, S., Ya, S., Zeng, Y., & Hu, H. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.11.003 · Cited by 57 · see citing works
Ouyang, D., Liang, Y., Li, L., Ai, N., Lu, S., Yu, M., Liu, X., & Xie, S. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107303 · Cited by 56 · see citing works
Exploring and Exploiting Uncertainty for Incomplete Multi-View Classification
Xie, M., Han, Z., Zhang, C., Bai, Y., & Hu, Q. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01903 · Cited by 51 · see citing works
Multi-Level Confidence Learning for Trustworthy Multimodal Classification
Zheng, X., Tang, C., Wan, Z., Hu, C., & Zhang, W. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26346 · Cited by 40 · see citing works
Learning from the global view: Supervised contrastive learning of multimodal representation
Mai, S., Zeng, Y., & Hu, H. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101920 · Cited by 41 · see citing works
Zheng, X., Wang, M., Huang, K., & Zhu, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102077 · Cited by 39 · see citing works
Chen, Z., Liu, A., Zhang, X., Cao, X., Ding, Z., Sha, Q., Shen, H., Deng, H., & Zhou, W. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108058 · Cited by 33 · see citing works
Multimodal Boosting: Addressing Noisy Modalities and Identifying Modality Contribution
Mai, S., Ya, S., Xiong, A., Zeng, Y., & Hu, H. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3306489 · Cited by 29 · see citing works
Variational Distillation for Multi-View Learning
Tian, X., Zhang, Z., Wang, C., Zhang, W., Qu, Y., Ma, L., Wu, Z., Xie, Y., & Tao, D. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3343717 · Cited by 27 · see citing works
Multimodal analysis methods in predictive biomedicine
Qoku, A., Katsaouni, N., Flinner, N., Buettner, F., & Schulz, M. H. (2023) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2023.11.011 · Cited by 29 · see citing works
Multimodal Reaction: Information Modulation for Cross-Modal Representation Learning
Zeng, Y., Mai, S., Yan, W., & Hu, H. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3293335 · Cited by 24 · see citing works
A Two-Stage Information Extraction Network for Incomplete Multi-View Multi-Label Classification
Tan, X., Ce, Z., Liu, C., Wen, J., & Tang, Z. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29448 · Cited by 22 · see citing works
Integrating language into medical visual recognition and reasoning: A survey
Lu, Y., & Wang, A. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103514 · Cited by 26 · see citing works
Multi-View Information Bottleneck Without Variational Approximation
Zhang, Q., Yu, S., Xin, J., & Chen, B. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747614 · Cited by 17 · see citing works
Jeong, Y., Ronen, J., Kopp, W., Lutsik, P., & Akalin, A. (2024) · BMC Bioinformatics · doi:10.1186/s12859-024-05880-w · Cited by 15 · see citing works
Zhang, Y., Deng, Y., Zhou, Z., Zhang, X., Jiao, P., & Zhao, Z. (2022) · Frontiers in Physiology · doi:10.3389/fphys.2022.1021400 · Cited by 13 · see citing works
Discovering common information in multi-view data
Zhang, Q., Lu, M., Yu, S., Xin, J., & Chen, B. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102400 · Cited by 13 · see citing works
MultiCTox: Empowering Accurate Cardiotoxicity Prediction through Adaptive Multimodal Learning
Feng, L., Fu, X., Du, Z., Guo, Y., Zhuo, L., Yang, Y., Cao, D., & Yao, X. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c00022 · Cited by 13 · see citing works
Complementary information mutual learning for multimodality medical image segmentation
Shen, C., Li, W., Chen, H., Wang, X., Zhu, F., Li, Y., Wang, X., & Jin, B. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106670 · Cited by 11 · see citing works
Ma, Y., Yang, Y., Du, Y., Jin, L., Liang, B., Zhang, Y., Wang, Y., Liu, L., Zhang, Z., Jin, Z., et al. (2025) · BMC Medicine · doi:10.1186/s12916-025-03962-x · Cited by 11 · see citing works
Hierarchical Attention Learning for Multimodal Classification
Zou, X. G., Tang, C., Zhang, W., Sun, K., & Jiang, L. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00165 · Cited by 10 · see citing works
Curriculum Learning Meets Weakly Supervised Multimodal Correlation Learning
Mai, S., Ya, S., & Hu, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.209 · Cited by 13 · see citing works
MVIB-DVA: Learning minimum sufficient multi-feature speech emotion embeddings under dual-view aware
Li, G., Hou, J., Liu, Y., & Wei, J. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.123110 · Cited by 9 · see citing works
Gliozzo, J., Gomez, M. A. S., Bonometti, A., Patak, A., Casiraghi, E., & Valentini, G. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf150 · Cited by 8 · see citing works
Bi-modal Variational Autoencoders for Metabolite Identification Using Tandem Mass SpectrometryPreprint
Kutuzova, S., Igel, C., Nielsen, M. E., & McCloskey, D. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.08.03.454944 · Cited by 8 · see citing works
SurvBoard: Standardised Benchmarking for Multi-omics Cancer Survival ModelsPreprint
Wissel, D., Janakarajan, N., Grover, A., Toniato, E., Martínez, M. R., & Boeva, V. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.18.517043 · Cited by 8 · see citing works
Biased Incomplete Multi-View Learning
Chen, H., Xu, C. X., Guan, Z., Zhao, W., & Liu, J. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i15.33731 · Cited by 7 · see citing works
Trusted Cross-view Completion for incomplete multi-view classification
Zhou, L., Shi-yun, C., Song, P., Zheng, Q., & Yu, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129722 · Cited by 7 · see citing works
On the Limitations of Multimodal VAEsPreprint
Daunhawer, I., Sutter, T. M., Chin-Cheong, K., Palumbo, E., & Vogt, J. E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.04121 · Cited by 7 · see citing works
Starfysh reveals heterogeneous spatial dynamics in the breast tumor microenvironmentPreprint
He, S., Jin, Y., Nazaret, A., Shi, L., Chen, X., Rampersaud, S., Dhillon, B. S., Valdez, I. K., Friend, L. E., Fan, J. L., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.21.517420 · Cited by 7 · see citing works
Towards a robust multi-view information bottleneck using Cauchy–Schwarz divergence
Zhang, Q., Lu, M., Xin, J., & Chen, B. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.102934 · Cited by 6 · see citing works
Xie, W., Zhao, L. Y., Long, J., Lu, X., & Nie, B. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00193 · Cited by 6 · see citing works
Intracerebral Hemorrhage Prognosis Classification via Joint-Attention Cross-Modal Network
Xu, M., Fu, X., Jin, H., Yu, X., Xu, G., Ma, Z., Pan, C., & Liu, B. (2024) · Brain Sciences · doi:10.3390/brainsci14060618 · Cited by 5 · see citing works
RNA-to-image multi-cancer synthesis using cascaded diffusion modelsPreprint
Carrillo‐Pérez, F., Pizurica, M., Zheng, Y., Nandi, T., Madduri, R., Shen, J., & Gevaert, O. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.01.13.523899 · Cited by 5 · see citing works
Zhou, W., Chen, Z., Liu, A., Zhang, X., Cao, X., Ding, Z., Sha, Q., Shen, H., & Deng, H. (2023) · Research Square · doi:10.21203/rs.3.rs-2768563/v1 · Cited by 5 · see citing works
UVaT: Uncertainty Incorporated View-Aware Transformer for Robust Multi-View Classification
Li, Y., Luo, Y., & Du, B. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3451931 · Cited by 4 · see citing works
Zhao, X., Miao, X., Xu, X., Liu, Y., & Cao, Y. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650083 · Cited by 4 · see citing works
Semantic-Driven Crossmodal Fusion for Multimodal Sentiment Analysis
Liu, P., Wang, Z., & Huang, F. J. (2024) · International Journal on Semantic Web and Information Systems · doi:10.4018/ijswis.359985 · Cited by 4 · see citing works
Biologically Informed Variational Inference Enables Interpretable Cell Phenotyping and DiscoveryPreprint
Arnoldt, L., zu Belzen, J. U., Herrmann, L., Nguyen, K. P., Ishaque, N., Theis, F. J., Wild, B., & Eils, R. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.06.10.657924 · Cited by 4 · see citing works
Trustworthy data recovery for incomplete multi-view learning
Deng, H., Pan, N., Tang, C., & Shi, L. Q. (2025) · Signal Processing · doi:10.1016/j.sigpro.2025.110146 · Cited by 2 · see citing works
Uncertainty-induced Incomplete Multi-Omics Integration Network for Cancer Diagnosis
Gao, P., Du, L., Qiao, S., & Yin, N. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822063 · Cited by 2 · see citing works
Belenguer-Llorens, A., Sevilla-Salcedo, C., Tohka, J., & Gómez-Verdejo, V. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111887 · Cited by 1 · see citing works
Ballard, J. L., Dai, Z., Shen, L., Long, Q., & Initiative, A. D. N. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.06.16.659949 · Cited by 1 · see citing works
AI-enabled multi-omics integration for predictive food safety
Agrawal, K., Kumar, N., & Leung, M.-F. (2026) · Frontiers in Food Science and Technology · doi:10.3389/frfst.2026.1961363
- Authors
- Lee, C., & van der Schaar, M.
- ORCID
- Lee, Changhee
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Pages
- 1513-1521
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2102.03014
- OpenAlex
- W3128101433
- Cited by
- 50
- References
- 11
- Citations by year
- 2026: 1 · 2025: 12 · 2024: 12 · 2023: 14 · 2022: 8 · 2021: 3
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Artificial Intelligence and Statistics
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Keywords
- multi-omics integration, variational information bottleneck, missing data, multi-view learning, joint representation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
