CoChat

Challenges in AI-driven Biomedical Multimodal Data Fusion and Analysis

Open access
Liu, Junwei, Cen, Xiaoping, Yi, Chenxin, Wang, Feng-ao, Ding, Junxiang, Cheng, Jinyu, Wu, Qinhua, Gai, Baowen, Zhou, Yiwen, He, Ruikun, Gao, Feng, Li, Yixue · 2025 · Genomics, Proteomics & Bioinformatics

The DOI matches its Crossref record; 196 of the 197 references it cites were found in a registry or an index; 136 of the 210 sources its claims cite were checked for support.

Abstract

The rapid development of biological and medical examination methods has vastly expanded personal biomedical information, including molecular, cellular, image, and electronic health record datasets. Integrating this wealth of information enables precise disease diagnosis, biomarker identification, and treatment design in clinical settings. Artificial intelligence (AI) techniques, particularly deep learning models, have been extensively employed in biomedical applications, demonstrating increased precision, efficiency, and generalization. The success of the large language and vision models further significantly extends their biomedical applications. However, challenges remain in learning these multimodal biomedical datasets, such as data privacy, fusion, and model interpretation. In this review, we provide a comprehensive overview of various biomedical data modalities, multimodal representation learning methods, and the applications of AI in biomedical data integrative analysis. Additionally, we discuss the challenges in applying these deep learning methods and how to better integrate them into biomedical scenarios. We then propose future directions for adapting deep learning methods with model pretraining and knowledge integration to advance biomedical research and benefit their clinical applications.

Overview

CoChat Summary

TL;DR

This review surveys AI-driven multimodal biomedical data fusion, covering data modalities, representation learning methods, applications, challenges, and future directions. It argues that privacy, incomplete data, interpretation, and cross-scale integration remain key barriers, and highlights meta/transfer learning and foundation models as promising directions.

Key findings

  • The review categorizes biomedical multimodal data into numeric, image, text, and signal data, spanning sequencing, clinical, and experimental sources, and lists representative resources such as TCGA, ICGC, ADNI, UK Biobank, and MedMNIST.
  • It summarizes shallow methods (jNMF, PLS, CCA, MKL) and deep representation learning methods (VAE, GAN, GNN, Transformer) for aligning and integrating heterogeneous modalities.
  • Applications reviewed include clinical multimodal integration (e.g., WSI + genomics, CT/MRI + genomics), multi-omics analysis, single-cell/spatial analysis, and genotype–phenotype association; the text notes high-throughput single-cell techniques have generated millions of individual cell data points and a NeurIPS competition identified three key tasks.
  • Challenges include data privacy/sharing limits, incomplete modalities, model interpretation, and cross-scale integration; future directions include meta/transfer learning, foundation models, and LLM-based knowledge integration.

Methods

  • Design: narrative review.
  • Data/sample: existing literature and public multimodal biomedical databases/resources; no primary data collection.
  • Analysis: thematic synthesis of data modalities, representation learning methods, applications, challenges, and future directions; no systematic search protocol or quantitative meta-analysis stated.

Limitations

  • The paper does not explicitly state limitations of this review. It states field-level limitations: data privacy restrictions, incomplete multimodal datasets, limited cohort sizes, difficulty interpreting models, and reliance on predefined pathway annotations.
  • Evident from the text: as a narrative review, it lacks a described systematic search strategy, inclusion/exclusion criteria, and quantitative synthesis; examples are illustrative rather than exhaustive.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1093/gpbjnl/qzaf011

Cites

196 of 197 references verified0 citation errors · 1 not checkable

Statistics

Nothing to recompute.

Figures

Graphical abstract
Graphical abstract CC BY · PubMed Central
Figure 1 The categories and scales of biomedical multimodal data Biomedical multimodal datasets vary across individual, organ, tissue, cell, and molecule levels from biology perspective (see the annotations on the left). From computational terms, these datasets are categorized into numeric, image, text, and sequence data types (see the annotations on the right). EEG, electroencephalogram; ECG, electrocardiogram; CT, computed tomography; MRI, magnetic resonance imaging; PET, positron emission tomography; SNP, single nucleotide polymorphism.
Figure 1 The categories and scales of biomedical multimodal data Biomedical multimodal datasets vary across individual, organ, tissue, cell, and molecule levels from biology perspective (see the annotations on the left). From computational terms, these datasets are categorized into numeric, image, text, and sequence data types (see the annotations on the right). EEG, electroencephalogram; ECG, electrocardiogram; CT, computed tomography; MRI, magnetic resonance imaging; PET, positron emission tomography; SNP, single nucleotide polymorphism.CC BY · PubMed Central
Figure 2 Multimodal representation learning methods A.–C. Diagram of variational autoencoder (A), generative adversarial network (B), and graph neural network (C) based multimodal representation learning models. D. Diagrams of transformer-based multimodal learning models with different attention strategies, cross attention (left), concatenate attention (middle), and modal-specific attention (right). GCN, graph convolutional network; GAT, graph attention network; FFN, feedforward neural network.
Figure 2 Multimodal representation learning methods A.–C. Diagram of variational autoencoder (A), generative adversarial network (B), and graph neural network (C) based multimodal representation learning models. D. Diagrams of transformer-based multimodal learning models with different attention strategies, cross attention (left), concatenate attention (middle), and modal-specific attention (right). GCN, graph convolutional network; GAT, graph attention network; FFN, feedforward neural network.CC BY · PubMed Central
Figure 3 Diagram of the future directions and applications in biomedical multimodal learning The incorporation of multimodal data, including biomedical images, genomic information, clinical diagnosis, doctor–patient dialogue, treatment responses, and clinical examinations, into multimodal large language models would be future directions for biomedical multimodal learning. Challenges including limited data availability and incomplete multimodal data will be resolved by meta/transfer learning and incomplete modal learning/inference.
Figure 3 Diagram of the future directions and applications in biomedical multimodal learning The incorporation of multimodal data, including biomedical images, genomic information, clinical diagnosis, doctor–patient dialogue, treatment responses, and clinical examinations, into multimodal large language models would be future directions for biomedical multimodal learning. Challenges including limited data availability and incomplete multimodal data will be resolved by meta/transfer learning and incomplete modal learning/inference.CC BY · PubMed Central

Verification

Claims the paper makes

110 Valid · 2 Not valid · 52 Not checked · 35 Own results and interpretations

43 more claims · 19 with their cited sources checked

Create a free account to see all 199 claims and to verify the 17 references still open.

See all claims — free account
  • It may state two separate claims as one. 71
  • Probably not a substantial claim. 114

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 197 references

Cited by

See all 75

Metadata

Authors
Liu, J., Cen, X., Yi, C., Wang, F.-A., Ding, J., Cheng, J., Wu, Q., Gai, B., Zhou, Y., He, R., Gao, F., & Li, Y.
Affiliations
  • Guangzhou Laboratory (CN)
  • Chinese Academy of Sciences (CN)
  • Sun Yat-sen University (CN)
  • University of Chinese Academy of Sciences (CN)
  • Chinese University of Hong Kong (HK)
  • Shanghai Jiao Tong University (CN)
Corresponding author
  • Gao, Feng
  • Li, Yixue
Venue
Genomics, Proteomics & Bioinformatics
Published
2025-02
Volume
23
Issue
1
ISSN
  • 1672-0229 (ISSN-L)
  • 2210-3244
OpenAlex
W4408141508
Cited by
75
References
165
Citations by year
2026: 56 · 2025: 19
FWCI
7.80
Type
journal article
Language
en
Open access
Locations
  • Genomics Proteomics & Bioinformatics (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
Keywords
multimodal fusion, multimodal representation learning, large language models, vision models, data privacy, model interpretability, biomedical data integration, knowledge integration, biomarker discovery, disease diagnosis
MeSH terms
Deep Learning, Artificial Intelligence, Humans, Biomedical Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Challenges in AI-driven Biomedical Multimodal Data Fusion and Analysis. https://app.cochat.ai/papers/10.1093/gpbjnl/qzaf011
The paper
Liu, J., Cen, X., Yi, C., Wang, F.-A., Ding, J., Cheng, J., Wu, Q., Gai, B., Zhou, Y., He, R., Gao, F., & Li, Y. (2025). Challenges in AI-driven Biomedical Multimodal Data Fusion and Analysis. Genomics, Proteomics & Bioinformatics. https://doi.org/10.1093/gpbjnl/qzaf011

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.