Cited by 101Multimodal Machine Learning ApplicationsAdvanced Image Fusion TechniquesData Mining and Machine Learning Applications

Multimodal data fusion for systems improvement: A review

Gaw, Nathan, Yousefi, Safoora, Gahrooei, Mostafa Reisi·2022·IISE Transactions

Abstract

In recent years, information available from multiple data modalities has become increasingly common for industrial engineering and operations research applications. There have been a number of research works combining these data in unsupervised, supervised, and semi-supervised fashions that have addressed various issues of combining heterogeneous data, as well as several existing open challenges that remain to be addressed. In this review paper, we provide an overview of some methods for the fusion of multimodal data. We provide detailed real-world examples in manufacturing and medicine, introduce early, late, and intermediate fusion, as well as discuss several approaches under decomposition-based and neural network fusion paradigms. We summarize the capabilities and limitations of these methods and conclude the review article by discussing the existing challenges and potential research opportunities.

Integrity signals

Registry

Crossref · 10.1080/24725854.2021.1987593

Cites

117 of 117 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Mid-term fusion typically employs attention mechanisms, feature weighting, connectivity, or GNNs to combine modality-specific features.

    “This method typically employs attention mechanisms, feature weighting, connectivity, or GNNs to combine modality specific features [41,42].”

Cites

Flagged first, then by citations

2 of the 119 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Gaw, N., Yousefi, S., & Gahrooei, M. R.
Affiliations
  • Wright-Patterson Air Force Base (US)
  • Microsoft (United States) (US)
  • University of Florida (US)
Corresponding author
Gahrooei, Mostafa Reisi
Venue
IISE Transactions
Published
2021-12-03
Volume
54
Issue
11
Pages
1098-1116
ISSN
  • 2472-5854 (ISSN-L)
  • 2472-5862
OpenAlex
W3210892971
Cited by
101
References
119
Citations by year
2026: 20 · 2025: 28 · 2024: 33 · 2023: 14 · 2022: 5 · 2021: 1
FWCI
4.77
Type
journal article
Language
en
Open access
closed
Locations
  • IISE Transactions (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
  • Physical Sciences › Engineering › Media Technology › Advanced Image Fusion Techniques
  • Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
Keywords
multimodal fusion, data heterogeneity, feature-level fusion, decision fusion, intermediate fusion, neural network fusion, manufacturing industry, health data, industrial engineering, operations research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review