Multi-source information fusion: Progress and future
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Multi-Source Information Fusion (MSIF), as a comprehensive interdisciplinary field based on modern information technology, has gained significant research value and extensive application prospects in various domains, attracting high attention and interest from scholars, engineering experts, and practitioners worldwide. Despite achieving fruitful results in both theoretical and applied aspects over the past five decades, there remains a lack of comprehensive and systematic review articles that provide an overview of recent development in MSIF. In light of this, this paper aims to assist researchers and individuals interested in gaining a quick understanding of the relevant theoretical techniques and development trends in MSIF, which conducts a statistical analysis of academic reports and related application achievements in the field of MSIF over the past two decades, and provides a brief overview of the relevant theories, methodologies, and application domains, as well as key issues and challenges currently faced. Finally, an analysis and outlook on the future development directions of MSIF are presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · arXiv · doi:10.48550/arxiv.2005.12872 · Cited by 18,253
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955 · cited 2×
“Compared to classical fusion theories, AI 34 can provide more accurate descriptions and precise decision results for imperfect data detection without introducing prior knowledge, which is achieved throughdatapreprocessingandsegmentation, featureextractionand dimensionality reduction, as well as…”
BackgroundA Comprehensive Survey on Transfer Learning
Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., & He, Q. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004555 · Cited by 6,678 · cited 1×
“…learning can partially alleviate this problem by relaxing the requirement for a large amount of labeled data, in many situations, obtaining unlabeled instances is also challenging, leading to a significant decrease in accuracy or even failure of traditional machine learning or deep learning models.”
BackgroundRecent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
An efficient k-means clustering algorithm: analysis and implementation
Kanungo, T., Mount, D. M., Netanyahu, N. S., Piatko, C. D., Silverman, R., & Wu, A. Y. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017616 · Cited by 5,660
Multimodal Machine Learning: A Survey and Taxonomy
Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“181,182 MSIF can effectively interpret a large amount of battlefield information and help human operators quickly understand the current situation in high-pressure environments through rational combination and presentation of information, which enables operators to make decisions with the…”
BackgroundPawlak, Z., & Skowron, A. (2007) · Information Sciences · doi:10.1016/j.ins.2006.06.003 · Cited by 2,070
Deep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014 · cited 1×
“102 In the 𝑙 -th convolutional layer of the CNN model, let 𝑋 ( 𝑙 − 1 ) ∈ R × × in denote the input features, 𝐾 ( 𝑙 ) ∈ R 𝑛 × × out represent 𝐶 out convolutional kernels of size 𝑛 × 𝑛 , and 𝐵 ( 𝑙 ) ∈ R 𝐶 out denote the bias elements.”
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668 · cited 1×
“87 AI based information fusion methods have gained significant importance in practical engineering applications.”
BackgroundThe industrial management of SMEs in the era of Industry 4.0
Moeuf, A., Pellerin, R., Lamouri, S., Tamayo-Giraldo, S., & Barbaray, R. (2018) · International Journal of Production Research · doi:10.1080/00207543.2017.1372647 · Cited by 1,188 · cited 1×
“0, whichrevolvesaroundCyber-PhysicalSys-tems, 256 and China Manufacturing 2025.”
Deep Visual-Semantic Alignments for Generating Image Descriptions
Karpathy, A., & Fei-Fei, L. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2598339 · Cited by 1,048
A Review of Data Fusion Techniques
Castanedo, F. (2013) · The Scientific World Journal · doi:10.1155/2013/704504 · Cited by 1,027
Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges
Gravina, R., Alinia, P., Ghasemzadeh, H., & Fortino, G. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.09.005 · Cited by 899
Qiu, S., Zhao, H., Jiang, N., Wang, Z., Liu, L., An, Y., Zhao, H., Miao, X., Liu, R., & Fortino, G. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.006 · Cited by 671 · cited 1×
“29 Numerous multi-sensor systems targeting complex environments have significantly improved the efficiency of information acquisition, greatly facilitating the development of automated systems based on information interaction and processing.”
BackgroundDigital Twins: State of the art theory and practice, challenges, and open research questions
Sharma, A., Kosasih, E., Zhang, J., Brintrup, A., & Calinescu, A. (2022) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2022.100383 · Cited by 587
A systematic review of fundamental and technical analysis of stock market predictions
Nti, I. K., Adekoya, A. F., & Weyori, B. A. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09754-z · Cited by 547 · cited 3×
“208 suggest that 11% of the 122 studies examined attempted to combine both quantitative and qualitative data to predict future stock price trends.”
BackgroundMethodInfluentialMultimodal intelligence: Representation learning, information fusion, and applications
Zhang, C., Yang, Z., He, X., & Deng, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2987728 · Cited by 511
A deep learning approach to on-node sensor data analytics for mobile or wearable devices
Ravi, D., Wong, C., Lo, B., & Yang, G.-Z. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2633287 · Cited by 439
Smart health: Big data enabled health paradigm within smart cities
Pramanik, M. I., Lau, R. Y. K., Demirkan, H., & Azad, M. A. K. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.06.027 · Cited by 341 · cited 1×
“213 The global COVID-19 pandemic has further emphasized the importance of electronic healthcare or smart/remote healthcare (the global smart healthcare market was valued at approximately $143.6 billion in 2019 and is projected to grow at a cumulative rate of 16.2% over the next seven years).”
BackgroundInfluentialA comprehensive survey on multimodal medical signals fusion for smart healthcare systems
Muhammad, G., Alshehri, F., Karray, F., Saddik, A. E., Alsulaiman, M., & Falk, T. H. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.007 · Cited by 287
Biological underpinnings for lifelong learning machines
Kudithipudi, D., Aguilar-Simon, M., Babb, J., Bazhenov, M., Blackiston, D., Bongard, J., Brna, A. P., Chakravarthi Raja, S., Cheney, N., Clune, J., et al. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00452-0 · Cited by 236 · cited 1×
“(3) Lifelong learning 248 refers to the ability of AI to acquire new skills without compromising old ones to adapt to task changes, which involves applying previously learned knowledge to new tasks while preserving limited resources such as computing power, memory, and energy.”
BackgroundMachine Learning/Artificial Intelligence for Sensor Data Fusion–Opportunities and Challenges
Blasch, E., Pham, T., Chong, C.-Y., Koch, W., Leung, H., Braines, D., & Abdelzaher, T. (2021) · IEEE Aerospace and Electronic Systems Magazine · doi:10.1109/maes.2020.3049030 · Cited by 207 · cited 2×
“88 While AI has significantly enriched the technical approaches for MSIF, which has also brought forth new challenges and opportunities.”
BackgroundUddin, M. Z., Hassan, M. M., Alsanad, A., & Savaglio, C. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.08.004 · Cited by 194
TransModality: An End2End Fusion Method with Transformer for Multimodal Sentiment Analysis
Wang, Z., Wan, Z., & Wan, X. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380000 · Cited by 156 · cited 1×
“For sentiment analysis tasks, Wang et al. 129 introduced a novel fusion method called TransModality based on Transformer.”
MethodA survey: Optimization and applications of evidence fusion algorithm based on Dempster–Shafer theory
Zhao, K., Li, L., Chen, Z., Sun, R., Yuan, G., & Li, J. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109075 · Cited by 150
Soleimani, E., & Nazerfard, E. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.10.056 · Cited by 146
Metadata
- Authors
- LI, X., DUNKIN, F., & DEZERT, J.
- Venue
- Chinese Journal of Aeronautics
- Publisher
- Elsevier BV
- Published
- 2024-07
- Volume
- 37
- Issue
- 7
- Pages
- 24-58
- ISSN
- 1000-9361 (ISSN-L)
- OpenAlex
- W4389611043
- Cited by
- 204
- References
- 32
- FWCI
- 17.92
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.