MFAS: Multimodal Fusion Architecture Search

Perez-Rua, Juan-Manuel, Vielzeuf, Valentin, Pateux, Stephane, Baccouche, Moez, Jurie, Frederic·2019·2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
DOI 10.1109/cvpr.2019.00713

Cited by (193)

Items 101–193 of 193

  1. Multi-Scale Features Are Effective for Multi-Modal Classification: An Architecture Search Viewpoint
    Pinhan Fu, Xinyan Liang, Yuhua Qian, Qian Jian Guo, Yayu Zhang, Qin Huang, Ke Tang · 2024 · IEEE Transactions on Circuits and Systems for Video Technology
  2. Learnable Depth-Sensitive Attention for Deep RGB-D Saliency Detection with Multi-modal Fusion Architecture Search
    Peng Sun, Wenhu Zhang, Songyuan Li, Yilin Guo, Congli Song, Xi Li · 2022 · International Journal of Computer Vision
  3. Flexible Material Quality Assessment Based on Visual–Tactile Fusion
    Shuchang Xu, Haohao Xu, Fangtao Mao, Wen Su, Menghui Ji, Haiyong Gan, Wenzhen Yang · 2024 · IEEE Transactions on Instrumentation and Measurement
  4. Enhancing Multimodal Learning via Hierarchical Fusion Architecture Search With Inconsistency Mitigation
    Kaifang Long, Guoyang Xie, Lianbo Ma, Qing Li, Min Huang, Jianhui Lv, Zhichao Lu · 2025 · IEEE Transactions on Image Processing
  5. Skeleton-Based Human Action Recognition Based on Single Path One-Shot Neural Architecture Search
    Yujian Jiang, Saisai Yu, Tianhao Wang, Zhaoneng Sun, Shuang Wang · 2023 · Electronics
  6. Comparison Analysis of Multimodal Fusion for Dangerous Action Recognition in Railway Construction Sites
    Otmane Amel, Xavier Siebert, Sidi Ahmed Mahmoudi · 2024 · Electronics
  7. Neural Inheritance Relation Guided One-Shot Layer Assignment Search
    Rang Meng, Weijie Chen, Di Xie, Yuan Zhang, Shiliang Pu · 2020 · Proceedings of the AAAI Conference on Artificial Intelligence
  8. A Multi-Stream Recurrent Neural Network for Social Role Detection in Multiparty Interactions
    Lingyu Zhang, Richard J. Radke · 2020 · IEEE Journal of Selected Topics in Signal Processing
  9. Multi-Modal and Multi-Scale Temporal Fusion Architecture Search for Audio-Visual Video Parsing
    Jiayi Zhang, Weixin Li · 2023 · ACM International Conference on Multimedia (ACM MM)
  10. Learning modality-fused representation based on transformer for emotion analysis
    Piao Shi, Min Qiang Hu, Fuji Ren, Xuefeng Shi, Liangfeng Xu · 2022 · Journal of Electronic Imaging
  11. Selective interactive networks with knowledge graphs for image classification
    Wenqiang Tang, Zhouwang Yang, Yanzhi Song · 2023 · Knowledge-Based Systems
  12. DSF2-NAS: Dual-Stage Feature Fusion via Network Architecture Search for Classification of Multimodal Remote Sensing Images
    Shiyang Feng, Zhaowei Li, Bo Zhang, Tao Chen, Bin Wang · 2025 · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  13. Automatic Network Architecture Search for RGB-D Semantic Segmentation
    Wenna Wang, Tao Zhuo, Xiuwei Zhang, Mingjun Sun, Hanlin Yin, Yinghui Xing, Yanning Zhang · 2023 · ACM International Conference on Multimedia (ACM MM)
  14. Fused and Modified Evolutionary Optimization of Multiple Intelligent Systems Using ANN, SVM approaches
    Jalal Sadoon Hameed Al‐bayati, Burak Berk Üstündağ · 2020 · Computers, materials & continua/Computers, materials & continua (Print)
  15. MBA: A Multimodal Bilinear Attention Model with Residual Connection for Abstractive Multimodal Summarization
    Ye Xia, Zengying Yue, Ruiheng Liu · 2021 · Journal of Physics Conference Series
  16. Human risky behaviour recognition during ladder climbing based on multi-modal feature fusion and adaptive graph convolutional network
    Wenrui Zhu, Donghui Shi, Rui Cheng, Ruifeng Huang, Tao Hu, Junyi Wang · 2024 · Signal Image and Video Processing
  17. Towards a General Model of Knowledge for Facial Analysis by Multi-Source Transfer Learning
    Valentin Vielzeuf, Alexis Lechervy, Stéphane Pateux, Frédéric Jurie · 2019 · arXiv (Cornell University)
  18. Multimodal-information-based optimized agricultural prescription recommendation system of crop electronic medical records
    Chang Xu, Junqi Ding, Bo Wang, Yan Qiao, Lingxian Zhang, Y. F. Zhang · 2024 · Journal of Industrial Information Integration
  19. Trustworthy Multi-Modal Ultrasound Fusion via Uncertainty Calibration and Conflict Resolution
    Peng Wan, Limei Wei, Shukang Zhang, Haiyan Xue, Wei Shao, Wentao Kong, Daoqiang Zhang · 2025 · IEEE Transactions on Medical Imaging
  20. Feature Stacking Fusion in Multimodal Neural Architecture Search
    Kaifang Long, Lianbo Ma, Yang Gao, Guo Yu · 2024 · International Conference on Data-driven Optimization of Complex Systems (DOCS)
  21. A Neural Architecture Search for Automated Multimodal Learning
    Anuraj Singh, Haritha Nair · 2022 · Expert Systems with Applications
  22. Multi-modal fusion network guided by prior knowledge for 3D CAD model recognition
    Qiang Li, Zibo Xu, Shaojin Bai, Weizhi Nie, An-An Liu · 2024 · Neurocomputing
  23. RandomNet: Towards Fully Automatic Neural Architecture Design for Multimodal Learning
    Stefano Alletto, Shenyang Huang, Vincent François-Lavet, Yohei Nakata, Guillaume Rabusseau · 2020 · arXiv (Cornell University)
  24. UVaT: Uncertainty Incorporated View-Aware Transformer for Robust Multi-View Classification
    Yapeng Li, Yong Luo, Bo Du · 2024 · IEEE Transactions on Image Processing
  25. Hierarchical multi-modal fusion architecture search for stock market forecasting
    Kisu Lee, Young J. Kim, Minkyoung Kim, Ha Young Kim · 2025 · Applied Soft Computing
  26. Entity Representation Learning with Multimodal Neighbors for Link Prediction in Knowledge Graph
    Wenxuan Liu, Hao Duan, Zeng Li, Jingdong Liu, Hong Huo, Tao Fang · 2021 · IEEE International Conference on Computer and Communications (ICCC)
  27. Towards Better Multi-modal Keyphrase Generation via Visual Entity Enhancement and Multi-granularity Image Noise Filtering
    Yifan Dong, Suhang Wu, Fandong Meng, Jie Zhou, Xiaoli Wang, Jianxin Lin, Jinsong Su · 2023 · ACM International Conference on Multimedia (ACM MM)
  28. COPILOT: Cooperative Perception using Lidar for Handoffs between Road Side Units
    Suyash Pradhan, Debashri Roy, Batool Salehi, Kaushik Roy Chowdhury · 2024 · IEEE Conference on Computer Communications (INFOCOM)
  29. On the Robustness and Reliability of Late Multi-Modal Fusion using Probabilistic Circuits
    Sahil Sidheekh, Pranuthi Tenali, Saurabh Mathur, Erik Blasch, Sriraam Natarajan · 2024 · International Conference on Information Fusion (FUSION)
  30. CoMO-NAS: Core-Structures-Guided Multi-Objective Neural Architecture Search for Multi-Modal Classification
    Pinhan Fu, Xinyan Liang, Yuhua Qian, Qian Jian Guo, Zhifang Wei, Wen Li · 2024 · ACM International Conference on Multimedia (ACM MM)
  31. MAVT-FG
    Xiaoyu Zhou, Xiaotong Song, Hao Wu, Jingran Zhang, Xing Xu · 2022 · ACM International Conference on Multimedia (ACM MM)
  32. Self-Supervised Video Representation and Temporally Adaptive Attention for Audio-Visual Event Localization
    Yue Ran, Hongying Tang, Baoqing Li, Guohui Wang · 2022 · Applied Sciences
  33. M2SN: Adaptive and Dynamic Multi-modal Shortcut Network Architecture for Latency-Aware Applications
    Yifei Pu, Chi Wang, Xiaofeng Hou, Cheng Xu, Jiacheng Liu, Jing Wang, Minyi Guo, Chao Li · 2024 · IEEE International Conference on Multimedia and Expo (ICME)
  34. Multi-scale Feature Refinement via Perspective Scaling and Adaptive Regularization for text-based person search
    Sheng Xie, Canlong Zhang, Runcong Ma, Zhixin Li, Zhiwen Wang, Chunrong Wei · 2025 · Engineering Applications of Artificial Intelligence
  35. Dual-channel attention-autoencoder for tabular-graph fusion: tackling heterogeneous data in AI for Science
    Wenyu Yang, Heng Li, Yun-Kun Wang, Yun-Qian Wang · 2026 · Expert systems with applications
  36. In-Network Fusion for High Interference Signal Detection within CBRS Band
    Shafi Ullah Khan, Michel Kulhandjian, Debashri Roy · 2025 · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)
  37. GSS-RiskAsser: A Multi-Modal Deep-Learning Framework for Urban Gas Supply System Risk Assessment on Business Users
    Xuefei Li, Liangtu Song, Liu Liu, Linli Zhou · 2021 · Sensors
  38. DM2S2: Deep Multimodal Sequence Sets With Hierarchical Modality Attention
    Shunsuke Kitada, Yuki Iwazaki, Riku Togashi, Hitoshi Iyatomi · 2022 · IEEE Access
  39. M2-Mixer: A Multimodal Mixer with Multi-head Loss for Classification from Multimodal Data
    Grigor Bezirganyan, Sana Sellami, Laure Berti‐Équille, Sébastien Fournier · 2023 · IEEE International Conference on Big Data (BigData)
  40. Cross-Modality Calibration in Multi-Input Network for Axillary Lymph Node Metastasis Evaluation
    Michela Gravina, Domiziana Santucci, Ermanno Cordelli, Paolo Soda, Carlo Sansone · 2024 · IEEE Transactions on Artificial Intelligence
  41. MMCAF : A Survival Status Prediction Method Based on Cross‐Attention Fusion of Multimodal Colorectal Cancer Data
    Xueping Tan, Dinghui Wu, Hao Wang, Zihao Zhao, Yuxi Ge, Shudong Hu · 2025 · International Journal of Imaging Systems and Technology
  42. Emerging Trends of Multimodal Research in Vision and Language.
    Shagun Uppal, Sarthak Bhagat, Devamanyu Hazarika, Navonil Majumder, Soujanya Poria, Roger Zimmermann, Amir Zadeh · 2020 · arXiv (Cornell University)
  43. Multimodal Deep Learning with Boosted Trees for Edge Inference
    Penny Chong, Laura Wynter, Bharathi Chaudhury · 2023 · IEEE ... International Conference on Data Mining workshops
  44. Research on type-aware fashion compatibility prediction based on a hybrid attention mechanism
    Yun Li, Guoxiang Li, Jing Zhang, Peiguang Jing, Xingyu Lu · 2024 · Multimedia Tools and Applications
  45. Correlation-Adaptive Multi-view CEUS Fusion for Liver Cancer Diagnosis
    Peng Wan, Shukang Zhang, Wei Shao, Junyong Zhao, Yinkai Yang, Wentao Kong, Haiyan Xue, Daoqiang Zhang · 2024 · Lecture notes in computer science
  46. MixMAS: A Framework for Sampling-Based Mixer Architecture Search for Multimodal Fusion and Learning
    Abdelmadjid Chergui, Grigor Bezirganyan, Sana Sellami, Laure Berti‐Équille, Sébastien Fournier · 2024 · IEEE International Conference on Big Data (BigData)
  47. ModiFedCat: A multi-modal distillation based federated catalytic framework
    Dongdong Li, Zhenqiang Weng, Zhengji Xuan, Zhe Wang · 2025 · Information Fusion
  48. Music4All A+A: A Multimodal Dataset for Music Information Retrieval Tasks
    Jonas Geiger, Marta Moscati, Shah Nawaz, Markus Schedl · 2025 · International Workshop on Content-Based Multimedia Indexing (CBMI)
  49. MMFC-PFL: Multimodal Feature Collaborative Personalized Federated Learning
    Dongdong Li, Zhenqiang Weng, Jia Yao, Zhengji Xuan, Zhe Wang · 2026 · IEEE Transactions on Network Science and Engineering
  50. Multimodal Graph Representation Learning over Arbitrary Sets of Modalities
    Santosh Patapati, Trisanth Srinivasan · 2026 · IEEE Winter Conference on Applications of Computer Vision
  51. Timing Is Everything: Finding the Optimal Fusion Points in Multimodal Medical Imaging
    Valerio Guarrasi, Klara Mogensen, Sara Tassinari, Sara Qvarlander, Paolo Soda · 2025 · International Joint Conference on Neural Networks (IJCNN)
  52. AWDF: An Adaptive Weighted Deep Fusion Architecture for Multi-modality Learning
    Qinghan Xue, Abhishek Kolagunda, Steven Eliuk, Xiaolong Wang · 2019 · IEEE International Conference on Big Data (BigData)
  53. M2FN: Multi-step modality fusion for advertisement image assessment
    Kyung-Wha Park, Jung-Woo Ha, Junghoon Lee, Sunyoung Kwon, Kyung-Min Kim, Byoung‐Tak Zhang · 2021 · Applied Soft Computing
  54. Multi-parametric Magnetic Resonance Imaging Fusion for Automatic Classification of Prostate Cancer
    Wei‐Kai Huang, Xiangyu Wang, Yijin Huang, Lin Fan, Xiaoying Tang · 2022 · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
  55. A Survey of pet Action Recognition with action Recommendation based on HAR
    Shunke Zhou · 2022 · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT)
  56. Focal Channel Knowledge Distillation for Multi-Modality Action Recognition
    Lipeng Gan, Runze Cao, Ning Li, Man Yang, Xiaochao Li · 2023 · IEEE Access
  57. Deep Multi-Modal Sets
    Austin Reiter, Menglin Jia, Pu Yang, Ser-Nam Lim · 2020 · arXiv (Cornell University)
  58. Violence-MFAS: Audio-Visual Violence Detection Using Multimodal Fusion Architecture Search
    Dan Si, Qing Ye, Jindi Lv, Yuhao Zhou, Jiancheng Lv · 2023 · Communications in computer and information science
  59. MMBypass: Towards efficient multi-modal AI computing with adaptive bypass network
    Yifei Pu, Xinfeng Xia, Xiaofeng Hou, Chi Wang, Cheng Xu, Jiacheng Liu, Jing Wang, Minyi Guo, Jingling Yuan, Chao Li · 2025 · Journal of Parallel and Distributed Computing
  60. A Wander Through the Multimodal Landscape: Efficient Transfer Learning via Low-rank Sequence Multimodal Adapter
    Zirun Guo, Xize Cheng, Yangyang Wu, Tao Jin · 2025 · Proceedings of the AAAI Conference on Artificial Intelligence
  61. Uncertainty Quantification via Hölder Divergence for Multi-View Representation Learning
    Yan Zhang, Ming Li, Chun Li, Zhaoxia Liu, Ye Zhang, Fei Richard Yu · 2025 · IEEE Transactions on Multimedia
  62. PgM: Partitioner Guided Modal Learning Framework
    Guimin Hu, Yuchen Xin, Lijie Hu, Zhihong Zhu, Hasti Seifi · 2025 · ACM International Conference on Multimedia (ACM MM)
  63. Multi-Branch Tree-Based Fusion Neural Architecture Search With Zero-Cost Screen for Multi-Modal Classification
    Qian Jian Guo, Quanchen Su, Xinyan Liang, Yuhua Qian, Nan Li, Zhihua Cui · 2026 · IEEE Transactions on Image Processing
  64. Differential Evolution for Deep Learning: A Comprehensive Survey
    Lishu Qin, Z Li, Xinyuan Lu, Yu Gao · 2026 · Archives of Computational Methods in Engineering
  65. ML-TFN: Multi Layers Tensor Fusion Network for Affective Video Content Analysis
    Qi Wang, Xiaohong Xiang, Jun Zhao · 2022 · Communications in computer and information science
  66. Modality mixer exploiting complementary information for multi-modal action recognition
    Sumin Lee, Sangmin Woo, Muhammad Adi Nugroho, Changick Kim · 2025 · Computer Vision and Image Understanding
  67. Optimizing Agricultural Prescription Recommendation with Cross-Modal Multi-Layer Feature Fusion of Crop Electronic Medical Records
    Junqi Ding, Bo Wang, Yan Qiao, Lingxian Zhang · 2023 · SSRN Electronic Journal
  68. Deep audio and video emotion detection
    Masih Aminbeidokhti · 2020 · Espace ÉTS (ETS)
  69. A Multimodal Fusion Model Based on Hybrid Attention Mechanism for Gesture Recognition
    Yajie Li, Yiqiang Chen, Yang Gu, Jianquan Ouyang · 2021 · Lecture notes in computer science
  70. Deep Neural Network Based Student Response Modeling With Uncertainty, Multimodality and Attention
    Xinyi Ding · 2020 · SMU Scholar (Southern Methodist University)
  71. Turning old models fashion again: Recycling classical CNN networks using the Lattice Transformation
    Ana Paula G. S. de Almeida, Flávio de Barros Vidal · 2021 · arXiv (Cornell University)
  72. Automated Machine Learning for Multimedia
    Wenwu Zhu, Xin Wang · 2021 · Springer eBooks
  73. Multi-layer Feature Fusion Method with Fewer Connections for Fast Semantic Segmentation
    Jie Yuan, Zhaoyi Shi, Shuo Chen, Shaona Yu · 2021 · International Conference on Computer Science and Management Technology (ICCSMT)
  74. Multimodal object tracking by exploiting appearance and class information
    Zhongjie Mao, Xi Chen, Jia Yan, Tao Qu · 2022 · Journal of Visual Communication and Image Representation
  75. Multi-selection Attention for Multimodal Aspect-level Sentiment Classification
    Yuqing Miao, Ronghai Luo, Tonglai Liu, Wanzhen Zhang, Guoyong Cai, Ming Quan Zhou · 2022 · International Symposium on Parallel Architectures, Algorithms and Programming
  76. Efficient Human Activity Recognition Based on Grouped Representations of Multimodal Wearable Data
    Guillaume Habault, Shinya Wada · 2023 · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
  77. Granularity Based Inter and Intra-Modal Fusion Network for Sarcasm Detection
    Yicong Shi, Xiaoli Zhao, Mingxuan Chen · 2023 · Research Square
  78. Inputmix: A Strategy to Regularize and Balance Multi-Modality and Multi-View Model Learning
    Junjie Wang, Tomas Nordström · 2024 · IEEE International Conference on Acoustics Speech and Signal Processing
  79. Modality Mixer Exploiting Complementary Information for Multi-Modal Action Recognition
    Sumin Lee, Sangmin Woo, Muhammad Adi Nugroho, Changick Kim · 2024 · SSRN Electronic Journal
  80. A Conceptual Framework for Immersive Behavioral Data Exploration Assisted by a Deep Learned Representation of Data
    Yves Duvivier Victor Roger, Matthieu Perreira Da Silva, Yannick Prié · 2025 · IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)
  81. Self-Supervised Neural Architecture Search for Multimodal Deep Neural Networks
    Shota SUZUKI, Satoshi Ono · 2024 · IEICE Transactions on Information and Systems
  82. Advanced Multimodal Sentiment Analysis Using Stacking for Enhanced Decision Support in Organizational Systems
    D.V. Fazulianov, Anna I. Guseva · 2024 · International Conference on Control Systems, Mathematical Modeling, Automation and Energy Efficiency (SUMMA)
  83. Hybrid Active Learning with Privacy-Preserving Synthetic Data for Medical Multimodal LLM Enhancement
    xiaochen xiao · 2025 · Research Square
  84. Trustworthy Localized Corrections-guided Mutual Learning for Multi-View Learning
    Qiuran Li, Yi Luo, Yan Sun, Tong Wu, Aiguo Chen · 2025 · IEEE International Conference on Multimedia and Expo (ICME)
  85. Multimodal Data Augmentation for Dynamic Fusion
    Haining Li, Shan Huang, Changqing Zhang · 2025 · International Joint Conference on Neural Networks (IJCNN)
  86. Cross-Modal Learning for Engine Health Monitoring: Bridging Vibration Signatures and Oil Debris Characteristics
    Hai Liu, Fu Zhou Feng, Da Shan Huang, Xin Xin · 2025 · International Conference on Communication, Image and Signal Processing (CCISP)
  87. Sparse Coding for Multimodal Hand Biometrics
    Bob Zhang, Shuping Zhao, Lunke Fei, Shuyi Li · 2026 · Springer eBooks
  88. Granularity-guided fusion for multi-modal sentiment understanding
    Mingxuan Chen, Huarong Tang, Chen Sun, Nannan Zhang · 2026 · Scientific Reports
  89. Apprentissage neuronal profond pour l'analyse de contenus multimodaux et temporels
    Valentin Vielzeuf · 2019 · theses.fr (ABES)
  90. Spatio-temporal Attention Mechanisms for Activity Recognition
    Srijan Das · 2020 · theses.fr (ABES)
  91. CaLB: Caption and Language-Based with Simple Fusion Network
    Yicong Shi, Songyang Wu, Zhiguo Ding, Hang Shao, Yingna Li · 2026 · Lecture notes in electrical engineering
  92. OAFBC-Net: A Lightweight RGB-Depth Fusion Network for Occlusion-Aware Apple Detection in Complex Orchard Canopies
    Long Gao, Pengfei Wang, L S Liu, Hongjie Liu, Jianping Li, Xin Yang · 2026 · Agronomy
  93. DS-MMFNet: A Fusion Network for Same-Source Multi-View Representations in Partial Discharge Pattern Recognition
    Zhenhang Wang, Jie Li, Chunyan Zhang, Jianlei Zhang · 2026 · International Conference on Advanced Algorithms and Neural Networks (AANN)