Multimodal Co-learning: Challenges, applications with datasets, recent advances and future directions

Rahate, Anil, Walambe, Rahee, Ramanna, Sheela, Kotecha, Ketan·2022·Information Fusion
DOI 10.1016/j.inffus.2021.12.003

Cites (226)

Items 201–236 of 236

  1. MT-GCN for Multi-label Audio-tagging with Noisy Labels
    Harsh Shrivastava, Yifang Yin, Rajiv Ratn Shah, Roger Zimmermann · 2020 · IEEE International Conference on Acoustics Speech and Signal Processing
  2. Computer Vision – ECCV 2020
    ECCV 2020 Online, Vedaldi, Andrea, Bischof, Horst, Brox, Thomas, Jan‐Michael Frahm · 2020 · Lecture notes in computer science
  3. Audio-Visual Speech Enhancement based on Multimodal Deep Convolutional Neural Network.
    Jen-Cheng Hou, Syu‐Siang Wang, Ying-Hui Lai, Jen‐Chun Lin, Yu Tsao, Hsiu-Wen Chang, Hsin‐Min Wang · 2017 · arXiv (Cornell University)
  4. Multimodal Sentiment Analysis: A Multitask Learning Approach
    Mathieu Pagé Fortin, Brahim Chaib-draa · 2019 · International Conference on Pattern Recognition Applications and Methods
  5. COBRA: Contrastive Bi-Modal Representation Algorithm
    Vishaal Udandarao, Abhishek Maiti, Deepak Srivatsav, Suryatej Reddy Vyalla, Yifang Yin, Rajiv Ratn Shah · 2020 · arXiv (Cornell University)
  6. Computer Vision – ECCV 2020
    2020 · Lecture notes in computer science
  7. Computer Vision – ECCV 2018
    Edo Collins, Radhakrishna Achanta, Sabine E. Susstrunk · 2018 · Lecture notes in computer science
  8. A deep multimodal generative and fusion framework for class-imbalanced multimodal data
    Qing Li, Guanyuan Yu, Jun Wang, Yuehao Liu · 2020 · Multimedia Tools and Applications
  9. Multimodal Fusion with Co-attention Mechanism
    Li, Pei, Li, Xinde · 2020 · 2020 IEEE 23rd International Conference on Information Fusion (FUSION)
  10. Learning Disentangled Multimodal Representations for the Fashion Domain
    Amrita Saha, Megha Nawhal, Mitesh M. Khapra, Vikas Chandrakant Raykar · 2018 · IEEE Winter Conference on Applications of Computer Vision
  11. Question-Conditioned Counterfactual Image Generation for VQA
    Pan, Jingjing, Yash Goyal, Stefan Lee · 2019 · arXiv (Cornell University)
  12. Robust Latent Representations Via Cross-Modal Translation and Alignment
    Vandana Rajan, Alessio Brutti, Andrea Cavallaro · 2021 · IEEE International Conference on Acoustics Speech and Signal Processing
  13. SMIL: Multimodal Learning with Severely Missing Modality
    Mengmeng Ma, Jian Cun Ren, Long Zhao · 2021 · arXiv (Cornell University)
  14. MCQA: Multimodal Co-attention Based Network for Question Answering
    Abhishek Kumar, Trisha Mittal, Dinesh Manocha · 2020 · arXiv (Cornell University)
  15. MMED: A multi-domain and Multi-modality event dataset
    Zhenguo Yang, Zehang Lin, Lingni Guo, Qing Li, Wenyin Liu · 2020 · Information Processing & Management
  16. Acted vs. Improvised: Domain Adaptation for Elicitation Approaches in Audio-Visual Emotion Recognition
    Haoqi Li, Yelin Kim, Cheng-Hao Kuo, Shrikanth Shri Narayanan · 2021 · Interspeech (USB)
  17. Computer Vision – ECCV 2018
    2018 · Lecture notes in computer science
  18. Evaluating the Effectiveness of Large Language Models in Representing Textual Descriptions of Geometry and Spatial Relations (Short Paper)
    Yuhan Ji, Song Gao · 2023 · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)
  19. Zero-Shot Transfer VQA Dataset
    Yuanpeng Li, Yang, Yi, Jianyu Wang, Wei Xu · 2018 · arXiv (Cornell University)
  20. CMCGAN: A Uniform Framework for Cross-Modal Visual-Audio Mutual Generation
    Wangli Hao, Zhaoxiang Zhang, He Guan · 2017 · arXiv (Cornell University)
  21. FairCVtest Demo
    Alejandro Peña, Ignacio Serna, Aythami Morales, Julián Fiérrez · 2020 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  22. Cross-Domain and Cross-Modality Transfer Learning for Multi-domain and Multi-modality Event Detection
    Zhenguo Yang, Min Cheng, Qing Li, Yukun Li, Zehang Lin, Wenyin Liu · 2017 · Lecture notes in computer science
  23. Audio-Visual Event Recognition Through the Lens of Adversary
    Juncheng B Li, Kaixin Ma, Shuhui Qu, Po-Yao Huang, Florian Metze · 2021 · IEEE International Conference on Acoustics Speech and Signal Processing
  24. Learning Alignment for Multimodal Emotion Recognition from Speech
    2019
  25. Multimodal Co-Training for Selecting Good Examples from Webly Labeled Video
    Ryota Hinami, Junwei Liang, Shin’ichi Satoh, Alexander G. Hauptmann · 2018 · arXiv (Cornell University)
  26. Teacher/Student Deep Semi-Supervised Learning for Training with Noisy Labels
    Zeyad Hailat, Xuewen Chen · 2018 · International Conference on Machine Learning and Applications
  27. MAF: Multimodal Alignment Framework for Weakly-Supervised Phrase Grounding
    Qinxin Wang, Hao Xuan Tan, Sheng Shen · 2020 · arXiv (Cornell University)
  28. Image Captioning with Unseen Objects
    Berkan Demirel, Ramazan Gökberk Cinbiş, Nazlı İkizler-Cinbiş · 2019 · OpenMETU (Middle East Technical University)
  29. Web Information Systems Engineering – WISE 2017
    Qing Li, Stanislav Klimenko, Weijia Jia · 2017 · Lecture notes in computer science
  30. Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models
    Po-Yao Huang, Mandela Patrick, Junjie Hu, Graham Neubig, Florian Metze, Alexander G. Hauptmann · 2021 · arXiv (Cornell University)
  31. Audio-Visual Event Localization via Recursive Fusion by Joint Co-Attention
    Bin Duan, Hao Tang, Wei Wang · 2020 · arXiv (Cornell University)
  32. MMED: A Multi-domain and Multi-modality Event Dataset
    Zhenguo Yang, Zehang Lin, Min Cheng · 2019 · arXiv (Cornell University)
  33. Taxonomy of multimodal self-supervised representation learning.
    Alex Fedorov, Tristan Sylvain, Margaux M. Luck, Lei Wu, Thomas P. DeRamus, Alex Kirilin, Dmitry Bleklov, Vince D. Calhoun, Sergey Plis · 2020 · arXiv (Cornell University)
  34. Multi-Modal Multiple-Instance Learning and Attribute Discovery with the Application to the Web Violent Video Detection
    Shuai Hao, Ou Wu, Weiming Hu, Jinfeng Yang · 2013 · Lecture notes in computer science
  35. Image Captioning with Unseen Objects
    Berkan Demirel, Ramazan Gökberk Cinbiş, Nazlı İkizler-Cinbiş · 2019 · arXiv (Cornell University)
  36. Acted vs. Improvised: Domain Adaptation for Elicitation Approaches in Audio-Visual Emotion Recognition
    Haoqi Li, Yelin Kim, Cheng-Hao Kuo, Shrikanth S. Narayanan · 2021 · arXiv (Cornell University)