Multimodal Learning With Transformers: A Survey

Xu, Peng, Zhu, Xiatian, Clifton, David A.·2023·IEEE Transactions on Pattern Analysis and Machine Intelligence
DOI 10.1109/tpami.2023.3275156

Cites (290)

Items 201–290 of 290

  1. Revamping Cross-Modal Recipe Retrieval with Hierarchical Transformers and Self-supervised Learning
    Amaia Salvador, Erhan Gündoğdu, Loris Bazzani, Michael Donoser · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  2. Context-aware Scene Graph Generation with Seq2Seq Transformers
    Yichao Lu, Himanshu Rai, Jason S. Chang, Boris A. Knyazev, Guangwei Yu, Shashank Shekhar, Graham W. Taylor, Maksims Volkovs · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  3. E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning
    Xu, Haiyang, Yan, Ming, Li, Chenliang, Bi, Bin, Huang, Songfang, Xiao, Wenming, Huang, Fei · 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
  4. A Comparison of Pre-trained Vision-and-Language Models for Multimodal Representation Learning across Medical Images and Reports
    Li, Yikuan, Wang, Hanyin, Luo, Yuan · 2020 · 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
  5. Humor Knowledge Enriched Transformer for Understanding Multimodal Humor
    Md Kamrul Hasan, Sangwu Lee, Wasifur Rahman, Amir Zadeh, Rada F. Mihalcea, Louis‐Philippe Morency, Mohammed Ehsan Hoque · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
  6. The Road to Know-Where: An Object-and-Room Informed Sequential BERT for Indoor Vision-Language Navigation
    Qi, Yuankai, Pan, Zizheng, Hong, Yicong, Yang, Ming-Hsuan, van den Hengel, Anton, Wu, Qi · 2021 · 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
  7. Learning from the Master: Distilling Cross-modal Advanced Knowledge for Lip Reading
    Sucheng Ren, Yong Du, Jianming Lv, Guoqiang Han, Shengfeng He · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  8. Multiple Instance Captioning: Learning Representations from Histopathology Textbooks and Articles
    Gamper, Jevgenij, Rajpoot, Nasir · 2021 · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  9. Towards Accurate Text-based Image Captioning with Content Diversity Exploration
    Guanghui Xu, Shuaicheng Niu, Mingkui Tan, Yucheng Luo, Qing Du, Qi Wu · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  10. Long-Short Transformer: Efficient Transformers for Language and Vision
    Chen Zhu, Wei Ping, Chaowei Xiao, Mohammad Shoeybi, Tom Goldstein, Animashree Anandkumar, Bryan Catanzaro · 2021 · CaltechAUTHORS (California Institute of Technology)
  11. Target Adaptive Context Aggregation for Video Scene Graph Generation
    Teng, Yao, Wang, Limin, Li, Zhifeng, Wu, Gangshan · 2021 · 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
  12. Learning to Generate Scene Graph from Natural Language Supervision
    Zhong, Yiwu, Shi, Jing, Yang, Jianwei, Xu, Chenliang, Li, Yin · 2021 · 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
  13. Sketch, Ground, and Refine: Top-Down Dense Video Captioning
    Chaorui Deng, Shizhe Chen, Da Chen, Yuan He, Qi Wu · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  14. Temporal Alignment Networks for Long-term Video
    Tengda Han, Weidi Xie, Andrew Zisserman · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  15. Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers
    Stella Frank, Emanuele Bugliarello, Desmond Elliott · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  16. XGPT: Cross-modal Generative Pre-Training for Image Captioning
    Xia, Qiaolin, Huang, Haoyang, Duan, Nan, Zhang, Dongdong, Ji, Lei, Sui, Zhifang, Cui, Edward, Bharti, Taroon, Zhou, Ming · 2021 · Lecture Notes in Computer Science
  17. e-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language Tasks
    Kayser, Maxime, Camburu, Oana-Maria, Salewski, Leonard, Emde, Cornelius, Do, Virginie, Akata, Zeynep, Lukasiewicz, Thomas · 2021 · 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
  18. Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models
    Linjie Li, Jie Lei, Zhe Gan, Jingjing Liu · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  19. Probing Image-Language Transformers for Verb Understanding
    Hendricks, Lisa Anne, Nematzadeh, Aida · 2021 · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
  20. Bridged Transformer for Vision and Point Cloud 3D Object Detection
    Yikai Wang, TengQi Ye, Lele Cao, Wenbing Huang, Fuchun Sun, Fengxiang He, Dacheng Tao · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  21. VX2TEXT: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs
    Xudong Lin, Gedas Bertasius, Jue Wang, Shih‐Fu Chang, Devi Parikh, Lorenzo Torresani · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  22. 3D Scene Reconstruction With Multi-Layer Depth and Epipolar Transformers
    Shin, Daeyun, Ren, Zhile, Sudderth, Erik, Fowlkes, Charless · 2019 · 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
  23. M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
    Ni, Minheng, Huang, Haoyang, Su, Lin, Cui, Edward, Bharti, Taroon, Wang, Lijuan, Zhang, Dongdong, Duan, Nan · 2021 · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  24. Survey: Transformer based video-language pre-training
    Ludan Ruan, Qin Jin · 2022 · AI Open
  25. How to Understand Masked Autoencoders
    Shuhao Cao, Peng Xu, David Andrew Clifton · 2022 · arXiv (Cornell University)
  26. Words Aren’t Enough, Their Order Matters: On the Robustness of Grounding Visual Referring Expressions
    Arjun Akula, Spandana Gella, Yaser Al-Onaizan, Song Chun Zhu, Siva Reddy · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  27. Product1M: Towards Weakly Supervised Instance-Level Product Retrieval via Cross-Modal Pretraining
    Zhan, Xunlin, Wu, Yangxin, Dong, Xiao, Wei, Yunchao, Lu, Minlong, Zhang, Yichi, Xu, Hang, Liang, Xiaodan · 2021 · 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
  28. Deep Self-Supervised Representation Learning for Free-Hand Sketch
    Xu, Peng, Song, Zeyu, Yin, Qiyue, Song, Yi-Zhe, Wang, Liang · 2021 · IEEE Transactions on Circuits and Systems for Video Technology
  29. MultiMET: A Multimodal Dataset for Metaphor Understanding
    Dongyu Zhang, Minghao Zhang, Heting Zhang, Liang Yang, Hongfei Lin · 2021
  30. Vision-Language Intelligence: Tasks, Representation Learning, and Large Models
    Feng Li, Hao Zhang, Yifan Zhang, Shilong Liu, Jian Guo, Lionel Ming-shuan Ni, PengChuan Zhang, Lei Zhang · 2022 · arXiv (Cornell University)
  31. Parameter Efficient Multimodal Transformers for Video Representation Learning
    Lee, Sangho, Yu, Youngjae, Kim, Gunhee, Breuel, Thomas, Kautz, Jan, Song, Yale · 2020 · arXiv
  32. Scheduled Sampling in Vision-Language Pretraining with Decoupled Encoder-Decoder Network
    Li, Yehao, Pan, Yingwei, Yao, Ting, Chen, Jingwen, Mei, Tao · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
  33. Playing Lottery Tickets with Vision and Language
    Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang, Zicheng Liu · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
  34. VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers
    Estelle Aflalo, Meng Du, Shao-Yen Tseng, Yongfei Liu, Chenfei Wu, Nan Duan, Vasudev Lal · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  35. CLIP-TD: CLIP Targeted Distillation for Vision-Language Tasks
    Zhecan Wang, Noel Codella, Yen-Chun Chen, Luowei Zhou, Jianwei Yang, Xiyang Dai, Xiao, Bin, Haoxuan You, Shih‐Fu Chang, Lu Yuan · 2022 · arXiv (Cornell University)
  36. Probing Inter-modality: Visual Parsing with Self-Attention for Vision-Language Pre-training
    Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, Jiebo Luo · 2021 · arXiv (Cornell University)
  37. Exploring Cross-Video and Cross-Modality Signals for Weakly-Supervised Audio-Visual Video Parsing
    Yan-Bo Lin, Hung-Yu Tseng, Hsin-Ying Lee, Yen‐Yu Lin, Ming–Hsuan Yang · 2021 · neural information processing systems
  38. SGEITL: Scene Graph Enhanced Image-Text Learning for Visual Commonsense Reasoning
    Zhecan Wang, Haoxuan You, Liunian Harold Li, Alireza Zareian, Suji Park, Yiqing Liang, Kai-Wei Chang, Shih‐Fu Chang · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
  39. CommerceMM
    Licheng Yu, Jun Chen, Animesh Sinha, Mengjiao Wang, Yu Chen, Tamara L. Berg, Ning Zhang · 2022 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
  40. A Survey of Visual Transformers
    Yang Liu, Yao Zhang, Yixin Wang · 2021 · arXiv (Cornell University)
  41. Actor-Transformers for Group Activity Recognition
    Kirill Gavrilyuk, Ryan Sanford, Mehrsan Javan, Cees G. M. Snoek · 2020 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  42. Fine-Grained Instance-Level Sketch-Based Video Retrieval
    Peng Xu, Kun Liu, Tao Xiang, Timothy M. Hospedales, Zhanyu Ma, Jun Hai Guo, Yi-Zhe Song · 2020 · IEEE Transactions on Circuits and Systems for Video Technology
  43. Rethinking the Value of Transformer Components
    Wang, Wenxuan, Tu, Zhaopeng · 2020 · Proceedings of the 28th International Conference on Computational Linguistics
  44. Read and Attend: Temporal Localisation in Sign Language Videos
    Varol, Gul, Momeni, Liliane, Albanie, Samuel, Afouras, Triantafyllos, Zisserman, Andrew · 2021 · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  45. Dynamic Graph Representation Learning for Video Dialog via Multi-Modal Shuffled Transformers
    Geng, Shijie, Gao, Peng, Chatterjee, Moitreya, Hori, Chiori, Le Roux, Jonathan, Zhang, Yongfeng, Li, Hongsheng, Cherian, Anoop · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
  46. LayoutTransformer: Scene Layout Generation with Conceptual and Spatial Diversity
    Cheng-Fu Yang, Wan-Cyuan Fan, Fu-En Yang, Yu-Chiang Frank Wang · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  47. The Right to Talk: An Audio-Visual Transformer Approach
    Truong, Thanh-Dat, Duong, Chi Nhan, De Vu, The, Pham, Hoang Anh, Raj, Bhiksha, Le, Ngan, Luu, Khoa · 2021 · 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
  48. GilBERT: Generative Vision-Language Pre-Training for Image-Text Retrieval
    Hong, Weixiang, Ji, Kaixiang, Liu, Jiajia, Wang, Jian, Chen, Jingdong, Chu, Wei · 2021 · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval
  49. COOKIE: Contrastive Cross-Modal Knowledge Sharing Pre-training for Vision-Language Representation
    Wen, Keyu, Xia, Jin, Huang, Yuanyuan, Li, Linyang, Xu, Jiayan, Shao, Jie · 2021 · 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
  50. Video Object Grounding Using Semantic Roles in Language Description
    Sadhu, Arka, Chen, Kan, Nevatia, Ram · 2020 · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  51. 3D Human Texture Estimation from a Single Image with Transformers
    Xiangyu Xu, Chen Change · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  52. Contrast and Classify: Training Robust VQA Models
    Yash Kant, Abhinav Moudgil, Dhruv Batra, Devi Parikh, Harsh Agrawal · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  53. TVT: Two-View Transformer Network for Video Captioning.
    Ming Chen, Yingming Li, Zhongfei Mark Zhang · 2018 · Asian Conference on Machine Learning
  54. M6: Multi-Modality-to-Multi-Modality Multitask Mega-transformer for Unified Pretraining
    Junyang Lin, Rui Men, Yang An, Chang Zhou, Yichang Zhang, Peng Wang, Jingren Zhou, Jie Tang, Hongxia Yang · 2021 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
  55. A Closer Look at the Robustness of Vision-and-Language Pre-trained Models
    Linjie Li, Zhe Gan, Jingjing Liu · 2020 · arXiv (Cornell University)
  56. VisQA: X-raying Vision and Language Reasoning in Transformers
    Jaunet, Theo, Kervadec, Corentin, Vuillemot, Romain, Antipov, Grigory, Baccouche, Moez, Wolf, Christian · 2022 · IEEE Transactions on Visualization and Computer Graphics
  57. End-to-end Multi-modal Video Temporal Grounding
    Yiwen Chen, Yi–Hsuan Tsai, Ming–Hsuan Yang · 2021 · arXiv (Cornell University)
  58. Aligning Subtitles in Sign Language Videos
    Bull, Hannah, Afouras, Triantafyllos, Varol, Gul, Albanie, Samuel, Momeni, Liliane, Zisserman, Andrew · 2021 · 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
  59. Beyond Mono to Binaural: Generating Binaural Audio from Mono Audio with Depth and Cross Modal Attention
    Parida, Kranti Kumar, Srivastava, Siddharth, Sharma, Gaurav · 2022 · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
  60. ERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language Generation
    Han Zhang, Weichong Yin, Yewei Fang · 2021 · arXiv (Cornell University)
  61. Multi-Modal Dynamic Graph Transformer for Visual Grounding
    Chen, Sijia, Li, Baochun · 2022 · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  62. SemVLP: Vision-Language Pre-training by Aligning Semantics at Multiple Levels
    Chenliang Li, Ming Yan, Haiyang Xu, Fuli Luo, Wei Wang, Bin Bi, Songfang Huang · 2021 · arXiv (Cornell University)
  63. KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation
    Yongfei Liu, Chenfei Wu, Shao-Yen Tseng, Vasudev Lal, Xuming He, Nan Duan · 2022 · Findings of the Association for Computational Linguistics: NAACL
  64. SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQL
    Ruichu Cai, Jinjie Yuan, Boyan Xu · 2021 · arXiv (Cornell University)
  65. Masking Modalities for Cross-modal Video Retrieval
    Valentin Gabeur, Arsha Nagrani, Chen Sun, Karteek Alahari, Cordelia Schmid · 2022 · IEEE Winter Conference on Applications of Computer Vision
  66. Multi-query Video Retrieval
    Zeyu Wang, Yu Wu, Karthik Narasimhan, Olga Russakovsky · 2022 · Lecture notes in computer science
  67. How Transferable are Reasoning Patterns in VQA?
    Kervadec, Corentin, Jaunet, Theo, Antipov, Grigory, Baccouche, Moez, Vuillemot, Romain, Wolf, Christian · 2021 · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  68. Domain-robust VQA with diverse datasets and methods but no target labels
    Mingda Zhang, Tristan D. Maidment, Ahmad Diab, Adriana Kovashka, Rebecca Hwa · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  69. ProTo: Program-Guided Transformer for Program-Guided Tasks
    Zelin Zhao, Karan Samel, Binghong Chen, lee song · 2021 · arXiv (Cornell University)
  70. Multimodal and Multilingual Embeddings for Large-Scale Speech Mining
    Paul-Ambroise Duquenne, Hongyu Gong, Holger Schwenk · 2021 · neural information processing systems
  71. Topic Scene Graph Generation by Attention Distillation from Caption
    Wenbin Wang, Ruiping Wang, Xilin Chen · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  72. Towards a Unified Foundation Model: Jointly Pre-Training Transformers on Unpaired Images and Text
    Li, Qing, Boqing Gong, Yin Cui, Dan Kondratyuk, Xianzhi Du, Ming–Hsuan Yang, Brown, Matthew · 2021 · arXiv (Cornell University)
  73. MAM: Masked Acoustic Modeling for End-to-End Speech-to-Text Translation
    Junkun Chen, Mingbo Ma, Renjie Zheng, Liang Huang · 2020 · arXiv (Cornell University)
  74. PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models
    Chaoyang He, Li Shen, Mahdi Soltanolkotabi, Salman Avestimehr · 2021 · International Conference on Machine Learning
  75. X-World: Accessibility, Vision, and Autonomy Meet
    Jimuyang Zhang, Minglan Zheng, Matthew Boyd, Eshed Ohn-Bar · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  76. Vset: A Multimodal Transformer for Visual Speech Enhancement
    Karthik Ramesh, Chao Xing, Wupeng Wang, Dong Wang, Xiao Chen · 2021 · IEEE International Conference on Acoustics Speech and Signal Processing
  77. Learning Contextual Tag Embeddings for Cross-Modal Alignment of Audio and Tags
    Xavier Favory, Konstantinos Drossos, Tuomas I. Virtanen, Xavier Serra · 2021 · IEEE International Conference on Acoustics Speech and Signal Processing
  78. Speech2Action: Cross-Modal Supervision for Action Recognition
    Nagrani, Arsha, Sun, Chen, Ross, David, Sukthankar, Rahul, Schmid, Cordelia, Zisserman, Andrew · 2020 · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  79. Multi-stage Pre-training over Simplified Multimodal Pre-training Models
    Liu, Tongtong, Feng, Fangxiang, Wang, Xiaojie · 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
  80. Speech-T: Transducer for Text to Speech and Beyond
    Jiawei Chen, Xu Tan, Yichong Leng, Jin Xu, Guihua Wen, Tao Qin, Tie‐Yan Liu · 2021 · neural information processing systems
  81. DeepChange: A Large Long-Term Person Re-Identification Benchmark with Clothes Change
    Peng Xu, Xiatian Zhu · 2021 · arXiv (Cornell University)
  82. Multimodal Multi-Speaker Merger & Acquisition Financial Modeling: A New Task, Dataset, and Neural Baselines
    Sawhney, Ramit, Goyal, Mihir, Goel, Prakhar, Mathur, Puneet, Shah, Rajiv Ratn · 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
  83. Using BERT Encoding and Sentence-Level Language Model for Sentence Ordering
    Melika Golestani, Seyedeh Zahra Razavi, Zeinab Borhanifard, Farnaz Tahmasebian, Hesham Faili · 2021 · Lecture notes in computer science
  84. Robust Visual Reasoning via Language Guided Neural Module Networks
    Arjun Akula, Varun Jampani, Soravit Changpinyo, Song Chun Zhu · 2021 · neural information processing systems
  85. UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training
    Mingyang Zhou, Luowei Zhou, Shuohang Wang, Cheng Yu, Linjie Li, Yu Zhou, Jingjing Liu · 2021 · arXiv (Cornell University)
  86. TriBERT: Human-centric Audio-visual Representation Learning
    Tanzila Rahman, Mengyu Yang, Leonid Sigal · 2021 · neural information processing systems
  87. Speech-to-SQL: Towards Speech-driven SQL Query Generation From Natural Language Question
    Yuanfeng Song, Raymond Chi-Wing Wong, Xuefang Zhao · 2022 · arXiv (Cornell University)
  88. Supervising the Transfer of Reasoning Patterns in VQA
    Corentin Kervadec, Christian Wolf, Grigory Antipov, Moez Baccouche, Madiha Nadri · 2021 · arXiv (Cornell University)
  89. From Multimodal to Unimodal Attention in Transformers using Knowledge Distillation
    Dhruv Agarwal, Tanay Agrawal, Laura M. Ferrari, François Brémond · 2021 · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS)
  90. Face, Body, Voice: Video Person-Clustering with Multiple Modalities
    Andrew J. Brown, Vicky S. Kalogeiton, Andrew Zisserman · 2021 · IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)