VL-BERT: Pre-training of Generic Visual-Linguistic Representations

Su, Weijie, Zhu, Xizhou, Cao, Yue, Li, Bin, Lu, Lewei, Wei, Furu, Dai, Jifeng·2019·arXiv

Cited by (957)

Items 401–500 of 957

  1. Multilingual Speech Translation with Efficient Finetuning of Pretrained Models
    Xian Li, Changhan Wang, Yun Tang, Tran, Chau, Yuqing Tang, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli · 2020 · arXiv (Cornell University)
  2. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: Student Research Workshop
    2021
  3. Cross-Modal Sentiment Sensing with Visual-Augmented Representation and Diverse Decision Fusion
    Sun Zhang, Bo Li, Chunyong Yin · 2021 · Sensors
  4. Space-Time Crop & Attend: Improving Cross-modal Video Representation Learning
    Mandela Patrick, Po-Yao Huang, Ishan Misra, Florian Metze, Andrea Vedaldi, Yuki M. Asano, Joao Henriques · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  5. A question-guided multi-hop reasoning graph network for visual question answering
    Zhaoyang Xu, Jinguang Gu, Maofu Liu, Guangyou Zhou, Haidong Fu, Chen Qiu · 2022 · Information Processing & Management
  6. Unsupervised Road Anomaly Detection with Language Anchors
    Beiwen Tian, M. Liu, Huan-ang Gao, Pengfei Li, Hao Zhao, Guyue Zhou · 2023 · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
  7. Semantic Segmentation using Foundation Models for Cultural Heritage: an Experimental Study on Notre-Dame de Paris
    Kévin Réby, Anaïs Guilhelm, Livio De Luca · 2023 · IEEE International Conference on Computer Vision Workshops
  8. LoGoPrompt: Synthetic Text Images Can Be Good Visual Prompts for Vision-Language Models
    Shi Cheng, Sibei Yang · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  9. Inspecting the Geographical Representativeness of Images from Text-to-Image Models
    Basu, Abhipsa, Babu, R. Venkatesh, Pruthi, Danish · 2023 · 2023 IEEE/CVF International Conference on Computer Vision (ICCV)
  10. Recommending Themes for Ad Creative Design via Visual-Linguistic Representations
    Yichao Zhou, Shaunak Mishra, Manisha Verma, Narayan L. Bhamidipati, Wei William Wang · 2020 · International World Wide Web Conference (WWW)
  11. Proceedings of the 5th Workshop on Online Abuse and Harms (WOAH 2021)
    2021
  12. What do they “meme”? A metaphor-aware multi-modal multi-task framework for fine-grained meme understanding
    Bingbing Wang, Shijue Huang, Bin Liang, Geng Tu, Min Yang, Ruifeng Xu · 2024 · Knowledge-Based Systems
  13. Cross-lingual Cross-modal Pretraining for Multimodal Retrieval
    Hongliang Fei, Tan Yu, Ping Li · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  14. Decoupled Cross-Modal Phrase-Attention Network for Image-Sentence Matching
    Zhangxiang Shi, Tianzhu Zhang, Xi Wei, Feng He Wu, Yongdong Zhang · 2022 · IEEE Transactions on Image Processing
  15. Masked Vision-language Transformer in Fashion
    Ge-Peng Ji, Mingchen Zhuge, Dehong Gao, Deng-Ping Fan, Christos Sakaridis, Luc Van Gool · 2023 · Machine Intelligence Research
  16. FashionSAP: Symbols and Attributes Prompt for Fine-Grained Fashion Vision-Language Pre-Training
    Yunpeng Han, Lisai Zhang, Qingcai Chen, Zhijian Chen, Zhonghua Li, Jianxin Yang, Zhao Cao · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  17. Notice of Removal: DeltaEdit: Exploring Text-free Training for Text-Driven Image Manipulation
    Yueming Lyu, Tianwei Lin, Fu Li, Dongliang He, Jing Dong, Tieniu Tan · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  18. Reservoir Computing Transformer for Image-Text Retrieval
    Wenrui Li, Zhengyu Ma, Liang-Jian Deng, Penghong Wang, Jinqiao Shi, Xiaopeng Fan B · 2023 · ACM International Conference on Multimedia (ACM MM)
  19. Multi-event Video-Text Retrieval
    Gengyuan Zhang, Jisen Ren, Jindong Gu, Volker Tresp C · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  20. HairCLIPv2: Unifying Hair Editing via Proxy Feature Blending
    Tianyi Wei, Dongdong Chen, Wenbo Zhou, Jing Liao, Weiming Zhang, Gang Hua, Nenghai Yu · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  21. RSAdapter: Adapting Multimodal Models for Remote Sensing Visual Question Answering
    Yuduo Wang, Pedram Ghamisi · 2024 · IEEE Transactions on Geoscience and Remote Sensing
  22. The Singleton Fallacy: Why Current Critiques of Language Models Miss the Point
    Magnus Sahlgren, Fredrik Carlsson · 2021 · Frontiers in Artificial Intelligence
  23. SemVLP: Vision-Language Pre-training by Aligning Semantics at Multiple Levels
    Chenliang Li, Ming Yan, Haiyang Xu, Fuli Luo, Wei Wang, Bin Bi, Songfang Huang · 2021 · arXiv (Cornell University)
  24. A Survey on MLLMs in Education: Application and Future Directions
    Weicheng Xing, Tianqing Zhu, Jenny Wang, Bo Liu · 2024 · Future Internet
  25. VisdaNet: Visual Distillation and Attention Network for Multimodal Sentiment Classification
    Shangwu Hou, Gulanbaier Tuerhong, Mairidan Wushouer · 2023 · Sensors
  26. YORO - Lightweight End to End Visual Grounding
    Chih-Hui Ho, Srikar Appalaraju, Bhavan A. Jasani, Raghaven Manmatha, Nuno M. Vasconcelos · 2023 · Lecture notes in computer science
  27. Multi-Granularity Matching Transformer for Text-Based Person Search
    Liping Bao, Longhui Wei, Wengang Zhou, Lin Liu, Lingxi Xie, Houqiang Li, Qi Tian · 2023 · IEEE Transactions on Multimedia
  28. DIME-FM : DIstilling Multimodal and Efficient Foundation Models
    Ximeng Sun, Pengchuan Zhang, Peizhao Zhang, Hardik Shah, Kate Saenko, Xide Xia · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  29. HowToCaption: Prompting LLMs to Transform Video Annotations at Scale
    Nina Shvetsova, Anna Kukleva, Xudong Hong, Christian Rupprecht, Bernt Schiele, Hilde Kuehne · 2024 · Lecture notes in computer science
  30. Variational Knowledge Distillation for Disease Classification in Chest X-Rays
    Tom van Sonsbeek, Xiantong Zhen, Marcel Worring, Ling Shao · 2021 · Lecture notes in computer science
  31. Fine-grained Semantic Alignment Network for Weakly Supervised Temporal Language Grounding
    Yuechen Wang, Wengang Zhou, Houqiang Li · 2021 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  32. ManiTrans: Entity-Level Text-Guided Image Manipulation via Token-wise Semantic Alignment and Generation
    Jianan Wang, Guansong Lu, Hang Xu, Zhenguo Li, Chunjing Xu, Yanwei Fu · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  33. Koala: Key Frame-Conditioned Long Video-LLM
    Reuben Tan, Ximeng Sun, Ping Hu, Jui-Hsien Wang, Hanieh Deilamsalehy, Bryan A. Plummer, Bryan Christopher Russell, Kate Saenko · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  34. Accuracy vs. complexity: A trade-off in visual question answering models
    Moshiur R. Farazi, Salman Hameed Khan, Nick M. Barnes · 2021 · Pattern Recognition
  35. Data Efficient Masked Language Modeling for Vision and Language
    Yonatan Bitton, Michael Elhadad, Gabriel Stanovsky, Roy Schwartz · 2021 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  36. Multi visual and textual embedding on visual question answering for blind people
    Tung Le, Huy Tien Nguyen, Le-Minh Nguyen · 2021 · Neurocomputing
  37. Mobile App Crowdsourced Test Report Consistency Detection via Deep Image-and-Text Fusion Understanding
    Shengcheng Yu, Chunrong Fang, Quanjun Zhang, Zhihao Cao, Yexiao Yun, Zhenfei Cao, Kai Mei, Zhenyu Chen · 2023 · IEEE Transactions on Software Engineering
  38. Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training
    Yan Zeng, Wangchunshu Zhou, Ao Luo, Ziming Cheng, Xinsong Zhang · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  39. The Potential of a Visual Dialogue Agent In a Tandem Automated Audio Description System for Videos
    Abigale J. Stangl, Shasta M. Ihorn, Yue-Ting Siu, Aditya Bodi, Mar Castanon, Lothar D Narins, Ilmi Yoon · 2023 · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)
  40. An Empirical Study of Multimodal Model Merging
    Yi-Lin Sung, Linjie Li, Kevin Lin, Zhe Gan, Mohit Bansal, Lijuan Wang · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  41. CoVR-2: Automatic Data Construction for Composed Video Retrieval
    Lucas Ventura, Antoine Yang, Cordelia Schmid, Gül Varol · 2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  42. Domain Prompt Learning with Quaternion Networks
    Qinglong Cao, Zhengqin Xu, Yuntian Chen, M. Chao, Xiaokang Yang · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  43. Jack of All Tasks, Master of Many: Designing General-purpose Coarse-to-Fine Vision-Language Model
    Shraman Pramanick, Guangxing Han, Rui Hou, Sayan Nag, Ser-Nam Lim, Nicolas Ballas, Qifan Wang, Rama Chellappa, Amjad Almahairi · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  44. VLGrammar: Grounded Grammar Induction of Vision and Language
    Yining Hong, Qing Li, Song Chun Zhu, Siyuan Huang · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  45. MELINDA: A Multimodal Dataset for Biomedical Experiment Method Classification
    Te-Lin Wu, Shikhar Singh, Sayan Paul, Gully Burns, Nanyun Peng · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
  46. Video Question Answering with Iterative Video-Text Co-tokenization
    AJ Piergiovanni, Kairo Morton, Weicheng Kuo, Michael S. Ryoo, Anelia Angelova · 2022 · Lecture notes in computer science
  47. Seeing the Unseen: Visual Common Sense for Semantic Placement
    Ram Ramrakhya, Aniruddha Kembhavi, Dhruv Batra, Zsolt Kira, Kuo-Hao Zeng, Luca Weihs · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  48. Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation
    Matthieu Futeral, Cordelia Schmid, Ivan Laptev, Benoît Sagot, Rachel Bawden · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  49. Deeply Coupled Cross-Modal Prompt Learning
    Xuejing Liu, Wei Tang, Jinghui Lu, Rui Zhao, Zhaojun Guo, Fei Zhi Tan · 2023 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  50. Deep visual-linguistic fusion network considering cross-modal inconsistency for rumor detection
    Yang Yang, Ran Bao, Weili Guo, De‐Chuan Zhan, Yilong Yin, Jian Jun Yang · 2023 · Science China Information Sciences
  51. CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation
    Devaansh Gupta, Siddhant Kharbanda, Jiawei Zhou, Wanhua Li, Hanspeter Pfister, Donglai Wei · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  52. Monocular 3D Object Detection with Bounding Box Denoising in 3D by Perceiver
    Xianpeng Liu, Ce Zheng, Kelvin Cheng, Nan Xue, Guo-Jun Qi, Tianfu Wu · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  53. MCA: Moment Channel Attention Networks
    Yangbo Jiang, Zhiwei Jiang, Le Han, Zenan Huang, Nenggan Zheng · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
  54. Center-enhanced video captioning model with multimodal semantic alignment
    Benhui Zhang, Junyu Gao, Yuan Yuan · 2024 · Neural Networks
  55. Unsupervised Natural Language Inference via Decoupled Multimodal Contrastive Learning
    Cui, Wanyun, Zheng, Guangyu, Wang, Wei · 2020 · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
  56. Learning Relation Alignment for Calibrated Cross-modal Retrieval
    Shuhuai Ren, Junyang Lin, Guangxiang Zhao, Rui Men, Yang An, Jingren Zhou, Xu Sun, Hongxia Yang · 2021
  57. A Survey of Large Language Model for Drug Research and Development
    Huijie Guo, Xudong Xing, Yongjie Zhou, Wenjiao Jiang, Xiaoyi Chen, Ting Wang, Zixuan Jiang, Yibing Wang, Junyan Hou, Yukun Jiang et al. · 2025 · IEEE Access
  58. MIRTT: Learning Multimodal Interaction Representations from Trilinear Transformers for Visual Question Answering
    Junjie Wang, Yatai Ji, Jiaqi Sun, Yujiu Yang, Tetsuya Sakai · 2021 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  59. Depth-Aware and Semantic Guided Relational Attention Network for Visual Question Answering
    Yuhang Liu, Wei Wei, Daowan Peng, Xian-Ling Mao, HE Zhi-yong, Pan Zhou · 2022 · IEEE Transactions on Multimedia
  60. Cross-Modality Pyramid Alignment for Visual Intention Understanding
    Mang Ye, Qinghongya Shi, Kehua Su, Bo Du · 2023 · IEEE Transactions on Image Processing
  61. University Student Dropout Prediction Using Pretrained Language Models
    Hyun-Sik Won, M Kim, Dohyun Kim, Hee‐Soo Kim, Kang-Min Kim · 2023 · Applied Sciences
  62. Multimodality in language education: implications of a multimodal affective perspective in foreign language teaching
    Xiaoshuang Guo · 2023 · Frontiers in Psychology
  63. Align Before Adapt: Leveraging Entity-to-Region Alignments for Generalizable Video Action Recognition
    Yifei Chen, Dapeng Chen, Ruijin Liu, Sai Zhou, Wenyuan Xue, Wei Peng · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  64. Open-Vocabulary Camouflaged Object Segmentation
    Youwei Pang, Xiaoqi Zhao, Jiaming Zuo, Lihe Zhang, Huchuan Lu · 2024 · Lecture notes in computer science
  65. Efficient Prompt Tuning of Large Vision-Language Model for Fine-Grained Ship Classification
    Long Lan, Fengxiang Wang, Xiangtao Zheng, Zengmao Wang, Xinwang Liu · 2024 · IEEE Transactions on Geoscience and Remote Sensing
  66. CSS-LM: A Contrastive Framework for Semi-Supervised Fine-Tuning of Pre-Trained Language Models
    Yusheng Su, Xu Han, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Peng Li, Jie Zhou, Maosong Sun · 2021 · IEEE/ACM Transactions on Audio Speech and Language Processing
  67. Linguistically Routing Capsule Network for Out-of-distribution Visual Question Answering
    Qingxing Cao, Wentao Wan, Keze Wang, Xiaodan Liang, Liang Lin · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  68. ECG-ViT: A Transformer-Based ECG Classifier for Energy-Constraint Wearable Devices
    Neha Shukla, Anand Kishor Pandey, Anand Prakash Shukla, Sanjeev Chandra Neupane · 2022 · Journal of Sensors · Retracted
  69. Open-set domain adaptation with visual-language foundation models
    Qing Yu, Go Irie, Kiyoharu Aizawa · 2024 · Computer Vision and Image Understanding
  70. Layout-Aware Dreamer for Embodied Visual Referring Expression Grounding
    Mingxiao Li, Zehao Wang, Tinne Tuytelaars, Marie‐Francine Moens · 2023 · Proceedings of the AAAI Conference on Artificial Intelligence
  71. Multi-modal adaptive gated mechanism for visual question answering
    Yangshuyi Xu, Lin Zhang, Xiang Shen · 2023 · PLoS ONE
  72. Attention-Based Multimodal Deep Learning on Vision-Language Data: Models, Datasets, Tasks, Evaluation Metrics and Applications
    Priyankar Bose, Pratip Rana, Preetam Ghosh · 2023 · IEEE Access
  73. Can Language Models Understand Physical Concepts?
    Lei Li, Jingjing Xu, Qingxiu Dong, Ce Zheng, Xu Sun, Lingpeng Kong, Qi Liu · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  74. Enhancing Visual Grounding in Vision-Language Pre-Training With Position-Guided Text Prompts
    Jinpeng Wang, Pan Zhou, Mike Zheng Shou, Shuicheng Yan · 2023 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  75. Improving Medical Speech-to-Text Accuracy using Vision-Language Pre-training Models
    Jaeyoung Huh, Sang Joon Park, Jeong Eun Lee, Jong Chul Ye · 2023 · IEEE Journal of Biomedical and Health Informatics
  76. Learning to Ground Instructional Articles in Videos through Narrations
    Effrosyni Mavroudi, Triantafyllos Afouras, Lorenzo Torresani · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  77. An Overview of Text-Based Person Search: Recent Advances and Future Directions
    Kai Niu, Yanyi Liu, Yuzhou Long, Yan Huang, Liang Wang, Yanning Zhang · 2024 · IEEE Transactions on Circuits and Systems for Video Technology
  78. EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE
    Junyi Chen, Longteng Guo, Jia Sun, Shuai Shao, Zehuan Yuan, Liang Lin, Dongyu Zhang · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
  79. Rethinking Multimodal Content Moderation from an Asymmetric Angle with Mixed-modality
    Jialin Yuan, Ye Yu, Gaurav Kumar Mittal, Matthew Hall, Sandra Sajeev, Mei Chen · 2024 · IEEE Winter Conference on Applications of Computer Vision
  80. ModaVerse: Efficiently Transforming Modalities with LLMs
    Xinyu Wang, Bohan Zhuang, Qi Wu · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  81. Single-Stream Multi-level Alignment for Vision-Language Pretraining
    Zaid Khan, B. G. Vijay Kumar, Xiang Yu, Samuel Schulter, Manmohan Krishna Chandraker, Yun Fu · 2022 · Lecture notes in computer science
  82. Learning to Agree on Vision Attention for Visual Commonsense Reasoning
    Zhenyang Li, Yangyang Guo, Kejie Wang, Fan Liu, Liqiang Nie, Mohan Kankanhalli · 2023 · IEEE Transactions on Multimedia
  83. PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pre-Training
    Rogerio Bonatti, Sai H. Vemprala, Shuang Ma, Felipe Vieira Frujeri, Shuhang Chen, Ashish Kapoor · 2023 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
  84. High-Fidelity Audio Generation and Representation Learning With Guided Adversarial Autoencoder
    Kazi Nazmul Haque, Rajib Kumar Rana, Björn Wolfgang Schuller · 2020 · IEEE Access
  85. Reasoning over Vision and Language: Exploring the Benefits of Supplemental Knowledge
    Violetta Shevchenko, Damien Teney, Anthony Dick, Anton van den Hengel · 2021 · arXiv (Cornell University)
  86. Assessing Multilingual Fairness in Pre-trained Multimodal Representations
    Jialu Wang, Yang Liu, Xin Wang · 2022 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  87. Learning Better Visual Dialog Agents with Pretrained Visual-Linguistic Representation
    Tao Tu, Qing Ping, Govindarajan Thattai, Gökhan Tür, Prem Natarajan · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  88. Effect of Visual Extensions on Natural Language Understanding in Vision-and-Language Models
    Taichi Iki, Akiko Aizawa · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  89. Vision-and-Language Navigation Based on Cross-Modal Feature Fusion in Indoor Environment
    Shuhuan Wen, Xiaohan Lv, Fei Richard Yu, Simeng Gong · 2021 · IEEE Transactions on Cognitive and Developmental Systems
  90. Reasoning with Multi-Structure Commonsense Knowledge in Visual Dialog
    Shunyu Zhang, Xiaoze Jiang, Zequn Yang, Tao Wan, Zengchang Qin · 2022 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  91. TableVLM: Multi-modal Pre-training for Table Structure Recognition
    Leiyuan Chen, Chengsong Huang, Xiaoqing Zheng, Jinshu Lin, Xuanjing Huang · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  92. Semantic-Aware Modular Capsule Routing for Visual Question Answering
    Yudong Han, Jianhua Yin, Jianlong Wu, Yinwei Wei, Liqiang Nie · 2023 · IEEE Transactions on Image Processing
  93. RSRNeT: a novel multi-modal network framework for named entity recognition and relation extraction
    Min Wang, Hongbin Chen, Dingcai Shen, Baolei Li, Shiyu Hu · 2024 · PeerJ Computer Science
  94. CAD - Contextual Multi-modal Alignment for Dynamic AVQA
    Asmar Nadeem, Adrian Hilton, Robert Dawes, Graham Thomas, Armin Mustafa · 2024 · IEEE Winter Conference on Applications of Computer Vision
  95. Vision and Structured-Language Pretraining for Cross-Modal Food Retrieval
    Mustafa Shukor, Nicolas Thome, Matthieu Cord · 2024 · Computer Vision and Image Understanding
  96. A large cross-modal video retrieval dataset with reading comprehension
    Weijia Wu, Yuzhong Zhao, Zhuang Li, Jiahong Li, Hong Zhou, Mike Zheng Shou, Xiang Bai · 2024 · Pattern Recognition
  97. Linguistic issues behind visual question answering
    Raffaella Bernardi, Sandro Pezzelle · 2021 · Language and Linguistics Compass
  98. Vector Semiotic Model for Visual Question Answering
    Alexey K. Kovalev, Makhmud Shaban, Evgeny Osipov, Aleksandr I. Panov · 2021 · Cognitive Systems Research
  99. Owner name entity recognition in websites based on multiscale features and multimodal co-attention
    Yimo Ren, Hong Li, Peipei Liu, Jie Liu, Hongsong Zhu, Limin Sun · 2023 · Expert Systems with Applications
  100. Visually Grounded Continual Learning of Compositional Phrases
    Xisen Jin, Junyi Du, Arka Sadhu, Ram Nevatia, Xiang Ren · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)