Heterogeneous Memory Enhanced Multimodal Attention Model for Video Question Answering

Fan, Chenyou, Zhang, Xiaofan, Zhang, Shu, Wang, Wensheng, Zhang, Chi, Huang, Heng·2019·2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
DOI 10.1109/cvpr.2019.00210

Cited by (293)

Items 201–293 of 293

  1. ICSVR: Investigating Compositional and Syntactic Understanding in Video Retrieval Models
    Avinash Madasu, Vasudev Lal · 2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  2. Collaborative Aware Bidirectional Semantic Reasoning for Video Question Answering
    Xize Wu, Jiasong Wu, Lei Zhu, Lotfi Senhadji, Huazhong Shu · 2024 · IEEE Transactions on Circuits and Systems for Video Technology
  3. Data Augmentation Techniques for the Video Question Answering Task
    Alex Falcon, Oswald Lanz, Giuseppe Serra · 2020 · Lecture notes in computer science
  4. Two-Stream Spatiotemporal Compositional Attention Network for VideoQA
    Taiki Miyanishi, Takuya Maekawa, Motoaki Kawanabe · 2020 · British Machine Vision Conference (BMVC)
  5. Memory Augmented Variational Auto-Encoder for Anomaly Detection
    Xiaoyu Gao, Xiaoyong Zhao, Lei Wang · 2021 · International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI)
  6. Watch, Listen, and Answer: Open-Ended VideoQA with Modulated Multi-Stream 3D ConvNets
    Taiki Miyanishi, Motoaki Kawanabe · 2021 · European Signal Processing Conference (EUSIPCO)
  7. CoCo-BERT: Improving Video-Language Pre-training with Contrastive Cross-modal Matching and Denoising
    Jianjie Luo, Yehao Li, Yingwei Pan, Ting Yao, Hongyang Chao, Tao Mei · 2021 · arXiv (Cornell University)
  8. Graph-based relational reasoning network for video question answering
    Tao Tan, Guanglu Sun · 2024 · Machine Vision and Applications
  9. Memory association guided unsupervised anomaly detection with adaptive 3D attention
    Xu Liu, Chunlei Wu, Huan Zhang, Leiquan Wang · 2025 · Information Fusion
  10. Bilinear pooling in video-QA: empirical challenges and motivational drift from neurological parallels
    Thomas Masterman Winterbottom, Sarah Hong Xiao, Alistair McLean, Noura Al Moubayed · 2022 · PeerJ Computer Science
  11. Enabling Visual Object Detection With Object Sounds via Visual Modality Recalling Memory
    Jung Uk Kim, Yong Man Ro · 2023 · IEEE Transactions on Neural Networks and Learning Systems
  12. MMTF: Multi-Modal Temporal Fusion for Commonsense Video Question Answering
    Mobeen Ahmad, Geonwoo Park, Dongchan Park, Sanguk Park · 2023 · IEEE International Conference on Computer Vision Workshops
  13. Multimodal Transformer with Pointer Network for the DSTC8 AVSD Challenge
    Le, Hung, Nancy F. Chen · 2020 · arXiv (Cornell University)
  14. BDIQA: A New Dataset for Video Question Answering to Explore Cognitive Reasoning through Theory of Mind
    Yuanyuan Mao, Xin Alex Lin, Qin Ni, Liang He · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
  15. HSSHG: Heuristic Semantics-Constrained Spatio-Temporal Heterogeneous Graph for VideoQA
    Ruomei Wang, Yuanmao Luo, Fuwei Zhang, Mingyang Liu, Xiaonan Luo · 2024 · IEEE Transactions on Multimedia
  16. VQALS: A Video Question Answering Method in Low-Light Scenes Based on Illumination Correction and Feature Enhancement
    Jie Yang, Miao Ma, Yutong Li, Zhao Pei · 2025 · Chinese Journal of Electronics
  17. Video Flow as Time Series: Discovering Temporal Consistency and Variability for VideoQA
    Zijie Song, Zhenzhen Hu, Yixiao Ma, Jia Li, Richang Hong · 2025 · IEEE International Conference on Multimedia and Expo (ICME)
  18. MDIF: A multimodal dynamic inference framework for traffic video question answering
    Wenhao Guo, Lingling Zi, Xin Cong · 2025 · Applied Intelligence
  19. AV-Unified: A Unified Framework for Audio-Visual Scene Understanding
    G Li, Xin Wang, Wenwu Zhu · 2026 · IEEE Transactions on Multimedia
  20. Temporally Multi-Modal Semantic Reasoning with Spatial Language Constraints for Video Question Answering
    Mingyang Liu, Ruomei Wang, Fan Zhou, Ge Lin · 2022 · Symmetry
  21. Spatio-Temporal Two-stage Fusion for video question answering
    Feifei Xu, Yitao Zhu, Chun Wang, Yangze Cao, Zheng Zhong, Xiongmin Li · 2023 · Computer Vision and Image Understanding
  22. Hierarchical Synergy-Enhanced Multimodal Relational Network for Video Question Answering
    Min Peng, Xiaohu Shao, Yu Shi, Xiangdong Zhou · 2023 · ACM Transactions on Multimedia Computing Communications and Applications
  23. Construction of Sports Culture Recommendation Model Combining Big Data Technology and Video Semantic Comprehension
    Bin Xie, Fuye Zhang · 2023 · International Journal of Advanced Computer Science and Applications
  24. Hierarchical synchronization with structured multi-granularity interaction for video question answering
    Shanshan Qi, Lüxi Yang, Chunguo Li · 2024 · Neurocomputing
  25. Understanding Human Preferences: Towards More Personalized Video to Text Generation
    Yihan Wu, Ruihua Song, Xu Chen, Hao Jiang, Zhao Cao, Jin Shou Yu · 2024 · International World Wide Web Conference (WWW)
  26. Harnessing Representative Spatial-Temporal Information for Video Question Answering
    Yuanyuan Wang, Meng Liu, Xuemeng Song, Liqiang Nie · 2024 · ACM Transactions on Multimedia Computing Communications and Applications
  27. Bottom-Up Hierarchical Propagation Networks with Heterogeneous Graph Modeling for Video Question Answering
    Jinsheng Qi, Yuanxing Xu, Bin Wu · 2024 · International Joint Conference on Neural Networks (IJCNN)
  28. Chatting with interactive memory for text-based person retrieval
    Chen He, Shenshen Li, Zheng Wang, Hua Chen, Fumin Shen, Xing Xu · 2024 · Multimedia Systems
  29. Spatial–Temporal Clue Reasoning Chain for Long Video Question Answering
    Haibo Gong, Chenggang Yan, Jiehua Zhang, Yaoqi Sun, Yuhan Gao, Liang Li · 2025 · IEEE Transactions on Circuits and Systems for Video Technology
  30. Multi-Granularity Semantic Clues Extraction for Video Question Answering
    Fei Zhou, Yahong Han · 2022 · IEEE International Conference on Multimedia and Expo (ICME)
  31. Two-Stream Heterogeneous Graph Network with Dynamic Interactive Learning for Video Question Answering
    Min Peng, Xiaohu Shao, Yu Shi, Xiangdong Zhou · 2023 · International Joint Conference on Neural Networks (IJCNN)
  32. Trying Bilinear Pooling in Video-QA
    Winterbottom, Thomas, Sarah Hong Xiao, Alistair McLean, Noura Al Moubayed · 2020 · arXiv (Cornell University)
  33. Attend What You Need: Motion-Appearance Synergistic Networks for Video Question Answering
    Ahjeong Seo, Gi-Cheon Kang, Joonhan Park, Byoung‐Tak Zhang · 2021 · arXiv (Cornell University)
  34. Temporal-aware Mechanism with Bidirectional Complementarity for Video Q&A
    Yuanmao Luo, Ruomei Wang, Fuwei Zhang, Fan Zhou, Shujin Lin · 2022 · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics
  35. Gated Multi-modal Fusion with Cross-modal Contrastive Learning for Video Question Answering
    Chenyang Lyu, Wenxi Li, Tianbo Ji, Liting Zhou, Cathal G. Gurrin · 2023 · Lecture notes in computer science
  36. Appearance-Motion Dual-Stream Heterogeneous Network for VideoQA
    Feifei Xu, Zheng Zhong, Yitao Zhu, Yingchen Zhou, Guangzhen Li · 2024 · Lecture notes in computer science
  37. Semantic Distance-Aware Cross-Modal Attention Mechanism for Video Question Answering
    Mingyang Liu, Fan Zhou, Ruomei Wang, Baoquan Zhao, Fuwei Zhang · 2025 · IEEE Transactions on Instrumentation and Measurement
  38. Parse, Align and Aggregate: Graph-Driven Compositional Reasoning for Video Question Answering
    Jiangtong Li, Zhaohe Liao, Fengshun Xiao, Tianjiao Li, Qiang Zhang, Haohua Zhao, Li Niu, Guang Chen, Liqing Zhang, Changjun Jiang · 2026 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  39. Question Understanding and Temporality Guiding for Video Question Answering
    Jiahao Lu, Sisi You, Bing-Kun Bao · 2026 · IEEE Transactions on Multimedia
  40. Adaptive Proposal on Spatio-Temporal Graph in Audio-Visual Question Answering
    Zhuyang Xie, Yi Yang, Yankai Yu, Jie Wang, Bo Peng, Xiaofan Li, Yan Liu · 2026 · IEEE Transactions on Multimedia
  41. Fusing Temporally Distributed Multi-Modal Semantic Clues for Video Question Answering
    Fuwei Zhang, Ruomei Wang, Songhua Xu, Fan Zhou · 2021 · IEEE International Conference on Multimedia and Expo (ICME)
  42. Inferential Knowledge-Enhanced Integrated Reasoning for Video Question Answering
    Jianguo Mao, Wenbin Jiang, Hong Liu, Xiangdong Wang, Yajuan Lyu · 2023 · Proceedings of the AAAI Conference on Artificial Intelligence
  43. SpaceCLIP: A Vision-Language Pretraining Framework With Spatial Reconstruction On Text
    Bo Zou, Yang Chao, Chengbin Quan, Youjian Zhao · 2023 · ACM International Conference on Multimedia (ACM MM)
  44. Semantic Enrichment for Video Question Answering with Gated Graph Neural Networks
    Chenyang Lyu, Wenxi Li, Tianbo Ji, Yi Yu, Longyue Wang · 2024 · IEEE International Conference on Acoustics Speech and Signal Processing
  45. Foundation Models and Adaptive Feature Selection: A Synergistic Approach to Video Question Answering
    Sai Bhargav Rongali, Mohamad Hassan N C, Ankit Jha, Neha Bhargava, Saurabh Prasad, Biplab Banerjee · 2025 · IEEE Winter Conference on Applications of Computer Vision
  46. Differentiated Attention with Multi-modal Reasoning for Video Question Answering
    Shentao Yao, Kun Li, Kun Xing, Kewei Wu, Zhao Xie, Dan Guo · 2022 · IEEE International Conference on Electrical Engineering, Big Data and Algorithms (EEBDA)
  47. Multimodal Graph Reasoning and Fusion for Video Question Answering
    Shuai Zhang, Xingfu Wang, Ammar Hawbani, Liang Zhao, Saeed Hamood Alsamhi · 2022 · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom)
  48. Language Guided Networks for Cross-modal Moment Retrieval
    Kun Liu, Huadóng Ma, Chuang Gan · 2020 · arXiv (Cornell University)
  49. TrafficQA: A Question Answering Benchmark and an Efficient Network for Video Reasoning over Traffic Events
    Li Xu, He Huang, Jun Liu · 2021 · arXiv (Cornell University)
  50. The AI Hippocampus: How Far are We From Human Memory?
    Jia, Zixia, Li, Jiaqi, Kang, Yipeng, Wang, Yuxuan, Wu, Tong, Wang, Quansen, Wang, Xiaobo, Zhang, Shuyi, Shen, Junzhe, Li, Qing et al. · 2026 · arXiv
  51. Co-attentional Transformers for Story-Based Video Understanding
    Björn Bebensee, Byoung‐Tak Zhang · 2020 · arXiv (Cornell University)
  52. Question-answering on image/video content
    Muhammad Iqbal Hasan Chowdhury · 2020 · Queensland University of Technology
  53. Analysis on Image Set Visual Question Answering
    Abhinav Khattar, Aviral Joshi, Har Simrat Singh, Pulkit Goel, Rohit Prakash Barnwal · 2021 · arXiv (Cornell University)
  54. VGNMN: Video-grounded Neural Module Network to Video-Grounded Language Tasks
    Le, Hung, Nancy F. Chen, Steven C. H. Hoi · 2021 · arXiv (Cornell University)
  55. Advanced Models for Video Question Answering
    Qi Wu, Peng Wang, Xin Yue Wang, Xiaodong He, Wenwu Zhu · 2022 · Advances in computer vision and pattern recognition
  56. Peer Review #2 of "Bilinear pooling in video-QA: empirical challenges and motivational drift from neurological parallels (v0.1)"
    2022 · PeerJ Computer Science
  57. Peer Review #1 of "Bilinear pooling in video-QA: empirical challenges and motivational drift from neurological parallels (v0.1)"
    2022 · PeerJ Computer Science
  58. Hierarchical Recurrent Contextual Attention Network for Video Question Answering
    Fei Zhou, Yahong Han · 2022 · Lecture notes in computer science
  59. Weight-based multi-stream model for Multi-Modal Video Question Answering
    Mohith Rajesh, Sanjiv Sridhar, Chinmay Kulkarni, Aaditya Shah, S. Natarajan · 2023 · Proceedings of the ... International Florida Artificial Intelligence Research Society Conference
  60. Question difficulty estimation via enhanced directional modality association transformer
    Bong-Min Kim, Gyu-Min Park, Seong-Bae Park · 2023 · Applied Intelligence
  61. Video Question Answering with Overcoming Spatial and Temporal Redundancy in Feature Extraction
    Ju-Hee Lee, Seong Jong Ha, Je‐Won Kang · 2023 · Journal of Broadcast Engineering
  62. ADVANCEMENTS IN VIDEO CAPTIONING: A COMPREHENSIVE REVIEW OF DEEP LEARNING TECHNIQUES, ARCHITECTURES, AND PRE-PROCESSING STRATEGIES
    2024 · International Research Journal of Modernization in Engineering Technology and Science
  63. Video Q &A based on two-stage deep exploration of temporally-evolving features with enhanced cross-modal attention mechanism
    Yuanmao Luo, Ruomei Wang, Fuwei Zhang, Fan Zhou, Mingyang Liu, Jiawei Feng · 2024 · Neural Computing and Applications
  64. Object-based Appearance-Motion Heterogeneous Network for Video Question Answering
    Feifei Xu, Zheng Zhong, Yitao Zhu, Guangzhen Li, Yingchen Zhou, Wang Zhou · 2023 · IEEE International Conference on Parallel and Distributed Systems (ICPADS)
  65. Removing Bias of Video Question Answering by Causal Theory
    Yue Huang, Xiaodong Gu · 2024 · IEEE Conference on Industrial Electronics and Applications (ICIEA)
  66. Pre-trained Bidirectional Dynamic Memory Network For Long Video Question Answering
    Jinmeng Wu, Pengcheng Shu, Hanyu Hong, Lei Ma, Ying Zhu, Lei Wang · 2024 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  67. Video question answering algorithm that integrates video-level and clip-level features by introducing Multi-head attention units
    Ting Zhao, Yude Wang, Fei Song, Teng Liu · 2024
  68. DFS-QA: Dynamic Frame Selection for Better Video Question Answering
    Zhibo Ren, Baoyu Hou, Huizhen Wang, Muhua Zhu, Tong Xiao, Jingbo Zhu · 2024 · Lecture notes in computer science
  69. Rethinking Video-Text Pretraining Via Masked Autoencoder
    Siran Chen, Yue Ma, Bowei Jia, Xiu Li, Yicheng Xiao, Tianyu Yang · 2024 · SSRN Electronic Journal
  70. Dual-Stream Keyframe Enhancement for Video Question Answering
    Zhenzhen Hu, Xin Guan, Jia Li, Zijie Song, Richang Hong · 2024 · ACM International Conference on Multimedia in Asia (MMAsia)
  71. Enhancing Video-Text Matching via Sparse Stratified Sampling
    Chenyang Lyu, Wenxi Li, Tianbo Ji, Liting Zhou, Pintu Lohar, Yi Yu, Longyue Wang · 2025 · IEEE International Conference on Acoustics Speech and Signal Processing
  72. GVEV-Net: Graph-based Visual Enhanced Video Network for Audio-Visual Question Answering
    Yixin Wang, Xujian Zhao, Peiquan Jin, Xuebo Cai, Bo Li, Yin Long, Xiuzhu Wang · 2024 · International Conference on Virtual Reality and Visualization
  73. LBA: Multi-Scale Video Segment Sampling for Open-Ended Video Question Answering
    Jin Wang, Yahong Han · 2025 · Lecture notes in computer science
  74. APSam: An Aggregating-Then-Pruning Sampler for Question-Conditional Denoising
    Jiafeng Liang, Shixin Jiang, Wei Tang, Ning Wang, Zekun Wang, Xun Mao, Kai Lv, Ming Liu, Bing Qin · 2025 · IEEE Transactions on Circuits and Systems for Video Technology
  75. Multi-granularity Frequency Difference-Aware Attention for Video Question Answering
    Mingyang Liu, Fan Zhou, Ruomei Wang, Baoquan Zhao · 2025 · IEEE International Conference on Multimedia and Expo (ICME)
  76. How Vision-Language Tasks Benefit From Large Pre-Trained Models: A Survey
    Yayun Qi, LI Hong-xi, Yiqi Song, Xinxiao Wu, Jiebo Luo · 2025 · IEEE Transactions on Multimedia
  77. Semantic-Driven Video Question Answering with Fine-Grained Spatio-Temporal Interaction
    Jiawei Zhang, Qiuxiang Yang, Shurong Pang, Yuanyuan Shen, Si Wang, Fuwei Zhang · 2024
  78. Introduction
    Xin Wang, Xiaohan Lan, Wenwu Zhu · 2025 · Springer eBooks
  79. TBGA: Tripartite and Bipartite Graph Attention for Multi-modal Video Question Answering
    Junyeong Kim · 2025 · International Conference on Electrical, Control and Instrumentation Engineering (ICECIE)
  80. Leveraging Static-Dynamic Scene Parsing to Enhance Progressive Symbolic Reasoning for Video Question Answering
    Guanglu Sun, Lili Liang, Jin Qiu, Lizhong Zhang, Fei Lang · 2026 · IEEE Transactions on Multimedia
  81. Lexical Distractor Mining Network for Causal Video Question Answering
    Junyeong Kim, Sunjae Yoon · 2026 · IEEE Access
  82. A novel multi-modal attentional collaborative learning framework with semantic enhancement for audio–visual question answering
    Jie Yang, Miao Ma, Peng Wang, Yutong Li, Zhao Pei, Chao Yao, Longjiang Guo · 2026 · Engineering Applications of Artificial Intelligence
  83. Query-based Collaborative Multimodal Token Pruning for Audio-Visual Question Answering
    Xilin Qin, Dexiang Hong, Weidong Chen, Cheng Ye, Xinyan Liu, Peipei Song, Lei Zhang · 2025 · International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR)
  84. Video question answering with limited supervision
    Deniz Engin · 2024 · theses.fr (ABES)
  85. Multimodal deep learning for audiovisual production
    Kaouther Ouenniche · 2023 · theses.fr (ABES)
  86. IntentQA: Intent Question Answering in Videos by Cognitive Context Reasoning
    J H Li, Ping Wei, Wenjuan Han, Song Chun Zhu, Lifeng Fan · 2026 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  87. HAViG: Hierarchical adaptive visual grounding framework for video question answering
    Lei Zhu, Lingmin Pan, Siqiao Tan, C T Zhang, Deyin Liu, Lin Yuanbo Wu, Farid Boussaïd, Mohammed Bennamoun · 2026 · Pattern Recognition
  88. Q-TriM: Question-Guided Tri-Modal Attention for Audio–Visual Question Answering
    SungHun Kim, SeungJun Baek · 2026 · Lecture notes in computer science
  89. Multi-granularity visual relationship reasoning with heterogeneous graph interaction for video question answering
    Tao Tan, Guanglu Sun · 2026 · Multimedia Systems
  90. A Survey of Multi-Model Collaboration in Video Understanding
    Yi Chen, Jianwei Zhang, Lei Zhang, Chang Liu, Rui Gao, Zhixian Lu, Jun Qi, Qiyu Lei · 2026 · Data
  91. A Survey of Visual Question Answering for Embodied Robots: Tasks, Methods, and Future Directions
    Weihan Shi, Yinlong Liu · 2026 · AI
  92. Text-Parsing Adaptive Gated Fusion for Audio-Visual Question Answering
    Liang Shan, Guang-Yao Li · 2026 · Journal of Computer Science and Technology
  93. Causal Chain-Guided Reasoning for Modular and Explainable Causal-Why Video Question Answering
    Paritosh Parmar, Eric Peh, Basura Fernando · 2026