The DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.
Cross-Modal Causal Relational Reasoning for Event-Level Visual Question Answering
Open accessAbstract
Existing visual question answering methods often suffer from cross-modal spurious correlations and oversimplified event-level reasoning processes that fail to capture event temporality, causality, and dynamics spanning over the video. In this work, to address the task of event-level visual question answering, we propose a framework for cross-modal causal relational reasoning. In particular, a set of causal intervention operations is introduced to discover the underlying causal structures across visual and linguistic modalities. Our framework, named Cross-Modal Causal RelatIonal Reasoning (CMCIR), involves three modules: i) Causality-aware Visual-Linguistic Reasoning (CVLR) module for collaboratively disentangling the visual and linguistic spurious correlations via front-door and back-door causal interventions; ii) Spatial-Temporal Transformer (STT) module for capturing the fine-grained interactions between visual and linguistic semantics; iii) Visual-Linguistic Feature Fusion (VLFF) module for learning the global semantic-aware visual-linguistic representations adaptively. Extensive experiments on four event-level datasets demonstrate the superiority of our CMCIR in discovering visual-linguistic causal structures and achieving robust event-level visual question answering.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
Anderson, P., He, X., Buehler, C., Teney, D., Johnson, M., Gould, S., & Zhang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00636 · Cited by 4,948
VQA: Visual Question Answering
Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.279 · Cited by 4,487
Swin Transformer V2: Scaling Up Capacity and Resolution
Liu, Z., Hu, H., Lin, Y., Yao, Z., Xie, Z., Wei, Y., Ning, J., Cao, Y., Zhang, Z., Dong, L., et al. (2021) · arXiv · doi:10.48550/arxiv.2111.09883 · Cited by 2,679
Swin Transformer V2: Scaling Up Capacity and Resolution
Liu, Z., Hu, H., Lin, Y., Yao, Z., Xie, Z., Wei, Y., Ning, J., Cao, Y., Zhang, Z., Dong, L., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01170 · Cited by 2,484
Liu, Z., Ning, J., Cao, Y., Wei, Y., Zhang, Z., Lin, S., & Hu, H. (2021) · arXiv · doi:10.48550/arxiv.2106.13230 · Cited by 2,294
Liu, Z., Ning, J., Cao, Y., Wei, Y., Zhang, Z., Lin, S., & Hu, H. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00320 · Cited by 2,294
Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?
Hara, K., Kataoka, H., & Satoh, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00685 · Cited by 2,205
Causal Inference in Statistics
Pearl, J., Glymour, M., & Jewell, N. P. (2016) · Cited by 2,024
Stacked Attention Networks for Image Question Answering
Yang, Z., He, X., Gao, J., Deng, L., & Smola, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.10 · Cited by 1,998
MSR-VTT: A Large Video Description Dataset for Bridging Video and Language
Xu, J., Mei, T., Yao, T., & Rui, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.571 · Cited by 1,759
The Book of Why: The New Science of Cause and Effect
Goldberg, L. R. (2019) · Notices of the American Mathematical Society · doi:10.1090/noti1912 · Cited by 1,655
Dense-Captioning Events in Videos
Krishna, R., Hata, K., Ren, F., Fei-Fei, L., & Niebles, J. C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.83 · Cited by 1,251
Anderson, P., Wu, Q., Teney, D., Bruce, J., Johnson, M., Sunderhauf, N., Reid, I., Gould, S., & van den Hengel, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00387 · Cited by 1,187
Temporal Relational Reasoning in Videos
Zhou, B., Andonian, A., Oliva, A., & Torralba, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_49 · Cited by 1,067
Collecting Highly Parallel Data for Paraphrase Evaluation
Chen, D. J., & Dolan, W. B. (2011) · Cited by 904
From Recognition to Cognition: Visual Commonsense Reasoning
Zellers, R., Bisk, Y., Farhadi, A., & Choi, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00688 · Cited by 769
Unbiased Scene Graph Generation From Biased Training
Tang, K., Niu, Y., Huang, J., Shi, J., & Zhang, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00377 · Cited by 755
Less is More: CLIPBERT for Video-and-Language Learning via Sparse Sampling
Lei, J., Li, L., Zhou, L., Gan, Z., Berg, T. L., Bansal, M., & Liu, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00725 · Cited by 589
TVQA: Localized, Compositional Video Question Answering
Lei, J., Yu, L., Bansal, M., & Berg, T. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1167 · Cited by 541 · cited 3×
“First, existing visual question answering methods usually focus on relatively simple events like movie [21], TVshow [22] or synthetic videos [23] where temporal understanding and causality discovery are simply not required to perform well, and ignore more complex and challenging events that require in-depth understand…”
BackgroundInfluentialTGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering
Jang, Y., Song, Y., Yu, Y., Kim, Y., & Kim, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.149 · Cited by 488
Das, A., Kottur, S., Gupta, K., Singh, A., Yadav, D., Moura, J. M. F., Parikh, D., & Batra, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.121 · Cited by 445 · cited 1×
“To achieve event-level visual question answering [7], [8], [9], the model needs to have a fine-grained understanding of video and language content involving var-”
BackgroundVideo Question Answering via Gradually Refined Attention over Appearance and Motion
Xu, D., Zhao, Z., Xiao, J., Wu, F., Zhang, H., He, X., & Zhuang, Y. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123427 · Cited by 429
Counterfactual VQA: A Cause-Effect Look at Language Bias
Niu, Y., Tang, K., Zhang, H., Lu, Z., Hua, X.-S., & Wen, J.-R. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01251 · Cited by 418
Exploring Models and Data for Image Question Answering
Ren, M., Kiros, R., & Zemel, R. S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.02074 · Cited by 359
Causal Intervention for Weakly-Supervised Semantic Segmentation
Zhang, D., Zhang, H., Tang, J., Hua, X., & Sun, Q. (2020) · arXiv · doi:10.48550/arxiv.2009.12547 · Cited by 353
Counterfactual Samples Synthesizing for Robust Visual Question Answering
Chen, L., Yan, X., Xiao, J., Zhang, H., Pu, S., & Zhuang, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01081 · Cited by 341
Heterogeneous Memory Enhanced Multimodal Attention Model for Video Question Answering
Fan, C., Zhang, X., Zhang, S., Wang, W., Zhang, C., & Huang, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00210 · Cited by 293
Wang, T., Huang, J., Zhang, H., & Sun, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01077 · Cited by 291
Interventional Few-Shot LearningPreprint
Yue, Z., Zhang, H., Sun, Q., & Hua, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13000 · Cited by 282
Supervised Open Information Extraction
Stanovsky, G., Michael, J., Zettlemoyer, L., & Dagan, I. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1081 · Cited by 265
Hierarchical Conditional Relation Networks for Video Question Answering
Le, T. M., Le, V., Venkatesh, S., & Tran, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00999 · Cited by 260
Beyond RNNs: Positional Self-Attention with Co-Attention for Video Question Answering
Li, X., Song, J., Gao, L., Liu, X., Huang, W., He, X., & Gan, C. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018658 · Cited by 259
Motion-Appearance Co-memory Networks for Video Question Answering
Gao, J., Ge, R., Chen, K., & Nevatia, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00688 · Cited by 250
Actor-Context-Actor Relation Network for Spatio-Temporal Action Localization
Pan, J., Chen, S., Shou, M. Z., Yu, L., Shao, J., & Li, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00053 · Cited by 208
Invariant Grounding for Video Question Answering
Li, Y., Wang, X., Xiao, J., Ji, W., & Chua, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00294 · Cited by 208
Interventional Video Grounding with Dual Contrastive Learning
Nan, G., Qiao, R., Xiao, Y., Liu, J., Leng, S., Zhang, H., & Lu, W. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00279 · Cited by 203
Reasoning with Heterogeneous Graph Alignment for Video Question Answering
Jiang, P., & Han, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6767 · Cited by 186
Causal Attention for Unbiased Visual Recognition
Wang, T., Zhou, C., Sun, Q., & Zhang, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00308 · Cited by 185
Causal Attention for Vision-Language Tasks
Yang, X., Zhang, H., Qi, G., & Cai, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00972 · Cited by 175
The Devil Is in Classification: A Simple Framework for Long-Tail Instance Segmentation
Wang, T., Li, Y., Kang, B., Li, J., Liew, J., Tang, S., Hoi, S., & Feng, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58568-6_43 · Cited by 172
Xu, L., Huang, H., & Liu, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00975 · Cited by 172
Location-Aware Graph Convolutional Networks for Video Question Answering
Huang, D., Chen, P., Zeng, R., Du, Q., Tan, M., & Gan, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6737 · Cited by 170
Deconfounded Image Captioning: A Causal Retrospect
Yang, X., Zhang, H., & Cai, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3121705 · Cited by 169
Counterfactual Critic Multi-Agent Training for Scene Graph Generation
Chen, L., Zhang, H., Xiao, J., He, X., Pu, S., & Chang, S.-F. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00471 · Cited by 166
Attend and Interact: Higher-Order Object Interactions for Video Understanding
Ma, C., Kadav, A., Melvin, I., Kira, Z., AlRegib, G., & Graf, H. P. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00710 · Cited by 159
Revisiting the “Video” in Video-Language Understanding
Buch, S., Eyzaguirre, C., Gaidon, A., Wu, J., Fei-Fei, L., & Niebles, J. C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00293 · Cited by 157
TCGL: Temporal Contrastive Graph for Self-Supervised Video Representation Learning
Liu, Y., Wang, K., Liu, L., Lan, H., & Lin, L. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3147032 · Cited by 154
Self-citationAgarwal, V., Shetty, R., & Fritz, M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00971 · Cited by 152
Two Causal Principles for Improving Visual Dialog
Qi, J., Niu, Y., Huang, J., & Zhang, H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01087 · Cited by 152
BERT Representations for Video Question Answering
Yang, Z., García, N., Chu, C., Otani, M., Nakashima, Y., & Takemura, H. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093596 · Cited by 138
Counterfactual Vision and Language Learning
Abbasnejad, E., Teney, D., Parvaneh, A., Shi, Q., & van den Hengel, A. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01006 · Cited by 138
Semantics-Aware Adaptive Knowledge Distillation for Sensor-to-Vision Action Recognition
Liu, Y., Wang, K., Li, G., & Lin, L. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3086590 · Cited by 132
Self-citationSCOUT: Self-Aware Discriminant Counterfactual Explanations
Wang, P., & Vasconcelos, N. M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00900 · Cited by 117
Gao, L., Yu, L., Zeng, P., Song, J., Wang, M., & Shen, H. T. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3120867 · Cited by 116
DualVGR: A Dual-Visual Graph Reasoning Unit for Video Question Answering
Wang, J., Bao, B., & Xu, C. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3097171 · Cited by 114
Jiang, J., Chen, Z., Lin, H., Zhao, X., & Gao, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6766 · Cited by 108
Bridge to Answer: Structure-aware Graph Interaction Network for Video Question Answering
Park, J., Lee, J., & Sohn, K. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01527 · Cited by 108
Causal Reasoning Meets Visual Representation Learning: A Prospective Study
Liu, Y., Wei, Y.-S., Yan, H., Li, G., & Lin, L. (2022) · Machine Intelligence Research · doi:10.1007/s11633-022-1362-z · Cited by 83
Self-citationGlobal Temporal Representation Based CNNs for Infrared Action Recognition
Liu, Y., Lu, Z., Li, J., Yang, T., & Yao, C. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2823910 · Cited by 75
Self-citationHAIR: Hierarchical Visual-Semantic Relational Reasoning for Video Question Answering
Liu, F., Liu, J., Wang, N., & Lu, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00172 · Cited by 74
Deep Image-to-Video Adaptation and Fusion Networks for Action Recognition
Liu, Y., Lu, Z., Li, J., Yang, T., & Yao, C. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2957930 · Cited by 73
Self-citationAttend What You Need: Motion-Appearance Synergistic Networks for Video Question Answering
Seo, A., Kang, G.-C., Park, J., & Zhang, B. (2021) · doi:10.18653/v1/2021.acl-long.481 · Cited by 67
Hierarchically Learned View-Invariant Representations for Cross-View Action Recognition
Liu, Y., Lu, Z., Li, J., & Yang, T. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2868123 · Cited by 57
Self-citationRepresentation Learning on Visual-Symbolic Graphs for Video Understanding
Mavroudi, E., Béjar, B., & Vidal, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58526-6_5 · Cited by 47
Video Question Answering with Spatio-Temporal Reasoning
Jang, Y., Song, Y., Kim, C. D., Yu, Y., Kim, Y., & Kim, G. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01189-x · Cited by 46
Adaptive Spatio-Temporal Graph Enhanced Vision-Language Representation for Video QA
Jin, W., Zhao, Z., Cao, X., Zhu, J., He, X., & Zhuang, Y. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3076556 · Cited by 46
Graph-Based Multi-Interaction Network for Video Question Answering
Gu, M., Zhao, Z., Jin, W., Hong, R., & Wu, F. Q. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3051756 · Cited by 45
Cross-Attentional Spatio-Temporal Semantic Graph Networks for Video Question Answering
Liu, Y., Zhang, X., Huang, F., Zhang, B., & Li, Z. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3142526 · Cited by 42
Self-citationHierarchical Relational Attention for Video Question Answering
Chowdhury, M. I. H., Nguyen, K., Sridharan, S., & Fookes, C. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451103 · Cited by 36
Multimodal Explanations by Predicting Counterfactuality in Videos
Kanehira, A., Takemoto, K., Inayoshi, S., & Harada, T. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00879 · Cited by 36
Feature Augmented Memory with Global Attention Network for VideoQA
Cai, J., Yuan, C., Shi, C., Li, L., Cheng, Y., & Shan, Y. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/139 · Cited by 29
Modularized Textual Grounding for Counterfactual Resilience
Fang, Z., Kong, S., Fowlkes, C. C., & Yang, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00654 · Cited by 26
Video Question Answering Using Language-Guided Deep Compressed-Domain Video Feature
Kim, N., Ha, S. J., & Kang, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00173 · Cited by 21
Weakly-Supervised Video Object Grounding via Causal Intervention
Wang, W. J., Gao, J., & Xu, C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3180025 · Cited by 21
Question-Guided Erasing-Based Spatiotemporal Attention Learning for Video Question Answering
Liu, F., Liu, J., Hong, R., & Lu, H. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3105280 · Cited by 19
Controlling Selection Bias in Causal Inference
Bareinboim, E., & Pearl, J. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v25i1.8056 · Cited by 17
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Research works printed but not linked: 8
- vaswani, 2017, Attention is all you need, Proc Adv Neural Inf Process Syst, 5998
- sukhbaatar, 2015, End-to-end memory networks, Proc Adv Neural Inf Process Syst, 2440
- goyal, 2019, Counterfactual visual explanations, Proc Int Conf Mach Learn, 2376
- besserve, 2020, Counterfactuals uncover the modular structure of deep generative models, Proc 8th Int Conf Learn Representations, 1
- huang, 2019, Dynamic graph modules for modeling object-object interactions in activity recognition, Proc Brit Mach Vis Conf, 174
- 10.1109/CVPR.2019.00033 · DOI
- 10.1109/TII.2022.3179243 · DOI
- tang, 2020, Long-tailed classification by keeping the good and removing the bad momentum causal effect, Proc Adv Neural Inf Process Syst
Cited by
(1996) · Institutional Research Information System University of Turin (University of Turin) · doi:10.1111/j · Cited by 5,486
A Novel Blockchain-Based Deepfake Detection Method Using Federated and Deep Learning Models
Heidari, A., Navimipour, N. J., Dag, H., Talebi, S., & Unal, M. (2024) · Cognitive Computation · doi:10.1007/s12559-024-10255-7 · Cited by 164
Unbiased Embodied Visual Representation Learning with Causal Inference and Cross-Modality Alignment
Kang, J., Chen, B., Zhong, P., Wang, Y., Yang, H., & Sheng, Y. (2025) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3760261
Metadata
- Authors
- Liu, Y., Li, G., & Lin, L.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2023-10
- Volume
- 45
- Issue
- 10
- Pages
- 11624-11641
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4379929708
- Cited by
- 348
- References
- 88
- FWCI
- 14.64
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Key R&D Program of China (2021ZD0111601)
- National Natural Science Foundation of China (62002395, 61976250)
- Basic and Applied Basic Research Foundation of Guangdong Province (2023A1515011530, 2021A1515012311, 2020B1515020048)
- Guangzhou Science and Technology Planning (2023A04J2030)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.