The DOI matches its Crossref record; 114 of the 114 references it cites were found in a registry or an index.
The multi-modal fusion in visual question answering: a review of attention mechanisms
Open accessAbstract
Visual Question Answering (VQA) is a significant cross-disciplinary issue in the fields of computer vision and natural language processing that requires a computer to output a natural language answer based on pictures and questions posed based on the pictures. This requires simultaneous processing of multimodal fusion of text features and visual features, and the key task that can ensure its success is the attention mechanism. Bringing in attention mechanisms makes it better to integrate text features and image features into a compact multi-modal representation. Therefore, it is necessary to clarify the development status of attention mechanism, understand the most advanced attention mechanism methods, and look forward to its future development direction. In this article, we first conduct a bibliometric analysis of the correlation through CiteSpace, then we find and reasonably speculate that the attention mechanism has great development potential in cross-modal retrieval. Secondly, we discuss the classification and application of existing attention mechanisms in VQA tasks, analysis their shortcomings, and summarize current improvement methods. Finally, through the continuous exploration of attention mechanisms, we believe that VQA will evolve in a smarter and more human direction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01228-7 · Cited by 6,909
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
Anderson, P., He, X., Buehler, C., Teney, D., Johnson, M., Gould, S., & Zhang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00636 · Cited by 4,948
VQA: Visual Question Answering
Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.279 · Cited by 4,487
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2022) · ACM Computing Surveys · doi:10.1145/3505244 · Cited by 3,595
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2021) · arXiv · doi:10.48550/arxiv.2101.01169 · Cited by 3,594
A review on the attention mechanism of deep learning
Niu, Z., Zhong, G., & Yu, H. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.03.091 · Cited by 3,379
Attention mechanisms in computer vision: A survey
Guo, M.-H., Xu, T.-X., Liu, J.-J., Liu, Z.-N., Jiang, P.-T., Mu, T.-J., Zhang, S.-H., Martin, R. R., Cheng, M.-M., & Hu, S.-M. (2022) · Computational Visual Media · doi:10.1007/s41095-022-0271-y · Cited by 2,566
Stacked Attention Networks for Image Question Answering
Yang, Z., He, X., Gao, J., Deng, L., & Smola, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.10 · Cited by 1,998
SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning
Chen, L., Zhang, H., Xiao, J., Nie, L., Shao, J., Liu, W., & Chua, T.-S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.667 · Cited by 1,992
Long Short-Term Memory-Networks for Machine Reading
Cheng, J., Dong, L., & Lapata, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1053 · Cited by 1,172
Hierarchical Question-Image Co-Attention for Visual Question Answering
Lu, J., Yang, J., Batra, D., & Parikh, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00061 · Cited by 1,129
Stand-Alone Self-Attention in Vision Models
Ramachandran, P., Parmar, N., Vaswani, A., Bello, I., Levskaya, A., & Shlens, J. (2019) · arXiv · doi:10.48550/arxiv.1906.05909 · Cited by 977
Deep Modular Co-Attention Networks for Visual Question Answering
Yu, Z., Yu, J., Cui, Y., Tao, D., & Tian, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00644 · Cited by 964
Visual7W: Grounded Question Answering in Images
Zhu, Y., Groth, O., Bernstein, M., & Fei-Fei, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.540 · Cited by 794 · cited 1×
“Given a picture and a natural language question including which, when, where, who, what, how and why ( Zhu et al., 2016 ) that is correlative with this picture, the system need to produce a natural language answer as an output.”
BackgroundDual Attention Networks for Multimodal Reasoning and Matching
Nam, H., Ha, J.-W., & Kim, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.232 · Cited by 726
An Attentive Survey of Attention Models
Chaudhari, S., Mithal, V., Polatkan, G., & Ramanath, R. (2021) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3465055 · Cited by 689
Ask Your Neurons: A Neural-Based Approach to Answering Questions about Images
Malinowski, M., Rohrbach, M., & Fritz, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.9 · Cited by 631
VizWiz Grand Challenge: Answering Visual Questions from Blind People
Gurari, D., Li, Q., Stangl, A. J., Guo, A., Lin, C., Grauman, K., Luo, J., & Bigham, J. P. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00380 · Cited by 621 · cited 1×
“…et al., 2022 ; Li et al., 2022 ; Gong et al., 2021 ; Zhan et al., 2020 ; Wang et al., 2022a ; Wang et al., 2022b ), remote sensing ( Bazi et al., 2022 ; Zheng et al., 2022b ; Al Rahhal et al., 2022 ), and blindness help ( Gurari et al., 2018 ; Tung et al., 2021 ; Tung, Huy Tien & Minh Le, 2021 ).”
Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answering
Agrawal, A., Batra, D., Parikh, D., & Kembhavi, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00522 · Cited by 566
Beyond Bilinear: Generalized Multimodal Factorized High-Order Pooling for Visual Question Answering
Yu, Z., Yu, J., Xiang, C., Fan, J., & Tao, D. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2817340 · Cited by 532
Visual question answering: A survey of methods and datasets
Wu, Q., Teney, D., Wang, P., Shen, C., Dick, A., & van den Hengel, A. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.05.001 · Cited by 438
Human Attention in Visual Question Answering: Do Humans and Deep Networks look at the same regions?
Das, A., Agrawal, H., Zitnick, L., Parikh, D., & Batra, D. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1092 · Cited by 427
Tips and Tricks for Visual Question Answering: Learnings from the 2017 Challenge
Teney, D., Anderson, P., He, X., & Hengel, A. V. D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00444 · Cited by 396
Dynamic Fusion With Intra- and Inter-Modality Attention Flow for Visual Question Answering
Gao, P., Jiang, Z., You, H., Lu, P., Hoi, S. C. H., Wang, X., & Li, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00680 · Cited by 381
Nguyen, D.-K., & Okatani, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00637 · Cited by 347
Predicting drug–protein interaction using quasi-visual question answering system
Zheng, S., Li, Y., Chen, S., Xu, J., & Yang, Y. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0152-y · Cited by 311
End-to-End Instance Segmentation with Recurrent Attention
Ren, M., & Zemel, R. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.39 · Cited by 309
Heterogeneous Memory Enhanced Multimodal Attention Model for Video Question Answering
Fan, C., Zhang, X., Zhang, S., Wang, W., Zhang, C., & Huang, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00210 · Cited by 293
Beyond RNNs: Positional Self-Attention with Co-Attention for Video Question Answering
Li, X., Song, J., Gao, L., Liu, X., Huang, W., He, X., & Gan, C. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018658 · Cited by 259
Self-citationABC-CNN: An Attention Based Convolutional Neural Network for Visual Question Answering
Chen, K., Wang, J., Chen, L.-C., Gao, H., Xu, W., & Nevatia, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05960 · Cited by 254
Adversarial Representation Learning for Text-to-Image Matching
Sarafianos, N., Xu, X., & Kakadiaris, I. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00591 · Cited by 250
Multi-level Attention Networks for Visual Question Answering
Yu, D., Fu, J., Mei, T., & Rui, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.446 · Cited by 230
Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question Answering
Gao, H., Mao, J., Zhou, J., Huang, Z., Wang, L., & Xu, W. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.05612 · Cited by 216
Knowledge base graph embedding module design for Visual question answering model
Zheng, W., Yin, L., Chen, X., Ma, Z., Liu, S., & Yang, B. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108153 · Cited by 214
Self-citationMedical Visual Question Answering via Conditional Reasoning
Zhan, L.-M., Liu, B., Fan, L., Chen, J., & Wu, X.-M. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413761 · Cited by 166
Mutual Attention Inception Network for Remote Sensing Visual Question Answering
Zheng, X., Wang, B., Du, X., & Lu, X. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3079918 · Cited by 159
Sentence Representation Method Based on Multi-Layer Semantic Network
Zheng, W., Liu, X., & Yin, L. (2021) · Applied Sciences · doi:10.3390/app11031316 · Cited by 149
Self-citationJoint embedding VQA model based on dynamic word vector
Ma, Z., Zheng, W., Chen, X., & Yin, L. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.353 · Cited by 149
Self-citationA Focused Dynamic Attention Model for Visual Question AnsweringPreprint
Ilievski, I., Yan, S., & Feng, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.01485 · Cited by 144
Are You Talking to Me? Reasoned Visual Dialog Generation Through Adversarial Learning
Wu, Q., Wang, P., Shen, C., Reid, I. D., & van den Hengel, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00639 · Cited by 134
A Deep Fusion Matching Network Semantic Reasoning Model
Zheng, W., Zhou, Y., Liu, S., Tian, J., Yang, B., & Yin, L. (2022) · Applied Sciences · doi:10.3390/app12073416 · Cited by 123
Self-citationCross-Modal Self-Attention with Multi-Task Pre-Training for Medical Visual Question Answering
Gong, H., Chen, G., Liu, S., Yu, Y., & Li, G. (2021) · International Conference on Multimedia Retrieval · doi:10.1145/3460426.3463584 · Cited by 118
Multi-step Reasoning via Recurrent Dual Attention for Visual Dialog
Gan, Z., Cheng, Y., Kholy, A. E., Li, L., Liu, J., & Gao, J. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1648 · Cited by 112
Zheng, W., & Yin, L. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.908 · Cited by 112
Self-citationJiang, J., Chen, Z., Lin, H., Zhao, X., & Gao, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6766 · Cited by 108
Video Question Answering via Hierarchical Spatio-Temporal Attention Networks
Zhao, Z., Yang, Q., Cai, D., He, X., & Zhuang, Y. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/492 · Cited by 104
Knowledge mapping of computer applications in education using CiteSpace
Rawat, K. S., & Sood, S. K. (2021) · Computer Applications in Engineering Education · doi:10.1002/cae.22388 · Cited by 104
Focal Visual-Text Attention for Visual Question Answering
Liang, J., Jiang, L., Cao, L., Li, L.-J., & Hauptmann, A. G. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00642 · Cited by 103
MRA-Net: Improving VQA Via Multi-Modal Relation Attention Network
Peng, L., Yang, Y., Wang, Z., Huang, Z. H., & Shen, H. T. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3004830 · Cited by 103
Learning Visual Question Answering by Bootstrapping Hard Attention
Malinowski, M., Doersch, C., Santoro, A., & Battaglia, P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01231-1_1 · Cited by 102
Exploring Human-Like Attention Supervision in Visual Question Answering
Qiao, T., Dong, J., & Xu, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12272 · Cited by 100
Yu, J., Zhang, W., Lu, Y., Qin, Z., Hu, Y., Tan, J., & Wu, Q. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2972830 · Cited by 97
Visual Reference Resolution using Attention Memory for Visual DialogPreprint
Seo, P. H., Lehrmann, A., Han, B., & Sigal, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.07992 · Cited by 95
Fooling Vision and Language Models Despite Localization and Attention Mechanism
Xu, X., Chen, X., Liu, C., Rohrbach, A., Darrell, T., & Song, D. X. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00520 · Cited by 94
Visual question answering model based on visual relationship detection
Xi, Y., Zhang, Y., Ding, S., & Wan, S. (2019) · Signal Processing Image Communication · doi:10.1016/j.image.2019.115648 · Cited by 92
Lu, P., Li, H., Zhang, W., Wang, J., & Wang, X. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12240 · Cited by 89
Differential Attention for Visual Question Answering
Patro, B. N., & Namboodiri, V. P. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00801 · Cited by 88
Dual Attention Networks for Visual Reference Resolution in Visual Dialog
Kang, G.-C., Lim, J., & Zhang, B. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1209 · Cited by 86
Bi-Modal Transformer-Based Approach for Visual Question Answering in Remote Sensing Imagery
Bazi, Y., Rahhal, M. M. A., Mekhalfi, M. L., Zuair, M., & Melgani, F. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3192460 · Cited by 86
Lu, P., Ji, L., Zhang, W., Duan, N., Zhou, M., & Wang, J. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220036 · Cited by 78
From Pixels to Objects: Cubic Visual Attention for Visual Question Answering
Song, J., Zeng, P., Gao, L., & Shen, H. T. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/126 · Cited by 77
Multi attention module for visual tracking
Chen, B., Li, P., Sun, C., Wang, D., Yang, G., & Lu, H. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.10.005 · Cited by 76
Making History Matter: History-Advantage Sequence Training for Visual Dialog
Yang, T., Zha, Z.-J., & Zhang, H. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00265 · Cited by 73
Focal Visual-Text Attention for Memex Question Answering
Liang, J., Jiang, L., Cao, L., Kalantidis, Y., Li, L.-J., & Hauptmann, A. G. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2890628 · Cited by 71
Multimodal feature fusion by relational reasoning and attention for visual question answering
Zhang, W., Yu, J., Hu, H., Hu, H., & Qin, Z. (2019) · Information Fusion · doi:10.1016/j.inffus.2019.08.009 · Cited by 70
Dual self-attention with co-attention networks for visual question answering
Liu, Y., Zhang, X., Zhang, Q., Li, C., Huang, F., Tang, X., & Li, Z. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107956 · Cited by 69
Multimodal feature-wise co-attention method for visual question answering
Zhang, S., Chen, M., Chen, J., Zou, F., Li, Y.-F., & Lü, P. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.022 · Cited by 68
AMAM: An Attention-based Multimodal Alignment Model for Medical Visual Question Answering
Pan, H., He, S., Zhang, K., Qu, B., Chen, C., & Shi, K. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109763 · Cited by 65
Multimodal Encoder-Decoder Attention Networks for Visual Question Answering
Chen, C., Han, D., & Wang, J. (2020) · IEEE Access · doi:10.1109/access.2020.2975093 · Cited by 60
Object-Difference Attention: A Simple Relational Attention for Visual Question Answering
Wu, C., Liu, J., Wang, X., & Dong, X. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240513 · Cited by 59
DRAU: Dual Recurrent Attention Units for Visual Question Answering
Osman, A., & Samek, W. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.05.001 · Cited by 55
Question Type Guided Attention in Visual Question Answering
Shi, Y., Furlanello, T., Zha, S., & Anandkumar, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01225-0_10 · Cited by 55
Vision-to-Language Tasks Based on Attributes and Attention Mechanism
Li, X., Yuan, A., & Lu, X. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2914351 · Cited by 54
Sparse co-attention visual question answering networks based on thresholds
Guo, Z., & Han, D. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03559-4 · Cited by 53
Co-Attention Network With Question Type for Visual Question Answering
Yang, C., Jiang, M., Jiang, B., Zhou, W., & Li, K. (2019) · IEEE Access · doi:10.1109/access.2019.2908035 · Cited by 52
CRA-Net: Composed Relation Attention Network for Visual Question Answering
Peng, L., Yang, Y., Wang, Z., Wu, X. Y., & Huang, Z. H. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350925 · Cited by 45
Answer Questions with Right Image Regions: A Visual Attention Regularization Approach
Liu, Y., Guo, Y., Yin, J., Song, X., Liu, W., Nie, L., & Zhang, M. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3498340 · Cited by 42
Dynamic Capsule Attention for Visual Question Answering
Zhou, Y., Ji, R., Su, J., Sun, X., & Chen, W. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019324 · Cited by 40
Dual Visual Attention Network for Visual Dialog
Guo, D., Wang, H., & Wang, M. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/693 · Cited by 37
Object-difference drived graph convolutional networks for visual question answering
Zhu, X., Mao, Z., Chen, Z., Li, Y., Wang, Z., & Wang, B. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08790-0 · Cited by 35
Answer Again: Improving VQA with Cascaded-Answering Model
Peng, L., Yang, Y., Zhang, X., Ji, Y., Lu, H., & Shen, H. T. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2998805 · Cited by 34
Language Features Matter: Effective Language Representations for Vision-Language Tasks
Burns, A., Tan, R., Saenko, K., Sclaroff, S., & Plummer, B. A. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00757 · Cited by 30
Medical visual question answering based on question-type reasoning and semantic space constraint
Wang, M., He, X., Liu, L., Qing, L., Chen, H., Liu, Y., & Ren, C. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102346 · Cited by 30
Adversarial Learning With Multi-Modal Attention for Visual Question Answering
Liu, Y., Zhang, X., Huang, F., Cheng, L., & Li, Z. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3016083 · Cited by 29
Cross-modality co-attention networks for visual question answering
Han, D., Zhou, S., Li, K., & de Mello, R. F. (2021) · Soft Computing · doi:10.1007/s00500-020-05539-7 · Cited by 27
A Bi-level representation learning model for medical visual question answering
Li, Y., Long, S., Yang, Z., Weng, H., Zeng, K., Huang, Z., Wang, F. L., & Hao, T. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104183 · Cited by 25
Multi-Modal Explicit Sparse Attention Networks for Visual Question Answering
Guo, Z., & Han, D. (2020) · Sensors · doi:10.3390/s20236758 · Cited by 24
Research on Visual Question Answering Based on GAT Relational Reasoning
Miao, Y., Cheng, W., He, S., & Jiang, H. (2022) · Neural Processing Letters · doi:10.1007/s11063-021-10689-2 · Cited by 22
Deep Modular Bilinear Attention Network for Visual Question Answering
Yan, F., Silamu, W., & Li, Y. (2022) · Sensors · doi:10.3390/s22031045 · Cited by 20
Yan, F., Silamu, W., Li, Y., & Chai, Y. (2022) · The Visual Computer · doi:10.1007/s00371-022-02524-z · Cited by 20
Densely Connected Attention Flow for Visual Question Answering
Liu, F., Liu, J., Fang, Z., Hong, R., & Lu, H. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/122 · Cited by 19
Multi visual and textual embedding on visual question answering for blind people
Le, T., Nguyen, H. T., & Nguyen, L.-M. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.08.117 · Cited by 19
Generative Attention Model with Adversarial Self-learning for Visual Question Answering
Ilievski, I., & Feng, J. (2017) · Thematic Workshops of ACM Multimedia · doi:10.1145/3126686.3126695 · Cited by 17
Miao, Y., He, S., Cheng, W., Li, G., & Tong, M. (2022) · Scientific Reports · doi:10.1038/s41598-022-21149-9 · Cited by 17
Adversarial Learning of Answer-Related Representation for Visual Question Answering
Liu, Y., Zhang, X., Huang, F., & Li, Z. (2018) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3269206.3271765 · Cited by 16
Varga, D. (2022) · Sensors · doi:10.3390/s22062209 · Cited by 16
Open-ended remote sensing visual question answering with transformers
Al Rahhal, M. M., Bazi, Y., Alsaleh, S. O., Al-Razgan, M., Mekhalfi, M. L., Al Zuair, M., & Alajlan, N. (2022) · International Journal of Remote Sensing · doi:10.1080/01431161.2022.2145583 · Cited by 15
No-Reference Video Quality Assessment Using Distortion Learning and Temporal Attention
Kossi, K. K., Coulombe, S., Desrosiers, C., & Gagnon, G. (2022) · IEEE Access · doi:10.1109/access.2022.3167446 · Cited by 12
Multi-modal co-attention relation networks for visual question answering
Guo, Z., & Han, D. (2022) · The Visual Computer · doi:10.1007/s00371-022-02695-9 · Cited by 12
Video Quality Assessment With Serial Dependence Modeling
Liu, Y., Wu, J., Li, A., Li, L., Dong, W., Shi, G., & Lin, W. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3107148 · Cited by 11
Dual Self-Guided Attention with Sparse Question Networks for Visual Question Answering
Xiang, S. H. E. N., Han, D., Chang, C., & Zong, L. (2022) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2021edp7189 · Cited by 10
M2FNet: Multi-granularity Feature Fusion Network for Medical Visual Question Answering
Wang, H., Pan, H., Zhang, K., He, S., & Chen, C. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20865-2_11 · Cited by 9
Multi-Modal Alignment of Visual Question Answering Based on Multi-Hop Attention Mechanism
Xia, Q., Yu, C., Hou, Y., Peng, P., Zheng, Z., & Chen, W. (2022) · Electronics · doi:10.3390/electronics11111778 · Cited by 7
Sharma, H., & Srivastava, S. (2021) · The Imaging Science Journal · doi:10.1080/13682199.2022.2153489 · Cited by 6
Suresh, N., Mylavarapu, P. M., Mahankali, N. S., & Channappayya, S. S. (2022) · National Conference on Communications · doi:10.1109/ncc55593.2022.9806466 · Cited by 4
Path-Wise Attention Memory Network for Visual Question Answering
Xiang, Y., Zhang, C., Han, Z., Yu, H., Li, J., & Zhu, L. (2022) · Mathematics · doi:10.3390/math10183244 · Cited by 2
Research works printed but not linked: 1
- Patro, 2022, Explanation vs. attention: a two-player game to obtain attention for VQA and visual dialog, Pattern Recognition, 132, 108898, 10.1016/j.patcog.2022.108898 · doi:10.1016/j.patcog.2022.108898
Cited by
(1996) · Institutional Research Information System University of Turin (University of Turin) · doi:10.1111/j · Cited by 5,486
Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence
Hassija, V., Chamola, V., Mahapatra, A., Singal, A., Goel, D., Huang, K., Scardapane, S., Spinelli, I., Mahmud, M., & Hussain, A. (2024) · Cognitive Computation · doi:10.1007/s12559-023-10179-8 · Cited by 2,495
“Following that, we come to the idea of responsible artificial intelligence, which is an AI that takes into account societal values as well as moral and ethical issues to improve the usability of AI models in real-world applications [27, 28].”
BackgroundVehicle Detection and Classification via YOLOv8 and Deep Belief Network over Aerial Image Sequences
Al Mudawi, N., Qureshi, A. M., Abdelhaq, M., Alshahrani, A., Alazeb, A., Alonazi, M., & Algarni, A. (2023) · Sustainability · doi:10.3390/su151914597 · Cited by 68
Metadata
- Authors
- Lu, S., Liu, M., Yin, L., Yin, Z., Liu, X., & Zheng, W.
- Venue
- PeerJ Computer Science
- Publisher
- PeerJ
- Published
- 2023-05-30
- Volume
- 9
- Pages
- e1400
- ISSN
- 2376-5992 (ISSN-L)
- OpenAlex
- W4381598461
- Cited by
- 477
- References
- 114
- FWCI
- 26.46
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- The Sichuan Science and Technology Program (2021YFQ0003)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.