The DOI matches its Crossref record; 63 of the 65 references it cites were found in a registry or an index.
VQA: Visual Question Answering
Abstract
We propose the task of free-form and open-ended Visual Question Answering (VQA). Given an image and a natural language question about the image, the task is to provide an accurate natural language answer. Mirroring real-world scenarios, such as helping the visually impaired, both the questions and answers are open-ended. Visual questions selectively target different areas of an image, including background details and underlying context. As a result, a system that succeeds at VQA typically needs a more detailed understanding of the image and complex reasoning than a system producing generic image captions. Moreover, VQA is amenable to automatic evaluation, since many open-ended answers contain only a few words or a closed set of answers that can be provided in a multiple-choice format. We provide a dataset containing ~0.25M images, ~0.76M questions, and ~10M answers (www.visualqa.org), and discuss the information it provides. Numerous baselines for VQA are provided and compared with human performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This level of expert disagreement is in line with what is observed in other well-known machine learning benchmarks59–62.”
From Humanity's Last Exam (2025) · cites this paper as [60]
In the citing paper
“VQA models (e.g., Antol et al., 2015) are able to give a visual answer to a verbal question; for example, in response to the question “How many giraffes are drinking water?” and a given image, the network would respond by drawing bounding boxes around all the giraffes drinking from the water hole (but not the other ones, even if they are standing by the water hole).”
From Towards a Smart Bionic Eye : AI-powered artificial vision for the treatment of incurable blindness (2022) · cites this paper as Antol et al., 2015
In the citing paper
“Although VQA has traditionally been treated as a task with a single ground-truth label [4], recent work highlights the inherent subjectivity in visual information seeking, showing that blind users integrate multiple perspectives to shape their visual understanding, whether with AI tools or humans [94].”
From Disability-First AI Dataset Annotation: Co-designing Stuttered Speech Annotation Guidelines with People Who Stutter (2026) · cites this paper as [4]
In the citing paper
“Most datasets that are currently available for training question generation systems are crowd-sourced [42, 47, 84, 92, 114, 115, 119, 120, 122, 123], which largely impacts the quality of generated questions.”
From Automatic question generation: a review of methodologies, datasets, evaluation metrics, and applications (2023) · cites this paper as [84]
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Self-citationDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
Caffe: Convolutional Architecture for Fast Feature EmbeddingPreprint
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 5,299
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Deep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
Freebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852
CIDEr: Consensus-based image description evaluation
Vedantam, R., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299087 · Cited by 4,845
Self-citation
Flagged first, then by citations
2 of the 65 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- lin, 2015, Don't just listen, use your imagination: Leveraging visual common sense for non-visual tasks, CVPR
- lenat, 1989, Building Large Knowledge-Based Systems Representation and Inference in the CYC Project
Cited by
Sorted by citations
Items 401–500 of 1,027
What Does BERT with Vision Look At?
Li, L. H., Yatskar, M., Yin, D., Hsieh, C., & Chang, K.-W. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.469 · Cited by 141
Pothole Detection Using Deep Learning: A Real‐Time and AI‐on‐the‐Edge Perspective
Asad, M. H., Khaliq, S., Yousaf, M. H., Ullah, M. O., & Ahmad, A. (2022) · Advances in Civil Engineering · doi:10.1155/2022/9221211 · Cited by 149
DRAMA: Joint Risk Localization and Captioning in Driving
Malla, S., Choi, C., Dwivedi, I., Choi, J. H., & Li, J. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00110 · Cited by 128
Towards Faithful Model Explanation in NLP: A Survey
Lyu, Q., Apidianaki, M., & Callison-Burch, C. (2024) · Computational Linguistics · doi:10.1162/coli_a_00511 · Cited by 196
Jin, P., Takanobu, R., Zhang, W., Cao, X., & Li, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01300 · Cited by 281
Liu, F., Emerson, G., & Collier, N. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00566 · Cited by 212
Kaleido-BERT: Vision-Language Pre-training on Fashion Domain
Zhuge, M., Gao, D., Fan, D.-P., Jin, L., Chen, B., Zhou, H., Qiu, M., & Shao, L. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01246 · Cited by 130
Answering Questions about Charts and Generating Visual Explanations
Kim, D. H., Hoque, E., & Agrawala, M. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376467 · Cited by 133
Learning to Answer Questions in Dynamic Audio-Visual Scenarios
Li, G., Wei, Y., Tian, Y., Xu, C., Wen, J.-R., & Hu, D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01852 · Cited by 153
Answer-Type Prediction for Visual Question Answering
Kafle, K., & Kanan, C. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.538 · Cited by 123
Link the Head to the "Beak": Zero Shot Learning from Noisy Text Description at Part Precision
Elhoseiny, M., Zhu, Y., Zhang, H., & Elgammal, A. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.666 · Cited by 123
Chen, H., Zhang, H., Chen, P., Yi, J., & Hsieh, C. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1241 · Cited by 155
RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipes
Yagcioglu, S., Erdem, A., Erdem, E., & İkizler-Cinbiş, N. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1166 · Cited by 161
Structured Attentions for Visual Question Answering
Zhu, C., Zhao, Y., Huang, S., Tu, K., & Ma, Y. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.145 · Cited by 118
A unified framework for multi-modal federated learning
Xiong, B., Yang, X., Qi, F., & Xu, C. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.01.063 · Cited by 122
Automatic question generation and answer assessment: a survey
Das, B., Majumder, M., Phadikar, S., & Sekh, A. A. (2021) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-021-00151-1 · Cited by 123
Query-Guided Regression Network with Context Policy for Phrase Grounding
Chen, K., Kovvuri, R., & Nevatia, R. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.95 · Cited by 120
Deep Learning for Image-to-Text Generation: A Technical Overview
He, X., & Deng, L. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2741510 · Cited by 126
Conditional Image-Text Embedding Networks
Plummer, B. A., Kordas, P., Kiapour, M. H., Zheng, S., Piramuthu, R., & Lazebnik, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_16 · Cited by 122
Saliency-Guided Attention Network for Image-Sentence Matching
Ji, Z., Wang, H., Han, J., & Pang, Y. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00585 · Cited by 119
Overcoming Language Priors with Self-supervised Learning for Visual Question Answering
Zhu, X., Mao, Z., Liu, C., Zhang, P., Wang, B., & Zhang, Y. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/151 · Cited by 128
Liu, B., Zhan, L.-M., & Wu, X.-M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87196-3_20 · Cited by 120
Weakly-Supervised Visual Grounding of Phrases with Linguistic Structures
Xiao, F., Sigal, L., & Lee, Y. J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.558 · Cited by 120
Gan, C., Li, Y., Li, H., Sun, C., & Gong, B. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.201 · Cited by 116
Data Augmentation for Visual Question Answering
Kafle, K., Yousefhussien, M., & Kanan, C. (2017) · International Conference on Natural Language Generation · doi:10.18653/v1/w17-3529 · Cited by 116
CGMVQA: A New Classification and Generative Model for Medical Visual Question Answering
Ren, F., & Zhou, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2980024 · Cited by 117
Step-Wise Hierarchical Alignment Network for Image-Text Matching
Ji, Z., Chen, K., & Wang, H. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/106 · Cited by 120
Learning Models for Actions and Person-Object Interactions with Transfer to Question Answering
Mallya, A., & Lazebnik, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46448-0_25 · Cited by 118
Federated Learning for Vision-and-Language Grounding Problems
Liu, F., Wu, X., Ge, S., Fan, W., & Zou, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6824 · Cited by 115
TAP: Text-Aware Pre-training for Text-VQA and Text-Caption
Yang, Z., Lu, Y., Wang, J., Yin, X. P., Florencio, D. A. F., Wang, L., Zhang, C., Zhang, L., & Luo, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00864 · Cited by 130
Contextual Object Detection with Multimodal Large Language Models
Zang, Y., Li, W., Han, J., Zhou, K., & Loy, C. C. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02214-4 · Cited by 178
Context-Aware Captions from Context-Agnostic Supervision
Vedantam, R., Samy Bengio, A., Murphy, K. P., Parikh, D., & Chechik, G. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.120 · Cited by 120
Self-citationEnd-to-end Audio Visual Scene-aware Dialog Using Multimodal Attention-based Video Features
Hori, C., Alamri, H., Wang, J., Wichern, G., Hori, T., Cherian, A., Marks, T. K., Cartillier, V., Lopes, R. G., Das, A., et al. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682583 · Cited by 112
Self-citationVisual Question Answering with Memory-Augmented Networks
Ma, C., Shen, C., Dick, A., Wu, Q., Wang, P., van den Hengel, A., & Reid, I. D. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00729 · Cited by 117
Cross-modal knowledge reasoning for knowledge-based visual question answering
Yu, J., Zhu, Z., Wang, Y., Zhang, W., Hu, Y., & Tan, J. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107563 · Cited by 113
Entity-Oriented Multi-Modal Alignment and Fusion Network for Fake News Detection
Li, P., Sun, X., Yu, H., Tian, Y., Yao, F., & Xu, G. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3098988 · Cited by 112
Deep Understanding of Cooking Procedure for Cross-modal Recipe Retrieval
Chen, J., Ngo, C., Feng, F., & Chua, T. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240627 · Cited by 111
CLEVR-Ref+: Diagnosing Visual Reasoning With Referring Expressions
Liu, R., Liu, C., Bai, Y., & Yuille, A. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00431 · Cited by 118
Fine-Grained Scene Graph Generation with Data Transfer
Zhang, A., Yao, Y., Chen, Q., Ji, W., Liu, Z., Sun, M., & Chua, T. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19812-0_24 · Cited by 111
Causal Inference Meets Deep Learning: A Comprehensive Survey
Jiao, L., Wang, Y., Liu, X., Li, L., Liu, F., Ma, W., Guo, Y., Chen, P., Yang, S., & Hou, B. (2024) · Research · doi:10.34133/research.0467 · Cited by 141
Multi-step Reasoning via Recurrent Dual Attention for Visual Dialog
Gan, Z., Cheng, Y., Kholy, A. E., Li, L., Liu, J., & Gao, J. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1648 · Cited by 112
Learning What Makes a Difference from Counterfactual Examples and Gradient Supervision
Teney, D., Abbasnedjad, E., & van den Hengel, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58607-2_34 · Cited by 117
Schwartz, I., Yu, S., Hazan, T., & Schwing, A. G. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00214 · Cited by 110
Large-Scale Pretraining for Visual Dialog: A Simple State-of-the-Art Baseline
Murahari, V., Batra, D., Parikh, D., & Das, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58523-5_20 · Cited by 109
Self-citationImproving fake news detection with domain-adversarial and graph-attention neural network
Yuan, H., Zheng, J., Ye, Q., Qian, Y., & Zhang, Y. (2021) · Decision Support Systems · doi:10.1016/j.dss.2021.113633 · Cited by 113
Jiang, J., Chen, Z., Lin, H., Zhao, X., & Gao, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6766 · Cited by 108
Eigen-CAM: Visual Explanations for Deep Convolutional Neural Networks
Muhammad, M. B., & Yeasin, M. (2021) · SN Computer Science · doi:10.1007/s42979-021-00449-3 · Cited by 117
What Can Neural Networks Reason About?Preprint
Xu, K., Li, J., Zhang, M., Du, S. S., Kawarabayashi, K., & Jegelka, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13211 · Cited by 159
HUMAN‐CENTERED DESIGN OF ARTIFICIAL INTELLIGENCE
Margetis, G., Ntoa, S., Antona, M., & Stephanidis, C. (2021) · Wiley eBooks · doi:10.1002/9781119636113.ch42 · Cited by 113
Towards a Better Metric for Evaluating Question Generation Systems
Nema, P., & Khapra, M. M. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1429 · Cited by 106
Overcoming Language Priors in VQA via Decomposed Linguistic Representations
Jing, C., Wu, Y., Zhang, X., Jia, Y., & Wu, Q. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6776 · Cited by 103
Referring Expression Comprehension: A Survey of Methods and Datasets
Qiao, Y., Deng, C., & Wu, Q. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3042066 · Cited by 115
Bottom-Up Shift and Reasoning for Referring Image Segmentation
Yang, S., Xia, M., Li, G., Zhou, H.-Y., & Yu, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01111 · Cited by 106
Cross on Cross Attention: Deep Fusion Transformer for Image Captioning
Zhang, J., Xie, Y., Ding, W., & Wang, Z. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3243725 · Cited by 109
ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene GraphPreprint
Yu, F. R., Tang, J., Yin, W., Sun, Y., Tian, H., Wu, H. R., & Wang, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.16934 · Cited by 106
Towards Unsupervised Image Captioning With Shared Multimodal Embeddings
Laina, I., Rupprecht, C., & Navab, N. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00751 · Cited by 111
Towards Better Explanations of Class Activation Mapping
Jung, H., & Oh, Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00137 · Cited by 112
Ask Your Neurons: A Deep Learning Approach to Visual Question Answering
Malinowski, M., Rohrbach, M., & Fritz, M. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-1038-2 · Cited by 111
Image Understanding using vision and reasoning through Scene Description Graph
Aditya, S., Yang, Y., Baral, C. R., Aloimonos, Y., & Fermuller, C. M. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.12.004 · Cited by 103
Focal Visual-Text Attention for Visual Question Answering
Liang, J., Jiang, L., Cao, L., Li, L.-J., & Hauptmann, A. G. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00642 · Cited by 103
Context-Aware Visual Policy Network for Sequence-Level Image Captioning
Liu, D., Zha, Z.-J., Zhang, H., Zhang, Y., & Wu, F. H. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240632 · Cited by 110
B reak It Down: A Question Understanding Benchmark
Wolfson, T., Geva, M., Gupta, A., Gardner, M., Goldberg, Y., Deutch, D., & Berant, J. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00309 · Cited by 150
Bugliarello, E., Cotterell, R., Okazaki, N., & Elliott, D. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00408 · Cited by 133
Cross-media analysis and reasoning: advances and directions
Peng, Y., Zhu, W., Zhao, Y., Xu, C., Huang, Q., Lu, H., Zheng, Q., Huang, T., & Gao, W. (2017) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1601787 · Cited by 104
Learning Visual Question Answering by Bootstrapping Hard Attention
Malinowski, M., Doersch, C., Santoro, A., & Battaglia, P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01231-1_1 · Cited by 102
Straight to the Facts: Learning Knowledge Base Retrieval for Factual Visual Question Answering
Narasimhan, M., & Schwing, A. G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_28 · Cited by 107
MRA-Net: Improving VQA Via Multi-Modal Relation Attention Network
Peng, L., Yang, Y., Wang, Z., Huang, Z. H., & Shen, H. T. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3004830 · Cited by 103
Dataset Condensation with Differentiable Siamese AugmentationPreprint
Zhao, B., & Bilen, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.08259 · Cited by 111
Gurari, D., Li, Q., Lin, C., Zhao, Y., Guo, A., Stangl, A. J., & Bigham, J. P. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00103 · Cited by 103
Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Models
Cao, J., Gan, Z., Cheng, Y., Yu, L., Chen, Y.-C., & Liu, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58539-6_34 · Cited by 112
Deep Multimodal Neural Architecture Search
Zhou, Y., Cui, Y., Yu, J., Wang, M., Tao, D., & Tian, Q. C. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413977 · Cited by 106
A Survey on Machine Reading Comprehension—Tasks, Evaluation Metrics and Benchmark Datasets
Zeng, C., Li, S., Li, Q., Hu, J., & Hu, J. (2020) · Applied Sciences · doi:10.3390/app10217640 · Cited by 117
Gao, L., Yu, L., Zeng, P., Song, J., Wang, M., & Shen, H. T. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3120867 · Cited by 106
The Amazing Mysteries of the Gutter: Drawing Inferences Between Panels in Comic Book Narratives
Iyyer, M., Manjunatha, V., Guha, A., Vyas, Y., Boyd-Graber, J. L., Daumé, H., & Davis, L. S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.686 · Cited by 107
Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learning
Amrani, E., Ben‐Ari, R., Rotman, D., & Bronstein, A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16822 · Cited by 35
Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers
Hendricks, L. A., Mellor, J., Schneider, R., Alayrac, J.-B., & Nematzadeh, A. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00385 · Cited by 100
Sharma, D., Purushotham, S., & Reddy, C. K. A. (2021) · Scientific Reports · doi:10.1038/s41598-021-98390-1 · Cited by 106
Greedy Gradient Ensemble for Robust Visual Question Answering
Han, X., Wang, S., Su, C., Huang, Q., & Tian, Q. C. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00161 · Cited by 100
On the Value of Out-of-Distribution Testing: An Example of Goodhart's LawPreprint
Teney, D., Kafle, K., Shrestha, R., Abbasnejad, E., Kanan, C., & van den Hengel, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.09241 · Cited by 104
Ref-NMS: Breaking Proposal Bottlenecks in Two-Stage Referring Expression Grounding
Chen, L., Ma, W., Xiao, J., Zhang, H., & Chang, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16188 · Cited by 99
Re-Attention for Visual Question Answering
Guo, W., Zhang, Y., Yang, J., & Yuan, X. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3097180 · Cited by 98
TrSeg: Transformer for semantic segmentation
Jin, Y., Han, D. K., & Ko, H. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.04.024 · Cited by 101
Transform-Retrieve-Generate: Natural Language-Centric Outside-Knowledge Visual Question Answering
Gao, F., Ping, Q., Thattai, G., Reganti, A., Wu, Y. N., & Natarajan, P. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00501 · Cited by 114
COCO Attributes: Attributes for People, Animals, and Objects
Patterson, G., & Hays, J. H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46466-4_6 · Cited by 97
Visual Relationship Detection With Deep Structural Ranking
Liang, K., Guo, Y., Chang, H., & Chen, X. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12274 · Cited by 97
Yu, J., Zhang, W., Lu, Y., Qin, Z., Hu, Y., Tan, J., & Wu, Q. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2972830 · Cited by 96
Ishmam, M. F., Shovon, M. S. H., Mridha, M. F., & Dey, N. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102270 · Cited by 107
Chen, Y., Li, Q., & Liu, J. (2024) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.337606 · Cited by 102
Social-IQ: A Question Answering Benchmark for Artificial Social Intelligence
Zadeh, A., Chan, M., Liang, P. P., Tong, E., & Morency, L. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00901 · Cited by 107
DualVGR: A Dual-Visual Graph Reasoning Unit for Video Question Answering
Wang, J., Bao, B., & Xu, C. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3097171 · Cited by 100
Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization
Liang, P. P., Liu, Z., Tsai, Y.-H. H., Zhao, Q., Salakhutdinov, R., & Morency, L.-P. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1152 · Cited by 95
Image-Chat: Engaging Grounded Conversations
Shuster, K., Humeau, S., Bordes, A., & Weston, J. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.219 · Cited by 95
Spatially Aware Multimodal Transformers for TextVQA
Kant, Y., Batra, D., Anderson, P., Schwing, A. G., Parikh, D., Lu, J., & Agrawal, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58545-7_41 · Cited by 95
Self-citationHu, Z., İşcen, A., Sun, C., Wang, Z., Chang, K.-W., Sun, Y., Schmid, C., Ross, D. A., & Fathi, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02238 · Cited by 123
BreakingNews: Article Annotation by Image and Text Processing
Arnau Ramisa, A., Yan, F., Moreno-Noguer, F., & Mikolajczyk, K. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2721945 · Cited by 116
Localizing Natural Language in Videos
Chen, J., Ma, L., Chen, X., Jie, Z., & Luo, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018175 · Cited by 94
MarioQA: Answering Questions by Watching Gameplay Videos
Mun, J., Seo, P. H., Jung, I., & Han, B. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.312 · Cited by 95
Adversarial attack and defense technologies in natural language processing: A survey
Qiu, S., Liu, Q., Zhou, S., & Huang, W. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.04.020 · Cited by 94
A Survey of Code-switched Speech and Language ProcessingPreprint
Sitaram, S., Chandu, K. R., Rallabandi, S. K., & Black, A. W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.00784 · Cited by 94
Gordo, A., & Larlus, D. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.560 · Cited by 93
Metadata
- Authors
- Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Zitnick, C. L., & Parikh, D.
- Affiliations
- Virginia Tech (US)
- Microsoft (United States) (US)
- Georgia Institute of Technology (US)
- Venue
- 2015 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2015-12
- Pages
- 2425-2433
- OpenAlex
- W1933349210
- Cited by
- 4,487
- References
- 65
- Citations by year
- 2026: 260 · 2025: 519 · 2024: 532 · 2023: 560 · 2022: 518 · 2021: 620 · 2020: 485 · 2019: 432 · 2018: 293 · 2017: 183 · 2016: 76 · 2015: 9
- FWCI
- 76.70
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- visual question answering, open-ended question answering, image understanding, visual reasoning, assistive technology for visually impaired, automated assessment, image captioning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
