CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning
Open accessAbstract
When building artificial intelligence systems that can reason and answer questions about visual data, we need diagnostic tests to analyze our progress and discover shortcomings. Existing benchmarks for visual question answering can help, but have strong biases that models can exploit to correctly answer questions without reasoning. They also conflate multiple sources of error, making it hard to pinpoint model weaknesses. We present a diagnostic dataset that tests a range of visual reasoning abilities. It contains minimal biases and has detailed annotations describing the kind of reasoning each question requires. We use this dataset to analyze a variety of modern visual reasoning systems, providing novel insights into their abilities and limitations.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
To the best of the authors' knowledge, none of the existing scene representation benchmarks consider an active camera that can move in the scene.
“To the best of our knowledge, none of these benchmarks consider an active camera that can move in the scene.”
From Object-Centric Scene Representations Using Active Inference (2024) · cites this paper as Johnson et al., 2016
Section 2 (Related Work; page unavailable) discusses visual-understanding benchmarks but does not say whether any allow an active camera. Section 3 (The CLEVR Diagnostic Dataset; page unavailable) says camera positions are randomly jittered when images are generated, which does not establish whether a camera can move actively through a scene. Searches for active and movable cameras found no passage supporting the claim about all existing benchmarks. (LLM, conf=0.72)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460 · see citing works
Self-citation(2014) · Cited by 33,419 · see citing works
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · see citing works
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · see citing works
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
Krishna, R., Zhu, Y., Groth, O., Johnson, J., Hata, K., Kravitz, J., Chen, S., Kalantidis, Y., Li, L.-J., Shamma, D. A., et al. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0981-7 · Cited by 5,107 · see citing works
Self-citationDeep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196 · see citing works
Understanding natural language
Winograd, T. A. (1972) · Cognitive Psychology · doi:10.1016/0010-0285(72)90002-3 · Cited by 2,803 · see citing works
Young, P., Lai, A., Hodosh, M., & Hockenmaier, J. (2014) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00166 · Cited by 2,439 · see citing works
Stacked Attention Networks for Image Question Answering
Yang, Z., He, X., Gao, J., Deng, L., & Smola, A. J. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.10 · Cited by 2,036 · see citing works
Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
Fukui, A., Park, D. H., Yang, D., Rohrbach, A., Darrell, T., & Rohrbach, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1044 · Cited by 1,582 · see citing works
Hybrid computing using a neural network with dynamic external memory
Graves, A., Wayne, G., Reynolds, M., Harley, T., Danihelka, I., Grabska-Barwińska, A., Colmenarejo, S. G., Grefenstette, E., Ramalho, T., Agapiou, J., et al. (2016) · Nature · doi:10.1038/nature20101 · Cited by 1,412 · see citing works
Hierarchical Question-Image Co-Attention for Visual Question AnsweringPreprint
Lu, J., Yang, J., Batra, D., & Parikh, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00061 · Cited by 1,303 · see citing works
Image retrieval using scene graphs
Johnson, J., Krishna, R., Stark, M., Li, L.-J., Shamma, D. A., Bernstein, M. S., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298990 · Cited by 1,101 · see citing works
Self-citationReferItGame: Referring to Objects in Photographs of Natural Scenes
Kazemzadeh, S., Ordóñez, V., Matten, M., & Berg, T. L. (2014) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1086 · Cited by 1,082 · see citing works
VQA: Visual Question AnsweringPreprint
Agrawal, A., Lu, J., Antol, S., Mitchell, M., Zitnick, C. L., Batra, D., & Parikh, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.00468 · Cited by 968 · see citing works
Self-citationAndreas, J., Rohrbach, M., Darrell, T., & Klein, D. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.12 · Cited by 933 · see citing works
Gao, Y., Beijbom, O., Zhang, N., & Darrell, T. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.41 · Cited by 912 · see citing works
Levesque, H. J., Davis, E., & Morgenstern, L. (2011) · Cited by 879 · see citing works
Visual7W: Grounded Question Answering in Images
Zhu, Y., Groth, O., Bernstein, M., & Fei-Fei, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.540 · Cited by 794 · see citing works
Self-citationDynamic Memory Networks for Visual and Textual Question AnsweringPreprint
Xiong, C., Merity, S., & Socher, R. (2016) · International Conference on Machine Learning · doi:10.48550/arxiv.1603.01417 · Cited by 770 · see citing works
Ask, Attend and Answer: Exploring Question-Guided Spatial Attention for Visual Question Answering
Xu, H., & Saenko, K. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46478-7_28 · Cited by 753 · see citing works
MovieQA: Understanding Stories in Movies through Question-Answering
Tapaswi, M., Zhu, Y., Stiefelhagen, R., Torralba, A. B., Urtasun, R., & Fidler, S. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.501 · Cited by 646 · see citing works
Ask Your Neurons: A Neural-Based Approach to Answering Questions about Images
Malinowski, M., Rohrbach, M., & Fritz, M. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.9 · Cited by 633 · see citing works
Exploring Models and Data for Image Question AnsweringPreprint
Ren, M., Kiros, R., & Zemel, R. S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.02074 · Cited by 618 · see citing works
Where to Look: Focus Regions for Visual Question Answering
Shih, K. J., Singh, S., & Hoiem, D. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.499 · Cited by 503 · see citing works
Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question AnsweringPreprint
Gao, H., Mao, J., Zhou, J., Huang, Z., Wang, L., & Xu, W. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.05612 · Cited by 437 · see citing works
Visual Turing test for computer vision systems
Geman, D., Geman, S., Hallonquist, N., & Laurent Younes, B. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1422953112 · Cited by 323 · see citing works
Yin and Yang: Balancing and Answering Binary Visual Questions
Zhang, P., Goyal, Y., Summers-Stay, D. A., Batra, D., & Parikh, D. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.542 · Cited by 312 · see citing works
Analyzing the Behavior of Visual Question Answering Models
Agrawal, A., Batra, D., & Parikh, D. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1203 · Cited by 297 · see citing works
Simple Baseline for Visual Question AnsweringPreprint
Zhou, B., Tian, Y., Sukhbaatar, S., Szlam, A. D., & Fergus, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.02167 · Cited by 266 · see citing works
Learning to Answer Questions from Image Using Convolutional Neural Network
Ma, L., Lu, Z., & Li, H. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10442 · Cited by 260 · see citing works
Bringing Semantics into Focus Using Visual Abstraction
Zitnick, C. L., & Parikh, D. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.387 · Cited by 197 · see citing works
Self-citationA Simple Method to Determine if a Music Information Retrieval System is a “Horse”
Sturm, B. L. T. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2330697 · Cited by 177 · see citing works
Clever Hans, the Horse of Mr. Von Osten; A Contribution to Experimental Animal and Human Psychology
S., E. C., Pfungst, O., & Rahn, C. L. (1914) · The American Journal of Psychology · doi:10.2307/1413026 · Cited by 133 · see citing works
Learning to Compose Neural Networks for Question AnsweringPreprint
Andreas, J., Rohrbach, M., Darrell, T., & Klein, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.01705 · Cited by 100 · see citing works
Visual Madlibs: Fill in the blank Image Generation and Question AnsweringPreprint
Yu, L., Park, E., Berg, A. C., & Berg, T. L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.00278 · Cited by 75 · see citing works
Wu, Q., Shen, C., van den Hengel, A., Wang, P., & Dick, A. (2016) · arXiv (Cornell University) · Cited by 32 · see citing works
Flagged first, then by citations
4 of the 43 references couldn’t be matched to a known paper.
Research works printed but not linked: 10
- J. Chen, P. Kuznetsova, D. Warren, and Y. Choi. Deja image- captions: A corpus of expressive image descriptions in repe- tition. In NAACL, 2015. 2
- A. Farhadi, M. Hejrati, A. Sadeghi, P. Young, C. Rashtchian, J. Hockenmaier, and D. Forsyth. Every picture tells a story: Generating sentences for images. In ECCV, 2010. 2
- A. Jabri, A. Joulin, and L. van der Maaten. Revisiting visual question answering baselines. In ECCV, 2016. 1, 4
- A. Joulin and T. Mikolov. Inferring algorithmic patterns with stack-augmented recurrent nets. In NIPS, 2015. 8
- H. J. Levesque, E. Davis, and L. Morgenstern. The Wino- grad schema challenge. In AAAI Spring Symposium: Logi- cal Formalizations of Commonsense Reasoning, volume 46, page 47, 2011. 2
- M. Malinowski and M. Fritz. A multi-world approach to question answering about real-world scenes based on uncer- tain input. In NIPS, 2014. 1, 2
- M. Malinowski and M. Fritz. Towards a visual Turing chal- lenge. In NIPS 2014 Workshop on Learning Semantics, 2014. 2
- A. Ray, G. Christie, M. Bansal, D. Batra, and D. Parikh. Question relevance in vqa: Identifying non-visual and false- premise questions. In EMNLP, 2016. 1
- J. Weston, A. Bordes, S. Chopra, A. Rush, B. van Merriënboer, A. Joulin, and T. Mikolov. Towards ai- complete question answering: A set of prerequisite toy tasks. In ICLR, 2016. 2
- J. Weston, S. Chopra, and A. Bordes. Memory networks. In ICLR, 2015. 8
Cited by
Sorted by citations
Inferring and Executing Programs for Visual Reasoning
Johnson, J., Hariharan, B., van der Maaten, L., Hoffman, J., Fei-Fei, L., Zitnick, C. L., & Girshick, R. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.325 · Cited by 487 · see citing works
Self-citationIQA: Visual Question Answering in Interactive Environments
Gordon, D., Kembhavi, A., Rastegari, M., Redmon, J., Fox, D., & Farhadi, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00430 · Cited by 362 · see citing works
Compositional Attention Networks for Machine ReasoningPreprint
Hudson, D. A., & Manning, C. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.03067 · Cited by 341 · see citing works
Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoning
Ramanishka, V., Chen, Y., Misu, T., & Saenko, K. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00803 · Cited by 319 · see citing works
Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning
Mascharka, D., Tran, P., Soklaski, R., & Majumdar, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00519 · Cited by 203 · see citing works
Park, D. H., Darrell, T., & Rohrbach, A. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00472 · Cited by 201 · see citing works
Mapping Instructions and Visual Observations to Actions with Reinforcement Learning
Misra, D. K., Langford, J., & Artzi, Y. (2017) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1106 · Cited by 258 · see citing works
Visual Entailment: A Novel Task for Fine-Grained Image UnderstandingPreprint
Xie, N., Lai, F., Doran, D., & Kadav, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.06706 · Cited by 156 · see citing works
Two Can Play This Game: Visual Dialog with Discriminative Question Generation and Answering
Jain, U., Schwing, A. G., & Lazebnik, S. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00603 · Cited by 75 · see citing works
CHALET: Cornell House Agent Learning EnvironmentPreprint
Yan, C., Misra, D. K., Bennnett, A., Walsman, A., Bisk, Y., & Artzi, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.07357 · Cited by 71 · see citing works
Evaluating ‘Graphical Perception’ with CNNs
Haehn, D., Tompkin, J., & Pfister, H. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2865138 · Cited by 63 · see citing works
Question Type Guided Attention in Visual Question Answering
Shi, Y., Furlanello, T., Zha, S., & Anandkumar, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01225-0_10 · Cited by 54 · see citing works
CLOSURE: Assessing Systematic Generalization of CLEVR ModelsPreprint
Bahdanau, D., de Vries, H., O’Donnell, T. J., Murty, S., Beaudoin, P., Bengio, Y., & Courville, A. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.05783 · Cited by 60 · see citing works
Quantifying and Alleviating the Language Prior Problem in Visual Question Answering
Guo, Y., Cheng, Z., Nie, L., Liu, Y., Wang, Y., & Kankanhalli, M. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331186 · Cited by 40 · see citing works
Lee, K.-H., Palangi, H., Chen, X., Hu, H., & Gao, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.09953 · Cited by 33 · see citing works
A survey on knowledge-enhanced multimodal learning
Lymperaiou, M., & Stamou, G. B. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10825-z · Cited by 35 · see citing works
Raboh, M., Herzig, R., Berant, J., Chechik, G., & Globerson, A. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093297 · Cited by 28 · see citing works
Visual Entailment Task for Visually-Grounded Language LearningPreprint
Xie, N., Lai, F., Doran, D., & Kadav, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.10582 · Cited by 28 · see citing works
RAVEN: A Dataset for Relational and Analogical Visual rEasoNingPreprint
Zhang, C., Gao, F., Jia, B., Zhu, Y., & Zhu, S. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.02741 · Cited by 28 · see citing works
DDRprog: A CLEVR Differentiable Dynamic Reasoning ProgrammerPreprint
Suárez, J., Johnson, J., & Fei-Fei, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.11361 · Cited by 27 · see citing works
Self-citationNeuro-Symbolic AI: An Emerging Class of AI Workloads and their CharacterizationPreprint
Susskind, Z., Arden, B., John, L. K., Stockton, P., & John, E. B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.06133 · Cited by 21 · see citing works
Scene Graph Generation via Conditional Random FieldsPreprint
Cong, W., Wang, W. Y., & Lee, W.-C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.08075 · Cited by 15 · see citing works
Library learning for neurally-guided Bayesian program induction
Ellis, K., Morales, L., Sablé-Meyer, M., Solar-Lezama, A., & Tenenbaum, J. B. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 13 · see citing works
Differentiable Adaptive Computation Time for Visual Reasoning
Eyzaguirre, C., & Soto, Á. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01283 · Cited by 13 · see citing works
Better Set Representations For Relational ReasoningPreprint
Huang, Q., He, H., Singh, A., Zhang, Y., Lim, S.-N., & Benson, A. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04448 · Cited by 11 · see citing works
CoDraw: Collaborative Drawing as a Testbed for Grounded Goal-driven CommunicationPreprint
Kim, J.-H., Kitaev, N., Chen, X., Rohrbach, M., Zhang, B., Tian, Y., Batra, D., & Parikh, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.05558 · Cited by 10 · see citing works
Object-Centric Scene Representations Using Active Inference
Van de Maele, T., Verbelen, T., Mazzaglia, P., Ferraro, S., & Dhoedt, B. (2024) · Neural Computation · doi:10.1162/neco_a_01637 · Cited by 5 · see citing works
Track, Check, Repeat: An EM Approach to Unsupervised Tracking
Harley, A. W., Zuo, Y., Wen, J. A., Mangal, A., Potdar, S., Chaudhry, R., & Fragkiadaki, K. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01631 · Cited by 6 · see citing works
Knowledge Graph Extraction from Videos
Mahon, L., Giunchiglia, E., Li, B., & Lukasiewicz, T. (2020) · International Conference on Machine Learning and Applications · doi:10.1109/icmla51294.2020.00014 · Cited by 4 · see citing works
A visual questioning answering approach to enhance robot localization in indoor environments
Peña‐Narvaez, J. D., Martín, F., Hernández, J. M. G., & Pérez‐Rodríguez, R. (2023) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2023.1290584 · Cited by 3 · see citing works
Searching for explanations of black-box classifiers in the space of semantic queries
Liartis, J., Dervakos, E., Mastromichalakis, O. M., Chortaras, A., & Stamou, G. B. (2023) · Semantic Web · doi:10.3233/sw-233469 · Cited by 3 · see citing works
Grounding Spatio-Temporal Language with TransformersPreprint
Karch, T., Teodorescu, L., Hofmann, K., Moulin-Frier, C., & Oudeyer, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08858 · Cited by 3 · see citing works
Embodied Language Grounding with 3D Visual Feature RepresentationsPreprint
Prabhudesai, M., Tung, H.-Y. F., Javed, S. A., Sieb, M., Harley, A. W., & Fragkiadaki, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.01210 · Cited by 3 · see citing works
Deep Algorithmic Question Answering: Towards a Compositionally Hybrid AI for Algorithmic ReasoningPreprint
Nuamah, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08006 · Cited by 2 · see citing works
Semantic Queries Explaining Opaque Machine Learning Classifiers.
Liartis, J., Dervakos, E., Mastromichalakis, O. M., Chortaras, A., & Stamou, G. B. (2021) · Cited by 1 · see citing works
Visual Reasoning with Natural LanguagePreprint
Zhou, S., Suhr, A., & Artzi, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.00453 · Cited by 1 · see citing works
Towards Cognitive-and-Immersive Systems: Experiments in a Shared (or common) Blockworld Framework.
Peveler, M., Srivastava, B., Talamadupula, K., Sundar, G. N., Bringsjord, S., & Su, H. (2017)
A new dataset and model for learning to understand navigational instructionsPreprint
Can, O. A., & Yüret, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07952
Learning from Implicit Information in Natural Language Instructions for Robotic Manipulations
Can, O. A., Martires, P. Z. D., Persson, A., Gaal, J., Loutfi, A., Raedt, L. D., Yüret, D., & Saffiotti, A. (2019) · doi:10.18653/v1/w19-1604
Weakly-supervised multi-class object localization using only object counts as labelsPreprint
Mills, K., & Tamblyn, I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.11743
Post-hoc XAI Method for Visual Question Answering (VQA)
Muddamsetty, S. M., Schmidt, A. B., & Moeslund, T. B. (2025) · Lecture notes in computer science · doi:10.1007/978-981-97-8705-0_25
- Authors
- Johnson, J., Hariharan, B., van der Maaten, L., Fei-Fei, L., Zitnick, C. L., & Girshick, R.
- Affiliations
- Meta (United States) (US)
- Stanford University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1612.06890
- OpenAlex
- W2953212746
- Cited by
- 40
- References
- 43
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 2 · 2021: 6 · 2020: 4 · 2019: 8 · 2018: 13 · 2017: 5
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Zenodo (CERN European Organization for Nuclear Research) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Logic, Reasoning, and Knowledge
- Keywords
- visual reasoning, compositional language, diagnostic dataset, visual question answering, benchmark bias, model weaknesses
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
