Are You Smarter Than a Sixth Grader? Textbook Question Answering for Multimodal Machine Comprehension
Kembhavi, Aniruddha, Seo, Minjoon, Schwenk, Dustin, Choi, Jonghyun, Farhadi, Ali, Hajishirzi, Hannaneh·2017·2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Cited by (246)
Items 101–200 of 246
- VTQA: Visual Text Question Answering via Entity Alignment and Cross-Media ReasoningKang Chen, Xiangqian Wu · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- Relation-Aware Fine-Grained Reasoning Network for Textbook Question AnsweringJie Ma, Jun Liu, Yaxian Wang, Junjun Li, Tongliang Liu · 2021 · IEEE Transactions on Neural Networks and Learning Systems
- Investigating Educational and Noneducational Answer Selection for Educational Question GenerationSteuer, Tim, Filighera, Anna, Tregel, Thomas · 2022 · IEEE Access
- Procedural Reasoning Networks for Understanding Multimodal ProceduresMustafa Sercan Amac, Semih Yagcioglu, Aykut Erdem, Erkut Erdem · 2019 · Conference on Computational Natural Language Learning
- Asking questions on handwritten document collectionsMinesh Mathew, Lluís Gómez, Dìmosthenis Karatzas, C. V. Jawahar · 2021 · International Journal on Document Analysis and Recognition (IJDAR)
- Fs-DSM: Few-Shot Diagram-Sentence Matching via Cross-Modal Attention Graph ModelXin Hu, Lingling Zhang, Jun Liu, Qinghua Zheng, Jianlong J. Zhou · 2021 · IEEE Transactions on Image Processing
- Computer Science Diagram Understanding with Topology ParsingShaowei Wang, Lingling Zhang, Xuan Luo, Yi Yang, Xin Hu, Tao Qin, Jun Liu · 2022 · ACM Transactions on Knowledge Discovery from Data
- Unified Generative Adversarial Networks for Multiple-Choice Oriented Machine ComprehensionZhuang Liu, Keli Xiao, Bo Jin, Kaiyu Huang, Degen Huang, Yunxia Zhang · 2020 · ACM Transactions on Intelligent Systems and Technology
- Visuo-Linguistic Question Answering (VLQA) ChallengeShailaja Keyur Sampat, Yezhou Yang, Chitta R. Baral · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- Attention in Reasoning: Dataset, Analysis, and ModelingShi Chen, Ming Xin Jiang, Jinhui Yang, Qi Zhao · 2021 · IEEE Transactions on Pattern Analysis and Machine Intelligence
- Diagram Perception Networks for Textbook Question Answering via Joint OptimizationJie Ma, Jun Liu, Qi Chai, Pinghui Wang, Jing Tao · 2023 · International Journal of Computer Vision
- Answering Science Exam Questions Using Query Rewriting with Background KnowledgeRyan Musa, Xiaoyan Wang, Achille Fokoue, Nicholas Mattei, Chang, Maria, Pavan Kapanipathi, Bassem Makni, Kartik Talamadupula, Michael Witbrock · 2018 · arXiv (Cornell University)
- Improving QA Generalization by Concurrent Modeling of Multiple BiasesMingzhu Wu, Nafise Sadat Moosavi, Andreas Rücklé, Iryna Gurevych · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- GPTR: Gestalt-Perception Transformer for Diagram Object DetectionXin Hu, Lingling Zhang, Jun Liu, Jinfu Fan, Yang You, Yaqiang Wu · 2023 · Proceedings of the AAAI Conference on Artificial Intelligence
- Robust Question Answering Through Sub-part AlignmentJifan Chen, Greg Durrett · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
- NewsKVQA: Knowledge-Aware News Video Question AnsweringPranay Gupta, Manish Gupta · 2022 · Lecture notes in computer science
- PDF-VQA: A New Dataset for Real-World VQA on PDF DocumentsYihao Ding, Siwen Luo, Hyunsuk Chung, Soyeon Caren Han · 2023 · Lecture notes in computer science
- Answer Mining from a Pool of Images: Towards Retrieval-Based Visual Question AnsweringAbhirama Subramanyam Penamakuri, Manish Gupta, Mithun Das Gupta, Anand Mishra · 2023 · International Joint Conference on Artificial Intelligence
- Essay-Anchor Attentive Multi-Modal Bilinear Pooling for Textbook Question AnsweringJuzheng Li, Hang Su, Jun Zhu, Bo Zhang · 2018 · IEEE International Conference on Multimedia and Expo (ICME)
- Textbook Question Answering with Multi-type Question Learning and Contextualized Diagram RepresentationJianwei He, Xianghua Fu, Zi Long, Shuxin Wang, Chaojie Liang, Hongbin Lin · 2021 · Lecture notes in computer science
- Enhancing few-shot KB-VQA with panoramic image captions guided by Large Language ModelsPengpeng Qiang, Hongye Tan, Xiaoli Li, Dian Wang, Ru Li, Xinyi Sun, Hu Zhang, Jiye Liang · 2025 · Neurocomputing
- Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional ManualsTe-Lin Wu, Alex Spangher, Pegah Alipoormolabashi, Marjorie Freedman, Ralph Weischedel, Nanyun Peng · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Humans Optional? Automatic Large-Scale Test Collections for Entity, Passage, and Entity-Passage RetrievalLaura Dietz, Jeff Dalton · 2020 · Datenbank-Spektrum
- An exploratory study on the potential of machine reading comprehension as an instructional scaffolding device in second language reading lessonsDongkwang Shin, Jang Ho Lee, Yongsang Lee · 2022 · System
- A Survey of Machine Reading Comprehension MethodsXiaobo Xu, Turdi Tohti, Askar Hamdulla · 2022 · International Conference on Asian Language Processing
- CLER: Cross-task Learning with Expert Representation to Generalize Reading and UnderstandingTakumi Takahashi, Motoki Taniguchi, Tomoki Taniguchi, Tomoko Ohkuma · 2019 · Workshop on Machine Reading for Question Answering (MRQA)
- CoG-DQA: Chain-of-Guiding Learning with Large Language Models for Diagram Question AnsweringShaowei Wang, Lingling Zhang, Longji Zhu, Tao Qin, Kim–Hui Yap, Xinyu Zhang, Jun Liu · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- Can Machines Learn to Comprehend Scientific Literature?Donghyeon Park, Yonghwa Choi, Daehan Kim, Minhwan Yu, Seongsoon Kim, Jaewoo Kang · 2019 · IEEE Access
- Perhaps PTLMs Should Go to School – A Task to Assess Open Book and Closed Book QAManuel R. Ciosici, Joe Cecil, Dong‐Ho Lee, Alex Hedges, Marjorie Freedman, Ralph Weischedel · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Text-to-ESQ: A Two-Stage Controllable Approach for Efficient Retrieval of Vaccine Adverse Events from NoSQL DatabaseWenlong Zhang, Kangping Zeng, Yang Xinming, Tian Shi, Ping Wang · 2023 · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB)
- VLsI: Verbalized Layers-to-Interactions from Large to Small Vision Language ModelsByung‐Kwan Lee, Ryo Hachiuma, Yu-Chiang Frank Wang, Yong Man Ro, Yueh-Hua Wu · 2025 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- Exploring The Landscape of Distributional Robustness for Question Answering ModelsAnas Awadalla, Mitchell Wortsman, Gabriel Ilharco, Sewon Min, Ian Magnusson, Hannaneh Hajishirzi, Ludwig Schmidt · 2022 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- MMInstruct: a high-quality multi-modal instruction tuning dataset with extensive diversityYangzhou Liu, Yue Qin Cao, Zhangwei Gao, Weiyun Wang, Zhe Chen, Wenhai Wang, Hao Tian, Lewei Lu, Xizhou Zhu, Tong Lu et al. · 2024 · Science China Information Sciences
- Improving Generalization in Visual Reasoning via Self-ensembleTien-Huy Nguyen, Quang-Khai Tran, Anh-Tuan Quang-Hoang · 2025 · Lecture notes in computer science
- Navigating the Landscape of Hint Generation Research: From the Past to the FutureAnubhav Jangra, Jamshid Mozafari, Adam Jatowt, Smaranda Muresan · 2025 · Transactions of the Association for Computational Linguistics
- MoQA – A Multi-modal Question Answering ArchitectureMonica Haurilet, Ziad Al-Halah, Rainer Stiefelhagen · 2019 · Lecture notes in computer science
- Multi-Level Multimodal Transformer Network for Multimodal Recipe ComprehensionAo Liu, Shuai Yuan, Chenbin Zhang, Congjian Luo, Yaqing Liao, Kun Bai, Zenglin Xu · 2020 · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
- From Two Graphs to N Questions: A VQA Dataset for Compositional Reasoning on Vision and Commonsense.Difei Gao, Ruiping Wang, Shiguang Shan, Xilin Chen · 2019 · arXiv (Cornell University)
- TPKE-QA: A gapless few-shot extractive question answering approach via task-aware post-training and knowledge enhancementQiao Xiao, Li Ren, Jianxi Yang, Yu Chen, Shixin Jiang, Di Wang · 2024 · Expert Systems with Applications
- Vector-Quantized Input-Contextualized Soft Prompts for Natural Language UnderstandingRishabh Bhardwaj, Amrita Saha, Steven C. H. Hoi, Soujanya Poria · 2022 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Relation-Aware Heterogeneous Graph Network for Learning Intermodal Semantics in Textbook Question AnsweringSai Zhang, Yunjie Wu, Xiaowang Zhang, Zhiyong Feng, Liang Wan, Zhiqiang Zhuang · 2024 · IEEE Transactions on Neural Networks and Learning Systems
- Prompt Learning for Few-Shot Question Answering via Self-Context Data AugmentationJian-Qiang Qiu, Chun-Yang Zhang, C. L. Philip Chen · 2024 · IEEE Transactions on Artificial Intelligence
- Reason-and-Execute Prompting: Enhancing Multi-Modal Large Language Models for Solving Geometry QuestionsXiuliang Duan, Dating Tan, Liangda Fang, Yuyu Zhou, Chaobo He, Ziliang Chen, Lusheng Wu, Guanliang Chen, Zhiguo Gong, Weiqi Luo et al. · 2024 · ACM International Conference on Multimedia (ACM MM)
- TriRAG: Enhancing Retrieval-Augmented Generation Method with Triple-Based Knowledge Graphs for Improved Question AnsweringHongzhi Zhang, M. Omair Shafiq · 2025 · IEEE International Conference on Semantic Computing (ICSC)
- Not to Overfit or Underfit the Source Domains? An Empirical Study of Domain Generalization in Question AnsweringMd Arafat Sultan, Avi Sil, Radu Florian · 2022 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Tokenization Consistency Matters for Generative Models on Extractive NLP TasksKaiser Sun, Peng Qi, Yuhao Zhang, Lan Liu, William Yang Wang, Zhiheng Huang · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- Language Based Mapping of Science Assessment Items to SkillsFarah Nadeem, Mari Ostendorf E · 2017 · Workshop on Innovative Use of NLP for Building Educational Applications
- Look, Read and Enrich - Learning from Scientific Figures and their CaptionsGomez-Perez, Jose Manuel, Ortega, Raul · 2019 · Proceedings of the 10th International Conference on Knowledge Capture
- InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic TasksWenhai Wang, Zhe Chen, Yangzhou Liu, Yue Cao, Weiyun Wang, Xizhou Zhu, Lewei Lu, Tong Lü, Yu Qiao, Yifeng Dai · 2025 · Advances in computer vision and pattern recognition
- Evaluating Multimodal Large Language Models on Educational Textbook Question AnsweringHessa Abdulrahman Alawwad, Anas Zafar, Areej Alhothali, Usman Naseem, Ali Alkhathlan, Amani Tariq Jamal · 2025 · International Generative AI and Computational Language Modelling Conference (GACLM)
- Transductive Cross-Lingual Scene-Text Visual Question AnsweringLin Li, Haohan Zhang, Zeqin Fang, Zhongwei Xie, Jianquan Liu · 2023 · Lecture notes in computer science
- MRHF: Multi-stage Retrieval and Hierarchical Fusion for Textbook Question AnsweringPeide Zhu, Zhen Wang, Manabu Okumura, Jie Yang · 2024 · Lecture notes in computer science
- Enhancing the Learning Experience: Using Vision-Language Models to Generate Questions for Educational VideosMarkos Stamatakis, Joshua Berger, Christian Wartena, Ralph Ewerth, Anett Hoppe · 2025 · Lecture notes in computer science
- Spoken Multiple-Choice Question Answering Using Multimodal Convolutional Neural NetworksShang-Bao Luo, Hung-Shin Lee, Kuan‐Yu Chen, Hsin‐Min Wang · 2019 · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)
- CSDQA: Diagram Question Answering in Computer ScienceShaowei Wang, Lingling Zhang, Yi Yang, Xin Hu, Tao Qin, Bifan Wei, Jun Liu · 2021 · Communications in computer and information science
- Qasar: Self-Supervised Learning Framework for Extractive Question AnsweringHaytham Assem, Rajdeep Sarkar, Sourav Dutta · 2021 · IEEE International Conference on Big Data (BigData)
- Survey of Machine Reading Comprehension Models and its Evaluation MetricsM. Therasa, G. Mathivanan · 2022 · International Conference on Computing Methodologies and Communication (ICCMC)
- Mind Reasoning Manners: Enhancing Type Perception for Generalized Zero-Shot Logical Reasoning Over TextFangzhi Xu, Jun Liu, Qika Lin, Tianzhe Zhao, Jian Zhang, Lingling Zhang · 2023 · IEEE Transactions on Neural Networks and Learning Systems
- Two Decades of GREC Workshop Series. Conclusions of GREC2017Josep Lladós · 2018 · Lecture notes in computer science
- A Question-Answer Driven Approach to Reveal Affirmative Interpretations from Verbal NegationsMd Mosharaf Hossain, Luke Holman, Anusha Kakileti, Tiffany H. Kao, Nathan Brito, Aaron Mathews, Eduardo Blanco · 2022 · Findings of the Association for Computational Linguistics: NAACL
- TT-Net: Topic Transfer-Based Neural Network for Conversational Reading ComprehensionYingjie Gu, Xiaolin Gui, Defu Li · 2019 · IEEE Access
- Textbook Question Answering with Knowledge Graph Understanding and Unsupervised Open-set Text Comprehension.Daesik Kim, Seonhoon Kim, Nojun Kwak · 2018 · arXiv (Cornell University)
- Reasoning-Driven Question-Answering for Natural Language UnderstandingDaniel Khashabi · 2019 · arXiv (Cornell University)
- Aligning LLMs for the Classroom with Knowledge-Based Retrieval: A Comparative RAG StudyAmay Dilip Jain, Liu Cui, Si Chen · 2025 · IEEE International Conference on Teaching, Assessment, and Learning for Engineering
- Alignment Relation is What You Need for Diagram ParsingX. M. Zhang, Lingling Zhang, Xin Hu, Jun Liu, Shaowei Wang, Qianying Wang · 2024 · IEEE Transactions on Image Processing
- CircuitVQA: A Visual Question Answering Dataset for Electrical Circuit ImagesRahul Mehta, Bhavyajeet Singh, Vasudeva Varma, Manish Gupta · 2024 · Lecture notes in computer science
- Cross-modal multi-relational graph reasoning: A novel model for multimodal textbook comprehensionLingyun Song, Wenqing Du, Xinbiao Gan, Xinbiao Gan, Xiaoqi Wang, Xuequn Shang · 2025 · Information Fusion
- WikiDT: Visual-Based Table Recognition and Question Answering DatasetHui Shi, Yusheng Xie, Luis Goncalves, Sicun Gao, Jishen Zhao · 2024 · Lecture notes in computer science
- CEDA-TQA: Context Enhancement and Domain Adaptation Method for Textbook QA Based on LLM and RAGXiaopu Wang, Jianing Sun, Chao Qi · 2024 · International Conference on Networking and Network Applications (NaNA)
- LFSRM: Few-Shot Diagram-Sentence Matching via Local-Feedback Self-Regulating MemoryLingling Zhang, Wenjun Wu, Jun Liu, Xiaojun Chang, Xin Hu, Xuan Luo, Yaqiang Wu, Qinghua Zheng · 2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence
- A Prolog application for reasoning on maths puzzles with diagramsRiccardo Buscaroli, Federico Chesani, Giulia Giuliani, Daniela Loreti, Paola Mello · 2022 · Journal of Experimental & Theoretical Artificial Intelligence
- Reconstructing cognitive levels of test items in Indonesian Textbook for vocational schoolErikson Saragih, Samuel Sinulingga, Bethesda Bukit, Vanny Wiranata · 2022 · KEMBARA Journal of Scientific Language Literature and Teaching
- How Optimal is Greedy Decoding for Extractive Question Answering?Or Castel, Ori Ram, Avia Efrat, Omer Levy · 2021 · arXiv (Cornell University)
- Proceedings of the Workshop on Machine Reading for Question Answering2018
- Optimal RAG System Design for Turkish Textbooks: A Comprehensive Evaluation and Performance Enhancement StudyElif Nur Öner, Sinem Ceyhun, Muhammed Halil Yıldız, Andalib Goncharova, Türkan Sena Yücel, H. Toprak Kesgin, Mehmet Fatih Amasyalı · 2025 · Innovations in Intelligent Systems and Applications Conference (ASYU)
- Beyond LLaVA-HD: Diving Into High-Resolution Multimodal Large Language ModelsYifan Zhang, Qingsong Wen, Chaoyou Fu, Kun Wang, Xue Wang, Zhang Zhang, Liang Wang, Rong Jin · 2026 · IEEE Transactions on Pattern Analysis and Machine Intelligence
- Enhancing Textbooks with Visuals from the Web for Improved LearningJanvijay Singh, Vilém Zouhar, Mrinmaya Sachan · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- DEMON24: ACM MM24 Demonstrative Instruction Following ChallengeZhiqi Ge, Juncheng Li, Qifan Yu, Wei Zhou, Siliang Tang, Yueting Zhuang · 2024 · ACM International Conference on Multimedia (ACM MM)
- A resilient generative model in few-shot question answeringAnqi Zou, Yanping Chen, Ruizhang Huang, Yongbin Qin · 2025 · Knowledge-Based Systems
- On the Transferability of Minimal Prediction Preserving Inputs in Question AnsweringShayne Longpre, Yi Lu, Christopher DuBois · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
- Question Classification for Efficient QA SystemEt. al. K. P. Moholkar · 2021 · Türk bilgisayar ve matematik eğitimi dergisi
- Modeling Temporal-Modal Entity Graph for Procedural Multimodal Machine ComprehensionHuibin Zhang, Zhengkun Zhang, Yao Zhang, Jun Wang, Yufan Li, Ning Jiang, Xin Wei, Zhenglu Yang · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Image Position Prediction in Multimodal DocumentsMasayasu Muraoka, Ryosuke Kohita, Etsuko Ishii · 2020 · Rare & Special e-Zone (The Hong Kong University of Science and Technology)
- Data Interpretation over Plots.Nitesh Methani, Pritha Ganguly, Mitesh M. Khapra, Pratyush Kumar · 2019 · arXiv (Cornell University)
- ManyModalQA: Modality Disambiguation and QA over Diverse InputsDarryl Hannan, Jain, Akshay, Mohit Bansal · 2020 · arXiv (Cornell University)
- Prerequisites for Explainable Machine Reading Comprehension: A Position Paper.Saku Sugawara, Pontus Stenetorp, Akiko Aizawa · 2020 · arXiv (Cornell University)
- Math Operation Embeddings for Open-ended Solution Analysis and FeedbackZhang, Mengxue, Zichao Wang, Richard G. Baraniuk, Andrew Lan · 2021 · arXiv (Cornell University)
- Nested Learning: The Illusion of Deep Learning ArchitecturesBehrouz, Ali, Razaviyayn, Meisam, Zhong, Peilin, Mirrokni, Vahab · 2025 · arXiv
- Advancing Question Answering on Handwritten DocumentsAniket Pal, Ajoy Mondal, C. V. Jawahar · 2025 · Communications in computer and information science
- Inferential and Commonsense Visual Question GenerationChao Bi, Shuhui Wang, Na Li, Qingming Huang · 2025 · IEEE Transactions on Multimedia
- ViPPS: Building a Multimodal Dataset for Physics Problem Solving in VietnameseQuynh Vo, Xinh T. Le, Thao H. M. Tran, Tho Quan · 2025 · Lecture notes in computer science
- MCQs Generation With Large Language Models: A Survey of Methodologies, Evolution, and Open Research IssuesMuhammad Raheel Anwar, Shah Khalid, Saied Alshahrani, Hafiz Syed Muhammad Bilal, Mohammed F. Aldawsari · 2026 · IEEE Access
- DOGR: Towards Versatile Visual Document Grounding and ReferringYinan Zhou, Yuxin Chen, Haokun Lin, Yichen Wu, Shuyu Yang, Zhongang Qi, Chen Ma, Li Zhu · 2025 · IEEE/CVF International Conference on Computer Vision (ICCV)
- Augmenting BERT with CNN for Multiple Choice Question AnsweringShishir Roy, Nayeem Ehtesham, Md. Saiful Islam, Marium-E-Jannat · 2021 · International Conference on Computer and Information Technology (ICCIT)
- Review of Parameters, Approaches and Challenges in Reading Comprehension SystemsPradnya S. Gotmare, Manish M. Potey · 2022 · Lecture notes in networks and systems
- An Empirical Study of Multilingual Scene-Text Visual Question AnsweringLin Li, Haohan Zhang, Zeqin Fang · 2023
- Enhancing Image Comprehension for Computer Science Visual Question AnsweringHongyu Wang, Pengpeng Qiang, Hongye Tan, Jingchang Hu · 2023 · Lecture notes in computer science
- Multi-view cognition with path search for one-shot part labelingShaowei Wang, Lingling Zhang, Tao Qin, Jun Liu, Yifei Li, Qianying Wang, Qinghua Zheng · 2024 · Computer Vision and Image Understanding
- Enhancing Multimodal Large Language Models on Demonstrative Multi-Image InstructionsXian Fu · 2024 · ACM International Conference on Multimedia (ACM MM)
- Alignment-Guided Self-Supervised Learning for Diagram Question AnsweringShaowei Wang, Lingling Zhang, Wenjun Wu, Tao Qin, X. M. Zhang, Jun Liu · 2024 · IEEE Transactions on Multimedia