Leaf: Multiple-Choice Question Generation
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Unlike Leaf [55], our methodology allows for training-free generation of questions and distractors, ensuring effective generation without necessarily worrying about out-of-domain generalization.”
From A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Education (2024) · cites this paper as [55]
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308
Unified Language Model Pre-training for Natural Language Understanding and Generation
Dong, L., Yang, N., Wang, W., Wei, F., Liu, X., Wang, Y., Gao, J., Zhou, M., & Hon, H.-W. (2019) · arXiv · doi:10.48550/arxiv.1905.03197 · Cited by 1,225
Meteor: an automatic metric for MT evaluation with high levels of correlation with human judgments
Lavie, A., & Agarwal, A. (2007) · Proceedings of the Second Workshop on Statistical Machine Translation - StatMT '07 · doi:10.3115/1626355.1626389 · Cited by 1,047
RACE: Large-scale ReAding Comprehension Dataset From Examinations
Lai, G., Xie, Q., Liu, H., Yang, Y., & Hovy, E. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1082 · Cited by 1,044
NewsQA: A Machine Comprehension Dataset
Trischler, A., Wang, T., Yuan, X., Harris, J., Sordoni, A., Bachman, P., & Suleman, K. (2017) · Proceedings of the 2nd Workshop on Representation Learning for NLP · doi:10.18653/v1/w17-2623 · Cited by 706
Learning to Ask: Neural Question Generation for Reading Comprehension
Du, X., Shao, J., & Cardie, C. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1123 · Cited by 696
Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering
Mihaylov, T., Clark, P., Khot, T., & Sabharwal, A. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1260 · Cited by 649
A Systematic Review of Automatic Question Generation for Educational Purposes
Kurdi, G., Leo, J., Parsia, B., Sattler, U., & Al-Emari, S. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-019-00186-y · Cited by 514
Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
Clark, P., Cowhey, I., Etzioni, O., Khot, T., Sabharwal, A., Schoenick, C., & Tafjord, O. (2018) · arXiv · doi:10.48550/arxiv.1803.05457 · Cited by 462
Ten Benefits of Testing and Their Applications to Educational Practice
Roediger III, H. L., Putnam, A. L., & Smith, M. A. (2011) · Psychology of Learning and Motivation · doi:10.1016/b978-0-12-387691-1.00001-6 · Cited by 447
MLQA: Evaluating Cross-lingual Extractive Question Answering
Lewis, P., Oguz, B., Rinott, R., Riedel, S., & Schwenk, H. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.653 · Cited by 387
ProphetNet: Predicting Future N-gram for Sequence-to-SequencePre-training
Qi, W., Yan, Y., Gong, Y., Liu, D., Duan, N., Chen, J., Zhang, R., & Zhou, M. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.217 · Cited by 374
Neural Question Generation from Text: A Preliminary Study
Zhou, Q., Yang, N., Wei, F., Tan, C., Bao, H., & Zhou, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-73618-1_56 · Cited by 346
Clark, J. H., Choi, E., Collins, M., Garrette, D., Kwiatkowski, T., Nikolaev, V., & Palomaki, J. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00317 · Cited by 342
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation
Hu, J., Ruder, S., Siddhant, A., Neubig, G., Fırat, O., & Johnson, M. (2020) · International Conference on Machine Learning · Cited by 325
Question Generation for Question Answering
Duan, N., Tang, D., Chen, P., & Zhou, M. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1090 · Cited by 272
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
Bao, H., Dong, L., Wei, F., Wang, W., Yang, N., Liu, X., Wang, Y., Piao, S., Gao, J., Zhou, M., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.12804 · Cited by 254
Computer-aided generation of multiple-choice tests
Mitkov, R., & Ha, L. A. (2003) · Proceedings of the HLT-NAACL 03 workshop on Building educational applications using natural language processing - · doi:10.3115/1118894.1118897 · Cited by 252
sense2vec - A Fast and Accurate Method for Word Sense Disambiguation In Neural Word EmbeddingsPreprint
Trask, A., Michalak, P., & Liu, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06388 · Cited by 175
From F to A on the New York Regents Science Exams — An Overview of the Aristo Project
Clark, P. E., Etzioni, O., Khashabi, D., Khot, T., Mishra, B. D., Richardson, K., Sabharwal, A., Schoenick, C., Tafjord, O., Tandon, N., et al. (2020) · AI Magazine · doi:10.1609/aimag.v41i4.5304 · Cited by 172
Leveraging Context Information for Natural Question Generation
Song, L., Wang, Z., Hamza, W., Zhang, Y., & Gildea, D. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2090 · Cited by 143
Xiao, D., Zhang, H., Li, Y., Sun, Y., Tian, H., Wu, H., & Wang, H. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/553 · Cited by 121
Hardalov, M., Mihaylov, T., Zlatkova, D., Dinkov, Y., Koychev, I. K., & Nakov, P. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.438 · Cited by 111
Self-citationLearning to Ask: Neural Question Generation for Reading ComprehensionPreprint
Du, X., Shao, J., & Cardie, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.00106 · Cited by 110
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingPreprint
Qi, W., Yan, Y., Gong, Y., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.04063 · Cited by 84
Few-shot Learning with Multilingual Language Models
Lin, X. V., Mihaylov, T., Artetxe, M., Wang, T., Chen, S., Simig, D., Ott, M., Goyal, N., Bhosale, S., Du, J., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.10668 · Cited by 74
Generating Distractors for Reading Comprehension Questions from Real Examinations
Gao, Y., Bing, L., Li, P., King, I., & Lyu, M. R. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016423 · Cited by 63
QUAREL: A Dataset and Models for Answering Questions about Qualitative Relationships
Tafjord, O., Clark, P., Gardner, M., Yih, W.-T., & Sabharwal, A. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017063 · Cited by 55
Chung, H.-L., Chan, Y.-H., & Fan, Y.-C. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.393 · Cited by 46
Generating Question-Answer Hierarchies
Krishna, K., & Iyyer, M. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1224 · Cited by 44
Evaluation methodologies in Automatic Question Generation 2013-2018
Amidei, J., Piwek, P., & Willis, A. (2018) · Proceedings of the 11th International Conference on Natural Language Generation · doi:10.18653/v1/w18-6537 · Cited by 42
Jing, Y., Xiong, D., & Yan, Z. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1249 · Cited by 41
Nguyen, K. V., Tran, K. V., Luu, S. T., Nguyen, A. G.-T., & Nguyen, N. L.-T. (2020) · IEEE Access · doi:10.1109/access.2020.3035701 · Cited by 41
Better Distractions: Transformer-based Distractor Generation and Multiple Choice Question FilteringPreprint
Offerijns, J., Verberne, S., & Verhoef, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.09598 · Cited by 36
Hardalov, M., Koychev, I. K., & Nakov, P. (2019) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-056-4_053 · Cited by 30
Self-citationEvaluation of automatically generated English vocabulary questions
Susanti, Y., Tokunaga, T., Nishikawa, H., & Obari, H. (2017) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-017-0051-y · Cited by 24
Restatement and Question Generation for Counsellor Chatbot
Lee, J. S. Y., Liang, B., & Fong, H. (2021) · Workshop on NLP for Positive Impact (NLP4PI) · doi:10.18653/v1/2021.nlp4posimpact-1.1 · Cited by 18
AnswerQuest: A System for Generating Question-Answer Items from Multi-Paragraph Documents
Roemmele, M., Sidhpura, D., DeNeefe, S., & Tsou, L. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-demos.6 · Cited by 14
WebExperimenter for multiple-choice question generation
Hoshino, A., & Nakagawa, H. (2005) · doi:10.3115/1225733.1225743 · Cited by 10
Generating Answer Candidates for Quizzes and Answer-Aware Question Generators
Vachev, K., Hardalov, M., Karadzhov, G., Georgiev, G., Releva AI, S., Koychev, I. K., & Nakov, P. (2021) · Student Research Workshop .../Proceedings of the Student Research Workshop ... · doi:10.26615/issn.2603-2821.2021_028 · Cited by 8
Self-citation
Research works printed but not linked: 2
- Chin-Yew Lin. ROUGE: A package for automatic evaluation of summaries. In Proceedigs of the Workshop on Text Summarization Branches Out, pages 74–81, Barcelona, Spain, 2004. Association for Computational Linguistics
- Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., Liu, P.J.: Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research 21(140), 1–67 (2020)
Cited by
A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Education
Doughty, J., Wan, Z., Bompelli, A., Qayum, J., Wang, T., Zhang, J., Zheng, Y., Doyle, A., Sridhar, P., Agarwal, A., et al. (2024) · Proceedings of the 26th Australasian Computing Education Conference · doi:10.1145/3636243.3636256 · Cited by 132
Scalable Educational Question Generation with Pre-trained Language Models
Bulathwela, S., Muse, H., & Yılmaz, E. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-36272-9_27 · Cited by 82
Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends
Lan, Y., Li, X., Du, H., Lu, X., Gao, M. Z., Qian, W., & Zhou, A. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3621181 · Cited by 62
Grévisse, C., Pavlou, M. A. S., & Schneider, J. G. (2024) · SN Computer Science · doi:10.1007/s42979-024-02963-6 · Cited by 41
“Several articles focused on the generation of multiple question types from a text through an encoder-decoder architecture-based text-to-text transfer transformer ( T5 ) [19–23].”
Can large language models meet the challenge of generating school-level questions?
Maity, S., Deroy, A., & Sarkar, S. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100370 · Cited by 44
Metadata
- Authors
- Vachev, K., Hardalov, M., Karadzhov, G., Georgiev, G., Koychev, I., & Nakov, P.
- Affiliations
- Sofia University "St. Kliment Ohridski" (BG)
- University of Cambridge (GB)
- Corresponding author
- Vachev, Kristiyan
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2022
- Pages
- 321-328
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W4226032012
- Cited by
- 45
- References
- 43
- Citations by year
- 2026: 5 · 2025: 17 · 2024: 11 · 2023: 9 · 2022: 3
- FWCI
- 5.20
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Lecture notes in computer science (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- multiple-choice question generation, automatic question generation, quiz generation, factual texts, educational assessment, knowledge extraction, onboarding, knowledge sharing, chatbots, question answering systems, MOOCs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.