Automatic Multiple Choice Question Generation From Text: A Survey
The DOI matches its Crossref record; 100 of the 106 references it cites were found in a registry or an index.
Abstract
Automatic multiple choice question (MCQ) generation from a text is a popular research area. MCQs are widely accepted for large-scale assessment in various domains and applications. However, manual generation of MCQs is expensive and time-consuming. Therefore, researchers have been attracted toward automatic MCQ generation since the late 90's. Since then, many systems have been developed for MCQ generation. We perform a systematic review of those systems. This paper presents our findings on the review. We outline a generic workflow for an automatic MCQ generation system. The workflow consists of six phases. For each of these phases, we find and discuss the list of techniques adopted in the literature. We also study the evaluation techniques for assessing the quality of the system generated MCQs. Finally, we identify the areas where the current research focus should be directed toward enriching the literature.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Additionally, while existing systems rely on textual context to generate reading-comprehension-like questions, [4, 30] we focus on generating a question well-aligned with the provided LO, allowing for easier large-scale evaluation.”
From A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Education (2024) · cites this paper as [4]
Citations
Cites
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · cited 1×
“Kumar, Banchs, and D’Haro [46] selected the distractors using semantic similarity computed through the word2vec tool [110].”
MethodAn introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880 · cited 1×
“Aldabe and Maritxalar [27] used Latent Semantic Analysis [108] to generate distractors.”
MethodIntroduction to WordNet: An On-line Lexical Database*
Miller, G. A., Beckwith, R., Fellbaum, C., Gross, D., & Miller, K. J. (1990) · International Journal of Lexicography · doi:10.1093/ijl/3.4.235 · Cited by 4,197 · cited 1×
“WordNet: WordNet [105] is a lexical database that groups the words into sets of synonyms (called synsets), and records the relations among these synonym sets or their members.”
BackgroundJurafsky, D. S., & Martin, J. (2000) · Cited by 4,132
Automatic Labeling of Semantic Roles
Gildea, D., & Jurafsky, D. (2002) · Computational Linguistics · doi:10.1162/089120102760275983 · Cited by 1,626
Information filtering and information retrieval: two sides of the same coin?
Belkin, N. J., & Croft, W. B. (1992) · Communications of the ACM · doi:10.1145/138859.138861 · Cited by 1,308
Antoniou, G., & van Harmelen, F. (2004) · Handbook on Ontologies · doi:10.1007/978-3-540-24750-0_4 · Cited by 1,017
Interpreting TF-IDF term weights as making relevance decisions
Wu, H. C., Luk, R. W. P., Wong, K. F., & Kwok, K. L. (2008) · ACM Transactions on Information Systems · doi:10.1145/1361684.1361686 · Cited by 821 · cited 1×
“Statistical Analysis: Several systems used certain word level analysis including word frequency, n-gram frequency, Term frequency * inverse document frequency (Tf*Idf) [85], and co-occurrence statistics in various modules ([1], [6], [14], [16], [47], [49], [69], [76], [77], [86], [87], [88]).”
MethodStanford’s Multi-Pass Sieve Coreference Resolution System at the CoNLL-2011 Shared Task
Lee, H., Peirsman, Y., Chang, A. L. S., Chambers, N., Surdeanu, M., & Jurafsky, D. (2011) · Lirias · Cited by 504
Using WordNet Based Context Vectors to Estimate the Semantic Relatedness of Concepts
Patwardhan, S., & Pedersen, T. (2006) · Cited by 375
Research works printed but not linked: 11
- hoshino, 2010, Predicting the difficulty of multiple-choice close questions for computer-adaptive testing, Proc CICLing, 279
- correia, 2010, Automatic generation of cloze question distractors, Proc Interspeech Satellite Workshop 2nd Lang Stud Acquisition Learn Edu Technol, 1
- stancheva, 2017, A model for generation of test questions, Comptes Rendus de L'Academie Bulgare des Sciences, 70, 619
- bhale, 0, Automatic question generation using Wikipedia, Imperial Journal of Interdisciplinary Research (IJIR), 2, 943
- agarwal, 2012, Cloze and open cloze question generation systems and their evaluation guidelines, MS Thesis IIIT Hyderabad Hyderabad INDIA
- pino, 2008, A selection strategy to improve cloze question quality, Proc Workshop Intell Tutoring Syst Ill-Defined Domains 9th Int Conf Intell Tutoring Syst, 22
- kojiri, 2010, Statistical learning-based approach for automatic generation system of multiple-choice cloze questions, Proc Workshop Proc 18th Int Conf Comput Edu
- sung, 2007, The design of automatic quiz generation for ubiquitous English e-learning system, Proc Conf Technol Enhanced Learn, 161
- nielsen, 2008, A taxonomy of questions for question generation, Workshop on the Question Generation Shared Task and Evaluation Challenge, 15
- goto, 2009, An automatic generation of multiple-choice cloze questions based on statistical learning, Proc 17th Int Conf Comput Edu, 415
- lin, 2007, An automatic multiple-choice question generation scheme for English adjective understanding, Proc Workshop Model Manage Gener Problems/Questions eLearn 15th Int Conf Comput Edu, 137
Cited by
Items 101–162 of 162
Knowledge Graph Based Absolute Difficulty Prediction of Multiple Choice Question
Wei, L., & Hao, G. (2024) · International Conference on Electronic Technology and Information Science (ICETIS) · doi:10.1109/icetis61828.2024.10593775 · Cited by 2
“One distinctive advantage of MCQs lies in their ability to provide clear answers and reduce subjective influences, thereby promoting fairness, accuracy, and efficiency in grading [2].”
BackgroundAI-Based Grading of Handwritten Responses
Aureo, A. R., Lemia, N. B., Nizma, P. M. N., Jose, S., & George, S. (2025) · Algorithms for intelligent systems · doi:10.1007/978-981-96-0228-5_25 · Cited by 2
Dong, X., Li, Z., Su, H., Xue, J., & Dang, X. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11237-3 · Cited by 2
“One MCQ traditionally consists of three core components: (1) questions, (2) correct answers, and (3) distractors or incorrect answers intended to mislead examinees (Ch and Saha 2020).”
Automatic Question Answering Method Based on IMGRU-Seq2seq
Jiang, Y., Huang, L., Jia, Z., & Yang, B. (2021) · International Conference on Computer and Communication Systems (ICCCS) · doi:10.1109/icccs52626.2021.9449260 · Cited by 2
“…Seq2seq model uses the RNNs network as the semantic extraction unit, which is easy to produce network degradation and gradient disappearance [12], this paper makes the following specific improvements on the basis of GRU neural network : In order to solve the problem of gradient…”
MethodPirozelli, P., José, M. M., Silveira, I. C., Cação, F. N., Peres, S. M., Brandão, A. A. F., Costa, A. H. R., & Cozman, F. G. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.10945 · Cited by 2
“0, taking inspiration from the long-standing tradition in AI of automatically generating alternatives for MCQA [40, 41].”
Version Control System for Auto Generation of Question Papers
Naik, P. G., & Oza, K. S. (2023) · Lecture notes in networks and systems · doi:10.1007/978-981-99-0769-4_33 · Cited by 1
Histobot: Question Generation System Using Deep Learning Techniques
Pranav, D. S., & R, B. P. V. (2023) · International Research Journal on Advanced Science Hub · doi:10.47392/irjash.2023.s071 · Cited by 1
An Efficient Seq2Seq Model to Predict Question and Answer Response System
Nerella, P., Pittu, D., Undrakonda, S., Chennamsetty, S., Venkatrama Phani Kumar, S., & Kolli, V. K. K. (2024) · doi:10.1109/icait61638.2024.10690343 · Cited by 1
“Dhawaleswar Rao et. al [9] in his paper used n-gram, parts-of-speech, parse structure, and semantic information for sentence selection.”
MethodMultiple-Choice Question Generation in Low Resource Indonesian Language with T5
(2025) · International journal of intelligent engineering and systems · doi:10.22266/ijies2025.0630.26 · Cited by 1
A Review of Recent Advances on Automatic Question Generation for the Portuguese Language
Ehlert, A. D., Junqueira, J. D. R., de Freitas, L. A., & Corrêa, U. B. (2025) · Proceedings of the ... International Florida Artificial Intelligence Research Society Conference · doi:10.32473/flairs.38.1.138961 · Cited by 1
“The authors established a generic workflow for MCQ generation consisting of six phases: preprocessing, sentence selection, key selection, question formation, distractor generation, and postprocessing (CH and Saha, 2020).”
Smart Method to Automatically Match Question and Answer in Multiple-Choice Test
Vo-Le, C., Thịnh, V. X., Bach, V. G., Dung, N. M., & Thang, N. X. (2024) · RIVF International Conference on Computing and Communication Technologies (RIVF) · doi:10.1109/rivf64335.2024.11009106 · Cited by 1
“Multiple-choice tests have been a popular and important student assessment method in different parts of the world [1][2] and international exams, i.e. IELTS, TOEFL, GMAT, SAT, etc.”
Yee-King, M. J., & Fiorucci, A. (2025) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon62633.2025.11016587 · Cited by 1
“Switching from detecting cheating to generating tests, researchers have been investigating the automated generation of multiple choice questions (MCQ) “since the late 90s” [6].”
A New Automatic Generation and Grading System for Multiple-Choice Tests Based on 2D Barcodes
Tardioli, D., Aznar, F., & Mosteo, A. R. (2025) · International Conference on Information and Education Technology (ICIET) · doi:10.1109/iciet66371.2025.11046313 · Cited by 1
“MCQ generation from text is explored in [6] with a gap-fill generator, reviewed systematically in [7], and made available in a GitHub tool in [8].”
A survey on automated evaluation system for handwritten Telugu answer books
Pragada, P., & Chamala, D. R. (2025) · AIP conference proceedings · doi:10.1063/5.0279820 · Cited by 1
Shimmei, M., Uto, M., Matsubayashi, Y., Inui, K., Mallavarapu, A., & Matsuda, N. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-99264-3_16 · Cited by 3
Asri, H., Carbonel, H., Julien, J. M., & Rochdi, A. (2025) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-031-98476-1_33 · Cited by 1
Smarter Questions, Smaller Models: RAG-Enhanced Multiple-Choice Question Generation for POSCOMP
Junior, J. R. D. S. A., Marinho, L. B., Campos, L. S., Lima, K. N. D. S., Pereira, D. E., Cavalcanti, H. B., Ramos, A. T., & de Araújo, E. C. (2025) · Anais do ... Simpósio Brasileiro de Informática na Educação/Anais do Simpósio Brasileiro de Informática na Educação · doi:10.5753/sbie.2025.12854 · Cited by 1
“Although some studies propose end-to-end solutions, others focus on specific stages of this pipeline [Ch and Saha 2018].”
Automated Evaluation and Quiz Generation using Deep Learning and Transformers
Bilonikar, A., Chandra, H., Dapolikar, V., Halbe, A., & Mulla, N. (2026) · IEEE International Conference for Convergence in Computing Technology (I3CTCON) · doi:10.1109/i3ctcon68242.2026.11507516 · Cited by 1
“While early multiple-choice question generation relied on traditional NLP techniques with significant limitations [13], the advent of Large Language Models (LLMs) has fundamentally transformed the field.”
Dueñas, G., Jiménez, S., & Ferro, G. E. M. (2026) · AI · doi:10.3390/ai7070249 · Cited by 1
Web Application for Quiz Monitoring System using NODE.JS and FIREBASE
Sudarsanam, M., & Chrisolus Timonsingh, J. (2022) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-3961 · Cited by 1
eLearning Assessments, Issues, Mitigation Strategies, and the Future
Wambua, A. (2022) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-7998-8904-5.ch002 · Cited by 1
An Extractive Question Answering System for the Tamil Language
Krishnan, A., Sriram, S. R., Ganesan, B. V. R., & Sridhar, S. S. (2023) · Advances in science and technology · doi:10.4028/p-tsrdcl · Cited by 1
ViQG: Web Tool for Automatic Question Generation from Code for Viva Preparation
Gaur, H., Tayal, D. K., & Jain, A. (2023) · International Conference on Speech Database and Assessments · doi:10.1109/o-cocosda60357.2023.10482988 · Cited by 1
NATURAL LANGUAGE PROCESSING BASED QUESTION AND ANSWER GENERATOR
Manoj, D., & john, D. P. M. (2024) · IARJSET · doi:10.17148/iarjset.2024.11519 · Cited by 1
Question Generation System using NLP
Devi, D. R. N., Sharon, B., & Reddy, K. A. (2023) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.7976519 · Cited by 1
Leite, B., Cardoso, H. L., Pinto, P., Ferreira, A. G. M., Abreu, L., Rangel, I., & Monteiro, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.15598 · Cited by 2
An, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.18891 · Cited by 1
“Automatic question generation (AQG) is a mature research area that predates modern LLMs. Surveys of automatic MCQ generation describe modular pipelines that identify candidate concepts, construct stems, generate distractors, and apply quality filters (Ch and Saha, 2018).”
Pirozelli, P., José Marcos, M., Igor, S., Cação, F. N., Peres, S. M., Brandão, A. A. F., R., C. A. H., & Cozman, F. G. (2022) · Research Square · doi:10.21203/rs.3.rs-2046889/v1
Automated Question Generator using NLP
Phadatare, A. P. M. M. M., Chakankar, T., Shinkar, T., Waghdhare, S., & Waichal, S. (2023) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2023.54763
Zyrianova, M., & Kalpakchi, D. (2023) · Northern European Journal of Language Technology · doi:10.3384/nejlt.2000-1533.2023.4939
“As Ch and Saha (2018) report, researchers have tried different techniques for MCQ generation, ranging from the manually created pipelines to more recent methods based on learning from data.”
MethodPol, N., Sharma, R., Madhan, S., Singh, Y., Arunadevi, R., & Kayathri, S. (2023) · International Conference on Sustainable Communication Networks and Application (ICSCNA) · doi:10.1109/icscna58489.2023.10370337
“Multiple-choice question (MCQ) time was introduced to the field of study by[5].”
MethodXian, R. P., Lee, A. J., Lolla, S., Wang, V., Cui, Q., Ro, R., & Abbasi-Asl, R. (2024) · arXiv · doi:10.48550/arxiv.2402.10527
“The distractors are the wrong choices given to confuse test-takers, while the key is the correct one (CH & Saha, 2020).”
BackgroundOptimization Strategies for Knowledge Graph Based Distractor Generation
Guo, Y., Zhang, J., Dong, J., Li, C., Ouyang, Y., & Rong, W. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5492-2_15 · Cited by 2
Yanosko, S., Valentine, G., & Liberatore, M. W. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--47227
Dynamic Question Generation using NER with various Feature Extraction and NLP Techniques
Dhomse, K. B. (2024) · Advances in Nonlinear Variational Inequalities · doi:10.52783/anvi.v27.1432
“This research primarily focuses on developing a comprehensive process for the automated development of multiple-choice questions (MCQs) [7].”
Smart MCQ Generation using KeyBERT and BERT Based Models
Talupuri, P. K., Kumar, M. G., Lavanya, K., Chetan, G., & Challa, N. P. (2024) · IEEE Delhi Section Conference (DELCON) · doi:10.1109/delcon64804.2024.10866615
Automated MCQ Generator for Multimedia Files Using T5 Transformer
Sundari, M. S., Devi, T. D., Gnapana, V., Amulya, K. S., & Afreen, S. M. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-81083-1_40
Automatic Distractor Generation with Paradigmatic Relation for English Vocabulary Tests
Setiawan, H. C., Hidayah, I., & Kusumawardani, S. S. (2025) · International Conference on Smart Computing, IoT and Machine Learning (SIML) · doi:10.1109/siml65326.2025.11081171
Xie, X. Y., & Cui, R. (2025) · International Conference on Computer Technologies (ICCTech) · doi:10.1109/icctech66294.2025.00037
“Research investigates LLMs for automated question production [14] , tailored feedback [15] , and as intelligent conversational agents [16] .”
Raju, M. V., & Sreenivasulu, M. (2025) · Smart innovation, systems and technologies · doi:10.1007/978-981-96-4410-0_50
Generative AI tools in designing MCQs for English language examinations: Insights from Lecturers
Vu, T. K. C., Nguyen, T. T. A., & Vo, D. V. C. (2025) · ICTE Conference Proceedings · doi:10.54855/979-8-9870112-9-4_1
“Generally speaking, the stem must be legitimate while the distractors should be persuasive enough, plausible but incorrect (Dhawaleswar Rao & Saha, 2020).”
Khalil Gómez, O. (2020) · Espacio Tiempo y Forma Serie I Prehistoria y Arqueología
Fuadillah, E. (2024) · Repository at Universitas Pendidikan Indonesia (Universitas Pendidikan Indonesia)
Educational Question Generation with Narrative and Difficulty Control: A Special Focus on Portuguese
Leite, B. J. C. (2025) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
ADAPTIVE LEARNING MODELS FOR ART CURATION EDUCATION
Khalique, F., Josephine, Shipra, K., Faiz, A., Sharma, P., Verma, A., & Shelar, P. A. (2025) · ShodhKosh Journal of Visual and Performing Arts · doi:10.29121/shodhkosh.v6.i3s.2025.6776
Leveraging Large Language Model Token Probabilities for Literature Review Abstract Filtering
Mitchell, P., Andrieu, B., Heydari, M., Cullen, J. M., & Serrenho, A. C. (2026) · Applied Artificial Intelligence · doi:10.1080/08839514.2026.2724370
Londhe, G. V., Gangrade, J., Sharma, G., Shukla, R., Sahu, S. K., & Dubey, P. (2025) · International Conference on Circuits, Controls and Communications (CCUBE) · doi:10.1109/ccube66458.2025.11340281
“Fueled by advances in NLP, automated question generation (AQG) has established itself as an emerging field aiming to automatically turn a text document into a set of questions relevant to its content [6][12].”
Improving Cloze Distractor Generation Through Retrieval-based Example Selection
Dong, J., Bai, J., Zhang, J., Li, C., Lin, X., & Rong, W. (2025) · IEEE Smart World Congress (SWC) · doi:10.1109/swc65939.2025.00193
“The multiple-choice question (MCQ) is a type of question where participants fill in the blanks within a passage or sentence by selecting the correct word or phrase from a list of options [1].”
Transforming Pdfs Into Assessments: Nlp-Based Question Generation
Mendoza, H. C., Antonio, R. B., Manaloto, E. A. B., Lagman, M. P., Landayan, R. M. M., Balilo, A. T., & Hernandez, R. J. W. (2025) · IEEE International Conference on Engineering Education (ICEED) · doi:10.1109/iceed66794.2025.11400009
“As [2] emphasizes, well-crafted objective test items are effective tools for assessing higher-order thinking skills, challenging the notion that such formats merely gauge factual recall.”
Tekeş, E., AKDİKMEN, Y., Yurdal, M. O., Mazman, S. G., Alakurt, T., Alimoğlu, M. K., Toraman, Ç., KORKMAZ, G. S., Saygılı, E. S., Kılınçarslan, M. G., et al. (2024) · Çanakkale Onsekiz Mart University AVESIS
Özdemir, B., Aydin, M. O., & Akdeniz, E. (2026) · Journal of Health Sciences and Medicine · doi:10.32322/jhsm.1842373
Misconception-Aware Prompting Can Generate Authentic Analytical Multiple-Choice Questions
Shimmei, M., Uto, M., Matsubayashi, Y., Inui, K., Mallavarapu, A., & Matsuda, N. (2026) · IEEE Access · doi:10.1109/access.2026.3681235
“Recently, automatic question generation using LLMs has gained significant attention [2], [28], [29], [30], [31].”
J, S. N., Kumara, A., Abhishek, A., & Khandelwal, A. (2026) · IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI) · doi:10.1109/iatmsi68868.2026.11466262
“Models such as Opinerium modified models such as Flan-T5 and GPT-3 to generate subjective, opinion-based questions, thereby promoting engagement, critical thinking, and high-order thinking activity [10].”
A Hybrid LLM and RAG Framework for Generating Questions Aligned with Bloom’s TaxonomyPreprint
P, S., & Nandhini, K. (2026) · Research Square · doi:10.21203/rs.3.rs-9162087/v1 · Cited by 1
Robust LLM-as-a-Judge Validators for Assessing the Quality of Educational Exams
Degiovanni, R., Morales, S., Coccia, M., Clarisó, R., & Cabot, J. (2026) · ACM Symposium on Applied Computing · doi:10.1145/3748522.3779926
“…a combination of Natural-Language Processing (NLP) and information retrieval techniques to analyze an input text, followed by a wide variety of approaches (e.g., pattern matching, knowledge representation and machine learning) to propose suitable question stems, answers, and distractors [5, 9, 20].”
Nath, S., DasGupta, S., & Saha, S. (2026) · Research Square · doi:10.21203/rs.3.rs-9241853/v1
Self-citationUsing AI-powered multiple-choice question generation for self-regulated learning
Barra, E., Pilicita, A., Conde, J., Pozo, A., López‐Pernas, S., & Reviriego, P. (2026) · Revista de Educación a Distancia (RED) · doi:10.6018/red.711091
“Consequently, significant research efforts have been dedicated to developing techniques for automatic MCQ generation (Ch & Saha, 2020; Mulla & Gharpure, 2023) .”
Langer, P., & Deepak, G. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.06.573
The Evolution of Question Generation: Analyzing the Impact of Large Language Models
Bhakuni, P., Singh, G. B., Punia, A., Suyal, H., & Sharma, N. (2026) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70133
“Early frameworks examined the generation pipeline, including preprocessing, question formulation, distractor generation, and post-processing and identified limitations related to multi-sentence contexts and the lack of standardized benchmarks (Ch and Saha 2018).”
Yang, A. C. M., Kao, C., & Wu, Y. (2026) · IEEE Access · doi:10.1109/access.2026.3734218
“The effectiveness of traditional ITS is often constrained by the construction costs of static item banks, content limitations, and diminishing marginal returns caused by repetitive practice [5], [9], [10].”
AI-Based Model Paper Generation and Intelligent Answer Evaluation for Adaptive Learning
Perera, M., Abeygunawardhana, P. K. W., & Suranjini, P. D. (2026) · IEEE Region 10 Symposium (TENSYMP) · doi:10.1109/tensymp68909.2026.11704022
Santos, H. S., Cavalcanti, A. P., Freire, J. P., Oliveira, F. B., Costa, W., Santos, M. A. P., Lima, T., Toda, A. M., Rodrigues, L., & Mello, R. F. (2026) · Anais do ... Simpósio Brasileiro de Informática na Educação/Anais do Simpósio Brasileiro de Informática na Educação · doi:10.5753/sbie.2026.27158
Metadata
- Authors
- CH, D. R., & Saha, S. K.
- Affiliations
- Birla Institute of Technology, Mesra (IN)
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2020-01-01
- Volume
- 13
- Issue
- 1
- Pages
- 14-25
- ISSN
- 1939-1382 (ISSN-L)
- 2372-0050
- OpenAlex
- W2906432682
- Cited by
- 144
- References
- 106
- Citations by year
- 2026: 15 · 2025: 29 · 2024: 29 · 2023: 25 · 2022: 20 · 2021: 17 · 2020: 8
- FWCI
- 3.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Learning Technologies (publishedVersion)
- Funders
- Science and Engineering Research Board (YSS/2015/001948)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Educational Technology and Assessment
- Keywords
- large-scale assessment, automated assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.