The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Computer-aided generation of multiple-choice tests
Open accessAbstract
This paper describes a novel computer-aided procedure for generating multiple-choice tests from electronic instructional documents. In addition to employing various NLP techniques including term extraction and shallow parsing, the program makes use of language resources such as a corpus and WordNet. The system generates test questions and distractors, offering the user the option to post-edit the test items.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Technical terminology: some linguistic properties and an algorithm for identification in text
Justeson, J. S., & Katz, S. M. (1995) · Natural Language Engineering · doi:10.1017/s1351324900000048 · Cited by 820
A non-projective dependency parser
Tapanainen, P., & Järvinen, T. (1997) · Proceedings of the fifth conference on Applied natural language processing - · doi:10.3115/974557.974568 · Cited by 369
Constructing achievement tests
Gronlund, N. E. (1968) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 187
Constructing Achievement Tests
Madaus, G. F., & Stufflebeam, D. L. (1989) · Springer eBooks · doi:10.1007/978-94-009-2679-0_3 · Cited by 137
A web-based system for automatic language skill assessment
Fairon, C. (1999) · doi:10.3115/1598834.1598846 · Cited by 10
Cited by
Learning to Ask: Neural Question Generation for Reading Comprehension
Du, X., Shao, J., & Cardie, C. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1123 · Cited by 696
“For the most part, question generation has been tackled in the past via rule-based approaches ( e.g. , Mitkov and Ha (2003); Rus et al. (2010).”
BackgroundA Systematic Review of Automatic Question Generation for Educational Purposes
Kurdi, G., Leo, J., Parsia, B., Sattler, U., & Al-Emari, S. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-019-00186-y · Cited by 514
Good Question! Statistical Ranking for Question Generation
Heilman, M., & Smith, N. A. (2018) · Figshare · doi:10.1184/r1/6473390 · Cited by 366
Generating Natural Questions About an Image
Mostafazadeh, N., Misra, I., Devlin, J., Mitchell, M., He, X., & Vanderwende, L. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1170 · Cited by 270
“Previous work on question generation from textual input has focused on two aspects: the gram-maticality (Wolfe, 1976; Mitkov and Ha, 2003; Heilman and Smith, 2010) and the content focus of question generation, i.e., “what to ask about”.”
BackgroundA computer-aided environment for generating multiple-choice test items
MITKOV, R., AN HA, L., & KARAMANIS, N. (2006) · Natural Language Engineering · doi:10.1017/s1351324906004177 · Cited by 229
Self-citationHarvesting Paragraph-level Question-Answer Pairs from Wikipedia
Du, X., & Cardie, C. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1177 · Cited by 168
Automatic Multiple Choice Question Generation From Text: A Survey
CH, D. R., & Saha, S. K. (2020) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2018.2889100 · Cited by 144
“We find the use of this pre-processing step in several systems including [6], [14], [76], [87].”
BackgroundMethodInfluentialLearningQ: A Large-Scale Dataset for Educational Question Generation
Chen, G., Yang, J., Hauff, C., & Houben, G.-J. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.14987 · Cited by 83
Automatic Chinese Factual Question Generation
Liu, M., Rus, V., & Liu, L. (2017) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2016.2565477 · Cited by 52
EQG-RACE: Examination-Type Question Generation
Jia, X., Zhou, W., Sun, X., & Wu, Y. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i14.17553 · Cited by 48
EQG-RACE: Examination-Type Question Generation
Jia, X., Zhou, W., Sun, X., & Wu, Y. (2020) · arXiv · doi:10.48550/arxiv.2012.06106 · Cited by 48
“To facilitate the instructing process, QG has been investigated for many years (Kunichika et al. 2001; Mitkov 2003; Heilman and Smith 2010).”
MethodLeaf: Multiple-Choice Question Generation
Vachev, K., Hardalov, M., Karadzhov, G., Georgiev, G., Koychev, I., & Nakov, P. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-99739-7_41 · Cited by 45
Reinforced Dynamic Reasoning for Conversational Question Generation
Pan, B., Li, H., Yao, Z., Cai, D., & Sun, H. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1203 · Cited by 40
Generative Language Models for Paragraph-Level Question Generation
Ushio, A., Alva-Manchego, F., & Camacho-Collados, J. (2022) · arXiv · doi:10.48550/arxiv.2210.03992 · Cited by 38
Automatic generation of short answer questions for reading comprehension assessment
HUANG, Y., & HE, L. (2016) · Natural Language Engineering · doi:10.1017/s1351324915000455 · Cited by 30
“The linguistic information that has been utilized in the prior studies, from shallow to deep, includes surface words (Wolfe 1976), syntactic chunks (Mitkov and Ha 2003), syntactic relations (Kunichika et al. 2003, Gates 2008, Ali, Chali and Hasan 2010, Heilman and Smith 2010, Kalady, Elikkottil and…”
MethodOn the Generation of Medical Question-Answer Pairs
Shen, S., Li, Y., Du, N., Wu, X., Xie, Y., Ge, S., Yang, T., Wang, K., Liang, X., & Fan, W. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6410 · Cited by 25
Qi, P., Zhang, Y., & Manning, C. D. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.3 · Cited by 23
(2011) · The Electronic Journal of e-Learning · Cited by 24
A comprehensive review on MCQ generation from text
Madri, V. R., & Meruva, S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-14768-5 · Cited by 15
Bongir, A., Attar, V., & Janardhanan, R. (2018) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-68385-0_15 · Cited by 6
Metadata
- Authors
- Mitkov, R., & Ha, L. A.
- Venue
- Proceedings of the HLT-NAACL 03 workshop on Building educational applications using natural language processing -
- Published
- 2003
- Volume
- 2
- Pages
- 17-22
- OpenAlex
- W2109609717
- Cited by
- 252
- References
- 5
- FWCI
- 3.68
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.