Multiple Choice Question Generation Utilizing An Ontology
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Ontologies provide a structured representation of concepts and the relationships which connect them.This work investigates how a pre-existing educational Biology ontology can be used to generate useful practice questions for students by using the connectivity structure in a novel way.It also introduces a novel way to generate multiple-choice distractors from the ontology, and compares this to a baseline of using embedding representations of nodes.An assessment by an experienced science teacher shows a significant advantage over a baseline when using the ontology for distractor generation.A subsequent study with three science teachers on the results of a modified question generation algorithm finds significant improvements.An in-depth analysis of the teachers' comments yields useful insights for any researcher working on automated question generation for educational applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Generating Factoid Questions With Recurrent Neural Networks: The 30M Factoid Question-Answer Corpus
Serban, I. V., García-Durán, A., Gulcehre, C., Ahn, S., Chandar, S., Courville, A., & Bengio, Y. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1056 · Cited by 280 · cited 1×
“Recent advances in text generation have used neural generative models to create interestingly worded questions (Serban et al., 2016; Indurthi et al., 2017).”
BackgroundReddy, S., Raghu, D., Khapra, M. M., & Joshi, S. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1036 · Cited by 93 · cited 1×
“Recent advances in text generation have used neural generative models to create interestingly worded questions (Serban et al., 2016; Indurthi et al., 2017).”
BackgroundInfusing NLU into Automatic Question Generation
Mazidi, K., & Tarau, P. (2016) · Proceedings of the 9th International Natural Language Generation conference · doi:10.18653/v1/w16-6609 · Cited by 36 · cited 1×
“Approaches have included factual generation directly from text (Brown et al., 2005; Mannem et al., 2010; Mazidi and Tarau, 2016; Yao et al., 2012) as well as generation from knowledge bases (Olney et al., 2012a).”
Background
Cited by
Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering
Mihaylov, T., Clark, P., Khot, T., & Sabharwal, A. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1260 · Cited by 649
A Systematic Review of Automatic Question Generation for Educational Purposes
Kurdi, G., Leo, J., Parsia, B., Sattler, U., & Al-Emari, S. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-019-00186-y · Cited by 514
Automatic Multiple Choice Question Generation From Text: A Survey
CH, D. R., & Saha, S. K. (2020) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2018.2889100 · Cited by 144
“…grammar & vocabulary learning ([35], [36], [37]), science ([38], [39]), history ([40], [41]), general science ([42], [43]), biology & medical ([9], [44], [45], [46], [47], [48], [49]), technology ([50], [51], [52], [53], [54], [55]), generic domain ([32], [56], [57], [58]), e-learning & active…”
Kumar, A. P., Nayak, A., K, M. S., Chaitanya, & Ghosh, K. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-023-00333-6 · Cited by 41
Co-Attention Hierarchical Network: Generating Coherent Long Distractors for Reading Comprehension
Zhou, X., Luo, S., & Wu, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6522 · Cited by 34
Metadata
- Authors
- Stasaski, K., & Hearst, M. A.
- Venue
- Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications
- Published
- 2017
- Pages
- 303-312
- OpenAlex
- W2758592353
- Cited by
- 63
- References
- 3
- FWCI
- 2.67
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multiple Choice Question Generation Utilizing An Ontology. https://app.cochat.ai/papers/10.18653/v1/w17-5034
- The paper
- Stasaski, K., & Hearst, M. A. (2017). Multiple Choice Question Generation Utilizing An Ontology. Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications. https://doi.org/10.18653/v1/w17-5034
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.