The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Proceedings of the 19th ACM international conference on Information and knowledge management
Abstract
In the educational framework, knowledge assessment is a critical component, and quizzes (sets of questions with concise answers) are a popular tool for this purpose.This paper focuses on the generation of balanced quizzes, i.e., quizzes that relate to a given set of documents, and to the central concepts described by the documents, in an evenly distributed manner.Our approach leverages a graph representing the relationships between questions, documents, and concepts, and phrases quiz construction as a node selection problem in this graph.We provide algorithms for constructing the graph and for selecting a good set of quiz questions.In our concrete implementation, we build quizzes for a collection of Wikipedia articles and evaluate them both with simulated students and with real human quiz takers, finding that our balanced quizzes are better suited at determining which articles the user has not read (corresponding to their knowledge gaps) than reasonable baselines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
An analysis of approximations for maximizing submodular set functions—I
Nemhauser, G. L., Wolsey, L. A., & Fisher, M. L. (1978) · Mathematical Programming · doi:10.1007/bf01588971 · Cited by 4,412
A computer-aided environment for generating multiple-choice test items
MITKOV, R., AN HA, L., & KARAMANIS, N. (2006) · Natural Language Engineering · doi:10.1017/s1351324906004177 · Cited by 229
A Joint Model for Question Answering and Question GenerationPreprint
Wang, T., Yuan, X., & Trischler, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.01450 · Cited by 104
Discriminative Approach to Fill-in-the-Blank Quiz Generation for Language Learners
Sakaguchi, K., Arase, Y., & Komachi, M. (2013) · Cited by 60
Questimator: generating knowledge assessments for arbitrary topics
Guo, Q., Kulkarni, C. E., Kittur, A., Bigham, J. P., & Brunskill, E. (2016) · International Joint Conference on Artificial Intelligence · Cited by 53
Automatic Generation of Multiple Choice Questions Using Wikipedia
Bhatia, A. S., Kirti, M., & Saha, S. K. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-45062-4_104 · Cited by 39
Generating Quiz Questions from Knowledge Graphs
Seyler, D., Yahya, M., & Berberich, K. (2015) · International World Wide Web Conference (WWW) · doi:10.1145/2740908.2742722 · Cited by 37
TEDQuiz: Automatic Quiz Generation for TED Talks Video Clips to Assess Listening Comprehension
Huang, Y.-T., Tseng, Y.-M., Sun, Y. S., & Chen, M. C. (2014) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2014.105 · Cited by 30
Cited by
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02145-9 · Cited by 3,281
Feature selection in machine learning: A new perspective
Cai, J., Luo, J., Wang, S., & Yang, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.11.077 · Cited by 2,061
A survey on opinion mining and sentiment analysis: Tasks, approaches and applications
Ravi, K., & Ravi, V. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.06.015 · Cited by 1,306
Filieri, R. (2015) · Journal of Business Research · doi:10.1016/j.jbusres.2014.11.006 · Cited by 1,083
A review of natural language processing techniques for opinion mining systems
Sun, S., Luo, C., & Chen, J. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.10.004 · Cited by 542
Link prediction techniques, applications, and performance: A survey
Kumar, A., Singh, S. S., Singh, K., & Biswas, B. (2020) · Physica A: Statistical Mechanics and its Applications · doi:10.1016/j.physa.2020.124289 · Cited by 516
Dynamics of information diffusion and its applications on complex networks
Zhang, Z.-K., Liu, C., Zhan, X.-X., Lu, X., Zhang, C.-X., & Zhang, Y.-C. (2016) · Physics Reports · doi:10.1016/j.physrep.2016.07.002 · Cited by 484
Exploring the travel behaviors of inbound tourists to Hong Kong using geotagged photos
Vu, H. Q., Li, G., Law, R., & Ye, B. H. (2015) · Tourism Management · doi:10.1016/j.tourman.2014.07.003 · Cited by 371
A systematic literature review: Opinion mining studies from mobile app store user reviews
Genc-Nayebi, N., & Abran, A. (2017) · Journal of Systems and Software · doi:10.1016/j.jss.2016.11.027 · Cited by 358
A Deep Look into neural ranking models for information retrieval
Guo, J., Fan, Y., Pang, L., Yang, L., Ai, Q., Zamani, H., Wu, C., Croft, W. B., & Cheng, X. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.102067 · Cited by 349
Sentiment analysis of Twitter data during critical events through Bayesian networks classifiers
Ruz, G. A., Henríquez, P. A., & Mascareño, A. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.01.005 · Cited by 332
A survey of serendipity in recommender systems
Kotkov, D., Wang, S., & Veijalainen, J. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.08.014 · Cited by 329
Recent advances and emerging challenges of feature selection in the context of big data
Bolón-Canedo, V., Sánchez-Maroño, N., & Alonso-Betanzos, A. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.05.014 · Cited by 320
Recent Named Entity Recognition and Classification techniques: A systematic review
Goyal, A., Gupta, V., & Kumar, M. (2018) · Computer Science Review · doi:10.1016/j.cosrev.2018.06.001 · Cited by 309
A survey of active learning in collaborative filtering recommender systems
Elahi, M., Ricci, F., & Rubens, N. (2016) · Computer Science Review · doi:10.1016/j.cosrev.2016.05.002 · Cited by 292
Detection of review spam: A survey
Heydari, A., Tavakoli, M. A., Salim, N., & Heydari, Z. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.12.029 · Cited by 290
Search engine marketing is not all gold: Insights from Twitter and SEOClerks
Aswani, R., Kar, A. K., Ilavarasan, P. V., & Dwivedi, Y. K. (2018) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2017.07.005 · Cited by 262
Brühlmann, F., Petralito, S., Aeschbach, L. F., & Opwis, K. (2020) · Methods in Psychology · doi:10.1016/j.metip.2020.100022 · Cited by 168
Detection of malicious social bots: A survey and a refined taxonomy
Latah, M. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113383 · Cited by 94
Benchmarking LLM-based Relevance Judgment Methods
Arabzadeh, N., & Clarke, C. L. A. (2025) · Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3726302.3730305 · Cited by 46
Metadata
- Publisher
- ACM
- Published
- 2010-10-26
- OpenAlex
- W4252566574
- Cited by
- 620
- References
- 10
- Type
- paratext
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.