Stay Hungry, Stay Focused: Generating Informative and Specific Questions in Information-Seeking Conversations
Open accessAbstract
We investigate the problem of generating informative questions in information-asymmetric conversations.Unlike previous work on question generation which largely assumes knowledge of what the answer might be, we are interested in the scenario where the questioner is not given the context from which answers are drawn, but must reason pragmatically about how to acquire new information, given the shared conversation history.We identify two core challenges: (1) formally defining the informativeness of potential questions, and (2) exploring the prohibitively large space of potential questions to find the good candidates.To generate pragmatic questions, we use reinforcement learning to optimize an informativeness metric we propose, combined with a reward function designed to promote more specific questions.We demonstrate that the resulting pragmatic questioner substantially improves the informativeness and specificity of questions generated over a baseline model, as evaluated by our metrics as well as humans.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
[99] addresses generating informative questions.
“The problem of generating informative questions is dwelled upon in [99].”
From Automatic question generation: a review of methodologies, datasets, evaluation metrics, and applications (2023) · cites this paper as [99]
The [99] experiments on QuAC show that combined informativeness and specificity metrics steer conversation toward rationally relevant questions.
“The experiments are performed on the conversational QuAC dataset and the combined metrics for informativeness and specificity help to direct the conversation towards rationally relevant questions.”
From Automatic question generation: a review of methodologies, datasets, evaluation metrics, and applications (2023) · cites this paper as [99]
The [99] architecture has two parts: an automatic question generation model and a model measuring informativeness and specificity of the generated question.
“The architecture used in this work consists of two fragments: the automatic question generation model and the informativeness and specificity measurement model for the generated question.”
From Automatic question generation: a review of methodologies, datasets, evaluation metrics, and applications (2023) · cites this paper as [99]
In [99], informativeness is measured by the extra information in a student's answer that was not in the conversation history.
“The informativeness is measured using what additional information a given answer by the student provides which was not present the history of the conversation so far.”
From Automatic question generation: a review of methodologies, datasets, evaluation metrics, and applications (2023) · cites this paper as [99]
No existing approach completely solves generating relevant questions for text given a topic, although a few topic-based approaches exist.
“Although there are a few approaches where topic-based questions [99] have been looked at, there is no existing approach that completely solves the problem.”
From Automatic question generation: a review of methodologies, datasets, evaluation metrics, and applications (2023) · cites this paper as [99]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · see citing works
Self-citationLearning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · see citing works
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221 · see citing works
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344 · see citing works
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · see citing works
(2004) · Cited by 9,718 · see citing works
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 7,936 · see citing works
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · see citing works
BERTScore: Evaluating Text Generation with BERT
Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., & Artzi, Y. (2019) · arXiv · doi:10.48550/arxiv.1904.09675 · Cited by 2,865 · see citing works
Bidirectional Attention Flow for Machine ComprehensionPreprint
Seo, M., Kembhavi, A., Farhadi, A., & Hajishirzi, H. (2016) · International Conference on Learning Representations · doi:10.48550/arxiv.1611.01603 · Cited by 2,322 · see citing works
Know What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240 · see citing works
Self-Critical Sequence Training for Image Captioning
Rennie, S. J., Marcheret, E., Mroueh, Y., Ross, J., & Goel, V. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.131 · Cited by 2,177 · see citing works
AllenNLP: A Deep Semantic Natural Language Processing Platform
Gardner, M., Grus, J., Neumann, M., Tafjord, O., Dasigi, P., Liu, N. F., Peters, M. E., Schmitz, M., & Zettlemoyer, L. (2018) · Workshop for NLP Open Source Software (NLP-OSS) · doi:10.18653/v1/w18-2501 · Cited by 1,273 · see citing works
Deep Reinforcement Learning for Dialogue Generation
Li, J., Monroe, W., Ritter, A., Jurafsky, D., Galley, M., & Gao, J. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1127 · Cited by 1,221 · see citing works
A Deep Reinforced Model for Abstractive Summarization
Paulus, R., Xiong, C., & Socher, R. (2017) · arXiv · doi:10.48550/arxiv.1705.04304 · Cited by 1,182 · see citing works
CoQA: A Conversational Question Answering Challenge
Reddy, S., Chen, D., & Manning, C. D. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00266 · Cited by 975 · see citing works
Self-citationPredicting pragmatic reasoning in language games
Frank, M. C., & Goodman, N. D. (2012) · Science · doi:10.1126/science.1218633 · Cited by 868 · see citing works
QuAC: Question Answering in Context
Choi, E., He, H., Iyyer, M., Yatskar, M., Yih, W.-T., Choi, Y., Liang, P., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1241 · Cited by 714 · see citing works
Learning to Ask: Neural Question Generation for Reading Comprehension
Du, X., Shao, J., & Cardie, C. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1123 · Cited by 696 · see citing works
Using the Output Embedding to Improve Language Models
Press, O., & Wolf, L. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2025 · Cited by 642 · see citing works
Wizard of Wikipedia: Knowledge-Powered Conversational agentsPreprint
Dinan, E., Roller, S., Shuster, K., Fan, A., Auli, M., & Weston, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.01241 · Cited by 610 · see citing works
Learning End-to-End Goal-Oriented DialogPreprint
Bordes, A., Boureau, Y.-L., & Weston, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07683 · Cited by 481 · see citing works
Why We Need New Evaluation Metrics for NLG
Novikova, J., Dušek, O., Cercas Curry, A., & Rieser, V. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1238 · Cited by 422 · see citing works
Simple and Effective Multi-Paragraph Reading Comprehension
Clark, C., & Gardner, M. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1078 · Cited by 402 · see citing works
Document Expansion by Query PredictionPreprint
Nogueira, R. F., Yang, W., Lin, J., & Cho, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.08375 · Cited by 382 · see citing works
Good Question! Statistical Ranking for Question Generation
Heilman, M., & Smith, N. A. (2018) · Figshare · doi:10.1184/r1/6473390 · Cited by 366 · see citing works
Neural Question Generation from Text: A Preliminary Study
Zhou, Q. S., Yang, N., Wei, F., Tan, C., Bao, H., & Zhou, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-73618-1_56 · Cited by 353 · see citing works
Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses
Lowe, R., Noseworthy, M., Serban, I. V., Angelard-Gontier, N., Bengio, Y., & Pineau, J. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1103 · Cited by 341 · see citing works
Question Generation for Question Answering
Duan, N., Tang, D., Chen, P., & Zhou, M. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1090 · Cited by 271 · see citing works
Questioning to Resolve Decision Problems
van Rooy, R. (2003) · Linguistics and Philosophy · doi:10.1023/b:ling.0000004548.98658.8f · Cited by 261 · see citing works
Computer-aided generation of multiple-choice tests
Mitkov, R., & Ha, L. A. (2003) · doi:10.3115/1118894.1118897 · Cited by 258 · see citing works
It doesn’t hurt to ask: Question-asking increases liking.
Huang, K., Yeomans, M., Brooks, A. W., Minson, J. A., & Francesca Gino, B. (2017) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000097 · Cited by 194 · see citing works
Effects of question-generation training on reading comprehension.
Davey, B., & McBride, S. (1986) · Journal of Educational Psychology · doi:10.1037/0022-0663.78.4.256 · Cited by 166 · see citing works
Unifying Human and Statistical Evaluation for Natural Language Generation
Hashimoto, T. B., Zhang, H., & Liang, P. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1169 · Cited by 161 · see citing works
Rao, S., & Daumé, H. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1255 · Cited by 154 · see citing works
Reasoning about Pragmatics with Neural Listeners and Speakers
Andreas, J., & Klein, D. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1125 · Cited by 115 · see citing works
The first question generation shared task evaluation challenge
Rus, V., Brendan Wyse, A., Piwek, P., Lintean, M. C., Stoyanchev, S., & Moldovan, C. (2010) · Open Research Online (The Open University) · Cited by 95 · see citing works
Colors in Context: A Pragmatic Neural Model for Grounded Language Understanding
Monroe, W., Hawkins, R. X. D., Goodman, N. D., & Potts, C. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00064 · Cited by 94 · see citing works
Generating More Interesting Responses in Neural Conversation Models with Distributional Constraints
Baheti, A., Ritter, A., Li, J., & Dolan, B. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1431 · Cited by 87 · see citing works
Better Conversations by Modeling, Filtering, and Optimizing for Coherence and Diversity
Xu, X., Dušek, O., Konstas, I., & Rieser, V. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1432 · Cited by 74 · see citing works
Reinforcing Coherence for Sequence to Sequence Model in Dialogue Generation
Zhang, H., Lan, Y., Guo, J., Xu, J., & Cheng, X. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/635 · Cited by 67 · see citing works
Pretraining with Contrastive Sentence Objectives Improves Discourse Performance of Language Models
Iter, D., Guu, K., Lansing, L., & Jurafsky, D. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.439 · Cited by 66 · see citing works
Interconnected Question Generation with Coreference Alignment and Conversation Flow Modeling
Gao, Y., Li, P., King, I., & Lyu, M. R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1480 · Cited by 44 · see citing works
Reinforced Dynamic Reasoning for Conversational Question Generation
Pan, B., Li, H., Yao, Z., Cai, D., & Sun, H. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1203 · Cited by 40 · see citing works
Goal-Oriented Visual Question Generation via Intermediate Rewards
Zhang, J., Wu, Q., Shen, C., Zhang, J., Lu, J., & van den Hengel, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01228-1_12 · Cited by 39 · see citing works
Answer-based Adversarial Training for Generating Clarification QuestionsPreprint
Rao, S., & Daumé, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.02281 · Cited by 39 · see citing works
Answer-based Adversarial Training for Generating Clarification Questions
Rao, S., & Daumé, H. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1013 · Cited by 34 · see citing works
Domain Agnostic Real-Valued Specificity Prediction
Ko, W.-J., Durrett, G., & Li, J. J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016610 · Cited by 28 · see citing works
An Incremental Iterated Response Model of Pragmatics
Cohn-Gordon, R., Goodman, N., & Potts, C. (2019) · University of Massachusetts Amherst · doi:10.7275/cprc-8x17 · Cited by 26 · see citing works
Comtuter-aided generation of multiple-choice tests
Mtkov, R. (2004) · International Conference on Natural Language Processing and Knowledge Engineering (NLPKE) · doi:10.1109/nlpke.2003.1275861 · Cited by 25 · see citing works
It Doesn’t Hurt to Ask: Question-Asking Increases Liking
Huang, K., Yeomans, M., & Minson, J. A. (2017) · Academy of Management Proceedings · doi:10.5465/ambpp.2017.10647abstract · Cited by 23 · see citing works
Ask to Learn: A Study on Curiosity-driven Question Generation
Scialom, T., & Staiano, J. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.202 · Cited by 22 · see citing works
Linguistically-Informed Specificity and Semantic Plausibility for Dialogue Generation
Ko, W.-J., Durrett, G., & Li, J. J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1349 · Cited by 21 · see citing works
Towards Answer-unaware Conversational Question Generation
Nakanishi, M., Kobayashi, T., & Hayashi, Y. (2019) · Proceedings of the 2nd Workshop on Machine Reading for Question Answering · doi:10.18653/v1/d19-5809 · Cited by 21 · see citing works
Rao, S., & Daumé, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.04655 · Cited by 18 · see citing works
Effects of question-generation training on reading comprehension.
Davey, B., & McBride, S. (1986) · Journal of Educational Psychology · doi:10.1037//0022-0663.78.4.256 · Cited by 18 · see citing works
Interconnected Question Generation with Coreference Alignment and Conversation Flow ModelingPreprint
Gao, Y., Li, P., King, I., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.06893 · Cited by 10 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805
Flagged first, then by citations
1 of the 62 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Ronald J Williams. 1992. Simple statistical gradientfollowing algorithms for connectionist reinforcement learning. Machine learning , 8(3-4):229-256.
- Junjie Zhang, Qi Wu, Chunhua Shen, Jian Zhang, Jianfeng Lu, and Anton Van Den Hengel. 2018b. Goaloriented visual question generation via intermediate rewards. In Proceedings of the European Conference on Computer Vision (ECCV) , pages 186-201.
Cited by
Sorted by citations
Mulla, N., & Gharpure, P. (2023) · Progress in Artificial Intelligence · doi:10.1007/s13748-023-00295-9 · Cited by 132 · see citing works
Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Models
Shao, Y., Jiang, Y., Kanell, T., Xu, P., Khattab, O., & Lam, M. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2024.naacl-long.347 · Cited by 41 · see citing works
Inquisitive Question Generation for High Level Text Comprehension
Ko, W.-J., Chen, T.-Y., Huang, Y., Durrett, G., & Li, J. J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.530 · Cited by 33 · see citing works
Review on Neural Question Generation for Education Purposes
Faraby, S. A., Adiwijaya, A., & Romadhony, A. (2023) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-023-00374-x · Cited by 31 · see citing works
ChainCQG: Flow-Aware Conversational Question Generation
Gu, J., Mirshekari, M., Yu, Z., & Sisto, A. (2021) · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume · doi:10.18653/v1/2021.eacl-main.177 · Cited by 28 · see citing works
Contrastive Multi-document Question Generation
Cho, W. S., Zhang, Y., Rao, S., Çelikyılmaz, A., Xiong, C., Gao, J., Wang, M., & Dolan, B. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.2 · Cited by 27 · see citing works
Self-citationAsking It All: Generating Contextualized Questions for any Semantic Role
Pyatkin, V., Roit, P., Michael, J., Goldberg, Y., Tsarfaty, R., & Dagan, I. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.108 · Cited by 26 · see citing works
Selecting Better Samples from Pre-trained LLMs: A Case Study on Question Generation
Yuan, X., Wang, T., Wang, Y.-H., Fine, E., Abdelghani, R., Sauzéon, H., & Oudeyer, P.-Y. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.820 · Cited by 21 · see citing works
Majumder, B. P., Rao, S., Galley, M., & McAuley, J. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.340 · Cited by 23 · see citing works
Learning to Ask Conversational Questions by Optimizing Levenshtein Distance
Liu, Z., Ren, P., Chen, Z., Ren, Z., de Rijke, M., & Zhou, M. (2021) · doi:10.18653/v1/2021.acl-long.438 · Cited by 12 · see citing works
Dynamics of the social construction of knowledge: an empirical study of Zhihu in China
Zhang, L., Yong-ning, L., Peng, T., & Wu, Y. (2022) · EPJ Data Science · doi:10.1140/epjds/s13688-022-00346-6 · Cited by 11 · see citing works
Unified Question Generation with Continual Lifelong Learning
Yuan, W., Yin, H., He, T., Chen, T., Wang, Q., & Cui, L. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3511930 · Cited by 11 · see citing works
Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Models
Shao, Y., Jiang, Y., Kanell, T. A., Xu, P., Khattab, O., & Lam, M. S. (2024) · arXiv · doi:10.48550/arxiv.2402.14207 · Cited by 10 · see citing works
Generating Information-Seeking Conversations from Unlabeled Documents
Kim, G., Kim, S., Yoo, K. M., & Kang, J. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.151 · Cited by 8 · see citing works
S2M: Converting Single-Turn to Multi-Turn Datasets for Conversational Question Answering
Li, B., Zhang, S., Zhang, W., Chen, Y.-C., Yang, C., Hu, S., Xu, T., Liu, S., & Li, J. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230413 · Cited by 3 · see citing works
Summary-Oriented Question Generation for Informational Queries
Yin, X., Zhou, L., Small, K., & May, J. (2021) · doi:10.18653/v1/2021.dialdoc-1.11 · Cited by 4 · see citing works
Mulla, N., & Gharpure, P. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.12.041 · Cited by 3 · see citing works
Similarity or deeper understanding? Analyzing the TED-Q dataset of evoked questions
Westera, M., Amidei, J., & Mayol, L. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.439 · Cited by 2 · see citing works
TAGNet: a tiny answer-guided network for conversational question generation
Wang, Z., Zhu, H., Liu, M., & Qin, B. (2022) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-022-01737-x · Cited by 2 · see citing works
Zhou, L., Small, K., Zhang, Y., & Atluri, S. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.416 · Cited by 2 · see citing works
Self-citationModeling What-to-ask and How-to-ask for Answer-unaware Conversational Question Generation
Long, X., Zou, B., Joty, S., Tai, T., Pan, L., Chen, N. F., & Aw, A. T. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.603 · Cited by 3 · see citing works
How Well Do You Know Your Audience? Toward Socially-aware Question Generation
Stewart, I., & Mihalcea, R. F. (2022) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2022.sigdial-1.27 · Cited by 1 · see citing works
An Empirical Study of Clarifying Question-Based SystemsPreprint
Zou, J., Kanoulas, E., & Liu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.00279
Learning to Ask Conversational Questions by Optimizing Levenshtein DistancePreprint
Liu, Z., Ren, P., Chen, Z., Ren, Z., de Rijke, M., & Zhou, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15903
How Well Do You Know Your Audience? Reader-aware Question Generation.Preprint
Stewart, I., & Mihalcea, R. F. (2021) · arXiv (Cornell University)
- Authors
- Qi, P., Zhang, Y., & Manning, C. D.
- Affiliations
- Stanford University (US)
- Venue
- Findings of the Association for Computational Linguistics: EMNLP 2020
- Published
- 2020
- Pages
- 25-40
- OpenAlex
- W3105144279
- Cited by
- 23
- References
- 62
- Citations by year
- 2023: 6 · 2022: 5 · 2021: 9 · 2020: 3
- FWCI
- 2.20
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Samsung
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- question generation, informativeness, information asymmetry, pragmatic reasoning, reinforcement learning, reward function design, chatbots
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review