Multi-turn Intent Determination for Goal-oriented Dialogue systems
The DOI matches its Crossref record; 37 of the 51 references it cites were found in a registry or an index.
Abstract
Intent determination is one of the main tasks of natural language understanding and dialogue systems, aiming to determine the intent of the user’s input. Incorporating contextual information for intent determination has shown much promise. Recently, memory networks have been used to encode context from the dialogue history at each turn. However, these methods lack general mechanism for encoding intent patterns. In this paper, we investigate the incorporation of intent patterns extracted from regular expression for the multi-turn intent determination task. We propose a novel neural network model with two memories. The first memory encodes context from dialogue history at each turn whereas the second memory contains the information obtained from the regular expression patterns. We evaluate the model on Frames and Key-Value Retrieval datasets, the experimental results demonstrate that encoding intent patterns with memory networks significantly improves the multi-turn intent determination.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
BoosTexter: A Boosting-based System for Text Categorization
Schapire, R. E., & Singer, Y. (2000) · Machine Learning · doi:10.1023/a:1007649029923 · Cited by 2,188
Sukhbaatar, S., Szlam, A., Weston, J., & Fergus, R. (2015) · arXiv · doi:10.48550/arxiv.1503.08895 · Cited by 1,345
The ATIS spoken language systems pilot corpus
Hemphill, C. T., Godfrey, J. J., & Doddington, G. R. (1990) · Proceedings of the workshop on Speech and Natural Language - HLT '90 · doi:10.3115/116580.116613 · Cited by 790
Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling
Liu, B., & Lane, I. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-1352 · Cited by 709
Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks
Weston, J., Bordes, A., Chopra, S., Rush, A. M., van Merriënboer, B., Joulin, A., & Mikolov, T. (2015) · arXiv · doi:10.48550/arxiv.1502.05698 · Cited by 670
Harnessing Deep Neural Networks with Logic Rules
Hu, Z., Ma, X., Liu, Z., Hovy, E., & Xing, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1228 · Cited by 545
Spoken Language Understanding: Systems for Extracting Semantic Information from Speech
Tür, G., & Mori, R. D. (2011) · Cited by 510
Slot-Gated Modeling for Joint Slot Filling and Intent Prediction
Goo, C.-W., Gao, G., Hsu, Y.-K., Huo, C.-L., Chen, T.-C., Hsu, K.-W., & Chen, Y.-N. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2118 · Cited by 497
Multi-Domain Joint Semantic Frame Parsing Using Bi-Directional RNN-LSTM
Hakkani-Tür, D., Tur, G., Celikyilmaz, A., Chen, Y.-N., Gao, J., Deng, L., & Wang, Y.-Y. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-402 · Cited by 463
Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding
Mesnil, G., Dauphin, Y., Yao, K., Bengio, Y., Deng, L., Hakkani-Tur, D., He, X., Heck, L., Tur, G., Yu, D., et al. (2015) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2383614 · Cited by 461
Key-Value Retrieval Networks for Task-Oriented Dialogue
Eric, M., Krishnan, L., Charette, F., & Manning, C. D. (2017) · Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue · doi:10.18653/v1/w17-5506 · Cited by 388
Spoken Language Understanding: Systems for Extracting Semantic Information from Speech
(2011) · Wiley eBooks · doi:10.1002/9781119992691 · Cited by 291
Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks
Weston, J., Bordes, A., Chopra, S., Rush, A. M., van Merriënboer, B., Joulin, A., & Mikolov, T. (2016) · International Conference on Learning Representations · Cited by 261
Optimizing SVMs for complex call classification
Haffner, P., Tur, G., & Wright, J. H. (2003) · 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). · doi:10.1109/icassp.2003.1198860 · Cited by 214
Frames: a corpus for adding memory to goal-oriented dialogue systems
El Asri, L., Schulz, H., Sharma, S., Zumer, J., Harris, J., Fine, E., Mehrotra, R., & Suleman, K. (2017) · Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue · doi:10.18653/v1/w17-5526 · Cited by 212
Harnessing Deep Neural Networks with Logic RulesPreprint
Hu, Z., Ma, X., Liu, Z., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.06318 · Cited by 198
Recurrent neural network and LSTM models for lexical utterance classification
Ravuri, S., & Stolcke, A. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-42 · Cited by 175
End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
Chen, Y.-N., Hakkani-Tür, D., Tur, G., Gao, J., & Deng, L. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-312 · Cited by 144
Deep belief nets for natural language call-routing
Sarikaya, R., Hinton, G. E., & Ramabhadran, B. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947649 · Cited by 125
Towards deeper understanding: Deep convex networks for semantic utterance classification
Tur, G., Deng, L., Hakkani-Tur, D., & He, X. (2012) · 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2012.6289054 · Cited by 122
Xu, P., & Sarikaya, R. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6853573 · Cited by 103
Easy contextual intent prediction and slot detection
Bhargava, A., Celikyilmaz, A., Hakkani-Tur, D., & Sarikaya, R. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639291 · Cited by 91 · cited 3×
“Recently, different research works [8], [9] have tried to address such issues by incorporating previous context.”
BackgroundResultDeep Neural Networks with Massive Learned Knowledge
Hu, Z., Yang, Z., Salakhutdinov, R., & Xing, E. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1173 · Cited by 76
Learning End-to-End Goal-Oriented Dialog
Bordes, A., Boureau, Y.-L., & Weston, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07683 · Cited by 62
Sequential Dialogue Context Modeling for Spoken Language Understanding
Bapna, A., Tür, G., Hakkani-Tür, D. Z., & Heck, L. P. (2017) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/w17-5514 · Cited by 61
A comparative study of recurrent neural network models for lexical domain classification
Ravuri, S. V., & Stolcke, A. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472844 · Cited by 60
Su, S., Yuan, P.-C., & Chen, Y.-N. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1194 · Cited by 59
Marrying Up Regular Expressions with Neural Networks: A Case Study for Spoken Language Understanding
Luo, B., Feng, Y., Wang, Z., Huang, S., Yan, R., & Zhao, D. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1194 · Cited by 41
Multi-turn QA: A RNN Contextual Approach to Intent Classification for Goal-oriented Systems
Mensio, M., Rizzo, G. F., & Morisio, M. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3184558.3191539 · Cited by 28
An Efficient Approach to Encoding Context for Spoken Language Understanding
Gupta, R., Rastogi, A., & Hakkani-Tür, D. Z. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-2403 · Cited by 27
Research works printed but not linked: 3
- eric, 2017, Key-value retrieval networks for taskoriented dialogue, arXiv preprint arXiv 1705 05414
- zhang, 2016, A joint model of intent determination and slot APPENDIX filling for spoken language understanding, IJCAI
- bordes, 2016, Learning end-to-end goaloriented dialog, arXiv preprint arXiv 1605 07683
Cited by
Software defect prediction employing BiLSTM and BERT-based semantic feature
Uddin, M. N., Li, B., Ali, Z., Kefalas, P., Khan, I. U., & Zada, I. (2022) · Soft Computing · doi:10.1007/s00500-022-06830-5 · Cited by 115
Self-citationDeep learning in citation recommendation models survey
Ali, Z., Kefalas, P., Muhammad, K., Ali, B., & Imran, M. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113790 · Cited by 79
Self-citationDeep Learning for Medication Recommendation: A Systematic Survey
Ali, Z., Huang, Y., Ullah, I., Feng, J., Deng, C., Thierry, N., Khan, A., Jan, A. U., Shen, X., Rui, W., et al. (2022) · Data Intelligence · doi:10.1162/dint_a_00197 · Cited by 87
Self-citationA graph-based taxonomy of citation recommendation models
Ali, Z., Qi, G., Kefalas, P., Abro, W. A., & Ali, B. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09819-4 · Cited by 45
Self-citationGlobal citation recommendation employing generative adversarial network
Ali, Z., Qi, G., Muhammad, K., Kefalas, P., & Khusro, S. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114888 · Cited by 45
Self-citation
Metadata
- Authors
- Abro, W. A., Qi, G., Gao, H., Khan, M. A., & Ali, Z.
- Affiliations
- Southeast University (CN)
- Venue
- 2019 International Joint Conference on Neural Networks (IJCNN)
- Publisher
- IEEE
- Published
- 2019-07
- Pages
- 1-8
- ISSN
- 2161-4407 (ISSN-L)
- OpenAlex
- W2977830552
- Cited by
- 23
- References
- 51
- Citations by year
- 2026: 1 · 2024: 2 · 2023: 3 · 2022: 6 · 2021: 8 · 2020: 3
- FWCI
- 1.63
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- International Joint Conference on Neural Networks (IJCNN) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- task-oriented dialogue systems, memory networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.