The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Neural Belief Tracker: Data-Driven Dialogue State Tracking
Open accessAbstract
One of the core components of modern spoken dialogue systems is the belief tracker, which estimates the user's goal at every step of the dialogue.However, most current approaches have difficulty scaling to larger, more complex dialogue domains.This is due to their dependency on either: a) Spoken Language Understanding models that require large amounts of annotated training data; or b) hand-crafted lexicons for capturing some of the linguistic variation in users' language.We propose a novel Neural Belief Tracking (NBT) framework which overcomes these problems by building on recent advances in representation learning.NBT models reason over pre-trained word vectors, learning to compose them into distributed representations of user utterances and dialogue context.Our evaluation on two datasets shows that this approach surpasses past limitations, matching the performance of state-of-the-art models which rely on hand-crafted semantic lexicons and outperforming them when such lexicons are not provided.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
(2014) · Cited by 33,419
(2008) · Journal of Machine Learning Research · Cited by 33,051
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
A Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601
Partially observable Markov decision processes for spoken dialog systems
Williams, J. D., & Young, S. (2007) · Computer Speech & Language · doi:10.1016/j.csl.2006.06.008 · Cited by 853
Self-citationAttention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling
Liu, B., & Lane, I. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-1352 · Cited by 709
Reasoning about Entailment with Neural Attention
Rocktäschel, T., Grefenstette, E., Hermann, K. M., Kočiský, T., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.06664 · Cited by 582
The Second Dialog State Tracking Challenge
Henderson, M., Thomson, B., & Williams, J. D. (2014) · Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL) · doi:10.18653/v1/w14-4337 · Cited by 538
Self-citationThe Hidden Information State model: A practical framework for POMDP-based spoken dialogue management
Young, S., Gašić, M., Keizer, S., Mairesse, F., Schatzmann, J., Thomson, B., & Yu, K. (2010) · Computer Speech & Language · doi:10.1016/j.csl.2009.04.001 · Cited by 481
Self-citationA Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.2188 · Cited by 407
Word-Based Dialog State Tracking with Recurrent Neural Networks
Henderson, M., Thomson, B., & Young, S. (2014) · Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL) · doi:10.18653/v1/w14-4340 · Cited by 337
Self-citationSpoken language understanding using long short-term memory neural networks
Yao, K., Peng, B., Zhang, Y., Yu, D., Zweig, G., & Shi, Y. (2014) · 2014 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2014.7078572 · Cited by 317
Generative and discriminative algorithms for spoken language understanding
Raymond, C., & Riccardi, G. (2007) · Interspeech 2007 · doi:10.21437/interspeech.2007-448 · Cited by 295
From Paraphrase Database to Compositional Paraphrase Model and Back
Wieting, J., Bansal, M., Gimpel, K., & Livescu, K. (2015) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00143 · Cited by 268
The Dialog State Tracking Challenge Series: A Review
Williams, J. D., Raux, A., & Henderson, M. (2016) · Dialogue & Discourse · doi:10.5087/dad.2016.301 · Cited by 192
Multi-domain dialog state tracking using recurrent neural networks
Séaghdha, D. Ó., Thomson, B., Su, P.-H., David, V., Wen, T.-H., & Young, S. J. (n.d.) · Cited by 172
Self-citationThe third Dialog State Tracking Challenge
Henderson, M., Thomson, B., & Williams, J. D. (2014) · 2014 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2014.7078595 · Cited by 158
Self-citationWang, Z., & Lemon, O. (2013) · doi:10.13140/2.1.1213.1522 · Cited by 149
Discriminative spoken language understanding using word confusion networks
Henderson, M., Gašić, M., Thomson, B., Tsiakoulis, P., Yu, K., & Young, S. J. (2012) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2012.6424218 · Cited by 123
Self-citationWeb-style ranking and SLU combination for dialog state tracking
Williams, J. D. (2014) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.3115/v1/w14-4339 · Cited by 117
Gated End-to-End Memory Networks
Liu, F., & Pérez, J. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1001 · Cited by 116
Joint Online Spoken Language Understanding and Language Modeling With Recurrent Neural Networks
Liu, B., & Lane, I. R. (2016) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/w16-3603 · Cited by 109
Henderson, M., Thomson, B., & Young, S. J. (2014) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2014.7078601 · Cited by 95
Self-citationIncremental LSTM-based dialog state tracker
Žilka, L., & Jurčíček, F. (2015) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404864 · Cited by 91
Bi-directional recurrent neural network with ranking loss for spoken language understanding
Vu, N. T., Gupta, P., Adel, H., & Schütze, H. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472841 · Cited by 79
Recurrent Neural Networks with External Memory for Spoken Language Understanding
Peng, B., Yao, K., Li, J., & Wong, K. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25207-0_3 · Cited by 66
Dialog state tracking, a machine reading approach using Memory Network
Pérez, J., & Liu, F. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1029 · Cited by 60
Semantic parsing using word confusion networks with conditional random fields
Tür, G., Deoras, A., & Hakkani-Tür, D. Z. (2013) · Interspeech (USB) · doi:10.21437/interspeech.2013-580 · Cited by 43
Recurrent Polynomial Network for Dialogue State Tracking
Sun, K., Xie, Q., & Yu, K. (2016) · Dialogue & Discourse · doi:10.5087/dad.2016.303 · Cited by 38
A New Corpus and Imitation Learning Framework for Context-Dependent Semantic Parsing
Vlachos, A., & Clark, S. (2014) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00202 · Cited by 34
Convolutional neural networks for multi-topic dialog state tracking,
Shi, H., Ushio, T., Endo, M., Yamagami, K., & Horii, N. (2017) · Lecture Notes in Electrical Engineering · doi:10.1007/978-981-10-2585-3_37 · Cited by 24
Hybrid Dialog State Tracker with ASR Features
Vodolán, M., Kadlec, R., & Kleindienst, J. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2033 · Cited by 20
Neural dialog state tracker for large ontologies by attention mechanism
Jang, Y., Ham, J., Lee, B.-J., Chang, Y., & Kim, K.-E. (2016) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2016.7846314 · Cited by 14
Convolutional Neural Network Based Semantic Tagging with Entity Embeddings
Çelikyılmaz, A., & Hakkani-Tür, D. Z. (2015) · neural information processing systems · Cited by 8
Spectral decomposition method of dialog state tracking via collective matrix factorization
Pérez, J. (2016) · Dialogue & Discourse · doi:10.5087/dad.2016.304 · Cited by 1
(2013)
Cited by
MultiWOZ - A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modelling
Budzianowski, P., Wen, T.-H., Tseng, B.-H., Casanueva, I., Ultes, S., Ramadan, O., & Gašić, M. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1547 · Cited by 1,028
Self-citationA Network-based End-to-End Trainable Task-oriented Dialogue System
Wen, T.-H., Vandyke, D., Mrkšić, N., Gasic, M., Rojas Barahona, L. M., Su, P.-H., Ultes, S., & Young, S. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1042 · Cited by 778
Self-citationA Survey on Dialogue Systems: Recent Advances and New Frontiers
Chen, H., Liu, X., Yin, D., & Tang, J. (2017) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3166054.3166058 · Cited by 579
A Survey of Cross-lingual Word Embedding Models
Ruder, S., Vulić, I., & Søgaard, A. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.30462 · Cited by 510
Towards Scalable Multi-Domain Conversational Agents: The Schema-Guided Dialogue Dataset
Rastogi, A., Zang, X., Sunkara, S., Gupta, R., & Khaitan, P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6394 · Cited by 450
Metadata
- Authors
- Mrkšić, N., Ó Séaghdha, D., Wen, T.-H., Thomson, B., & Young, S.
- Venue
- Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2017
- Pages
- 1777-1788
- OpenAlex
- W2432549722
- Cited by
- 459
- References
- 38
- FWCI
- 28.20
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.