The DOI matches its Crossref record; 111 of the 111 references it cites were found in a registry or an index.
POMDP-Based Statistical Spoken Dialog Systems: A Review
Abstract
Statistical dialog systems (SDSs) are motivated by the need for a data-driven framework that reduces the cost of laboriously handcrafting complex dialog managers and that provides robustness against the errors created by speech recognizers operating in noisy environments. By including an explicit Bayesian model of uncertainty and by optimizing the policy via a reward-driven process, partially observable Markov decision processes (POMDPs) provide such a framework. However, exact model representation and optimization is computationally intractable. Hence, the practical application of POMDP-based systems requires efficient algorithms and carefully constructed approximations. This review article provides an overview of the current state of the art in the development of POMDP-based spoken dialog systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
Planning and acting in partially observable stochastic domains
Kaelbling, L. P., Littman, M. L., & Cassandra, A. R. (1998) · Artificial Intelligence · doi:10.1016/s0004-3702(98)00023-x · Cited by 4,149
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Natural Gradient Works Efficiently in Learning
Amari, S.-I. (1998) · Neural Computation · doi:10.1162/089976698300017746 · Cited by 2,681
(2000) · doi:10.2460/ajvr.67.2.323 · Cited by 1,621
Expectation Propagation for approximate Bayesian inference
Minka, T. P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.2294 · Cited by 1,392
Point-based value iteration: an anytime algorithm for POMDPs
Pineau, J., Gordon, G., & Thrun, S. (2003) · Cited by 918
Partially observable Markov decision processes for spoken dialog systems
Williams, J. D., & Young, S. (2007) · Computer Speech & Language · doi:10.1016/j.csl.2006.06.008 · Cited by 853
Self-citationSARSOP: Efficient Point-Based POMDP Planning by Approximating Optimally Reachable Belief Spaces
Kurniawati, H., Hsu, D., & Sun Lee, W. (2008) · Robotics: Science and Systems IV · doi:10.15607/rss.2008.iv.009 · Cited by 759
Peters, J., & Schaal, S. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.11.026 · Cited by 738
PARADISE: a framework for evaluating spoken dialogue agents
Walker, M. A., Litman, D. J., Kamm, C. A., & Abella, A. (1997) · Proceedings of the 35th annual meeting on Association for Computational Linguistics - · doi:10.3115/976909.979652 · Cited by 537
Speech recognition by machines and humans
Lippmann, R. P. (1997) · Speech Communication · doi:10.1016/s0167-6393(97)00021-6 · Cited by 529
Perseus: Randomized point-based value iteration for POMDPs
Spaan, M. T. J., & Vlassis, N. A. (2005) · UvA-DARE (University of Amsterdam) · Cited by 526
The Hidden Information State model: A practical framework for POMDP-based spoken dialogue management
Young, S., Gašić, M., Keizer, S., Mairesse, F., Schatzmann, J., Thomson, B., & Yu, K. (2010) · Computer Speech & Language · doi:10.1016/j.csl.2009.04.001 · Cited by 481
Self-citationPredictive Representations of State
Littman, M. L., & Sutton, R. S. (2001) · Cited by 425
(2004) · doi:10.5555/1036843.1036906 · Cited by 417
Optimizing Dialogue Management with Reinforcement Learning: Experiments with the NJFun System
Singh, S., Litman, D., Kearns, M., & Walker, M. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.859 · Cited by 352
SCHATZMANN, J., WEILHAMMER, K., STUTTLE, M., & YOUNG, S. (2006) · The Knowledge Engineering Review · doi:10.1017/s0269888906000944 · Cited by 336
Self-citationReinforcement learning with Gaussian processes
Engel, Y., Mannor, S., & Meir, R. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102377 · Cited by 335
Agenda-based user simulation for bootstrapping a POMDP dialogue system
Schatzmann, J., Thomson, B., Weilhammer, K., Ye, H., & Young, S. (2007) · Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers on XX - NAACL '07 · doi:10.3115/1614108.1614146 · Cited by 332
Self-citationPerseus: Randomized Point-based Value Iteration for POMDPs
Spaan, M. T. J., & Vlassis, N. (2005) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1659 · Cited by 331
Bayesian update of dialogue state: A POMDP framework for spoken dialogue systems
Thomson, B., & Young, S. (2010) · Computer Speech & Language · doi:10.1016/j.csl.2009.07.003 · Cited by 303
Self-citationSpoken dialogue management using probabilistic reasoning
Roy, N., Pineau, J., & Thrun, S. (2000) · Proceedings of the 38th Annual Meeting on Association for Computational Linguistics - ACL '00 · doi:10.3115/1075218.1075231 · Cited by 285
Conversational interfaces: advances and challenges
Zue, V. W., & Glass, J. R. (2000) · Proceedings of the IEEE · doi:10.1109/5.880078 · Cited by 245
Reinforcement Learning for Spoken Dialogue Systems
Singh, S. P., Kearns, M. J., Litman, D. J., & Walker, M. A. (1999) · Cited by 222
SARSOP: Efficient Point-Based POMDP Planning by Approximating Optimally Reachable Belief Spaces
Kurniawati, H., Hsu, D., & Lee, W. S. (2009) · Robotics · doi:10.7551/mitpress/8344.003.0013 · Cited by 203
State abstraction for programmable reinforcement learning agents
André, D., & Russell, S. (2002) · doi:10.5555/777092.777114 · Cited by 201
User modeling for spoken dialogue system evaluation
Eckert, W., Levin, E., & Pieraccini, R. (2002) · 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings · doi:10.1109/asru.1997.658991 · Cited by 190
Solving POMDPs by Searching in Policy Space
Hansen, E. A. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.7380 · Cited by 187
Using Markov decision process for learning dialogue strategies
Levin, E., Pieraccini, R., & Eckert, W. (2002) · Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181) · doi:10.1109/icassp.1998.674402 · Cited by 177
A stochastic model of computer-human interaction for learning dialogue strategies
Levin, E., & Pieraccini, R. (1997) · 5th European Conference on Speech Communication and Technology (Eurospeech 1997) · doi:10.21437/eurospeech.1997-380 · Cited by 158
Automatic learning of dialogue strategy using dialogue simulation and reinforcement learning
Scheffler, K., & Young, S. J. (2002) · doi:10.3115/1289189.1289246 · Cited by 148
Self-citationQuantitative Evaluation of User Simulation Techniques for Spoken Dialogue Systems
Schatzmann, J., Georgila, K., & Young, S. J. (2005) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2005.sigdial-1.6 · Cited by 145
Self-citationProbabilistic methods in spoken–dialogue systems
Young, S. J. (2000) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2000.0593 · Cited by 140
Self-citationSpoken Dialogues with Computers
Mori, R. D. (1998) · Cited by 136
Talking to machines (statistically speaking)
Young, S. J. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.2002-2 · Cited by 136
Self-citationA probabilistic framework for dialog simulation and optimal strategy learning
Pietquin, O., & Dutoit, T. (2006) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tsa.2005.855836 · Cited by 135
Learning dialogue strategies within the Markov decision process framework
Levin, E., Pieraccini, R., & Eckert, W. (2002) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.1997.658989 · Cited by 130
Learning user simulations for information state update dialogue systems
Georgila, K., Henderson, J., & Lemon, O. (2005) · Interspeech (USB) · doi:10.21437/interspeech.2005-401 · Cited by 128
Hybrid Reinforcement/Supervised Learning of Dialogue Policies from Fixed Data Sets
Henderson, J., Lemon, O., & Georgila, K. (2008) · Computational Linguistics · doi:10.1162/coli.2008.07-028-r2-05-82 · Cited by 128
Learning optimal dialogue strategies
Walker, M. A., Fromer, J. C., & Narayanan, S. S. (1998) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/980691.980788 · Cited by 128
User simulation for spoken dialogue systems: learning and evaluation
Georgila, K., Henderson, J., & Lemon, O. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-160 · Cited by 126
Human-computer dialogue simulation using hidden Markov models
Cuayáhuitl, H., Renals, S. J., Lemon, O., & Shimodaira, H. (2005) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2005.1566485 · Cited by 122
Automating spoken dialogue management design using machine learning: An industry perspective
Paek, T., & Pieraccini, R. (2008) · Speech Communication · doi:10.1016/j.specom.2008.03.010 · Cited by 121
(2000) · Applied Physics Letters · doi:10.1162/jmlr.2003.4.6.1107 · Cited by 120
The Hidden Information State Approach to Dialog Management
Young, S. J., Schatzmann, J., Weilhammer, K., & Ye, H. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.367185 · Cited by 116
Self-citationSpoken Natural Language Dialog Systems
Smith, R. W., & Hipp, D. R. (1995) · Oxford University Press eBooks · doi:10.1093/oso/9780195091878.001.0001 · Cited by 115
A Computational Architecture for Conversation
Horvitz, E., & Paek, T. (1999) · Courses and lectures · doi:10.1007/978-3-7091-2490-1_20 · Cited by 114
The best of both worlds: unifying conventional dialog systems and POMDPs
Williams, J. D. (2008) · Interspeech (USB) · doi:10.21437/interspeech.2008-355 · Cited by 113
Self-citationFactored partially observable Markov decision processes for dialogue management
Williams, J. D., Poupart, P., & Young, S. J. (2005) · Cited by 111
Self-citationScaling POMDPs for Spoken Dialog Management
Williams, J. D., & Young, S. J. (2007) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2007.902050 · Cited by 110
Self-citationHybrid reinforcement/supervised learning for dialogue policies from COMMUNICATOR data
Henderson, J., Lemon, O., & Georgila, K. (2005) · Cited by 107
A survey on metrics for the evaluation of user simulations
Pietquin, O., & Hastie, H. (2012) · The Knowledge Engineering Review · doi:10.1017/s0269888912000343 · Cited by 104
The Hidden Agenda User Simulation Model
Schatzmann, J., & Young, S. J. (2009) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2008.2012071 · Cited by 94
Self-citationSample-efficient batch reinforcement learning for dialogue management optimization
Pietquin, O., Geist, M., Chandramohan, S., & Frezza-Buet, H. (2011) · ACM Transactions on Speech and Language Processing · doi:10.1145/1966407.1966412 · Cited by 90
Real user evaluation of spoken dialogue systems using Amazon Mechanical Turk
Jurčíček, F., Keizer, S., Gašić, M., Mairesse, F., Thomson, B., Yu, K., & Young, S. J. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-766 · Cited by 83
Self-citationScaling up POMDPs for Dialog Management: The ``Summary POMDP'' Method
Williams, J. D., & Young, S. J. (2005) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2005.1566498 · Cited by 81
Self-citationData-Driven Methods for Adaptive Spoken Dialogue Systems
Lemon, O., & Pietquin, O. (2012) · Springer eBooks · doi:10.1007/978-1-4614-4803-7 · Cited by 80
Effects of the user model on simulation-based learning of dialogue strategies
Schatztnann, J., Stuttle, M., Weilhammer, K., et al. (2005) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2005.1566539 · Cited by 79
Voice Extensible Markup Language (VoiceXML)
Burke, D. (2007) · doi:10.1002/9780470060599.ch16 · Cited by 77
On-line policy optimisation of spoken dialogue systems via live interaction with human subjects
Gašić, M., Jurčíček, F., Thomson, B., Yu, K., & Young, S. J. (2011) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2011.6163950 · Cited by 71
Self-citationAlgorithms and Representations for Reinforcement Learning
Engel, Y. (2005) · Cited by 66
Automatic detection of poor speech recognition at the dialogue level
Litman, D. J., Walker, M. A., & Kearns, M. S. (1999) · doi:10.3115/1034678.1034729 · Cited by 65
Spoken Dialog Challenge 2010: Comparison of Live and Control Test Results
Black, A. W., Burger, S., Conkie, A. D., Hastie, H., Keizer, S., Lemon, O., Merigaud, N., Parent, G., Schubiner, G., Thomson, B., et al. (2011) · Cited by 64
Self-citationLi, L. C., Williams, J. D., & Balakrishnan, S. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-659 · Cited by 61
Self-citationThe use of belief networks for mixed-initiative dialog modeling
Meng, H. M. L., Wai, C., & Pieraccini, R. (2003) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/tsa.2003.814380 · Cited by 61
Inferring Informational Goals from Free-Text Queries: A Bayesian ApproachPreprint
Heckerman, D. E., & Horvitz, E. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.7382 · Cited by 59
Spoken language interaction with model uncertainty: an adaptive human–robot interaction system
Doshi, F., & Roy, N. (2008) · Connection Science · doi:10.1080/09540090802413145 · Cited by 59
Statistical Methods for Spoken Dialogue Management
Thomson, B. (2013) · Springer theses · doi:10.1007/978-1-4471-4923-1 · Cited by 57
Self-citationOverview of evaluation in speech and natural language processing
Hirschman, L., & Thompson, H. S. (1997) · Cited by 56
Incremental partition recombination for efficient tracking of multiple dialog states
Williams, J. D. (2010) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2010.5494939 · Cited by 54
Self-citationYoung, S. J. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.935874 · Cited by 46
Self-citationCluster-based user simulations for learning dialogue strategies
Rieser, V., & Lemon, O. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-489 · Cited by 45
Spoken dialogue management as planning and acting under uncertainty
Zhang, B., Cai, Q., Mao, J., Chang, E., & Guo, B. (2001) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.2001-511 · Cited by 44
Bui, T., Poel, M., Nijholt, A., & Zwiers, J. (2009) · Natural Language Engineering · doi:10.1017/s1351324908005032 · Cited by 43
Probabilistic simulation of human-machine dialogues
Scheffler, K., & Young, S. J. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2000.859185 · Cited by 43
Self-citationJurčíček, F., Thomson, B., & Young, S. J. (2011) · ACM Transactions on Speech and Language Processing · doi:10.1145/1966407.1966411 · Cited by 41
Self-citationLearning more effective dialogue strategies using limited dialogue move features
Frampton, M., & Lemon, O. (2006) · doi:10.3115/1220175.1220199 · Cited by 41
Combining Reinformation Learning with Information-State Update Rules
Heeman, P. A. (2007) · North American Chapter of the Association for Computational Linguistics · Cited by 39
Parameter estimation for agenda-based user simulation
Keizer, S., Gašić, M., Jurčíček, F., Mairesse, F., Thomson, B., Yu, K., & Young, S. J. (2010) · Cited by 38
Self-citationReinforcement Learning of Question-Answering Dialogue Policies for Virtual Museum Guides
Misu, T., Georgila, K., Leuski, A., & Traum, D. R. (2012) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · Cited by 38
Ji, S., Parr, R., Li, H., Liao, X., & Carin, L. (2007) · Cited by 37
The permutable POMDP: fast solutions to POMDPs for preference elicitation
Doshi‐Velez, F., & Roy, N. (2008) · doi:10.5555/1402383.1402454 · Cited by 37
Conversational Games‚ Belief Revision and Bayesian Networks
Pulman, S. (1997) · Cited by 32
A frame-based probabilistic framework for spoken dialog management using dialog examples
Kim, K., Lee, C., Jung, S., & Lee, G. G. (2008) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.3115/1622064.1622088 · Cited by 28
Exploiting the ASR n-best by tracking multiple dialog state hypotheses
Williams, J. D. (2008) · Interspeech (USB) · doi:10.21437/interspeech.2008-61 · Cited by 27
Self-citationJurčíček, F., Thomson, B., Keizer, S., Mairesse, F., Gašić, M., Yu, K., & Young, S. J. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-41 · Cited by 27
Self-citationFast reinforcement learning of dialog strategies
Goddeau, D., & Pineau, J. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2000.859189 · Cited by 26
Pietquin, O. (2006) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2006.262563 · Cited by 26
Kalman Temporal Differences: The deterministic case
Geist, M., Pietquin, O., & Fricout, G. (2009) · IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning · doi:10.1109/adprl.2009.4927543 · Cited by 24
Comparing ASR modeling methods for spoken dialogue simulation and optimal strategy learning
Pietquin, O., & Beaufort, R. (2005) · Interspeech (USB) · doi:10.21437/interspeech.2005-393 · Cited by 23
Knowledge consistent user simulations for dialog systems
Ai, H., & Litman, D. J. (2007) · Interspeech (USB) · doi:10.21437/interspeech.2007-708 · Cited by 22
Metrics and Evaluation of Spoken Dialogue Systems
Hastie, H. W. (2012) · Springer eBooks · doi:10.1007/978-1-4614-4803-7_7 · Cited by 22
Using particle filters to track dialogue state
Williams, J. D. (2007) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2007.4430163 · Cited by 21
Self-citationManaging Uncertainty within the KTD Framework
Geist, M., & Pietquin, O. (2010) · HAL · Cited by 19
An evaluation understudy for dialogue coherence models
Gandhe, S., & Traum, D. R. (2008) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.3115/1622064.1622098 · Cited by 19
Robust Performance Evaluation of POMDP-Based Dialogue Systems
Kim, D., Kim, J. H., & Kim, K.-E. (2010) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2010.2076394 · Cited by 17
A Probabilistic Description of Man-Machine Spoken Communication
Pietquin, O. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2005.1521447 · Cited by 16
Learning Observation Models for Dialogue POMDPs
Chinaei, H. R., Chaib-draa, B., & Lamontagne, L. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30353-1_24 · Cited by 13
Evaluating Dialogue Strategies under Communication Errors Using Computer-to-Computer Simulation
Watanabe, T., Araki, M., & Doshita, S. (1998) · IEICE Transactions on Information and Systems · Cited by 13
Dynamic Bayesian Networks for NLU Simulation with Applications to Dialog Optimal Strategy Learning
Pietquin, O., & Dutoit, T. (2006) · doi:10.1109/icassp.2006.1659954 · Cited by 13
Demonstration of a POMDP voice dialer
Williams, J. D. (2008) · doi:10.3115/1564144.1564145 · Cited by 12
Self-citationModeling Spoken Decision Making Dialogue and Optimization of its Dialogue Strategy
Misu, T., Sugiura, K., Ohtake, K., Hori, C., Kashioka, H., Kawai, H., & Nakamura, S. (2010) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · Cited by 12
Learning dialogue policies using state aggregation in reinforcement learning
Denecke, M., Dohsaka, K., & Nakano, M. (2004) · Interspeech (USB) · doi:10.21437/interspeech.2004-149 · Cited by 11
Bui, T., Poel, M., Nijholt, A., & Zwiers, J. (2006) · University of Twente Research Information · Cited by 10
Dialogue strategy optimization to assist user's decision for spoken consulting dialogue systems
Misu, T., Sugiura, K., Ohtake, K., Hori, C., Kashioka, H., Kawai, H., & Nakamura, S. (2010) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2010.5700878 · Cited by 5
Research works printed but not linked: 50
- 10.3115/1075096.1075127 · doi:10.3115/1075096.1075127
- bohus, 2006, A ‘K hypotheses + other’ belief updating model, Proc AAAI Workshop Statist Empirical Approaches Spoken Dialogue Syst, 13
- crook, 2011, Lossless value directed compression of complex user goal states for statistical spoken dialogue systems, Proc Annu Conf Int Speech Commun Assoc, 1029
- 10.1109/SLT.2010.5700896 · doi:10.1109/slt.2010.5700896
- 10.1109/ICASSP.2008.4518765 · doi:10.1109/icassp.2008.4518765
- 10.3115/1557690.1557710 · doi:10.3115/1557690.1557710
- gai, 2011, Effective handling of dialogue state in the hidden information state POMDP dialogue manager, ACM Trans Speech Lang Process, 7
- thomson, 2008, Evaluating semantic-level confidence scores with multiple hypotheses, Proc Annu Conf Int Speech Commun Assoc, 1153
- 10.1109/ICASSP.2007.367189 · doi:10.1109/icassp.2007.367189
- 10.1007/978-3-540-30211-7_1 · doi:10.1007/978-3-540-30211-7_1
- 10.3115/1220835.1220870 · doi:10.3115/1220835.1220870
- tetreault, 2006, Using reinforcement learning to build a better model of dialogue state, Proc of the Association for Computational Linguistics
- 10.1007/978-3-642-21043-3_11 · doi:10.1007/978-3-642-21043-3_11
- pinault, 2011, Unsupervised clustering of probability distributions of semantic frame graphs for pomdp-based spoken dialogue systems with summary space, Proc Workshop Knowl Reasoning Practical Dialog Syst IJCAI
- pinault, 2011, Semantic graph clustering for POMDP-based spoken dialog systems, Proc Annu Conf Int Speech Commun Assoc, 1321
- boularias, 2010, Learning the reward model of dialogue POMDPs from data, Proc NIPS Workshop of Mach Learn for Assistive Tech
- pinault, 2009, Feature-based summary space for stochastic dialogue modeling with hierarchical semantic frames, Proc Annu Conf Int Speech Commun Assoc, 284
- bui, 2007, Practical dialogue manager development using POMDPs, 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 215
- 10.1109/SLT.2006.326775 · doi:10.1109/slt.2006.326775
- cuayhuitl, 2006, Learning multi-goal dialogue strategies using reinforcement learning with reduced state-action spaces, Proc Annu Conf Int Speech Commun Assoc, 547
- lison, 2010, Towards relational POMDPs for adaptive dialogue management, Proc Annu Meeting Assoc Comput Linguist, 7
- williams, 2011, An empirical evaluation of a statistical dialog system in public use, 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 130
- 10.3115/1556328.1556329 · doi:10.3115/1556328.1556329
- 10.1016/j.specom.2008.05.007 · doi:10.1016/j.specom.2008.05.007
- schatzmann, 2008, Statistical User and Error Modelling for Spoken Dialogue Systems
- gai, 2009, Back-off action selection in summary space-based POMDP dialogue systems, Proc IEEE Workshop Autom Speech Recog and Understanding, 456
- 10.3115/1622064.1622097 · doi:10.3115/1622064.1622097
- mcgraw, 2010, Collecting voices from the cloud, Proc Int Conf Lang Resources Eval, 1576
- williams, 2008, Integrating expert knowledge into POMDP optimization for spoken dialog systems, Proc AAAI Workshop Adv POMDP Solvers
- 10.1109/ICASSP.2011.5947627 · doi:10.1109/icassp.2011.5947627
- lefevre, 2009, <ref_formula><tex Notation="TeX">$k$</tex></ref_formula>-nearest neighbor Monte-Carlo control algorithm for POMDP-based dialogue systems, 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue
- 10.1109/SLT.2010.5700863 · doi:10.1109/slt.2010.5700863
- 10.1109/ICASSP.2002.1005671 · doi:10.1109/icassp.2002.1005671
- chandramohan, 2011, User simulation in dialogue systems using inverse reinforcement learning, Proc Annu Conf Int Speech Commun Assoc, 1025
- 10.3115/1557690.1557722 · doi:10.3115/1557690.1557722
- 10.1016/j.csl.2009.03.002 · doi:10.1016/j.csl.2009.03.002
- 10.1109/SLT.2008.4777855 · doi:10.1109/slt.2008.4777855
- rossignol, 2011, Training a BN-based user model for dialogue simulation with missing data, Proc Int Joint Conf Natural Lang Process, 598
- 10.1109/TSA.2005.855836 · DOI
- hua ai, 2007, Comparing user simulation models for dialog strategy learning, Proc Conf North Amer Chapt Assoc Comput Linguist, 1
- 10.1109/ASRU.2007.4430167 · doi:10.1109/asru.2007.4430167
- 10.1007/978-3-540-74628-7_74 · doi:10.1007/978-3-540-74628-7_74
- littman, 2002, Advances in Neural Information Processing Systems 14, 1555
- smith, 2005, Point-based POMDP algorithms: Improved analysis and implementation, Proc 13th Annu Conf Uncertainty Artif Intell, 542
- gai, 2011, Statistical Dialogue Modelling
- gai, 2010, Gaussian processes for fast policy optimisation of a POMDP dialogue manager for a real-world task, 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 201
- pietquin, 2011, Sample efficient on-line learning of optimal dialogue policies with Kalman temporal differences, Proc Int Joint Conf Artif Intell, 1878
- janarthanam, 2011, ‘The day after the day after tomorrow?’ A machine learning approach to adaptive temporal expression generation: Training and evaluation with real users, 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 142
- kim, 2007, Multimodal dialog system using hidden information state dialog manager, Proc Int Conf Multimodal Interfaces Demonstration Session
- pietquin, 2004, A Framework for Unsupervised Learning of Dialogue Strategies
Cited by
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921
Advances in natural language processing
Hirschberg, J., & Manning, C. D. (2015) · Science · doi:10.1126/science.aaa8685 · Cited by 1,712
Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models
Serban, I., Sordoni, A., Bengio, Y., Courville, A., & Pineau, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9883 · Cited by 1,615
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388
“Recent advances in machine learning and a renewed interest in neural networks have led to the development of much more complex and efficient conversational agents.(9,40,41) The use of agent-based dialogue management appears to be rare in health applications.”
BackgroundDeep Reinforcement Learning for Dialogue Generation
Li, J., Monroe, W., Ritter, A., Jurafsky, D., Galley, M., & Gao, J. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1127 · Cited by 1,204
Metadata
- Authors
- Young, S., Gasic, M., Thomson, B., & Williams, J. D.
- Venue
- Proceedings of the IEEE
- Published
- 2013-05
- Volume
- 101
- Issue
- 5
- Pages
- 1160-1179
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W1975244201
- Cited by
- 882
- References
- 111
- FWCI
- 48.96
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.