The Hidden Agenda User Simulation Model
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
A key advantage of taking a statistical approach to spoken dialogue systems is the ability to formalise dialogue policy design as a stochastic optimization problem. However, since dialogue policies are learnt by interactively exploring alternative dialogue paths, conventional static dialogue corpora cannot be used directly for training and instead, a user simulator is commonly used. This paper describes a novel statistical user model based on a compact stack-like state representation called auseragendawhich allows state transitions to be modeled as sequences of push- and pop-operations and elegantly encodes the dialogue history from a user's point of view. An expectation-maximisation based algorithm is presented which models the observable user output in terms of a sequence of hidden states and thereby allows the model to be trained on a corpus of minimally annotated data. Experimental results with a real-world dialogue system demonstrate that the trained user model can be successfully used to optimise a dialogue policy which outperforms a hand-crafted baseline in terms of task completion rates and user satisfaction scores.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Austin, J. L. (1975) · doi:10.1093/acprof:oso/9780198245537.001.0001 · Cited by 21,496
SCHATZMANN, J., WEILHAMMER, K., STUTTLE, M., & YOUNG, S. (2006) · The Knowledge Engineering Review · doi:10.1017/s0269888906000944 · Cited by 336 · cited 1×
“A survey of user simulation techniques for dialogue optimization is given in [7].”
BackgroundSelf-citationMachine learning for spoken dialogue systems
Lemon, O., & Pietquin, O. (2007) · Interspeech 2007 · doi:10.21437/interspeech.2007-705 · Cited by 104
Research works printed but not linked: 36
- 10.1109/ASRU.2007.4430164 · doi:10.1109/asru.2007.4430164
- 10.3115/990820.990893 · DOI · Paper page
- schatzmann, 2005, effects of the user model on simulation-based learning of dialogue strategies, Proc ASRU
- schatzmann, 2008, Statistical user and error modeling for spoken dialogue systems
- 10.1109/ICSLP.1996.607774 · DOI
- 10.1109/ICASSP.2007.367185 · DOI
- issar, 1994, flexible parsing: cmu's approach to spoken language understanding, Proc ARPA Workshop Spoken Lang Technol
- 10.3115/1075812.1075857 · DOI · Paper page
- lemon, 2007, dialogue policy learning for combinations of noise and user simulation: transfer results, Proc SIGDial
- 10.3115/1614108.1614146 · DOI · Paper page
- pietquin, 2004, A Framework for Unsupervised Learning of Dialogue Strategies
- georgila, 2005, learning user simulations for information state update dialog systems, Proc EUROSPEECH
- frampton, 2006, learning more effective dialogue strategies using limited dialogue move features, Proc ACL
- lemon, 2006, evaluating effectiveness and portability of reinforcement learned dialogue strategies with real users: the talk towninfo eval, Proc SLT
- rieser, 2006, cluster-based user simulations for learning dialogue strategies, Proc ICSLP
- ai, 2007, knowledge consistent user simulations for dialog systems, Proc ICSLP
- 10.1109/ASRU.2005.1566485 · DOI · Paper page
- bunt, 1981, Rules for the interpretation evaluation and generation of dialogue acts, 99
- core, 1997, coding dialogs with the damsl annotation scheme, Working Notes of the AAAI Fall Symp Communicative Action in Humans and Machines
- henderson, 2005, hybrid reinforcement/supervised learning for dialogue policies from communicator data, Proc Workshop Knowl Reasoning Practical Dialog Syst IJCAI
- 10.1109/89.817450 · DOI · Paper page
- 10.1109/ASRU.2005.1566498 · DOI
- 10.1109/ASRU.2007.4430167 · DOI
- young, 2005, The hidden information state approach to dialogue management
- sutton, 1998, Reinforcement Learning
- 10.1109/89.817450 · DOI · Paper page
- young, 2002, talking to machines (statistically speaking), Proc ICSLP, 9
- scheffler, 2002, Automatic Design of Spoken Dialogue Systems
- traum, 1999, Foundations of Rational Agency, 169, 10.1007/978-94-015-9204-8_8 · DOI
- 10.3115/1072133.1072148 · DOI · Paper page
- young, 2007, CUED standard dialogue acts
- 10.1162/089120100561737 · DOI · Paper page
- bohus, 2003, ravenclaw: dialog management using hierarchical task decomposition and an expectation agenda, Proc EUROSPEECH, 10.21437/Eurospeech.2003-255 · DOI · Paper page
- wei, 1999, an agenda-based dialog management architecture for spoken language systems, Proc ASRU
- 10.3115/1556328.1556330 · DOI
- schatzmann, 2007, statistical user simulation with a hidden agenda, Proc SIGDial
Cited by
POMDP-Based Statistical Spoken Dialog Systems: A Review
Young, S., Gasic, M., Thomson, B., & Williams, J. D. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2225812 · Cited by 882
Self-citationRecent advances in deep learning based dialogue systems: a systematic survey
Ni, J., Young, T., Pandelea, V., Xue, F., & Cambria, E. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10248-8 · Cited by 264
Survey on reinforcement learning for language processing
Uc-Cetina, V., Navarro-Guerrero, N., Martin-Gonzalez, A., Weber, C., & Wermter, S. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10205-5 · Cited by 177
“[107] implemented a user simulator using a stack structure to represent the states.”
MethodUser Simulation for Evaluating Information Access Systems
Balog, K., & Zhai, C. (2024) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000098 · Cited by 52
Memory-Augmented Dialogue Management for Task-Oriented Dialogue Systems
Zhang, Z., Huang, M., Zhao, Z., Ji, F., Chen, H., & Zhu, X. (2019) · ACM Transactions on Information Systems · doi:10.1145/3317612 · Cited by 37
“During the course of a dialogue, the user simulator maintains a stack-like representation of dialogue state, namely the user agenda [43], which consists of an agenda and a goal.”
BackgroundMethod
Metadata
- Authors
- Schatzmann, J., & Young, S.
- Venue
- IEEE Transactions on Audio, Speech, and Language Processing
- Published
- 2009-05
- Volume
- 17
- Issue
- 4
- Pages
- 733-747
- ISSN
- 1558-7916 (ISSN-L)
- OpenAlex
- W2120045257
- Cited by
- 94
- References
- 3
- FWCI
- 1.81
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Hidden Agenda User Simulation Model. https://app.cochat.ai/papers/10.1109/tasl.2008.2012071
- The paper
- Schatzmann, J., & Young, S. (2009). The Hidden Agenda User Simulation Model. IEEE Transactions on Audio, Speech, and Language Processing. https://doi.org/10.1109/tasl.2008.2012071
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.