Using knowledge graphs and behaviour trees for feedback-aware presentation agents,
Open accessAbstract
In this paper, we address the problem of how an interactive agent (such as a robot) can present information to an audience and adapt the presentation according to the feedback it receives. We extend a previous behaviour tree-based model to generate the presentation from a knowledge graph (Wikidata), which allows the agent to handle feedback incrementally, and adapt accordingly. Our main contribution is using this knowledge graph not just for generating the system's dialogue, but also as the structure through which short-term user modelling happens. In an experiment using simulated users and third-party observers, we show that referring expressions generated by the system are rated more highly when they adapt to the type of feedback given by the user, and when they are based on previously grounded information as opposed to new information.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The knowledge-graph approach of Axelsson and Skantze (2020) works well for mapping a presentation task, where the robot has the initiative and the user's responsibility is to react with feedback, even when there are multiple users.
“The approach works well for mapping a presentation task, where the robot has the initiative and the user's responsibility is to react with feedback, even when there are multiple users.”
From Modeling Feedback in Interaction With Conversational Agents—A Review (2022) · cites this paper as Axelsson and Skantze (2020)
When it comes to user feedback, domains where the agent is talking most of the time are typically selected, such as agent-human presentation scenarios.
“When it comes to user feedback, domains where the agent is talking most of the time are typically selected, such as agenthuman presentation scenarios (Buschmeier and Kopp, 2018; Axelsson and Skantze, 2020).”
From Modeling Feedback in Interaction With Conversational Agents—A Review (2022) · cites this paper as Axelsson and Skantze, 2020
Cites
Models for multiparty engagement in open-world dialog
Bohus, D., & Horvitz, E. (2009) · Proceedings of the SIGDIAL 2009 Conference on The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue - SIGDIAL '09 · doi:10.3115/1708376.1708409 · Cited by 145 · see citing works
Modelling adaptive presentations in human-robot interaction using behaviour trees,
Axelsson, N., & Skantze, G. (2019) · Proceedings of the 20th Annual SIGdial Meeting on Discourse and Dialogue · doi:10.18653/v1/w19-5940 · Cited by 15 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Modeling Feedback in Interaction With Conversational Agents—A Review
Axelsson, A., Buschmeier, H., & Skantze, G. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.744574 · Cited by 33 · see citing works
“Figure 2 illustrates the approach taken in Axelsson and Skantze (2020): Feedback from the user, which can be either verbal or non-verbal, marks edges of the knowledge graph as grounded or ungrounded on the four levels defined by Clark (1996) (see Section 2.2).”
BackgroundInfluentialSelf-citationMultimodal User Feedback During Adaptive Robot-Human Presentations
Axelsson, A., & Skantze, G. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.741148 · Cited by 14 · see citing works
Self-citation
- Authors
- Axelsson, N., & Skantze, G.
- Affiliations
- KTH Royal Institute of Technology (SE)
- ORCID
- Skantze, Gabriel
- Venue
- Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents
- Publisher
- ACM
- Published
- 2020-10-19
- Pages
- 1-8
- OpenAlex
- W3094545784
- Cited by
- 11
- References
- 2
- Citations by year
- 2026: 2 · 2025: 2 · 2023: 2 · 2022: 3 · 2021: 2
- FWCI
- 0.67
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM International Conference on Intelligent Virtual Agents (IVA) (publishedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- behavior trees, knowledge graphs, Wikidata, user modeling, referring expressions, interactive robots, dialogue generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
