An End-to-End Conversational Style Matching Agent
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
We present an end-to-end voice-based conversational agent that is able to engage in naturalistic multi-turn dialogue and align with the interlocutor's conversational style. The system uses a series of deep neural network components for speech recognition, dialogue generation, prosodic analysis and speech synthesis to generate language and prosodic expression with qualities that match those of the user. We conducted a user study (N=30) in which participants talked with the agent for 15 to 20 minutes, resulting in over 8 hours of natural interaction data. Users with high consideration conversational styles reported the agent to be more trustworthy when it matched their conversational style. Whereas, users with high involvement conversational styles were indifferent. Finally, we provide design guidelines for multi-turn dialogue interactions using conversational style adaptation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bartneck, C., Kulić, D., Croft, E., & Zoghbi, S. (2009) · International Journal of Social Robotics · doi:10.1007/s12369-008-0001-3 · Cited by 3,193 · cited 1×
“[1].”
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176 · cited 1×
“ons has been done with embodied agents [10, 13]. This large gulf in expectations is perhaps part of the reason why conversational agents are only used for very simple tasks and often disappoint users [23]. It has been shown that rapport and information disclosure are higher with assistants that can engage in social di…”
BackgroundRelational agents: a model and implementation of building user trust
Bickmore, T., & Cassell, J. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365304 · Cited by 479
Creating Rapport with Virtual Agents
Gratch, J., Wang, N., Gerten, J., Fast, E., & Duffy, R. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74997-4_12 · Cited by 419 · cited 1×
“In part, this is because the agents are unable to have multi-turn conversations with the users and fail to adapt to the social behaviors of humans, although some work on improving interactions has been done with embodied agents [10, 13].”
BackgroundSocial Dialongue with Embodied Conversational Agents
Bickmore, T., & Cassell, J. (2005) · Text, Speech and Language Technology · doi:10.1007/1-4020-3933-6_2 · Cited by 324 · cited 1×
“he conversational style of these agents has received less attention. However, it has been shown that people’s perceptions of conversational agents are influenced by the interaction style of the agent [5, 24, 29]. In terms of understanding human-to-human conversation, Deborah Tannen’s theory on conversational style is…”
BackgroundMorris, R. R., Kouddous, K., Kshirsagar, R., & Schueller, S. M. (2018) · Journal of Medical Internet Research · doi:10.2196/10148 · Cited by 273
Negotiated Collusion: Modeling Social Language and its Relationship Effects in Intelligent Agents
Cassell, J., & Bickmore, T. (2003) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1024026532471 · Cited by 253
Timing and entrainment of multimodal backchanneling behavior for an embodied conversational agent
Inden, B., Malisz, Z., Wagner, P., & Wachsmuth, I. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2522890 · Cited by 25 · cited 1×
“Entrainment has been used in related work to generate more accurate and realistic reactions [20] or backchannels [18].”
Method
Cited by
Voice in Human–Agent Interaction: A Survey
Seaborn, K., Miyake, N. P., Pennefather, P., & Otake-Matsuura, M. (2022) · ACM Computing Surveys · doi:10.1145/3386867 · Cited by 249
“[77] found that participants with “high consideration” conversation styles perceived a matching agent to be more trustworthy, while those with “high involvement” conversation styles were indifferent.”
BackgroundMeasuring Voice UX Quantitatively: A Rapid Review
Seaborn, K., & Urakami, J. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3451712 · Cited by 55
“high warning with details); [21]; [19] language style conversational fllers; conversation style matching Context Lab Environment (e.”
BackgroundInfluentialLoveys, K., Sagar, M., Zhang, X., Fricchione, G., & Broadbent, E. (2021) · Journal of Medical Internet Research · doi:10.2196/30624 · Cited by 25
Conversational Error Analysis in Human-Agent Interaction
Aneja, D., McDuff, D., & Czerwinski, M. (2020) · Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents · doi:10.1145/3383652.3423901 · Cited by 15
“A recent conversational style matching framework [12] can successfully generate dialogue turns that are appropriate for small talk and maintain longer conversations.”
BackgroundSelf-citationWei, C. Z., Kim, Y.-H., & Kuzminykh, A. (2023) · Proceedings of the 5th International Conference on Conversational User Interfaces · doi:10.1145/3571884.3597139 · Cited by 14
“A commonly used survey is adapted from the Godspeed questionnaire [3], which evaluates human-likeness based on users’ impression of the agent as fake / natural, machinelike / human-like, unconscious / conscious, and artificial / lifelike (used by [35], [41] and [70]).”
BackgroundMethodInfluential
Metadata
- Authors
- Hoegen, R., Aneja, D., McDuff, D., & Czerwinski, M.
- Venue
- Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents
- Publisher
- ACM
- Published
- 2019-07
- Pages
- 111-118
- OpenAlex
- W2933971837
- Cited by
- 51
- References
- 8
- FWCI
- 2.50
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An End-to-End Conversational Style Matching Agent. https://app.cochat.ai/papers/10.1145/3308532.3329473
- The paper
- Hoegen, R., Aneja, D., McDuff, D., & Czerwinski, M. (2019). An End-to-End Conversational Style Matching Agent. Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents. https://doi.org/10.1145/3308532.3329473
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.