Designing Conversational Agents: A Self-Determination Theory Approach
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Bringing positive experiences to users is one of the key goals when designing conversational agents (CAs). Yet we still lack an understanding of users’ underlying needs to achieve positive experiences and how to support them in design. This research first applies Self-Determination Theory in an interview study to explore how users’ needs of competence, autonomy and relatedness could be supported or undermined in CA experiences. Ten guidelines are then derived from the interview findings. The key findings demonstrate that: competence is affected by users’ knowledge of the CA capabilities and effectiveness of the conversation; autonomy is influenced by flexibility of the conversation, personalisation of the experiences, and control over user data; regarding relatedness, users still have concerns over integrating social features into CAs. The guidelines recommend how to inform users about the system capabilities, design effective and socially appropriate conversations, and support increased system intelligence, customisation, and data transparency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Motivation reconsidered: The concept of competence.
White, R. W. (1959) · Psychological Review · doi:10.1037/h0040934 · Cited by 5,681 · cited 2×
“In SDT, competence describes “people’s inherent desire to be effective in dealing with the surrounding environment”, which is the desire of feeling capable and effective [21, 82].”
BackgroundThe motivational pull of video games: a self-determination theory approach
Ryan, R. M., Rigby, C. S., & Przybylski, A. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9051-8 · Cited by 3,332
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 10×
“The value of articulating guidelines is present in examples such as the usability heuristics [59] and AI guidelines [2].”
BackgroundMethodInfluentialVansteenkiste, M., & Ryan, R. M. (2013) · Journal of Psychotherapy Integration · doi:10.1037/a0032359 · Cited by 2,170
What is satisfying about satisfying events? Testing 10 candidate psychological needs.
Sheldon, K. M., Elliot, A. J., Kim, Y., & Kasser, T. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.80.2.325 · Cited by 1,694 · cited 5×
“It is worth noting that, psychological needs often co-exist in human experiences with various degrees of salience [79].”
BackgroundInfluentialPrinciples of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490
A Motivational Model of Video Game Engagement
Przybylski, A. K., Rigby, C. S., & Ryan, R. M. (2010) · Review of General Psychology · doi:10.1037/a0019440 · Cited by 1,422 · cited 1×
“Competence is not only related to how well the user can perform the current task [65, 73, 82].”
BackgroundLuger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176 · cited 7×
“in [17, 29, 37, 54, 85]) which could limit the effective application of these findings in design practice (e.”
BackgroundResultInfluentialDesigning for Motivation, Engagement and Wellbeing in Digital Experience
Peters, D., Calvo, R. A., & Ryan, R. M. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00797 · Cited by 888
Voice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 2×
“However, this inherently increases the chances of CAs behaving independently and unpredictably [63], thus increasing users’ sense of lack of control.”
BackgroundPrinciples of Explanatory Debugging to Personalize Interactive Machine Learning
Kulesza, T., Burnett, M., Wong, W.-K., & Stumpf, S. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701399 · Cited by 576
Sheldon, K. M., Abad, N., & Hinsch, C. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0022407 · Cited by 514 · cited 1×
“For example, it has been suggested that designs should be meaningful and satisfy genuine relatedness rather than the mere semblance of connection [78].”
BackgroundWhat Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents
Clark, L., Pantidi, N., Cooney, O., Doyle, P., Garaialde, D., Edwards, J., Spillane, B., Gilmartin, E., Murad, C., Munteanu, C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300705 · Cited by 461 · cited 1×
“In previous works, it has been shown that people were resistant to build relationships with CAs beyond the level of “strangers” or “casual acquaintances” [19].”
BackgroundPradhan, A., Mehta, K., & Findlater, L. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174033 · Cited by 448 · cited 1×
“Existing research has mostly explored the social roles of CAs with particular types of use cases, for example, supporting the elderly [74], playing with children [26, 55] and helping people with disabilities [64].”
BackgroundPeng, W., Lin, J.-H., Pfeiffer, K. A., & Winn, B. (2012) · Media Psychology · doi:10.1080/15213269.2012.673850 · Cited by 426
Explanations as Mechanisms for Supporting Algorithmic Transparency
Rader, E., Cotter, K., & Cho, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173677 · Cited by 388 · cited 1×
“for example, transparency and trust [50, 66, 69, 81], personalisation [24, 30, 34], predictability and accuracy [35].”
Background"What can i help you with?": infrequent users' experiences of intelligent personal assistants
Cowan, B. R., Pantidi, N., Coyle, D., Morrissey, K., Clarke, P., Al-Shehri, S., Earley, D., & Bandeira, N. (2017) · Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3098279.3098539 · Cited by 351
A comparison of static, adaptive, and adaptable menus
Findlater, L., & McGrenere, J. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985704 · Cited by 316 · cited 1×
“for example, transparency and trust [50, 66, 69, 81], personalisation [24, 30, 34], predictability and accuracy [35].”
BackgroundBrill, T. M., Munoz, L., & Miller, R. J. (2019) · Journal of Marketing Management · doi:10.1080/0267257x.2019.1687571 · Cited by 291 · cited 1×
“For example, businesses frequently choose to integrate CAs into their enterprise platforms to improve customer service or to promote productivity and collaboration at work [5, 8, 12, 49].”
BackgroundPatterns for How Users Overcome Obstacles in Voice User Interfaces
Myers, C., Furqan, A., Nebolsky, J., Caro, K., & Zhu, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173580 · Cited by 213 · cited 1×
“[57] have summarised four types of obstacles that users encounter during voice interaction–Natural Language Processing (NLP) errors, unfamiliar intent, system errors and failed feedback–and found that users handle these obstacles differently.”
BackgroundExploring the design space for adaptive graphical user interfaces
Gajos, K. Z., Czerwinski, M., Tan, D. S., & Weld, D. S. (2006) · Proceedings of the working conference on Advanced visual interfaces - AVI '06 · doi:10.1145/1133265.1133306 · Cited by 198
A conversational robot in an elderly care center: an ethnographic study
Sabelli, A. M., Kanda, T., & Hagita, N. (2011) · Proceedings of the 6th international conference on Human-robot interaction · doi:10.1145/1957656.1957669 · Cited by 187 · cited 1×
“Existing research has mostly explored the social roles of CAs with particular types of use cases, for example, supporting the elderly [74], playing with children [26, 55] and helping people with disabilities [64].”
BackgroundPersonification of the Amazon Alexa: BFF or a Mindless Companion
Lopatovska, I., & Williams, H. (2018) · Proceedings of the 2018 Conference on Human Information Interaction&Retrieval - CHIIR '18 · doi:10.1145/3176349.3176868 · Cited by 160
Once a Kind Friend is Now a Thing: Understanding How Conversational Agents at Home are Forgotten
Cho, M., Lee, S.-S., & Lee, K.-P. (2019) · Proceedings of the 2019 on Designing Interactive Systems Conference · doi:10.1145/3322276.3322332 · Cited by 90 · cited 1×
“On the other hand, users expect to have humanlike conversations with CAs, as this is more natural and familiar to them [18, 20].”
BackgroundChatila, R., Firth-Butterflied, K., Havens, J. C., & Karachalios, K. (2017) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2017.2670225 · Cited by 72
The Effect of Audiences on the User Experience with Conversational Interfaces in Physical Spaces
Candello, H., Pinhanez, C., Pichiliani, M., Cavalin, P., Figueiredo, F., Vasconcelos, M., & Do Carmo, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300320 · Cited by 33
Research works printed but not linked: 49
- Amazon. 2020. Designing for Conversation. Retrieved April 3, 2020 from https://developer.amazon.com/ask-resources/guided/conversational-design-workshop#/
- C. Baber. 1993. Developing interactive speech technology, Interactive speech technology: human factors issues in the application of speech input/output to computers. Taylor & Francis, Inc., Bristol, PA.
- Ruben Babu. 2019. The conversational designer's guide to AI assistants. Medium. Retrieved December 4, 2019 from https://uxdesign.cc/the-conversational-designers-guide-to-ai-assistants-by-ruben-babu-6aa45de578f0
- Roy F. Baumeister and Mark R. Leary. 1995. The need to belong: desire for interpersonal attachments as a fundamental human motivation. Psychological bulletin 117, 3: 497.
- 10.24251/HICSS.2019.035 · DOI · Paper page
- 10.1145/3242969.3242995 · DOI · Paper page
- Rafael A. Calvo and Dorian Peters. 2014. Positive computing: technology for wellbeing and human potential. MIT Press.
- 10.5555/371552.371555 · doi:10.5555/371552.371555
- 10.1145/3173574.3173765 · DOI · Paper page
- 10.1007/978-3-642-25691-2_1 · DOI
- Pieter M.A. Desmet and Anna E. Pohlmeyer. 2013. Positive Design: An Introduction to Design for Subjective Well-Being. International Journal of Design 7, 3: 5–19. Retrieved March 9, 2016 from http://www.ijdesign.org/ojs/index.php/IJDesign/article/view/1666
- Tilman Deuschel and Ted Scully. 2016. On the Importance of Spatial Perception for the Design of Adaptive User Interfaces. In 2016 IEEE 10th International Conference on Self-Adaptive and Self-Organizing Systems (SASO), 70–79.
- Paul Dourish and Graham Button. 1998. On" technomethodology": Foundational relationships between ethnomethodology and system design. Human-computer interaction 13 4: 395–432. · DOI · Paper page
- 10.1145/3202185.3202741 · DOI · Paper page
- Suzanne Eggins and Diana Slade. 2005. Analysing casual conversation. Equinox Publishing Ltd.
- Ahmed Fadhil, Gianluca Schiavo, Yunlong Wang, and Bereket A. Yilma. 2018. The effect of emojis when interacting with conversational interface assisted health coaching system. In Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare, 378–383.
- Ethan Fast, Binbin Chen, Julia Mendelsohn, Jonathan Bassen, and Michael S. Bernstein. 2018. Iris: A Conversational Agent for Complex Tasks. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 473.
- Batya Friedman, Peter Kahn, and Alan Borning. 2002. Value sensitive design: Theory and methods. University of Washington technical report, 02–12.
- 10.1145/257089.257434 · DOI
- Krzysztof Z. Gajos, Katherine Everitt, Desney S. Tan, Mary Czerwinski, and Daniel S. Weld. 2008. Predictability and accuracy in adaptive user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1271–1274.
- Arthur C. Graesser, Nia Dowell, and Danielle Clewley. 2017. Assessing Collaborative Problem Solving Through Conversational Agents. In Innovative Assessment of Collaboration. Springer, 65–80.
- 10.1007/978-3-031-02191-6 · DOI · Paper page
- Marc Hassenzahl, Kai Eckoldt, Sarah Diefenbach, Matthias Laschke, Eva Len, and Joonhwan Kim. 2013. Designing moments of meaning and pleasure. Experience design and happiness. International Journal of Design 7, 3. Retrieved February 22, 2016 from http://search.proquest.com/openview/f1d52b35adb0c2727cc8478e2d1bfbd8/1?pq-origsite=gscholar
- 10.1145/2694344.2694347 · DOI · Paper page
- Ting-Hao'Kenneth’ Huang, Joseph Chee Chang, and Jeffrey P. Bigham. 2018. Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time. arXiv preprint arXiv:1801.02668. · arXiv
- 10.1145/3025453.3026003 · DOI · Paper page
- Barbara Johnstone. 2018. Discourse analysis. John Wiley & Sons.
- Jasmine Jones and Mark S. Ackerman. 2018. Co-constructing Family Memory: Understanding the Intergenerational Practices of Passing on Family Stories. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 1–13.
- Evangelos Karapanos, Rúben Gouveia, Marc Hassenzahl, and Jodi Forlizzi. 2016. Wellbeing in the making: peoples’ experiences with wearable activity trackers. Psychology of well-being 6, 1: 4.
- 10.1109/ACII.2019.8925488 · DOI · Paper page
- Philipp Kirschthaler, Martin Porcheron, and Joel E. Fischer. 2020. What Can I Say? Effects of Discoverability in VUIs on Task Performance and User Experience. In Proceedings of the 2nd Conference on Conversational User Interfaces, 1–9.
- 10.11648/j.ebm.20180402.12 · DOI
- 10.1609/aimag.v37i4.2685 · DOI
- J. Derek Lomas, Kenneth Koedinger, Nirmal Patel, Sharan Shodhan, Nikhil Poonwala, and Jodi L. Forlizzi. 2017. Is difficulty overrated?: The effects of choice, novelty and suspense on intrinsic motivation in educational games. In Proceedings of the 2017 CHI conference on human factors in computing systems, 1028–1039.
- 10.1145/3025453.3025735 · DOI · Paper page
- Jakob Nielsen. 1994. 10 Heuristics for User Interface Design: Article by Jakob Nielsen. Nielsen Norman Group. Retrieved October 24, 2019 from https://www.nngroup.com/articles/ten-usability-heuristics/
- Jakob Nielsen. 1995. 10 usability heuristics for user interface design. Nielsen Norman Group 1, 1.
- 10.1145/176789.176796 · DOI · Paper page
- 10.1145/2939672.2939778 · DOI · Paper page
- Scott Rigby and Richard M. Ryan. 2011. Glued to games: How video games draw us in and hold us spellbound: How video games draw us in and hold us spellbound. AbC-CLIo.
- Richard M. Ryan and Edward L. Deci. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American psychologist 55, 1: 68. Retrieved June 20, 2016 from http://psycnet.apa.org/journals/amp/55/1/68/
- Richard M. Ryan and Edward L. Deci. 2017. Self-determination theory: Basic psychological needs in motivation, development, and wellness. Guilford Publications.
- Muhammad Sarwar and Tariq Rahim Soomro. 2013. Impact of smartphone's on society. European journal of scientific research 98 2: 216–226.
- Alex Sciuto, Arnita Saini, Jodi Forlizzi, and Jason I. Hong. 2018. “ Hey Alexa, What's Up?” A Mixed-Methods Studies of In-Home Conversational Agent Usage. In Proceedings of the 2018 Designing Interactive Systems Conference, 857–868.
- Daniel S. Weld and Gagan Bansal. 2018. Intelligible artificial intelligence. ArXiv e-prints, March 2018.
- 10.1145/3290607.3313090 · DOI · Paper page
- 10.1145/3301275.3302264 · DOI · Paper page
- 10.1145/3290605.3300772 · DOI · Paper page
- Xi Yang, Marco Aurisicchio, James Mackrill, and Weston Baxter. 2017. On the products and experiences that make us happy. In DS 87-8 Proceedings of the 21st International Conference on Engineering Design (ICED 17) Vol 8: Human Behaviour in Design, Vancouver, Canada, 21-25.08. 2017, 499–508.
Cited by
Xia, Q., Chiu, T. K. F., Chai, C. S., & Xie, K. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13305 · Cited by 203
How does HCI Understand Human Agency and Autonomy?
Bennett, D., Metatla, O., Roudaut, A., & Mekler, E. D. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580651 · Cited by 111
Will AI Console Me when I Lose my Pet? Understanding Perceptions of AI-Mediated Email Writing
Liu, Y., Mittal, A., Yang, D., & Bruckman, A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517731 · Cited by 92
Self-Determination Theory and HCI Games Research: Unfulfilled Promises and Unquestioned Paradigms
Tyack, A., & Mekler, E. D. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3673230 · Cited by 57
Burnell, R., Peters, D., Ryan, R. M., & Calvo, R. A. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1092288 · Cited by 33
Metadata
- Authors
- Yang, X., & Aurisicchio, M.
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-16
- OpenAlex
- W3162051685
- Cited by
- 81
- References
- 27
- FWCI
- 5.06
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.