The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Designing Everyday Conversational Agents for Managing Health and Wellness: A Study of Alexa Skills Reviews
Open accessAbstract
Conversational agents have been developed for supporting a wide array of areas, including autonomous vehicles, decision making, and health behavior change. In the last few years, conversational agents increasingly became available as everyday technologies. This phenomenon enables opportunities for finding novel ways to support health and wellness in everyday contexts. By conducting a content analysis of 433 user reviews of Amazon Alexa's Skills, the goal of this study is two-fold: (1) Extract users' perceived strengths of conversational agents in everyday health and wellness management, (2) develop design heuristics for developing conversational agents for health and wellness. We found that the role of trustworthy content providers is critical during the adoption. The Skills enabled people to overcome logistical barriers to improving daily health and wellness routines. The findings also revealed the importance of transparency in the limitations of the Skill and how to better design command dialogues. We present the design heuristics of conversational agents, building on Nielsen's Usability Heuristics, and discuss implications for designing conversational agents that support health and wellness.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Thus far this research area has assumed older adults to be defined as a homogeneous group where researchers have considered age and functional limitation as the primary determinants of health outcomes and usability [92].”
From "It's Kind of Like Code-Switching": Black Older Adults' Experiences with a Voice Assistant for Health Information Seeking (2022) · cites this paper as [92]
Citations
Cites
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388
Establishing and maintaining long-term human-computer relationships
Bickmore, T. W., & Picard, R. W. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1067860.1067867 · Cited by 1,333 · cited 2×
“Presenting honesty [35], making small talk [8,51], and restraining from acting as less encouraging agents [32] were the effective ways to offer simple advice.”
BackgroundChatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape
Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719828977 · Cited by 1,048
Voice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 1×
“Conversational agents need much improvement in mimicking natural, sophisticated conversational exchanges among humans [4,34,46,49].”
BackgroundCommunication Breakdowns Between Families and Alexa
Beneteau, E., Richards, O. K., Zhang, M., Kientz, J. A., Yip, J., & Hiniker, A. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300473 · Cited by 313 · cited 3×
“These strategies refer to users’ efforts to modify dialogues to resolve misinterpretations [4].”
BackgroundManaging the Personal Side of Health: How Patient Expertise Differs from the Expertise of Clinicians
Hartzler, A., & Pratt, W. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1728 · Cited by 259
Perry, E., Swartz, J., Brown, S., Smith, D., Kelly, G., & Swartz, R. (2005) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2005.03.018 · Cited by 131
Designing a spoken dialogue interface to an intelligent cognitive assistant for people with dementia
Wolters, M. K., Kelly, F., & Kilgour, J. (2016) · Health Informatics Journal · doi:10.1177/1460458215593329 · Cited by 79 · cited 1×
“…offer a potential to serve as a personal health assistant by finding healthcare resources, having sympathy and brief advice for users’ emotional concerns [9,28,38], monitoring sleep patterns [50], or assisting dementia patients as they can repeatedly answer the same questions with patience [62].”
BackgroundHealth and Fitness Apps for Hands-Free Voice-Activated Assistants: Content Analysis
Chung, A. E., Griffin, A. C., Selezneva, D., & Gotz, D. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9705 · Cited by 70 · cited 4×
“These devices offer diverse conversational agent applications (e.g., ‘Skills’ in Amazon Alexa and ‘Actions’ in Google Assistant) that span from entertainment, work assistance, and purchasing items to controlling smart devices [39,60].”
BackgroundInfluentialWhy doesn't it work?: voice-driven interfaces and young children's communication repair strategies
Cheng, Y., Yen, K., Chen, Y., Chen, S., & Hiniker, A. (2018) · Proceedings of the 17th ACM Conference on Interaction Design and Children · doi:10.1145/3202185.3202749 · Cited by 69
Research works printed but not linked: 47
- 10.4103/2230-8229.94006 · DOI
- 10.1109/MPULS.2019.2911816 · DOI
- Erin Beneteau Julie A Kientz Olivia K Richards Jason Yip Mingrui Zhang and Alexis Hiniker. 2019. Communication Breakdowns Between Families and Alexa. (2019). DOI:https://doi.org/10.1145/3290605.3300473 · DOI · Paper page
- 10.1145/3264901 · DOI · Paper page
- Hugh Beyer and Karen Holtzblatt . 1997. Contextual design: defining customer-centered systems . Elsevier . Hugh Beyer and Karen Holtzblatt. 1997. Contextual design: defining customer-centered systems. Elsevier.
- 10.2196/jmir.5239 · DOI · Paper page
- 10.1016/j.pragma.2009.12.012 · DOI
- 10.1145/332051.332075 · DOI
- 10.1080/088395199117360 · DOI · Paper page
- 10.1145/3322276.3322332 · DOI · Paper page
- 10.1145/2800835.2800928 · DOI
- 10.1006/ijhc.1999.0325 · DOI
- Yang Gao , Zhengyu Pan , Honghao Wang , and Guanling Chen . 2018. Alexa , My Love : Analyzing Reviews of Amazon Echo. In 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) , 372--380. Yang Gao, Zhengyu Pan, Honghao Wang, and Guanling Chen. 2018. Alexa, My Love: Analyzing Reviews of Amazon Echo. In 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), 372--380.
- Michael Hildebrandt , Alan Dix , and Herbert A. Meyer . 2004. Time design . Conf. Hum. Factors Comput. Syst. - Proc. ( 2004 ), 1737--1738. DOI:https://doi.org/10.1145/985921.986208 10.1145/985921.986208 Michael Hildebrandt, Alan Dix, and Herbert A. Meyer. 2004. Time design. Conf. Hum. Factors Comput. Syst. - Proc. (2004), 1737--1738. DOI:https://doi.org/10.1145/985921.986208 · DOI
- 10.1080/02763869.2018.1404391 · DOI · Paper page
- 10.1177/0093650209351512 · DOI
- 10.1145/2347504.2347572 · DOI
- 10.1145/2484028.2484092 · DOI
- Lassi A. Liikkanen and Paula Gømez Gømez. 2013. Designing interactive systems for the experience of time . Proc. 6th Int. Conf. Des. Pleasurable Prod. Interfaces, DPPI 2013 ( 2013 ), 146--155. DOI:https://doi.org/10.1145/2513506.2513522 10.1145/2513506.2513522 Lassi A. Liikkanen and Paula Gømez Gømez. 2013. Designing interactive systems for the experience of time. Proc. 6th Int. Conf. Des. Pleasurable Prod. Interfaces, DPPI 2013 (2013), 146--155. DOI:https://doi.org/10.1145/2513506.2513522 · DOI
- 10.1109/ROBOT.2008.4543743 · DOI
- 10.1145/3311927.3323150 · DOI
- 10.1145/3267851.3267855 · DOI
- Martin H Luerssen and Tim Hawke. 2018. Virtual Agents as a Service: Applications in Healthcare. In IVA 107--112. Martin H Luerssen and Tim Hawke. 2018. Virtual Agents as a Service: Applications in Healthcare. In IVA 107--112. · DOI · Paper page
- 10.1145/2858036.2858288 · DOI · Paper page
- Nikolas Martelaro , Victoria C Nneji , Wendy Ju , and Pamela Hinds . 2016 . Tell me more: Designing hri to encourage more trust, disclosure, and companionship . In The Eleventh ACM/IEEE International Conference on Human Robot Interaction, 181--188 . Nikolas Martelaro, Victoria C Nneji, Wendy Ju, and Pamela Hinds. 2016. Tell me more: Designing hri to encourage more trust, disclosure, and companionship. In The Eleventh ACM/IEEE International Conference on Human Robot Interaction, 181--188.
- 10.1145/2556288.2557299 · DOI
- Herbert A. Meyer and Michael Hildebrandt. 2002. Towards time design: Pacing of hypertext navigation by system response times . Conf. Hum. Factors Comput. Syst. - Proc. ( 2002 ), 824--825. Herbert A. Meyer and Michael Hildebrandt. 2002. Towards time design: Pacing of hypertext navigation by system response times. Conf. Hum. Factors Comput. Syst. - Proc. (2002), 824--825.
- 10.1001/jamainternmed.2016.0400 · DOI · Paper page
- 10.1145/3321705.3329842 · DOI
- Tova Most. 2002. The use of repair strategies by children with and without hearing impairment. Lang. Speech. Hear. Serv. Sch. (2002). Tova Most. 2002. The use of repair strategies by children with and without hearing impairment. Lang. Speech. Hear. Serv. Sch. (2002). · DOI
- 10.1145/3240925.3240933 · DOI
- 10.1145/97243.97281 · DOI · Paper page
- 10.1177/002383099804100409 · DOI
- 10.1145/2858036.2858478 · DOI · Paper page
- 10.1145/3027063.3053246 · DOI · Paper page
- 10.7326/0003-4819-125-9-199611010-00010 · DOI
- Ashwin Ram , Rohit Prasad , Chandra Khatri , Anu Venkatesh , Raefer Gabriel , Qing Liu , Jeff Nunn , Behnam Hedayatnia , Ming Cheng , and Ashish Nagar . 2018. Conversational ai: The science behind the alexa prize. arXiv Prepr. arXiv1801.03604 ( 2018 ). Ashwin Ram, Rohit Prasad, Chandra Khatri, Anu Venkatesh, Raefer Gabriel, Qing Liu, Jeff Nunn, Behnam Hedayatnia, Ming Cheng, and Ashish Nagar. 2018. Conversational ai: The science behind the alexa prize. arXiv Prepr. arXiv1801.03604 (2018).
- Steven R Rick , Aaron Paul Goldberg , and Nadir Weibel . 2019 . SleepBot: encouraging sleep hygiene using an intelligent chatbot . In Proceedings of the 24th International Conference on Intelligent User Interfaces: Companion, 107--108 . Steven R Rick, Aaron Paul Goldberg, and Nadir Weibel. 2019. SleepBot: encouraging sleep hygiene using an intelligent chatbot. In Proceedings of the 24th International Conference on Intelligent User Interfaces: Companion, 107--108.
- 10.1145/1541948.1541983 · DOI
- Alex Sciuto , Arnita Saini , Jodi Forlizzi , and Jason I Hong . 2018 . " Hey Alexa, what's up?": studies of in-home conversational agent usage . Proc. Des. Interact. Syst. Conf. 2018 - DIS '18 (2018 ), 857--868. DOI:https://doi.org/10.1145/3196709.3196772 10.1145/3196709.3196772 Alex Sciuto, Arnita Saini, Jodi Forlizzi, and Jason I Hong. 2018. "Hey Alexa, what's up?": studies of in-home conversational agent usage. Proc. Des. Interact. Syst. Conf. 2018 - DIS '18 (2018), 857--868. DOI:https://doi.org/10.1145/3196709.3196772 · DOI · Paper page
- 10.1145/1349822.1349843 · DOI
- Anselm Strauss and Juliet Corbin . 1994 . Grounded theory methodology . Handb. Qual. Res. 17 , (1994), 273--285. Anselm Strauss and Juliet Corbin. 1994. Grounded theory methodology. Handb. Qual. Res. 17, (1994), 273--285.
- 10.1093/jamia/ocy072 · DOI · Paper page
- Anna Vallgårda , Morten Winther , Nina Mørch , and Edit E. Vizer . 2015 . Temporal form in interaction design . Int. J. Des. 9 , 3 (2015), 1 -- 15 . Anna Vallgårda, Morten Winther, Nina Mørch, and Edit E. Vizer. 2015. Temporal form in interaction design. Int. J. Des. 9, 3 (2015), 1--15.
- 10.1145/357980.357991 · DOI
- 10.1145/3185336 · DOI
- 10.1249/FIT.0000000000000048 · DOI
Cited by
Sorted by citations
Harrington, C. N., Garg, R., Woodward, A., & Williams, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501995 · Cited by 98
What's The Talk on VUI Guidelines? A Meta-Analysis of Guidelines for Voice User Interface Design
Murad, C., Candello, H., & Munteanu, C. (2023) · Proceedings of the 5th International Conference on Conversational User Interfaces · doi:10.1145/3571884.3597129 · Cited by 36
Impact of Voice Fidelity on Decision Making: A Potential Dark Pattern?
Dubiel, M., Sergeeva, A., & Leiva, L. A. (2024) · Proceedings of the 29th International Conference on Intelligent User Interfaces · doi:10.1145/3640543.3645202 · Cited by 16
Metadata
- Authors
- Shin, J. Y., & Huh-Yoo, J.
- Affiliations
- Michigan State University (US)
- College of Computing, Drexel University, Philadelphia, Pennsylvania, USA
- ORCID
- Shin, Ji Youn
- Venue
- Proceedings of the 14th EAI International Conference on Pervasive Computing Technologies for Healthcare
- Publisher
- ACM
- Published
- 2020-05-18
- Pages
- 50-61
- ISSN
- 2153-1633 (ISSN-L)
- OpenAlex
- W3128474827
- Cited by
- 18
- References
- 11
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 2 · 2023: 3 · 2022: 6
- FWCI
- 1.64
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- International Conference on Pervasive Computing Technologies for Healthcare (publishedVersion)
- Funders
- NSF IIS (1622626)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- chatbots, Amazon Alexa, Alexa skills, online reviews, design heuristics, Nielsen's usability heuristics, transparency, health behavior change
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
