CoChat
Sign Up
Cited by 46

The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.

Healthcare Voice AI Assistants: Factors Influencing Trust and Intention to Use

Zhan, Xiao, Abdi, Noura, Seymour, William, Such, Jose·2024·Proceedings of the ACM on Human-Computer Interaction
DOI 10.1145/3637339
Open this paper in CoChat — free account

Abstract

AI assistants such as Alexa, Google Assistant, and Siri, are making their way into the healthcare sector, offering a convenient way for users to access different healthcare services. Trust is a vital factor in the uptake of healthcare services, but the factors affecting trust in voice assistants used for healthcare are under-explored and this specialist domain introduces additional requirements. This study explores the effects of different functional, personal, and risk factors on trust in and adoption of healthcare voice AI assistants (HVAs), generating a partial least squares structural model from a survey of 300 voice assistant users. Our results indicate that trust in HVAs can be significantly explained by functional factors (usefulness, content credibility, quality of service relative to a healthcare professional), together with security, and privacy risks and personal stance in technology. We also discuss differences in terms of trust between HVAs and general-purpose voice assistants as well as implications that are unique to HVAs.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3637339

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Show all 30 references

Research works printed but not linked: 176

  1. MM Abbasi and S Kashiyarndi. 2006. Clinical Decision Support Systems: A discussion on different methodologies used in Health Care. Marlaedalen University Sweden (2006).
  2. Noura Abdi, Kopo Ramokapane, and Jose Such. 2019. More than smart speakers: security and privacy perceptions of smart home personal assistants. In Fifteenth Symposium on Usable Privacy and Security ($$SOUPS$$ 2019). 451--466.
  3. 10.1145/3411764.3445122 · DOI
  4. 10.1016/j.chb.2020.106466 · DOI
  5. Jawaher Hamad Al Shamsi, Mostafa Al-Emran, and Khaled Shaalan. 2022. Understanding key drivers affecting students' use of artificial intelligence-based voice assistants. Education and Information Technologies (2022), 1--21.
  6. 10.1136/bmjhci-2019--100075 · DOI
  7. 10.3390/technologies6030064 · DOI · Paper page
  8. 10.1109/ACCESS.2019.2904006 · DOI
  9. 10.1145/3311956 · DOI · Paper page
  10. 10.1177/1077699015606057 · DOI
  11. 10.2196/15154 · DOI · Paper page
  12. 10.1177/1094428110397773 · DOI
  13. 10.1007/BF02723327 · DOI · Paper page
  14. Phoebe E Bailey and Tarren Leon. 2019. A systematic review and meta-analysis of age-related differences in trust. Psychology and aging, Vol. 34, 5 (2019), 674.
  15. Adam Baker, Yura Perov, Katherine Middleton, Janie Baxter, Daniel Mullarkey, Davinder Sangar, Mobasher Butt, Arnold DoRosario, and Saurabh Johri. 2020. A comparison of artificial intelligence and human doctors for the purpose of triage and diagnosis. Frontiers in artificial intelligence , Vol. 3 (2020), 543405.
  16. 10.5555/2873818.2873843 · DOI
  17. 10.1145/3491102.3517683 · DOI · Paper page
  18. 10.17705/1jais.00065 · DOI
  19. 10.1109/ICCES48766.2020.9137944 · DOI
  20. 10.2196/11510 · DOI · Paper page
  21. Reuben Binns. 2018. Fairness in machine learning: Lessons from political philosophy. In Conference on Fairness, Accountability and Transparency. PMLR, 149--159.
  22. 10.1145/3543829.3544520 · DOI
  23. 10.1016/S2213-8587(21)00267-9 · DOI · Paper page
  24. 10.1145/3484507 · DOI · Paper page
  25. Susana Buinhas, Ana Paula Cláudio, Maria Beatriz Carmo, Jo ao Balsa, Afonso Cavaco, Anabela Mendes, Isa Félix, Nuno Pimenta, and Mara Pereira Guerreiro. 2018. Virtual assistant to improve self-care of older people with type 2 diabetes: first prototype. In International Workshop on Gerontechnology. Springer, 236--248.
  26. 10.1080/08824096.2021.1980380 · DOI · Paper page
  27. 10.1016/j.ijhcs.2023.103177 · DOI
  28. 10.1109/ICIMTech.2018.8528182 · DOI
  29. Ching-Sheng Chang, Su-Yueh Chen, and Yi-Ting Lan. 2013. Service quality, trust, and patient satisfaction in interpersonal-based medical service encounters. BMC health services research , Vol. 13, 1 (2013), 1--11.
  30. 10.1016/j.chb.2016.12.013 · DOI
  31. Cheng-Min Chao. 2019. Factors determining the behavioral intention to use mobile learning: An application and extension of the UTAUT model. Frontiers in psychology , Vol. 10 (2019), 1652.
  32. Qian Qian Chen and Hyun Jung Park. 2021. How anthropomorphism affects trust in intelligent personal assistants. Industrial Management & Data Systems (2021).
  33. 10.1016/j.chb.2021.106700 · DOI
  34. 10.1145/3313831.3376551 · DOI
  35. 10.1111/j.1470-6431.2009.00777.x · DOI
  36. 10.1037/0033--2909.112.1.155 · DOI
  37. 10.1109/GreenCom.2012.32 · DOI
  38. 10.1145/3449157 · DOI
  39. Fred D Davis. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly (1989), 319--340.
  40. 10.23919/MIPRO.2019.8756983 · DOI
  41. 10.1145/3377325.3377501 · DOI · Paper page
  42. 10.1080/10447318.2014.986642 · DOI · Paper page
  43. Jide Edu, Xavi Ferrer Aran, Jose Such, and Guillermo Suarez-Tangil. 2021. SkillVet: Automated traceability analysis of Amazon Alexa skills. IEEE Transactions on Dependable and Secure Computing (2021).
  44. 10.1145/3485447.3512289 · DOI
  45. 10.1145/3412383 · DOI
  46. 10.1177/1062860619878515 · DOI · Paper page
  47. 10.1037/0033--295X.114.4.864 · DOI
  48. 10.1007/s10479-018--2818-y · DOI
  49. 10.1016/j.jbusres.2020.08.058 · DOI
  50. 10.1007/s10606-012-9168-0 · DOI
  51. 10.1086/707731 · DOI
  52. 10.1177/002224378101800104 · DOI · Paper page
  53. Frontiers. 2021. The Trustworthiness of Voice Assistants in the Context of Healthcare Investigating the Effect of Perceived Expertise on the Trustworthiness of Voice Assistants Providers Data Receivers and Automatic Speech Recognition. https://www.frontiersin.org/articles/10.3389/fcomp.2021.685250/full · DOI
  54. 10.1108/APJML-06--2013-0061 · DOI
  55. 10.1016/j.sapharm.2020.07.023 · DOI
  56. Zhixiu Guo, Zijin Lin, Pan Li, and Kai Chen. 2020. $$SkillExplorer$$: Understanding the Behavior of Skills in Large Scale. In 29th USENIX Security Symposium (USENIX Security 20). 2649--2666.
  57. 10.1016/j.ijinfomgt.2019.03.008 · DOI · Paper page
  58. 10.1080/10548408.2016.1237405 · DOI
  59. Melissa Gymrek, Amy L McGuire, David Golan, Eran Halperin, and Yaniv Erlich. 2013. Identifying personal genomes by surname inference. Science, Vol. 339, 6117 (2013), 321--324.
  60. Taehyun Ha, Sangyeon Kim, Donghak Seo, and Sangwon Lee. 2020. Effects of explanation types and perceived risk on trust in autonomous vehicles. Transportation research part F: traffic psychology and behaviour , Vol. 73 (2020), 271--280.
  61. J Hair, W Black, B Babin, and R Anderson. 2009. Multivariate Data Analysis 7th Edition Pearson Prentice Hall: JOUR. (2009).
  62. 10.1108/IMDS-04--2016-0130 · DOI
  63. Joseph F Hair, G Thomas M Hult, Christian Ringle, and Marko Sarstedt. 2014. A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). (2014).
  64. 10.2753/MTP1069-6679190202 · DOI · Paper page
  65. Joseph F Hair, Jeffrey J Risher, Marko Sarstedt, and Christian M Ringle. 2019. When to use and how to report the results of PLS-SEM. European business review (2019).
  66. 10.1111/1468-0009.00223 · DOI
  67. 10.1108/IMDS-05--2017-0214 · DOI
  68. Christina N Harrington, Lyndsie Marie Koon, and Wendy A Rogers. 2020. Design of health information and communication technologies for older adults. In Design for Health. Elsevier, 341--363.
  69. 10.1016/j.jbusres.2020.12.012 · DOI
  70. 10.1145/3500868.3559450 · DOI
  71. David J Hauser and Norbert Schwarz. 2016. Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants. Behavior research methods , Vol. 48, 1 (2016), 400--407.
  72. Erika C Hayden. 2013. Privacy loophole found in genetic databases. Nature News , Vol. 17 (2013).
  73. 10.1007/s10606-005-9001-0 · DOI · Paper page
  74. Tanja B Jutzi, Eva I Krieghoff-Henning, Tim Holland-Letz, Jochen Sven Utikal, Axel Hauschild, Dirk Schadendorf, Wiebke Sondermann, Stefan Fröhling, Achim Hekler, Max Schmitt, et al. 2020. Artificial intelligence in skin cancer diagnostics: the patients' perspective. Frontiers in medicine , Vol. 7 (2020), 233.
  75. 10.1016/j.jocn.2019.03.001 · DOI
  76. 10.1177/0894439317752406 · DOI
  77. 10.1145/3196490 · DOI
  78. 10.1145/2675133.2675154 · DOI
  79. 10.1016/j.ijhcs.2010.08.002 · DOI
  80. 10.1007/s11277-011-0386--4 · DOI
  81. Pascal Kowalczuk. 2018. Consumer acceptance of smart speakers: a mixed methods approach. Journal of Research in Interactive Marketing (2018).
  82. 10.1002/mar.20196 · DOI
  83. 10.1055/s-0038-1666844 · DOI
  84. Yi Lai Atreyi Kankanhalli and Desmond Ong. 2021. Human-AI collaboration in healthcare: A review and research agenda. (2021). · DOI
  85. 10.1145/2818052.2855527 · DOI
  86. 10.1145/3328925 · DOI
  87. 10.1111/jpim.12176 · DOI · Paper page
  88. 10.3390/ijerph18010271 · DOI · Paper page
  89. 10.1145/3411764.3445570 · DOI · Paper page
  90. 10.1108/JSIT-07--2020-0132 · DOI
  91. 10.1037/1076-898X.6.2.104 · DOI
  92. 10.1145/3427228.3427250 · DOI
  93. 10.1007/978--3-030--15742--5_9 · DOI
  94. 10.1080/19368623.2020.1685053 · DOI
  95. Xiaoxuan Liu, Livia Faes, Aditya U Kale, Siegfried K Wagner, Dun Jack Fu, Alice Bruynseels, Thushika Mahendiran, Gabriella Moraes, Mohith Shamdas, Christoph Kern, et al. 2019. A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. The lancet digital health , Vol. 1, 6 (2019), e271--e297.
  96. 10.1080/15252019.2018.1533501 · DOI · Paper page
  97. 10.1108/EJM-06-2019-966 · DOI
  98. Yaobin Lu, Shuiqing Yang, Patrick YK Chau, and Yuzhi Cao. 2011. Dynamics between the trust transfer process and intention to use mobile payment services: A cross-environment perspective. Information & management , Vol. 48, 8 (2011), 393--403.
  99. Niklas Luhmann. 2001. Familiarity, confidence, trust: Problems and alternatives. Reseaux, Vol. 108, 4 (2001), 15--35.
  100. Poornima Madhavan, Douglas A Wiegmann, and Frank C Lacson. 2006. Automation failures on tasks easily performed by operators undermine trust in automated aids. Human factors, Vol. 48, 2 (2006), 241--256.
  101. 10.1145/3555613 · DOI
  102. 10.1109/SEGAH52098.2021.9551864 · DOI
  103. Winter Mason and Siddharth Suri. 2012. Conducting behavioral research on Amazon's Mechanical Turk. Behavior research methods , Vol. 44, 1 (2012), 1--23.
  104. 10.2307/258792 · DOI · Paper page
  105. 10.1016/j.chb.2019.05.009 · DOI · Paper page
  106. 10.1145/3359278 · DOI
  107. 10.1145/3449119 · DOI
  108. Adam S Miner, Arnold Milstein, Stephen Schueller, Roshini Hegde, Christina Mangurian, and Eleni Linos. 2016. Smartphone-based conversational agents and responses to questions about mental health, interpersonal violence, and physical health. JAMA internal medicine , Vol. 176, 5 (2016), 619--625.
  109. 10.1016/j.ergon.2009.01.004 · DOI · Paper page
  110. 10.1007/s12525-020-00411-w · DOI · Paper page
  111. 10.1145/2818052.2855508 · DOI
  112. 10.1080/15332861.2021.1927437 · DOI
  113. Tom Nadarzynski, Oliver Miles, Aimee Cowie, and Damien Ridge. 2019. Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: A mixed-methods study. Digital health , Vol. 5 (2019), 2055207619871808.
  114. Myura Nagendran, Yang Chen, Christopher A Lovejoy, Anthony C Gordon, Matthieu Komorowski, Hugh Harvey, Eric J Topol, John PA Ioannidis, Gary S Collins, and Mahiben Maruthappu. 2020. Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies. bmj , Vol. 368 (2020).
  115. Caroline A Nelson, Lourdes Maria Pérez-Chada, Andrew Creadore, Sara Jiayang Li, Kelly Lo, Priya Manjaly, Ashley Bahareh Pournamdari, Elizabeth Tkachenko, John S Barbieri, Justin M Ko, et al. 2020. Patient perspectives on the use of artificial intelligence for skin cancer screening: a qualitative study. JAMA dermatology, Vol. 156, 5 (2020), 501--512.
  116. 10.1038/s41746-019-0215--9 · DOI
  117. 10.1145/2441776.2441838 · DOI · Paper page
  118. 10.1007/s00330-019-06486-0 · DOI · Paper page
  119. Shane O'Sullivan, Nathalie Nevejans, Colin Allen, Andrew Blyth, Simon Leonard, Ugo Pagallo, Katharina Holzinger, Andreas Holzinger, Mohammed Imran Sajid, and Hutan Ashrafian. 2019. Legal, regulatory, and ethical frameworks for development of standards in artificial intelligence (AI) and autonomous robotic surgery. The international journal of medical robotics and computer assisted surgery, Vol. 15, 1 (2019), e1968.
  120. 10.1007/s11002-018-9448-7 · DOI
  121. 10.1145/975817.975844 · DOI · Paper page
  122. 10.1145/2998181.2998357 · DOI
  123. 10.1145/3311957.3359433 · DOI
  124. Paul A Pavlou. 2003. Consumer acceptance of electronic commerce: Integrating trust and risk with the technology acceptance model. International journal of electronic commerce, Vol. 7, 3 (2003), 101--134.
  125. Eyal Peer, Joachim Vosgerau, and Alessandro Acquisti. 2014. Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behavior research methods , Vol. 46, 4 (2014), 1023--1031.
  126. 10.3390/ijerph17010139 · DOI
  127. 10.1016/j.rser.2014.04.003 · DOI
  128. 10.1002/mar.21457 · DOI
  129. W Nicholson Price and I Glenn Cohen. 2019. Privacy in the age of medical big data. Nature medicine, Vol. 25, 1 (2019), 37--43.
  130. Rebecca Schnall, Tracy Higgins, William Brown, Alex Carballo-Dieguez, and Suzanne Bakken. 2015. Trust, perceived risk, perceived ease of use and perceived usefulness as factors related to mHealth technology use. Studies in health technology and informatics , Vol. 216 (2015), 467.
  131. William Seymour, Noura Abdi, Kopo M Ramokapane, Jide Edu, Guillermo Suarez-Tangil, and Jose Such. 2024. Voice App Developer Experiences with Alexa and Google Assistant: Juggling Risks, Liability, and Security. In USENIX Security Symposium (SEC).
  132. 10.1145/3544548.3580967 · DOI
  133. William Seymour and Jose Such. 2023. Ignorance is Bliss? The Effect of Explanations on Perceptions of Voice Assistants. Proceedings of the ACM on Human-Computer Interaction, Vol. 7, CSCW1 (2023), 1--24.
  134. 10.1145/3479515 · DOI · Paper page
  135. 10.1145/3600211.3604679 · DOI
  136. 10.1038/s41746-020-00332-0 · DOI · Paper page
  137. 10.2196/14202 · DOI
  138. 10.1016/j.jretconser.2019.101946 · DOI
  139. 10.1145/3432233 · DOI
  140. 10.4018/JGIM.2021030102 · DOI
  141. Clay Spinuzzi. 2005. The methodology of participatory design. Technical communication , Vol. 52, 2 (2005), 163--174.
  142. 10.1145/3025453.3025668 · DOI
  143. Jose M Such. 2017. Privacy and Autonomous Systems.. In Ijcai. 4761--4767. · DOI
  144. 10.2307/23042805 · DOI
  145. 10.26858/pdr.v3i2.13255 · DOI
  146. Henri Tajfel, John C Turner, William G Austin, and Stephen Worchel. 1979. An integrative theory of intergroup conflict. Organizational identity: A reader , Vol. 56, 65 (1979), 9780203505984--16.
  147. 10.3390/ijerph18094538 · DOI
  148. TechRepublic. 2020. Alexa Skills: Cheat Sheet. https://www.techrepublic.com/article/alexa-skills-cheat-sheet/
  149. R Thomson, DW Barclay, and CA Higgins. 1995. The partial least squares approach to causal modeling: Personal computer adoption and use as an illustration. Technology Studies: Special Issue on Research Methodology, Vol. 2, 2 (1995), 284--324.
  150. Eric J Topol. 2019. High-performance medicine: the convergence of human and artificial intelligence. Nature medicine, Vol. 25, 1 (2019), 44--56.
  151. 10.1177/1094670516679272 · DOI · Paper page
  152. 10.1145/3555546 · DOI
  153. Michelle ME van Pinxteren, Ruud WH Wetzels, Jessica Rüger, Mark Pluymaekers, and Martin Wetzels. 2019. Trust in humanoid robots: implications for services marketing. Journal of Services Marketing (2019).
  154. Eleftheria Vaportzis, Maria Giatsi Clausen, and Alan J Gow. 2017. Older adults perceptions of technology and barriers to interacting with tablet computers: a focus group study. Frontiers in psychology , Vol. 8 (2017), 1687.
  155. Viswanath Venkatesh and Hillol Bala. 2008. Technology acceptance model 3 and a research agenda on interventions. Decision sciences, Vol. 39, 2 (2008), 273--315.
  156. Viswanath Venkatesh and Fred D Davis. 2000. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management science, Vol. 46, 2 (2000), 186--204.
  157. Viswanath Venkatesh, Michael G Morris, Gordon B Davis, and Fred D Davis. 2003. User acceptance of information technology: Toward a unified view. MIS quarterly (2003), 425--478.
  158. Viswanath Venkatesh, James YL Thong, and Xin Xu. 2012. Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology. MIS quarterly (2012), 157--178.
  159. Sebastian Vollmer, Bilal A Mateen, Gergo Bohner, Franz J Király, Rayid Ghani, Pall Jonsson, Sarah Cumbers, Adrian Jonas, Katherine SL McAllister, Puja Myles, et al. 2018. Machine learning and AI research for patient benefit: 20 critical questions on transparency, replicability, ethics and effectiveness. arXiv preprint arXiv:1812.10404 (2018). · arXiv
  160. Dakuo Wang Elizabeth Churchill Pattie Maes Xiangmin Fan Ben Shneiderman Yuanchun Shi and Qianying Wang. 2020. From human-human collaboration to Human-AI collaboration: Designing AI systems that can work together with people. In Extended abstracts of the 2020 CHI conference on human factors in computing systems. 1--6. · DOI · Paper page
  161. Weiyu Wang and Keng Siau. 2018. Living with Artificial Intelligence--Developing a Theory on Trust in Health Chatbots. In Proceedings of the Sixteenth Annual Pre-ICIS Workshop on HCI Research in MIS.
  162. 10.4172/2472--1654.100146 · DOI
  163. 10.1016/j.jesp.2014.01.005 · DOI · Paper page
  164. 10.1016/j.chb.2010.07.033 · DOI
  165. Jie Xu, Kim Le, Annika Deitermann, and Enid Montague. 2014. How different types of users develop trust in technology: A qualitative analysis of the antecedents of active and passive user trust in a shared technology. Applied ergonomics, Vol. 45, 6 (2014), 1495--1503.
  166. T Yan. 2008. Nondifferentiation. Encyclopedia of survey research methods , Vol. 2 (2008), 520--521.
  167. Zheng Yan and Silke Holtmanns. 2008. Trust modeling and management: from social trust to digital trust. In Computer security privacy and politics: current issues challenges and solutions. IGI Global 290--323. · DOI
  168. 10.2196/24045 · DOI
  169. 10.1145/3359161 · DOI
  170. 10.1177/1356389013497081 · DOI
  171. 10.17705/1jais.00496 · DOI
  172. 10.1016/S2589-7500(21)00132-1 · DOI · Paper page
  173. Jeffrey Young, Song Liao, Long Cheng, Hongxin Hu, and Huixing Deng. 2022. $$SkillDetective$$: Automated $$Policy-Violation$$ Detection of Voice Assistant Applications in the Wild. In 31st USENIX Security Symposium (USENIX Security 22).
  174. 10.1145/3514094.3534129 · DOI
  175. Xiao Zhan, Stefan Sarkadi, and Jose Such. 2023. Privacy-enhanced Personal Assistants based on Dialogues and Case Similarity. In European Conference on Artificial Intelligence. IOS Press.
  176. Runting Zhong and Mengyao Ma. 2022. Effects of communication style, anthropomorphic setting and individual differences on older adults using voice assistants in a health context. BMC geriatrics, Vol. 22, 1 (2022), 1--13. io

Cited by

Sorted by citations

See all 46

Metadata

Authors
Zhan, X., Abdi, N., Seymour, W., & Such, J.
Affiliations
  • King's College London, London, United Kingdom
  • Kings College London, London, United Kingdom
  • King's College London & VRAIN, Universitat Politecnica de Valencia, London, United Kingdom
ORCID
Venue
Proceedings of the ACM on Human-Computer Interaction
Publisher
Association for Computing Machinery (ACM)
Published
2024-04-17
Volume
8
Issue
CSCW1
Pages
1-37
ISSN
2573-0142
DOI
10.1145/3637339
Cited by
46
References
30
Language
en
Licence
www.acm.org/publications/policies/copyright_policy#Background (vor)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review