The DOI matches its Crossref record; 36 of the 39 references it cites were found in a registry or an index.
Does a Digital Assistant Need a Body? The Influence of Visual Embodiment and Social Behavior on the Perception of Intelligent Virtual Agents in AR
Abstract
Intelligent Virtual Agents (IVAs) are becoming part of our everyday life, thanks to artificial intelligence technology and Internet of Things devices. For example, users can control their connected home appliances through natural voice commands to the IVA. However, most current-state commercial IVAs, such as Amazon Alexa, mainly focus on voice commands and voice feedback, and lack the ability to provide non-verbal cues which are an important part of social interaction. Augmented Reality (AR) has the potential to overcome this challenge by providing a visual embodiment of the IVA. In this paper we investigate how visual embodiment and social behaviors influence the perception of the IVA. We hypothesize that a user's confidence in an IVA's ability to perform tasks is improved when imbuing the agent with a human body and social behaviors compared to the agent solely depending on voice feedback. In other words, an agent's embodied gesture and locomotion behavior exhibiting awareness of the surrounding real world or exerting influence over the environment can improve the perceived social presence with and confidence in the agent. We present a human-subject study, in which we evaluated the hypothesis and compared different forms of IVAs with speech, gesturing, and locomotion behaviors in an interactive AR scenario. The results show support for the hypothesis with measures of confidence, trust, and social presence. We discuss implications for future developments in the field of IVAs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, in the context of both autonomous vehicles and virtual agents, people showed more trust in AIs with human characteristics than without [41-43].”
From Anthropomorphism in AI: hype and fallacy (2024) · cites this paper as [42]
Citations
Cites
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,872
Towards a Better Understanding of Context and Context-Awareness
Abowd, G. D., Dey, A. K., Brown, P. J., Davies, N., Smith, M. T., & Steggles, P. (1999) · Lecture notes in computer science · doi:10.1007/3-540-48157-5_29 · Cited by 2,994
Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments
Slater, M. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2009.0138 · Cited by 2,691
Toward a More Robust Theory and Measure of Social Presence: Review and Suggested Criteria
Biocca, F. A., Harms, C., & Burgoon, J. K. (2003) · PRESENCE Virtual and Augmented Reality · doi:10.1162/105474603322761270 · Cited by 2,365
Trust in a specific technology: An investigation of its components and measures
Mcknight, D. H., Carter, M., Thatcher, J. B., & Clay, P. F. (2011) · ACM Transactions on Management Information Systems · doi:10.1145/1985347.1985353 · Cited by 1,185
Nowak, K. L., & Biocca, F. (2003) · Presence - Teleoperators and Virtual Environments · doi:10.1162/105474603322761289 · Cited by 1,162
It's only a computer: virtual humans increase willingness to disclose
Lucas, G. M., Gratch, J., King, A., & Morency, L.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.043 · Cited by 977
Interpersonal Distance in Immersive Virtual Environments
Bailenson, J., Blascovich, J., Beall, A., & Loomis, J. (2003) · Personality and Social Psychology Bulletin · doi:10.1177/0146167203029007002 · Cited by 851
Self-citationEquilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments
Bailenson, J. N., Blascovich, J., Beall, A. C., & Loomis, J. M. (2001) · PRESENCE Virtual and Augmented Reality · doi:10.1162/105474601753272844 · Cited by 573
Self-citationThe impact of animated interface agents: a review of empirical research
Dehn, D. M., & van Mulken, S. (2000) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0325 · Cited by 567
Research works printed but not linked: 3
- bos, 2002, Rich Media Helps Trust Development, Proceedings of ACM CHI, 135
- amores, 2012, Smart Avatars: Using Avatars to Interact With Objects, Proceedings of ACM CHI, 1
- lombard, 2009, Measuring presence: The temple presence inventory, International Workshop on Presence, 1
Cited by
Sorted by citations
Trust in AI and Its Role in the Acceptance of AI Technologies
Choung, H., David, P., & Ross, A. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2050543 · Cited by 963
“Studies have found that the embodiment of an agent can increase trust because users are better able to perceive its social presence (Kim et al., 2018; Shin, 2021c; Waytz et al., 2014).”
BackgroundRevisiting Trends in Augmented Reality Research: A Review of the 2nd Decade of ISMAR (2008–2017)
Kim, K., Billinghurst, M., Bruder, G., Duh, H. B., & Welch, G. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2868591 · Cited by 335
Self-citationSocial interaction in augmented reality
Miller, M. R., Jun, H., Herrera, F., Villa, J. Y., Welch, G., & Bailenson, J. N. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216290 · Cited by 235
Self-citationA Review of Trust in Artificial Intelligence: Challenges, Vulnerabilities and Future Directions
Lockey, S., Gillespie, N. A., Holm, D., & Someh, I. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.664 · Cited by 233
The Effect of Avatar Appearance on Social Presence in an Augmented Reality Remote Collaboration
Yoon, B., Kim, H.-I., Lee, G., Billinghurst, M., & Woo, W. (2019) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr.2019.8797719 · Cited by 204
Metadata
- Authors
- Kim, K., Boelling, L., Haesler, S., Bailenson, J., Bruder, G., & Welch, G. F.
- Affiliations
- University of Central Florida (US)
- University of Würzburg (DE)
- Stanford University (US)
- Venue
- 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
- Publisher
- IEEE
- Published
- 2018-10
- Pages
- 105-114
- ISSN
- 1554-7868 (ISSN-L)
- OpenAlex
- W2909822833
- Cited by
- 206
- References
- 39
- Citations by year
- 2026: 23 · 2025: 44 · 2024: 32 · 2023: 26 · 2022: 21 · 2021: 21 · 2020: 23 · 2019: 12 · 2018: 4
- FWCI
- 26.89
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Augmented Reality Applications
- Keywords
- intelligent virtual agents, augmented reality, social presence, user confidence, gesturing, locomotor activity, nonverbal cues, voice feedback, virtual assistants, human-agent interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review