CoChat

Effect of Behavioral Realism on Social Interactions Inside Collaborative Virtual Environments

Open access
Herrera, Fernanda, Oh, Soo Youn, Bailenson, Jeremy N. · 2018 · PRESENCE: Virtual and Augmented Reality
Cited by 100

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

Abstract

Collaborative virtual environments (CVEs), wherein people can virtually interact with each other via avatars, are becoming increasingly prominent. However, CVEs differ in type of avatar representation and level of behavioral realism afforded to users. The present investigation compared the effect of behavioral realism on users' nonverbal behavior, self-presence, social presence, and interpersonal attraction during a dyadic interaction. Fifty-one dyads (aged 18 to 26) embodied either a full-bodied avatar with mapped hands and inferred arm movements, an avatar consisting of only a floating head and mapped hands, or a static full-bodied avatar. Planned contrasts compared the effect of behavioral realism against no behavioral realism, and compared the effect of low versus high behavioral realism. Results show that participants who embodied the avatar with only a floating head and hands experienced greater social presence, self-presence, and interpersonal attraction than participants who embodied a full-bodied avatar with mapped hands. In contrast, there were no significant differences on these measures between participants in the two mapped-hands conditions and those who embodied a static avatar. Participants in the static-avatar condition rotated their own physical head and hands significantly less than participants in the other two conditions during the dyadic interaction. Additionally, side-to-side head movements were negatively correlated with interpersonal attraction regardless of condition. We discuss implications of the finding that behavioral realism influences nonverbal behavior and communication outcomes.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1162/pres_a_00324

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 49

  1. Argyle, M., & Williams, M. (1969). Observer or observed? A reversible perspective in person perception.Sociometry, 32(4), 396–412. · DOI
  2. Argyle, M., Alkema, F., & Gilmour, R. (1971). The communication of friendly and hostile attitudes by verbal and non-verbal signals.European Journal of Social Psychology, 1(3), 385–402. · DOI · Paper page
  3. Aymerich-Franch, L., Karutz, C., & Bailenson, J. N. (2012). Effects of facial and voice similarity on presence in a public speaking virtual environment. Proceedings of the International Society for Presence Research Annual Conference, 24–26.
  4. Bailenson, J. N., Beall, A. C., & Blascovich, J. (2002). Mutual gaze and task performance in shared virtual environments. Journal of Visualization and Computer Animation, 13, 1–8. · DOI · Paper page
  5. Bailenson, J. N., Blascovich, J., Beall, A. C., & Loomis, J. M. (2001). Equilibrium revisited: Mutual gaze and personal space in virtual environments. Presence: Teleoperators and Virtual Environments, 10, 583–598. · DOI · Paper page
  6. Bailenso, J. N., Beall, A. C., Blascovich, J., Loomis, J., & Turk, M. (2005). Transformed social interaction, augmented gaze, and social influence in immersive virtual environments. Human Communication Research, 31, 511–537. · doi:10.1111/j.1468-2958.2005.tb00881.x · Paper page
  7. Bailenson, J. N., Beall, A. C., Loomis, J., Blascovich, J., & Turk, M. (2004). Transformed social interaction: Decoupling representation from behavior and form in collaborative virtual environments. Presence: Teleoperators and Virtual Environments, 13(4), 428–441. · DOI · Paper page
  8. Bailenson, J. N., & Yee, N. (2006). A longitudinal study of task performance, head movements, subjective report, simulator sickness, and transformed social interaction in collaborative virtual environments.Presence: Teleoperators and Virtual Environments, 15(6), 699–716. · DOI
  9. Bailey, J. O., Bailenson, J. N., & Casasanto, D. (2016). When does virtual embodiment change our minds?Presence: Teleoperators and Virtual Environments, 25(2), 222–233. · DOI · Paper page
  10. Biocca, F. (1997). The cyborg's dilemma: Embodiment in virtual environments.Proceedings of the 2nd International Conference on Cognitive Technology, “Humanizing the Information Age,”12–26. · DOI · Paper page
  11. Biocca, F., Harms, C., & Burgoon, J. K. (2003). Toward a more robust theory and measure of social presence: Review and suggested criteria.Presence: Teleoperators and Virtual Environments, 12(5), 456–480. · DOI · Paper page
  12. Blascovich, J. (2002). Social influence within immersive virtual environments. In R.Schroeder (Ed.), The social life of avatars (pp. 127–145). London: Springer. · DOI · Paper page
  13. Burgoon, J. K., Birk, T., & Pfau, M. (1990). Nonverbal behaviors, persuasion, and credibility.Human Communication Research, 17(1), 140–169. · DOI · Paper page
  14. Burgoon, J. K., Guerrero, L. K., & Manusov, V. (2011). Nonverbal signals.The SAGE handbook of interpersonal communication. London: SAGE.
  15. Davis, D., & Perkowitz, W. T. (1979). Consequences of responsiveness in dyadic interaction: Effects of probability of response and proportion of content-related responses on interpersonal attraction.Journal of Personality and Social Psychology, 37(4), 534. · doi:10.1037//0022-3514.37.4.534
  16. DiMatteo, M. R., Taranta, A., Friedman, H. S., & Prince, L. M. (1980). Predicting patient satisfaction from physicians' nonverbal communication skills.Medical Care, 18(4), 376–387. · DOI · Paper page
  17. Dodds, T. J., Mohler, B. J., & Bülthoff, H. H. (2011). Talk to the virtual hands: Self-animated avatars improve communication in head-mounted display virtual environments.PlOS One, 6(10), e25759. · DOI
  18. Ekman, P., & Friesen, W. V. (1979). Handbewegungnen. In K. R.Schere & H. G.Wallbott (Eds.), Nonverbale kommunikation (pp. 108–123). Weinheim, Germany: Beltz.
  19. Gratch, J., Kang, S. H., & Wang, N. (2013). Using social agents to explore theories of rapport and emotional resonance. In J.Gratch & S.Marsella (Eds.), Social emotions in nature and artifact (pp. 181–197). New York: Oxford University Press. · DOI · Paper page
  20. Guadagno, R. E., Blascovich, J., Bailenson, J. N., & Mccall, C. (2007). Virtual humans and persuasion: The effects of agency and behavioral realism.Media Psychology, 10(1), 1–22.
  21. Harms, C., & Biocca, F. (2004). Internal consistency and reliability of the networked minds social presence measure. Proceedings of the Seventh Annual International Workshop: Presence, 246–251.
  22. Heidicker, P., Langbehn, E., & Steinicke, F. (2017, March). Influence of avatar appearance on presence in social VR.Proceedings of IEEE Symposium on 3D User Interfaces, 233–234. · DOI · Paper page
  23. Heylen, D. et al et al. (2002). Experimenting with the gaze of a conversational agent. Proceedings of the International CLASS Workshop on Natural, Intelligent and Effective Interaction in Multimodal Dialogue System, 93–100.
  24. Huang, L., Morency, L. P., & Gratch, J. (2011, September). Virtual Rapport 2.0.International Workshop on Intelligent Virtual Agents, 68–79. · DOI
  25. Krämer, N. C., Simons, N., & Kopp, S. (2007, September). The effects of an embodied conversational agent's nonverbal behavior on user's evaluation and behavioral mimicry.International Workshop on Intelligent Virtual Agents, 238–251. · DOI
  26. Krämer, N. C., Tietz, B., & Bente, G. (2003). Effects of embodied interface agent and their gestural activity.International Workshop on Intelligent Virtual Agents, 292–300. · DOI
  27. Lombard, M., & Ditton, T. (1997). At the heart of it all: The concept of presence.Journal of Computer-Mediated Communication, 3(2). · DOI · Paper page
  28. McMahan, E. M. (1976). Nonverbal communication as a function of attribution in impression formation.Communications Monographs, 43(4), 287–294. · DOI
  29. McMahon, J. M., Pouget, E. R., & Tortu, S. (2006). A guide for multilevel modeling of dyadic data with binary outcomes using SAS PROC NLMIXED.Computational Statistics & Data Analysis, 50(12), 3663–3680. · DOI
  30. Nowak, K. L., & Biocca, F. (2003). The effect of the agency and anthropomorphism on users' sense of telepresence, copresence, and social presence in virtual environments.Presence: Teleoperators and Virtual Environments, 12(5), 481–494. · DOI · Paper page
  31. Pan, Y., & Steed, A. (2017). The impact of self-avatars on trust and collaboration in shared virtual environments.PLOS One, 12(12), e0189078. · DOI
  32. Peña, J., & Hancock, J. T. (2006). An analysis of socioemotional and task communication in online multiplayer video games.Communication Research, 33(1), 92–109. · DOI · Paper page
  33. Rice, R. E., & Love, G. (1987). Electronic emotion: Socioemotional content in a computer-mediated communication network.Communication Research, 14(1), 85–108. · DOI · Paper page
  34. Riggio, R. E., & Friedman, H. S. (1986). Impression formation: The role of expressive behavior.Journal of Personality and Social Psychology, 50(2), 421. · doi:10.1037//0022-3514.50.2.421 · Paper page
  35. Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (2000). Contrasts and effect sizes in behavioral research: A correlational approach. Cambridge, Cambridge University Press. · DOI · Paper page
  36. Roth, D., Latoschik, M. E., Vogeley, K., & Bente, G. (2015). Hybrid avatar–agent technology—A conceptual step towards mediated “social” virtual reality and its respective challenges.i-com, 14(2), 107–114. · DOI
  37. Slater, M., & Steed, A. (2002). Meeting people virtually: Experiments in shared virtual environments. In The social life of avatars (pp. 146–171). London: Springer. · DOI
  38. Srivastava, S., McGonigal, K. M., Richards, J. M., Butler, E. A., & Gross, J. J. (2006). Optimism in close relationships: How seeing things in a positive light makes them so.Journal of Personality and Social Psychology, 91(1), 143. · DOI · Paper page
  39. Steed, A., Pan, Y., Zisch, F., & Steptoe, W. (2016). The impact of a self-avatar on cognitive load in immersive virtual reality.IEEE Virtual Reality, 67–76. · DOI · Paper page
  40. Swinth, K., & Blascovich, J. (2002). Perceiving and responding to others: Human–human and human–computer social interaction in collaborative virtual environments. Proceedings of the 5th Annual International Workshop on Presence, 392.
  41. Usoh, M., Arthur, K., Whitton, M. C., Bastos, R., Steed, A., Slater, M., & Brooks Jr, F. P. (1999). Walking > walking-in-place > flying, in virtual environments. Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, 359–364. · DOI · Paper page
  42. Vilhjálmsson, H. H., & Cassell, J. (1998). Bodychat: Autonomous communicative behaviors in avatars. Proceedings of the Second International Conference on Autonomous Agents, 269–276. · DOI
  43. Walther, J. B. (1992). Interpersonal effects in computer-mediated interaction: A relational perspective.Communication Research, 19(1), 52–90. · DOI · Paper page
  44. Walther, J. B., Anderson, J. F., & Park, D. W. (1994). Interpersonal effects in computer-mediated interaction: A meta-analysis of social and antisocial communication.Communication Research, 21(4), 460–487. · DOI · Paper page
  45. Won, A. S., Bailenson, J. N., Stathatos, S. C., & Dai, W. (2014). Automatically detected nonverbal behavior predicts creativity in collaborating dyads.Journal of Nonverbal Behavior, 38(3), 389–408. · DOI
  46. Won, A. S., Bailenson, J. N., & Janssen, J. H. (2014). Automatic detection of nonverbal behavior predicts learning in dyadic interactions.IEEE Transactions on Affective Computing, 5(2), 112–125. · DOI
  47. Won, A. S., Perone, B., Friend, M., & Bailenson, J. N. (2016). Identifying anxiety through tracked head movements in a virtual classroom.Cyberpsychology, Behavior, and Social Networking, 19(6), 380–387. · DOI
  48. Yee, N., Bailenson, J. N., & Ducheneaut, N. (2009). The Proteus effect: Implications of transformed digital self-representation on online and offline behavior.Communication Research, 36(2), 285–312. · DOI · Paper page
  49. Zibrek, K., Kokkinara, E., & McDonnell, R. (2018). The effect of realistic appearance of virtual characters in immersive environments: Does the character's personality play a role?IEEE Transactions on Visualization and Computer Graphics, 24(4), 1681–1690. · DOI · Paper page

Cited by

See all 100

Metadata

Authors
Herrera, F., Oh, S. Y., & Bailenson, J. N.
Venue
PRESENCE: Virtual and Augmented Reality
Publisher
MIT Press
Published
2018
Volume
27
Issue
2
Pages
163-182
ISSN
  • 1054-7460 (ISSN-L)
  • 1531-3263
OpenAlex
W3005590178
Cited by
100
References
10
FWCI
4.84
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.