CoChat

Gender affordances of conversational agents

Brahnam, Sheryl, De Angeli, Antonella · 2012 · Interacting with Computers
Cited by 147

The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.

Abstract

Conversational agents are attributed humanlike characteristics; in particular, they are often assumed to have a gender. There is evidence that gender sets up expectations that have an impact on user experiences with agents. The objective of this paper is to explore gender affordances of conversational agents. Our examination takes a holistic approach to the analysis of the application of gender stereotypes to nine chatterbots: six embodied (three male and three female), two disembodied (male and female), and a robot embodiment. Building on social psychology research, we test the persistence of gender stereotypes in the selection of conversation topics and in the elicitation of disinhibition and verbal abuse. Our study is based on quantitative textual analysis of interaction logs. A dictionary of English sexual slang and derogatory terms was developed for this study. Results show that gender stereotypes tend to affect interaction more at the relational (style) level then at the referential (content) level of conversation. People attribute negative stereotypes to female-presenting chatterbots more often than they do to male-presenting chatterbots, and female-presenting chatterbots are more often the objects of implicit and explicit sexual attention and swear words. We conclude by calling for a more informed analysis of user interactions that considers the full range of user interactions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.intcom.2012.05.001

Cites

14 of 14 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 85

  1. Allen, 1976, Race and physical attractiveness as criteria for white subjects’ dating choices, Social Behavior and Personality, 4, 289, 10.2224/sbp.1976.4.2.289 · DOI
  2. Amalberti, 1993, User representations of computer systems in human–computer speech interaction, International Journal of Man–Machine Studies, 38, 547, 10.1006/imms.1993.1026 · DOI
  3. Bar-Tal, 1976, Physical attractiveness and its relationship to sex-role stereotyping, Sex Roles, 2
  4. Bartneck, 2008, Editorial for the special issue on misuse and abuse of interactive technologies, Interaction Studies: Social Behaviour and Communication in Biological and Artificial Systems, 9, 397, 10.1075/is.9.3.01edi · doi:10.1075/is.9.3.01edi
  5. Baumeister, 2002, Suppression of female sexuality, Review of General Psychology, 6, 166, 10.1037/1089-2680.6.2.166 · doi:10.1037/1089-2680.6.2.166 · Paper page
  6. Baylor, A.L., Kim, Y., 2004. Pedagogical agent design: the impact of agent realism, gender, ethnicity, and instructional role. In: Paper Presented at the Intelligent Tutoring Systems, Maceió, Alagoas, Brazil. · DOI · Paper page
  7. Baylor, 2005, Simulating instructional roles through pedagogical agents, International Journal of Artificial Intelligence in Education, 15, 95
  8. Brahnam, S., 2005. Strategies for handling customer abuse of ECAs. In: Paper Presented at the Interact Workshop On Abuse: The Darker Side of Human–Computer Interaction, Rome, Italy.
  9. Brahnam, S., 2006. Gendered bods and bot abuse. In: Paper Presented at the CHI 2006 Workshop Misuse and Abuse of Interactive Technologies, Montréal, Québec, Canada.
  10. Brahnam, 2009, Building character for artificial conversational agents: ethos, ethics, believability, and credibility, PsychNology Journal, 7
  11. Brahnam, 2008, Special issue on abuse and misuse of social agents, Interacting with Computers, 20, 287, 10.1016/j.intcom.2008.02.001 · DOI
  12. Burgess, 1999, Who women are, who women should be: descriptive and prescriptive gender stereotyping and sex discrimination, Psychology, Public Policy, and Law, 5, 665, 10.1037/1076-8971.5.3.665 · DOI · Paper page
  13. Carli, 1990, Gender, language, and influence, Journal of Personality and Social Psychology, 59, 941, 10.1037/0022-3514.59.5.941 · doi:10.1037/0022-3514.59.5.941 · Paper page
  14. Carli, 1999, Gender, interpersonal power, and social influence, Journal of Social Issues, 55, 81, 10.1111/0022-4537.00106 · DOI · Paper page
  15. Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., Yan, H., 1999. Embodiment in conversational interfaces: Rea. In: Paper presented at the CHI 99, Pittsburgh, PA. · DOI · Paper page
  16. Cassell, 2001, More than just a pretty face: conversational protocols and the affordances of embodiment, Knowledge-Based Systems, 14, 55, 10.1016/S0950-7051(00)00102-7 · DOI
  17. Creed, 2008, Abusive interactions with emobodied agents, Interaction Studies: Social Behaviour and Communication in Biological and Artificial Systems, 9, 481, 10.1075/is.9.3.07cre · DOI
  18. De Angeli, 2009, Ethical implications of verbal disinhibition with conversational agents, PsychNology Journal, 7, 49
  19. De Angeli, A., Brahnam, S., 2006. Sex stereotypes and conversational agents. In: Paper Presented at the AVI 2006 Workshop Gender and Interaction: Real and Virtual Women in a Male World, Venice, Italy.
  20. De Angeli, 2008, I hate you: disinhibition with virtual partners, Interacting with Computers, 20, 302, 10.1016/j.intcom.2008.02.004 · DOI · Paper page
  21. De Angeli, A., Carpenter, R., 2005. Stupid computer! Abuse and social identity. In: Paper Presented at the Interact 2005 Workshop Abuse: The Dark Side of Human–Computer Interaction, Rome.
  22. De Angeli, A., Johnson, G.I., Coventry, L., 2001. The unfriendly user: exploring social reactions to chatterbots. In: Paper presented at the International Conference on Affective Human Factor Design, London.
  23. De Angeli, A., Brahnam, S., Wallis, P., Dix, A., 2006. Misuse and abuse of interactive technologies. In: Paper Presented at the CHI, Montreal, Québec, Canada. · DOI
  24. Dehn, 2000, The impact of animated interface agents: a review of empirical research, International Journal of Human Computer Studies, 52, 1, 10.1006/ijhc.1999.0325 · DOI · Paper page
  25. Denegri-Knott, 2005, The labelling game: a conceptual exploration of deviance on the internet, Social Science Computer Review, 23, 93, 10.1177/0894439304271541 · DOI
  26. DeWall, 2005, Understanding the structure of stereotypes of women: virtue and agency as dimensions distinguishing female subgroups, Psychology of Women Quarterly, 29, 396, 10.1111/j.1471-6402.2005.00239.x · DOI
  27. Dill, 2008, Effects of exposure to sex-stereotyped video game characters on tolerance of sexual harassment, Journal of Experimental Social Psychology, 44, 1402, 10.1016/j.jesp.2008.06.002 · DOI · Paper page
  28. Dindia, 1992, Sex differences in self-disclosure: a metaanalysis, Psychological Bulletin, 112, 106, 10.1037/0033-2909.112.1.106 · doi:10.1037/0033-2909.112.1.106 · Paper page
  29. Dix, 2008, Response to “sometimes its hard to be a robot: a call for action on the ethics of abusing artificial agents”, Interacting with Computers, 20, 334, 10.1016/j.intcom.2008.02.003 · doi:10.1016/j.intcom.2008.02.003
  30. Eagly, 1994, Are people prejudiced against women? Some answers from research on attitudes, gender stereotypes, and judgments of competence, European Review of Social Psychology, 5, 1, 10.1080/14792779543000002 · DOI · Paper page
  31. Feingold, 1992, Good-looking people are not what we think, Psychological Bulletin, 111, 304, 10.1037/0033-2909.111.2.304 · doi:10.1037/0033-2909.111.2.304 · Paper page
  32. Foner, L., 1997. Entertaining agents: a sociological case study. In: Paper Presented at the Proceedings of the First International Conference on Autonomous Agents (AA ‘97), Marina Del Rey, CA. · DOI
  33. Friedman, 1992, The contribution of facial maturity to sex-role stereotypes, Personality and Social Psychology Bulletin, 18, 430, 10.1177/0146167292184006 · DOI · Paper page
  34. Gillen, 1981, Physical attractiveness: a determinant of two types of goodness, Personality and Social Psychology Bulletin, 7, 277, 10.1177/014616728172015 · DOI
  35. Grenci, 2002, Solutions-driven marketing, Communications of the ACM, 45, 65, 10.1145/504729.504730 · DOI · Paper page
  36. Heilman, 1979, When beauty is beastly: the effects of appearance and sex on evaluations of job applicants for managerial and nonmanagerial jobs, Organization Behavior and Human Decision Processes, 35, 202, 10.1016/0749-5978(85)90035-4 · DOI · Paper page
  37. Heilman, 1985, Being attractive, advantage or disadvantage? Performance based evaluations and recommended personnel actions as a function appearance, sex, and job type, Organizational Behavior and Human Decision Processes, 202, 10.1016/0749-5978(85)90035-4 · DOI · Paper page
  38. Herring, 2000, Gender differences in CMC: findings and implications, The Computer Professionals for Social Responsibility Newsletter, 18
  39. Hinsz, 1991, Smile and (half) the world smiles with you, frown and you frown alone, Personality and Social Psychology Bulletin, 17, 586, 10.1177/0146167291175014 · DOI
  40. Holzwarth, 2006, The influence of avatars on online consumer shopping behavior, Journal of Marketing Management, 70, 19, 10.1509/jmkg.70.4.19 · doi:10.1509/jmkg.70.4.19 · Paper page
  41. John, 2001, Usability and software architecture, Behaviour & Information Technology, 20, 329, 10.1080/01449290110081686 · DOI
  42. Johnstone, 1994, There was a long pause: influencing turn-taking behaviour in human–human and human–computer spoken dialogues, International Journal of Human–Computer Studies, 41, 383
  43. Kannabiran, G., Bardzell, J., Bardzell, S., 2011. How HCI talks about sexuality: discursive strategies, blind spots, and opportunities for future research. In: Paper Presented at the CHI 2011 Session HCI for All, Vancouver, BC, Canada. · DOI
  44. Khan, R., De Angeli, A., 2009. The attractiveness stereotype in the evaluation of embodied conversational agents. In: Paper Presented at the Interact. · DOI
  45. Khoo, 2004, Not wanted in the inbox!: evaluation of unsolicited and harassing e-mail, Psychology of Women Quarterly, 28, 204, 10.1111/j.1471-6402.2004.00137.x · doi:10.1111/j.1471-6402.2004.00137.x
  46. Kiesler, 1992, Group decision making and communication technology, Organizational Behavior and Human Decision Processes Group Decision Making, 52, 96, 10.1016/0749-5978(92)90047-B · DOI · Paper page
  47. Konijn, E.A., Utz, S., Martin, T., Barnes, S.B., 2008. Mediated Interpersonal Communication. Routledge, New York. · DOI · Paper page
  48. Krämer, N., Bente, G., Piesk, J., 2003. The ghost in the machine: the influence of embodied conversational agents on user expectations and user behaviour in a TV/VCR application. In: Paper Presented at the MC Workshop 2003, Assistance, Mobility, Applications.
  49. LaPlante, 1980, Living the sexual script: college students’ views of influence in sexual encounters, Journal of Sex Research, 16, 338, 10.1080/00224498009551090 · DOI
  50. Larkin, 1994, Heterosexual courtship violence and sexual harassment: the private and public control of young women, Feminism & Psychology, 4, 213, 10.1177/0959353594042002 · DOI
  51. Lee, 2003, Effects of gender of the computer on informational social influence: the moderating role of task type, International Journal of Human–Computer Studies, 58, 347, 10.1016/S1071-5819(03)00009-0 · DOI
  52. Lott, 1982, Sexual assault and harassment: a campus community case study, Signs, 8, 296, 10.1086/493964 · DOI · Paper page
  53. Maes, 1999, Agents that buy and sell, Communications of the ACM, 42, 81, 10.1145/295685.295716 · DOI · Paper page
  54. Martin, 1998, Becoming a gendered body: practices of preschools, American Sociological Review, 63, 494, 10.2307/2657264 · DOI · Paper page
  55. Mauldin, M.L., 1994. Chatterbots, tinymuds, and the turing test: entering the loebner prize competition. In: Paper Presented at the Proceedings of AAAI ‘94 Conference, Seattle.
  56. McBreen, H., Shad, P., Jack, M., Wyard, P., 2000. Experimental assessment of the effectiveness of synthetic personae for multi-modal e-retail applications. In: Paper Presented at the Proceedings of the Fourth International Conference on Autonomous Agents. · DOI
  57. Miksch, S., Cheng, K., Hayes-Roth, B., 1997. An intelligent assistant for patient health care. In: Paper Presented at the Proceedings of the First International Conference on Autonomous Agents. · DOI
  58. Moreno, 2001, The case for social agency in computer-based teaching: do students learn more deeply when they interact with animated pedagogical agents?, Cognition and Instruction, 19, 177, 10.1207/S1532690XCI1902_02 · DOI · Paper page
  59. Moreno, K.N., Person, N.K., Adcock, A.B., Eck, R.N.V., Jackson, G.T., Marineau, J.C., 2002. Etiquette and efficacy in animated pedagogical agents: the role of stereotypes. In: Paper Presented at the AAAI Symposium on Personalized Agents, Cape Cod, MA.
  60. Murnen, 2000, The experience of sexual harassment among grade-school students: early socialization of female subordination?, Sex Roles, 43, 1, 10.1023/A:1007007727370 · DOI
  61. Niculescu, A., Hofs, D., Dijk, B.V., Nijholt, A., 2010. How the agent’s gender influence users’ evaluation of a QA system. In: Paper Presented at the 2010 International Conference on User Science Engineering, Malaysia. · DOI
  62. Nowak, 2006, The influence of the avatar on online perceptions of anthropomorphism, androgyny, credibility, homophily, and attraction, Journal of Computer-Mediated Communication, 11, 153, 10.1111/j.1083-6101.2006.tb00308.x · DOI · Paper page
  63. O’Sullivan, 1998, Feigning sexual desire: consenting to unwanted sexual activity in heterosexual dating relation ships, Journal of Sex Research, 35, 234, 10.1080/00224499809551938 · DOI · Paper page
  64. Oviatt, 1995, Predicting spoken disfluencies during human–computer interaction, Computer Speech and Language, 9, 19, 10.1006/csla.1995.0002 · DOI · Paper page
  65. Pelachaud, 2009, Modelling multimodal expression of emotion in a virtual agent, Philosophical Transactions of Royal Society Biological Science (B), 3539, 10.1098/rstb.2009.0186 · DOI · Paper page
  66. Pennebaker, 1992, Putting stress into words: The impact of writing on physiological, absentee, and self-reported emotional well-being measures, American Journal of Health Promotion, 6, 280, 10.4278/0890-1171-6.4.280 · DOI · Paper page
  67. Postmes, 1998, Breaching or building social boundaries? SIDE-effects of computer-mediated communication, Communication Research, 26, 689, 10.1177/009365098025006006 · DOI · Paper page
  68. Powell, 1986, Effects of sex role identity and sex on definitions of sexual harassment, Sex Roles, 14, 9, 10.1007/BF00287844 · DOI
  69. Reilly, 1986, Sexual harassment of university students, Sex Roles, 15, 333, 10.1007/BF00287976 · DOI · Paper page
  70. Rickenberg, R., Reeves, B., 2000. The effects of animated characters on anxiety, task performance, and evaluations of user interfaces. In: Paper Presented at the Proceedings of the CHI 2000 Conference on Human Factors in Computing Systems, Hague, Netherlands. · DOI · Paper page
  71. Roter, 2002, Physician gender effects in medical communication: a meta-analytic review, Journal of the American Medical Association, 288, 756, 10.1001/jama.288.6.756 · DOI · Paper page
  72. Sengers, P., MacCarthy, J., Dourish, P., 2006. Reflective HCI: articulating an agenda for critical practice. In: Paper Presented at the CHI ‘06, Quebec, Canada. · DOI
  73. Steckler, 1985, Sex differences in nonverbal and verbal communication with bosses, peers, and subordinates, Journal of Applied Psychology, 70, 157, 10.1037/0021-9010.70.1.157 · DOI
  74. Stevenage, 1999, Model applicants: the effect of facial appearance on recruitment decisions, British Journal of Psychology, 90, 221, 10.1348/000712699161369 · DOI · Paper page
  75. Struckman-Johnson, 2003, Tactics of sexual coercion: when men and women won’t take no for an answer, Journal of Sex Research, 40, 76, 10.1080/00224490309552168 · DOI · Paper page
  76. Thimbleby, 2008, Robot ethics? Not yet. A reflection on Whitby’s “sometimes its hard to be a robot”, Interacting with Computers, 20, 338, 10.1016/j.intcom.2008.02.006 · doi:10.1016/j.intcom.2008.02.006
  77. Timmerman, 2003, Sexual harassment of adolescents perpetuated by teachers and by peers: an exploration of the dynamics of power, culture, and gender in secondary schools, Sex Roles, 48, 231, 10.1023/A:1022821320739 · DOI
  78. Veletsianos, 2008, When sex, drugs, and violence enter the classroom: conversations between adolescents and a female pedagogical agent, Interacting with Computers, 20, 292, 10.1016/j.intcom.2008.02.007 · DOI
  79. Welle, B., Heilman, M.E., 2007. Formal and informal discrimination against women at work: the role of gender stereotypes. In: Gilliland, S.W., Steiner, D.D., Skarlicki, D.P. (Eds.), Managing Social and Ethical Issues in Organizations (pp. 135–252). Information Age Publishing Inc.
  80. Whitby, 2008, Sometimes its hard to be a robot: a call for action on the ethics of abusing artificial agents, Interacting with Computers, 20, 326, 10.1016/j.intcom.2008.02.002 · DOI · Paper page
  81. Williams, 1975, The definition of sex stereotypes via the adjective check list, Sex Roles, 1, 327, 10.1007/BF00287224 · DOI · Paper page
  82. Williams, 1999, Pancultural gender stereotypes revisited: the five factor model, Sex Roles, 40, 513, 10.1023/A:1018831928829 · DOI
  83. Wilson, 1978, Helping behavior and physical attractiveness, Journal of Social Psychology, 104, 313, 10.1080/00224545.1978.9924081 · DOI
  84. Zdenek, 2003, Artificial intelligence as a discursive practice: the case of embodied software agent systems, AI & Society, 17, 340, 10.1007/s00146-003-0284-8 · DOI
  85. Zimbardo, P.G., 1969. The human choice: individuation, reason, and order vs. deindividuation, impulse, and chaos. In: Arnold, W.J., Levine, D. (Eds.), Nebraska Symposium on Motivation. University of Nebraska Press, Lincoln, pp. 237–307.

Cited by

See all 147

Metadata

Authors
Brahnam, S., & De Angeli, A.
Venue
Interacting with Computers
Published
2012-05
Volume
24
Issue
3
Pages
139-153
ISSN
0953-5438 (ISSN-L)
OpenAlex
W2011121091
Cited by
147
References
14
FWCI
1.88
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.