I hate you! Disinhibition with virtual partners
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
This paper presents a descriptive lexical analysis of spontaneous conversations between users and the 2005 Loebner prize winning chatterbot, Jabberwacky. The study was motivated in part by the suspicion that evidence in support of the Media Equation, especially in the field of conversational agents, was supported by incomplete data; too often omitted in its purview is the occurrence of unsavoury user responses. Our study shows that conversations with Jabberwacky often bring about the expression of negative verbal disinhibition. We discovered that 10% of the total stems in the corpus reflected abusive language, and approximately 11% of the sample addressed hard-core sex. Users were often rude and violated the conversation maxims of manner, quantity, and relevance. Also particularly pronounced in the conversations was a persistent need of the user to define the speakers’ identities (human vs. machine). Users were also curious to understand and test the cognitive capabilities of the chatterbot. Our analysis indicates that the Media Equation may need qualifying, that users treat computers that talk, less as they do people and more as they might treat something not quite an object yet not quite human.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Clark, H. H. (1996) · doi:10.1017/cbo9780511620539 · Cited by 5,123
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 2×
“The chatterbot's basic mechanism for generating automatic conversation, however, is much older, dating back to Weizenbaum (1966).”
BackgroundMethodRelational agents: a model and implementation of building user trust
Bickmore, T., & Cassell, J. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365304 · Cited by 479
Sproull, L., Subramani, M., Kiesler, S., Walker, J., & Waters, K. (1996) · Human-Computer Interaction · doi:10.1207/s15327051hci1102_1 · Cited by 399 · cited 1×
“There are studies, for example, that show people negatively stereotyping computers once they are endowed with a voice (Reeves and Nass, 1996) or a face (Sproull et al., 1996).”
Background
Research works printed but not linked: 11
- De Angeli, A., Brahnam, S., Wallis, P., 2005. ABUSE: The dark side of human-computer interaction. In: Buono, P., Costabile, M.F., Paterno, F., Santoro, C. (Eds.), Interact Adjunct Proceedings. Rome, pp. 91–92.
- De Angeli, A., Brahnam, S., P. Wallis, Dix, A., 2006. Misuse and abuse of interactive technologies. In: CHI ‘06 Extended Abstracts on Human Factors in Computing Systems. Montreal, April 22, pp. 1647–1650. · DOI
- L’abbate, M., Thiel, U., Kamps, T., 2005. Can proactive behavior turn chatterbots into conversational agents? In: IEEE/WIC/ACM International Conference on Intelligent Agent Technology, pp. 173–179. · DOI
- Mauldin, M.L., 1994. Chatterbots, tinymuds, and the turing test: Entering the Loebner prize competition. In: Proceedings of AAAI ‘94 Conference, Seattle.
- Foner, L.N., 1997. Entertaining agents: A sociological case study, in: Proceedings of the First International Conference On Autonomous Agents (Agents’97), Marina del Rey, CA, pp. 122-129. · DOI
- Zdenek, S., 2003. Artificial Intelligence as a Discursive Practice: The Case of Embodied Software Agent Systems. AI & Society, vol. 17. pp. 340–363. · DOI
- Colby, 1971, Artificial Paranoia, Artificial Intelligence, 2, 1, 10.1016/0004-3702(71)90002-6 · DOI · Paper page
- De Angeli, A., Lynch, P., Johnson, G.I., 2001a. Personifying the e-market: A framework for social agents. In: Hirose, M. (Ed.) Interact’01, Tokyo Japan, 9–13 July, pp. 198–205.
- Brahnam, S., 2005. Notes on developing strategies for handling customer abuse of ECAs. In: Proceedings of Interact05 Workshop On Abuse: The Darker Side of Human-Computer Interaction, Rome, Italy, pp. 62–67.
- De Angeli, A., Johnson, G.I., Coventry, L., 2001b. The unfriendly user: Exploring social reactions to chatterbots. In: Helander, M.G., Khalid, H.M. & Ming Po, T. (Eds.), International Conference on Affective Human Factor Design, Singapore, 27–29 June, pp. 467–474.
- Brahnam, S., 2006. Gendered bods and bot abuse. In: Proceedings of CHI06 Workshop On the Misuse and Abuse of Interactive Technologies, Montréal, Québec, Canada, pp. 13–17, www.agentsabuse.org. (Last accessed September 2007).
Cited by
Interacting with educational chatbots: A systematic review
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11177-3 · Cited by 841
Unleashing the Potential of Chatbots in Education: A State-Of-The-Art Analysis
Winkler, R., & Soellner, M. (2018) · Academy of Management Proceedings · doi:10.5465/ambpp.2018.15903abstract · Cited by 581
The Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities
Floridi, L. (2023) · doi:10.1093/oso/9780198883098.001.0001 · Cited by 507
Artificial Intelligence Crime: An Interdisciplinary Analysis of Foreseeable Threats and Solutions
King, T. C., Aggarwal, N., Taddeo, M., & Floridi, L. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-018-00081-0 · Cited by 271
“Social bots can support the promotion of sexual offences, and De Angeli (2009, 4) points out that verbal abuse and sexual conversations were found to be common elements of anonymous interaction with conversational agents (De Angeli and Brahnam 2008; Rehm 2008; Veletsianos et al. 2008).”
BackgroundZhang, R., Li, H., Meng, H., Zhan, J., Gan, H., & Lee, Y.-C. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713429 · Cited by 123
“Previous research has shown abusive language and behavior towards robots and chatbots [21, 68], raising concerns about AI abuse and mistreatment.”
Bot-Adversarial Dialogue for Safe Conversational Agents
Xu, J., Ju, D., Li, M., Boureau, Y.-L., Weston, J., & Dinan, E. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.235 · Cited by 64
“De Angeli and Carpenter (2005); De Angeli and Brahnam (2008) suggest that one in ten human-bot conversations may contain instances of the human demonstrating unprovoked abusive behavior towards the chatbot.”
BackgroundAnticipating Safety Issues in E2E Conversational AI: Framework and Tooling
Dinan, E., Abercrombie, G., Bergman, A. S., Spruit, S., Hovy, D., Boureau, Y.-L., & Rieser, V. (2021) · arXiv · doi:10.48550/arxiv.2107.03451 · Cited by 44
“Non-adversarial unsafe setting: Past research suggests that one in ten human-bot conversations may contain abusive behavior on the part of the human (De Angeli & Carpenter, 2005; De Angeli & Brahnam, 2008).”
BackgroundSafetyKit: First Aid for Measuring Safety in Open-domain Conversational Systems
Dinan, E., Abercrombie, G., Bergman, A., Spruit, S., Hovy, D., Boureau, Y.-L., & Rieser, V. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.284 · Cited by 32
Artificial Intelligence Crime: An Interdisciplinary Analysis of Foreseeable Threats and Solutions
King, T., Aggarwal, N., Taddeo, M., & Floridi, L. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3183238 · Cited by 17
Metadata
- Authors
- Angeli, A. D., & Brahnam, S.
- Venue
- Interacting with Computers
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-05
- Volume
- 20
- Issue
- 3
- Pages
- 302-310
- ISSN
- 0953-5438 (ISSN-L)
- OpenAlex
- W2101900802
- Cited by
- 140
- References
- 4
- FWCI
- 8.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.