Judgment of the Humanness of an Interlocutor Is in the Eye of the Beholder
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Despite tremendous advances in artificial language synthesis, no machine has so far succeeded in deceiving a human. Most research focused on analyzing the behavior of "good" machine. We here choose an opposite strategy, by analyzing the behavior of "bad" humans, i.e., humans perceived as machine. The Loebner Prize in Artificial Intelligence features humans and artificial agents trying to convince judges on their humanness via computer-mediated communication. Using this setting as a model, we investigated here whether the linguistic behavior of human subjects perceived as non-human would enable us to identify some of the core parameters involved in the judgment of an agents' humanness. We analyzed descriptive and semantic aspects of dialogues in which subjects succeeded or failed to convince judges of their humanness. Using cognitive and emotional dimensions in a global behavioral characterization, we demonstrate important differences in the patterns of behavioral expressiveness of the judges whether they perceived their interlocutor as being human or machine. Furthermore, the indicators of interest displayed by the judges were predictive of the final judgment of humanness. Thus, we show that the judgment of an interlocutor's humanness during a social interaction depends not only on his behavior, but also on the judge himself. Our results thus demonstrate that the judgment of humanness is in the eye of the beholder.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774 · cited 1×
“LIWC’ validity of measure has been demonstrated for emotional expression presented in text [21] and for detecting attention focus, thinking style, emotionality, social relationships, and individual differences [22].”
BackgroundELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
The Development and Psychometric Properties of LIWC2015
Pennebaker, J. W., Boyd, R. L., Jordan, K., & Blackburn, K. (2015) · University of Texas at Austin · doi:10.15781/t25p41 · Cited by 1,674
Accommodation theory: Communication, context, and consequence
Giles, H., Coupland, N., & Coupland, J. (1991) · Contexts of Accommodation · doi:10.1017/cbo9780511663673.001 · Cited by 1,442
Socially intelligent robots: Dimensions of human-robot interaction
Dautenhahn, K. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2006.2004 · Cited by 1,210 · cited 2×
“As the use of the Internet and virtual reality applications is largely spreading into everyday situations, the need for human-like autonomous agents is rapidly growing [1,2].”
BackgroundWalther, J. B. (2007) · Computers in Human Behavior · doi:10.1016/j.chb.2006.05.002 · Cited by 915 · cited 2×
“In addition, language complexity in computer-mediated communication has been related with immediacy, and perceived as an indicator of care [29].”
BackgroundAre Machines Gender Neutral? Gender‐Stereotypic Responses to Computers With Voices
Nass, C., Moon, Y., & Green, N. (1997) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1997.tb00275.x · Cited by 670
Bailenson (2005) · doi:10.1111/j.1467-9280.2005.01619.x · Cited by 549
Pfeil, U., Arjan, R., & Zaphiris, P. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.08.015 · Cited by 534
Cited by
Hill, J., Randolph Ford, W., & Farreras, I. G. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.02.026 · Cited by 856
“…evaluating users’ attribution of human qualities or personality traits to the chatbots they converse with, and how that may lead to greater disclosure in medical, research, or therapeutic settings (Hasler, Tuchman, & Friedman, 2013; Holtgraves, Ross, Weywadt, & Han, 2007; Lortie & Guitton, 2011).”
BackgroundMethodResultInfluentialA Taxonomy of Social Cues for Conversational Agents
Feine, J., Gnewuch, U., Morana, S., & Maedche, A. (2019) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2019.07.009 · Cited by 567
Bendig, E., Erb, B., Schulze-Thuesing, L., & Baumeister, H. (2022) · Verhaltenstherapie · doi:10.1159/000501812 · Cited by 214
“…chatbots also use knowledge bases or models of machine learning to construct their dialogues and AI to generate possible answers and to enhance the conversational proficiency of the bot (often called mental capacities in the research literature) [Lortie and Guitton, 2011; Ireland et al., 2016].”
BackgroundWang, Q., Saha, K., Gregori, E., Joyner, D., & Goel, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445645 · Cited by 120
“Contrary to prior research and popular belief [28, 45, 60], our fndings suggest that students who used more number of unique words per post or more complex language tended to perceive JW as less human-like, less intelligent, and less likeable.”
BackgroundResultIs chatting with a sophisticated chatbot as good as chatting online or FTF with a stranger?
Drouin, M., Sprecher, S., Nicola, R., & Perkins, T. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107100 · Cited by 75
Metadata
- Authors
- Lortie, C. L., & Guitton, M. J.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-09-22
- Volume
- 6
- Issue
- 9
- Pages
- e25085
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2083365005
- Cited by
- 47
- References
- 15
- FWCI
- 0.84
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Judgment of the Humanness of an Interlocutor Is in the Eye of the Beholder. https://app.cochat.ai/papers/10.1371/journal.pone.0025085
- The paper
- Lortie, C. L., & Guitton, M. J. (2011). Judgment of the Humanness of an Interlocutor Is in the Eye of the Beholder. PLoS ONE. https://doi.org/10.1371/journal.pone.0025085
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.