Cited by 572Social Robot Interaction and HRIAI in Service InteractionsSpeech and dialogue systems

How Should My Chatbot Interact? A Survey on Social Characteristics in Human–Chatbot Interaction Design

Open access
Chaves, Ana Paula, Gerosa, Marco Aurelio·2021·International Journal of Human–Computer Interaction

Abstract

Chatbots’ growing popularity has brought new challenges to HCI, having changed the patterns of human interactions with computers. The increasing need to approximate conversational interaction styles raises expectations for chatbots to present social behaviors that are habitual in human–human communication. In this survey, we argue that chatbots should be enriched with social characteristics that cohere with users’ expectations, ultimately avoiding frustration and dissatisfaction. We bring together the literature on disembodied, text-based chatbots to derive a conceptual model of social characteristics for chatbots. We analyzed 56 papers from various domains to understand how social characteristics can benefit human–chatbot interactions and identify the challenges and strategies to designing them. Additionally, we discussed how characteristics may influence one another. Our results provide relevant opportunities to both researchers and designers to advance human–chatbot interactions.

Verified 2026-10-09 · 1 reference not checked yet

AI snapshot

Written from the paper’s full text.

TL;DR

This survey analyzes 56 studies on disembodied, text-based chatbots to derive a conceptual model of 11 social characteristics grouped into conversational intelligence, social intelligence, and personification. It maps reported benefits, challenges, and strategies for each characteristic and proposes 22 interrelationship propositions to guide chatbot design and future research.

Key findings

  • The review derived 11 social characteristics: proactivity (18 studies), conscientiousness (11), communicability (6), damage control (12), thoroughness (13), manners (10), moral agency (6), emotional intelligence (14), personalization (11), identity (16), and personality (12).
  • These characteristics are grouped into three categories: conversational intelligence, social intelligence, and personification; the paper reports benefits such as increasing human-likeness, believability, engagement, and interpersonal relationships, alongside challenges such as timing, privacy, emotional regulation, and stereotyping.
  • The survey states 22 propositions about how characteristics influence one another, e.g., proactivity influences perceived personality and conscientiousness, and identity influences moral agency.
  • Most surveyed papers focus on task-oriented chatbots (59%), while general-purpose chatbots account for 33%; education is the most representative specific domain with 9 papers, followed by customer services with 5 papers.

Methods

  • Literature survey using Google Scholar with a search string covering synonyms such as chatbots, chatterbots, conversational agents, conversational interfaces, dialogue systems, and digital assistants; studies on embodiment, speech input, social bots, and personal assistants were excluded.
  • Screening started with about one thousand papers, reduced to 464, then 104, and finally 56 studies after title, abstract, and full-text review; the dataset of included and excluded studies is available in Chaves and Gerosa (2019).
  • Analysis used a qualitative coding process inspired by Grounded Theory: one researcher selected relevant statements and labeled them as characteristics, a second researcher reviewed the set, and both discussed merging, renaming, or removing characteristics; quotes were then labeled as benefits, challenges, or strategies.

Limitations

  • The paper states it focused on disembodied, text-based chatbots, excluding embodied and speech-based conversational agents, which may underrepresent domains such as Ambient Intelligence and Software Engineering.
  • The paper states the definition of chatbot is not consolidated, so some studies with relevant social aspects may not have been found despite using several synonyms and Google Scholar.
  • The paper states the conceptual model was derived through qualitative coding and relies on researchers’ subjective assessment, mitigated by in-person consensus discussions; it also notes that most surveyed results are exploratory and that strategies for moral agency and thoroughness were not identified.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1080/10447318.2020.1841438

Cites

115 of 116 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 425 cited sources checked · 0 supported · 0 flagged

  • Findingown data
    § 2. Overview of the surveyed literature

    Among studies that adopted real chatbots, 18 studies analyze logs of conversations or users' perceptions of third-party chatbots such as Cleverbot, Talkbot, and Woebot.

    “among them, 18 studies analyze logs of conversations or users' perceptions of third-party chatbots such as Cleverbot (e.g., Corti and Gillespie (2016)), Talkbot (e.g., Brahnam and De Angeli (2012)), and Woebot K. K. Fitzpatrick et al. (2017).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Corti and Gillespie (2016)

      Not checked in the free run.

    • cites Brahnam and De Angeli (2012)

      Not checked in the free run.

    • cites K. K. Fitzpatrick et al. (2017)

      Not checked in the free run.

  • Findingown data
    § 1. Introduction

    From an analysis of 56 scientific studies, the survey derives a conceptual model of social characteristics.

    “From our analysis of 56 scientific studies, we derive a conceptual model of social characteristics, aiming to help researchers and designers identify the subset of characteristics that are relevant to their context and how adopting-or neglecting-a particular characteristic may influence the way humans perceive the chatbots.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: A lack of studies brings together the social characteristics that influence the way users perceive and behave toward chatbots.
  • Findingown data
    § 2. Overview of the surveyed literature

    Most papers (59%) focus on task-oriented chatbots.

    “Most papers (59%) focus on task-oriented chatbots.”
    Quote in the paperNot a substantial claim
  • Findingown data
    § 3.1.1. Proactivity

    The survey found 18 papers that report either chatbots with proactive behavior or implications of manifesting a proactive behavior.

    “In this survey, we found 18 papers that report either chatbots with proactive behavior or implications of manifesting a proactive behavior.”
    Quote in the paperNot a substantial claim
  • Findingown data
    § 3.1.1. Proactivity

    Proactivity was mostly investigated in open domain and education chatbots (four studies each).

    “Proactivity was mostly investigated in open domain and education chatbots (four studies each).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. 213
  • May combine two claims. 108
  • The quote only partly states this claim. 2
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data
    § 2. Overview of the surveyed literature

    The most representative specific domain is education, with 9 papers, followed by customer services, with 5 papers.

    “The most representative specific domain is education, with 9 papers, followed by customer services, with 5 papers.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 2. Overview of the surveyed literature

    Most surveyed studies adopted real chatbots (35 out of 56).

    “Most surveyed studies adopted real chatbots (35 out of 56);”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 2. Overview of the surveyed literature

    Most of the selected studies are recent publications (less than 10 years old).

    “Most of the selected studies are recent publications (less than 10 years old).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given
    § 1. Introduction

    The survey stated 22 propositions about how social characteristics may influence one another.

    “We stated 22 propositions about how social characteristics may influence one another.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 2. Overview of the surveyed literature

    General purpose chatbots reflect 33% of the surveyed studies.

    “General purpose chatbots reflect 33% of the surveyed studies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data
    § 2. Overview of the surveyed literature

    The publication venues include human-computer interactions (25 papers), learning and education (8 papers), information and interactive systems (8 papers), virtual agents (5 papers), artificial intelligence (3 papers), and natural language processing (2 papers).

    “The publication venues include the domains of human-computer interactions (25 papers), learning and education (8 papers), information and interactive systems (8 papers), virtual agents (5 papers), artificial intelligence (3 papers), and natural language processing (2 papers).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 2. Overview of the surveyed literature

    Most general purpose chatbots (16 out of 19) are designed to handle topic-unrestricted conversations.

    “Most general purpose chatbots (16 out of 19) are designed to handle topic-unrestricted conversations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data
    § 3.1. Conversational Intelligence

    Only five studies applied only quantitative methods, while seven focused on qualitative methods.

    “Only five studies applied only quantitative methods, while seven focused on qualitative methods.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given
    § 3. Chatbots Social Characteristics

    Social intelligence focuses on habitual social protocols.

    “Social intelligence focuses on habitual social protocols, while personification refers to the chatbot's perceived identity and personality representations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given
    § 3. Chatbots Social Characteristics

    Personification refers to the chatbot's perceived identity and personality representations.

    “Social intelligence focuses on habitual social protocols, while personification refers to the chatbot's perceived identity and personality representations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given
    § 3.1. Conversational Intelligence

    The questionnaires are mostly Likert-scales, and some of them include subjective feedback.

    “The questionnaires are mostly Likert-scales, and some of them include subjective feedback.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingnone given
    § 3.1. Conversational Intelligence

    The social characteristics related to conversational intelligence are proactivity (18 studies), conscientiousness (11 studies), and communicability (6 studies).

    “In this section, we discuss social characteristics related to conversational intelligence , namely: proactivity (18 studies), conscientiousness (11 studies), and communicability (6 studies).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingcitation
    § 3.1.1. Proactivity

    In most of the studies, proactivity emerged either as an exploratory result, mostly from post-intervention interviews and user's feedback, or as a strategy to attend to domain-specific requirements.

    “In most of the studies, however, proactivity emerged either as an exploratory result, mostly from post-intervention interviews and user's feedback (Duijvelshoff, 2017; Jain, Kumar, et al., 2018; Morrissey & Kirakowski, 2013; Portela & Granell-Canut, 2017; Shum et al., 2018; Thies et al., 2017), or as a strategy to attend to domain-specific requirements (e.g., monitoring, and guidance) (K. K. Fitzp”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Duijvelshoff, 2017

      Not checked in the free run.

    • cites Jain, Kumar, et al., 2018

      Not checked in the free run.

    • cites Morrissey & Kirakowski, 2013

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Findingnone given
    § 2. Overview of the surveyed literature

    For each characteristic, the paper points out the benefits, challenges, and strategies of implementing the characteristic in chatbots as reported in the literature.

    “For each characteristic, we point out the benefits, challenges, and strategies of implementing the characteristic in chatbots as reported in the literature.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingnone given
    § 3.1.1. Proactivity

    In task-oriented domains, some characteristics are largely influenced by the topic (e.g., Moral agency and Personality), while others are more generally applied (e.g., Manners and Damage control).

    “In he task-oriented domains, some characteristics are largely influenced by the topic (e.g., Moral agency and Personality ), while others are more generally applied (e.g., Manners and Damage control ).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data
    § 2. Overview of the surveyed literature

    When a chatbot was simulated (11 studies), Wizard of Oz (WoZ) is the most used technique (9 studies).

    “When a chatbot was simulated (11 studies), Wizard of Oz (WoZ) is the most used technique (9 studies).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 2. Overview of the surveyed literature

    Eight studies do not address a particular chatbot.

    “Eight studies do not address a particular chatbot.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given
    § 3.1. Conversational Intelligence

    Most studies analyzed the interaction with real chatbots, although Wizard of Oz (WoZ) settings are also common.

    “Most studies analyzed the interaction with real chatbots, although Wizard of Oz (WoZ) settings are also common.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation
    § 3.1. Conversational Intelligence

    Only two papers did not evaluate a particular type of interaction because they were based on a literature review and surveys with chatbot users in general.

    “Only two papers did not evaluate a particular type of interaction because they were based on a literature review (Gnewuch et al., 2017) and surveys with chatbot users in general (Brandtzaeg & Følstad, 2017).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Gnewuch et al., 2017

      Not checked in the free run.

    • cites Brandtzaeg & Følstad, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 2. Overview of the surveyed literature

    Nine studies introduce a self-developed architecture and/or dialogue management.

    “Nine studies introduce a selfdeveloped architecture and/or dialogue management (e.g. Dohsaka, Asai, Higashinaka, Minami, and Maeda (2014); Kumar, Ai, Beuth, and Ros´ e (2010)).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Dohsaka et al. (2014)

      Not checked in the free run.

    • cites Kumar et al. (2010)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning
    § 3.1. Conversational Intelligence

    The majority of the studies (15) applied mixed methods (both quantitative and qualitative).

    “The majority of the studies (15) applied mixed methods (both quantitative and qualitative).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation
    § 2. Overview of the surveyed literature

    In another nine studies, the chatbots were designed for research purposes using third-party platforms for chatbot development and deployment, such as IBM's Watson service and Microsoft's Bot Framework as well as pattern-matching packages such as Artificial Intelligence Markup Language (AIML).

    “In another nine studies, the chatbots were designed for research purposes using third-party platforms for chatbot development and deployment, such as IBM's Watson service (e.g., Q. V. Liao et al. (2018)) and Microsoft's Bot Framework (Toxtli et al., 2018) as well as patternmatching packages such as Artificial Intelligence Markup Language (AIML) (Silvervarg & J¨ onsson, 2013).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Q. V. Liao et al. (2018)

      Not checked in the free run.

    • cites Toxtli et al., 2018

      Not checked in the free run.

    • cites Silvervarg & Jönsson, 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given
    § 3. Chatbots Social Characteristics

    The category conversational intelligence includes characteristics that help the chatbot manage interactions.

    “As Table 1 depicts, the category conversational intelligence includes characteristics that help the chatbot manage interactions.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 2. Overview of the surveyed literature

    The survey derived a total of 11 social characteristics and grouped them into three categories: conversational intelligence, social intelligence, and personification.

    “We derived a total of 11 social characteristics, and grouped them into three categories, as depicted in Table 1: conversational intelligence , social intelligence , and personification .”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given
    § 3. Chatbots Social Characteristics

    The supplementary materials highlight five constructs that can be used to assess whether social characteristics reach the intended design goals.

    “Finally, the supplementary materials also highlight five constructs that can be used to assess whether social characteristics reach the intended design goals.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 3. Chatbots Social Characteristics

    The social characteristics were also grouped based on the domain in which they were investigated.

    “We also grouped the social characteristics based on the domain in which they were investigated (Table 2).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning
    § 3.1.3. Communicability

    We did not identify studies on open domain chatbots that report on communicability, since in open domain interactions users are free to talk about varying topics and guidance is less a concern.

    “We did not identify studies on open domain chatbots that report on communicability , since in open domain interactions users are free to talk about varying topics and guidance is less a concern.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 3.2. Social Intelligence

    16 studies reported both qualitative and quantitative results.

    “16 studies reported both qualitative and quantitative results.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data
    § 3.2. Social Intelligence

    Regarding adopted research methods, 12 studies applied qualitative methods and 10 focused on quantitative methods.

    “Regarding the adopted research methods, 12 studies applied qualitative methods and 10 focuses on quantitative methods.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 3.2.1. Damage control

    Damage control was mostly investigated for open domain (two studies) and customer service chatbots (three studies).

    “Damage control was mostly investigated for open domain (two studies) and customer service chatbots (three studies).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 3.2.5. Emotional Intelligence

    Only three papers highlighted emotional intelligence as an exploratory outcome, where needs emerged from participants' subjective feedback and post-intervention surveys.

    “Only three papers highlighted emotional intelligence as an exploratory outcome (Jenkins et al., 2007; Thies et al., 2017; Zamora, 2017), where needs for emotional intelligence emerged from participants' subjective feedback and post-intervention surveys.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Jenkins et al., 2007

      Not checked in the free run.

    • cites Thies et al., 2017

      Not checked in the free run.

    • cites Zamora, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Findingnone given
    § 3.2.5. Emotional Intelligence

    The literature shows that emotional intelligence is widely investigated, with particular interest from education and mental health care domains.

    “The literature shows that emotional intelligence is widely investigated, with particular interest from education and mental health care domains.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given
    § 3.3.1. Identity

    Chatbots may have anthropomorphic, zoomorphic, or robotic representations.

    “Additionally, chatbots may have anthropomorphic, zoomorphic, or robotic representations.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Findingreasoning
    § actions:

    The social intelligence category includes characteristics that help a chatbot manifest adequate social behavior, by managing conflicts, using appropriate language, displaying manners and moral agency, sharing emotions, and handling personalized interactions.

    “In summary, the social intelligence category includes characteristics that help a chatbot to manifest an adequate social behavior, by managing conflicts, using appropriate language, displaying manners and moral agency , sharing emotions, and handling personalized interactions.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § 3.3.1. Identity

    The survey found 16 studies that discuss identity issues, ten of which include identity as part of their main investigation.

    “We found 16 studies that discuss identity issues, ten of which include identity as part of their main investigation (Araujo, 2018; Candello et al., 2017; Ciechanowski et al., 2018; Corti & Gillespie, 2016; De Angeli & Brahnam, 2006; De Angeli, Johnson, & Coventry, 2001; Jenkins et al., 2007; Q. V. Liao et al., 2018; Marino, 2014; Schlesinger et al., 2018).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Araujo, 2018

      Not checked in the free run.

    • cites Candello et al., 2017

      Not checked in the free run.

    • cites Ciechanowski et al., 2018

      Not checked in the free run.

  • May combine two claims.

    Findingown data
    § 3.3. Personification

    Six studies applied quantitative methods, whereas the majority reported qualitative (10) or mixed (11) methods.

    “Six studies applied quantitative methods, whereas the majority reported qualitative (10) or mixed (11) methods.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given
    § 3.3.1. Identity

    Other domains include race-talk, education, and gaming.

    “Other domains include race-talk, education, and gaming.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation
    § 3.3.1. Identity

    In two studies, authors argue for impact of identity on interaction based on literature.

    “In two studies, the authors argue for the impact of identity on the interaction based on the literature (Brandtzaeg & Følstad, 2018; Gnewuch et al., 2017).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Brandtzaeg & Følstad, 2018

      Not checked in the free run.

    • cites Gnewuch et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation
    § 3.3.1. Identity

    Some authors include identity aspects in the definition of personality.

    “Some authors include identity aspects in the definition of personality (see, e.g., Shum et al. (2018)).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Shum et al. (2018)

      Not checked in the free run.

  • May combine two claims.

    Findingreasoning
    § actions:

    The benefits relate to resolving social positioning and recovering from failures, as well as increasing believability, human-likeness, engagement, and rapport.

    “The benefits relate to resolving social positioning and recovering from failures, as well as increasing believability, human-likeness, engagement, and rapport.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 3.3. Personification

    In this category, the survey found several studies where part of the main investigation relates to social characteristics.

    “In this category, we found several studies where part of the main investigation relates to the social characteristics.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given
    § 3.3.1. Identity

    Aspects that convey chatbots' identity include gender, age, language style, and name.

    “Aspects that convey the chatbots' identity include gender, age, language style, and name.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § 3.3. Personification

    The survey divided social characteristics that reflect personification into identity (16 papers) and personality (12 papers).

    “In this section, we divided the social characteristics that reflect personification into identity (16 papers) and personality (12 papers).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 7. Conclusion

    Some characteristics are largely influenced by the domain (e.g., moral agency and communicability), while others are more generally applied (e.g., manners and damage control).

    “We showed that some characteristics are largely influenced by the domain (e.g., moral agency and communicability ), while others are more generally applied (e.g., manners and damage control ).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning
    § 4.2. The importance of conversational context

    Personalization mostly co-occurs with proactivity.

    “Noticeably, personalization mostly co-occurs with proactivity, since users expects proactive messages to be relevant to their particular interactional context.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § 4.2. The importance of conversational context

    Moral agency was reported only in race-talk, and open domain.

    “It was reported only in race-talk, and open domain.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning
    § 2. Overview of the surveyed literature

    The survey decided not to include terms that relate to social characteristics/traits, because most studies do not explicitly label their results as such.

    “We decided to not include terms that relate to social characteristics/traits, because most studies do not explicitly label their results as such.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Most studies do not explicitly label their results as social characteristics/traits.
  • Classified as probably not a substantial claim.

    Premisecitation
    § 1. Introduction

    Making a conversational agent acceptable to users is primarily a social, not only technical, problem.

    “Neururer and colleagues (2018) state that making a conversational agent acceptable to users is primarily a social, not only technical, problem.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Neururer et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 1. Introduction

    Chatbots are changing the patterns of interactions between humans and computers.

    “Chatbots are changing the patterns of interactions between humans and computers (Følstad & Brandtzæg, 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Følstad & Brandtzæg, 2017

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductreasoning
    § 2. Overview of the surveyed literature

    The survey did not include 'personal assistants', since this term consistently refers to commercially available, voice-based assistants such as Google Assistant, Amazon's Alexa, Apple's Siri, and Microsoft's Cortana.

    “We did not include 'personal assistants' either, since this term consistently refers to commercially available, voice-based assistants such as Google Assistant, Amazon's Alexa, Apple's Siri, and Microsoft's Cortana.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation
    § 1. Introduction

    Most studies focus on a single or small set of characteristics; in other studies, the social characteristics emerged as secondary, exploratory results.

    “However, most studies focus on a single or small set of characteristics (e.g., Mairesse and Walker (2009); Schlesinger, O'Hara, and Taylor (2018)); in other studies, the social characteristics emerged as secondary, exploratory results (e.g., Tallyn, Fried, Gianni, Isard, and Speed (2018); Toxtli, Cranshaw, et al. (2018)).”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Mairesse and Walker (2009)

      Not checked in the free run.

    • cites Schlesinger, O'Hara, and Taylor (2018)

      Not checked in the free run.

    • cites Tallyn et al. (2018)

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § 1. Introduction

    It has become difficult to find evidence regarding what characteristics are important for designing a particular chatbot, and what research opportunities exist in the field.

    “It has become difficult to find evidence regarding what characteristics are important for designing a particular chatbot, and what research opportunities exist in the field.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data
    § 2. Overview of the surveyed literature

    To find relevant studies, the survey used a search string that includes the synonyms 'chatbots, chatterbots, conversational agents, conversational interfaces, conversational systems, conversation systems, dialogue systems, digital assistants, intelligent assistants, conversational user interfaces, and conversational UI'.

    “to find relevant studies we used a search string that includes the synonyms 'chatbots, chatterbots, conversational agents, conversational interfaces, conversational systems, conversation systems, dialogue systems, digital assistants, intelligent assistants, conversational user interfaces, and conversational UI' .”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The literature presents no coherent definition of chatbots.
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given
    § 2. Overview of the surveyed literature

    After reading the full texts, papers that either did not highlight social characteristics or represented previous, ongoing research of another complete study from the same authors were removed.

    “After reading the full texts, we removed the papers that either did not highlight social characteristics or represented previous, ongoing research of another complete study from the same authors.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data
    § 2. Overview of the surveyed literature

    After filtering the search results, 56 studies remained.

    “After filtering the search results, we had 56 remaining studies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation
    § 2. Overview of the surveyed literature

    The datasets with all analyzed studies (original list of results and exclusions per round) are available in Chaves and Gerosa (2019).

    “The datasets with all analyzed studies (original list of results and exclusions per round) is available in Chaves and Gerosa (2019).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Chaves and Gerosa (2019)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data
    § 2. Overview of the surveyed literature

    The search started with a set of about one thousand papers.

    “We started with a set of about one thousand papers.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 1. Introduction

    Designing overly humanized agents results in uncanny feelings and increased expectations, which also negatively impacts the interaction.

    “In contrast, designing overly humanized agents results in uncanny feelings and increased expectations (Ciechanowski, Przegalinska, Magnuski, & Gloor, 2018; Gnewuch et al., 2017), which also negatively impacts the interaction.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Ciechanowski, Przegalinska, Magnuski, & Gloor, 2018

      Not checked in the free run.

    • cites Gnewuch et al., 2017

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductcitation
    § 2. Overview of the surveyed literature

    The search string did not include the term 'social bots', because it refers to chatbots that produce content for social networks such as Twitter.

    “The search string did not include the term 'social bots', because it refers to chatbots that produce content for social networks such as Twitter (Ferrara, Varol, Davis, Menczer, & Flammini, 2016).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Ferrara, Varol, Davis, Menczer, & Flammini, 2016

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation
    § 1. Introduction

    As chatbots are designed to interact with users in a way that mimics person-to-person conversations, new challenges in HCI arise.

    “As chatbots are designed to interact with users in a way that mimics person-to-person conversations, new challenges in HCI arise (Følstad & Brandtzæg, 2017; Nguyen & Sidorova, 2018).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Følstad & Brandtzæg, 2017

      Not checked in the free run.

    • cites Nguyen & Sidorova, 2018

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductown data
    § 2. Overview of the surveyed literature

    To find studies from a variety of domains (not only computing), the survey used Google Scholar to search for papers.

    “Additionally, to find studies from a variety of domains (not only computing), we used Google Scholar to search for papers.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data
    § 2. Overview of the surveyed literature

    The second round started with 464 studies.

    “We started the second round with 464 studies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given
    § 2. Overview of the surveyed literature

    In the second round, short/position papers, theses, book chapters, and documents published in non-scientific venues were excluded.

    “In this round, we excluded short/position papers, theses, book chapters, and documents published in non-scientific venues.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data
    § 2. Overview of the surveyed literature

    The third and last round started with 104 papers.

    “The third and last round started with 104 papers.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given
    § 2. Overview of the surveyed literature

    The survey explicitly left out studies that relate to embodiment ('ECA, multimodal, robots, eye-gaze, gesture') and speech input mode ('speech-based, speech-recognition, voice-based').

    “We explicitly left out studies that relate to embodiment ( 'ECA, multimodal, robots, eye-gaze, gesture' ), and speech input mode ( 'speech-based, speech-recognition, voice-based' ).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given
    § 2. Overview of the surveyed literature

    Papers for which full text was not available or written in a language other than English were removed.

    “We also removed papers for which full text was not available or written in a language other than English.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data
    § 2. Overview of the surveyed literature

    In the first round, the amount was reduced by about half based on the titles.

    “In the first round, we reduced this amount by about half based on the titles.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given
    § ABSTRACT

    Enriching chatbots with social characteristics that cohere with users' expectations avoids frustration and dissatisfaction.

    “In this survey, we argue that chatbots should be enriched with social characteristics that cohere with users' expectations, ultimately avoiding frustration and dissatisfaction.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The increasing need to approximate conversational interaction styles raises users' expectations that chatbots present social behaviors habitual in human-human communication.
  • Classified as probably not a substantial claim.

    Study design and conductnone given
    § 2. Overview of the surveyed literature

    Abstracts were read and all papers that focused on technical aspects rather than social ones were removed.

    “We also read the abstracts and removed all the papers that focused on technical aspects, rather than social ones.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductown data
    § 2. Overview of the surveyed literature

    After coding all the studies, a second researcher (the second author) reviewed the produced set of characteristics and both researchers participated in discussion sessions to identify characteristics that could be merged, renamed, or removed.

    “After coding all the studies, a second researcher (the second author) reviewed the produced set of characteristics and both researchers participated in discussion sessions to identify characteristics that could be merged, renamed, or removed.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data
    § 2. Overview of the surveyed literature

    At the end, the characteristics were grouped into categories depending on whether the characteristic relates to the chatbot's virtual representation, conversational behavior, or social protocols.

    “At the end, the characteristics were grouped into the categories, depending on whether the characteristic relates to the chatbot's virtual representation, conversational behavior, or social protocols.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation
    § 3.1.1. Proactivity

    Proactively suggesting and encouraging new topics have been shown useful to inspire users and keep the conversation alive.

    “proactively suggesting and encouraging new topics have been shown useful to both inspire users (Avula et al., 2018; Chaves & Gerosa, 2018) and keep the conversation alive (Silvervarg & J¨ onsson, 2013).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Avula et al., 2018

      Not checked in the free run.

    • cites Chaves & Gerosa, 2018

      Not checked in the free run.

    • cites Silvervarg & J¨ onsson, 2013

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductown data
    § 2. Overview of the surveyed literature

    The papers were analyzed by searching for chatbot behavior or attributed characteristics that influence the way users perceive it and behave toward it.

    “We analyzed the papers by searching for chatbot behavior or attributed characteristics that influence the way users perceive it and behave toward it.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given
    § 2. Overview of the surveyed literature

    These steps were performed by one researcher (the first author).

    “These steps were performed by one researcher (the first author).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given
    § 2. Overview of the surveyed literature

    Finally, the quotes for each characteristic were labeled as references to benefits, challenges, or strategies.

    “Finally, the quotes for each characteristic were labeled as references to benefits, challenges, or strategies.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data
    § 2. Overview of the surveyed literature

    For each study (document), relevant statements from the paper (quotes) were selected and labeled as a characteristic (code).

    “For each study ( document ), we selected relevant statements from the paper ( quotes ) and labeled them as a characteristic ( code ).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.1. Proactivity

    In human-chatbot conversations, a proactive behavior enables a chatbot to share initiative with the user, contributing to the conversation in a more natural way.

    “In human-chatbot conversations, a proactive behavior enables a chatbot to share initiative with the user, contributing to the conversation in a more natural way (Morrissey & Kirakowski, 2013).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Morrissey & Kirakowski, 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.2. Conscientiousness

    For complex tasks, to keep the conversation on track the user must be aware of the next steps or why something is happening.

    “The authors found that, for complex tasks, to keep the conversation on track the user must be aware of the next steps or why something is happening.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Duijst, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.2. Conscientiousness

    Comfortably conversing on any topic related to the service offering is a requirement for task-oriented chatbots.

    “based on the literature on customer support chatbots, Gnewuch et al. (2017) argue that comfortably conversing on any topic related to the service offering is a requirement for task-oriented chatbots.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gnewuch et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.1.2. Conscientiousness

    In task-oriented interactions, a chatbot should understand the purpose of the interaction and strive to conduct the conversation toward this goal in an efficient, productive way.

    “in taskoriented interactions, a chatbot should understand the purpose of the interaction and strive to conduct the conversation toward this goal in an efficient, productive way (Ayedoun et al., 2017; Duijst, 2017).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Ayedoun et al., 2017

      Not checked in the free run.

    • cites Duijst, 2017

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.1.2. Conscientiousness

    Most chatbots in the second language field cannot hold continuous conversations, since they are developed to answer the user's last input; therefore, they did not have the sense of topic, which resulted in instances of inappropriate response.

    “Coniam (2008) reviewed popular chatbots for practicing second languages. The author showed that most chatbots in this field cannot hold continuous conversations, since they are developed to answer the user's last input. Therefore, they did not have the sense of topic, which resulted in instances of inappropriate response.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Coniam, 2008

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.1.2. Conscientiousness

    Maintaining a theme is convincing, while failure to do so is unconvincing.

    “When evaluating the naturalness of a chatbot, Morrissey and Kirakowski (2013) found that maintaining a theme is convincing, while failure to do so is unconvincing.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Morrissey & Kirakowski, 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.2. Conscientiousness

    Productivity is the key motivating factor for using chatbots (68% of the participants mentioned it as the main reason for using chatbots).

    “Brandtzaeg and Følstad (2017) show that productivity is the key motivating factor for using chatbots (68% of the participants mentioned it as the main reason for using chatbots).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Brandtzaeg & Følstad, 2017

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § 3.1.2. Conscientiousness

    The chatbot's attentiveness to the interactional goal may not be evident to the user if the chatbot passively waits for the user to control the interaction; thus, conscientiousness relates to proactive ability.

    “the chatbot's attentiveness to the interactional goal may not be evident to the user if the chatbot passively waits for the user to control the interaction. Thus, conscientiousness relates to proactive ability, as discussed in Section 3.1.1.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 3.1.2. Conscientiousness

    As the complexity of tasks increases, more turns are required to achieve a goal; hence, more mistakes may be made.

    “as the complexity of tasks increases, more turns are required to achieve a goal; hence, more mistakes may be made. This argument was supported by both Duijst (2017) and Dyke et al. (2013)”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Duijst, 2017

      Not checked in the free run.

    • cites Dyke et al., 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.1.2. Conscientiousness

    Conscientiousness enables a chatbot to follow the conversational flow, show understanding of the context, and interpret each utterance as a meaningful part of the whole conversation.

    “It enables a chatbot to follow the conversational flow, show understanding of the context, and interpret each utterance as a meaningful part of the whole conversation (Morrissey & Kirakowski, 2013).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Morrissey & Kirakowski, 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.2. Conscientiousness

    A conversation with a chatbot should maintain a 'sense of continuity over time' to demonstrate that the chatbot is exerting effort to track the conversation.

    “a conversation with a chatbot should maintain a ' sense of continuity over time ' (Jain, Kumar, et al., 2018) to demonstrate that the chatbot is exerting effort to track the conversation.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jain, Kumar, et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning
    § 3.1.1. Proactivity

    Contextualized proactive interventions suggest that the chatbot should be attentive to the conversation, which conveys conscientiousness.

    “Contextualized proactive interventions also suggest that the chatbot should be attentive to the conversation, which conveys conscientiousness , as discussed in the next section.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 3.1.1. Proactivity

    Privacy concerns may result in under-motivated users, discomfort about disclosing information, and lack of engagement.

    “Privacy concerns may result in under-motivated users, discomfort about disclosing information, and lack of engagement (Duijvelshoff, 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Duijvelshoff, 2017

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.1.2. Conscientiousness

    When a chatbot does not interpret the meaning of users' utterances, users show frustration and the chatbot's credibility is compromised.

    “As shown by Duijst (2017), when a chatbot does not interpret the meaning of users' utterances, users show frustration and the chatbot's credibility is compromised.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Duijst, 2017

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.1.2. Conscientiousness

    Chatbots are designed to restrict free-text inputs from the user to ensure the conversational structure and to hide natural language limitations.

    “aiming to ensure the conversational structureand to hide natural language limitations-chatbots are designed to restrict free-text inputs from the user (Duijst, 2017; Jain, Kumar, et al., 2018; Tallyn et al., 2018).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Duijst, 2017

      Not checked in the free run.

    • cites Jain, Kumar, et al., 2018

      Not checked in the free run.

    • cites Tallyn et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.1.2. Conscientiousness

    The user and chatbot should be on the same page about the chatbot's contextual state, providing the users the opportunity to clarify possible misunderstandings.

    “In both cases, the user and chatbot should be on the same page about the chatbot's contextual state (Jain, Kota, et al., 2018), providing the users the opportunity to clarify possible misunderstandings (Gnewuch et al., 2017).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Jain, Kota, et al., 2018

      Not checked in the free run.

    • cites Gnewuch et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation
    § 3.1.2. Conscientiousness

    A chatbot should provide a way to inform the user of the current context, especially for complex tasks.

    “a chatbot should provide a way to inform the user of the current context, especially for complex tasks.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Jain, Kota, et al., 2018

      Not checked in the free run.

    • cites Gnewuch et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.1.1. Proactivity

    One surveyed paper proposes a chatbot that selects a topic randomly but also observes that the lack of context is a major problem of this approach.

    “One surveyed paper (Portela & Granell-Canut, 2017) proposes a chatbot that [S2] selects a topic randomly but also observes that the lack of context is a major problem of this approach.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Portela & Granell-Canut, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Premisecitation
    § 3.2. Social Intelligence

    Chatbots should be able to respond to social cues, accept differences, manage conflicts, be empathic, and demonstrate caring.

    “Chatbots should be able to respond to social cues during the conversation, accept differences, and manage conflicts (Salovey & Mayer, 1990) as well as be empathic and demonstrate caring (Bj¨ orkqvist et al., 2000)”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Salovey & Mayer, 1990

      Not checked in the free run.

    • cites Björkqvist et al., 2000

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.1.3. Communicability

    Providing communicability helps users to interpret the codes used by designers to convey the interactional possibilities embedded in the software, which improves system learnability.

    “Providing communicability helps users to interpret the codes used by designers to convey the interactional possibilities embedded in the software (De Souza, Prates, & Barbosa, 1999), which improves system learnability (Grossman, Fitzmaurice, & Attar, 2009).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites De Souza et al., 1999

      Not checked in the free run.

    • cites Grossman et al., 2009

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.1.3. Communicability

    When the chatbot is not able to answer the user, or when it notices that the user is silent, it may suggest available features to stimulate the user to engage.

    “when the chatbot is not able to answer the user, or when it notices that the user is silent, it may suggest available features to stimulate the user to engage (Jain, Kumar, et al., 2018; Val´ erio et al., 2017).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Jain, Kumar, et al., 2018

      Not checked in the free run.

    • cites Val´ erio et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.3. Communicability

    The problem around chatbots' communicability lies in the nature of the interface: instead of buttons, menus, and links, chatbots unveil their capabilities through conversational turns, one sentence at a time.

    “The problema around chatbots' communicability lies in the nature of the interface: instead of buttons, menus, and links, chatbots unveil their capabilities through conversational turns, one sentence at a time (Val´ erio et al., 2017)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Val´ erio et al., 2017

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.1.3. Communicability

    While interacting with chatbots, users may not know that a desired functionality is available or how to use it.

    “while interacting with chatbots, users may not know that a desired functionality is available or how to use it (Jain, Kumar, et al., 2018; Val´ erio et al., 2017).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Jain, Kumar, et al., 2018

      Not checked in the free run.

    • cites Val´ erio et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.3. Communicability

    System learnability is the most fundamental component for usability.

    “The literature on interactive systems has highlighted system learnability as the most fundamental component for usability (Grossman et al., 2009)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Grossman et al., 2009

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.3. Communicability

    Chatbots should recognize a 'help' input from the user, so it can provide instructions on how to proceed.

    “chatbots should recognize a 'help' input from the user, so it can provide instructions on how to proceed (Val´ erio et al., 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Val´ erio et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.1.2. Conscientiousness

    The workflow should be flexible enough to handle both multi-turn and one-turn question-answer interactions; it also should be unambiguous, such that users can efficiently achieve their goals.

    “Gnewuch et al. (2017) argue that the workflow should be flexible enough to handle both multi-turn and one-turn question-answer interactions; it also should be unambiguous, such that users can efficiently achieve their goals.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gnewuch et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.3. Communicability

    Interactive software is communicative by its nature, since users achieve their goals by exchanging messages with the system.

    “Interactive software is communicative by its nature, since users achieve their goals by exchanging messages with the system (Prates, de Souza, & Barbosa, 2000; Sundar, Bellur, Oh, Jia, & Kim, 2016).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Prates et al., 2000

      Not checked in the free run.

    • cites Sundar et al., 2016

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.3. Communicability

    Communicating chatbots' functionalities should be performed as much as possible within the chat interface.

    “communicating chatbots' functionalities should be performed as much as possible within the chat interface (Jain, Kumar, et al., 2018).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jain, Kumar, et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisereasoning
    § 3.2. Social Intelligence

    When developing chatbots, it is necessary to account for socially acceptable protocols for conversational interactions.

    “Hence, when developing chatbots, it is necessary to account for the socially acceptable protocols for conversational interactions (Walker, 2009; Wallis & Norling, 2005).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Walker, 2009

      Not checked in the free run.

    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.3. Communicability

    Chatbots should be able to answer ability-check questions.

    “results from (Q. V. Liao et al., 2018) show that chatbots should be able to answer ability-check questions (e.g., ' what can you do? ' or ' can you do [functionality]? ').”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Q. V. Liao et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.1.3. Communicability

    This inconsistency produces the user's feeling of misinterpreting the affordances, which has a negative impact on the system's learnability.

    “This inconsistency produces the user's feeling of misinterpreting the affordances, which has a negative impact on the system's learnability.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Val´ erio et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given
    § 3.1.2. Conscientiousness

    When chatbots are built into third-party apps (e.g., Facebook Messenger), an extra window may not be possible.

    “However, when the chatbots are built into third-party apps (e.g., Facebook Messenger), an extra window may not be possible.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2. Social Intelligence

    These abilities ultimately increase chatbots' authenticity.

    “which ultimately increase chatbots' authenticity (Neururer et al., 2018)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Neururer et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.3. Communicability

    Providing an opening message with insights into the chatbots' capabilities is a requirement for chatbots design.

    “The authors argue that providing an opening message with insights into the chatbots' capabilities is a requirement for chatbots design.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gnewuch et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.2. Conscientiousness

    Designing a conversational blueprint helps to conduct the conversation strictly and productively to the goal.

    “designing a conversational blueprint helps to conduct the conversation strictly and productively to the goal (Duijst, 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Duijst, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.3. Communicability

    Business integration is a requirement for designing chatbots, so that the chatbot can solve the users' requests without transferring the interaction to another user interface.

    “According to Gnewuch et al. (2017), business integration is a requirement for designing chatbots, so that the chatbot can solve the users' requests without transferring the interaction to another user interface.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gnewuch et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § 3.1.3. Communicability

    Communicability may be used as a strategy to avoid mistakes (damage control).

    “Communicability may also be used as a strategy to avoid mistakes ( damage control )”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.1.3. Communicability

    A clarification about the chatbots' purpose should be placed in the introductory message.

    “First-time users in Jain, Kumar, et al. (2018) highlighted that a clarification about the chatbots' purpose should be placed in the introductory message.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jain, Kumar, et al., 2018

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.1.3. Communicability

    When first-time users do not understand chatbots' capabilities and limitations, they have high expectations and, consequently, end up more frustrated when the chatbots fail.

    “Jain, Kumar, et al. (2018) observed that when first-time users do not understand chatbots' capabilities and limitations, they have high expectations and, consequently, end up more frustrated when the chatbots fail.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jain, Kumar, et al., 2018

      Not checked in the free run.

  • May combine two claims.

    Premisenone given
    § 3.1.2. Conscientiousness

    Most of the results are exploratory; a lack of studies investigate the extent to which the provided strategies influence users' behaviors and perceptions.

    “However, most of the results are exploratory; a lack of studies investigate the extent to which the provided strategies influence users' behaviors and perceptions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § 3.1.3. Communicability

    An easy-to-learn system should lead the user to perform well, even during their initial interactions.

    “an easy-to-learn system should lead the user to perform well, even during their initial interactions”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.1.3. Communicability

    Ability-check questions helped users to understand the system and reduce uncertainty.

    “According to the authors, ability-check questions helped users to understand the system and reduce uncertainty (Q. V. Liao et al., 2018).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Q. V. Liao et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2. Social Intelligence

    In HCI, Media Equation theory posits that people react to computers as social actors.

    “In the HCI domain, the Media Equation theory (Reeves & Nass, 1996) posits that people react to computers as social actors.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Reeves & Nass, 1996

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    Dialogue-reference errors are one of the major reasons for failed dialogues and they mostly result from chatbots' misunderstandings.

    “dialogue-reference errors (e.g., user's attempt to correct a previous answer or jumping back to an earlier question) are one of the major reasons for failed dialogues and they mostly result from chatbots' misunderstandings”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Mäurer & Weihe, 2015

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Chatbots often fail in a conversation due to lack of either linguistic or world knowledge.

    “chatbots often fail in a conversation due to lack of either linguistic or world knowledge (Wallis & Norling, 2005)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning
    § 3.2.1. Damage control

    It is necessary to enrich chatbots with the ability to recover from failures and handle inappropriate talk in a socially acceptable manner.

    “Thus, it is necessary to enrich chatbots with the ability to recover from failures and handle inappropriate talk in a socially acceptable manner (Jain, Kumar, et al., 2018; Silvervarg & J¨ onsson, 2013; Wallis & Norling, 2005).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Jain, Kumar, et al., 2018

      Not checked in the free run.

    • cites Silvervarg & Jönsson, 2013

      Not checked in the free run.

    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Providing damage control in chatbots has the benefit of dealing with testing.

    “[B2] to deal with testing”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    In open domain interactions, users are free to wander among topics and testing or flaming tends to be more frequent.

    “In open domain interactions, users are free to wander among topics and testing or flaming tends to be more frequent (Hill et al., 2015).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Hill et al., 2015

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    The longer the conversations last, the more users are encouraged to go beyond the chatbot's main functions.

    “Qualitative evaluation reveals that the longer the conversations last, the more users are encouraged to go beyond the chatbots main functions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Lasek & Jessa, 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    The chatbot failed to answer 10% of the exchanged messages in a task management chatbot log.

    “the chatbot failed to answer 10% of the exchanged messages”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Toxtli et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Users who want to test and find the system's borders are likely to never have a meaningful conversation with the chatbot no matter how sophisticated it is.

    “users who want to test and find the system's borders are likely to never have a meaningful conversation with the chatbot no matter how sophisticated it is”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Silvervarg & Jönsson, 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    About 4% of the conversations in the Amazon Alexa Prize 2017 corpus included sexually explicit utterances.

    “the researchers estimated that about 4% of the conversations included sexually explicit utterances”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Curry & Rieser, 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    2.8% of all statements were abusive.

    “2.8% of all statements were abusive”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Lasek & Jessa, 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    In analyzing conversation logs from hotel chatbots, Lasek and Jessa (2013) observed that 4% of the conversations contained vulgar, indecent, and insulting vocabulary.

    “When analyzing conversation logs from hotel chatbots, Lasek and Jessa (2013) observed that 4% of the conversations contained vulgar, indecent, and insulting vocabulary”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Lasek & Jessa, 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Casually testing the chatbots' 'intelligence' is a manifestation of satisfaction seeking.

    “casually testing the chatbots' 'intelligence' is a manifestation of satisfaction seeking”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Q. V. Liao et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    In the customer services context, the chatbot needs to avoid disappointing the user, as frustration may negatively reflect the business that the agent represents.

    “In the customer services context, the chatbot needs to avoid disappointing the user, as frustration may negatively reflect the business that the agent represents (Araujo, 2018).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Araujo, 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Sexual expressions represented 1.8% of all statements.

    “sexual expressions represented 1.8% of all statements”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Lasek & Jessa, 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Handling testing helps chatbots to establish limits and resolve social positioning.

    “Wallis and Norling (2005) argue that handling this type of testing helps the chatbots to establish limits and resolve social positioning.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    Damage control enables the chatbot to admit the lack of knowledge or cover up cleverly.

    “Damage control enables the chatbot to admit the lack of knowledge or cover up cleverly (Jain, Kumar, et al., 2018)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jain, Kumar, et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    A few interactions failed because the users' motivations were curiosity and mischief rather than trying to solve the decision problem.

    “a few interactions failed because the users' motivations were curiosity and mischief rather than trying to solve the decision problem”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Mäurer & Weihe, 2015

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning
    § 3.2.1. Damage control

    Providing means to identify an abusive utterance is important to adopting damage control strategies.

    “Providing means to identify an abusive utterance is important to adopting damage control strategies.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § 3.2.1. Damage control

    Enriching chatbots with the ability to choose between the options is a challenge.

    “Enriching chatbots with the ability to choose between the options is a challenge.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    The most powerful conversational act that predicted user satisfaction was the agent ability-check questions and the explicit feedback #fail, although closings and off-topic requests were also significant in predicting frustration.

    “The most powerful conversational act that predicted user satisfaction in that study was the agent ability-check questions, see discussion in Communicability section) and the explicit feedback #fail , although closings and off-topic requests were also significant in predicting frustration.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Q. V. Liao et al., 2018

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § 3.2.1. Damage control

    Successfully implementing conscientiousness and communicability may prevent errors; hence, strategies to provide these characteristics can also be used for damage control.

    “successfully implementing conscientiousness and communicability may prevent errors; hence, strategies to provide these characteristics can also be used for damage control”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    Because chatbots do not understand profanity or abuse, they may not recognize a statement as harassment, which makes it difficult to adopt answering strategies.

    “Because they do not understand profanity or abuse, they may not recognize a statement as harassment, which makes it difficult to adopt answering strategies (Curry & Rieser, 2018).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Curry & Rieser, 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    42.4% of the users sent a '#fail' statement at least once, and the number of complaints and flaming for the proposed chatbot was significantly lower than the baseline.

    “42.4% of the users did it at least once, and the number of complaints and flaming for the proposed chatbot was significantly lower than the baseline”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Q. V. Liao et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Being part of a recognized institution places the chatbot in a stronger social group.

    “being part of a recognized institution places the chatbot in a stronger social group”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Chatbots could redirect users' problematic requests to a human attendant in order to avoid conflict situations.

    “Toxtli et al. (2018) and Jenkins et al. (2007) also suggest that chatbots could redirect users' problematic requests to a human attendant in order to avoid conflict situations.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Toxtli et al., 2018

      Not checked in the free run.

    • cites Jenkins et al., 2007

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    The amount of implicit feedback was also significant, which advocates for predicting user's satisfaction from the conversation.

    “However, the amount of implicit feedback was also significant, which advocates for predicting user's satisfaction from the conversation.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Q. V. Liao et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Choosing between peaceful or aggressive reactions in conflict situations is optional for socially intelligent individuals.

    “For Bj¨ orkqvist et al. (2000), choosing between peaceful or aggressive reactions in conflict situations is optional for socially intelligent individuals.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Björkqvist et al., 2000

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    When facing testing or abuse, chatbots can communicate consequences or call on the authority of others.

    “when facing testing or abuse, chatbots can communicate consequences (Silvervarg & J¨ onsson, 2013) or call on the authority of others (Toxtli et al., 2018; Wallis & Norling, 2005)”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Silvervarg & Jönsson, 2013

      Not checked in the free run.

    • cites Toxtli et al., 2018

      Not checked in the free run.

    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Ignoring abuse and testing is not a good strategy because it could encourage more extreme behaviors.

    “Wallis and Norling (2005) argue that ignoring abuse and testing is not a good strategy because it could encourage more extreme behaviors.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    Ignoring abuse and testing positions the chatbot as an inferior individual, which is particularly harmful in scenarios where the chatbot should demonstrate a more prominent or authoritative social role.

    “It also positions the chatbot as an inferior individual, which is particularly harmful in scenarios where the chatbot should demonstrate a more prominent or authoritative social role (e.g., a tutor).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    When faced with abuse, a chatbot could be seen to take offense and respond in kind or act hurt.

    “Wallis and Norling (2005) suggest that when faced with abuse, a chatbot could be seen to take offense and respond in kind or act hurt.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning
    § 3.2.1. Damage control

    Damage control strategies need to be adapted to both the social situation and the intensity of the conflict.

    “Damage control strategies need to be adapted to both the social situation and the intensity of the conflict.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    When the chatbot is not accepted as part of the social group it represents, it is discredited by the user, leading the interaction to fail.

    “Wallis and Norling (2005) argue that when the chatbot is not accepted as part of the social group it represents, it is discredited by the user, leading the interaction to fail.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Posting confirmation messages avoids trapping the users in the wrong conversation path.

    “Gnewuch et al. (2017) discuss that posting confirmation messages avoids trapping the users in the wrong conversation path.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gnewuch et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § 3.2.1. Damage control

    The strategies can escalate in severity if the conflict is not solved.

    “The strategies can escalate in severity if the conflict is not solved.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Abusive behavior may lead the chatbot to stop responding until the student changes the topic.

    “abusive behavior may lead the chatbot to stop responding until the student changes the topic”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Silvervarg & Jönsson, 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Curry and Rieser (2018) categorized responses from state-of-the-art conversational systems in a pool of emotional reactions, both positive and negative.

    “Curry and Rieser (2018) categorized responses from state-of-the-art conversational systems in a pool of emotional reactions, both positive and negative.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Curry & Rieser, 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Deciding what strategy is adequate to the intensity of the conflict is crucial.

    “Deciding what strategy is adequate to the intensity of the conflict is crucial (Wallis & Norling, 2005).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Humans might feel inhibited about hurting the pretended feelings of a machine if the machine is willing to hurt a human's feelings too.

    “humans might feel inhibited about hurting the pretended feelings of a machine if the machine is willing to hurt a human's feelings too (Wallis & Norling, 2005)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Designing chatbots with too strong of reactions may lead to ethical concerns.

    “designing chatbots with too strong of reactions may lead to ethical concerns (Wallis & Norling, 2005)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Cooperative users are significantly more likely to give a higher rating for overall evaluation and decision efficiency.

    “cooperative users are significantly more likely to give a higher rating for overall evaluation and decision efficiency”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Mäurer & Weihe, 2015

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    Having visual elements such as quick replies prevents errors, since they keep the users aware of what to ask and the chatbot is more likely to know how to respond.

    “having visual elements such as quick replies prevents errors, since they keep the users aware of what to ask and the chatbot is more likely to know how to respond (Duijst, 2017)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Duijst, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given
    § 3.2.1. Damage control

    In human-chatbot interactions, predicting users' behavior toward the chatbots in a specific context to develop the appropriate behavior is a challenge.

    “In humanchatbot interactions, however, predicting users' behavior toward the chatbots in a specific context to develop the appropriate behavior is a challenge.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    According to Wallis and Norling (2005), humans also fail in conversations; they misunderstand what their partner says and do not know things that are assumed common knowledge by others.

    “According to Wallis and Norling (2005), humans also fail in conversations; they misunderstand what their partner says and do not know things that are assumed common knowledge by others.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    Users appeared to be uncomfortable and annoyed whenever the chatbot pointed out any defect in the user or reacted to aggression, as this behavior conflicted with the user's perceived power relations.

    “users appeared to be uncomfortable and annoyed whenever the chatbot pointed out any defect in the user or reacted to aggression, as this behavior conflicted with the user's perceived power relations”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites De Angeli, Johnson, & Coventry, 2001

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    The reactions include humorous responses, chastising and retaliation, and evasive responses, as well as flirtation and play-along utterances.

    “The reactions include humorous responses, chastising and retaliation, and evasive responses, as well as flirtation and play-along utterances.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Curry & Rieser, 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.1. Damage control

    If escalating the aggressive behavior is not appropriate, the chatbot could withdraw from the conversation to demonstrate that the user's behavior is not acceptable.

    “If escalating the aggressive behavior is not appropriate, the chatbot could withdraw from the conversation (Wallis & Norling, 2005) to demonstrate that the user's behavior is not acceptable.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given
    § 3.2.1. Damage control

    To provide an emotional reaction, emotional intelligence is also required.

    “To provide an emotional reaction, emotional intelligence is also required.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.1. Damage control

    Being evasive about sexual statements may convey the impression of flirtatiousness, which would not be an acceptable behavior for a customer assistant or a tutor chatbot.

    “Curry and Rieser (2018) showed that being evasive about sexual statements may convey the impression of flirtatiousness, which would not be an acceptable behavior for a customer assistant or a tutor chatbot.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Curry & Rieser, 2018

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § 3.2.4. Moral agency

    The clean-data strategy does not manifest agency, but rather alienates the chatbot of the topic.

    “Although this strategy is useful to prevent unwanted behavior, it does not manifest agency, but rather alienates the chatbot of the topic.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.2. Thoroughness

    People use fewer words per message and a more limited vocabulary with chatbots.

    “people use, indeed, fewer words per message and a more limited vocabulary with chatbots”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Hill et al., 2015

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation
    § 3.2.4. Moral agency

    In Banks (2018), all constructs (goodwill, trustworthiness, willingness to engage, and relational certainty) correlate with morality.

    “Statistical results showed that all the constructs correlate with morality, which suggests that manifesting moral agency can enrich interpersonal relationships with chatbots.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Banks (2018)

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data
    § 3.2.4. Moral agency

    Moral agency is primarily relevant when the conversational topic may raise moral concerns, which ultimately requires ethical behavior from conversational partners.

    “Moral agency was observed in only two domains of studies: open domain (four studies) and race-talk (two studies), which shows that this characteristic is primarily relevant when the conversational topic may raise moral concerns, which ultimately requires ethical behavior from the conversational partners.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.3. Manners

    Current online communication media has been successfully used to initiate, develop, and maintain interpersonal relationships.

    “even so, current online communication media has been successfully used to initiate, develop, and maintain interpersonal relationships (Walther, 2011).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Walther, 2011

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.2.4. Moral agency

    Lack of understanding about sex-talk does not prevent the studied chatbot from harsh verbal abuse, or even from being perceived as encouraging such abuse.

    “De Angeli and Brahnam (2006) show that the lack of understanding about sex-talk does not prevent the studied chatbot from harsh verbal abuse, or even from being perceived as encouraging such abuse.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites De Angeli and Brahnam (2006)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.4. Moral agency

    In Shum et al. (2018), moral agency is discussed as a secondary result, where the authors discuss the impact of biased responses on emotional connection.

    “In Shum et al. (2018), moral agency is discussed as a secondary result, where the authors discuss the impact of biased responses on emotional connection.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Shum et al. (2018)

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.2.4. Moral agency

    Text-based chatbots may also be assessed by their social representation, which risks building or reinforcing stereotypes.

    “Although the chatbot's personification is more evident in embodied conversational agents, text-based chatbots may also be assessed by their social representation, which risks building or reinforcing stereotypes (Marino, 2014).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Marino, 2014

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.3. Manners

    CMC is by itself more impersonal than face-to-face conversation.

    “CMC is by itself more impersonal than face-to-face conversation (Walther, 1992, 1996);”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Walther, 1992, 1996

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.4. Moral agency

    Schlesinger et al. (2018) argue that lack of context about the world does not redeem the chatbot from the necessity of being respectful with all social groups.

    “Schlesinger et al. (2018) argue that the lack of context about the world does not redeem the chatbot from the necessity of being respectful with all the social groups.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Schlesinger et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.3. Manners

    Participants who received frequent follow-up questions from the task management chatbot about their pending tasks perceived the chatbot as invasive.

    “Participants who received frequent follow-up questions from the task management chatbot about their pending tasks perceived the chatbot as invasive.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Toxtli et al. (2018)

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.2.4. Moral agency

    When the chatbot is positioned in a minority identity group, it exposes the image of that group to judgment and flaming, which is frequent in chatbot interactions.

    “When the chatbot is positioned in a minority identity group, it exposes the image of that group to judgment and flaming, which is frequent in chatbot interactions (Marino, 2014).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Marino, 2014

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing), S4 (based). The quote only partly states this claim.

    Premisenone given
    § 3.2.2. Thoroughness

    Providing thoroughness has the benefit of increasing human-likeness.

    “[B1] to increase human-likeness”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 3.2.4. Moral agency

    Sex talks with the male chatbot were rarely coercive or violent; his sexual preference was often questioned, and he was frequently propositioned by reported male users.

    “De Angeli and Brahnam (2006) show that sex talks with the male chatbot were rarely coercive or violent; his sexual preference was often questioned, though, and he was frequently propositioned by reported male users.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites De Angeli and Brahnam (2006)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.2. Thoroughness

    The repetition of vocabulary led the users to imitate it.

    “the repetition of this vocabulary led the users to imitate it”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jenkins et al., 2007

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.2.2. Thoroughness

    This approach produces high quality utterances; on the other hand, it reduces flexibility, since the chatbot is not able to adapt the tone of the conversation based on individual users and conversational context.

    “On the one hand, this approach produces high quality utterances; on the other hand, it reduces flexibility, since the chatbot is not able to adapt the tone of the conversation based on individual users and conversational context.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Mairesse & Walker, 2009

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.5. Emotional Intelligence

    Affective utterances improve the interpersonal relationship with a tutor chatbot.

    “Ayedoun et al. (2017), Kumar et al. (2010), and Dohsaka et al. (2014) suggest that affective utterances improve the interpersonal relationship with a tutor chatbot.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Ayedoun et al. (2017)

      Not checked in the free run.

    • cites Kumar et al. (2010)

      Not checked in the free run.

    • cites Dohsaka et al. (2014)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.5. Emotional Intelligence

    An emotionally intelligent chatbot can recognize and influence users' feelings and demonstrate respect, empathy, and understanding, improving the human-chatbot relationship.

    “An emotionally intelligent chatbot can recognize and influence users' feelings and demonstrate respect, empathy, and understanding, improving the humanchatbot relationship (Li et al., 2017; Salovey & Mayer, 1990).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Li et al., 2017

      Not checked in the free run.

    • cites Salovey & Mayer, 1990

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.5. Emotional Intelligence

    The WoZ condition was more engaging, resulting in conversations that lasted longer, with a higher number of turns.

    “Quantitative results showed that the WoZ condition was more engaging, since it resulted in conversations that lasted longer, with a higher number of turns.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Portela and Granell-Canut (2017)

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.2.5. Emotional Intelligence

    Affective backchannel combined with communicative strategies significantly increased learners' confidence and desire to communicate, while reducing anxiety.

    “The authors statistically demonstrated that affective backchannel, combined with communicative strategies (see Section 3.1.2) significantly increased learners' confidence and desire to communicate, while reducing anxiety.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ayedoun et al. (2017)

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § 3.2.4. Moral agency

    Building unbiased training datasets and learning algorithms that connect outputs with individual, real-world experiences are challenges to overcome.

    “Building unbiased training datasets and learning algorithms that connect the outputs with individual, real-world experiences, therefore, are challenges to overcome.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § 3.2.5. Emotional Intelligence

    Identity does not matter if the challenge of regulating emotions is overcome.

    “The wizards were blind to whether users thought they were talking to a chatbot or a person, which reveals that identity does not matter if the challenge of regulating emotions is overcome.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation
    § 3.2.4. Moral agency

    Moral agency relies on data that is biased in its nature, producing unsatisfactory results from an ethical perspective.

    “Hence, moral agency relies on data that is biased in its nature, producing unsatisfactory results from an ethical perspective.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.5. Emotional Intelligence

    Longer conversations (10+ turns) are needed to fulfill the needs of affection and belonging.

    “Shum et al. (2018) argue that longer conversations (10+ turns) are needed to fulfill the needs of affection and belonging.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Shum et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.5. Emotional Intelligence

    Chatbot's empathic utterances may be seen as pre-programmed and inauthentic.

    “Ho et al. (2018) state that chatbot's empathic utterances may be seen as pre-programmed and inauthentic.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ho et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.5. Emotional Intelligence

    Adapting chatbots' language to their current emotional state, along with personality and social role awareness, results in more believable interactions.

    “(Morris, 2002) argue that adapting chatbots' language to their current emotional state, along with their personality and social role awareness, results in more believable interactions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Morris, 2002

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.5. Emotional Intelligence

    Chatbots do not have genuine emotions.

    “Although chatbots do not have genuine emotions (Wallis & Norling, 2005), there are considerable discussions about the role of manifesting emotional cues in chatbots (Ho et al., 2018; Shum et al., 2018; Wallis & Norling, 2005).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallis & Norling, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.5. Emotional Intelligence

    In Thies et al. (2017), the energetic chatbot was reported as having an enthusiasm too high to match.

    “In Thies et al. (2017), the energetic chatbot was reported as having an enthusiasm too high to match.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Thies et al. (2017)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.5. Emotional Intelligence

    Five participants highlighted that the chatbot demonstrated attention to their users' feelings.

    “Five participants highlighted that the chatbot demonstrated attention to their users' feelings.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites K. K. Fitzpatrick et al. (2017)

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation
    § 3.2.5. Emotional Intelligence

    Empathic utterances encouraged users to engage and utter non-answer statements.

    “This result shows that empathic utterances encouraged the users to engage and utter non-answers statements.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.5. Emotional Intelligence

    When a chatbot's emotional reaction triggers a social response from the user, the chatbot has achieved group membership and users' sympathy.

    “According to Wallis and Norling (2005), when a chatbot's emotional reaction triggers a social response from the user, the chatbot has achieved group membership and users' sympathy.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallis and Norling (2005)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.4. Moral agency

    In Shum et al. (2018), authors propose a framework for developing social chatbots and highlight that the core chat module should follow ethical design to generate unbiased, non-discriminative responses, but do not discuss specific strategies.

    “In Shum et al. (2018), the authors propose a framework for developing social chatbots. The authors highlight that the core chat module should follow ethical design to generate unbiased, non-discriminative responses, but they do not discuss specific strategies for that.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Shum et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.5. Emotional Intelligence

    Partners' identity (chatbot vs. person) had no effect in perceived relational and emotional experience.

    “Although their results revealed that the partners' identity (chatbot vs. person) had no effect in the perceived relational and emotional experience, the chatbot condition was a WoZ setup.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ho et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning
    § 3.2.4. Moral agency

    Research on perceived moral agency is still necessary to develop chatbots whose social behavior is inclusive and respectful.

    “As discussed in this section, research on perceived moral agency is still necessary in order to develop chatbots whose social behavior is inclusive and respectful.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.5. Emotional Intelligence

    Affective moves significantly improve the perception of amicability, and marginally increased social belonging.

    “Qualitative results show that affective moves significantly improve the perception of amicability, and marginally increased social belonging.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kumar et al. (2010)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.5. Emotional Intelligence

    Conversational logs revealed that the human tutor performed a significantly higher number of affective moves in that context.

    “Conversational logs revealed that the human tutor performed a significantly higher number of affective moves in that context.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kumar et al. (2010)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    Personalizing the amount of personal information a chatbot can access and store is required to establish a relation of trust and reciprocity in workplace environments.

    “Duijvelshoff (2017) state that personalizing the amount of personal information a chatbot can access and store is required to establish a relation of trust and reciprocity in workplace environments.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Duijvelshoff (2017)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    Chatbots whose focus is engagement need to personalize generation of responses for different users' backgrounds, personal interests, and needs to serve their needs for communication, affection, and social belonging.

    “Shum et al. (2018) argue that chatbots whose focus is engagement need to personalize the generation of responses for different users' backgrounds, personal interests, and needs in order to serve their needs for communication, affection, and social belonging.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Shum et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.5. Emotional Intelligence

    Reciprocity and self-disclosure are strong predictors of rapport and user satisfaction.

    “Results demonstrated that reciprocity and self-disclosure are strong predictors of rapport and user satisfaction.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites S. Lee and Choi (2017)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.5. Emotional Intelligence

    A chatbot needs to combine usefulness with emotion by asking questions that help clarify users' intentions.

    “Shum et al. (2018) argue that a chatbot needs to combine usefulness with emotion by asking questions that help to clarify the users' intentions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Shum et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    Duijst (2017) found no significant effect of personalization on user experience with the financial assistant chatbot.

    “Although Duijst (2017) has found no significant effect of personalization on the user experience with the financial assistant chatbot, the study applies personalization as the ability to provide empathic responses according to the users' issues, where emotional intelligence plays a role.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Duijst (2017)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.5. Emotional Intelligence

    Keeping track of the conversation was reported as an empathic behavior and resulted in mutual affection.

    “Keeping track of the conversation was reported as an empathic behavior and resulted in mutual affection.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Portela and GranellCanut (2017)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    Use of the task-assignment chatbot varied depending on participants' levels of hierarchy.

    “When exploring how teammates used a task-assignment chatbot, Toxtli et al. (2018) found that the use of the chatbot varied depending on the participants' levels of hierarchy.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Toxtli et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    Two participants expected chatbots to retain context from previous interactions to improve recommendations.

    “In Jain, Kumar, et al. (2018), two participants also expected chatbots to retain context from previous interactions to improve recommendations.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jain, Kumar, et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given
    § 3.2.5. Emotional Intelligence

    Using emotional utterances in a personalized, context relevant way is still a challenge.

    “Using emotional utterances in a personalized, context relevant way is still a challenge.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    Eight participants reported dissatisfaction with the chatbot's generic guidance to specific places.

    “In the ethnography data collection study (Tallyn et al., 2018), eight participants reported dissatisfaction with the chatbot's generic guidance to specific places.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tallyn et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § 3.2.5. Emotional Intelligence

    Adopting the strategy of combining usefulness with emotion requires the chatbot to handle message understanding, emotion and sentiment tracking, session context modeling, and user profiling.

    “Adopting this strategy requires the chatbot to handle message understanding, emotion and sentiment tracking, session context modeling, and user profiling Shum et al. (2018).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Shum et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    In HCI, personalization is used to customize the interface toward user familiarity.

    “in HCI, personalization is used to customize the interface toward user familiarity (Fan & Poole, 2006).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Fan & Poole, 2006

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    One participant suggested that choice of text color and font size should be customizable.

    “In Jenkins et al. (2007), one participant suggested that the choice of text color and font size should be customizable.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jenkins et al. (2007)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationcitation
    § actions:

    There is a need to personalize interaction to individual user's mental models.

    “This outcome support to the need to personalize the interaction to individual user's mental models.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § actions:

    Duijst (2017) observed that participants faced difficulties with small letters, and concluded that adapting interface to provide accessibility needs to be considered.

    “Duijst (2017) also observed that participants faced difficulties with small letters, and concluded that adapting the interface to provide accessibility also needs to be considered.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Duijst (2017)

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § actions:

    Users with low social-agent orientation emphasize the utilitarian value of the system, while users with high social-agent orientation see the system as a humanized assistant.

    “V. Q. Liao et al. (2016) also found that users with low social-agent orientation emphasize the utilitarian value of the system, while users with high social-agent orientation see the system as a humanized assistant.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites V. Q. Liao et al. (2016)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § actions:

    Interpersonal relationship can be enriched by adapting chatbots' language to match user's context, energy, and formality.

    “Interpersonal relationship can also be enriched by adapting the chatbots' language to match the user's context, energy, and formality; the ability to appropriately use language is discussed in Section 3.2.2.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.2.6. Personalization

    Personalization can improve rapport and cooperation, ultimately increasing engagement with chatbots.

    “Grounded in robots and artificial agents' literature, V. Q. Liao et al. (2016) argue that personalization can improve rapport and cooperation, ultimately increasing engagement with chatbots.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites V. Q. Liao et al. (2016)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.2.6. Personalization

    In task-oriented contexts, personalization aims to increase relevance of services to particular users.

    “In task-oriented contexts, such as task management, personalization aims to increase the relevance of services to particular users (V. Q. Liao et al., 2016).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites V. Q. Liao et al., 2016

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § actions:

    To enrich efficiency and productivity of interaction, a chatbot needs to have memory of previous interactions as well as learn user's preferences and disclosed personal information.

    “To enrich the efficiency and productivity of the interaction, a chatbot needs to have memory of previous interactions as well as learn user's preferences and disclosed personal information (Thies et al., 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Thies et al., 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    Participants in Zamora (2017) reported that personal data and social media content may be inappropriate topics for chatbots because they can be sensitive.

    “Similarly, participants in Zamora (2017) reported that personal data and social media content may be inappropriate topics for chatbots because they can be sensitive.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Zamora (2017)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § 3.2.5. Emotional Intelligence

    Adaptation to dynamic context improves the sense of personalized interactions.

    “Adaption to the dynamic context also improves the sense of personalized interactions, which is discussed in the next section.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    Interviews with 12 participants generated 59 statements about how learning from experience promotes chatbots' authenticity.

    “In Neururer et al. (2018), interviews with 12 participants generated a total of 59 statements about how learning from experience promotes chatbots' authenticity.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Neururer et al. (2018)

      Not checked in the free run.

  • The quote only partly states this claim.

    Interpretationcitation
    § 3.3.1. Identity

    Attributing identity to a chatbot increases engagement.

    “[B1] to increase engagement: when evaluating signals of playful interactions, Q. V. Liao et al. (2018) found that agent-oriented conversations (asking about an agent's traits and status) are consistent with the tendency to anthropomorphize the agent and engage in chit-chat.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Q. V. Liao et al. (2018)

      Not checked in the free run.

    • cites Silvervarg and Jönsson (2013)

      Not checked in the free run.

    • cites Araujo (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.3. Personification

    In HCI, researchers argue that using a personified character in the user interface is a natural way to support interaction.

    “In the HCI field, researchers argue that using a personified character in the user interface is a natural way to support the interaction (Koda, 2003).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Koda, 2003

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationcitation
    § actions:

    If user prefers a more generic chatbot, then it would not store personal data, potentially increasing engagement with more resistant users.

    “If the user prefers a more generic chatbot, then it would not store personal data, potentially increasing the engagement with more resistant users.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing).

    Premisecitation
    § actions:

    Users should be able to choose level of chatbot's attributes, for example, agent's look and persona.

    “V. Q. Liao et al. (2016) suggest that users should be able to choose the level of the chatbot's attributes, for example, the agent's look and persona.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites V. Q. Liao et al. (2016)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § actions:

    Thies et al. (2017) raise possibility of offering an 'incognito' mode for chatbots or asking chatbot to forget what was said in previous utterances.

    “Thies et al. (2017) raise the possibility of offering an 'incognito' mode for chatbots or asking the chatbot to forget what was said in previous utterances.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Thies et al. (2017)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning
    § actions:

    This differentiation could be first signal to personalize further conversation, such as focusing on more productive or playful interactions.

    “This differentiation could be the first signal to personalize further conversation, such as focusing on more productive or playful interactions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    Privacy concerns may be reduced if a chatbot demonstrates care about privacy.

    “These concerns may be reduced if a chatbot demonstrates care about privacy (Duijvelshoff, 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Duijvelshoff, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.3. Personification

    Talking to a machine affords it a new identity.

    “According to De Angeli (2005), talking to a machine affords it a new identity .”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites De Angeli (2005)

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.3.1. Identity

    Chatbots lack agency to choose what social group to which they want to belong, but designers attribute identity to them, intentionally or not, when they define the way a chatbot talks or behaves.

    “Although chatbots lack the agency to choose what social group to which they want to belong, designers attribute identity to them, intentionally or not, when they define the way a chatbot talks or behaves (Cassell, 2009).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Cassell, 2009

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § actions:

    Conversation logs showed that tailored questions prompted users to report more detail about their experience, which is important in ethnography research.

    “As discussed in Section 3.1.2, quick replies may be seen as restrictive from an interactional perspective; however, conversation logs showed that the tailored questions prompted the users to report more detail about their experience, which is important in ethnography research.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tallyn et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    Chatbots should present strategies to learn from cultural, behavioral, personal, conversational, and contextual interaction data.

    “Neururer et al. (2018) state that chatbots should present strategies to learn from cultural, behavioral, personal, conversational, and contextual interaction data.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Neururer et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationcitation
    § actions:

    Users with low social-agent orientation could use a non-humanized interface, which would better represent their initial perspective.

    “By doing so, users with low social-agent orientation could use a non-humanized interface, which would better represent their initial perspective.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § actions:

    Interviews with potential users revealed that users should be able to manage what information chatbot knows about them and decide whether chatbot can learn from previous interactions.

    “Regarding chatbots' learning capabilities, in Duijvelshoff (2017), interviews with potential users revealed that users should be able to manage what information the chatbot knows about them and decide whether the chatbot can learn from previous interactions or not.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Duijvelshoff (2017)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.3. Personification

    Chatbot embodiment can be created through narrative without any visual help.

    “Although research on personification is more common in the Embodied Conversational Agents field, De Angeli, Johnson, and Coventry (2001) claim that chatbot embodiment can be created through narrative without any visual help.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites De Angeli, Johnson, and Coventry (2001)

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationcitation
    § 3.3.1. Identity

    Attributing identity to a chatbot requires balancing the identity and the technical capabilities.

    “[C2] to balance the identity and the technical capabilities: the literature comparing embodied vs. disembodied conversational agents yields contradictory results regarding the relevance of a human representation.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Corti and Gillespie (2016)

      Not checked in the free run.

    • cites Ciechanowski et al. (2018)

      Not checked in the free run.

    • cites Gnewuch et al. (2017)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § actions:

    Chatbot should remember user's preferences disclosed in previous conversations.

    “Thies et al. (2017) also suggest that the chatbot should remember user's preferences disclosed in previous conversations.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Thies et al. (2017)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.3.1. Identity

    Candello et al. (2017) found that users perceive machine-like typefaces as more chatbot-like.

    “When evaluating different typefaces for a financial adviser chatbot, Candello et al. (2017) found that users perceive machine-like typefaces as more chatbot-like, although they did not find strong evidence of handwriting-like typefaces conveying humanness.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Candello et al. (2017)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § 3.3.2. Personality

    Attributing personality to a chatbot requires adapting humor to the users' culture.

    “[C1] to adapt humor to the users' culture: sense of humor is highly shaped by cultural environment (Ruch, 1998).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Ruch (1998)

      Not checked in the free run.

    • cites Ptaszynski et al. (2010)

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.3.1. Identity

    Brahnam and De Angeli (2012) showed that people spoke more often about physical appearance and used more swear and sexual words with the female-presenting chatbot.

    “When evaluating the effect of gender identity on disinhibition, Brahnam and De Angeli (2012) showed that people spoke more often about physical appearance and used more swear and sexual words with the female-presenting chatbot, and racist attacks were observed in interactions with black-representing chatbots.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Brahnam and De Angeli (2012)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning
    § 6. Limitations

    Since the definition of chatbot is not consolidated in the literature and chatbots have been studied across several different domains, some studies that include social aspects of chatbots may not have been found.

    “Secondly, since the definition of chatbot is not consolidated in the literature and chatbots have been studied across several different domains, some studies that include social aspects of chatbots may not have been found.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning
    § 6. Limitations

    We adopted several synonyms in our research string and used Google Scholar as search engine.

    “To account for that, we adopted several synonyms in our research string and used Google Scholar as search engine, which provides a fairly comprehensive indexing of the literature in more domains.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductreasoning
    § 6. Limitations

    Both the conceptual framework and the relationships amongst the characteristics were derived based on outcomes the surveyed studies explicitly reported.

    “and both the conceptual framework and the relationships amongst the characteristics were derived based on outcomes the surveyed studies explicitly reported.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 3.3.2. Personality

    Outcomes consistently suggest that students prefer a chatbot that is not overly polite, but has some attitude.

    “Outcomes consistently suggest that students prefer a chatbot that is not overly polite, but has some attitude.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Ayedoun et al., 2017

      Not checked in the free run.

    • cites Kumar et al., 2010

      Not checked in the free run.

    • cites Sjödén et al., 2011

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductreasoning
    § 6. Limitations

    Since this survey focused on disembodied, text-based chatbots, the literature on embodied and speech-based conversational agents was excluded.

    “Firstly, since this survey focused on disembodied, text-based chatbots, the literature on embodied and speech-based conversational agents was excluded.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § 7. Conclusion

    Conscientiousness, thoroughness, and proactivity might be covered by the cooperative principle.

    “For example, conscientiousness , thoroughness , and proactivity might be covered by the cooperative principle (Grice et al., 1975)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Grice et al., 1975

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductown data
    § 6. Limitations

    The conceptual model of social characteristics was derived through a coding process inspired by qualitative methods, such as Grounded Theory.

    “Finally, the conceptual model of social characteristics was derived through a coding process inspired by qualitative methods, such as Grounded Theory.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning
    § 6. Limitations

    Like any qualitative coding methods, it relies on the researchers' subjective assessment.

    “Like any qualitative coding methods, it relies on the researchers' subjective assessment.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § 3.3.2. Personality

    Puns are restricted to a specific culture and language, with low portability.

    “However, puns are restricted to a specific culture and language, with low portability.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ptaszynski et al. (2010)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.3.2. Personality

    Jain, Kumar, et al. (2018) discussed that a chatbot's personality should match its domain.

    “Jain, Kumar, et al. (2018) discussed that a chatbot's personality should match its domain.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jain, Kumar, et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § 4.1. A note on chatbots' humanness

    The social characteristics identified in the survey align well with characteristics that are present in human-human interactions.

    “The social characteristics identified in the survey align well with characteristics that are present in human-human interactions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § 6. Limitations

    This decision may have caused the under-representation of certain research domains.

    “Additionally, this decision may have caused the under-representation of certain research domains.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § 3.3.1. Identity

    Ciechanowski et al. (2018) show that simpler text-based chatbots with no visual, human identity resulted in less of an uncanny effect and reduced negative affect.

    “in contrast, when evaluating a website assistant chatbot, Ciechanowski et al. (2018) show that simpler text-based chatbots with no visual, human identity resulted in less of an uncanny effect and reduced negative affect.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ciechanowski et al. (2018)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.3.2. Personality

    A consistent personality helps the chatbot to gain the users' confidence and trust.

    “In Shum et al. (2018) and (Sj¨ od´ en et al., 2011), the authors argue that a consistent personality helps the chatbot to gain the users' confidence and trust.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Shum et al. (2018)

      Not checked in the free run.

    • cites Sjödén et al. (2011)

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § 3.3.2. Personality

    In Ptaszynski et al. (2010), the joker chatbot was perceived as more human-like, knowledgeable, and funny, and participants felt more engaged.

    “In Ptaszynski et al. (2010), the joker chatbot was perceived as more human-like, knowledgeable, and funny, and participants felt more engaged.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ptaszynski et al. (2010)

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation
    § 4.1. A note on chatbots' humanness

    This survey shows the benefits of considering these characteristics when developing chatbots, which is supported by the Media Equation theory.

    “On the one hand, this survey shows the benefits of considering these characteristics when developing chatbots, which is supported by the Media Equation theory (Nass & Moon, 2000; Nass et al., 1993); we identified the domains in which each characteristic was studied.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Nass & Moon, 2000

      Not checked in the free run.

    • cites Nass et al., 1993

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning
    § 4.1. A note on chatbots' humanness

    As chatbots enrich their communication and social skills, their perceived social role may approach human profiles.

    “Still, as the chatbots enrich their communication and social skills, their perceived social role may approach human profiles.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § 3.3.2. Personality

    Mairesse and Walker (2009) observed that some utterances sounded unnatural because a human's personality is a continuous phenomenon, rather than a discrete one.

    “In Mairesse and Walker (2009), the researchers intentionally generated utterances to reflect extreme personalities; as a result, they observed that some utterances sounded unnatural because a human's personality is a continuous phenomenon, rather than a discrete one.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Mairesse and Walker (2009)

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductreasoning
    § 6. Limitations

    To mitigate this threat, the researchers discussed the social characteristics and categories during in-person meetings until reaching consensus.

    “To mitigate this threat, the researchers discussed the social characteristics and categories during in-person meetings until reaching consensus, and both the conceptual framework and the relationships amongst the characteristics were derived based on outcomes the surveyed studies explicitly reported.”
    Quote in the paperSubstantial claim
265 of 265
  • The paper relies on this without support.

    The increasing need to approximate conversational interaction styles raises users' expectations that chatbots present social behaviors habitual in human-human communication.

    “The increasing need to approximate conversational interaction styles raises expectations for chatbots to present social behaviors that are habitual in human-human communication.”
  • The paper relies on this without support.

    Chatbots' social characteristics knowledge is spread across several domains in which chatbots have been studied.

    “Although chatbots' social characteristics have been explored in the literature, this knowledge is spread across several domains in which chatbots have been studied, such as customer services, education, finances, and travel.”
  • The paper relies on this without support.

    A lack of studies brings together the social characteristics that influence the way users perceive and behave toward chatbots.

    “Whilst the literature has extensively reviewed the technical aspects of chatbots design (e.g., Ahmad, Che, Zainal, Rauf, and Adnan (2018); Deshpande, Shahane, Gadre, Deshpande, and Joshi (2017); Masche and Le (2017); Ramesh, Ravishankaran, Joshi, and Chandrasekaran (2017); Thorne (2017); Walgama and Hettige (2017); Winkler and S¨ ollner (2018)), a lack of studies brings together the social char”
  • The paper relies on this without support.

    The literature presents no coherent definition of chatbots.

    “The literature presents no coherent definition of chatbots; thus, to find relevant studies we used a search string that includes the synonyms 'chatbots, chatterbots, conversational agents, conversational interfaces, conversational systems, conversation systems, dialogue systems, digital assistants, intelligent assistants, conversational user interfaces, and conversational UI' .”
  • The paper relies on this without support.

    Most studies do not explicitly label their results as social characteristics/traits.

    “We decided to not include terms that relate to social characteristics/traits, because most studies do not explicitly label their results as such.”
  • The paper relies on this without support.

    The characteristics and categories are seldom explicitly highlighted in the literature.

    “Noticeably, the characteristics and categories are seldom explicitly highlighted to in the literature, so the conceptual model was derived using a qualitative coding process inspired by methods such as Grounded Theory (Auerbach & Silverstein, 2003) (open coding stage).”
  • The paper relies on this without support.

    The set of social characteristics identified from the surveyed literature is the relevant set for designing chatbot social behavior.

    “In this survey, we investigated the literature on disembodied, text-based chatbots to answer the question 'What chatbot social characteristics benefit human interactions and what are the challenges and strategies associated with them?'”
7 of 7

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

  • General-purpose study percentage is understated

    Minor

    The paper identifies 19 general-purpose chatbot studies out of 56 surveyed studies. That is approximately 34%, not the reported 33%.

    Reported 33 · recomputed 33.928571

  • Real-chatbot study subgroups total 36, not 35

    Minor

    The three groups described among the studies using real chatbots contain 18, 9, and 9 studies, totaling 36 rather than the reported 35.

    Reported 35 · recomputed 36

2 of 2

Cites

Flagged first, then by citations

Research works printed but not linked: 46

  1. Abdul-Kader S. A., 2015, International Journal of Advanced Computer Science and Applications, 6, 72
  2. Auerbach C., 2003, Qualitative data: An introduction to coding and analysis
  3. Augello A., 2017, International conference on internet science, 236
  4. Baron N. S., 1984, Visible Language, 18, 118
  5. Chaves A. P., 2018, Acm sigchi conference on human factors in computing systems
  6. Conrad S., 2009, Register, genre, and style
  7. De Angeli A., 2005, Proceedings of the joint symposium on virtual social agents, 7
  8. De Angeli A., 2006, Proceedings of the avi 2006 workshop on gender and interaction: real and virtual women in a male world
  9. De Angeli A., 2001, Proceedings of the international conference on affective human factors design, london, 467
  10. De Angeli A., 2001, Interact, 198
  11. De Souza, C. S., Prates, R. O. & Barbosa, S. D. (1999). A method for evaluating software communicability. In Proceedings of the IHC '99, Art28 (pp. 1–7). Campinas, SP, Brazil. October, 1999. https://www.unicamp.br/~ihc99/Ihc99/AtasIHC99/Atas.html
  12. Deshpande A., 2017, International Journal of Computer Engineering and Applications. XI(Special issue), 1–7. https://www.ijcea.com/survey-various-chatbot-implementation-techniques/
  13. Duijst, D. (2017). Can we improve the user experience of chatbots with personalisation [Unpublished master’s thesis]. University of Amsterdam.
  14. Duijvelshoff W., 2017, Workshop on chatbots and artificial intelligence
  15. Dyke G., 2013, Intelligent tutoring systems, 531
  16. Elliott, C. (1994). Research problems in the use of as allow artificial intelligence model of personality and emotion . In Proceedings of Twelfth National Conference on Artificial Intelligence (AAAI-94) (pp. 9–15). The AAAI Press, Menlo Park, California.
  17. Ferman, M. (2018). Towards best practices for chatbots [Unpublished master’s thesis]. Universidad Villa Rica.
  18. Gnewuch U., 2017, International conference on information systems 2017, proceedings 1
  19. Hayashi Y., 2015, International conference on educational data mining (edm)
  20. Kirakowskim J., O’Donnell, P., Yiu, A., 2009, Human-computer interaction
  21. Koda T., 2003, IEICE Transactions on Information and Systems, 86, 1369
  22. Lasek M., 2013, Information Systems in Management, 2, 146
  23. Li Y., 2017, International joint conference on natural language processing (ijcnlp), 986
  24. Liao Q. V., 2018, Proceedings of the 2018 chi conference on human factors in computing systems
  25. Mairesse F., 2009, Can conversational agents express big five personality traits through language?: Evaluating a psychologically-informed language generator
  26. Masche J., 2017, International conference on computer science, applied mathematics and applications, 212
  27. Maslowski I., 2017, International conference on natural language and speech processing
  28. Meany M. M., 2010, International Journal of the Humanities, 8, 129
  29. Morris T. W., 2002, Artificial intelligence and interactive entertainment, Technical Report SS-02-01, 82
  30. Nass C., 1994, Computers are social actors, 72
  31. Neff G., 2016, International Journal of Communication, 10, 17
  32. Nguyen Q. N., 2018, Twenty-fourth americas conference on information systems – emergent research forum (erf)
  33. Radziwill N. M., 2017, Software Quality Professional, 19, 25
  34. Reeves B., 1996, How people treat computers, television, and new media like real people and places
  35. Ruch W., 1998, The sense of humor: Explorations of a personality characteristic, 3
  36. Satu, M. S., Parvez, M. H., Shamim-Al-Mamun, 2015, Computer and information engineering (iccie), 2015 1st international conference on, 87
  37. Schuetzler R. M., 2018, Americas conference on information systems 2018 proceedings
  38. Shawar, B. A. & Atwell, E. (2007). Chatbots: Are they really useful? Journal for Language Technology and Computational Linguistics , 22 (1), 29–49. GSCL German Society for Computational Linguistics. https://jlcl.org/content/2-allissues/21-Heft1-2007/Bayan_Abu-Shawar_and_Eric_Atwell.pdf
  39. Silvervarg A., 2013, 6th international joint conference on natural language processing (ijcnlp 2013), 1223
  40. Thies I. M., 2017, Human-computer interaction–interact, 10513, 441
  41. Thomson L., 2005, 1st international workshop on innovations in web infrastructure (iwi 2005) co-located with the 14th world- wide web conference (www2005), japan
  42. Toxtli, C., Monroy-Hernández, A., Cranshaw, J., 2018, Proceedings of the 2018 chi conference on human factors in computing systems, 58
  43. Walgama M., 2017, KDU international research conference
  44. Wallis P., 2005, Proceedings of the joint symposium on virtual social agents, 29
  45. Walther, J. B. (2011). Theories of computer-mediated communication and interpersonal relations. In M. L. Knapp & J. A. Daly (Eds.), The handbook of interpersonal communication. (4th ed., pp. 443–479). Sage.
  46. Zhu P., 2018, Proceedings of the 27th international conference on computational linguistics: System demonstrations, 108

Cited by

Sorted by citations

Authors
Chaves, A. P., & Gerosa, M. A.
Affiliations
  • Universidade Tecnológica Federal do Paraná (BR)
  • Northern Arizona University (US)
Corresponding author
Chaves, Ana Paula
Venue
International Journal of Human–Computer Interaction
Published
2020-11-08
Volume
37
Issue
8
Pages
729-758
ISSN
  • 1044-7318 (ISSN-L)
  • 1532-7590
OpenAlex
W2939803556
Cited by
572
References
115
Citations by year
2026: 101 · 2025: 134 · 2024: 118 · 2023: 104 · 2022: 74 · 2021: 36 · 2020: 3 · 2019: 2
FWCI
59.25
Type
journal article
Language
en
Open access
Locations
  • International Journal of Human-Computer Interaction (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in Service Interactions
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
Keywords
chatbots, human-chatbot interaction, social characteristics, chatbot design, conversation, text-based chatbots, user expectations, conceptual model

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review