CoChat

Assessing the Topics and Motivating Factors Behind Human-Social Chatbot Interactions: Thematic Analysis of User Experiences

Open access
Ta-Johnson, Vivian P, Boatfield, Carolynn, Wang, Xinyu, DeCero, Esther, Krupica, Isabel C, Rasof, Sophie D, Motzer, Amelie, Pedryc, Wiktoria M · 2022 · JMIR Human Factors
Cited by 51

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.

Abstract

Background: Although social chatbot usage is expected to increase as language models and artificial intelligence improve, very little is known about the dynamics of human-social chatbot interactions. Specifically, there is a paucity of research examining why human-social chatbot interactions are initiated and the topics that are discussed. Objective: We sought to identify the motivating factors behind initiating contact with Replika, a popular social chatbot, and the topics discussed in these interactions. Methods: A sample of Replika users completed a survey that included open-ended questions pertaining to the reasons why they initiated contact with Replika and the topics they typically discuss. Thematic analyses were then used to extract themes and subthemes regarding the motivational factors behind Replika use and the types of discussions that take place in conversations with Replika. Results: Users initiated contact with Replika out of interest, in search of social support, and to cope with mental and physical health conditions. Users engaged in a wide variety of discussion topics with their Replika, including intellectual topics, life and work, recreation, mental health, connection, Replika, current events, and other people. Conclusions: Given the wide range of motivational factors and discussion topics that were reported, our results imply that multifaceted support can be provided by a single social chatbot. While previous research already established that social chatbots can effectively help address mental and physical health issues, these capabilities have been dispersed across several different social chatbots instead of deriving from a single one. Our results also highlight a motivating factor of human-social chatbot usage that has received less attention than other motivating factors: interest. Users most frequently reported using Replika out of interest and sought to explore its capabilities and learn more about artificial intelligence. Thus, while developers and researchers study human-social chatbot interactions with the efficacy of the social chatbot and its targeted user base in mind, it is equally important to consider how its usage can shape public perceptions and support for social chatbots and artificial agents in general.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/38876

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 27 references

Research works printed but not linked: 25

  1. 10.2139/ssrn.3920577 · DOI
  2. 10.1007/978-3-642-16202-2_20 · DOI
  3. Reis, H, 1988, Handbook of Personal Relationships: Theory, Research and Interventions, 367
  4. 10.1177/0093650216644025 · DOI
  5. 10.1145/336595.337562 · DOI
  6. 10.1109/mpuls.2019.2911816 · DOI · Paper page
  7. 10.14236/ewic/hci2018.129 · DOI
  8. Aboud, F, 1996, The Company They Keep: Friendship in Childhood and Adolescence, 87
  9. 10.1177/0265407584012005 · DOI · Paper page
  10. Blau, P, 1968, International Encyclopedia of the Social Sciences, 452
  11. Cook, K, 2003, Handbook of Social Psychology, 53
  12. 10.1037/0033-2909.117.3.497 · doi:10.1037/0033-2909.117.3.497 · Paper page
  13. 10.1086/671465 · DOI · Paper page
  14. Clark, D, 1995, Social Phobia: Diagnosis, Assessment, and Treatment, 69
  15. 10.1111/1468-5973.12319 · DOI
  16. Lin, Y, 2014, Future Information Technology, 661, 10.1007/978-3-642-55038-6_103 · DOI
  17. 10.1086/209118 · DOI · Paper page
  18. 10.1016/0030-5073(69)90004-x · DOI · Paper page
  19. 10.1016/j.cogsys.2016.06.002 · DOI
  20. 10.1177/1525822x02239569 · DOI · Paper page
  21. 10.3233/SHTI200270 · DOI
  22. 10.1037/pspa0000281 · DOI
  23. 10.2196/12231 · DOI · Paper page
  24. 10.1016/S0140-6736(07)61238-0 · DOI · Paper page
  25. 10.1371/journal.pone.0257732 · DOI · Paper page

Cited by

Metadata

Authors
Ta-Johnson, V. P., Boatfield, C., Wang, X., DeCero, E., Krupica, I. C., Rasof, S. D., Motzer, A., & Pedryc, W. M.
Venue
JMIR Human Factors
Published
2022-10-03
Volume
9
Issue
4
Pages
e38876
ISSN
2292-9495 (ISSN-L)
OpenAlex
W4300689645
Cited by
51
References
27
FWCI
7.35
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.