Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 105 of the 111 references it cites were found in a registry or an index; 4 of the 35 sources its claims cite were checked for support.

AI-based chatbots in customer service and their effects on user compliance

Open access
Adam, Martin, Wessel, Michael, Benlian, Alexander · 2021 · Electronic Markets

Abstract

Abstract Communicating with customers through live chat interfaces has become an increasingly popular means to provide real-time customer service in many e-commerce settings. Today, human chat service agents are frequently replaced by conversational software agents or chatbots, which are systems designed to communicate with human users by means of natural language often based on artificial intelligence (AI). Though cost- and time-saving opportunities triggered a widespread implementation of AI-based chatbots, they still frequently fail to meet customer expectations, potentially resulting in users being less inclined to comply with requests made by the chatbot. Drawing on social response and commitment-consistency theory, we empirically examine through a randomized online experiment how verbal anthropomorphic design cues and the foot-in-the-door technique affect user request compliance. Our results demonstrate that both anthropomorphism as well as the need to stay consistent significantly increase the likelihood that users comply with a chatbot’s request for service feedback. Moreover, the results show that social presence mediates the effect of anthropomorphic design cues on user compliance.

Overview

CoChat Summary

TL;DR

This randomized online experiment shows that verbal anthropomorphic design cues and the foot-in-the-door technique both increase users’ compliance with a chatbot’s request for service feedback. Social presence mediates the effect of anthropomorphic cues on compliance, but it does not moderate the foot-in-the-door effect.

Key findings

  • In the binary logistic regression on user compliance, the FITD manipulation increased compliance with an odds ratio of 2.499 (b = 0.916, p < 0.05), and the anthropomorphic design cues (ADCs) manipulation increased compliance with an odds ratio of 3.975 (b = 1.380, p < 0.01).
  • Mediation analysis with 5,000 bootstrap samples found that social presence significantly mediated the ADCs → user compliance relationship: indirect effect = 0.6485, standard error = 0.3252, 95% bias-corrected CI [0.1552, 1.2887].
  • ADCs were positively related to social presence (b = 1.2553, p < 0.01), while the direct effect of ADCs on compliance became insignificant after adding social presence (b = 0.8123, p > 0.05).
  • The moderation test found no significant interaction between social presence and FITD on compliance (b = 0.2305; p > 0.1), so H3 was not supported.

Methods

  • Randomized 2 × 2 between-subject, full-factorial online experiment manipulating ADCs (low vs. high) and FITD (small request absent vs. present).
  • Context was a customer-service chatbot for online banking; the final dataset included 153 German participants (from 308 who started the experiment).
  • Main analyses used hierarchical binary regression, plus bootstrapped mediation analysis (Hayes model 4, 5,000 samples) and bootstrapped moderation analysis (Hayes model 1, 5,000 samples).

Limitations

  • The paper explicitly says the study was conducted in an experimental setting with a simplified version of an instant messaging application, and future research should confirm and refine the results in a more realistic field study.
  • The sample consisted of only German participants, so the authors note that the effects should be tested in other cultural contexts.
  • It also says the effects were shown only for the specific operationalized manipulations; other forms of verbal ADCs and FITD should be investigated.
  • Evident from the text: the study measured request compliance in a single customer-service scenario (a debit-card-in-the-U.S. banking chatbot), so generalization to other chatbot tasks and settings is not established in the paper.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s12525-020-00414-7

Cites

105 of 105 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

4 Valid · 0 Not valid · 22 Not checked · 34 Own results and interpretations

27 more claims

Create a free account to see all 60 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 12
  • Probably not a substantial claim. 19

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 111 references

Research works printed but not linked: 3

  1. Cialdini, R., & Garde, N. (1987). Influence (Vol. 3). A. Michel.
  2. Nunnally, J., & Bernstein, I. (1994). Psychometric theory (3rd ed.). New York: McGraw Hill Inc..
  3. Raymond, J. (2001). No more shoppus interruptus. American Demographics, 23(5), 39–40.

Cited by

See all 1,195

Metadata

Authors
Adam, M., Wessel, M., & Benlian, A.
Affiliations
  • Technische Universität Darmstadt (DE)
  • Copenhagen Business School (DK)
Corresponding author
Adam, Martin
Venue
Electronic Markets
Published
2020-03-17
Volume
31
Issue
2
Pages
427-445
ISSN
  • 1019-6781 (ISSN-L)
  • 1422-8890
OpenAlex
W3012220842
Cited by
1,195
References
111
Citations by year
2026: 247 · 2025: 273 · 2024: 271 · 2023: 184 · 2022: 120 · 2021: 83 · 2020: 16
FWCI
39.58
Type
journal article
Language
en
Open access
Licence
Locations
  • Electronic Markets (publishedVersion, cc-by)
  • CBS Research Portal (Copenhagen Business School) (publishedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • Econstor (Econstor) (submittedVersion, cc-by)
  • GoeScholar The Publication Server of the Georg-August-Universität Göttingen (Georg-August-Universität Göttingen) (submittedVersion, cc-by)
  • TUbilio (Technical University of Darmstadt) (submittedVersion)
Funders
Technische Universität Darmstadt
Topics
  • Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Social Sciences › Business, Management and Accounting › Marketing › Digital Marketing and Social Media
Keywords
AI chatbots, customer service, anthropomorphism, foot-in-the-door technique, social presence, service feedback, e-commerce, chatbots

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: AI-based chatbots in customer service and their effects on user compliance. https://app.cochat.ai/papers/10.1007/s12525-020-00414-7
The paper
Adam, M., Wessel, M., & Benlian, A. (2021). AI-based chatbots in customer service and their effects on user compliance. Electronic Markets. https://doi.org/10.1007/s12525-020-00414-7

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.