The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Users' experiences with chatbots: findings from a questionnaire study
Open accessAbstract
For chatbots to be broadly adopted by users, it is critical that they are experienced as useful and pleasurable. While there is an emerging body of research concerning user uptake and use of chatbots, there is a lack of theoretically grounded studies detailing what constitutes good or poor chatbot user experiences. In this paper, we present findings from a questionnaire study involving more than 200 chatbot users who reported on episodes of chatbot use that they found particularly satisfactory or frustrating. The user reports were analysed with basis in theory on user experience, with particular concern for pragmatic and hedonic attributes. We found that pragmatic attributes such as efficient assistance (positive) and problems with interpretation (negative) were important elements in user reports of satisfactory and frustrating episodes. Hedonic attributes such as entertainment value (positive) and strange and rude responses (negative) were also frequently mentioned. Older participants tended to report on pragmatic attributes more often, whereas younger participants tended to report on hedonic attributes more often. Drawing on the findings, we propose four high-level lessons learnt that may benefit chatbot service providers, and we suggest relevant future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The critical incident technique.
Flanagan, J. C. (1954) · Psychological Bulletin · doi:10.1037/h0061470 · Cited by 8,191
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 4×
“For example, chatbots for education [19], health [16] and customer service [38] may provide a more compelling user experience if the hedonic attributes of the interaction are also addressed in the chatbot interaction.”
BackgroundInfluentialTractinsky, N., Katz, A. S., & Ikar, D. (2000) · Interacting with Computers · doi:10.1016/s0953-5438(00)00031-x · Cited by 1,376 · cited 1×
“User experience has been studied for a range of application domains, from games [2] and websites [45] to mobile phones [33] and larger hardware systems such as ATM terminals [44].”
BackgroundLuger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
The Thing and I: Understanding the Relationship Between User and Product
Hassenzahl, M. (2003) · Human-Computer Interaction Series · doi:10.1007/1-4020-2967-5_4 · Cited by 1,097
AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität
Hassenzahl, M., Burmester, M., & Koller, F. (2003) · Berichte des German Chapter of the ACM · doi:10.1007/978-3-322-80058-9_19 · Cited by 955
Hill, J., Randolph Ford, W., & Farreras, I. G. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.02.026 · Cited by 856
User experience (UX): towards an experiential perspective on product quality
Hassenzahl, M. (2008) · Proceedings of the 20th Conference on l'Interaction Homme-Machine · doi:10.1145/1512714.1512717 · Cited by 791
Brandtzaeg, P. B., & Følstad, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70284-1_30 · Cited by 788
Self-citation
Cited by
Cheng, Y., & Jiang, H. (2022) · Journal of Product & Brand Management · doi:10.1108/jpbm-05-2020-2907 · Cited by 393
Nicolescu, L., & Tudorache, M. T. (2022) · Electronics · doi:10.3390/electronics11101579 · Cited by 280
Beatty, C., Malik, T., Meheli, S., & Sinha, C. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.847991 · Cited by 224
“An alternative approach is to mimic human dialogue (23) with users via an artificial intelligence (AI) conversational agent.”
BackgroundFuture directions for chatbot research: An interdisciplinary research agenda
Følstad, A., Araujo, T., Law, E. L.-C., Brandtzaeg, P. B., Papadopoulos, S., Reis, L., Baez, M., Laban, G., McAllister, P., Ischen, C., et al. (2021) · Computing · doi:10.1007/s00607-021-01016-7 · Cited by 247
“In line with this scoping of the research area, we understand chatbots as conversational agents providing access to information and services through interaction in everyday language —an understanding which is in line with the definitions by Føl-stad and Brandtzaeg [39] and Hobert and Meyer von Wolff [54].”
BackgroundSelf-citationHaugeland, I. K. F., Følstad, A., Taylor, C., & Bjørkli, C. A. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102788 · Cited by 235
Self-citation
Metadata
- Authors
- Følstad, A., & Brandtzaeg, P. B.
- Venue
- Quality and User Experience
- Published
- 2020-04-11
- Volume
- 5
- Issue
- 1
- ISSN
- 2366-0139 (ISSN-L)
- 2366-0147
- OpenAlex
- W3022161378
- Cited by
- 252
- References
- 18
- FWCI
- 9.94
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Users' experiences with chatbots: findings from a questionnaire study. https://app.cochat.ai/papers/10.1007/s41233-020-00033-2
- The paper
- Følstad, A., & Brandtzaeg, P. B. (2020). Users' experiences with chatbots: findings from a questionnaire study. Quality and User Experience. https://doi.org/10.1007/s41233-020-00033-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.