Understanding the Design Elements Affecting User Acceptance of Intelligent Agents: Past, Present and Future
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Intelligent agents (IAs) are permeating both business and society. However, interacting with IAs poses challenges moving beyond technological limitations towards the human-computer interface. Thus, the knowledgebase related to interaction with IAs has grown exponentially but remains segregated and impedes the advancement of the field. Therefore, we conduct a systematic literature review to integrate empirical knowledge on user interaction with IAs. This is the first paper to examine 107 Information Systems and Human-Computer Interaction papers and identified 389 relationships between design elements and user acceptance of IAs. Along the independent and dependent variables of these relationships, we span a research space model encompassing empirical research on designing for IA user acceptance. Further we contribute to theory, by presenting a research agenda along the dimensions of the research space, which shall be useful to both researchers and practitioners. This complements the past and present knowledge on designing for IA user acceptance with potential pathways into the future of IAs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Technology Acceptance Model 3 and a Research Agenda on Interventions
Venkatesh, V., & Bala, H. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00192.x · Cited by 8,159 · cited 2×
“In the vein of dependent variables, most studies share similar theoretical foundations, which are primarily based on the Technology Acceptance Model (TAM) (Davis, 1989) and its subsequent modifications, such as the TAM2 (Venkatesh & Davis, 2000), TAM3 (Venkatesh & Bala, 2008), Unified Theory of Technology Use and Acce…”
MethodAn alternative "description of personality": The Big-Five factor structure.
Goldberg, L. R. (1990) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.59.6.1216 · Cited by 6,652
Universal dimensions of social cognition: warmth and competence
Fiske, S. T., Cuddy, A. J. C., & Glick, P. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.11.005 · Cited by 4,567 · cited 1×
“Per the underlying assumption of sRAM, user acceptance of IAs is determined by how well IAs meet functional, socio-emotional, and relational requirements (Davis, 1989; Fiske et al., 2007; Solomon et al., 1985).”
BackgroundELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“The groundwork for the new technology was laid in 1966 when Joseph Weizenbaum created a computer program that communicated with humans via a text-based interface and passed the touring test (Weizenbaum, 1966).”
MethodThe Uncanny Valley [From the Field]
Mori, M., MacDorman, K., & Kageki, N. (2012) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2192811 · Cited by 3,542
Writing Integrative Literature Reviews: Guidelines and Examples
Torraco, R. J. (2005) · Human Resource Development Review · doi:10.1177/1534484305278283 · Cited by 3,534
Brave new world: service robots in the frontline
Wirtz, J., Patterson, P. G., Kunz, W. H., Gruber, T., Lu, V. N., Paluch, S., & Martins, A. (2018) · Journal of Service Management · doi:10.1108/josm-04-2018-0119 · Cited by 2,315 · cited 5×
“First, we present the scaffolding model developed by Wirtz et al. (2018) for the purpose of grounding the analysis of dependent variables on a solid theoretical basis.”
BackgroundMethodInfluentialvan Doorn, J., Mende, M., Noble, S. M., Hulland, J., Ostrom, A. L., Grewal, D., & Petersen, J. A. (2017) · Journal of Service Research · doi:10.1177/1094670516679272 · Cited by 1,344
Establishing and maintaining long-term human-computer relationships
Bickmore, T. W., & Picard, R. W. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1067860.1067867 · Cited by 1,333 · cited 1×
“…variables in this category were the like-ability of the IA (e.g., Chin & Yi, 2019; Miehle et al., 2018), the degree of involvement or engagement experienced by users (e.g., Van Es et al., 2002; Vugt et al., 2008), and the perceived closeness (Bickmore & Picard, 2005; SeoYoung Lee & Choi, 2017).”
BackgroundLuger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
Mainstream science on intelligence: An editorial with 52 signatories, history, and bibliography
Gottfredson, L. S. (1997) · Intelligence · doi:10.1016/s0160-2896(97)90011-8 · Cited by 1,137 · cited 2×
“638), which broadly speaking is the capacity of an entity for the acquisition and application of knowledge (Gottfredson, 1997).”
BackgroundA Review of the Predictors, Linkages, and Biases in IT Innovation Adoption Research
Jeyaraj, A., Rottman, J. W., & Lacity, M. C. (2006) · Journal of Information Technology · doi:10.1057/palgrave.jit.2000056 · Cited by 1,136
EDITOR'S COMMENTS: CONSTRUCT CLARITY IN THEORIES OF MANAGEMENT AND ORGANIZATION.
Suddaby, R. (2010) · Academy of Management Review · doi:10.5465/amr.2010.51141319 · Cited by 984
It's only a computer: virtual humans increase willingness to disclose
Lucas, G. M., Gratch, J., King, A., & Morency, L.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.043 · Cited by 977
Dellermann, D., Ebel, P., Söllner, M., & Leimeister, J. M. (2019) · Business & Information Systems Engineering · doi:10.1007/s12599-019-00595-2 · Cited by 826 · cited 3×
“…we refer to intelligence as “ the ability to accomplish complex goals, learn, reason, and adaptively perform effective actions within an environment ” (Dellermann et al., 2019, p. 638), which broadly speaking is the capacity of an entity for the acquisition and application of knowledge…”
BackgroundInfluentialSelf-citationMcLean, G., & Osei-Frimpong, K. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.05.009 · Cited by 762
Qiu, L., & Benbasat, I. (2009) · Journal of Management Information Systems · doi:10.2753/mis0742-1222250405 · Cited by 737
Artificial intelligence in organizations: New opportunities for phenomenon-based theorizing
von Krogh, G. (2018) · Academy of Management Discoveries · doi:10.5465/amd.2018.0084 · Cited by 641 · cited 1×
“Against the backdrop of the steep technological advancements in algorithms, data storage, and computing power during the last decades (von Krogh, 2018), which have facilitated the rise of Artificial Intelligence (AI), intelligent agents (IAs) are permeating both business and society.”
BackgroundUnleashing the Potential of Chatbots in Education: A State-Of-The-Art Analysis
Winkler, R., & Soellner, M. (2018) · Academy of Management Proceedings · doi:10.5465/ambpp.2018.15903abstract · Cited by 581
Nass, C., Steuer, J., & Tauber, E. R. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260288 · Cited by 579
What Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents
Clark, L., Pantidi, N., Cooney, O., Doyle, P., Garaialde, D., Edwards, J., Spillane, B., Gilmartin, E., Murad, C., Munteanu, C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300705 · Cited by 461 · cited 2×
“Researchers investigated the variables style (20 observations (OBS), e.g., Clark et al., 2019), adaptivity (10 OBS, e.g., Lee et al., 2019), and content (4 OBS, e.g., Clark et al., 2019).”
BackgroundAI-Based Digital Assistants: Opportunities, Threats, and Research Perspectives
Maedche, A., Legner, C., Benlian, A., Berger, B., Gimpel, H., Hess, T., Hinz, O., Morana, S., & Söllner, M. (2019) · Business & Information Systems Engineering · doi:10.1007/s12599-019-00600-8 · Cited by 432 · cited 4×
“According to Maedche et al. (2019), IAs are distinguishable from other entities of IS due to their capabilities for interaction and intelligence .”
BackgroundInfluentialSproull, L., Subramani, M., Kiesler, S., Walker, J., & Waters, K. (1996) · Human-Computer Interaction · doi:10.1207/s15327051hci1102_1 · Cited by 399 · cited 2×
“For example, the embodiment of the IA with facial expressions was perceived as more useful, and the users seemed to be more satisfied than with the faceless IA (Sproull et al., 1996).”
BackgroundLee, S., & Choi, J. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2017.02.005 · Cited by 388
Systematic Review: Trust-Building Factors and Implications for Conversational Agent Design
Rheu, M., Shin, J. Y., Peng, W., & Huh-Yoo, J. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1807710 · Cited by 360
Embodied Conversational Agent-Based Kiosk for Automated Interviewing
Nunamaker, J. F., Derrick, D. C., Elkins, A. C., Burgoon, J. K., & Patton, M. W. (2011) · Journal of Management Information Systems · doi:10.2753/mis0742-1222280102 · Cited by 280
An Initial Model of Trust in Chatbots for Customer Service—Findings from a Questionnaire Study
Nordheim, C. B., Følstad, A., & Bjørkli, C. A. (2019) · Interacting with Computers · doi:10.1093/iwc/iwz022 · Cited by 233 · cited 2×
“Concerning other perspectives of invisible design elements, the reasoning of Nordheim et al. (2019) indicates that attributing personality to IAs shall positively affect perceptions of trustworthiness.”
BackgroundWashington State University, Hess, T., Fuller, M., University of Massachusetts, A., Campbell, D., & Millsaps College (2009) · Journal of the Association for Information Systems · doi:10.17705/1jais.00216 · Cited by 233 · cited 2×
“Interaction Initial findings suggest that speaking versus talking with an interface can influence perceptions of social presence (Hess et al., 2009), such that generally voice-based interfaces are perceived as being more human-like.”
BackgroundResilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns
Ashktorab, Z., Jain, M., Liao, Q. V., & Weisz, J. D. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300484 · Cited by 224 · cited 1×
“Thereby, prior researchers have looked at usefulness (e.g., Qiu & Benbasat, 2010), ease of use ( e.g., Van Es et al., 2002 ) , and subjective social norms such as the quality of interaction (e.g., Ashktorab et al., 2019) and satisfaction (e.g., Chaves & Gerosa, 2018).”
BackgroundAnalyzing the past to prepare for the future
(2002) · MIS Quarterly · doi:10.5555/2017160.2017162 · Cited by 179
Conversational agents in business: A systematic literature review and future research directions
Bavaresco, R., Silveira, D., Reis, E., Barbosa, J., Righi, R., Costa, C., Antunes, R., Gomes, M., Gatti, C., Vanzin, M., et al. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100239 · Cited by 143 · cited 1×
“…of IAs (i.e., too high level of abstraction), or they focus on specific application domains such as education (e.g., Winkler & Söllner, 2018) or business (Bavaresco et al., 2020), which appears to be too narrow in scope to draw overall conclusions on user interaction (Pfeuffer et al., 2019).”
BackgroundFirst Impressions in Human--Agent Virtual Encounters
Cafaro, A., Vilhjálmsson, H. H., & Bickmore, T. (2016) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2940325 · Cited by 120
Liao, Q. V., Mas-ud Hussain, M., Chandar, P., Davis, M., Khazaeni, Y., Crasso, M. P., Wang, D., Muller, M., Shami, N. S., & Geyer, W. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173577 · Cited by 116 · cited 1×
“Researchers investigated the variables chronemics (3 OBS, e.g., Gnewuch et al., 2018) and personality (2 OBS, e.g., Liao et al., 2018).”
BackgroundLee, K., Lee, K. Y., & Sheehan, L. (2020) · Information Systems Frontiers · doi:10.1007/s10796-019-09975-1 · Cited by 95 · cited 5×
“Here, researchers have investigated IAs based on a variety of user interaction outcomes (e.g., attitudes, perceptions, intentions, and behavior as for instance, in Lee et al., 2020).”
BackgroundInfluentialThe effect of conversational agent skill on user behavior during deception
Schuetzler, R. M., Grimes, G. M., & Giboney, J. S. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.03.033 · Cited by 95
Sketching NLP: A Case Study of Exploring the Right Things To Design with Language Intelligence
Yang, Q., Cranshaw, J., Amershi, S., Iqbal, S. T., & Teevan, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300415 · Cited by 90
Hey Google, Can I Ask You Something in Private?
Cho, E. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300488 · Cited by 88 · cited 19×
“Prior researchers have found significant evidence when looking at the variable mode (15 OBS, Miehle et al., 2018).”
BackgroundInfluentialPorra, J., Lacity, M., & Parks, M. S. (2020) · Information Systems Frontiers · doi:10.1007/s10796-019-09969-z · Cited by 56
Kendall, L., Chaudhuri, B., & Bhalla, A. (2020) · Information Systems Frontiers · doi:10.1007/s10796-020-10015-6 · Cited by 37
Cited by
Janson, A. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107954 · Cited by 187
Self-citationTechnology acceptance research: Meta-analysis
Marikyan, D., Papagiannidis, S., & Stewart, G. (2026) · Journal of Information Science · doi:10.1177/01655515231191177 · Cited by 140
Schöbel, S., Schmitt, A., Benner, D., Saqr, M., Janson, A., & Leimeister, J. M. (2024) · Information Systems Frontiers · doi:10.1007/s10796-023-10375-9 · Cited by 127
“…for example, the role of trust supporting components (Rheu et al., 2021; V¨ossing et al., 2022), others discuss the meaning of disembodied chatbots in human-computer interaction (Chaves & Gerosa, 2021) or characteristics of the adoption of AI-based CAs (Rzepka & Berger, 2018; Elshan et al., 2022).”
Self-citationGao, J., Opute, A. P., Jawad, C., & Zhan, M. (2025) · Journal of Business Research · doi:10.1016/j.jbusres.2025.115661 · Cited by 36
Petsolari, M., Ibrahim, S. B., & Slovak, P. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642619 · Cited by 35
Metadata
- Authors
- Elshan, E., Zierau, N., Engel, C., Janson, A., & Leimeister, J. M.
- Venue
- Information Systems Frontiers
- Published
- 2022-01-04
- Volume
- 24
- Issue
- 3
- Pages
- 699-730
- ISSN
- 1387-3326 (ISSN-L)
- 1572-9419
- OpenAlex
- W4206671652
- Cited by
- 77
- References
- 41
- FWCI
- 4.69
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.