Designing Collaborative Intelligence Systems for Employee-AI Service Co-Production
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Employees increasingly co-produce services with artificial intelligence (AI). Focusing on system design, this research uncovers (1) which system features qualify an AI system as a so-called collaborative intelligence (CI) system, (2) to what extent CI systems influence work-related employee outcomes, and (3) which CI features relate to which outcomes. Based on an extensive literature review and a qualitative study, we demarcate CI from related concepts—such as hybrid intelligence, collective intelligence, and human-AI teaming—and identify five relevant CI system features: engagement, transparency, process control, outcome control, and reciprocal strength enhancement. Employing two scenario-based experiments with financial services employees ( N = 309) and HR professionals ( N = 345), we demonstrate that strong CI systems (i.e., characterized by the aforementioned five features) significantly relate to perceived service improvement, perceived outcome responsibility, (threat to) meaning of work, and adherence to the system. Particularly, transparency, process control, and outcome control are important design features, while, surprisingly, engagement seems less relevant. We also identify previous AI experience of employees as an important contingency factor: effects are much stronger for AI novices. Our research contributes to service literature by defining CI systems, while practitioners may benefit from our blueprint for CI system design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349 · cited 1×
“The data was analyzed by two researchers along pre-de fi ned coding rules (Cohen ’ s Kapa = 0.68; an inter-coder reliability considered satisfactory; Cicchetti 1994).”
InfluentialCustomer Engagement: Conceptual Domain, Fundamental Propositions, and Implications for Research
Brodie, R. J., Hollebeek, L. D., Jurić, B., & Ilić, A. (2011) · Journal of Service Research · doi:10.1177/1094670511411703 · Cited by 3,622
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232 · cited 1×
“In many cases, AI systems are superior to humans, but employees fail to trust the respective advice (Dietvorst, Simmons, and Massey 2015).”
MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011) · MIS Quarterly · doi:10.2307/23044045 · Cited by 3,165 · cited 1×
“Our aim was to gain an overview of how CI and related constructs have been de fi ned and to identify the relevant design features that relate to successful employee-CI co-production (cf. MacKenzie, Podsakoff, and Podsakoff 2011; Walls, Widmeyer, and El Sawy 2004).”
Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making
Jarrahi, M. H. (2018) · Business Horizons · doi:10.1016/j.bushor.2018.03.007 · Cited by 2,772
Brave new world: service robots in the frontline
Wirtz, J., Patterson, P. G., Kunz, W. H., Gruber, T., Lu, V. N., Paluch, S., & Martins, A. (2018) · Journal of Service Management · doi:10.1108/josm-04-2018-0119 · Cited by 2,315 · cited 2×
“Second, in contrast to lively discussions on customers and their AI perceptions (e.g., Le et al. 2024; Wirtz et al. 2018) and despite repeated calls to consider the employee perspective (e.g., Ostrom et al. 2021; Xiao and Kumar 2021), insights on how employees deal with AI systems in their daily…”
Empirical validation of affect, behavior, and cognition as distinct components of attitude.
Breckler, S. J. (1984) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.47.6.1191 · Cited by 1,593
Task-Dependent Algorithm Aversion
Castelo, N., Bos, M. W., & Lehmann, D. R. (2019) · Journal of Marketing Research · doi:10.1177/0022243719851788 · Cited by 1,500 · cited 1×
“Furthermore, research shows that people are less averse to using an algorithm when they know that the algorithm is capable of performing the task (Bigman and Gray 2018; Castelo, Bos, and Lehmann 2019).”
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2018) · Management Science · doi:10.1287/mnsc.2016.2643 · Cited by 1,230
Mende, M., Scott, M. L., van Doorn, J., Grewal, D., & Shanks, I. (2019) · Journal of Marketing Research · doi:10.1177/0022243718822827 · Cited by 1,197 · cited 1×
“…toward human-AI service co-production, rather than an employee perspective, and have consequently focused on outcomes such as service experience (McLeay et al. 2021), use intention (Mende et al. 2019), customer satisfaction (Le et al. 2024), and willingness to share data (Song and Kim 2021).”
AI-based chatbots in customer service and their effects on user compliance
Adam, M., Wessel, M., & Benlian, A. (2021) · Electronic Markets · doi:10.1007/s12525-020-00414-7 · Cited by 1,195 · cited 1×
“Such agency perceptions can lead to increased attribution of responsibility to AI systems (e.g., Johnson, Veltri, and Hornik 2008; Zafari and Koeszegi 2021) and might thus diminish perceived outcome responsibility while they increase adherence to the system (e.g., Adam, Wessel, and Benlian 2021).”
Competitive Advantage through Engagement
Kumar, V., & Pansari, A. (2016) · Journal of Marketing Research · doi:10.1509/jmr.15.0044 · Cited by 1,182
Buçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124 · cited 2×
“…have drawbacks, such as inducing threat to meaning of work (Smids, Nyholm, and Berkers 2020), stimulate employees ’ overreliance on AI recommendations (Buçinca, Malaya, and Gajos 2021), and decrease the extent to which they want to take responsibility for their service behavior (Santoni de Sio…”
Machines as teammates: A research agenda on AI in team collaboration
Seeber, I., Bittner, E., Briggs, R. O., de Vreede, T., de Vreede, G.-J., Elkins, A., Maier, R., Merz, A. B., Oeste-Reiß, S., Randrup, N., et al. (2020) · Information & Management · doi:10.1016/j.im.2019.103174 · Cited by 835 · cited 2×
“As notable exceptions, Seeber et al. (2020) and Dellermann et al. (2019; 2021) describe AI meta-design categories (e.g., appearance and conversation) but not their functionality nor how they relate to user outcomes.”
Dellermann, D., Ebel, P., Söllner, M., & Leimeister, J. M. (2019) · Business & Information Systems Engineering · doi:10.1007/s12599-019-00595-2 · Cited by 826 · cited 4×
“…system — as we have de fi ned it — represents a unique concept, we demarcate it from six related concepts in literature, namely, hybrid intelligence (Dellermann et al. 2019, 2021), human-AI symbiosis (Jarrahi 2018), collective intelligence (Gavriushenko, Kaikova, and Terziyan 2020), intelligence…”
InfluentialTransparency and the black box problem: why we do not trust AI
von Eschenbach, W. J. (2021) · Philosophy & Technology · doi:10.1007/s13347-021-00477-0 · Cited by 786 · cited 1×
“As a result, the typical black box problem of AI systems — which can undermine system acceptance in service co-production — is mitigated (von Eschenbach 2021; Gomez, Unberath, and Huang 2023).”
“Service Encounter 2.0”: An investigation into the roles of technology, employees and customers
Larivière, B., Bowen, D., Andreassen, T. W., Kunz, W., Sirianni, N. J., Voss, C., Wünderlich, N. V., & De Keyser, A. (2017) · Journal of Business Research · doi:10.1016/j.jbusres.2017.03.008 · Cited by 779 · cited 1×
“…(Dellermann et al. 2019, 2021), human-AI symbiosis (Jarrahi 2018), collective intelligence (Gavriushenko, Kaikova, and Terziyan 2020), intelligence augmentation (Larivière et al. 2017), human-AI teaming (Dubey et al. 2020), and machines-as-teammates (Lyons et al. 2021; Seeber et al. 2020).”
People are averse to machines making moral decisions.
Bigman, Y. E., & Gray, K. (2018) · Cognition · doi:10.1016/j.cognition.2018.08.003 · Cited by 738 · cited 1×
“Furthermore, research shows that people are less averse to using an algorithm when they know that the algorithm is capable of performing the task (Bigman and Gray 2018; Castelo, Bos, and Lehmann 2019).”
Lebovitz, S., Lifshitz-Assaf, H., & Levina, N. (2022) · Organization Science · doi:10.1287/orsc.2021.1549 · Cited by 632 · cited 2×
“For example, when physicians co-produce health evaluations with AI systems (Lebovitz, Lifshitz-Assaf, and Levina 2022) and lawyers make use of contract review systems (Spring, Faulconbridge, and Sarwar 2022), shifting responsibility for service outcomes to the AI system might facilitate undesirable…”
To Err Is Human(-oid): How Do Consumers React to Robot Service Failure and Recovery?
Choi, S., Mattila, A. S., & Bolton, L. E. (2021) · Journal of Service Research · doi:10.1177/1094670520978798 · Cited by 502
Four Responsibility Gaps with Artificial Intelligence: Why they Matter and How to Address them
Santoni de Sio, F., & Mecacci, G. (2021) · Philosophy & Technology · doi:10.1007/s13347-021-00450-x · Cited by 490 · cited 2×
“This outcome is important as AI service co-production may raise responsibility issues (Santoni de Sio and Mecacci 2021).”
The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systems
Dellermann, D., Calma, A., Lipusch, N., Weber, T., Weigel, S., & Ebel, P. (2021) · arXiv · doi:10.48550/arxiv.2105.03354 · Cited by 456
Adoption of artificial intelligence (AI) for talent acquisition in IT/ITeS organizations
Pillai, R., & Sivathanu, B. (2020) · Benchmarking: An International Journal · doi:10.1108/bij-04-2020-0186 · Cited by 422 · cited 1×
“Feelings of improvement are important because when employees perceive technology to be bene fi cial for their work outcomes, they use it more (Pillai and Sivathanu 2020).”
Paschen, J., Wilson, M., & Ferreira, J. J. (2020) · Business Horizons · doi:10.1016/j.bushor.2020.01.003 · Cited by 410 · cited 4×
“We contribute to literature on employee-AI interaction in service contexts (e.g., Epstein 2015; Paschen, Wilson, and Ferreira 2020); building on the ABC model (Breckler 1984) we comprehensively show the impact of our CI system features on four relevant work-related outcomes: threat to meaning of…”
InfluentialAI-enabled recruiting: What is it and how should a manager use it?
Black, J. S., & van Esch, P. (2020) · Business Horizons · doi:10.1016/j.bushor.2019.12.001 · Cited by 403 · cited 1×
“At the same time, since decisions involve future careers and are subject to ethical and legal standards, there will always be humans in the loop (Spring, Faulconbridge, and Sarwar 2022) and employee-AI collaboration is becoming a workplace norm (Black and van Esch 2020).”
The rise of artificial intelligence – understanding the AI identity threat at the workplace
Mirbabaie, M., Brünker, F., Möllmann Frick, N. R. J., & Stieglitz, S. (2022) · Electronic Markets · doi:10.1007/s12525-021-00496-x · Cited by 362
The Future of Human-AI Collaboration: A Taxonomy of Design Knowledge for Hybrid Intelligence Systems
Dellermann, D., Calma, A., Lipusch, N., Weber, T., Weigel, S., & Ebel, P. (2019) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2019.034 · Cited by 279 · cited 5×
“As notable exceptions, Seeber et al. (2020) and Dellermann et al. (2019; 2021) describe AI meta-design categories (e.g., appearance and conversation) but not their functionality nor how they relate to user outcomes.”
InfluentialUser acceptance of agile information systems: a model and empirical test
Hong, W., Thong, J. Y. L., Chasalow, L. C., & Dhillon, G. (2011) · Journal of Management Information Systems · doi:10.2753/mis0742-1222280108 · Cited by 212 · cited 2×
“Theoretical Background: Affect-Behavior-Cognition Model Employee responses to information technology are multi-faceted and encompass a range of responses (Hong et al. 2011).”
Weber, E., Büttgen, M., & Bartsch, S. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.01.036 · Cited by 205
Self-citationCollaboration among recruiters and Artificial Intelligence: Removing human prejudices in employment
Chen, Z. (2023) · Cognition, Technology & Work · doi:10.1007/s10111-022-00716-0 · Cited by 164
Cited by
Stylos, N., Okumus, F., & Onder, I. (2025) · Tourism Management · doi:10.1016/j.tourman.2025.105205 · Cited by 18
GenAI-Infused Service Delivery: Micro-Level Augmentation Patterns at the Service Frontline
Reinhard, P., Li, M. M., Peters, C., Janson, A., & Leimeister, J. M. (2026) · Journal of Service Research · doi:10.1177/10946705251414283 · Cited by 6
“Augmentation enables humans and AI to perform complementary or joint tasks and to co-produce the service (Blaurock, Büttgen, and Schepers 2024), while implicitly reconfiguring professional roles, positioning humans not just as service providers, but as collaborators, coordinators, or…”
InfluentialAI4Research: a survey of artificial intelligence for scientific research
Chen, Q., Yang, M., Qin, L., Liu, J., Yan, Z., Guan, J., Peng, D., Ji, Y., Li, H., Hu, M., et al. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-5000-y · Cited by 4
From testbeds to high-stakes work: a review of human-AI teaming domains and teaming factors
Kargarnovin, S., Hernandez, C. I., Reiners, D., Cruz-Neira, C., Bochenek, G., & Karwowski, W. (2026) · Frontiers in Robotics and AI · doi:10.3389/frobt.2026.1733942 · Cited by 2
“Early in adoption, pairing transparency with simple process/outcome controls lifted perceived service quality and reduced “threat to meaning” especially for AI novices (Blaurock et al., 2024).”
Metadata
- Authors
- Blaurock, M., Büttgen, M., & Schepers, J.
- Venue
- Journal of Service Research
- Publisher
- SAGE Publications
- Published
- 2024-03-18
- Volume
- 28
- Issue
- 4
- Pages
- 544-562
- ISSN
- 1094-6705 (ISSN-L)
- 1552-7379
- OpenAlex
- W4395089999
- Cited by
- 55
- References
- 30
- FWCI
- 8.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.