The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Will Humans-in-the-Loop Become Borgs? Merits and Pitfalls of Working with AI
Open accessAbstract
We analyze how advice from an AI affects complementarities between humans and AI, in particular what humans know that an AI does not know: “unique human knowledge.” In a multi-method study consisting of an analytical model, experimental studies, and a simulation study, our main finding is that human choices converge toward similar responses improving individual accuracy. However, as overall individual accuracy of the group of humans improves, the individual unique human knowledge decreases. Based on this finding, we claim that humans interacting with AI behave like “Borgs,” that is, cyborg creatures with strong individual performance but no human individuality. We argue that the loss of unique human knowledge may lead to several undesirable outcomes in a host of human–AI decision environments. We demonstrate this harmful impact on the “wisdom of crowds.” Simulation results based on our experimental data suggest that groups of humans interacting with AI are far less effective as compared to human groups without AI assistance. We suggest mitigation techniques to create environments that can provide the best of both worlds (e.g., by personalizing AI advice). We show that such interventions perform well individually as well as in wisdom of crowds settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Statistical Power Analysis for the Behavioral Sciences
Cohen, J. (2013) · doi:10.4324/9780203771587 · Cited by 25,373
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
Groups of diverse problem solvers can outperform groups of high-ability problem solvers
Hong, L., & Page, S. E. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0403723101 · Cited by 2,103
The preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998
Awad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2018) · Nature · doi:10.1038/s41586-018-0637-6 · Cited by 1,859
GALTON, F. (1907) · Nature · doi:10.1038/075450a0 · Cited by 1,080
How social influence can undermine the wisdom of crowd effect
Lorenz, J., Rauhut, H., Schweitzer, F., & Helbing, D. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1008636108 · Cited by 1,017
Cited by
Generative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363
Ooi, K.-B., Tan, G. W.-H., Al-Emran, M., Al-Sharafi, M. A., Capatina, A., Chakraborty, A., Dwivedi, Y. K., Huang, T.-L., Kar, A. K., Lee, V.-H., et al. (2025) · Journal of Computer Information Systems · doi:10.1080/08874417.2023.2261010 · Cited by 746
Managing artificial intelligence
Berente, N., Gu, B., Recker, J., & Santhanam, R. (2021) · MIS Quarterly · doi:10.25300/misq/2021/16274 · Cited by 898
Thinking responsibly about responsible AI and ‘the dark side’ of AI
Mikalef, P., Conboy, K., Lundström, J. E., & Popovič, A. (2022) · European Journal of Information Systems · doi:10.1080/0960085x.2022.2026621 · Cited by 435
Unveiling the shadows: beyond the hype of AI in education
Al-Zahrani, A. M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e30696 · Cited by 225
Large Language Model in Creative Work: The Role of Collaboration Modality and User Expertise
Chen, Z., & Chan, J. (2024) · Management Science · doi:10.1287/mnsc.2023.03014 · Cited by 204
Toward AI Governance: Identifying Best Practices and Potential Barriers and Outcomes
Papagiannidis, E., Enholm, I. M., Dremel, C., Mikalef, P., & Krogstie, J. (2023) · Information Systems Frontiers · doi:10.1007/s10796-022-10251-y · Cited by 191
Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations
Schemmer, M., Kuehl, N., Benz, C., Bartos, A., & Satzger, G. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584066 · Cited by 208
From explainable to interactive AI: A literature review on current trends in human-AI interaction
Raees, M., Meijerink, I., Lykourentzou, I., Khan, V.-J., & Papangelis, K. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103301 · Cited by 180
The risk of algorithm transparency: How algorithm complexity drives the effects on the use of advice
Lehmann, C. A., Haubitz, C. B., Fügener, A., & Thonemann, U. W. (2022) · Production and Operations Management · doi:10.1111/poms.13770 · Cited by 100
Self-citationAI Literacy - Towards Measuring Human Competency in Artificial Intelligence
Pinski, M., & Benlian, A. (2023) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2023.021 · Cited by 94
A Meta-Analysis of the Utility of Explainable Artificial Intelligence in Human-AI Decision-Making
Schemmer, M., Hemmer, P., Nitsche, M., Kühl, N., & Vössing, M. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534128 · Cited by 91
Introduction to large language models (LLMs) for dementia care and research
Treder, M. S., Lee, S., & Tsvetanov, K. A. (2024) · Frontiers in Dementia · doi:10.3389/frdem.2024.1385303 · Cited by 63
AI Knowledge: Improving AI Delegation through Human Enablement
Pinski, M., Adam, M., & Benlian, A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580794 · Cited by 62
Adam, M., Diebel, C., Goutier, M., & Benlian, A. (2024) · Decision Support Systems · doi:10.1016/j.dss.2024.114193 · Cited by 62
Experimental evidence of the effects of large language models versus web search on depth of learning
Melumad, S., & Yun, J. H. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf316 · Cited by 61
The Double-Edged Roles of Generative AI in the Creative Process: Experiments on Design Work
Hou, J. (., Wang, L., Wang, G., Wang, H. J., & Yang, S. (2025) · Information Systems Research · doi:10.1287/isre.2024.0937 · Cited by 63
Mobilising new frontiers in digital transformation research: A problematization review
Ashrafi, A., Constantinides, P., Mehandjiev, N., & Thatcher, J. B. (2025) · Information Systems Journal · doi:10.1111/isj.12531 · Cited by 33
“For example, research has found that, artificial actors can, over time, homogenise the performance of human actors, since the latter lose their unique knowledge about what needs to be performed and learn to (blindly) follow the suggestions of artificial actors (Fügener et al., 2021).”
Generative AI and Organizational Structure in the Knowledge Economy
Xu, F., Hou, J., Chen, W., & Xie, K. (2025) · arXiv · doi:10.48550/arxiv.2506.00532 · Cited by 22
Human Delegation Behavior in Human-AI Collaboration: The Effect of Contextual Information
Spitzer, P., Holstein, J., Hemmer, P., Vössing, M., Kühl, N., Martin, D., & Satzger, G. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710999 · Cited by 18
High-risk artificial intelligence
Sunyaev, A., Benlian, A., Pfeiffer, J., Jussupow, E., Thiebes, S., Maedche, A., & Gawlitza, J. (2025) · Business & Information Systems Engineering · doi:10.1007/s12599-025-00942-6 · Cited by 16
Death by AI: Will large language models diminish Wikipedia?
Wagner, C., & Jiang, L. (2025) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24975 · Cited by 13
Are numerical or verbal explanations of AI the key to appropriate user reliance and error detection?
Papenkordt, J., Ngonga Ngomo, A.-C., & Thommes, K. (2026) · Behaviour & Information Technology · doi:10.1080/0144929x.2025.2568928 · Cited by 2
“Fundamentally, the question arises as to how the strengths of humans and AI can be balanced in a symbiotic relationship (Fügener et al. 2021, 2022), requiring responsible AI (Mikalef et al. 2022).”
Khan, R. A., Feng, G., & Zhu, J. (2026) · Journal of Organizational Computing and Electronic Commerce · doi:10.1080/10919392.2025.2563463 · Cited by 2
When Recruiters Meet Algorithms: Advice Taking and Bias in AI‐Assisted Recruitment
Lacroux, A., & Martin Lacroux, C. (2026) · International Journal of Selection and Assessment · doi:10.1111/ijsa.70085
Metadata
- Authors
- Fügener, A., Grahl, J., Gupta, A., & Ketter, W.
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 2021-09-01
- Volume
- 45
- Issue
- 3
- Pages
- 1527-1556
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W3201195645
- Cited by
- 303
- References
- 20
- FWCI
- 30.22
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
