How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
The development of AI applications is a multidisciplinary effort, involving multiple roles collaborating with the AI developers, an umbrella term we use to include data scientists and other AI-adjacent roles on the same team. During these collaborations, there is a knowledge mismatch between AI developers, who are skilled in data science, and external stakeholders who are typically not. This difference leads to communication gaps, and the onus falls on AI developers to explain data science concepts to their collaborators. In this paper, we report on a study including analyses of both interviews with AI developers and artifacts they produced for communication. Using the analytic lens of shared mental models, we report on the types of communication gaps that AI developers face, how AI developers communicate across disciplinary and organizational boundaries, and how they simultaneously manage issues regarding trust and expectations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“AI documentation is advocated to increase the transparency and facilitate understanding of AI [35,36,40,75,76,82], and is embodied in recently proposed features of AI Factsheets [8,81] and Model Cards [64].”
From Investigating Explainability of Generative AI for Code through Scenario-based Design (2022) · cites this paper as [76]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“In addition, AI -based translation tools can help bridge the communication gap between employees with different language backgrounds and help them communicate effectively (Piorkowski et al., 2021).”
From The Impact of Artificial Intelligence on Workers' Skills: Upskilling and Reskilling in Organisations (2023) · cites this paper as Piorkowski et al., 2021
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Clark, H. H., & Brennan, S. E. (1991) · Perspectives on socially shared cognition. · doi:10.1037/10096-006 · Cited by 4,555
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“Existing efforts around documenting aspects of the AI lifecycle in dataset documentation [15] and model service documentation [4, 34] are fairly static and do not consider questions of how to dynamically vary the content that is displayed for the role in question.”
BackgroundMcDonald, N., Schoenebeck, S., & Forte, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359174 · Cited by 1,206
Software Engineering for Machine Learning: A Case Study
Amershi, S., Begel, A., Bird, C., DeLine, R., Gall, H., Kamar, E., Nagappan, N., Nushi, B., & Zimmermann, T. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip.2019.00042 · Cited by 1,135 · cited 6×
“Echoing findings from previous work, one of the common practices is to hold AI education sessions for software engineers to overcome the knowledge barrier [2].”
BackgroundInfluentialMetaphor No More: A 15-Year Review of the Team Mental Model Construct
Mohammed, S., Ferzandi, L., & Hamilton, K. (2010) · Journal of Management · doi:10.1177/0149206309356804 · Cited by 832 · cited 1×
“This allows them to more readily anticipate each others’ needs and work together more efficiently [35].”
BackgroundAustin, J. R. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.866 · Cited by 656 · cited 1×
“[69] summarized four stages for developing an SMM within agile software development teams from prior literature: knowing meta-knowledge of the team [26, 32], learning and building the team’s transactive memory system [6], understanding and reaching consensus [53], and executing team goals.”
MethodA New Chatbot for Customer Service on Social Media
Xu, A., Liu, Z., Guo, Y., Sinha, V., & Akkiraju, R. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025496 · Cited by 550 · cited 1×
“AI has been widely applied to many domains such as helping diagnose patients [14, 60], building chatbots to improve customer service [29, 66], and enhancing the education experience with intelligent tutoring systems [67].”
BackgroundSurvey on user interface programming
Myers, B. A., & Rosson, M. B. (1992) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '92 · doi:10.1145/142750.142789 · Cited by 445 · cited 1×
“Software development teams tend to spend extensive time on planning and brainstorming [39].”
BackgroundFactSheets: Increasing trust in AI services through supplier's declarations of conformity
Arnold, M., Bellamy, R. K. E., Hind, M., Houde, S., Mehta, S., Mojsilović, A., Nair, R., Ramamurthy, K. N., Olteanu, A., Piorkowski, D., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2942288 · Cited by 434 · cited 1×
“Existing efforts around documenting aspects of the AI lifecycle in dataset documentation [15] and model service documentation [4, 34] are fairly static and do not consider questions of how to dynamically vary the content that is displayed for the role in question.”
BackgroundSelf-citationTeam learning: building shared mental models
Van den Bossche, P., Gijselaers, W., Segers, M., Woltjer, G., & Kirschner, P. (2011) · Instructional Science · doi:10.1007/s11251-010-9128-3 · Cited by 379 · cited 2×
“In this approach, an SMM provides one means to establish common ground [53].”
BackgroundMethod
Research works printed but not linked: 19
- Arunima Chaudhary et almbox. 2021. AutoText: An End-to-End AutoAI Framework for Text. In AAAI. ACM.
- Herbert H Clark. 2006. Context and common ground. Concise Encyclopedia of Philosophy of Language and Linguistics (2006), 85--87.
- Sharolyn Converse, JA Cannon-Bowers, and E Salas. 1993. Shared mental models in expert team decision making. Individual and group decision making: Current issues, Vol. 221 (1993), 221--46.
- Paul Dourish. 2014. Reading and interpreting ethnography. In Ways of Knowing in HCI. Springer, 1--23.
- Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumeé III, and Kate Crawford. 2018. Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018). · arXiv
- Penny Lacey. 2002. 9 Multidisciplinary Work Challenges and Possibilities. Special Education Reformed: Inclusion-Beyond Rhetoric? (2002), 157.
- Charlotte P Lee and Drew Paine. 2015. From The Matrix to a Model of Coordinated Action (MoCA) A Conceptual Framework of and for CSCW. In Proceedings of the 18th ACM conference on computer supported cooperative work & social computing. 179--194.
- M Lee, Tristan Johnson, and Myung H Jin. 2012. Toward understanding the dynamic relationship between team and task shared mental models as determinants of team and individual performances. International journal of information technology and business management, Vol. 8, 1 (2012), 1--14.
- Sara A McComb. 2007. Mental model convergence: The shift from being an individual to being a team member. Research in multi-level issues, Vol. 6 (2007), 95--147.
- Michael Muller, Melanie Feinberg, Timothy George, Steven J Jackson, Bonnie E John, Mary Beth Kery, and Samir Passi. 2019 a. Human-Centered Study of Data Science Work Practices. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, W15.
- DJ Patil. 2011. Building data science teams." O'Reilly Media, Inc.".
- Gerry Stahl. 2013. Theories of collaborative cognition: Foundations for CSCL and CSCW together. In Computer-supported collaborative learning at the workplace. Springer, 43--63.
- Christoph Treude Margaret-anne Storey and Jens Weber. 2009. Empirical studies on collaboration in software development: A systematic literature review. (2009).
- Wil MP Van der Aalst. 2014. Data scientist: The engineer of the future. In Enterprise interoperability VI. Springer, 13--26.
- April Yi Wang, Anant Mittal, Christopher Brooks, and Steve Oney. 2019 a. How Data Scientists Use Computational Notebooks for Real-Time Collaboration. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--30.
- Dakuo Wang, Liuping Wang, Zhan Zhang, Ding Wang, Haiyi Zhu, Yvonne Gao, Xiangmin Fan, and Feng Tian. 2021 c. Brilliant AI Doctor in Rural China: Tensions and Challenges in AI-Powered CDSS Deployment. In Proceedings of the CHI 2021.
- Bryan Wilder, Eric Horvitz, and Ece Kamar. 2020. Learning to Complement Humans. arXiv preprint arXiv:2005.00582 (2020). · arXiv
- Ying Xu, Dakuo Wang, Penelope Collins, Hyelim Lee, and Mark Warschauer. [n.d.]. Same benefits, different communication patterns: Comparing Children's reading with a conversational agent vs. a human partner. Computers & Education, Vol. 161 ([n.,d.]), 104059.
- Xiaodan Yu and Stacie Petter. 2014. Understanding agile software development practices using shared mental models theory. Information and software technology, Vol. 56, 8 (2014), 911--921.
Cited by
Items 101–151 of 151
Leveraging Large Language Models to Enhance Domain Expert Inclusion in Data Science Workflows
Shih, J. Y., Mohanty, V., Katsis, Y., & Subramonyam, H. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3651115 · Cited by 4
Zhu, Q., Wang, D., Ma, S., Wang, A. Y., Chen, Z., Khurana, U., & Ma, X. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661517 · Cited by 6
“Given FE’s interdisciplinary and collaborative nature, many HCI papers have focused on studying how to facilitate the collaboration among DS practitioners or between them and other roles (e.g., domain experts) in a DS project [59, 61, 67, 69, 82].”
BackgroundSelf-citationBusquim, G., Araújo, A. A., Lima, M. J., & Kalinowski, M. (2024) · Simpósio Brasileiro de Engenharia de Software (SBES) · doi:10.5753/sbes.2024.3027 · Cited by 9
Nahar, N., Zhou, S., Lewis, G. A., & Kästner, C. (2021) · arXiv (Cornell University) · Cited by 6
Correa, T., Luco, F., Humeres, M., Cotorás, D., Davidoff, A., Hernández-Estrada, Y., Oyarzún-Merino, I., & López, C. (2025) · Communication and Change · doi:10.1007/s44382-025-00012-1 · Cited by 8
Ethics and Law for the Use and Development of Artificial Intelligence Technology
Mulyana, H. (2023) · East Asian Journal of Multidisciplinary Research · doi:10.55927/eajmr.v2i11.2947 · Cited by 4
Bakogeorge, A., Imtiaz, S. A., Hantash, N. A., Manshaei, R., & Mazalek, A. (2024) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/3623509.3633370 · Cited by 3
Erdoğan, T. G., Altunel, H., & Tarhan, A. (2024) · Journal of Software Evolution and Process · doi:10.1002/smr.2743 · Cited by 4
Cross-Cultural Training for HR Professionals in Multilingual Corporates
Al-Tarawneh, A., & Al-Badawi, M. A. (2025) · Studies in systems, decision and control · doi:10.1007/978-3-031-76011-2_58 · Cited by 2
Development and Deployment Challenges of Machine Learning Systems
Honkanen, T., O’Dwyer, J., Salminen, V., & Jussila, J. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-64359-0_15 · Cited by 2
Designing Data Science Software for Social Care Organisations
Reinmund, T. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3577062 · Cited by 1
Qasemy, H. E. (2025) · Westcliff International Journal of Applied Research · doi:10.47670/wuwijar20251heq · Cited by 1
“For instance, in healthcare, machine learning models can predict disease outcomes and identify potential areas for intervention (Davenport & Ronanki, 2018; Piorkowski et al., 2021).”
Salhab, M. A., & Sohai, N. (2026) · International Journal of ADVANCED AND APPLIED SCIENCES · doi:10.21833/ijaas.2026.04.014 · Cited by 1
Symbols to represent AI systems
Hawkes, T. D., & Bihl, T. (2021) · IEEE National Aerospace and Electronics Conference (NAECON) · doi:10.1109/naecon49338.2021.9696419 · Cited by 2
Gonzalez, M. F., & Cheban, Y. (2022) · Industrial and Organizational Psychology · doi:10.1017/iop.2022.55 · Cited by 1
“Each field has its own jargon that may facilitate communication within a given discipline but may also impede communication between disciplines (e.g., Piorkowski et al., 2021).”
BackgroundDhiman, H., Michael Fellmann, M. A., & Röcker, C. (2022) · Lecture notes in business information processing · doi:10.1007/978-3-031-16947-2_7 · Cited by 1
Rungbanapan, V., Thaipisutikul, T., Pongpaichet, S., Supratak, A., Lin, C., & Tuarob, S. (2022) · International Computer Science and Engineering Conference · doi:10.1109/icsec56337.2022.10049348 · Cited by 1
“Therefore, if these gorithmic process and source code [4].”
BackgroundVänskä, S., Kemell, K., Mikkonen, T., & Abrahamsson, P. (2023) · e-Informatica Software Engineering Journal · doi:10.37190/e-inf240102 · Cited by 8
“It seems common for ML experts to work in a silo [22] [21], although there are also examples of successfully integrating ML experts with the rest of the development team(s) found in existing papers [23].”
BackgroundA Case Study on Data Science Processes in an Academia-Industry Collaboration
Silva, S., & de França, B. B. N. (2023) · Brazilian Symposium on Software Quality (SBQS) · doi:10.1145/3629479.3629514 · Cited by 3
“What helps to deal with the challenges and communication gaps, which are pointed out in the work by Piorkowsk et al. [21], where the authors emphasize that there is no such participation and exchange between teams during the steps of the development process.”
BackgroundInfluentialInvestigations to Facilitate Human-Centred AI Development in Manufacturing
Hartikainen, M. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240210 · Cited by 1
Schrimpff, C., Link, E., Fisse, T., Baumann, E., & Klimmt, C. (2025) · Health Communication · doi:10.1080/10410236.2024.2447548 · Cited by 1
“To recognize and overcome such barriers to understanding and acceptance, health communication approaches can involve members of the public in the development of new technologies from an early stage on (Bruine de Bruin & Bostrom, 2013; Leitch, 2022; Piorkowski et al., 2021).”
From OSS to Open Source AI: an Exploratory Study of Collaborative Development Paradigm Divergence
Ye, H., & Zhou, M. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816938 · Cited by 1
Exploring the Community of Model Publishers on TensorFlow Hub
Yoo, T., Chun, M., Bae, Y., Kwon, S., & Jung, H. (2022) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3500868.3559477 · Cited by 1
“Researchers examined the community of programmers developing AI models [3, 19, 20].”
BackgroundDas, S., Hossain, M., & Shiva, S. G. (2023) · doi:10.1109/icit58056.2023.10225934 · Cited by 2
D2S: Document-to-Slide Generation Via Query-Based Text SummarizationPreprint
Sun, E., Hou, Y., Wang, D., Zhang, Y., & Wang, N. X. R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.03664 · Cited by 1
“From business to education to research, presentations are everywhere as they are visually effective in summarizing and explaining bodies of work to the audience (Bartsch and Cobern, 2003; Wang, 2016; Piorkowski et al., 2021).”
BackgroundSelf-citationPark, S. (2021) · doi:10.18653/v1/2021.dash-1.7
“Second, many steps in an ML development pipeline, from problem definition to feature engineering to model debugging, necessitate an understanding of domain-specific knowledge and requirements (Piorkowski et al., 2021).”
BackgroundSelf-citationImproving Real-Time Collaborative Data Science Through Context-Aware Mechanisms
Wang, A. Y. (2022) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc53370.2022.9833140 · Cited by 1
Self-citationSystems for Socially-Challenging Information Management
Park, S. (2022) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3500868.3561400
“In such teams, the team members are concerned about communication gaps stemming from mismatched expertise within the teams [11].”
BackgroundSelf-citationHenkin, R., Remfry, E., Reynolds, D. J., Clinch, M., & Barnes, M. R. (2026) · PLoS ONE · doi:10.1371/journal.pone.0354358 · Cited by 4
Park, S., Vishwabhan, S., Muller, M. J., & Karger, D. R. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3652603 · Cited by 1
Self-citationDevelopment of AI-tools for making sense of future complex intelligent systems
Särner, E. (2024) · Linköping studies in science and technology. Thesis · doi:10.3384/9789180756228 · Cited by 1
Domain Knowledge Elicitation for Data Curation to Promote Trustworthiness in Artificial Intelligence
Clemens-Sewall, M. V., Rafkin, E., & Cervantes, C. M. (2024) · IEEE International Conference on Assured Autonomy (ICAA) · doi:10.1109/icaa64256.2024.00013
Fan, G. (2024) · Frontiers in Business Economics and Management · doi:10.54097/etk4nv32
“According to Piorkowski (2021), having strong communication and listening abilities were associated with flexibility in international work chances.”
Raymond, C., Ratté, S., & Daoust, M. (2024) · IEEE International Conference on Collaborative Advances in Software and Computing (CASCON) · doi:10.1109/cascon62161.2024.10837695 · Cited by 1
Harnessing Big Data Analytics for Strategic Supply Chain Decisions
Naithani, K., Raiwani, Y. P., & Tiwari, S. (2025) · Flexible systems management · doi:10.1007/978-981-96-3556-6_8
Building Multidisciplinary Knowledge for Global Scholars and Professionals
Mehrad, A. (2025) · European Economic Letters (EEL) · doi:10.52783/eel.v15i3.3382
Communication Challenges and Practices in AI-based Software Systems: An Exploratory Study
Paiva, S. M. M., Alves, A., Araújo, N., Massoni, T. L., & Ramalho, F. (2025) · Simpósio Brasileiro de Engenharia de Software (SBES) · doi:10.5753/sbes.2025.11574
Strategic integration of social media in IT sector communication: designing effective practicesPreprint
Kesar, B., & Joseph, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5643370
Empirical Assessment of Software Engineers’ Mental models in the Context of Digital Library SystemsPreprint
Islam, M. H., & Shanto, H. I. (2026) · doi:10.14293/pr2199.002898.v1
Reproducibility Beyond Artifacts: Interactional Support for Collaborative Machine Learning
Li, Z., & Kesselman, C. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798590
Gu, K., Palani, S., & Setlur, V. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790802 · Cited by 5
Investigating How Leaders Decide on AI Innovations: Opportunities for HCI
Xie, S., Xiao, S., Peng, C., Mani, G., Zimmerman, J., & Eslami, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790484
AI Design Sprints: Facilitating AI Innovation within Cross-functional Industry Teams
Yildirim, N., Patel, K., Dusch, F., Knopf, D., Yusufoglu, M., Schuler, D., Holstein, K., Forlizzi, J., McCann, J., & Zimmerman, J. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3812991
SlideSAVR: Enabling Live Analysis during Data Presentations via Multimodal Sketching and Voice Input
Han, C., Tanjim, M. M., Guo, S., Dierk, C., Isaacs, K. E., & Hoffswell, J. (2026) · Computer Graphics Forum · doi:10.1111/cgf.70459 · Cited by 1
“Slide decks remain the primary way data science teams communicate [XWL ∗ 21, PPW ∗ 21] and thus prior tools have aided pre-hoc slide creation.”
Balayn, A., Rancourt, F., Casati, F., & Gadiraju, U. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816909
“…this interdependence of actors, and their collaborations and collective deliberations, e.g., between ML developers and domain experts [97, 100, 113, 117], business owners [115], UX practitioners [108, 140, 151], or potential end-users [21, 43, 161]; and researchers call for even more collaborative…”
Automated machine learning to foster AI development processes: an explorative study
Polzer, A. K., & Thalmann, S. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1867883
Metadata
- Authors
- Piorkowski, D., Park, S., Wang, A. Y., Wang, D., Muller, M., & Portnoy, F.
- Affiliations
- IBM (United States) (US)
- Massachusetts Institute of Technology (US)
- University of Michigan (US)
- IBM Research - Cambridge (United States) (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-04-13
- Volume
- 5
- Issue
- CSCW1
- Pages
- 1-25
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3121784008
- Cited by
- 151
- References
- 46
- Citations by year
- 2026: 11 · 2025: 27 · 2024: 44 · 2023: 38 · 2022: 20 · 2021: 11
- FWCI
- 25.55
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Interdisciplinary Research and Collaboration
- Social Sciences › Psychology › Social Psychology › Team Dynamics and Performance
- Keywords
- AI developers, multidisciplinary team, communication gap, shared mental models, stakeholder communication, trust, expectation management, interdisciplinary collaboration, organizational boundaries
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.