"Hello AI": Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making
Open accessThe DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index.
Abstract
Although rapid advances in machine learning have made it increasingly applicable to expert decision-making, the delivery of accurate algorithmic predictions alone is insufficient for effective human-AI collaboration. In this work, we investigate the key types of information medical experts desire when they are first introduced to a diagnostic AI assistant. In a qualitative lab study, we interviewed 21 pathologists before, during, and after being presented deep neural network (DNN) predictions for prostate cancer diagnosis, to learn the types of information that they desired about the AI assistant. Our findings reveal that, far beyond understanding the local, case-specific reasoning behind any model decision, clinicians desired upfront information about basic, global properties of the model, such as its known strengths and limitations, its subjective point-of-view, and its overall design objective--what it's designed to be optimized for. Participants compared these information needs to the collaborative mental models they develop of their medical colleagues when seeking a second opinion: the medical perspectives and standards that those colleagues embody, and the compatibility of those perspectives with their own diagnostic patterns. These findings broaden and enrich discussions surrounding AI transparency for collaborative decision-making, providing a richer understanding of what experts find important in their introduction to AI assistants before integrating them into routine practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The training included learning optimal ways of using the AI in their settings and pointing out possible errors [18].”
From Explainable recommendation: when design meets trust calibration (2021) · cites this paper as [18]
In the citing paper
“This finding relates to earlier work in Human-AI trust calibration [18], which showed that training clinicians to use the AI-based decision-making tool reduced users’ errors and increased the Human-AI collaborative decision-making performance.”
From Explainable recommendation: when design meets trust calibration (2021) · cites this paper as [18]
In the citing paper
“there has been increasing recent research efforts [8, 15, 22, 41, 58, 65] that highlight the importance of involving stakeholders to understand their practices and needs [15, 41, 65] and socio-environmental factors [8] for the design and evaluation of a system.”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [15]
In the citing paper
“researchers have discussed the importance of an AI explanation to communicate an AI output to a user [5, 20, 29] and realize human-AI collaboration [48] for a decision-making task [15, 42].”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [15]
In the citing paper
“Third, this allows uncertainty to be expressed seamlessly within the natural language interactions of LLM-infused applications, rather than on the side or in onboarding materials [21, 74, 79] that users might overlook.”
From "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust (2024) · cites this paper as [21]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Braun, V., & Clarke, V. (2012) · APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. · doi:10.1037/13620-004 · Cited by 10,299
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“Recent work on fairness and accountability has proposed the use of short documents accompanying trained ML models to disclose the intended use of models, details of their performance evaluation procedures, and the potential biases that they may embody [25, 51].”
BackgroundGuidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439
Shared mental models in expert team decision making.
Cannon‐Bowers, J. A., Salas, E., & Converse, S. A. (1993) · Cited by 1,545
Understanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514
SmoothGrad: removing noise by adding noise
Smilkov, D., Thorat, N., Kim, B., Viégas, F., & Wattenberg, M. (2017) · arXiv · doi:10.48550/arxiv.1706.03825 · Cited by 1,467
Research works printed but not linked: 7
- Wouter Bulten , Hans Pinckaers , Hester van Boven , Robert Vink , Thomas de Bel , Bram van Ginneken , Jeroen van der Laak , Christina Hulsbergen-van de Kaa, and Geert Litjens . 2019 . Automated Gleason Grading of Prostate Biopsies using Deep Learning . arXiv preprint arXiv:1907.07980 (2019). Wouter Bulten, Hans Pinckaers, Hester van Boven, Robert Vink, Thomas de Bel, Bram van Ginneken, Jeroen van der Laak, Christina Hulsbergen-van de Kaa, and Geert Litjens. 2019. Automated Gleason Grading of Prostate Biopsies using Deep Learning. arXiv preprint arXiv:1907.07980 (2019). · arXiv
- Dumitru Erhan , Yoshua Bengio , Aaron Courville , and Pascal Vincent . 2009 . Visualizing higher-layer features of a deep network . University of Montreal 1341 , 3 (2009), 1 . Dumitru Erhan, Yoshua Bengio, Aaron Courville, and Pascal Vincent. 2009. Visualizing higher-layer features of a deep network. University of Montreal 1341, 3 (2009), 1.
- Timnit Gebru , Jamie Morgenstern , Briana Vecchione , Jennifer Wortman Vaughan , Hanna Wallach, Hal Daumeé III, and Kate Crawford. 2018 . Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018). Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumeé III, and Kate Crawford. 2018. Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018). · arXiv
- Ken Hinckley ( Ed .). 2018 . ACM Trans. Comput.-Hum. Interact. 25 , 1 (2018). Ken Hinckley (Ed.). 2018. ACM Trans. Comput.-Hum. Interact. 25, 1 (2018).
- 10.5555/3305381.3305576 · doi:10.5555/3305381.3305576
- Forough Poursabzi-Sangdeh , Daniel G Goldstein , Jake M Hofman , Jennifer Wortman Vaughan, and Hanna Wallach . 2018 . Manipulating and measuring model interpretability. arXiv preprint arXiv:1802.07810 (2018). Forough Poursabzi-Sangdeh, Daniel G Goldstein, Jake M Hofman, Jennifer Wortman Vaughan, and Hanna Wallach. 2018. Manipulating and measuring model interpretability. arXiv preprint arXiv:1802.07810 (2018). · arXiv
- Ming Yin , Jennifer Wortman Vaughan, and Hanna Wallach . 2019 . Understanding the Effect of Accuracy on Trust in Machine Learning Models . (2019). Ming Yin, Jennifer Wortman Vaughan, and Hanna Wallach. 2019. Understanding the Effect of Accuracy on Trust in Machine Learning Models. (2019).
Cited by
Items 201–300 of 666
Okolo, C. T., Agarwal, D., Dell, N. L., & Vashistha, A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637348 · Cited by 34
Ben‐Michael, E., Greiner, D. J., Huang, M., Imai, K., Jiang, Z., & Shin, S. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2505106122 · Cited by 38
Ayobi, A., Hughes, J., Duckworth, C. J., Dylag, J. J., Gordon James, S., Marshall, P., Guy, M., Kumaran, A., Chapman, A., Boniface, M., et al. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581424 · Cited by 26
Marinescu, Ș. A., Oncioiu, I., & Ghibanu, I. A. (2025) · Healthcare · doi:10.3390/healthcare13111222 · Cited by 30
Suresh, H., Lewis, K. M., Guttag, J. V., & Satyanarayan, A. (2022) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3490099.3511160 · Cited by 32
Toward Affective XAI: Facial Affect Analysis for Understanding Explainable Human-AI Interactions
Guerdan, L., Raymond, A., & Güneş, H. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00423 · Cited by 36
Single-Turn Debate Does Not Help Humans Answer Hard Reading-Comprehension Questions
Parrish, A., Trivedi, H. K., Perez, E., Chen, A., Nangia, N., Phang, J., & Bowman, S. R. (2022) · doi:10.18653/v1/2022.lnls-1.3 · Cited by 29
Do I Look Like a Criminal? Examining how Race Presentation Impacts Human Judgement of Recidivism
Mallari, K., Inkpen, K., Johns, P., Tan, S., Ramesh, D., & Kamar, E. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376257 · Cited by 24
“Improving our understanding of biases related to human judgement in online systems is important given that the use of AI systems to assist human decision-making is growing, especially for critical domains such as medicine [5], criminal justice [14, 17], and social welfare [9].”
BackgroundYoo, D. W., Woo, H., Nguyen, V. C., Birnbaum, M. L., Kruzan, K. P., Kim, J. G., Abowd, G. D., & Choudhury, M. D. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642369 · Cited by 28
Barclay, I., Preece, A. D., Taylor, I., Radha, S. K., & Nabrzyski, J. (2022) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.6997 · Cited by 24
Yildirim, N., Zlotnikov, S., Venkat, A., Chawla, G., Kim, J., Bukowski, L. A., Kahn, J. M., McCann, J., & Zimmerman, J. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641982 · Cited by 23
A Clinical Decision Support System for the Prediction of Quality of Life in ALS
Antoniadi, A. M., Galvin, M., Heverin, M., Wei, L., Hardiman, O. M., & Mooney, C. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12030435 · Cited by 24
Agapie, E., Haldar, S., & Poblete, S. G. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555610 · Cited by 27
Legal Provocations for HCI in the Design and Development of Trustworthy Autonomous Systems
Urquhart, L., McGarry, G., & Crabtree, A. (2022) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3546155.3546690 · Cited by 29
Jiang, L., Qin, X., Yam, K. C., Dong, X., Liao, W., & Chen, C. (2023) · PLoS ONE · doi:10.1371/journal.pone.0284840 · Cited by 27
Sanga, P., Singh, J., Dubey, A. K., Khanna, N. N., Laird, J. R., Faa, G., Singh, I. M., Tsoulfas, G., Kalra, M. K., Teji, J. S., et al. (2023) · Diagnostics · doi:10.3390/diagnostics13193159 · Cited by 26
Clinical needs and preferences for AI-based explanations in clinical simulation training
Kollerup, N. K., Johansen, S. S., Tolsgaard, M. G., Friis, M. L., Skov, M. B., & van Berkel, N. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2334852 · Cited by 23
Expert gaze as a usability indicator of medical AI decision support systems: a preliminary study
Castner, N., Arsiwala-Scheppach, L. T., Mertens, S., Krois, J., Thaqi, E., Kasneci, E., Wahl, S., & Schwendicke, F. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01192-8 · Cited by 25
To Err Is AI! Debugging as an Intervention to Facilitate Appropriate Reliance on AI Systems
He, G., Bharos, A., & Gadiraju, U. (2024) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/3648188.3675130 · Cited by 24
Tsai, C.-C., Kim, J. Y., Chen, Q., Rowell, B. E., Yang, X. J., Kontar, R. A., Whitaker, M., & Lester, C. A. (2024) · Journal of Medical Internet Research · doi:10.2196/59946 · Cited by 25
Jung, J., Kang, S., Choi, J., El-Kareh, R. E., Lee, H., & Kim, H. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105943 · Cited by 23
Envisioning AI Support during Semi-Structured Interviews Across the Expertise Spectrum
Liu, Z., Dai, J., Conati, C., & McGrenere, J. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710909 · Cited by 25
Starke, G., Schmidt, B. R., Clercq, E. D., & Elger, B. S. (2022) · AI and Ethics · doi:10.1007/s43681-022-00177-1 · Cited by 26
Differences in technical and clinical perspectives on AI validation in cancer imaging: mind the gap!
Chouvarda, I., Colantonio, S., Verde, A. S. C., Jiménez-Pastor, A., Cerdá-Alberich, L., Metz, Y., Zacharias, L., Nabhani‐Gebara, S., Bobowicz, M., Tsakou, G., et al. (2025) · European Radiology Experimental · doi:10.1186/s41747-024-00543-0 · Cited by 24
Viswanathan, S., Ibrahim, S. B., Shankar, R., Binns, R., Kleek, M. G. V., & Slovák, P. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714088 · Cited by 21
Lim, B. Y., Cahaly, J. P., Sng, C. Y. F., & Chew, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714058 · Cited by 25
Integrating AI into Education: Preparation Factors and Teachers' Digital Competencies
Flores, W., & Chiappe, A. (2025) · Revista Colombiana de Educación · doi:10.17227/rce.num97-20825 · Cited by 21
Robertson, S., & Díaz, M. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3534638 · Cited by 31
Scanzera, A. C., Beversluis, C., Potharazu, A. V., Bai, P., Leifer, A., Cole, E. D., Du, D. Y., Musick, H., & Chan, R. V. P. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2023.1198228 · Cited by 23
Thavanesan, N., Bodala, I. P., Walters, Z. S., Ramchurn, S. D., Underwood, T., & Vigneswaran, G. (2023) · European Journal of Surgical Oncology · doi:10.1016/j.ejso.2023.106986 · Cited by 22
Aluso, L., & Enyejo, J. O. (2023) · International Journal of Scientific Research and Modern Technology. · doi:10.38124/ijsrmt.v2i11.1078 · Cited by 21
RootPainter3D: Interactive‐machine‐learning enables rapid and accurate contouring for radiotherapy
Smith, A. G., Petersen, J., Terrones‐Campos, C., Berthelsen, A. K., Forbes, N., Darkner, S., Specht, L., & Vogelius, I. R. (2021) · Medical Physics · doi:10.1002/mp.15353 · Cited by 22
One Map Does Not Fit All: Evaluating Saliency Map Explanation on Multi-Modal Medical ImagesPreprint
Jin, W., Li, X., & Hamarneh, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.05047 · Cited by 25
Knowledge Workers' Perspectives on AI Training for Responsible AI Use
Zhang, A., & Lee, M. K. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714100 · Cited by 25
Pareek, S., Schömbs, S., Velloso, E., & Gonçalves, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713468 · Cited by 27
Aslam, T. M., & Hoyle, D. C. (2021) · Ophthalmology and Therapy · doi:10.1007/s40123-021-00430-6 · Cited by 23
Alanzi, T. M., Alotaibi, R., Alajmi, R., Bukhamsin, Z. M., Fadaq, K., Alghamdi, N., Khamsin, N. B., Alzahrani, L., Abdullah, R. A., Alsayer, R., et al. (2023) · Cureus · doi:10.7759/cureus.49419 · Cited by 24
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511112 · Cited by 19
“In addition, there is increasing recent research efforts [6, 13, 21, 40, 54, 60] that highlight the importance of involving stakeholders to understand their practices and needs [13, 40, 60] and socio-environmental factors [6] for the design and evaluation of a system.”
BackgroundMethodInfluentialRetroLens: A Human-AI Collaborative System for Multi-step Retrosynthetic Route Planning
Shi, C., Hu, Y., Wang, S., Ma, S., Zheng, C., Ma, X., & Luo, Q. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581469 · Cited by 19
Zając, H. D., Andersen, T. O., Kwasa, E., Wanjohi, R., Onyinkwa, M. K., Mwaniki, E. K., Gitau, S. N., Yaseen, S. S., Carlsen, J. F., Fraccaro, M., et al. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3715115 · Cited by 22
Lester, C. A., Rowell, B. E., Zheng, Y., Co, Z., Marshall, V. D., Kim, J. Y., Chen, Q., Kontar, R. A., & Yang, X. J. (2025) · JMIR Medical Informatics · doi:10.2196/64902 · Cited by 25
Kahr, P. K., Rooks, G., Snijders, C. C. P., & Willemsen, M. C. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713099 · Cited by 26
From Interaction to Attitude: Exploring the Impact of Human-AI Cooperation on Mental Illness Stigma
Song, T., Jamieson, J., Zhu, T., Yamashita, N., & Lee, Y. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710987 · Cited by 26
Jo, E., Ryu, M., Kenderova, G., So, S., Shapiro, B. B., Papoutsaki, A., & Epstein, D. A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502206 · Cited by 22
Face Work: A Human-Centered Investigation into Facial Verification in Gig Work
Watkins, E. A. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579485 · Cited by 21
"It depends": Configuring AI to Improve Clinical Usefulness Across Contexts
Zając, H. D., Ribeiro, J., Ingala, S., Gentile, S., Wanjohi, R., Gitau, S. N., Carlsen, J. F., Nielsen, M. B., & Andersen, T. O. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3660707 · Cited by 23
Ren, X., Spina, G., Vries, S. D., Bijkerk, A., Faber, B., & Geraedts, A. S. (2020) · IEEE Access · doi:10.1109/access.2020.3005733 · Cited by 23
After-Action Review for AI (AAR/AI)
Dodge, J. E., Khanna, R., Irvine, J., Lam, K.-H., Mai, T., Lin, Z., Kiddle, N. G., Newman, E., Anderson, A. W., Raja, S., et al. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3453173 · Cited by 25
Human Delegation Behavior in Human-AI Collaboration: The Effect of Contextual Information
Spitzer, P., Holstein, J., Hemmer, P., Vössing, M., Kühl, N., Martin, D., & Satzger, G. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710999 · Cited by 18
“While many works exist in the context of providing contextual AI information, only a few investigate the effects of additional information on the underlying data despite its importance, as suggested by Cai et al. [12], Holstein et al. [39].”
Invisible to Machines: Designing AI that Supports Vision Work in Radiology
Anichini, G., Natali, C., & Cabitza, F. (2024) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-024-09491-0 · Cited by 18
“Recent years have seen a rise in studies focusing on radiologists’ perception and expectations of AI tools (Cai et al. 2019; Pinto dos Santos et al. 2019), and on their impact on medical reasoning (Cabitza et al. 2017), but there is still a lack of empirical studies on effective integration of AI…”
(Beyond) Reasonable Doubt: Challenges that Public Defenders Face in Scrutinizing AI in Court
Jin, A., & Salehi, N. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641902 · Cited by 23
Shedding Light on Explainable AI: Insights, Challenges, and the Future of Infrastructure Management
Hu, Y., Atta, Z., Rahman, T. U., Qiu, S., Wang, J., Wei, W., Liang, Z., & Zaheer, Q. (2026) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi15030100 · Cited by 19
Human-AI Collaboration in Healthcare: A Scoping Review
Strong, J., Rogers, H., Sun, E., Todsen, A. L., Ede, J., Lumley, C., Yeung, N., Higham, H., & Noble, J. A. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02918-6 · Cited by 22
Iterative Quality Control Strategies for Expert Medical Image Labeling
Freeman, B., Hammel, N., Phene, S., Huang, A. E., Ackermann, R., Kanzheleva, O., Hutson, M., Taggart, C., Duong, Q., & Sayres, R. (2021) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v9i1.18940 · Cited by 22
Training Towards Critical Use: Learning to Situate AI Predictions Relative to Human Knowledge
Kawakami, A., Guerdan, L., Cheng, Y., Glazko, K. S., Lee, M. L., Carter, S., Aréchiga, N., Zhu, H., & Holstein, K. (2023) · ACM Collective Intelligence Conference (CI) · doi:10.1145/3582269.3615595 · Cited by 25
Trust in Machine Learning Driven Clinical Decision Support Tools Among Otolaryngologists
Chen, H. Y., Ma, X., Rives, H., Serpedin, A., Yao, P., & Rameau, A. (2024) · The Laryngoscope · doi:10.1002/lary.31260 · Cited by 20
Reinhard, P., Li, M. M., Peters, C., & Leimeister, J. M. (2024) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2024.028 · Cited by 27
Beyond the Buzzwords: On the Perspective of AI in UX and Vice Versa
Wallach, D., Flohr, L. A., & Kaltenhauser, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50334-5_10 · Cited by 27
Antecedents of Constructive Human-AI Collaboration: An Exploration of Human Actors’ Key Competencies
Süße, T., Kobert, M., & Kries, C. (2021) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-85969-5_10 · Cited by 27
Piscitelli, M. S., Razzano, G., Buscemi, G., & Capozzoli, A. (2024) · Energy and Buildings · doi:10.1016/j.enbuild.2024.115115 · Cited by 20
Cameron, L. D., Christin, A., DeVito, M. A., Dillahunt, T. R., Elish, M. C., Gray, M. L., Qadri, R., Raval, N., Valentine, M., & Watkins, E. A. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3441331 · Cited by 17
ContractMind: Trust-calibration interaction design for AI contract review tools
Zeng, J., Chen, K., Wang, R., Li, Y., Fan, M., Wu, K., Qi, X., & Wang, L. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103411 · Cited by 21
Prince, E. W., Ghosh, D., Görg, C., & Hankinson, T. C. (2023) · Diagnostics · doi:10.3390/diagnostics13061132 · Cited by 19
Taking Off with AI: Lessons from Aviation for Healthcare
Bondi, E., Hartvigsen, T., Sanneman, L., Sankaranarayanan, S., Harned, Z., Wickerson, G., Gichoya, J. W., Oakden‐Rayner, L., Celi, L. A., Lungren, M. P., et al. (2023) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3617694.3623224 · Cited by 21
Xu, Y., Shao, Y., Dong, J., Shi, S., Jiang, C., & Li, Q. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713772 · Cited by 16
Levy, J., Chan, N., Marotti, J. D., Simoes, N. J. R., Ismail, A. A. O., Kerr, D. A., Gutmann, E. J., Glass, R. E., Dodge, C. P., Suriawinata, A. A., et al. (2023) · Cancer Cytopathology · doi:10.1002/cncy.22725 · Cited by 16
Using Sensor-Captured Patient-Generated Data to Support Clinical Decision-making in PTSD Therapy
Evans, H. I., Ryu, M., Hsieh, T., Zhou, J., Xu, K., Akers, K. W., Sherrill, A. M., & Arriaga, R. I. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637426 · Cited by 17
Meaningful Transparency for Clinicians: Operationalising HCXAI Research with Gynaecologists
Schor, B. G. S., Kallina, E., Singh, J., & Blackwell, A. F. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658971 · Cited by 20
Breckner, K., Neumayr, T., Mara, M., Streit, M., & Augstein, M. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2482742 · Cited by 16
How do People Perceive the Role of AI in Human-AI Collaboration to Solve Everyday Tasks?
Papachristos, E., Skov Johansen, P., Møberg Jacobsen, R., Bjørn Leer Bysted, L., & Skov, M. B. (2021) · CHI Greece 2021: 1st International Conference of the ACM Greek SIGCHI Chapter · doi:10.1145/3489410.3489420 · Cited by 15
Lee, J., Jung, K., Newman, E., Chow, E., & Chen, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713244 · Cited by 18
The Security & Privacy Acceptance Framework (SPAF)
Das, S., Faklaris, C., Hong, J., & Dabbish, L. (2022) · Foundations and Trends® in Privacy and Security · doi:10.1561/3300000026 · Cited by 27
Cherry on Top or Real Need? A Review of Explainable Machine Learning in Kidney Transplantation
de Souza, A. A., Stubbs, A., Hesselink, D. A., Baan, C. C., & Boer, K. (2024) · Transplantation · doi:10.1097/tp.0000000000005063 · Cited by 15
Rambach, T., Gleim, P., Mandelartz, S., Heizmann, C., Kunze, C., & Kellmeyer, P. (2024) · JMIR Research Protocols · doi:10.2196/58185 · Cited by 17
Prince, E. W., Mirsky, D. M., Hankinson, T. C., & Görg, C. (2025) · Frontiers in Radiology · doi:10.3389/fradi.2024.1433457 · Cited by 16
Opening Up Human-Robot Collaboration
Reeves, S., Pelikan, H. R. M., & Cantarutti, M. N. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757640 · Cited by 16
Ewals, L. J. S., Heesterbeek, L. J. J., Yu, B., van der Wulp, K., Mavroeidis, D., Funk, M., Snijders, C. C. P., Jacobs, I., Nederend, J., Pluyter, J. R., et al. (2024) · JMIR AI · doi:10.2196/52211 · Cited by 15
An Evidence-based Workflow for Studying and Designing Learning Supports for Human-AI Co-creation
Gmeiner, F., Conlin, J. L., Tang, E. H., Martelaro, N., & Holstein, K. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650763 · Cited by 15
Saßmannshausen, S. M., Ontika, N. N., de Carvalho, A. F. P., Rouncefield, M., & Pipek, V. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642362 · Cited by 16
Dancing With Chains: Ideating Under Constraints With UIDEC in UI/UX Design
Shokrizadeh, َ., Tadjuidje, B. B., Kumar, S., Kamble, S., & Cheng, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713785 · Cited by 17
Revisiting Human-Robot Teaching and Learning Through the Lens of Human Concept Learning
Booth, S., Sharma, S., Chung, S., Shah, J., & Glassman, E. L. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889398 · Cited by 26
Zhong, Y., Piao, Y., Tan, B., & Liu, J. (2024) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2024.108101 · Cited by 15
Jin, W., Li, X., & Hamarneh, G. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.06487 · Cited by 14
Team Learning as a Lens for Designing Human-AI Co-Creative SystemsPreprint
Gmeiner, F., Holstein, K., & Martelaro, N. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.02996 · Cited by 14
On the Importance of Application-Grounded Experimental Design for Evaluating Explainable ML Methods
Amarasinghe, K., Rodolfa, K. T., Jesus, S., Chen, V., Balayan, V., Saleiro, P., Bizarro, P., Talwalkar, A., & Ghani, R. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i19.30082 · Cited by 13
How Can I Signal You To Trust Me: Investigating AI Trust Signalling in Clinical Self-Assessments
Kollerup, N. K., Wester, J., Skov, M. B., & van Berkel, N. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661612 · Cited by 15
Safety principles for medical summarization using generative AI
Obika, B. D., Kelly, C. J., Ding, N., Farrance, C., Krause, J., Mittal, P., Cheung, D., Cole-Lewis, H. J., Elish, M. C., Karthikesalingam, A., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-03313-y · Cited by 14
SemFedXAI: A Semantic Framework for Explainable Federated Learning in Healthcare
Amato, A., & Branco, D. (2025) · Information · doi:10.3390/info16060435 · Cited by 13
Introduction to Human-Computer Interaction
Hornbæk, K., Kristensson, P. O., & Oulasvirta, A. (2025) · doi:10.1093/oso/9780192864543.001.0001 · Cited by 19
In Defense of Post Hoc Explanations in Medical AI
Hatherley, J. J., Munch, L. A., & Bjerring, J. C. (2026) · The Hastings Center Report · doi:10.1002/hast.4971 · Cited by 14
Eardley, R., Mackinnon, S., Tonkin, E. L., Soubutts, E., Ayobi, A., Linington, J., Tourte, G. J. L., Gross, Z. B., Bailey, D. J., Knights, R., et al. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534625 · Cited by 13
Balayn, A., Rikalo, N., Yang, J., & Bozzon, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581555 · Cited by 18
Kaleidoscope: Semantically-grounded, context-specific ML model evaluation
Suresh, H., Shanmugam, D., Chen, T., Bryan, A. G., D’Amour, A., Guttag, J. V., & Satyanarayan, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581482 · Cited by 19
Minimum levels of interpretability for artificial moral agents
Vijayaraghavan, A., & Badea, C. (2024) · AI and Ethics · doi:10.1007/s43681-024-00536-0 · Cited by 16
Aoyagui, P. A., Stemmler, K., Ferguson, S. A., Kim, Y., & Kuzminykh, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713248 · Cited by 17
Imperfections of XAI: Phenomena Influencing AI-Assisted Decision-Making
Spitzer, P., Morrison, K., Turri, V., Feng, M., Perer, A., & Kühl, N. (2025) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3750052 · Cited by 17
Factors Affecting Human-Generated AI Collaboration: Trust and Perceived Usefulness as Mediators
Chae, H.-S., & Yoon, C. (2025) · Information · doi:10.3390/info16100856 · Cited by 14
Explainable AI: Developing Interpretable Deep Learning Models for Medical Diagnosis
-, R. T. (2024) · International Journal For Multidisciplinary Research · doi:10.36948/ijfmr.2024.v06i04.25281 · Cited by 17
Zhang, T., Yang, X. J., & Li, B. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2364986 · Cited by 15
The Situated, Relational, and Evolving Nature of Epilepsy Diagnosis
Marathe, M., & Toyama, K. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3432916 · Cited by 12
Metadata
- Authors
- Cai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M.
- Affiliations
- Google (United States) (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2019-11-07
- Volume
- 3
- Issue
- CSCW
- Pages
- 1-24
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2970837303
- Cited by
- 594
- References
- 79
- Citations by year
- 2026: 84 · 2025: 158 · 2024: 97 · 2023: 75 · 2022: 80 · 2021: 70 · 2020: 28 · 2019: 2
- FWCI
- 20.77
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- human-AI collaboration, physicians, prostate cancer diagnosis, pathologists, AI transparency, model limitations, second opinion, deep neural network inference, clinical decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.