"Hello AI": Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making
Open accessThe DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index.
Abstract
Although rapid advances in machine learning have made it increasingly applicable to expert decision-making, the delivery of accurate algorithmic predictions alone is insufficient for effective human-AI collaboration. In this work, we investigate the key types of information medical experts desire when they are first introduced to a diagnostic AI assistant. In a qualitative lab study, we interviewed 21 pathologists before, during, and after being presented deep neural network (DNN) predictions for prostate cancer diagnosis, to learn the types of information that they desired about the AI assistant. Our findings reveal that, far beyond understanding the local, case-specific reasoning behind any model decision, clinicians desired upfront information about basic, global properties of the model, such as its known strengths and limitations, its subjective point-of-view, and its overall design objective--what it's designed to be optimized for. Participants compared these information needs to the collaborative mental models they develop of their medical colleagues when seeking a second opinion: the medical perspectives and standards that those colleagues embody, and the compatibility of those perspectives with their own diagnostic patterns. These findings broaden and enrich discussions surrounding AI transparency for collaborative decision-making, providing a richer understanding of what experts find important in their introduction to AI assistants before integrating them into routine practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The training included learning optimal ways of using the AI in their settings and pointing out possible errors [18].”
From Explainable recommendation: when design meets trust calibration (2021) · cites this paper as [18]
In the citing paper
“This finding relates to earlier work in Human-AI trust calibration [18], which showed that training clinicians to use the AI-based decision-making tool reduced users’ errors and increased the Human-AI collaborative decision-making performance.”
From Explainable recommendation: when design meets trust calibration (2021) · cites this paper as [18]
In the citing paper
“there has been increasing recent research efforts [8, 15, 22, 41, 58, 65] that highlight the importance of involving stakeholders to understand their practices and needs [15, 41, 65] and socio-environmental factors [8] for the design and evaluation of a system.”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [15]
In the citing paper
“researchers have discussed the importance of an AI explanation to communicate an AI output to a user [5, 20, 29] and realize human-AI collaboration [48] for a decision-making task [15, 42].”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [15]
In the citing paper
“Third, this allows uncertainty to be expressed seamlessly within the natural language interactions of LLM-infused applications, rather than on the side or in onboarding materials [21, 74, 79] that users might overlook.”
From "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust (2024) · cites this paper as [21]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Braun, V., & Clarke, V. (2012) · APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. · doi:10.1037/13620-004 · Cited by 10,299
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“Recent work on fairness and accountability has proposed the use of short documents accompanying trained ML models to disclose the intended use of models, details of their performance evaluation procedures, and the potential biases that they may embody [25, 51].”
BackgroundGuidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439
Shared mental models in expert team decision making.
Cannon‐Bowers, J. A., Salas, E., & Converse, S. A. (1993) · Cited by 1,545
Understanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514
SmoothGrad: removing noise by adding noise
Smilkov, D., Thorat, N., Kim, B., Viégas, F., & Wattenberg, M. (2017) · arXiv · doi:10.48550/arxiv.1706.03825 · Cited by 1,467
Research works printed but not linked: 7
- Wouter Bulten , Hans Pinckaers , Hester van Boven , Robert Vink , Thomas de Bel , Bram van Ginneken , Jeroen van der Laak , Christina Hulsbergen-van de Kaa, and Geert Litjens . 2019 . Automated Gleason Grading of Prostate Biopsies using Deep Learning . arXiv preprint arXiv:1907.07980 (2019). Wouter Bulten, Hans Pinckaers, Hester van Boven, Robert Vink, Thomas de Bel, Bram van Ginneken, Jeroen van der Laak, Christina Hulsbergen-van de Kaa, and Geert Litjens. 2019. Automated Gleason Grading of Prostate Biopsies using Deep Learning. arXiv preprint arXiv:1907.07980 (2019). · arXiv
- Dumitru Erhan , Yoshua Bengio , Aaron Courville , and Pascal Vincent . 2009 . Visualizing higher-layer features of a deep network . University of Montreal 1341 , 3 (2009), 1 . Dumitru Erhan, Yoshua Bengio, Aaron Courville, and Pascal Vincent. 2009. Visualizing higher-layer features of a deep network. University of Montreal 1341, 3 (2009), 1.
- Timnit Gebru , Jamie Morgenstern , Briana Vecchione , Jennifer Wortman Vaughan , Hanna Wallach, Hal Daumeé III, and Kate Crawford. 2018 . Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018). Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumeé III, and Kate Crawford. 2018. Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018). · arXiv
- Ken Hinckley ( Ed .). 2018 . ACM Trans. Comput.-Hum. Interact. 25 , 1 (2018). Ken Hinckley (Ed.). 2018. ACM Trans. Comput.-Hum. Interact. 25, 1 (2018).
- 10.5555/3305381.3305576 · doi:10.5555/3305381.3305576
- Forough Poursabzi-Sangdeh , Daniel G Goldstein , Jake M Hofman , Jennifer Wortman Vaughan, and Hanna Wallach . 2018 . Manipulating and measuring model interpretability. arXiv preprint arXiv:1802.07810 (2018). Forough Poursabzi-Sangdeh, Daniel G Goldstein, Jake M Hofman, Jennifer Wortman Vaughan, and Hanna Wallach. 2018. Manipulating and measuring model interpretability. arXiv preprint arXiv:1802.07810 (2018). · arXiv
- Ming Yin , Jennifer Wortman Vaughan, and Hanna Wallach . 2019 . Understanding the Effect of Accuracy on Trust in Machine Learning Models . (2019). Ming Yin, Jennifer Wortman Vaughan, and Hanna Wallach. 2019. Understanding the Effect of Accuracy on Trust in Machine Learning Models. (2019).
Cited by
Items 101–200 of 666
Lee, M. H., & Chew, C. J. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610218 · Cited by 78
Holding AI to Account: Challenges for the Delivery of Trustworthy AI in Healthcare
Procter, R., Tolmie, P., & Rouncefield, M. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3577009 · Cited by 92
Subramanian, H. V., Canfield, C., & Shank, D. B. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102780 · Cited by 84
Chiang, C.-W., Lu, Z., Li, Z., & Yin, M. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581015 · Cited by 98
Designing AI to Work WITH or FOR People?
Wang, D., Maes, P., Ren, X., Shneiderman, B., Shi, Y., & Wang, Q. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3450394 · Cited by 82
Bossen, C., & Pine, K. H. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3569892 · Cited by 80
Levy, A., Agrawal, M., Satyanarayan, A., & Sontag, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445522 · Cited by 73
“In interviews, clinicians discussed their information desiderata when onboarding new AI decision support: strengths, weaknesses, point-of-views [6].”
BackgroundFacilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Models
Park, S., Wang, A. Y., Kawas, B., Liao, Q. V., Piorkowski, D., & Danilevsky, M. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450637 · Cited by 88
Tulk Jesso, S., Kelliher, A., Sanghavi, H., Martin, T., & Henrickson Parker, S. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.830345 · Cited by 54
Verma, H., Mlynář, J., Schaer, R., Reichenbach, J., Jreige, M., Prior, J. O., Évéquoz, F., & Depeursinge, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581506 · Cited by 78
Cao, S., Liu, A., & Huang, C.-M. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637318 · Cited by 41
Explainable recommendation: when design meets trust calibration
Naiseh, M., Al-Thani, D., Jiang, N., & Ali, R. (2021) · World Wide Web · doi:10.1007/s11280-021-00916-0 · Cited by 68
“This finding relates to earlier work in Human-AI trust calibration [18], which showed that training clinicians to use the AI-based decision-making tool reduced users’ errors and increased the Human-AI collaborative decision-making performance.”
ResultNordic Human-Computer Interaction Conference
(2022) · doi:10.1145/3546155 · Cited by 67
AI in Global Health: The View from the Front Lines
Ismail, A., & Kumar, N. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445130 · Cited by 75
Buçinca, Z., Swaroop, S., Paluch, A. E., Doshi‐Velez, F., & Gajos, K. Z. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713229 · Cited by 75
The Spotlight: A General Method for Discovering Systematic Errors in Deep Learning Models
d'Eon, G., d’Eon, J., Wright, J. R., & Leyton‐Brown, K. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533240 · Cited by 111
Gu, H., Liang, Y., Xu, Y., Williams, C. K., Magaki, S., Khanlou, N., Vinters, H. V., Chen, Z., Ni, S., Yang, C., et al. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3577011 · Cited by 66
Wang, Q., Camacho, I., Jing, S., & Goel, A. K. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512977 · Cited by 77
Ramesh, D., Kameswaran, V., Wang, D., & Sambasivan, N. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533237 · Cited by 92
Zhu, H., Pysander, E.-L. S., & Söderberg, I. (2023) · Data and Information Management · doi:10.1016/j.dim.2023.100041 · Cited by 73
Ambiguity-aware AI Assistants for Medical Data Analysis
Schaekermann, M., Beaton, G., Sanoubari, E., Lim, A. S. P., Larson, K. S., & Law, E. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376506 · Cited by 70
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415227 · Cited by 57
Increasing the Speed and Accuracy of Data Labeling Through an AI Assisted Interface
Desmond, M., Muller, M. J., Ashktorab, Z., Dugan, C., Duesterwald, E., Brimijoin, K., Finegan‐Dollak, C., Brachman, M., Sharma, A., Joshi, N. N., et al. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450698 · Cited by 78
Lessons Learned from Designing an AI-Enabled Diagnosis Tool for Pathologists
Gu, H., Huang, J., Hung, L., & Chen, X. '. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449084 · Cited by 56
“When AI makes mistakes, instead of modifying or correcting the model, current work emphasizes informing users of AI’s pitfalls to ensure transparency [12].”
BackgroundSocial Sensemaking with AI: Designing an Open-ended AI Experience with a Blind Child
Morrison, C. P., Cutrell, E. B., Grayson, M., Thieme, A., Taylor, A. S., Roumen, G. J., Longden, C., Tschiatschek, S., Marques, R. F., & Sellen, A. J. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445290 · Cited by 65
Math Education with Large Language Models: Peril or Promise?
Kumar, H., Rothschild, D. M., Goldstein, D. G., & Hofman, J. (2023) · doi:10.2139/ssrn.4641653 · Cited by 54
“Research in human-centered AI has shown when AI systems explain their answers, the performance of human-AI team reaches a higher level compared to the performance of human alone [14, 45, 58].”
BackgroundMath Education With Large Language Models: Peril or Promise?
Kumar, H., Rothschild, D. M., Goldstein, D. G., & Hofman, J. M. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-98459-4_5 · Cited by 54
Onboarding Materials as Cross-functional Boundary Objects for Developing AI Assistants
Cai, C. J., Winter, S. R., Steiner, D. F., Wilcox, L. G., & Terry, M. A. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3443435 · Cited by 61
Self-citationTutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertise
Wang, R., Ribeiro, A., Robinson, C., Loeb, S., & Demszky, D. (2024) · doi:10.21203/rs.3.rs-5363154/v1 · Cited by 53
Decision Making Strategies and Team Efficacy in Human-AI Teams
Munyaka, I. N. S., Ashktorab, Z., Dugan, C., Johnson, J. M., & Pan, Q. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579476 · Cited by 63
Feng, K. J. K., Coppock, M. J., & McDonald, D. W. (2023) · Designing Interactive Systems Conference · doi:10.1145/3563657.3596101 · Cited by 58
Yu, B., Yuan, Y., Terveen, L., Wu, Z. S., Forlizzi, J., & Zhu, H. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395528 · Cited by 65
Machine Learning Operations in Health Care: A Scoping Review
Rajagopal, A., Ayanian, S., Ryu, A. J., Qian, R., Legler, S. R., Peeler, E. A., Issa, M., Coons, T. J., & Kawamoto, K. (2024) · Mayo Clinic Proceedings: Digital Health · doi:10.1016/j.mcpdig.2024.06.009 · Cited by 52
He, X., Hong, Y., Zheng, X., & Zhang, Y. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2095093 · Cited by 43
Advancing Patient-Centered Shared Decision-Making with AI Systems for Older Adult Cancer Patients
Hao, Y., Liu, Z., Riter, R. N., & Kalantari, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642353 · Cited by 62
Effects of Communication Directionality and AI Agent Differences in Human-AI Interaction
Ashktorab, Z., Dugan, C., Johnson, J., Pan, Q., Zhang, W., Kumaravel, S., & Campbell, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445256 · Cited by 50
Unpacking Human-AI Interaction in Safety-Critical Industries: A Systematic Literature Review
Bach, T. A., Kristiansen, J. K., Babić, A., & Jacovi, A. (2024) · IEEE Access · doi:10.1109/access.2024.3437190 · Cited by 61
Ma, S., Chen, Q., Wang, X., Zheng, C., Peng, Z., Yin, M., & Ma, X. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713423 · Cited by 48
“With remarkable technological advancements, AI has been increasingly used to support people in making decisions in various domains, including criminal justice [32, 35], admissions [25, 140], financial investment [53], and medical diagnosis [21, 79], among others.”
Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care Unit
Yildirim, N., Zlotnikov, S., Sayar, D., Kahn, J. M., Bukowski, L. A., Amin, S. S., Riman, K. A., Davis, B. S., Minturn, J. S., King, A. J., et al. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641896 · Cited by 55
An Uncommon Task: Participatory Design in Legal AI
Delgado, F. A., Barocas, S., & Levy, K. E. C. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512898 · Cited by 61
Kawakami, A., Sivaraman, V., Stapleton, L., Cheng, H.-F., Perer, A., Wu, Z. S., Zhu, H., & Holstein, K. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533556 · Cited by 74
Andersen, T. O., Nunes, F., Wilcox, L., Coiera, E., & Rogers, Y. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3589961 · Cited by 40
Self-citationBach, A. K. P., Nørgaard, T. M., Brok, J. C., & van Berkel, N. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581513 · Cited by 47
Hwang, J., Lee, T., Lee, H., & Byun, S. (2021) · Journal of Medical Internet Research · doi:10.2196/28659 · Cited by 55
Transfer Learning in Brain Tumor Classification: Challenges, Opportunities, and Future Prospects
Anwar, R. W., Abrar, M. Y. B. T., & Ullah, F. (2023) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc58733.2023.10392830 · Cited by 51
Turchi, T., Prencipe, G., Malizia, A., Filogna, S., Latrofa, F., & Sgandurra, G. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102850 · Cited by 47
Nudging through Friction: An Approach for Calibrating Trust in Explainable AI
Naiseh, M., Al-Mansoori, R. S., Al‐Thani, D., Jiang, N., & Ali, R. (2021) · International Conference on Behavioral, Economic, and Socio-Cultural Computing · doi:10.1109/besc53957.2021.9635271 · Cited by 46
Gu, H., Yang, C., Haeri, M., Wang, J., Tang, S., Yan, W., He, S., Williams, C. K., Magaki, S., & Chen, X. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580694 · Cited by 57
Calisto, F. M., Abrantes, J. M., Santiago, C., Nunes, N. J., & Nascimento, J. C. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103444 · Cited by 40
Realizing AI in Healthcare: Challenges Appearing in the Wild
Andersen, T. O., Nunes, F., Wilcox, L. G., Kaziunas, E., Matthiesen, S., & Magrabi, F. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3441347 · Cited by 52
Self-citationAI-Assisted Human Labeling: Batching for Efficiency without Overreliance
Ashktorab, Z., Desmond, M., Andres, J., Muller, M., Joshi, N. N., Brachman, M., Sharma, A., Brimijoin, K., Pan, Q., Wolf, C. T., et al. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449163 · Cited by 45
“A number of CSCW papers in recent years have addressed questions of human-AI collaboration, for example in medical decision-making [8], data science work [66], or IT infrastructure design practices [72].”
BackgroundMatthiesen, S., Diederichsen, S. Z., Hansen, M. K. H., Villumsen, C., Lassen, M. C. H., Jacobsen, P. K., Risum, N., Winkel, B. G., Philbert, B. T., Svendsen, J. H., et al. (2021) · JMIR Human Factors · doi:10.2196/26964 · Cited by 45
“Recently, researchers focused on the early human-AI onboarding process of pathologists and found that presenting a global view of a prediction tool and its capabilities, limitations, and biases is key to the formation of initial impressions and appropriate mental models [67].”
BackgroundBreastScreening: On the Use of Multi-Modality in Medical Imaging Diagnosis
Calisto, F. M., Nunes, N., & Nascimento, J. C. (2020) · International Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/3399715.3399744 · Cited by 50
Capturing Humans’ Mental Models of AI: An Item Response Theory Approach
Kelly, M., Kumar, A., Smyth, P., & Steyvers, M. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594111 · Cited by 60
The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool
Gerchick, M. K., Jegede, T., Shah, T., Gutiérrez, A. B., Beiers, S., Shemtov, N., Xu, K., Samant, A., & Horowitz, A. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594081 · Cited by 49
Trust Development and Repair in AI-Assisted Decision-Making during Complementary Expertise
Pareek, S., Velloso, E., & Gonçalves, J. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658924 · Cited by 54
Understanding the Role of Explanation Modality in AI-assisted Decision-making
Robbemond, V., Inel, O., & Gadiraju, U. (2022) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3503252.3531311 · Cited by 56
Salimzadeh, S., He, G., & Gadiraju, U. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641905 · Cited by 41
Nguyen, H., & Nguyen, A. (2024) · Journal of Science Education and Technology · doi:10.1007/s10956-024-10175-z · Cited by 49
Artificial Intelligence in Music and Performance: A Subjective Art-Research Inquiry
Caramiaux, B., & Donnarumma, M. (2021) · Springer eBooks · doi:10.1007/978-3-030-72116-9_4 · Cited by 49
Hopkins, A., & Booth, S. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462527 · Cited by 40
Artificial Intelligence for Cancer Detection—A Bibliometric Analysis and Avenues for Future Research
Karger, E., & Kureljusic, M. (2023) · Current Oncology · doi:10.3390/curroncol30020125 · Cited by 47
Pumplun, L., Peters, F., Gawlitza, J. F., & Buxmann, P. (2023) · Journal of the Association for Information Systems · doi:10.17705/1jais.00820 · Cited by 59
AI Consent Futures: A Case Study on Voice Data Collection with Clinicians
Wilcox, L. G., Brewer, R. N., & Díaz, F. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610107 · Cited by 45
Self-citationPublic Health Calls for/with AI: An Ethnographic Perspective
Ismail, A., Thakkar, D., Madhiwalla, N., & Kumar, N. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610203 · Cited by 47
Zhang, R., Flathmann, C., Musick, G., Schelble, B. G., McNeese, N. J., Knijnenburg, B. P., & Duan, W. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3635474 · Cited by 43
Ferreira, J. J., & Monteiro, M. D. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05460 · Cited by 38
Evaluating the impact of human explanation strategies on human-AI visual decision-making
Morrison, K., Shin, D., Holstein, K., & Perer, A. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579481 · Cited by 37
Requirements for Explainability and Acceptance of Artificial Intelligence in Collaborative Work
Theis, S., Jentzsch, S. F., Deligiannaki, F., Berro, C., Raulf, A., & Bruder, C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35891-3_22 · Cited by 46
Applications of interpretability in deep learning models for ophthalmology
Hanif, A. M., Beqiri, S., Keane, P. A., & Campbell, J. P. (2021) · Current Opinion in Ophthalmology · doi:10.1097/icu.0000000000000780 · Cited by 40
A Survey of Domain Knowledge Elicitation in Applied Machine Learning
Kerrigan, D., Hullman, J. R., & Bertini, E. (2021) · Multimodal Technologies and Interaction · doi:10.3390/mti5120073 · Cited by 47
(2022) · doi:10.1145/3491102.3501868 · Cited by 36
“Others have studied how AI could support the routine work of clinicians [100], and help with collaborative decision making across medical experts [15].”
BackgroundEvans, R. P., Bryant, L. D., Russell, G., & Absolom, K. L. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105342 · Cited by 41
Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI
Liu, H., Das, A., Boltz, A., Zhou, D., Pinaroc, D., Lease, M., & Lee, M. K. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686962 · Cited by 48
Kaltenhauser, A., Rheinstädter, V., Butz, A. M., & Wallach, D. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395436 · Cited by 38
Kanna, G. P., Kumar, S. J. K. J., Parthasarathi, P., & Kumar, Y. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-09896-y · Cited by 36
Are Visual Explanations Useful? A Case Study in Model-in-the-Loop Prediction
Chu, E., Roy, D., & Andreas, J. (2020) · arXiv · doi:10.48550/arxiv.2007.12248 · Cited by 34
“These can often determine success in real-life settings [9, 38, 10, 5], but are out of the scope of our study.”
BackgroundKudina, O., & de Boer, B. (2021) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13535 · Cited by 34
Metacognitive sensitivity: The key to calibrating trust and optimal decision making with AI
Lee, D., Pruitt, J., Zhou, T., Du, J., & Odegaard, B. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf133 · Cited by 43
Rapid Assisted Visual Search: Supporting Digital Pathologists with Imperfect AI
Lindvall, M., Lundström, C. F., & Löwgren, J. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450681 · Cited by 43
"What is Your Envisioned Future?": Toward Human-AI Enrichment in Data Work of Asthma Care
Su, Z., He, L., Jariwala, S. P., Zheng, K., & Chen, Y. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555157 · Cited by 41
The Virtues of Interpretable Medical Artificial Intelligence
Hatherley, J. J., Sparrow, R., & Howard, M. (2022) · Cambridge Quarterly of Healthcare Ethics · doi:10.1017/s0963180122000305 · Cited by 39
A theoretical framework for human-centered intelligent information services: A systematic review
Li, Q., Li, Y., Zhang, S., Zhou, X., & Pan, Z. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103891 · Cited by 35
Agharia, S., Szatkowski, J., Fraval, A., Stevens, J. M., & Zhou, Y. (2023) · Journal of Orthopaedics · doi:10.1016/j.jor.2023.11.063 · Cited by 33
AI in Your Mind: Counterbalancing Perceived Agency and Experience in Human-AI Interaction
Hwang, A. H., & Won, A. S. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519833 · Cited by 43
Liefgreen, A., Weinstein, N., Wachter, S., & Mittelstadt, B. (2023) · AI & Society · doi:10.1007/s00146-023-01684-3 · Cited by 35
Corbett, E., & Denton, E. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594104 · Cited by 42
Rideshare Transparency: Translating Gig Worker Insights on AI Platform Design to Policy
Rao, V. N., Dalal, S., Agarwal, E., Calacci, D., & Monroy‐Hernández, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711059 · Cited by 39
Cyber-physical system with IoT-based smart vehicles
Alshdadi, A. A. (2021) · Soft Computing · doi:10.1007/s00500-021-05908-w · Cited by 32
Who is Helping Whom? Student Concerns about AI-Teacher Collaboration in Higher Education Classrooms
Han, B., Coghlan, S., Buchanan, G., & McKay, D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711104 · Cited by 31
Shi, J. M., Yoo, D. W., Wang, K., Rodriguez, V. J., Karkar, R., & Saha, K. (2026) · ACM Transactions on Computing for Healthcare · doi:10.1145/3803549 · Cited by 45
Multi-Task Fusion for Improving Mammography Screening Data Classification
Wimmer, M., Sluiter, G., Major, D., Lenis, D., Berg, A., Neubauer, T., & Bühler, K. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3129068 · Cited by 34
Explainable Recommendations and Calibrated Trust: Two Systematic User Errors
Naiseh, M., Cemiloglu, D., Al Thani, D., Jiang, N., & Ali, R. (2021) · Computer · doi:10.1109/mc.2021.3076131 · Cited by 30
AI-Moderated Decision-Making: Capturing and Balancing Anchoring Bias in Sequential Decision Tasks
Echterhoff, J. M., Yarmand, M., & McAuley, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517443 · Cited by 30
Wu, S., Cao, W., Fu, S., Yao, B., Yang, Z., Yin, C., Mishra, V., Addison, D., Zhang, P., & Wang, D. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714272 · Cited by 35
Enhancing Intuitive Decision-Making and Reliance Through Human–AI Collaboration: A Review
Xu, G., Murthy, S. V., & Jia, B. (2025) · Informatics · doi:10.3390/informatics12040135 · Cited by 44
Pul, U., Tichý, A., Pitchika, V., & Schwendicke, P. D. F. (2025) · Journal of Dentistry · doi:10.1016/j.jdent.2025.105868 · Cited by 32
Fraile Navarro, D., Kocaballi, A. B., Dras, M., & Berkovsky, S. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3569893 · Cited by 28
“Equally, it has also shown the importance of addressing clinicians’ informational needs regarding the overall model objectives and attributes [18].”
BackgroundResultGround(less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Making
Guerdan, L., Coston, A., Wu, Z. S., & Holstein, K. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3594036 · Cited by 28
Corti, L., Oltmans, R., Jung, J., Balayn, A., Wijsenbeek, M. S., & Yang, J. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642551 · Cited by 43
Metadata
- Authors
- Cai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M.
- Affiliations
- Google (United States) (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2019-11-07
- Volume
- 3
- Issue
- CSCW
- Pages
- 1-24
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2970837303
- Cited by
- 594
- References
- 79
- Citations by year
- 2026: 84 · 2025: 158 · 2024: 97 · 2023: 75 · 2022: 80 · 2021: 70 · 2020: 28 · 2019: 2
- FWCI
- 20.77
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- human-AI collaboration, physicians, prostate cancer diagnosis, pathologists, AI transparency, model limitations, second opinion, deep neural network inference, clinical decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.