Augmenting Clinical Decision-Making with an Interactive and Interpretable AI Copilot: A Real-World User Study with Clinicians in Nephrology and Obstetrics
Open accessThe DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Abstract
Clinician skepticism toward opaque AI hinders adoption in high-stakes healthcare. We present AICare, an interactive and interpretable AI copilot for collaborative clinical decision-making. By analyzing longitudinal electronic health records, AICare grounds dynamic risk predictions in scrutable visualizations and LLM-driven diagnostic recommendations. Through a within-subjects counterbalanced study with 16 clinicians across nephrology and obstetrics, we comprehensively evaluated AICare using objective measures (task completion time and error rate), subjective assessments (NASA-TLX, SUS, and confidence ratings), and semi-structured interviews. Our findings indicate AICare’s reduced cognitive workload. Beyond performance metrics, qualitative analysis reveals that trust is actively constructed through verification, with interaction strategies diverging by expertise: junior clinicians used the system as cognitive scaffolding to structure their analysis, while experts engaged in adversarial verification to challenge the AI’s logic. This work offers design implications for creating AI systems that function as transparent partners, accommodating diverse reasoning styles to augment rather than replace clinical judgment.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
DeepSeek-AI, Guo, D., Yang, D., Zhang, H., Song, J., Wang, P., Zhu, Q., Xu, R., Zhang, R., Ma, S., et al. (2025) · arXiv · doi:10.48550/arxiv.2501.12948 · Cited by 18,918
Self-citation"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555 · cited 1×
“Common techniques include feature importance methods like SHAP (SHapley Additive exPlanations) or LIME (Local Interpretable Model-agnostic Explanations), which highlight the factors driving a prediction [40, 54].”
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · cited 1×
“We assess cognitive workload using the NASA Task Load Index (NASA-TLX) [26, 27] (see Appendix F.3).”
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · cited 1×
“On one hand, algorithmic performance continues to break records in controlled experiments [19, 51, 65, 82, 84].”
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312 · cited 1×
“On one hand, algorithmic performance continues to break records in controlled experiments [19, 51, 65, 82, 84].”
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181
Rajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 2×
“Immediately after completing each block of 5 cases, participants filled out the NASA-Task Load Index (NASA-TLX) questionnaire to assess their perceived cognitive workload for that condition [26].”
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083 · cited 1×
“Recent Large Language Models (LLMs) and deep learning architectures often match or exceed human experts in diagnostic tasks ranging from radiology to medical licensing examinations [20, 50, 58].”
An overview of clinical decision support systems: Benefits, risks, and strategies for success
Sutton, R. T., Pincock, D., Baumgart, D. C., Sadowski, D. C., Fedorak, R. N., & Kroeker, K. I. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0221-y · Cited by 3,019 · cited 1×
“Historically, Clinical Decision Support Systems (CDSS) often functioned as rule-based alert systems, providing reminders or flagging potential drug interactions [6, 45, 61].”
The aligned rank transform for nonparametric factorial analyses using only anova procedures
Wobbrock, J. O., Findlater, L., Gergle, D., & Higgins, J. J. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978963 · Cited by 2,854 · cited 1×
“The interview, detailed in Appen-dix F.7, explored their overall impressions of AICare, focusing on trust, usability, workflow integration, and the system’s clinical value.”
The System Usability Scale: Past, Present, and Future
Lewis, J. R. (2018) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2018.1455307 · Cited by 1,958 · cited 1×
“After completing all 10 cases, participants filled out the System Usability Scale (SUS) [36] and the Trust in Automation scale for the AICare system.”
Causability and explainability of artificial intelligence in medicine
Holzinger, A., Langs, G., Denk, H., Zatloukal, K., & Müller, H. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1312 · Cited by 1,885 · cited 1×
“Consequently, interpretability in AI has become a major focus [3, 29].”
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
The false hope of current approaches to explainable artificial intelligence in health care
Ghassemi, M., Oakden-Rayner, L., & Beam, A. L. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00208-9 · Cited by 1,724 · cited 1×
“However, studies show that standard “feature importance” explanations often fail to improve decision outcomes because they increase cognitive load without improving the user’s ability to detect errors [22, 46, 70].”
Shickel, B., Tighe, P. J., Bihorac, A., & Rashidi, P. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2767063 · Cited by 1,688 · cited 1×
“We contend that one of the most complex and critical challenges for clinical AI is the management of chronic conditions through long-term, longitudinal patient follow-up [16, 56], which involves reasoning over sparse, high-dimensional, and irreg-ularly sampled time-series data [42].”
InfluentialBuçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
Wong, A., Otles, E., Donnelly, J. P., Krumm, A., McCullough, J., DeTroyer-Cooley, O., Pestrue, J., Phillips, M., Konye, J., Penoza, C., et al. (2021) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2021.2626 · Cited by 995 · cited 1×
“With the advent of machine learning, these systems evolved to offer predictive analytics, such as risk scores for patient deterioration or disease onset [55], with prominent examples like the Epic Sepsis Model providing a single risk score to alert clinicians [73].”
Cognitive and usability engineering methods for the evaluation of clinical information systems.
Kushniruk, A. W., & Patel, V. L. (2004) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2004.01.003 · Cited by 760 · cited 1×
“Qualitatively, the superiority of the AI copilot stems from its ability to mitigate the information overload inherent in high-dimensional tabular datasets [34].”
Vellido, A. (2020) · Neural Computing and Applications · doi:10.1007/s00521-019-04051-w · Cited by 635 · cited 1×
“The “black box” nature of many deep learning models is a significant barrier to their adoption in healthcare, a field where accountability and justification are paramount [59, 67].”
Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design
Yang, Q., Steinfeld, A., Rosé, C., & Zimmerman, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376301 · Cited by 622 · cited 1×
“Yang et al. further attribute this difficulty to capability uncertainty, arguing that trust cannot be static because the AI functions as a living, sociotechnical system with evolving boundaries [76].”
Beede, E., Baylor, E., Hersch, F., Iurchenko, A., Wilcox, L., Ruamviboonsuk, P., & Vardoulakis, L. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376718 · Cited by 614 · cited 3×
“On the other hand, the successful and sustained deployment of these systems into actual clinical practice remains rare [5, 47, 80].”
Cai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594 · cited 2×
“Cai et al. found that pathologists need to understand the subjectivity and “medical personality” of the AI to treat it as a colleague rather than a tool [13].”
Do as AI say: susceptibility in deployment of clinical decision-aids
Gaube, S., Suresh, H., Raue, M., Merritt, A., Berkowitz, S. J., Lermer, E., Coughlin, J. F., Guttag, J. V., Colak, E., & Ghassemi, M. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00385-9 · Cited by 543 · cited 3×
“…frameworks warn of de-skilling for junior clinicians or algorithmic aversion from experts, there is limited empirical evidence demonstrating how interactive features might mitigate these risks by supporting distinct cognitive strategies for novices versus experts within the same system [7, 21, 72].”
A tutorial on calibration measurements and calibration models for clinical prediction models
Huang, Y., Li, W., Macheret, F., Gabriel, R. A., & Ohno-Machado, L. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz228 · Cited by 486
Miller, R. A. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95236141 · Cited by 458 · cited 1×
“Historically, Clinical Decision Support Systems (CDSS) often functioned as rule-based alert systems, providing reminders or flagging potential drug interactions [6, 45, 61].”
Trust and reliance on AI — An experimental study on the extent and costs of overreliance on AI
Klingbeil, A., Grützner, C., & Schreck, P. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108352 · Cited by 450
Wang, X., & Yin, M. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450650 · Cited by 320 · cited 1×
“However, studies show that standard “feature importance” explanations often fail to improve decision outcomes because they increase cognitive load without improving the user’s ability to detect errors [22, 46, 70].”
DeepSeek-AI, Liu, A., Feng, B., Xue, B., Wang, B., Wu, B., Lu, C., Zhao, C., Deng, C., Zhang, C., et al. (2024) · arXiv · doi:10.48550/arxiv.2412.19437 · Cited by 294
Self-citationHeer, J., & Shneiderman, B. (2012) · Queue · doi:10.1145/2133416.2146416 · Cited by 269
Yang, Q., Steinfeld, A., & Zimmerman, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300468 · Cited by 247 · cited 3×
“Medical decision-making is inherently collaborative, iterative, and socially situated [63, 77, 81].”
ConCare: Personalized Clinical Feature Embedding via Capturing the Healthcare Context
Ma, L., Zhang, C., Wang, Y., Ruan, W., Wang, J., Tang, W., Ma, X., Gao, X., & Gao, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5428 · Cited by 224 · cited 3×
“We contend that one of the most complex and critical challenges for clinical AI is the management of chronic conditions through long-term, longitudinal patient follow-up [16, 56], which involves reasoning over sparse, high-dimensional, and irreg-ularly sampled time-series data [42].”
InfluentialSelf-citationTun, H. M., Rahman, H. A., Naing, L., & Malik, O. A. (2025) · Journal of Medical Internet Research · doi:10.2196/69678 · Cited by 210
Wang, D., Wang, L., Zhang, Z., Wang, D., Zhu, H., Gao, Y., Fan, X., & Tian, F. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445432 · Cited by 209
Self-citationOverview of Clinical Decision Support Systems
Berner, E. S., & Lande, T. J. L. (2016) · Health informatics · doi:10.1007/978-3-319-31913-1_1 · Cited by 206
Thieme, A., Hanratty, M., Lyons, M., Palacios, J., Marques, R. F., Morrison, C., & Doherty, G. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3564752 · Cited by 171 · cited 2×
“Unlike a static predictor, an AI copilot facilitates clinical legitimacy not by demanding blind trust, but by providing the interactive mechanisms for clinicians to triangulate evidence and actively interrogate the underlying data [13, 44, 62].”
Shickel, B., Loftus, T. J., Adhikari, L., Ozrazgat-Baslanti, T., Bihorac, A., & Rashidi, P. (2019) · Scientific Reports · doi:10.1038/s41598-019-38491-0 · Cited by 165 · cited 1×
“With the advent of machine learning, these systems evolved to offer predictive analytics, such as risk scores for patient deterioration or disease onset [55], with prominent examples like the Epic Sepsis Model providing a single risk score to alert clinicians [73].”
Sivaraman, V., Bukowski, L. A., Levin, J., Kahn, J. M., & Perer, A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581075 · Cited by 141
Sox, H. C., Higgins, M. C., & Owens, D. K. (2013) · Wiley eBooks · doi:10.1002/9781118341544 · Cited by 136 · cited 1×
“Instead, it is an iterative process involving hypothesis generation, evidence gathering, and cross-checking, where clinicians must weigh conflicting data points against patient history and clinical guidelines [60, 63, 81].”
Singh, A., Nadkarni, G., Gottesman, O., Ellis, S. B., Bottinger, E. P., & Guttag, J. V. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.11.005 · Cited by 136
Co-design of human-centered, explainable AI for clinical decision support
Panigutti, C., Beretta, A., Fadda, D., Giannotti, F., Pedreschi, D., Perotti, A., & Rinzivillo, S. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3587271 · Cited by 127
Walsh, C. G., Sharman, K., & Hripcsak, G. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.10.008 · Cited by 99 · cited 1×
“To enhance the clinical utility of the model’s predictions, we implemented a two-stage post-hoc optimization process on the validation set after training was complete [68].”
Zhang, S., Yu, J., Xu, X., Yin, C., Lu, Y., Yao, B., Tory, M., Padilla, L. M., Caterino, J., Zhang, P., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642343 · Cited by 99
Healthcare AI Treatment Decision Support: Design Principles to Enhance Clinician Adoption and Trust
Burgess, E. R., Jankovic, I., Austin, M., Cai, N., Kapuścińska, A., Currie, S., Overhage, J. M., Poole, E. S., & Kaye, J. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581251 · Cited by 95 · cited 2×
“They need clinical legitimacy, inter-pretability that aligns with medical ontology and clinical reasoning structures [12, 14, 64].”
Assertiveness-based Agent Communication for a Personalized Medicine on Medical Imaging Diagnosis
Calisto, F. M., Fernandes, J., Morais, M., Santiago, C., Abrantes, J. M., Nunes, N., & Nascimento, J. C. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580682 · Cited by 93 · cited 2×
“Calisto et al. demonstrated that the optimal communication style of an AI varies by user: junior clinicians benefit from assertive guidance that provides structure, while experts prefer suggestive support that respects their autonomy and experience [14, 15].”
Bienefeld, N., Keller, E., & Grote, G. (2024) · Journal of Medical Internet Research · doi:10.2196/50852 · Cited by 88 · cited 1×
“Bienefeld et al. warn that without careful design, automation can atrophy the implicit knowledge required for holistic care [7, 8].”
Rajashekar, N. C., Shin, Y. E., Pu, Y., Chung, S., You, K., Giuffre, M., Chan, C. E., Saarinen, T., Hsiao, A., Sekhon, J., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642024 · Cited by 85
Zhu, Y., Ren, C., Wang, Z., Zheng, X., Xie, S., Feng, J., Zhu, X., Li, Z., Ma, L., & Pan, C. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679582 · Cited by 84
Self-citationBienefeld, N., Keller, E., & Grote, G. (2024) · Journal of Medical Internet Research · doi:10.2196/50130 · Cited by 83 · cited 3×
“Bienefeld et al. warn that without careful design, automation can atrophy the implicit knowledge required for holistic care [7, 8].”
Yildirim, N., Richardson, H., Wetscherek, M. T., Bajwa, J., Jacob, J., Pinnock, M. A., Harris, S., Coelho De Castro, D., Bannur, S., Hyland, S., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642013 · Cited by 82 · cited 2×
“This aligns with findings that clinical usefulness is distinct from algorithmic accuracy; usefulness depends on the configurability of the system to local workflows, such as prioritizing worklists or drafting reports, rather than just diagnosing pathology [63, 78, 80].”
Quantifying the impact of AI recommendations with explanations on prescription decision making
Nagendran, M., Festor, P., Komorowski, M., Gordon, A. C., & Faisal, A. A. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00955-z · Cited by 80 · cited 1×
“However, studies show that standard “feature importance” explanations often fail to improve decision outcomes because they increase cognitive load without improving the user’s ability to detect errors [22, 46, 70].”
Does More Advice Help? The Effects of Second Opinions in AI-Assisted Decision Making
Lu, Z., Wang, D., & Yin, M. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3653708 · Cited by 77
Comanici, G., Bieber, E., Schaekermann, M., Pasupat, I., Sachdeva, N., Dhillon, I., Blistein, M., Ram, O., Zhang, D., Rosen, E., et al. (2025) · arXiv · doi:10.48550/arxiv.2507.06261 · Cited by 69
Self-citationReicherts, L., Zhang, Z. T., von Oswald, E., Liu, Y., Rogers, Y., & Hassib, M. E. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713295 · Cited by 63 · cited 1×
“Ideally, interactive systems should support forward reasoning, where the AI extends the user’s thought process, engendering deeper engagement than those that simply provide a retrospective justification [50, 53].”
Realizing AI in Healthcare: Challenges Appearing in the Wild
Andersen, T. O., Nunes, F., Wilcox, L. G., Kaziunas, E., Matthiesen, S., & Magrabi, F. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3441347 · Cited by 52 · cited 2×
“This disconnect is widely termed the “last mile” problem of medical AI [48, 63].”
Woolley, S. B., Cardoni, A. A., & Goethe, J. W. (2009) · Pharmacotherapy: The Journal of Human Pharmacology and Drug Therapy · doi:10.1592/phco.29.12.1408 · Cited by 52 · cited 1×
“The process includes feature engineering, handling of missing values using methods such as Last Observation Carried Forward (LOCF) [74] and median imputation, feature normalization, and balancing of class distributions through oversampling.”
McGrath, M. J., Duenser, A., Lacey, J., & Paris, C. (2025) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2025.100200 · Cited by 51
Goh, E., Bunning, B., Khoong, E. C., Gallo, R. J., Milstein, A., Centola, D., & Chen, J. H. (2025) · Communications Medicine · doi:10.1038/s43856-025-00781-2 · Cited by 50
Bach, A. K. P., Nørgaard, T. M., Brok, J. C., & van Berkel, N. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581513 · Cited by 47
Mortality prediction with adaptive feature importance recalibration for peritoneal dialysis patients
Ma, L., Zhang, C., Gao, J., Jiao, X., Yu, Z., Zhu, Y., Wang, T., Ma, X., Wang, Y., Tang, W., et al. (2023) · Patterns · doi:10.1016/j.patter.2023.100892 · Cited by 40
Self-citationCalisto, F. M., Abrantes, J. M., Santiago, C., Nunes, N. J., & Nascimento, J. C. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103444 · Cited by 40 · cited 2×
“They need clinical legitimacy, inter-pretability that aligns with medical ontology and clinical reasoning structures [12, 14, 64].”
Gao, J., Zhu, Y., Wang, W., Wang, Z., Dong, G., Tang, W., Wang, H., Wang, Y., Harrison, E. M., & Ma, L. (2024) · Patterns · doi:10.1016/j.patter.2024.100951 · Cited by 24 · cited 1×
“Recent Large Language Models (LLMs) and deep learning architectures often match or exceed human experts in diagnostic tasks ranging from radiology to medical licensing examinations [20, 50, 58].”
Self-citationHussain, M. H., Iacovides, I., Lawton, T., Sharma, V., Porter, Z., Cunningham, A., Habli, I., Hickey, S., Jia, Y., Morgan, P., et al. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3660697 · Cited by 24 · cited 3×
“Furthermore, the lack of transparency prevents clinicians from performing their ethical duty of verification, turning the clinician into a liable agent who is responsible for AI errors without possessing the means to interrogate or understand them [7, 31].”
Zhu, Y., Wang, Z., He, L., Xie, S., Zheng, X., Ma, L., & Pan, C. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679521 · Cited by 24 · cited 1×
“On one hand, algorithmic performance continues to break records in controlled experiments [19, 51, 65, 82, 84].”
Self-citationZając, H. D., Andersen, T. O., Kwasa, E., Wanjohi, R., Onyinkwa, M. K., Mwaniki, E. K., Gitau, S. N., Yaseen, S. S., Carlsen, J. F., Fraccaro, M., et al. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3715115 · Cited by 22
Thieme, A., Rajamohan, A. M., Cooper, B., Groombridge, H., Simister, R. J., Wong, B., Woznitza, N., Pinnock, M. A., Wetscherek, M. T., Morrison, C. P., et al. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3716500 · Cited by 20
Wolf, S., Grundgeiger, T., Zähringer, R., Shishkova, L., Maas, F., Dilling, C., & Happel, O. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713372 · Cited by 12 · cited 3×
“In this mode, the AI helps novices structure their learning and organizes complex data without removing the cognitive effort required for mastery [63, 72].”
Xu, X., Xu, Z., Ma, T., Li, S., Pei, H., Zhao, J., Zhang, Y., Xiong, Z., Liao, Y., Li, Y., et al. (2024) · Clinical Kidney Journal · doi:10.1093/ckj/sfae242 · Cited by 12
Self-citationThieme, A., Rajamohan, A., Cooper, B., Groombridge, H., Simister, R., Wong, B., Woznitza, N., Pinnock, M. A., Wetscherek, M. T., Morrison, C., et al. (2024) · arXiv · doi:10.48550/arxiv.2405.05299 · Cited by 10
Distributing Deep Learning Hyperparameter Tuning for 3D Medical Image Segmentation
Berral, J. L., Aranda, O., Domínguez, J. L., & Torres, J. (2022) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw55747.2022.00172 · Cited by 9 · cited 1×
“These parameters were determined through a combination of standard practices and experimentation on the validation sets [38].”
Başaran, E., Tanaçan, A., Farisoğulları, N., et al. (2024) · Journal of Perinatal Medicine · doi:10.1515/jpm-2024-0337 · Cited by 2
Research works printed but not linked: 5
- Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian Q Weinberger. 2017. On calibration of modern neural networks. In International conference on machine learning. PMLR, 1321–1330.
- Scott M Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. Advances in neural information processing systems 30 (2017).
- John D Manning Beatriz E Marciano and James J Cimino. 2013. Visualizing the data–using lifelines2 to gain insights from data drawn from a clinical data repository. AMIA summits on translational science proceedings 2013 (2013) 168.
- National Academy of Medicine; The Learning Health System Series. 2023. Artificial Intelligence in Health Care: The Hope, the Hype, the Promise, the Peril. National Academies Press (US), Washington (DC).
- Sana Tonekaboni, Shalmali Joshi, Melissa D McCradden, and Anna Goldenberg. 2019. What clinicians want: contextualizing explainable machine learning for clinical end use. In Machine learning for healthcare conference. PMLR, 359–380.
Cited by
Choube, A., Shrestha, S., Le, H., Li, J.-C., Swain, V. D., & Mishra, V. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3832033 · Cited by 3
(2000) · Time to knit · doi:10.1145/3772318.3808884
OneEHR: Reproducible and AI Agent-Ready Longitudinal EHR Analysis Toolkit
Zhu, Y., Wang, Z., Gu, L., Sui, D., Wang, Y., Harrison, E. M., Fu, T., Gao, J., Yu, L., & Ma, L. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3816474
Self-citationArtificial Intelligence–Driven Decision Fatigue in Healthcare Management Systems
Abbas, K. D., Fahmi, A. M., & Kanbar, A. B. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-39711-9_18
Metadata
- Authors
- Zhu, Y., Sui, D., Wang, Z., Hu, X., Gu, L., Qi, Y., Wu, T., Wang, L., Wei, Y., Tang, W., Cui, Z., Wang, Y., Yu, L., Harrison, E. M., Gao, J., & Ma, L.
- Affiliations
- Peking University (CN)
- Hong Kong University of Science and Technology (HK)
- Peking University Third Hospital (CN)
- Xuzhou Medical College (CN)
- University of Hong Kong (HK)
- University of Edinburgh (GB)
- Health Data Research UK (GB)
- ORCID
- Venue
- Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2026-04-13
- Pages
- 1-26
- OpenAlex
- W7154143872
- Semantic Scholar
- 13365a9a9f9d796af8dc1d69460c8fab660fa915
- Cited by
- 3
- References
- 69
- Citations by year
- 2026: 3
- FWCI
- 25.86
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- Funders
- National Natural Science Foundation of China (62402017, 82470774, 82561128248, 82504426)
- Research Grants Council of Hong Kong (27206123, 17200125, C5055-24G, T45-401/22-N)
- Hong Kong Innovation and Technology Fund (GHP/318/22GD)
- Beijing Natural Science Foundation (QY25224, L244063, L244025)
- Peking University (Clinical Medicine Plus X Pilot Project) (2024YXXLHGG007)
- Peking University (\"TengYun\" Clinical Research Program) (TY2025015)
- Beijing Traditional Chinese Medicine Science and Technology Development Fund (BJZYZD-2025-13)
- Beijing Municipal Health Commission Research Ward Excellence Clinical Research Program (BRWEP2024W032150205)
- Xuzhou Scientific Technological Projects (KC23143)
- Health Data Research UK-The Alan Turing Institute Wellcome PhD Programme in Health Data Science (218529/Z/19/Z)
- Baidu Scholarship (/)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- AI copilots, explainable AI, clinical decision-making, clinician trust in AI, mental workload, nephrology, obstetrics, cognitive scaffolding, adversarial verification, AI adoption in healthcare, NASA-TLX, System Usability Scale
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.