Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lens
Open accessThe DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Abstract
Major depressive disorder is a debilitating disease affecting 264 million people worldwide. While many antidepressant medications are available, few clinical guidelines support choosing among them. Decision support tools (DSTs) embodying machine learning models may help improve the treatment selection process, but often fail in clinical practice due to poor system integration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“a recent study found that clinicians simply did not have time to engage with feature-based explanations for individual patient predictions and instead requested evidence that the tool had been clinically validated [37].”
From Explanations Can Reduce Overreliance on AI Systems During Decision-Making (2023) · cites this paper as [37]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The qualitative content analysis process
Elo, S., & Kyngäs, H. (2008) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04569.x · Cited by 22,617
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“Our results therefore align with recent discussions of the potential problems of using explainable AI in clinical settings [52].”
ResultDissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“We have seen several examples in recent years of AI predictions leading to biased or unfair behaviors [20, 45].”
BackgroundRush, A. J., Trivedi, M. H., Wisniewski, S. R., Nierenberg, A. A., Stewart, J. W., Warden, D., Niederehe, G., Thase, M. E., Lavori, P. W., Lebowitz, B. D., et al. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.11.1905 · Cited by 5,643
Explanation in Artificial Intelligence: Insights from the Social Sciences
Miller, T. (2017) · arXiv · doi:10.48550/arxiv.1706.07269 · Cited by 5,338
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Charles, C., Gafni, A., & Whelan, T. (1997) · Social Science & Medicine · doi:10.1016/s0277-9536(96)00221-3 · Cited by 4,137 · cited 1×
“While AI research continues to focus on improving information accuracy for clinicians, modern clinical care aspires toward shared decisionmaking with patients and clinicians working together to make decisions [12, 39].”
BackgroundGuidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 1×
“HCI research has helped to advance the field of explainable AI, examining how people interact with AI tools and designing tools to help end-users understand the inner workings of machine learning models [3, 8, 10, 24, 46, 73].”
BackgroundThe practical implementation of artificial intelligence technologies in medicine
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019) · Nature Medicine · doi:10.1038/s41591-018-0307-0 · Cited by 2,246 · cited 1×
“child welfare system [54], and medicine [22, 59, 68].”
Self-citationQualitative Interviewing and Grounded Theory Analysis
Charmaz, K., & Belgrave, L. L. (2012) · The SAGE Handbook of Interview Research: The Complexity of the Craft · doi:10.4135/9781452218403.n25 · Cited by 1,997
Research works printed but not linked: 3
- [2] Alex Albright. 2019. If You Give a Judge a Risk Score: Evidence from Kentucky Bail Decisions. The John M. Olin Center for Law, Economics, and Business Fellows' Discussion Paper Series (2019), 1-44. -
- [25] Michael C Hughes, Gabriel Hope, Leah Weiner, Thomas H Mccoy, Roy H Perlis, Erik Sudderth, and Finale Doshi-velez. 2018. Semi-Supervised PredictionConstrained Topic Models. In Proceedings of the 21st International Conference on Artificial Intelligence and Statistics (AISTATS) , Vol. 84. -
- [50] Melanie F. Pradier, Javier Zazo, Sonali Parbhoo, Roy H. Perlis, Maurizio Zazzi, and Finale Doshi-Velez. 2021. Preferential Mixture-of-Experts: Interpretable Models that Rely on Human Expertise As Much As Possible. In AMIA 2021 Virtual Informatics Summit . -
Cited by
Trust in AI: progress, challenges, and future directions
Afroogh, S., Akbari, A., Malone, E., Kargar, M., & Alambeigi, H. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-04044-8 · Cited by 507
Explanations Can Reduce Overreliance on AI Systems During Decision-Making
Vasconcelos, H., Jörke, M., Grunde-McLaughlin, M., Gerstenberg, T., Bernstein, M. S., & Krishna, R. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579605 · Cited by 402
“Ecological Validity: Selecting maze solving trade s off some ecological validity compared to other tasks, as few human-XAI tasks outside of the lab will include solving mazes, but a rich literature in cognitive psychology and cognitive science involves solving puzzles of this sort (e.g., [2, 60]).”
BackgroundInfluentialChen, H., Gomez, C., Huang, C.-M., & Unberath, M. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00699-2 · Cited by 300
“Formative user research is one possible strategy that can help designers to understand end users’ needs and background knowledge [14, 15], but other approaches exist [16].”
BackgroundMethodThe Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice
Delgado, F., Yang, S., Madaio, M., & Yang, Q. (2023) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3617694.3623261 · Cited by 256
Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations
Chen, V., Liao, Q. V., Wortman Vaughan, J., & Bansal, G. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610219 · Cited by 220
“Different from a small but growing number of qualitative studies that aim to understand the experience of decision-makers retrospectively [14, 41, 43, 60, 71], we adopt a think-aloud protocol to investigate the real-time process as participants engage with AI output [39, 77], and use the data to understand why two typ…”
MethodTun, H. M., Rahman, H. A., Naing, L., & Malik, O. A. (2025) · Journal of Medical Internet Research · doi:10.2196/69678 · Cited by 210
Position: Towards Bidirectional Human-AI Alignment
Shen, H., Knearem, T., Ghosh, R., Alkiek, K., Krishna, K., Yachuan, L., Petridis, S., Peng, Y.-H., Qiwei, L., Si, C., et al. (2025) · neural information processing systems · doi:10.52202/085713-4186 · Cited by 211
Henry, K. E., Kornfield, R., Sridharan, A., Linton, R. C., Groh, C., Wang, T., Wu, A., Mutlu, B., & Saria, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00597-7 · Cited by 207
Lai, V., Chen, C., Smith-Renner, A., Liao, Q. V., & Tan, C. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594087 · Cited by 204
“…[1, 16, 23, 30, 36, 45, 46, 68, 73, 82, 84, 101, 112], less than equals to $15 [2, 24, 38, 41, 47, 48, 72, 94], more than $15 [5, 9, 11, 15, 43, 44, 50, 57, 70, 72, 99], bonus available [2, 16, 21, 23, 29, 30, 41, 43, 61, 62, 71, 91, 105] Table 3: Types of tasks grouped by field in human-AI…”
BackgroundThieme, A., Hanratty, M., Lyons, M., Palacios, J., Marques, R. F., Morrison, C., & Doherty, G. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3564752 · Cited by 171
Fair Conformal Predictors for Applications in Medical Imaging
Lu, C., Lemay, A., Chang, K., Hoebel, K., & Kalpathy–Cramer, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21459 · Cited by 150
Henry, K. E., Adams, R., Parent, C., Soleimani, H., Sridharan, A., Johnson, L., Hager, D. N., Cosgrove, S. E., Markowski, A., Klein, E. Y., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01895-z · Cited by 144
“…can enable bedside implementation that improves responsiveness and alert value, while both reducing alert burden and the cost of additional staff 30,50,51 ; however, this introduces the question of whether clinicians would in fact use and adopt such a system and what factors may impact that use.”
BackgroundPeople Overtrust AI-Generated Medical Advice despite Low Accuracy
Shekar, S., Pataranutaporn, P., Sarabu, C. R., Cecchi, G., & Maes, P. (2025) · NEJM AI · doi:10.1056/aioa2300015 · Cited by 139
Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning
Gajos, K. Z., & Mamykina, L. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511138 · Cited by 127
“There is growing recognition that explainable AI systems should provide contrastive explanations [33, 51], but this is not yet the norm.”
BackgroundSelf-citationBreastScreening-AI: Evaluating medical intelligent agents for human-AI interactions
Calisto, F. M., Santiago, C., Nunes, N., & Nascimento, J. C. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102285 · Cited by 125
Benk, M., Kerstan, S., von Wangenheim, F., & Ferrario, A. (2024) · AI & Society · doi:10.1007/s00146-024-02059-y · Cited by 124
Seamful XAI: Operationalizing Seamful Design in Explainable AI
Ehsan, U., Liao, Q. V., Passi, S., Riedl, M. O., & Daumé, H. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637396 · Cited by 105
Wang, L., Zhang, Z., Wang, D., Cao, W., Zhou, X., Zhang, P., Liu, J., Fan, X., & Tian, F. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1187299 · Cited by 104
“Who goes first? Influences of human-AI workflow on decision making in clinical imaging,”
Fogliato, R., Chappidi, S., Lungren, M., Fisher, P., Wilson, D., Fitzke, M., Parkinson, M., Horvitz, E., Inkpen, K., & Nushi, B. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533193 · Cited by 103
Zhang, S., Yu, J., Xu, X., Yin, C., Lu, Y., Yao, B., Tory, M., Padilla, L. M., Caterino, J., Zhang, P., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642343 · Cited by 99
Evidence, ethics and the promise of artificial intelligence in psychiatry
McCradden, M., Hui, K., & Buchman, D. Z. (2023) · Journal of Medical Ethics · doi:10.1136/jme-2022-108447 · Cited by 97
Personalized health monitoring using explainable AI: bridging trust in predictive healthcare
Vani, M. S., Sudhakar, R. V., Mahendar, A., Ledalla, S., Radha, M., & Sunitha, M. (2025) · Scientific Reports · doi:10.1038/s41598-025-15867-z · Cited by 99
Rajashekar, N. C., Shin, Y. E., Pu, Y., Chung, S., You, K., Giuffre, M., Chan, C. E., Saarinen, T., Hsiao, A., Sekhon, J., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642024 · Cited by 85
Yildirim, N., Richardson, H., Wetscherek, M. T., Bajwa, J., Jacob, J., Pinnock, M. A., Harris, S., Coelho De Castro, D., Bannur, S., Hyland, S., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642013 · Cited by 82
Verma, H., Mlynář, J., Schaer, R., Reichenbach, J., Jreige, M., Prior, J. O., Évéquoz, F., & Depeursinge, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581506 · Cited by 78
Antagonistic AIPreprint
Cai, A., Arawjo, I., & Glassman, E. L. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.07350 · Cited by 78
Buçinca, Z., Swaroop, S., Paluch, A. E., Doshi‐Velez, F., & Gajos, K. Z. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713229 · Cited by 76
Self-citationPedro, A. R., Dias, M. B., Laranjo, L., Cunha, A. S., & Cordeiro, J. V. (2023) · PLOS ONE · doi:10.1371/journal.pone.0290613 · Cited by 74
Zając, H. D., Li, D., Dai, X., Carlsen, J. F., Kensing, F., & Andersen, T. O. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3582430 · Cited by 74
Vereschak, O., Alizadeh, F., Bailly, G., & Caramiaux, B. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642018 · Cited by 72
Harnessing Biomedical Literature to Calibrate Clinicians’ Trust in AI Decision Support Systems
Yang, Q., Hao, Y., Quan, K., Yang, S., Zhao, Y., Kuleshov, V., & Wang, F. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581393 · Cited by 72
Bertrand, A., Viard, T., Belloum, R., Eagan, J. R., & Maxwell, W. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581314 · Cited by 71
El–Sappagh, S., Alonso, J. M., Abuhmed, T., Ali, F., & Bugarín, A. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10415-5 · Cited by 70
Ma, Z., Mei, Y., Long, Y., Su, Z., & Gajos, K. Z. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642482 · Cited by 68
Self-citationPark, H., Ahn, D., Hosanagar, K., & Lee, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517672 · Cited by 67
Healthcare AI Treatment Decision Support: Design Principles to Enhance Clinician Adoption and Trust
Burgess, E. R., Jankovic, I., Austin, M., Cai, N., Kapuścińska, A., Currie, S., Overhage, J. M., Poole, E. S., & Kaye, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581251 · Cited by 65
Reicherts, L., Zhang, Z. T., von Oswald, E., Liu, Y., Rogers, Y., & Hassib, M. E. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713295 · Cited by 64
Optimizing human-centered AI for healthcare in the Global South
Okolo, C. T. (2022) · Patterns · doi:10.1016/j.patter.2021.100421 · Cited by 62
Unpacking Human-AI Interaction in Safety-Critical Industries: A Systematic Literature Review
Bach, T. A., Kristiansen, J. K., Babić, A., & Jacovi, A. (2024) · IEEE Access · doi:10.1109/access.2024.3437190 · Cited by 62
Li, B., Gross, O., Crampton, N., Kapoor, M., Tauseef, S., Jain, M., Truong, K. N., & Mariakakis, A. T. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641913 · Cited by 61
van Berkel, N., Sarsenbayeva, Z., & Gonçalves, J. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102954 · Cited by 61
Bertrand, A., Eagan, J., & Maxwell, W. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594053 · Cited by 61
The use of AI in mental health services to support decision-making: scoping review
Auf, H., Svedberg, P., Nygren, J., Nair, M., & Lundgren, L. E. (2025) · Journal of Medical Internet Research · doi:10.2196/63548 · Cited by 56
“Moreover, when multiple end users with different backgrounds use a single AI interface for decision-making, there is a growing need for interfaces to provide on-demand customized explanations to fit the understanding and reasoning of multiple stakeholders [59].”
Explainable AI: roles and stakeholders, desirements and challenges
Hoffman, R. R., Mueller, S. T., Klein, G. A., Jalaeian, M., & Tate, C. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1117848 · Cited by 57
Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care Unit
Yildirim, N., Zlotnikov, S., Sayar, D., Kahn, J. M., Bukowski, L. A., Amin, S. S., Riman, K. A., Davis, B. S., Minturn, J. S., King, A. J., et al. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641896 · Cited by 55
Gu, H., Liang, Y., Xu, Y., Williams, C. K., Magaki, S., Khanlou, N., Vinters, H., Chen, Z., Ni, S., Yang, C., et al. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3577011 · Cited by 54
Tulk Jesso, S., Kelliher, A., Sanghavi, H., Martin, T., & Henrickson Parker, S. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.830345 · Cited by 54
Shekar, S., Pataranutaporn, P., Sarabu, C. R., Cecchi, G., & Maes, P. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.15266 · Cited by 54
Selective Explanations: Leveraging Human Input to Align Explainable AI
Lai, V., Zhang, Y., Chen, C., Liao, Q. V., & Tan, C. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610206 · Cited by 53
Olsen, H. P., Hildebrandt, T., Wiesener, C., Larsen, M. S., & Flügge, A. W. A. (2024) · Digital Government Research and Practice · doi:10.1145/3632753 · Cited by 53
Insights From Art Therapists on Using AI-Generated Art in Art Therapy: Mixed Methods Study
Shojaei, F., Shojaei, F., Torres, J. O., & Shih, P. C. (2024) · JMIR Formative Research · doi:10.2196/63038 · Cited by 53
AI Trust: Can Explainable AI Enhance Warranted Trust?
de Brito Duarte, R., Correia, F., Arriaga, P., & Paiva, A. (2023) · Human Behavior and Emerging Technologies · doi:10.1155/2023/4637678 · Cited by 52
Critical roles of explainability in shaping perception, trust, and acceptance of autonomous vehicles
Zhang, T., Li, W., Huang, W., & Ma, L. (2024) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2024.103568 · Cited by 53
Turchi, T., Prencipe, G., Malizia, A., Filogna, S., Latrofa, F., & Sgandurra, G. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102850 · Cited by 49
How Time Pressure in Different Phases of Decision-Making Influences Human-AI Collaboration
Cao, S., Gomez, C., & Huang, C.-M. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610068 · Cited by 48
Public Health Calls for/with AI: An Ethnographic Perspective
Ismail, A., Thakkar, D., Madhiwalla, N., & Kumar, N. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610203 · Cited by 47
AI Consent Futures: A Case Study on Voice Data Collection with Clinicians
Wilcox, L. G., Brewer, R. N., & Díaz, F. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610107 · Cited by 45
He, X., Hong, Y., Zheng, X., & Zhang, Y. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2095093 · Cited by 43
Wentzel, A., Kamel, S., Zhang, X., Canahuate, G. M., Fuller, C. D., & Marai, G. E. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456160 · Cited by 43
"What is Your Envisioned Future?": Toward Human-AI Enrichment in Data Work of Asthma Care
Su, Z., He, L., Jariwala, S. P., Zheng, K., & Chen, Y. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555157 · Cited by 41
Generative Artificial Intelligence in Medicine
Shanmugam, D., Agrawal, M., Movva, R., Chen, I. Y., Ghassemi, M., Jacobs, M. L., & Pierson, E. (2025) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-103123-095332 · Cited by 42
Self-citationEvans, R. P., Bryant, L. D., Russell, G., & Absolom, K. L. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105342 · Cited by 41
Andersen, T. O., Nunes, F., Wilcox, L., Coiera, E., & Rogers, Y. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3589961 · Cited by 40
Calisto, F. M., Abrantes, J. M., Santiago, C., Nunes, N. J., & Nascimento, J. C. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103444 · Cited by 40
Schepart, A., Burton, A., Durkin, L., Fuller, A., Charap, E., Bhambri, R., & Ahmad, F. S. (2023) · Cardiovascular Digital Health Journal · doi:10.1016/j.cvdhj.2023.04.003 · Cited by 40
How Human-Centered Explainable AI Interface Are Designed and Evaluated: A Systematic SurveyPreprint
Nguyen, T., Canossa, A., & Zhu, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.14496 · Cited by 40
van der Meijden, S. L., de Hond, A. A. H., Thoral, P. J., Steyerberg, E. W., Kant, I. M. J., Cinà, G., & Arbous, M. S. (2023) · JMIR Human Factors · doi:10.2196/39114 · Cited by 39
Jin, W., Fatehi, M., Guo, R., & Hamarneh, G. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102751 · Cited by 39
Oberste, L., & Heinzl, A. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3227225 · Cited by 39
(De)troubling transparency: artificial intelligence (AI) for clinical applications
Winter, P. D., & Carusi, A. (2023) · Medical Humanities · doi:10.1136/medhum-2021-012318 · Cited by 36
Wu, S., Cao, W., Fu, S., Yao, B., Yang, Z., Yin, C., Mishra, V., Addison, D., Zhang, P., & Wang, D. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714272 · Cited by 35
Maslej, M. M., Kloiber, S. M., Ghassemi, M., Yu, J., & Hill, S. (2023) · Translational Psychiatry · doi:10.1038/s41398-023-02509-z · Cited by 35
On Hackathons: A Multidisciplinary Literature Review
Chau, C. W., & Gerber, E. M. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581234 · Cited by 34
Decoding AI’s Nudge: A Unified Framework to Predict Human Behavior in AI-Assisted Decision Making
Li, Z., Lu, Z., & Yin, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i9.28872 · Cited by 34
Kim, D., Vegt, N., Visch, V., & Bos-De Vos, M. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642883 · Cited by 33
“Previous research on clinical AI applications has emphasized the importance of training users (mostly healthcare providers) and providing explanations for algorithmic predictions to help users understand the limitations of AI models better [18, 29].”
InfluentialTell me something interesting: Clinical utility of machine learning prediction models in the ICU
Eini-Porat, B., Amir, O., Eytan, D., & Shalit, U. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104107 · Cited by 33
Explainable AI decision support improves accuracy during telehealth strep throat screening
Gomez, C., Smith, B.-L., Zayas, A., Unberath, M., & Canares, T. (2024) · Communications Medicine · doi:10.1038/s43856-024-00568-x · Cited by 30
Savardi, M., Signoroni, A., Benini, S., Vaccher, F., Alberti, M., Ciolli, P., Di Meo, N., Falcone, T., Ramanzin, M., Romano, B., et al. (2025) · Insights into Imaging · doi:10.1186/s13244-024-01893-4 · Cited by 30
Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Process
Zhang, Z. T., Feger, S. S., Dullenkopf, L., Liao, R., Süsslin, L. E., Liu, Y., & Butz, A. M. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3687024 · Cited by 31
Fraile Navarro, D., Kocaballi, A. B., Dras, M., & Berkovsky, S. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3569893 · Cited by 28
“Studies have evaluated the use of various automated systems such as Decision Support Systems to guide prescription decisions [57] combined with earlier NLP developments integrated into the EHR [33].”
MethodLiu, D., Zhang, Y., Zhao, B., Ma, S., Shi, C., & Ma, X. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714196 · Cited by 28
Agapie, E., Haldar, S., & Poblete, S. G. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555610 · Cited by 27
Kozlakidis, Z., Muradyan, A., & Sargsyan, K. (2024) · Sustainable development goals series · doi:10.1007/978-3-031-62332-5 · Cited by 27
Invisible clinical labor driving the successful integration of AI in healthcare
Ulloa, M., Rothrock, B., Ahmad, F. S., & Jacobs, M. L. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.1045704 · Cited by 26
Self-citationParticipatory AI Considerations for Advancing Racial Health Equity
Parker, A. G., Vardoulakis, L., Alla, J., & Harrington, C. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713165 · Cited by 26
Clinicians must participate in the development of multimodal AI
Banerji, C. R. S., Shah, A. B., Dabson, B., Chakraborti, T., Hellon, V., Harbron, C. G., & MacArthur, B. D. (2025) · EClinicalMedicine · doi:10.1016/j.eclinm.2025.103252 · Cited by 24
"It depends": Configuring AI to Improve Clinical Usefulness Across Contexts
Zając, H. D., Ribeiro, J., Ingala, S., Gentile, S., Wanjohi, R., Gitau, S. N., Carlsen, J. F., Nielsen, M. B., & Andersen, T. O. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3660707 · Cited by 25
Yildirim, N., Zlotnikov, S., Venkat, A., Chawla, G., Kim, J., Bukowski, L. A., Kahn, J. M., McCann, J., & Zimmerman, J. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641982 · Cited by 23
Zając, H. D., Andersen, T. O., Kwasa, E., Wanjohi, R., Onyinkwa, M. K., Mwaniki, E. K., Gitau, S. N., Yaseen, S. S., Carlsen, J. F., Fraccaro, M., et al. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3715115 · Cited by 22
Jo, E., Ryu, M., Kenderova, G., So, S., Shapiro, B. B., Papoutsaki, A., & Epstein, D. A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502206 · Cited by 22
McCradden, M. D., Thai, K., Assadi, A., Tonekaboni, S., Stedman, I., Joshi, S. D., Zhang, M., Chevalier, F., & Goldenberg, A. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2024-112919 · Cited by 21
Meaningful Transparency for Clinicians: Operationalising HCXAI Research with Gynaecologists
Schor, B. G. S., Kallina, E., Singh, J., & Blackwell, A. F. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658971 · Cited by 20
Thieme, A., Rajamohan, A. M., Cooper, B., Groombridge, H., Simister, R. J., Wong, B., Woznitza, N., Pinnock, M. A., Wetscherek, M. T., Morrison, C. P., et al. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3716500 · Cited by 20
Winter, P., & Carusi, A. (2022) · Journal of Responsible Technology · doi:10.1016/j.jrt.2022.100052 · Cited by 20
Kim, J. P., Ryan, K., Kasun, M., Hogg, J., Dunn, L. B., & Roberts, L. W. (2023) · JMIR AI · doi:10.2196/47449 · Cited by 20
Tadepalli, K., Das, A., Meena, T., & Roy, S. S. (2025) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2025.108682 · Cited by 18
Xu, Y., Shao, Y., Dong, J., Shi, S., Jiang, C., & Li, Q. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713772 · Cited by 18
Lee, J., Jung, K., Newman, E., Chow, E., & Chen, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713244 · Cited by 18
Zhang, Z. T., Liu, Y., & Hußmann, H. (2021) · Biannual Conference of the Italian SIGCHI Chapter (CHItaly) · doi:10.1145/3464385.3464696 · Cited by 17
Using Sensor-Captured Patient-Generated Data to Support Clinical Decision-making in PTSD Therapy
Evans, H. I., Ryu, M., Hsieh, T., Zhou, J., Xu, K., Akers, K. W., Sherrill, A. M., & Arriaga, R. I. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637426 · Cited by 17
Metadata
- Authors
- Jacobs, M., He, J., F. Pradier, M., Lam, B., Ahn, A. C., McCoy, T. H., Perlis, R. H., Doshi-Velez, F., & Gajos, K. Z.
- Affiliations
- Northwestern University (US)
- Harvard University (US)
- Center for Research on Computation and Society Harvard University, United States
- Beth Israel Deaconess Medical Center (US)
- Massachusetts General Hospital (US)
- SEAS Harvard University, United States
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-14
- OpenAlex
- W3127032480
- Cited by
- 177
- References
- 79
- Citations by year
- 2026: 30 · 2025: 43 · 2024: 38 · 2023: 33 · 2022: 29 · 2021: 4
- FWCI
- 23.31
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- major depressive disorder, antidepressant selection, clinical decision support systems, machine learning in medicine, trust in AI, socio-technical systems, system integration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.