Assertiveness-based Agent Communication for a Personalized Medicine on Medical Imaging Diagnosis
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Intelligent agents are showing increasing promise for clinical decision-making in a variety of healthcare settings. While a substantial body of work has contributed to the best strategies to convey these agents’ decisions to clinicians, few have considered the impact of personalizing and customizing these communications on the clinicians’ performance and receptiveness. This raises the question of how intelligent agents should adapt their tone in accordance with their target audience. We designed two approaches to communicate the decisions of an intelligent agent for breast cancer diagnosis with different tones: a suggestive (non-assertive) tone and an imposing (assertive) one. We used an intelligent agent to inform about: (1) number of detected findings; (2) cancer severity on each breast and per medical imaging modality; (3) visual scale representing severity estimates; (4) the sensitivity and specificity of the agent; and (5) clinical arguments of the patient, such as pathological co-variables. Our results demonstrate that assertiveness plays an important role in how this communication is perceived and its benefits. We show that personalizing assertiveness according to the professional experience of each clinician can reduce medical errors and increase satisfaction, bringing a novel perspective to the design of adaptive communication between intelligent agents and clinicians.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
From local explanations to global understanding with explainable AI for trees
Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-019-0138-9 · Cited by 10,551 · cited 2×
“While communicating AI predictions and explanations is shaping the design of recent works [31, 65], we do not know how assertiveness-based AI mediation is affecting novice or expert clinicians.”
BackgroundInternational evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287 · cited 1×
“Because of that, several works are arguing that these models can see beyond what a trained radiologist sees in medical images [70, 71, 85].”
BackgroundRajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212
Hannun, A. Y., Rajpurkar, P., Haghpanahi, M., Tison, G. H., Bourn, C., Turakhia, M. P., & Ng, A. Y. (2019) · Nature Medicine · doi:10.1038/s41591-018-0268-3 · Cited by 3,148
Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making
Jarrahi, M. H. (2018) · Business Horizons · doi:10.1016/j.bushor.2018.03.007 · Cited by 2,772 · cited 1×
“HCI has proposed and conceptualized several approaches of human-AI relationships, such as interactive Machine Learning (iML) [38], Human-In-The-Loop (HITL) [48, 117], human-AI symbiosis [52], and human-AI collaboration [118].”
BackgroundGuidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 2×
“While much of the mentioned prior work has employed handcrafted features [8, 55], we leverage the rich image data features automatically learned from DL algorithms.”
MethodExplainability for artificial intelligence in healthcare: a multidisciplinary perspective
the Precise4Q consortium, Amann, J., Blasimme, A., Vayena, E., Frey, D., & Madai, V. I. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01332-6 · Cited by 2,203 · cited 1×
“Trust is critical in communication, especially, in clinical environments, where clinicians are exposed to critical scenarios that affect life decisions [7].”
BackgroundExplainable machine-learning predictions for the prevention of hypoxaemia during surgery
Lundberg, S. M., Nair, B., Vavilala, M. S., Horibe, M., Eisses, M. J., Adams, T., Liston, D. E., Low, D. K.-W., Newman, S.-F., Kim, J., et al. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0304-0 · Cited by 1,967
The System Usability Scale: Past, Present, and Future
Lewis, J. R. (2018) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2018.1455307 · Cited by 1,958 · cited 1×
“The questionnaire included scales to measure three dimensions of trust [63] represented by perceived understanding, competence, and thought-fulness, as well as cognitive workload by using NASA-TLX [92], and usability by using SUS [60].”
MethodArtificial intelligence in cancer imaging: Clinical challenges and applications
Bi, W. L., Hosny, A., Schabath, M. B., Giger, M. L., Birkbak, N. J., Mehrtash, A., Allison, T., Arnaout, O., Abbosh, C., Dunn, I. F., et al. (2019) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21552 · Cited by 1,846 · cited 1×
“going from research and development environments to hospital or real clinical settings for these set of applications [12, 13].”
BackgroundHuman-computer collaboration for skin cancer recognition
Tschandl, P., Rinner, C., Apalla, Z., Argenziano, G., Codella, N., Halpern, A., Janda, M., Lallas, A., Longo, C., Malvehy, J., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0942-0 · Cited by 1,024
Clinical decision support in the era of artificial intelligence
Shortliffe, E. H., & Sepúlveda, M. J. (2018) · JAMA · doi:10.1001/jama.2018.17163 · Cited by 920 · cited 1×
“learn specific tasks from training data [24, 101, 125].”
Pelau, C., Dabija, D.-C., & Ene, I. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106855 · Cited by 889 · cited 1×
“As the means to achieve a more persuasive and reliable intelligent agent, we need to analyze and collect data regarding the clinician’s behavior [83].”
BackgroundDoes the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445717 · Cited by 757 · cited 1×
“Manyresearchers have argued that HAII would be improved if the AI systems could explain their reasoning [10, 53, 89].”
BackgroundDoes the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. S. (2020) · arXiv · doi:10.48550/arxiv.2006.14779 · Cited by 754
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
Fails, J. A., & Olsen, D. R. (2003) · Proceedings of the 8th international conference on Intelligent user interfaces · doi:10.1145/604045.604056 · Cited by 633
Beede, E., Baylor, E., Hersch, F., Iurchenko, A., Wilcox, L., Ruamviboonsuk, P., & Vardoulakis, L. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376718 · Cited by 614 · cited 3×
“Across the HCI literature [20, 40, 82, 100], or more precisely, from the CHI community [12, 19], human-centered evaluation of interactive, DL systems, is an open area of research within clinical environments.”
BackgroundCai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594 · cited 2×
“Across the HCI literature [20, 40, 82, 100], or more precisely, from the CHI community [12, 19], human-centered evaluation of interactive, DL systems, is an open area of research within clinical environments.”
BackgroundEnabling Technologies for Personalized and Precision Medicine
Ho, D., Quake, S. R., McCabe, E. R. B., Chng, W. J., Chow, E. K., Ding, X., Gelb, B. D., Ginsburg, G. S., Hassenstab, J., Ho, C.-M., et al. (2020) · Trends in Biotechnology · doi:10.1016/j.tibtech.2019.12.021 · Cited by 517
Human-Centered Tools for Coping with Imperfect Algorithms During Medical Decision-Making
Cai, C. J., Reif, E., Hegde, N., Hipp, J., Kim, B., Smilkov, D., Wattenberg, M., Viegas, F., Corrado, G. S., Stumpe, M. C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300234 · Cited by 405
Precision medicine in the era of artificial intelligence: implications in chronic disease management
Subramanian, M., Wojtusciszyn, A., Favre, L., Boughorbel, S., Shan, J., Letaief, K. B., Pitteloud, N., & Chouchane, L. (2020) · Journal of Translational Medicine · doi:10.1186/s12967-020-02658-5 · Cited by 362 · cited 1×
“In fact, recent works are highlighting how AI and the advancement of technologies together are empowering the aim of personalized and precision medicine [46, 111, 120].”
BackgroundResearch Through Design in HCI
Zimmerman, J., & Forlizzi, J. (2014) · Ways of Knowing in HCI · doi:10.1007/978-1-4939-0378-8_8 · Cited by 348
Convolutional neural networks for multi-class brain disease detection using MRI images
Talo, M., Yildirim, O., Baloglu, U. B., Aydin, G., & Acharya, U. R. (2019) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2019.101673 · Cited by 301 · cited 1×
“Both agents are recommending classification and segmentation based on the DenseNet model [49] for MG and US, as well as based on the ResNet model [112] for MRI.”
MethodKocielnik, R., Amershi, S., & Bennett, P. N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300641 · Cited by 277
Ruamviboonsuk, P., Krause, J., Chotcomwongse, P., Sayres, R., Raman, R., Widner, K., Campana, B. J. L., Phene, S., Hemarat, K., Tadarati, M., et al. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0099-8 · Cited by 233
Riasatian, A., Babaie, M., Maleki, D., Kalra, S., Valipour, M., Hemati, S., Zaveri, M., Safarpoor, A., Shafiei, S., Afshari, M., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102032 · Cited by 221
The effects of example-based explanations in a machine learning interface
Cai, C. J., Jongejan, J., & Holbrook, J. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302289 · Cited by 220
AI as a moral crumple zone: The effects of AI-mediated communication on attribution and trust
Hohenstein, J., & Jung, M. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2019.106190 · Cited by 212 · cited 3×
“The work of Hohenstein et al. [47] is showing that a successful collaboration between human and AI occurs when ambiguity and uncertainty in terms of perceptions are reduced through trust [47].”
BackgroundInfluentialWang, D., Wang, L., Zhang, Z., Wang, D., Zhu, H., Gao, Y., Fan, X., & Tian, F. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445432 · Cited by 209 · cited 4×
“The use of AI in medical settings raises complex questions that are not yet fully understood or addressed by existing laws and regulations [118].”
BackgroundInfluentialSaid, S., Gozdzik, M., Roche, T. R., Braun, J., Rössler, J., Kaserer, A., Spahn, D. R., Nöthiger, C. B., & Tscholl, D. W. (2020) · Journal of Medical Internet Research · doi:10.2196/19472 · Cited by 173 · cited 1×
“The questionnaire included scales to measure three dimensions of trust [63] represented by perceived understanding, competence, and thought-fulness, as well as cognitive workload by using NASA-TLX [92], and usability by using SUS [60].”
MethodNaiseh, M., Al-Thani, D., Jiang, N., & Ali, R. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102941 · Cited by 170 · cited 1×
“…following sections, we outline related works on the issues of guiding the Human-AI Interaction (HAII) topic, assisting clinical decision-making, going through some examples of Clinical Decision Support Systems (CDSS) present in the literature [41, 76], and ending on the effects of AI communication.”
BackgroundInfluentialXie, Y., Chen, M., Kao, D., Gao, G., & Chen, X. '. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376807 · Cited by 141
BreastScreening-AI: Evaluating medical intelligent agents for human-AI interactions
Calisto, F. M., Santiago, C., Nunes, N., & Nascimento, J. C. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102285 · Cited by 125 · cited 5×
“For that purpose, we updated the design of the BreastScreening-AI framework [26] in where we aim to study how does different expertise levels in clinical scenarios are influenced by an assertiveness-based communication.”
BackgroundMethodResultInfluentialSelf-citationHome robotic devices for older adults: opportunities and concerns
Deutsch, I., Erel, H., Paz, M., Hoffman, G., & Zuckerman, O. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.04.002 · Cited by 115
Kohli, A., & Jha, S. (2018) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2017.12.029 · Cited by 114
Modeling adoption of intelligent agents in medical imaging
Calisto, F. M., Nunes, N., & Nascimento, J. C. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102922 · Cited by 111
Self-citationYou Complete Me: Human-AI Teams and Complementary Expertise
Zhang, Q., Lee, M. L., & Carter, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517791 · Cited by 85
The design of reciprocal learning between human and artificial intelligence
Zagalsky, A., Te'eni, D., Yahav, I., Schwartz, D. G., Silverman, G., Cohen, D., Mann, Y., & Lewinsky, D. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479587 · Cited by 35 · cited 1×
“From the HCI literature [15, 61, 124], we know that the development of trust is influenced by the positive motivational attribution between the communication entity and the user.”
Background
Cited by
Hadi Mogavi, R., Deng, C., Juho Kim, J., Zhou, P., D. Kwon, Y., Hosny Saleh Metwally, A., Tlili, A., Bassanelli, S., Bucchiarone, A., Gujar, S., et al. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2023.100027 · Cited by 369
Yildirim, N., Richardson, H., Wetscherek, M. T., Bajwa, J., Jacob, J., Pinnock, M. A., Harris, S., Coelho De Castro, D., Bannur, S., Hyland, S., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642013 · Cited by 82
Large language model integrations in cancer decision-making: a systematic review and meta-analysis
Hao, Y., Qiu, Z., Holmes, J., Löckenhoff, C. E., Liu, W., Ghassemi, M., & Kalantari, S. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01824-7 · Cited by 67
de Jong, S., Paananen, V., Tag, B., & van Berkel, N. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710946 · Cited by 32
Personalising AI Assistance Based on Overreliance Rate in AI-Assisted Decision Making
Swaroop, S., Buçinca, Z., Gajos, K. Z., & Doshi-Velez, F. (2025) · Proceedings of the 30th International Conference on Intelligent User Interfaces · doi:10.1145/3708359.3712128 · Cited by 20
“The degree of engagement and efort people exert on the task may depend on (i) situational factors, such as stress or time pressure [46], (ii) semi-stable traits, such as expertise level [14], or (iii) individual diferences, such as people’s intrinsic motivation to think [7].”
Metadata
- Authors
- Calisto, F. M., Fernandes, J., Morais, M., Santiago, C., Abrantes, J. M., Nunes, N., & Nascimento, J. C.
- Venue
- Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2023-04-19
- Pages
- 1-20
- OpenAlex
- W4366548814
- Cited by
- 93
- References
- 39
- FWCI
- 17.42
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.