Compliance with medical recommendations depending on the use of artificial intelligence as a diagnostic method
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Background: Advanced analytics, such as artificial intelligence (AI), increasingly gain relevance in medicine. However, patients’ responses to the involvement of AI in the care process remains largely unclear. The study aims to explore whether individuals were more likely to follow a recommendation when a physician used AI in the diagnostic process considering a highly (vs. less) severe disease compared to when the physician did not use AI or when AI fully replaced the physician. Methods: Participants from the USA (n = 452) were randomly assigned to a hypothetical scenario where they imagined that they received a treatment recommendation after a skin cancer diagnosis (high vs. low severity) from a physician, a physician using AI, or an automated AI tool. They then indicated their intention to follow the recommendation. Regression analyses were used to test hypotheses. Beta coefficients (ß) describe the nature and strength of relationships between predictors and outcome variables; confidence intervals [CI] excluding zero indicate significant mediation effects. Results: The total effects reveal the inferiority of automated AI (ß = .47, p = .001 vs. physician; ß = .49, p = .001 vs. physician using AI). Two pathways increase intention to follow the recommendation. When a physician performs the assessment (vs. automated AI), the perception that the physician is real and present (a concept called social presence) is high, which increases intention to follow the recommendation (ß = .22, 95% CI [.09; 0.39]). When AI performs the assessment (vs. physician only), perceived innovativeness of the method is high, which increases intention to follow the recommendation (ß = .15, 95% CI [− .28; − .04]). When physicians use AI, social presence does not decrease and perceived innovativeness increases. Conclusion: Pairing AI with a physician in medical diagnosis and treatment in a hypothetical scenario using topical therapy and oral medication as treatment recommendations leads to a higher intention to follow the recommendation than AI on its own. The findings might help develop practice guidelines for cases where AI involvement benefits outweigh risks, such as using AI in pathology and radiology, to enable augmented human intelligence and inform physicians about diagnoses and treatments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Brave new world: service robots in the frontline
Wirtz, J., Patterson, P. G., Kunz, W. H., Gruber, T., Lu, V. N., Paluch, S., & Martins, A. (2018) · Journal of Service Management · doi:10.1108/josm-04-2018-0119 · Cited by 2,315
Horne, R., & Weinman, J. (1999) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(99)00057-4 · Cited by 2,201
Algorithm appreciation: People prefer algorithmic to human judgment
Logg, J. M., Minson, J. A., & Moore, D. A. (2019) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2018.12.005 · Cited by 2,061
Gefen, D., & Straub, D. W. (2004) · Omega · doi:10.1016/j.omega.2004.01.006 · Cited by 2,025
Resistance to Medical Artificial Intelligence
Longoni, C., Bonezzi, A., & Morewedge, C. K. (2019) · Journal of Consumer Research · doi:10.1093/jcr/ucz013 · Cited by 2,015
Abràmoff, M. D., Lavin, P. T., Birch, M., Shah, N., & Folk, J. C. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0040-6 · Cited by 1,638 · cited 1×
“Examples of recent uses of AI in this context include the detection of skin and breast cancer as well as of cardiac arrest [6, 12, 13].”
BackgroundTask-Dependent Algorithm Aversion
Castelo, N., Bos, M. W., & Lehmann, D. R. (2019) · Journal of Marketing Research · doi:10.1177/0022243719851788 · Cited by 1,500
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133
Human-computer collaboration for skin cancer recognition
Tschandl, P., Rinner, C., Apalla, Z., Argenziano, G., Codella, N., Halpern, A., Janda, M., Lallas, A., Longo, C., Malvehy, J., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0942-0 · Cited by 1,024
Bonaccio, S., & Dalal, R. S. (2006) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2006.07.001 · Cited by 1,011
Debating big data: a literature review on realizing value from big data
Günther, W. A., Rezazade Mehrizi, M. H., Huysman, M., & Feldberg, F. (2017) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2017.07.003 · Cited by 880
Technology, Humanness, and Trust: Rethinking Trust in Technology
Marshall University, Lankton, N., McKnight, D. H., Michigan State University, Tripp, J., & Baylor University (2015) · Journal of the Association for Information Systems · doi:10.17705/1jais.00411 · Cited by 553 · cited 1×
“High social presence creates the sense of a personal, sociable, and sensitive being [26].”
BackgroundMajor depression and medication adherence in elderly patients with coronary artery disease.
Carney, R. M., Freedland, K. E., Eisen, S. A., Rich, M. W., & Jaffe, A. S. (1995) · Health Psychology · doi:10.1037//0278-6133.14.1.88 · Cited by 502
Health Beliefs, Disease Severity, and Patient Adherence: A Meta-Analysis
DiMatteo, M. R., Haskard, K. B., & Williams, S. L. (2007) · Medical Care · doi:10.1097/mlr.0b013e318032937e · Cited by 482
Making sense of recommendations
Yeomans, M., Shah, A., Mullainathan, S., & Kleinberg, J. (2019) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2118 · Cited by 459
Han, S. S., Park, I., Eun Chang, S., Lim, W., Kim, M. S., Park, G. H., Chae, J. B., Huh, C. H., & Na, J.-I. (2020) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2020.01.019 · Cited by 248
Promberger, M., & Baron, J. (2006) · Journal of Behavioral Decision Making · doi:10.1002/bdm.542 · Cited by 242
Why do patients derogate physicians who use a computer-based diagnostic support system?
Shaffer, V. A., Probst, C. A., Merkle, E. C., Arkes, H. R., & Medow, M. A. (2013) · Medical Decision Making · doi:10.1177/0272989x12453501 · Cited by 115
New Information Technology and Implicit Bias
Elsbach, K. D., & Stigliani, I. (2019) · Academy of Management Perspectives · doi:10.5465/amp.2017.0079 · Cited by 74
Effects of emotion on medical decisions involving tradeoffs.
Ellis, E. M., Klein, W. M. P., Orehek, E., & Ferrer, R. A. (2018) · Medical Decision Making · doi:10.1177/0272989x18806493 · Cited by 19
Research works printed but not linked: 25
- Agarwal R, Gao G, DesRoches C, Jha AK. The digital transformation of healthcare: current status and the road ahead. Inform Syst Res. 2010;21(4):796–809. · DOI · Paper page
- Wang Y, Hajli N. Exploring the path to big data analytics success in healthcare. J Bus Res. 2016;70:287–99. · DOI · Paper page
- Pezzo MV, Pezzo SP. Physician evaluation after medical errors: does having a computer decision aid help or hurt in hindsight? Med Decis Making. 2006;26(1):48–56. · DOI · Paper page
- Haenssle HA, Fink C, Schneiderbauer R, Toberer F, Buhl T, Blum A, Kalloo A, Hassen ABH, Thomas L, Enk A, Uhlmann L. Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists. Ann Oncol. 2018;29(8):1836–42. · DOI · Paper page
- Beck AH, Sangoi AR, Leung S, Marinelli RJ, Nielsen TO, van de Vijver MJ, Koller D. Systematic analysis of breast cancer morphology uncovers stromal features associated with survival. Sci Transl Med. 2011;3(108):108–13. · DOI · Paper page
- Balas AE. Information systems can prevent errors and improve quality. J Am Med Inform Assn. 2001;8(4):398–9. · DOI
- Gino F, Moore DA. Effects of task difficulty on use of advice. J Behav Decis Making. 2007;20(1):21–35. · DOI · Paper page
- Bertsimas D, Orfanoudaki A, Weiner RB. Personalized treatment for coronary artery disease patients: a machine learning approach. Health Care Manag Sci. 2020;23(4):482–506. · DOI
- Supriya M, Deepa AJ. A novel approach for breast cancer prediction using optimized ANN classifier based on big data environment. Health Care Manag Sci. 2020;23(3):414–26. · doi:10.1007/s10729-019-09498-w
- Palmeira M, Spassova G. Consumer reactions to professionals who use decision aids. Eur J Marketing. 2015;49(3/4):302–26. · DOI · Paper page
- Arkes HR, Shaffer VA, Medow MA. Patients derogate physicians who use a computer-assisted diagnostic aid. Med Decis Making. 2007;27(2):189–202. · DOI · Paper page
- White TB. Consumer trust and advice acceptance: the moderating roles of benevolence, expertise, and negative emotions. J Consum Psychol. 2005;15(2):141–8. · DOI · Paper page
- Short J, Williams E, Christie B. The social psychology of telecommunications. London: Wiley; 1976.
- Xin C, Youjia F, Barbara L. Integrative review of social presence in distance education: issues and challenges. Educ Res Rev. 2015;10(13):1796–806. · DOI
- Biocca F, Harms C, Burgoon JK. Towards a more robust theory and measure of social presence: review and suggested criteria. Presence Teleoperators Virtual Environ. 2003;12(5):456–80. · DOI · Paper page
- Sambo CF, Howard M, Kopelman M, Williams S, Fotopoulou A. Knowing you care: effects of perceived empathy and attachment style on pain perception. Pain. 2010;151(3):687–93. · DOI · Paper page
- Fichman RG, Dos Santos BL, Zheng ZE. Digital innovation as a fundamental and powerful concept in the information systems curriculum. MIS Quart. 2014;38(2):329–53. · DOI · Paper page
- Clark BB, Robert C, Hampton SA. The technology effect: how perceptions of technology drive excessive optimism. J Bus Psychol. 2016;31(1):87–102. · DOI
- Hopkin G, Au A, Collier VJ, Yudkin JS, Basu S, Naci H. Combining multiple treatment comparisons with personalized patient preferences: a randomized trial of an interactive platform for statin treatment selection. Med Decis Mak. 2019;39(3):264–77. · DOI
- Manigault AW, Handley IM, Whillock SR. Assessment of unconscious decision aids applied to complex patient-centered medical decisions. J Med Internet Res. 2015;17(2):e37. · DOI
- Hayes AF. Introduction to mediation, moderation, and conditional process analysis: a regression-based approach. New York: Guilford Press; 2013.
- Spiller SA, Fitzsimons GJ, Lynch JG, McClelland GH. Spotlights, floodlights, and the magic number zero: simple effects tests in moderated regression. J Marketing Res. 2013;50(2):277–88. · DOI · Paper page
- Salla E, Pikkarainen M, Leväsluoto J, Blackbright H. AI innovations and their impact on healthcare and medical expertise. In: Bitran I, Conn S, Huizingh KRE, Torkeli M, Tynnhammar M, editors. ISPIM innovation conference proceedings; 2018.
- Lu B, Fan W, Zhou M. Social presence, trust, and social commerce purchase intention: an empirical research. Comput Hum Behav. 2016;52:225–37. · DOI · Paper page
- Kravitz R, Bell RA, Azari R, Krupat E, Kelly-Reif S, Thorn D. Request fulfillment in office practice: antecedents and relationship to outcomes. Med Care. 2002;40(1):38–51. · DOI · Paper page
Cited by
Deniz-Garcia, A., Fabelo, H., Rodriguez-Almeida, A. J., Zamora-Zamorano, G., Castro-Fernandez, M., Alberiche Ruano, M. D. P., Solvoll, T., Granja, C., Schopf, T. R., Callico, G. M., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/44030 · Cited by 268
Abdelwanis, M., Alarafati, H. K., Tammam, M. M. S., & Simsekler, M. C. E. (2024) · Journal of Safety Science and Resilience · doi:10.1016/j.jnlssr.2024.06.001 · Cited by 177
Osnat, B. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106007 · Cited by 68
Damiani, G., Altamura, G., Zedda, M., Nurchis, M. C., Aulino, G., Heidar Alizadeh, A., Cazzato, F., Della Morte, G., Caputo, M., Grassi, S., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-065301 · Cited by 44
Metadata
- Authors
- Soellner, M., & Koenigstorfer, J.
- Venue
- BMC Medical Informatics and Decision Making
- Published
- 2021-08-06
- Volume
- 21
- Issue
- 1
- Pages
- 236-236
- ISSN
- 1472-6947 (ISSN-L)
- OpenAlex
- W3192686185
- Cited by
- 53
- References
- 22
- FWCI
- 1.53
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- Technische Universität München
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.