Cited by 161

Explainable artificial intelligence in breast cancer detection and risk prediction: A systematic scoping review

Ghasemi, Amirehsan, Hashtarkhani, Soheil, Schwartz, David L., Shaban‐Nejad, Arash·2024·Cancer Innovation

Abstract

With the advances in artificial intelligence (AI), data‐driven algorithms are becoming increasingly popular in the medical domain. However, due to the nonlinear and complex behavior of many of these algorithms, decision‐making by such algorithms is not trustworthy for clinicians and is considered a black‐box process. Hence, the scientific community has introduced explainable artificial intelligence (XAI) to remedy the problem. This systematic scoping review investigates the application of XAI in breast cancer detection and risk prediction. We conducted a comprehensive search on Scopus, IEEE Explore, PubMed, and Google Scholar (first 50 citations) using a systematic search strategy. The search spanned from January 2017 to July 2023, focusing on peer‐reviewed studies implementing XAI methods in breast cancer datasets. Thirty studies met our inclusion criteria and were included in the analysis. The results revealed that SHapley Additive exPlanations (SHAP) is the top model‐agnostic XAI technique in breast cancer research in terms of usage, explaining the model prediction results, diagnosis and classification of biomarkers, and prognosis and survival analysis. Additionally, the SHAP model primarily explained tree‐based ensemble machine learning models. The most common reason is that SHAP is model agnostic, which makes it both popular and useful for explaining any model prediction. Additionally, it is relatively easy to implement effectively and completely suits performant models, such as tree‐based models. Explainable AI improves the transparency, interpretability, fairness, and trustworthiness of AI‐enabled health systems and medical devices and, ultimately, the quality of care and outcomes.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/cai2.136

Cites

17 of 17 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 124

  1. [1]Zhang B, Vakanski A, Xian M. BI‐RADS‐NET‐V2: a composite multi‐task neural network for computer‐aided diagnosis of breast cancer in ultrasound images with semantic and quantitative explanations. IEEE Access. 2023; 11: 79480– 79494. 10.1109/ACCESS.2023.3298569 37608804 PMC10443928 · DOI
  2. [2]Hayes‐Roth F. Rule‐based systems. Commun ACM. 1985; 28(9): 921– 932. 10.1145/4284.4286 · DOI
  3. [3]Howard A, Zhang C, Horvitz E. Addressing bias in machine learning algorithms: a pilot study on emotion recognition for intelligent systems. In: 2017 IEEE workshop on advanced robotics and its social impacts (ARSO). Austin, TX, USA: IEEE, 2017 Workshop on Advanced Robotics and its Social Impacts (ARSO); 2017. p. 1– 7.
  4. [4]van Giffen B, Herhausen D, Fahse T. Overcoming the pitfalls and perils of algorithms: a classification of machine learning biases and mitigation methods. J Bus Res. 2022; 144: 93– 106. 10.1016/j.jbusres.2022.01.076 · DOI · Paper page
  5. [5]Shaban‐Nejad A, Michalowski M, Brownstein JS, Buckeridge DL. Guest editorial explainable AI: towards fairness, accountability, transparency and trust in healthcare. IEEE J Biomed Health Inform. 2021; 25(7): 2374– 2375. 10.1109/JBHI.2021.3088832 · DOI · Paper page
  6. [6]Quinn TP, Senadeera M, Jacobs S, Coghlan S, Le V. Trust and medical AI: the challenges we face and the expertise needed to overcome them. J Am Med Inform Asso. 2020; 28(4): 890– 894. 10.1093/jamia/ocaa268 PMC7973477 33340404 · DOI · Paper page
  7. [7]Pan SJ, Yang Q. A survey on transfer learning. IEEE Trans Knowl Data Eng. 2010; 22(10): 1345– 1359. 10.1109/TKDE.2009.191 · DOI · Paper page
  8. [8]He K, Zhang X, Ren S, Sun J. Identity mappings in deep residual networks. In: Leibe B, Matas J, Sebe N, Welling M, editors. Computer vision—ECCV 2016. Cham: Springer International Publishing; 2016. p. 630– 645.
  9. [9]Mishkin D, Matas J. All you need is a good init. arXiv preprint arXiv:151106422. 2015.
  10. [10]Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Bach F, Blei D, editors. Proceedings of the 32nd international conference on machine learning vol. 37 of Proceedings of Machine Learning Research. Lille: PMLR; 2015. p. 448– 456. Available from: https://proceedings.mlr.press/v37/ioffe15.html
  11. [11]Yu D, Xiong W, Droppo J, Stolcke A, Ye G, Li J, et al. Deep convolutional neural networks with layer‐wise context expansion and attention. In: Interspeech. San Francisco, California, USA: Proc. Interspeech; 2016. p. 17– 21. 10.21437/Interspeech.2016-251 · DOI
  12. [12]Gunning D, Aha D. DARPA's explainable artificial intelligence (XAI) program. AI Magazine. 2019; 40(2): 44– 58. 10.1609/aimag.v40i2.2850 · DOI · Paper page
  13. [13]Shaban‐Nejad A, Michalowski M, Buckeridge DL. Explainability and interpretability: Keys to deep medicine. In: Shaban‐Nejad A, Michalowski M, Buckeridge DL, editors. Explainable AI in healthcare and medicine: building a culture of transparency and accountability. Cham: Springer International Publishing; 2021. p. 1– 10.
  14. [14]Shaban‐Nejad A, Michalowski M, Buckeridge D. Explainable AI in healthcare and medicine: building a culture of transparency and accountability. Stud Comp Intel. 2020; 914: 344. 10.1007/978-3-030-53352-6 · DOI
  15. [15]Luo W, Phung D, Tran T, Gupta S, Rana S, Karmakar C, et al. Guidelines for developing and reporting machine learning predictive models in biomedical research: a multidisciplinary view. J Med Internet Res. 2016; 18(12): e323. 10.2196/jmir.5870 27986644 PMC5238707 · DOI · Paper page
  16. [19]Bharati S, Mondal MRH, Podder P. A review on explainable artificial intelligence for healthcare: why, how, and when? IEEE Trans Artif Intel. 2023; 5: 1– 15. 10.1109/TAI.2023.3266418 · DOI
  17. [21]Hauser K, Kurz A, Haggenmüller S, Maron RC, von Kalle C, Utikal JS, et al. Explainable artificial intelligence in skin cancer recognition: a systematic review. Eur J Cancer. 2022; 167: 54– 69. 10.1016/j.ejca.2022.02.025 35390650 · DOI
  18. [22]James G, Witten D, Hastie T, Tibshirani R, et al. An introduction to statistical learning. vol. 112. New York, NY, USA: Springer; 2013.
  19. [23]Geurts P, Ernst D, Wehenkel L. Extremely randomized trees. Mach Learn. 2006; 63: 3– 42. 10.1007/s10994-006-6226-1 · DOI · Paper page
  20. [24]Breiman L. Random forests. Mach Learn. 2001; 45: 5– 32. 10.1023/A:1010933404324 · DOI · Paper page
  21. [26]Ke G, Meng Q, Finley T, Wang T, Chen W, Ma W, et al. LightGBM: a highly efficient gradient boosting decision tree. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, et al., editors. Advances in neural information processing systems. vol. 30. Long Beach, CA, USA: Curran Associates, Inc.; 2017. p. 3149– 3157. Available from: https://proceedings.neurips.cc/paper_files/paper/2017/file/6449f44a102fde848669bdd9eb6b76fa-Paper.pdf
  22. [28]Dorogush AV, Ershov V, Gulin A. CatBoost: gradient boosting with categorical features support. arXiv preprint arXiv:181011363. 2018.
  23. [29]Sagi O, Rokach L. Ensemble learning: a survey. WIREs Data Min Knowl Disc. 2018; 8(4): e1249. 10.1002/widm.1249 · DOI · Paper page
  24. [30]Shaban‐Nejad A, Michalowski M, Bianco S. Multimodal artificial intelligence: next wave of innovation in healthcare and medicine. Stud Comp Intel. 2022; 1060: 1– 9.
  25. [31]Cybenko GV. Approximation by superpositions of a sigmoidal function. Math Control Signals Syst. 1989; 2: 303– 314. 10.1007/BF02551274 · DOI · Paper page
  26. [32]Hornik K, Stinchcombe M, White H. Multilayer feedforward networks are universal approximators. Neural Netw. 1989; 2(5): 359– 366. 10.1016/0893-6080(89)90020-8 · DOI · Paper page
  27. [33]Baydin AG, Pearlmutter BA, Radul AA, Siskind JM. Automatic differentiation in machine learning: a survey. J Mach Learn Res. 2018; 18: 1– 43. 10.48550/arXiv.1502.05767 · DOI
  28. [34]Lecun Y, Bottou L, Bengio Y, Haffner P. Gradient‐based learning applied to document recognition. Proc IEEE. 1998; 86(11): 2278– 2324. 10.1109/5.726791 · DOI · Paper page
  29. [35]Simonyan K, Zisserman A. Very deep convolutional networks for large‐scale image recognition. arXiv preprint arXiv:14091556. 2014.
  30. [38]Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). Boston, MA, USA: IEEE; 2015. p. 1– 9. 10.1109/CVPR.2015.7298594 · DOI · Paper page
  31. [39]Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). Las Vegas, NV, USA: IEEE; 2016. p. 2818– 2826. 10.1109/CVPR.2016.308 · DOI · Paper page
  32. [40]Szegedy C, Ioffe S, Vanhoucke V, Alemi A. Inception‐v4, inception‐ResNet and the impact of residual connections on learning. Proc AAAI Conf Artif Intel. 2017; 31(1): 4278– 4284. 10.1609/aaai.v31i1.11231 · DOI · Paper page
  33. [42]Xie S, Girshick R, Dollar P, Tu Z, He K. Aggregated residual transformations for deep neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). Honolulu, HI, USA: IEEE; 2017. p. 5987– 5995. 10.1109/CVPR.2017.634 · DOI · Paper page
  34. [43]Zhang H, Wu C, Zhang Z, Zhu Y, Lin H, Zhang Z, et al. ResNeSt: split‐attention networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR) workshops; 2022. p. 2736– 2746.
  35. [45]Kipf TN, Welling M. Semi‐supervised classification with graph convolutional networks. arXiv. 10.48550/arXiv.1609.02907 · DOI · Paper page
  36. [46]Huang G, Liu Z, Pleiss G, Weinberger KQ. Convolutional networks with dense connectivity. IEEE Trans Pattern Anal Mach Intel. 2022; 44(12): 8704– 8716. 10.1109/TPAMI.2019.2918284 31135351 · DOI
  37. [47]Tan M, Le Q. EfficientNet: rethinking model scaling for convolutional neural networks. In: Chaudhuri K, Salakhutdinov R, editors. Proceedings of the 36th international conference on machine learning vol. 97 of proceedings of machine learning research. Long Beach, CA, USA: PMLR; 2019. p. 6105– 6114. Available from: https://proceedings.mlr.press/v97/tan19a.html
  38. [48]Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, et al. Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:170404861. 2017.
  39. [49]Sandler M, Howard A, Zhu M, Zhmoginov A, Chen LC. MobileNetV2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). Salt Lake City, UT, USA: IEEE; 2018. p. 4510– 4520. 10.1109/CVPR.2018.00474 · DOI · Paper page
  40. [51]Zhang X, Zhou X, Lin M, Sun J. ShuffleNet: an extremely efficient convolutional neural network for mobile devices. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR); 2018.
  41. [52]Iandola FN, Han S, Moskewicz MW, Ashraf K, Dally WJ, Keutzer K. SqueezeNet: AlexNet‐level accuracy with 50x fewer parameters and <0.5 MB model size. arXiv:160207360. 2016.
  42. [53]Hochreiter S, Schmidhuber J. Long short‐term memory. Neural Comput. 1997; 9(8): 1735– 1780. 10.1162/neco.1997.9.8.1735 9377276 · DOI · Paper page
  43. [54]Schuster M, Paliwal KK. Bidirectional recurrent neural networks. IEEE Trans Signal Proces. 1997; 45(11): 2673– 2681. 10.1109/78.650093 · DOI · Paper page
  44. [55]Cho K, van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, et al. Learning phrase representations using RNN encoder–decoder for statistical machine translation. In: Moschitti A, Pang B, Daelemans W, editors. Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Doha, Qatar: Association for Computational Linguistics; 2014. p. 1724– 1734. Available from: https://aclanthology.org/D14-1179
  45. [56]van der Veer SN, Riste L, Cheraghi‐Sohi S, Phipps DL, Tully MP, Bozentko K, et al. Trading off accuracy and explainability in AI decision‐making: findings from 2 citizens' juries. J Am Med Inform Assoc. 2021; 28(10): 2128– 2138. 10.1093/jamia/ocab127 34333646 PMC8522832 · DOI
  46. [57]Pintelas E, Livieris IE, Pintelas P. A grey‐box ensemble model exploiting black‐box accuracy and white‐box intrinsic interpretability. Algorithms. 2020; 13(1): 1– 17. 10.3390/a13010017 · DOI
  47. [58]Bennetot A, Franchi G, Ser JD, Chatila R, Díaz‐Rodríguez N. Greybox XAI: a neural‐symbolic learning framework to produce interpretable predictions for image classification. Knowl Based Syst. 2022; 258: 109947. 10.1016/j.knosys.2022.109947 · DOI
  48. [59]Wanner J, Herm LV, Heinrich K, Janiesch C, Zschech P. White, grey, black: effects of XAI augmentation on the confidence in ai‐based decision support systems. Forty‐First International Conference on Information Systems, India; 2020.
  49. [60]Bohlin TP. Practical grey‐box process identification: theory and applications. London, UK: Springer Science & Business Media; 2006.
  50. [61]Vilone G, Longo L. Classification of explainable artificial intelligence methods through their output formats. Mach Learn Knowl Extract. 2021; 3(3): 615– 661. 10.3390/make3030032 · DOI
  51. [64]Clement T, Kemmerzell N, Abdelaal M, Amberg M. XAIR: a systematic metareview of explainable AI (XAI) aligned to the software development process. Mach Learn Knowl Extract. 2023; 5(1): 78– 108. 10.3390/make5010006 · DOI · Paper page
  52. [66]Zilke JR, Loza Mencía E, Janssen F. DeepRED—rule extraction from deep neural networks. In: Calders T, Ceci M, Malerba D, editors. Discovery science. Cham: Springer International Publishing; 2016. p. 457– 473.
  53. [67]Craven M, Shavlik J. Extracting tree‐structured representations of trained networks. In: Touretzky D, Mozer MC, Hasselmo M, editors. Advances in neural information processing systems. vol. 8. MIT Press; 1995. Available from: https://proceedings.neurips.cc/paper_files/paper/1995/file/45f31d16b1058d586fc3be7207b58053-Paper.pdf
  54. [68]Werbos PJ. Beyond regression: new tools for prediction and analysis in the behavioral sciences. PhD thesis, Committee on Applied Mathematics, Harvard University, Cambridge, MA. 1974.
  55. [70]LeCun Y. A learning scheme for asymmetric threshold networks. Proc Cognit. 1985; 85(537): 599– 604.
  56. [72]Moher D, Liberati A, Tetzlaff J, Altman DG. the PRISMA Group. Preferred reporting items for systematic reviews and meta‐analyses: the PRISMA statement. Ann Int Med. 2009; 151(4): 264– 269. 10.7326/0003-4819-151-4-200908180-00135 19622511 · DOI · Paper page
  57. [73]Tober M. PubMed, ScienceDirect, Scopus or Google Scholar—which is the best search engine for an effective literature research in laser medicine? Med Laser Appl. 2011; 26(3): 139– 144. 10.1016/j.mla.2011.05.006 · DOI
  58. [74]Chakraborty D, Ivan C, Amero P, Khan M, Rodriguez‐Aguayo C, Başağaoğlu H, et al. Explainable artificial intelligence reveals novel insight into tumor microenvironment conditions linked with better prognosis in patients with breast cancer. Cancers. 2021; 13(14): 1– 15. 10.3390/cancers13143450 PMC8303703 34298668 · DOI
  59. [75]Moncada‐Torres A, van Maaren MC, Hendriks MP, Siesling S, Geleijnse G. Explainable machine learning can outperform cox regression predictions and provide insights in breast cancer survival. Sci Rep. 2021; 11. 10.1038/s41598-021-86327-7 PMC7998037 33772109 · DOI
  60. [76]Rezazadeh A, Jafarian Y, Kord A. Explainable ensemble machine learning for breast cancer diagnosis based on ultrasound image texture features. Forecasting. 2022; 4(1): 262– 274. 10.3390/forecast4010015 · DOI
  61. [77]Al‐Dhabyani W, Gomaa M, Khaled H, Fahmy A. Dataset of breast ultrasound images. Data Brief. 2020; 28: 104863. 10.1016/j.dib.2019.104863 31867417 PMC6906728 · DOI · Paper page
  62. [78]Nahid AA, Raihan MJ, Bulbul AAM. Breast cancer classification along with feature prioritization using machine learning algorithms. Health Technol. 2022; 12(6): 1061– 1069. 10.1007/s12553-022-00710-6 · DOI
  63. [79]Yu H, Chen F, Lam KO, Yang L, Wang Y, Jin JY, et al. Potential determinants for radiation‐induced lymphopenia in patients with breast cancer using interpretable machine learning approach. Front Immunol. 2022; 13. 10.3389/fimmu.2022.768811 PMC9253393 35799797 · DOI
  64. [80]Meshoul S, Batouche A, Shaiba H, AlBinali S. Explainable multi‐class classification based on integrative feature selection for breast cancer subtyping. Mathematics. 2022; 10(22). 10.3390/math10224271 · DOI
  65. [81]Kumar S, Das A. Peripheral blood mononuclear cell derived biomarker detection using explainable artificial intelligence (XAI) provides better diagnosis of breast cancer. Comp Biol Chem. 2023; 104: 107867. 10.1016/j.compbiolchem.2023.107867 37030103 · DOI
  66. [82]Silva‐Aravena F, NúñezDelafuente H, Gutiérrez‐Bahamondes JH, Morales J. A hybrid algorithm of ML and XAI to prevent breast cancer: a strategy to support decision making. Cancers. 2023; 15(9): 1– 18. 10.3390/cancers15092443 PMC10177162 37173910 · DOI
  67. [83]Nindrea RD, Usman E, Katar Y, Darma IY, Warsiti, Hendriyani H, et al. Dataset of Indonesian women's reproductive, high‐fat diet and body mass index risk factors for breast cancer. Data in Brief. 2021; 36: 107107. 10.1016/j.dib.2021.107107 34026989 PMC8134712 · DOI
  68. [84]Massafra R, Fanizzi A, Amoroso N, Bove S, Comes MC, Pomarico D, et al. Analyzing breast cancer invasive disease event classification through explainable artificial intelligence. Front Med. 2023; 10. 10.3389/fmed.2023.1116354 PMC9932275 36817766 · DOI
  69. [85]Vrdoljak J, Boban Z, Baric D, Segvic D, Kumric M, Avirovic M, et al. Applying explainable machine learning models for detection of breast cancer lymph node metastasis in patients eligible for neoadjuvant treatment. Cancers. 2023; 15(3). 10.3390/cancers15030634 PMC9913601 36765592 · DOI
  70. [86]Mohi Uddin KM, Biswas N, Rikta ST, Dey SK, Qazi A. XML‐LightGBMDroid: a self‐driven interactive mobile application utilizing explainable machine learning for breast cancer diagnosis. Eng Rep. 2023; 5: e12666. 10.1002/eng2.12666 · DOI
  71. [87]Wolberg MOSN William, Street W. Breast Cancer Wisconsin (Diagnostic). UCI Machine Learning Repository. Available from: 10.24432/C5DW2B. · DOI
  72. [88]Zhao X, Jiang C. The prediction of distant metastasis risk for male breast cancer patients based on an interpretable machine learning model. BMC Med Informat Decision Making. 2023; 23(1): 74. 10.1186/s12911-023-02166-8 PMC10120176 37085843 · DOI
  73. [89]Cordova C, Muñoz R, Olivares R, Minonzio JG, Lozano C, Gonzalez P, et al. HER2 classification in breast cancer cells: a new explainable machine learning application for immunohistochemistry. Oncol Lett. 2023; 25(2): 1– 9. 10.3892/ol.2022.13630 36644146 PMC9811637 · DOI
  74. [90]Kaplun D, Krasichkov A, Chetyrbok P, Oleinikov N, Garg A, Pannu HS. Cancer cell profiling using image moments and neural networks with model agnostic explainability: a case study of breast cancer histopathological (BreakHis) database. Mathematics. 2021; 9(20): 1– 20. 10.3390/math9202616 · DOI
  75. [91]Spanhol FA, Oliveira LS, Petitjean C, Heutte L. A dataset for breast cancer histopathological image classification. IEEE Trans Biomed Eng. 2016; 63(7): 1455– 1462. 10.1109/TBME.2015.2496264 26540668 · DOI
  76. [92]Saarela M, Jauhiainen S. Comparison of feature importance measures as explanations for classification models. SN Appl Sci. 2021; 3. 10.1007/s42452-021-04148-9 · DOI
  77. [93]Adnan N, Zand M, Huang THM, Ruan J. Construction and evaluation of robust interpretation models for breast cancer metastasis prediction. IEEE/ACM Trans Comp Biol Bioinform. 2022; 19(3): 1344– 1353. 10.1109/TCBB.2021.3120673 PMC9254332 34662279 · DOI
  78. [94]Staiger C, Cadot S, Györffy B, Wessels L, Klau G. Current composite‐feature classification methods do not outperform simple single‐genes classifiers in breast cancer prognosis. Front Genet. 2013; 4. 10.3389/fgene.2013.00289 PMC3870302 24391662 · DOI
  79. [95]Maouche I, Terrissa LS, Benmohammed K, Zerhouni N. An explainable AI approach for breast cancer metastasis prediction based on clinicopathological data. IEEE Trans Biomed Eng. 2023; 70: 1– 9. 10.1109/TBME.2023.3282840 37276094 · DOI
  80. [96]Slaoui M, Mouh FZ, Ghanname I, Razine R, El Mzibri M, Amrani M. Outcome of breast cancer in Moroccan young women correlated to clinic‐pathological features, risk factors and treatment: a comparative study of 716 cases in a single institution. PLoS One. 2016; 11(10): 1– 14. 10.1371/journal.pone.0164841 PMC5070817 27760178 · DOI
  81. [97]Deshmukh S, Behera BK, Mulay P, Ahmed EA, Al‐Kuwari S, Tiwari P, et al. Explainable quantum clustering method to model medical data. Knowl Based Syst. 2023; 267: 110413. 10.1016/j.knosys.2023.110413 · DOI
  82. [98]Qi X, Zhang L, Chen Y, Pi Y, Chen Y, Lv Q, et al. Automated diagnosis of breast ultrasonography images using deep neural networks. Med Image Anal. 2019; 52: 185– 198. 10.1016/j.media.2018.12.006 30594771 · DOI
  83. [100]Huang Z, Zhu X, Ding M, Zhang X. Medical image classification using a light‐weighted hybrid neural network based on PCANet and DenseNet. IEEE Access. 2020; 8: 24697– 24712. 10.1109/ACCESS.2020.2971225 · DOI
  84. [101]Xi P, Guan H, Shu C, Borgeat L, Goubran R. An integrated approach for medical abnormality detection using deep patch convolutional neural networks. Vis Comput. 2020; 36(9): 1869– 1882. 10.1007/s00371-019-01775-7 · DOI · Paper page
  85. [102]Kim J, Kim HJ, Kim C, Lee JH, Kim KW, Park YM, et al. Weakly‐supervised deep learning for ultrasound diagnosis of breast cancer. Sci Rep. 2021; 11: 24382. 10.1038/s41598-021-03806-7 34934144 PMC8692405 · DOI
  86. [103]El Adoui M, Drisis S, Benjelloun M. Multi‐input deep learning architecture for predicting breast tumor response to chemotherapy using quantitative MR images. Int J Comp Assist Radiol Surg. 2020; 15. 10.1007/s11548-020-02209-9 32556920 · DOI
  87. [104]Hussain SM, Buongiorno D, Altini N, Berloco F, Prencipe B, Moschetta M, et al. Shape‐based breast lesion classification using digital tomosynthesis images: the role of explainable artificial intelligence. Appl Sci. 2022; 12(12). 10.3390/app12126230 · DOI
  88. [105]Bevilacqua V, Brunetti A, Guerriero A, Trotta GF, Telegrafo M, Moschetta M. A performance comparison between shallow and deeper neural networks supervised classification of tomosynthesis breast lesions images. Cogn Syst Res. 2019; 53: 3– 19. 10.1016/j.cogsys.2018.04.011 · DOI
  89. [106]Agbley BLY, Li JP, Haq AU, Bankas EK, Mawuli CB, Ahmad S, et al. Federated fusion of magnified histopathological images for breast tumor classification in the Internet of medical things. IEEE J Biomed Health Inform. 2023: 1– 12. 10.1109/JBHI.2023.3256974 37028353 · DOI
  90. [107]Gerbasi A, Clementi G, Corsi F, Albasini S, Malovini A, Quaglini S, et al. DeepMiCa: automatic segmentation and classification of breast MIcroCAlcifications from mammograms. Comp Methods Prog Biomed. 2023; 235: 107483. 10.1016/j.cmpb.2023.107483 37030174 · DOI
  91. [108]Moreira IC, Amaral I, Domingues I, Cardoso A, Cardoso MJ, Cardoso JS. INbreast: toward a full‐field digital mammographic database. Acad Radiol. 2012; 19(2): 236– 248. 10.1016/j.acra.2011.09.014 22078258 · DOI
  92. [109]Lee RP, Markantonakis K, Akram RN. Provisioning software with hardware‐software binding. In: Proceedings of the 12th international conference on availability, reliability and security. ARES '17. New York, NY, USA: Association for Computing Machinery; 2017. Available from: 10.1145/3098954.3103158 · DOI
  93. [110]To T, Lu T, Jorns JM, Patton M, Schmidt TG, Yen T, et al. Deep learning classification of deep ultraviolet fluorescence images toward intra‐operative margin assessment in breast cancer. Front Oncol. 2023; 13. 10.3389/fonc.2023.1179025 PMC10313133 37397361 · DOI
  94. [111]Lu T, Jorns JM, Patton M, Fisher R, Emmrich A, Doehring T, et al. Rapid assessment of breast tumor margins using deep ultraviolet fluorescence scanning microscopy. J Biomed Opt. 2020; 25(12): 126501. 10.1117/1.JBO.25.12.126501 33241673 PMC7688317 · DOI
  95. [112]Grisci BI, Krause MJ, Dorn M. Relevance aggregation for neural networks interpretability and knowledge discovery on tabular data. Inform Sci. 2021; 559: 111– 129. 10.1016/j.ins.2021.01.052 · DOI
  96. [113]Feltes BC, Chandelier EB, Grisci BI, Dorn M. CuMiDa: an extensively curated microarray database for benchmarking and testing of machine learning approaches in cancer research. J Comp Biol. 2019; 26(4): 376– 386. 10.1089/cmb.2018.0238 30789283 · DOI
  97. [114]Chereda H, Bleckmann A, Menck K, Perera‐Bel J, Stegmaier P, Auer F, et al. Explaining decisions of graph convolutional neural networks: patient‐specific molecular subnetworks responsible for metastasis prediction in breast cancer. Genome Med. 2021; 13. 10.1186/s13073-021-00845-7 PMC7953710 33706810 · DOI
  98. [115]Barrett T, Wilhite SE, Ledoux P, Evangelista C, Kim IF, Tomashevsky M, et al. NCBI GEO: archive for functional genomics data sets—update. Nucl Acids Res. 2012; 41(D1): D991– D995. 10.1093/nar/gks1193 23193258 PMC3531084 · DOI · Paper page
  99. [116]Lundberg SM, Lee SI. A unified approach to interpreting model predictions. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, et al., editors. Advances in neural information processing systems. vol. 30. Curran Associates, Inc.; 2017. p. 1– 10. Available from: https://proceedings.neurips.cc/paper_files/paper/2017/file/8a20a8621978632d76c43dfd28b67767-Paper.pdf
  100. [117]Shapley LS. A value for n‐person games. Princeton: Princeton University Press; 1953. p. 307– 318. Available from: 10.1515/9781400881970-018 · DOI · Paper page
  101. [118]Winter E. Chapter 53 The shapley value vol. 3 of handbook of game theory with economic applications. Elsevier; 2002. p. 2025– 2054. Available from: https://www.sciencedirect.com/science/article/pii/S1574000502030163
  102. [119]Ribeiro MT, Singh S, Guestrin C. "Why should I trust you?”: explaining the predictions of any classifier. In: DeNero J, Finlayson M, Reddy S, editors. Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. KDD '16. New York, NY, USA: Association for Computing Machinery; 2016. p. 1135– 1144. Available from: 10.1145/2939672.2939778 · DOI · Paper page
  103. [121]Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A. Learning deep features for discriminative localization. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR). Las Vegas, NV, USA: IEEE; 2016. p. 2921– 2929.
  104. [122]Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad‐CAM: visual explanations from deep networks via gradient‐based localization. Int J Comput Vision. 2020; 128(2): 336– 359. 10.1007/s11263-019-01228-7 · DOI · Paper page
  105. [123]Chattopadhay A, Sarkar A, Howlader P, Balasubramanian VN. Grad‐CAM++: generalized gradient‐based visual explanations for deep convolutional networks. In: 2018 IEEE winter conference on applications of computer vision (WACV). Lake Tahoe, NV, USA: IEEE; 2018. p. 839– 847.
  106. [124]Bach S, Binder A, Montavon G, Klauschen F, Müller KR, Samek W. On pixel‐wise explanations for non‐linear classifier decisions by layer‐wise relevance propagation. PLoS One. 2015; 10(7): 1– 46. 10.1371/journal.pone.0130140 PMC4498753 26161953 · DOI · Paper page
  107. [125]Brenas JH, Shaban‐Nejad A. Health intervention evaluation using semantic explainability and causal reasoning. IEEE Access. 2020; 8: 9942– 9952. 10.1109/ACCESS.2020.2964802 · DOI · Paper page
  108. [126]Brakefield WS, Ammar N, Shaban‐Nejad A. An urban population health observatory for disease causal pathway analysis and decision support: underlying explainable artificial intelligence model. JMIR Form Res. 2022; 6(7): e36055. 10.2196/36055 35857363 PMC9350817 · DOI
  109. [127]Ammar N, Shaban‐Nejad A. Explainable artificial intelligence recommendation system by leveraging the semantics of adverse childhood experiences: proof‐of‐concept prototype development. JMIR Med Inform. 2020; 8(11): e18752. 10.2196/18752 33146623 PMC7673979 · DOI
  110. [128]Chanda T, Hauser K, Hobelsberger S, Bucher TC, Garcia CN, Wies C, et al. Dermatologist‐like explainable AI enhances trust and confidence in diagnosing melanoma. Nat Commun. 2024; 15(1): 524. 10.1038/s41467-023-43095-4 38225244 PMC10789736 · DOI
  111. [129]Borole P, Rajan A. Building trust in deep learning‐based immune response predictors with interpretable explanations. Commun Biol. 2024; 7(1): 279. 10.1038/s42003-024-05968-2 38448546 PMC10917751 · DOI
  112. [130]Fania A, Monaco A, Amoroso N, Bellantuono L, Cazzolla Gatti R, Firza N, et al. Machine learning and XAI approaches highlight the strong connection between O3 and NO2 pollutants and Alzheimer's disease. Sci Rep. 2024; 14(1): 5385. 10.1038/s41598-024-55439-1 38443419 PMC11319812 · DOI
  113. [131]Ng MY, Youssef A, Miner AS, Sarellano D, Long J, Larson DB, et al. Perceptions of data set experts on important characteristics of health data sets ready for machine learning: a qualitative study. JAMA Netw Open. 2023; 6(12): e2345892. 10.1001/jamanetworkopen.2023.45892 38039004 PMC10692863 · DOI
  114. [133]Zeiler MD, Fergus R. Visualizing and understanding convolutional networks. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T, editors. Computer vision—ECCV 2014. Cham: Springer International Publishing; 2014. p. 818– 833.
  115. [134]Friedman JH. Greedy function approximation: a gradient boosting machine. Ann Statist. 2001; 29(5): 1189– 1232. 10.1214/aos/1013203451 · DOI · Paper page
  116. [135]Wachter S, Mittelstadt B, Russell C. Counterfactual explanations without opening the black box: automated decisions and the GDPR. Harv JL Tech. 2017; 31: 841. 10.48550/arXiv.1711.00399 · DOI
  117. [136]Buitinck L, Louppe G, Blondel M, Pedregosa F, Mueller A, Grisel O, et al. API design for machine learning software: experiences from the scikit‐learn project. In: ECML PKDD workshop: languages for data mining and machine learning; 2013. p. 108– 122. 10.48550/arXiv.1309.0238 · DOI
  118. [137]Klaise J, Looveren AV, Vacanti G, Coca A. Alibi explain: algorithms for explaining machine learning models. J Mach Learn Res. 2021; 22(181): 1– 7. Available from: https://jmlr.org/papers/v22/21-0017.html
  119. [138]Sundararajan M, Taly A, Yan Q. Axiomatic attribution for deep networks. In: Precup D, Teh YW, editor. Proceedings of the 34th international conference on machine learning. vol. 70 of proceedings of machine learning research. PMLR; 2017. p. 3319– 3328. Available from: https://proceedings.mlr.press/v70/sundararajan17a.html
  120. [139]Shrikumar A, Greenside P, Kundaje A. Learning important features through propagating activation differences. ICML'17: Proceedings of the 34th International Conference on Machine Learning. Vo. 70. 2017. p. 3145– 3153.
  121. [141]Springenberg JT, Dosovitskiy A, Brox T, Riedmiller M. Striving for simplicity: the all convolutional net. arXiv. 2015. 10.48550/arXiv.1412.6806 · DOI · Paper page
  122. [142]Erhan D, Bengio Y, Courville A, Vincent P. Visualizing higher‐layer features of a deep network. Univ Montreal. 2009; 1341(3): 1.
  123. [143]Kim B, Wattenberg M, Gilmer J, Cai CJ, Wexler J, Viégas FB, et al. Interpretability beyond feature attribution: quantitative testing with concept activation vectors (TCAV). Proceedings of the 35th International Conference on Machine Learning (PMLR 80, 2018), Stockholm, Sweden; 2017.
  124. [144]Huang Q, Yamada M, Tian Y, Singh D, Chang Y. GraphLIME: local interpretable model explanations for graph neural networks. IEEE Trans Knowl Data Eng. 2023; 35(7): 6968– 6972. 10.1109/TKDE.2022.3187455 · DOI

Cited by

Sorted by citations

Authors
Ghasemi, A., Hashtarkhani, S., Schwartz, D. L., & Shaban‐Nejad, A.
Affiliations
  • Department of Pediatrics, Center for Biomedical Informatics, College of Medicine University of Tennessee Health Science Center Memphis Tennessee USA
  • Department of Radiation Oncology, College of Medicine University of Tennessee Health Science Center Memphis Tennessee USA
Venue
Cancer Innovation
Publisher
Wiley
Published
2024-07-03
Volume
3
Issue
5
ISSN
  • 2770-9191
  • 2770-9183
Cited by
161
References
17
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review