CoChat

Toward Explainable Artificial Intelligence for Precision Pathology

Open access
Klauschen, Frederick, Dippel, Jonas, Keyl, Philipp, Jurmeister, Philipp, Bockmayr, Michael, Mock, Andreas, Buchstab, Oliver, Alber, Maximilian, Ruff, Lukas, Montavon, Grégoire, Müller, Klaus-Robert · 2024 · Annual Review of Pathology: Mechanisms of Disease
Cited by 139

The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.

Abstract

The rapid development of precision medicine in recent years has started to challenge diagnostic pathology with respect to its ability to analyze histological images and increasingly large molecular profiling data in a quantitative, integrative, and standardized way. Artificial intelligence (AI) and, more precisely, deep learning technologies have recently demonstrated the potential to facilitate complex data analysis tasks, including clinical, histological, and molecular data for disease classification; tissue biomarker quantification; and clinical outcome prediction. This review provides a general introduction to AI and describes recent developments with a focus on applications in diagnostic pathology and beyond. We explain limitations including the black-box character of conventional AI and describe solutions to make machine learning decisions more transparent with so-called explainable AI. The purpose of the review is to foster a mutual understanding of both the biomedical and the AI side. To that end, in addition to providing an overview of the relevant foundations in pathology and machine learning, we present worked-through examples for a better practical understanding of what AI can achieve and how it should be done.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1146/annurev-pathmechdis-051222-113147

Cites

65 of 65 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 65 references

Research works printed but not linked: 105

  1. Krizhevsky A, 2012, Advances in Neural Information Processing Systems 25, 1106
  2. Brown TB, 2020, Advances in Neural Information Processing Systems 33, 1877
  3. 10.1038/nbt1371 · DOI · Paper page
  4. Kingma DP, Ba J. 2015. Adam: a method for stochastic optimization. arXiv:1412.6980 [cs.LG] · arXiv
  5. Chen T, 2020, Proceedings of the 37th International Conference on Machine Learning, 1597
  6. 10.1007/978-1-4614-7138-7 · DOI · Paper page
  7. 10.1109/72.914517 · DOI · Paper page
  8. 10.1093/bioinformatics/16.9.799 · DOI · Paper page
  9. 10.1162/089976698300017467 · DOI · Paper page
  10. 10.1016/j.neunet.2014.09.003 · DOI · Paper page
  11. Goodfellow I, 2016, Deep Learning
  12. 10.1098/rspa.2021.0068 · DOI · Paper page
  13. Vaswani A, 2017, Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS'17), 6000
  14. 10.1007/978-3-642-35289-8_3 · DOI · Paper page
  15. 10.1016/j.isci.2020.100882 · DOI · Paper page
  16. 10.1007/978-0-387-84858-7 · DOI · Paper page
  17. Ilse M, 2018, Proc. Mach. Learn. Res., 80, 2127
  18. 10.1109/TPAMI.2013.50 · DOI · Paper page
  19. Ciga O, 2022, Mach. Learn. Appl., 7, 100198
  20. 10.1186/1471-2105-8-60 · DOI · Paper page
  21. 10.1126/scitranslmed.aaw8513 · DOI
  22. 10.1038/nature26000 · DOI · Paper page
  23. 10.1038/s41467-022-31666-w · DOI
  24. 10.1016/j.esmoop.2022.100555 · DOI
  25. 10.3389/fgene.2020.585029 · DOI
  26. 10.1186/s12967-022-03369-9 · DOI
  27. 10.1038/s41598-021-86327-7 · DOI · Paper page
  28. 10.1038/s41698-022-00278-4 · DOI
  29. 10.1093/nar/gkac1212 · DOI
  30. 10.1186/s12920-020-0677-2 · DOI · Paper page
  31. 10.1371/journal.pone.0178751 · DOI · Paper page
  32. 10.1038/s41467-019-10168-2 · DOI · Paper page
  33. 10.3390/app11136194 · DOI
  34. 10.1093/nar/gkaa506 · DOI · Paper page
  35. 10.1172/JCI93801 · DOI · Paper page
  36. 10.1038/s42256-021-00325-y · DOI · Paper page
  37. 10.1038/s41598-022-21417-8 · DOI
  38. 10.1186/s13073-021-00845-7 · DOI
  39. 10.1186/s12859-021-04370-7 · DOI
  40. Baehrens D, 2010, J. Mach. Learn. Res., 11, 1803
  41. Zeiler MD, 2014, Computer Vision: 13th European Conference (ECCV 2014), 818
  42. Arras L, Arjona-Medina JA, Widrich M, Montavon G, Gillhofer M, et al. 2019. Explaining and interpreting LSTMs. See Ref. 100, pp. 231–38 · DOI
  43. Preuer K, Klambauer G, Rippmann F, Hochreiter S, Unterthiner T. 2019. Interpretable deep learning in drug discovery. See Ref. 100, pp. 331–45 · DOI
  44. 10.1109/TPAMI.2021.3115452 · DOI · Paper page
  45. Kim B, 2018, Proc. Mach. Learn. Res., 80, 2673
  46. Chormai P, Herrmann J, Müller KR, Montavon G. 2022. Disentangled explanations of neural network predictions by finding relevant subspaces. arXiv:2212.14855 [cs.LG] · arXiv
  47. Wachter S, 2018, Harvard J. Law Technol., 31, 841
  48. Verma S, Dickerson JP, Hines K. 2020. Counterfactual explanations for machine learning: a review. arXiv:2010.10596 [cs.LG] · arXiv
  49. 10.1109/CVPR.2016.319 · DOI · Paper page
  50. Covert I, 2021, J. Mach. Learn. Res., 22, 209
  51. Lundberg SM, 2017, Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS'17), 4765
  52. Sundararajan M, 2017, Proc. Mach. Learn. Res., 70, 3319
  53. 10.1145/2939672.2939778 · DOI · Paper page
  54. 10.1186/s12859-020-3443-8 · DOI
  55. 10.3390/genes10100778 · DOI
  56. 10.3390/cancers13153768 · DOI
  57. 10.1038/s41598-021-89789-x · DOI
  58. 10.1186/s12859-020-3465-2 · DOI · Paper page
  59. 10.1109/CVPR52688.2022.01008 · DOI
  60. 10.1016/j.inffus.2021.07.015 · DOI · Paper page
  61. 10.1038/s41598-020-62724-2 · DOI · Paper page
  62. 10.1145/3568294.3580147 · DOI
  63. Srivastava N, 2014, J. Mach. Learn. Res., 15, 1929
  64. 10.1038/s41467-022-34815-3 · DOI
  65. Gunning D, 2019, AI Mag., 40, 44
  66. 10.1007/978-3-031-04083-2 · DOI
  67. Montavon G, Binder A, Lapuschkin S, Samek W, Müller KR. 2019. Layer-wise relevance propagation: an overview. See Ref. 100, pp. 193–209 · DOI · Paper page
  68. 10.1145/3233231 · doi:10.1145/3233231 · Paper page
  69. Ali A, 2022, Proc. Mach. Learn. Res., 162, 435
  70. Hosseini MS, Bejnordi BE, Trinh VQH, Hasan D, Li X, et al. 2023. Computational pathology: a survey review and the way forward. arXiv:2304.05482 [eess.IV] · DOI
  71. 10.1038/s43856-022-00186-5 · DOI · Paper page
  72. 10.1146/annurev-cancerbio-061521-092038 · DOI
  73. Leiter C, Zhang R, Chen Y, Belouadi J, Larionov D, et al. 2023. ChatGPT: a meta-analysis after 2.5 months. arXiv:2302.13795 [cs] · DOI · Paper page
  74. 10.1109/JPROC.2021.3052449 · DOI · Paper page
  75. 10.1016/j.jpi.2022.100102 · DOI
  76. 10.1016/j.ebiom.2019.10.033 · DOI · Paper page
  77. 10.1093/nar/gki372 · DOI · Paper page
  78. 10.1186/s40246-022-00396-x · DOI · Paper page
  79. 10.1007/s00401-013-1126-5 · DOI · Paper page
  80. 10.1016/j.ccell.2015.04.002 · DOI · Paper page
  81. 10.1016/j.cell.2016.01.015 · DOI · Paper page
  82. 10.1093/neuonc/noac088 · DOI
  83. 10.1038/s41467-020-20603-4 · DOI · Paper page
  84. 10.1111/bpa.12832 · DOI · Paper page
  85. 10.1136/gutjnl-2017-314711 · DOI
  86. 10.1093/neuonc/noz061 · DOI · Paper page
  87. 10.1172/JCI91095 · DOI
  88. 10.1080/2162402X.2021.1932365 · DOI
  89. 10.1002/path.5845 · DOI
  90. 10.1016/S1470-2045(21)00288-6 · DOI · Paper page
  91. 10.1056/NEJMoa2201445 · DOI · Paper page
  92. 10.1002/jcsm.13158 · DOI
  93. 10.1016/j.artmed.2018.10.006 · DOI · Paper page
  94. 10.1155/2014/147648 · DOI · Paper page
  95. 10.1371/journal.pcbi.1008702 · DOI
  96. 10.1016/j.ccell.2020.03.007 · DOI · Paper page
  97. 10.1186/s12859-020-03879-7 · DOI · Paper page
  98. 10.1016/j.artmed.2022.102260 · DOI
  99. 10.1016/j.ccell.2022.09.012 · DOI · Paper page
  100. Kather JN, 2018, Zenodo
  101. Anders CJ, Neumann D, Samek W, Müller KR, Lapuschkin S. 2021. Software for dataset-wide XAI: from local explanations to global insights with Zennit, CoRelAy, and ViRelAy. arXiv:2106.13200v2 [cs.LG] · arXiv
  102. Jassal B, 2020, Nucleic Acids Res, 48, D498
  103. 10.1016/j.media.2014.11.010 · DOI · Paper page
  104. Goodman B, 2017, AI Mag., 38, 50
  105. 10.1007/978-1-4939-3578-9_5 · DOI · Paper page

Metadata

Authors
Klauschen, F., Dippel, J., Keyl, P., Jurmeister, P., Bockmayr, M., Mock, A., Buchstab, O., Alber, M., Ruff, L., Montavon, G., & Müller, K.-R.
Venue
Annual Review of Pathology: Mechanisms of Disease
Published
2024-01-24
Volume
19
Issue
1
Pages
541-570
ISSN
  • 1553-4006 (ISSN-L)
  • 1553-4014
OpenAlex
W4387873179
Cited by
139
References
65
FWCI
3.83
Type
journal article
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Toward Explainable Artificial Intelligence for Precision Pathology. https://app.cochat.ai/papers/10.1146/annurev-pathmechdis-051222-113147
The paper
Klauschen, F., Dippel, J., Keyl, P., Jurmeister, P., Bockmayr, M., Mock, A., Buchstab, O., Alber, M., Ruff, L., Montavon, G., & Müller, K.-R. (2024). Toward Explainable Artificial Intelligence for Precision Pathology. Annual Review of Pathology: Mechanisms of Disease. https://doi.org/10.1146/annurev-pathmechdis-051222-113147

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.