CoChat
Sign Up
PreprintCited by 116Explainable Artificial Intelligence (XAI)Time Series Analysis and ForecastingSoftware Testing and Debugging Techniques

Explainable Artificial Intelligence (XAI) on TimeSeries Data: A Survey

Open access
Rojat, Thomas, Puget, Raphaël, Filliat, David, Del Ser, Javier, Gelin, Rodolphe, Díaz-Rodríguez, Natalia·2021·arXiv
DOI 10.48550/arxiv.2104.00950arXiv 2104.00950
Open this paper in CoChat — free accountOpen PDF

Abstract

Most of state of the art methods applied on time series consist of deep learning methods that are too complex to be interpreted. This lack of interpretability is a major drawback, as several applications in the real world are critical tasks, such as the medical field or the autonomous driving field. The explainability of models applied on time series has not gather much attention compared to the computer vision or the natural language processing fields. In this paper, we present an overview of existing explainable AI (XAI) methods applied on time series and illustrate the type of explanations they produce. We also provide a reflection on the impact of these explanation methods to provide confidence and trust in the AI systems.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2104.00950

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 87

  1. [1][1] S. A. Siddiqui, D. Mercier, M. Munir, A. Dengel, and S. Ahmed, 'Tsviz: Demystification of deep learning models for time-series analysis,' IEEE Access , vol. 7, pp. 67 027-67 040, 2019. -
  2. [2][2] M. T. Ribeiro, S. Singh, and C. Guestrin, '' why should i trust you?' explaining the predictions of any classifier,' in Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining , 2016, pp. 1135-1144. -
  3. [3][3] R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, 'Grad-cam: Visual explanations from deep networks via gradient-based localization,' International Journal of Computer Vision , vol. 128, no. 2, p. 336-359, Oct 2019. [Online]. Available: http://dx.doi.org/10.1007/s11263-019-01228-7 - · DOI · Paper page
  4. [4][4] E. Tjoa and C. Guan, 'A survey on explainable artificial intelligence (xai): Toward medical xai,' IEEE Transactions on Neural Networks and Learning Systems , p. 1-21, 2020. [Online]. Available: http: //dx.doi.org/10.1109/TNNLS.2020.3027314 TABLE II: Summary of evaluation approaches for XAI methods applied to time series. - · DOI · Paper page
  5. [5][5] A. B. Arrieta, N. D´ ıaz-Rodr´ ıguez, J. Del Ser, A. Bennetot, S. Tabik, A. Barbado, S. Garc´ ıa, S. Gil-L´ opez, D. Molina, R. Benjamins et al. , 'Explainable artificial intelligence (xai): Concepts, taxonomies, opportunities and challenges toward responsible ai,' Information Fusion , vol. 58, pp. 82-115, 2020. -
  6. [8][8] B. Kailkhura, B. Gallagher, S. Kim, A. Hiszpanski, and T. Y.-J. Han, 'Reliable and explainable machine-learning methods for accelerated material discovery,' npj Computational Materials , vol. 5, no. 1, pp. 1-9, 2019. -
  7. [11][11] K. Eykholt, I. Evtimov, E. Fernandes, B. Li, A. Rahmati, C. Xiao, A. Prakash, T. Kohno, and D. Song, 'Robust physical-world attacks on deep learning visual classification,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2018, pp. 1625-1634. -
  8. [12][12] N. Morgulis, A. Kreines, S. Mendelowitz, and Y. Weisglass, 'Fooling a real car with adversarial traffic signs,' arXiv preprint arXiv:1907.00374 , 2019. - · arXiv
  9. [14][14] K. Xu, D. H. Park, C. Yi, and C. Sutton, 'Interpreting deep classifier by visual distillation of dark knowledge,' arXiv preprint arXiv:1803.04042 , 2018. - · arXiv
  10. [15][15] J. Haspiel, N. Du, J. Meyerson, L. P. Robert Jr, D. Tilbury, X. J. Yang, and A. K. Pradhan, 'Explanations and expectations: Trust building in automated vehicles,' in Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction , 2018, pp. 119120. -
  11. [17][17] J. Koo, J. Kwac, W. Ju, M. Steinert, L. Leifer, and C. Nass, 'Why did my car just do that? explaining semi-autonomous driving actions to improve driver understanding, trust, and performance,' International Journal on Interactive Design and Manufacturing (IJIDeM) , vol. 9, no. 4, pp. 269-275, 2015. -
  12. [18][18] J. Koo, D. Shin, M. Steinert, and L. Leifer, 'Understanding driver responses to voice alerts of autonomous car operations,' International journal of vehicle design , vol. 70, no. 4, pp. 377-392, 2016. -
  13. [20][20] A. Chander, R. Srinivasan, S. Chelian, J. Wang, and K. Uchino, 'Working with beliefs: Ai transparency in the enterprise.' in IUI Workshops , 2018. -
  14. [21][21] D. A. Norman, Living with complexity . MIT press, 2016. -
  15. [22][22] N. D´ ıaz-Rodr´ ıguez and G. Pisoni, 'Accessible cultural heritage through explainable artificial intelligence,' in Adjunct Publication of the 28th ACM Conference on User Modeling, Adaptation and Personalization , 2020, pp. 317-324. -
  16. [23][23] G. Pisoni, N. D´ ıaz-Rodr´ ıguez, H. Gijlers, and L. Tonolli, 'Humancentred artificial intelligence for designing accessible cultural heritage,' Applied Sciences , vol. 11, no. 2, p. 870, 2021. -
  17. [24][24] T. Lesort, V. Lomonaco, A. Stoian, D. Maltoni, D. Filliat, and N. D´ ıazRodr´ ıguez, 'Continual learning for robotics: Definition, framework, learning strategies, opportunities and challenges,' Information fusion , vol. 58, pp. 52-68, 2020. -
  18. [25][25] M. Moradi and M. Samwald, 'Post-hoc explanation of blackbox classifiers using confident itemsets,' Expert Systems with Applications , vol. 165, p. 113941, Mar 2021. [Online]. Available: http://dx.doi.org/10.1016/j.eswa.2020.113941 - · DOI
  19. [26][26] Z. Wang, W. Yan, and T. Oates, 'Time series classification from scratch with deep neural networks: A strong baseline,' in 2017 International joint conference on neural networks (IJCNN) . IEEE, 2017, pp. 15781585. -
  20. [27][27] H. Ismail Fawaz, G. Forestier, J. Weber, L. Idoumghar, and P.-A. Muller, 'Accurate and interpretable evaluation of surgical skills from kinematic data using fully convolutional neural networks,' International Journal of Computer Assisted Radiology and Surgery , vol. 14, no. 9, p. 1611-1617, Jul 2019. [Online]. Available: http://dx.doi.org/10.1007/s11548-019-02039-4 - · DOI
  21. [29][29] B. Zhou, A. Khosla, A. Lapedriza, A. Oliva, and A. Torralba, 'Learning deep features for discriminative localization,' in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 2921-2929. -
  22. [31][31] Y. Gao, S. S. Vedula, C. E. Reiley, N. Ahmidi, B. Varadarajan, H. C. Lin, L. Tao, L. Zappella, B. B´ ejar, D. D. Yuh et al. , 'Jhu-isi gesture and skill assessment working set (jigsaws): A surgical activity dataset for human motion modeling,' in MICCAI workshop: M2cai , vol. 3, 2014, p. 3. -
  23. [32][32] N. Strodthoff and C. Strodthoff, 'Detecting and interpreting myocardial infarction using fully convolutional neural networks,' Physiological Measurement , vol. 40, no. 1, p. 015001, Jan 2019. [Online]. Available: http://dx.doi.org/10.1088/1361-6579/aaf34d - · DOI
  24. [33][33] S. Cho, G. Lee, and J. Choi, 'Interpretation of deep temporal representations by selective visualization of internally activated units,' arXiv preprint arXiv:2004.12538 , 2020. - · arXiv
  25. [34][34] R. Bousseljot, D. Kreiseler, and A. Schnabel, 'Nutzung der ekgsignaldatenbank cardiodat der ptb ¨ uber das internet,' Biomedical Engineering/Biomedizinische Technik , vol. 40, no. s1, pp. 317-318, 1995. -
  26. [35][35] A. L. Goldberger, L. A. Amaral, L. Glass, J. M. Hausdorff, P. C. Ivanov, R. G. Mark, J. E. Mietus, G. B. Moody, C.-K. Peng, and H. E. Stanley, 'Physiobank, physiotoolkit, and physionet: components of a - new research resource for complex physiologic signals,' circulation , vol. 101, no. 23, pp. e215-e220, 2000. -
  27. [36][36] J. Liu, L. Zhong, J. Wickramasuriya, and V. Vasudevan, 'uwave: Accelerometer-based personalized gesture recognition and its applications,' Pervasive and Mobile Computing , vol. 5, no. 6, pp. 657-675, 2009. -
  28. [38][38] M. Ancona, E. Ceolini, C. ¨ Oztireli, and M. Gross, 'Towards better understanding of gradient-based attribution methods for deep neural networks,' arXiv preprint arXiv:1711.06104 , 2017. - · arXiv
  29. [39][39] S. Tonekaboni, S. Joshi, D. Duvenaud, and A. Goldenberg. (2019) Explaining time series by counterfactuals. [Online]. Available: https://openreview.net/pdf?id=HygDF1rYDB -
  30. [40][40] K. Kashiparekh, J. Narwariya, P. Malhotra, L. Vig, and G. Shroff, 'Convtimenet: A pre-trained deep convolutional neural network for time series classification,' in 2019 International Joint Conference on Neural Networks (IJCNN) , 2019, pp. 1-8. -
  31. [41][41] M. D. Zeiler and R. Fergus, 'Visualizing and understanding convolutional networks,' in European conference on computer vision . Springer, 2014, pp. 818-833. -
  32. [42][42] A. E. Johnson, T. J. Pollard, L. Shen, H. L. Li-Wei, M. Feng, M. Ghassemi, B. Moody, P. Szolovits, L. A. Celi, and R. G. Mark, 'Mimic-iii, a freely accessible critical care database,' Scientific data , vol. 3, no. 1, pp. 1-9, 2016. -
  33. [43][43] F. Karim, S. Majumdar, H. Darabi, and S. Chen, 'Lstm fully convolutional networks for time series classification,' IEEE Access , vol. 6, pp. 1662-1669, 2018. -
  34. [44][44] C. Schockaert, R. Leperlier, and A. Moawad, 'Attention mechanism for multivariate time series recurrent model interpretability applied to the ironmaking industry,' arXiv preprint arXiv:2007.12617 , 2020. - · arXiv
  35. [45][45] K. S. Choi, S. H. Choi, and B. Jeong, 'Prediction of IDH genotype in gliomas with dynamic susceptibility contrast perfusion MR imaging using an explainable recurrent neural network,' Neuro-Oncology , vol. 21, no. 9, pp. 1197-1209, 06 2019. [Online]. Available: https://doi.org/10.1093/neuonc/noz095 - · DOI
  36. [46][46] P. Vinayavekhin, S. Chaudhury, A. Munawar, D. J. Agravante, G. De Magistris, D. Kimura, and R. Tachibana, 'Focusing on what is relevant: Time-series learning and understanding using attention,' in 2018 24th International Conference on Pattern Recognition (ICPR) . IEEE, 2018, pp. 2624-2629. -
  37. [47][47] W. Ge, J.-W. Huh, Y. R. Park, J.-H. Lee, Y.-H. Kim, and A. Turchin, 'An interpretable icu mortality prediction model based on logistic regression and recurrent neural networks with lstm units.' in AMIA Annual Symposium Proceedings , vol. 2018. American Medical Informatics Association, 2018, p. 460. -
  38. [49][49] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, 'Attention is all you need,' Advances in neural information processing systems , vol. 30, pp. 59986008, 2017. -
  39. [51][51] J.-Y. Kim and S.-B. Cho, 'Electric energy consumption prediction by deep learning with state explainable autoencoder,' Energies , vol. 12, p. 739, 02 2019. -
  40. [53][53] J. Lin, E. Keogh, L. Wei, and S. Lonardi, 'Experiencing sax: A novel symbolic representation of time series,' Data Min. Knowl. Discov. , vol. 15, pp. 107-144, 08 2007. -
  41. [54][54] J. Lin, E. Keogh, S. Lonardi, and B. Chiu, 'A symbolic representation of time series, with implications for streaming algorithms,' 01 2003, pp. 2-11. -
  42. [55][55] E. Keogh, K. Chakrabarti, M. Pazzani, and S. Mehrotra, 'Dimensionality reduction for fast similarity search in large time series databases,' Knowledge and Information Systems , vol. 3, 01 2002. -
  43. [56][56] P. Senin and S. Malinchik, 'Sax-vsm: Interpretable time series classification using sax and vector space model,' in 2013 IEEE 13th International Conference on Data Mining , 2013, pp. 1175-1180. -
  44. [57][57] T. L. Nguyen, S. Gsponer, I. Ilie, and G. Ifrim, 'Interpretable time series classification using all-subsequence learning and sym- - bolic representations in time and frequency domains,' arXiv preprint arXiv:1808.04022 , 2018. - · arXiv
  45. [58][58] T. Le Nguyen, S. Gsponer, I. Ilie, M. O'Reilly, and G. Ifrim, 'Interpretable time series classification using linear models and multiresolution multi-domain symbolic representations,' Data mining and knowledge discovery , vol. 33, no. 4, pp. 1183-1222, 2019. -
  46. [59][59] L. A. Zadeh, 'Fuzzy logic,' Computer , vol. 21, no. 4, pp. 83-93, 1988. -
  47. [60][60] F. Herrera, E. Herrera-Viedma, and L. Martınez, 'A fusion approach for managing multi-granularity linguistic term sets in decision making,' Fuzzy sets and systems , vol. 114, no. 1, pp. 43-58, 2000. -
  48. [61][61] F. Herrera, S. Alonso, F. Chiclana, and E. Herrera-Viedma, 'Computing with words in decision making: foundations, trends and prospects,' Fuzzy optimization and decision making , vol. 8, no. 4, pp. 337-364, 2009. -
  49. [62][62] C. Mencar and J. M. Alonso, 'Paving the way to explainable artificial intelligence with fuzzy modeling,' in International Workshop on Fuzzy Logic and Applications . Springer, 2018, pp. 215-227. -
  50. [63][63] P. C. Nayak, K. Sudheer, D. Rangan, and K. Ramasastri, 'A neuro fuzzy computing technique for modeling hydrological time series,' Journal of Hydrology , vol. 291, pp. 52-66, 05 2004. -
  51. [64][64] S.-M. Chen, C.-C. Hsu et al. , 'A new method to forecast enrollments using fuzzy time series,' International Journal of Applied Science and Engineering , vol. 2, no. 3, pp. 234-244, 2004. -
  52. [65][65] S.-M. Chen and J.-R. Hwang, 'Temperature prediction using fuzzy time series,' IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) , vol. 30, no. 2, pp. 263-275, 2000. -
  53. [66][66] I. Aydin, M. Karakose, and E. Akin, 'The prediction algorithm based on fuzzy logic using time series data mining method,' World Academy of Science, Engineering and Technology , vol. 51, no. 27, pp. 91-98, 2009. -
  54. [67][67] N. K. Kasabov and Qun Song, 'Denfis: dynamic evolving neural-fuzzy inference system and its application for time-series prediction,' IEEE Transactions on Fuzzy Systems , vol. 10, no. 2, pp. 144-154, 2002. -
  55. [69][69] J. Wang, X. Wang, C. Li, J. Wu et al. , 'Deep fuzzy cognitive maps for interpretable multivariate time series prediction,' IEEE Transactions on Fuzzy Systems , 2020. -
  56. [70][70] R. P. Paiva and A. Dourado, 'Interpretability and learning in neurofuzzy systems,' Fuzzy sets and systems , vol. 147, no. 1, pp. 17-38, 2004. -
  57. [71][71] M. C. Mackey and L. Glass, 'Oscillation and chaos in physiological control systems,' Science , vol. 197, no. 4300, pp. 287-289, 1977. -
  58. [72][72] G. E. Box, G. M. Jenkins, G. C. Reinsel, and G. M. Ljung, Time series analysis: forecasting and control . John Wiley & Sons, 2015. -
  59. [73][73] Y.-H. Lee, C.-P. Wei, T.-H. Cheng, and C.-T. Yang, 'Nearest-neighborbased approach to time-series classification,' Decision Support Systems , vol. 53, no. 1, pp. 207-217, 2012. -
  60. [74][74] Z. Geler, V. Kurbalija, M. Ivanovi´ c, and M. Radovanovi´ c, 'Weighted knn and constrained elastic distances for time-series classification,' Expert Systems with Applications , vol. 162, p. 113829, 2020. -
  61. [75][75] S. Xu, Q. Luo, H. Li, and L. Zhang, 'Time series classification based on attributes weighted sample reducing knn,' in 2009 Second International Symposium on Electronic Commerce and Security , vol. 2. IEEE, 2009, pp. 194-199. -
  62. [76][76] L. Ye and E. Keogh, 'Time series shapelets: a new primitive for data mining,' in Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining , 2009, pp. 947956. -
  63. [78][78] T. Cover and P. Hart, 'Nearest neighbor pattern classification,' IEEE Transactions on Information Theory , vol. 13, no. 1, pp. 21-27, 1967. -
  64. [79][79] Y.-H. Lee, C.-P. Wei, T.-H. Cheng, and C.-T. Yang, 'Nearest-neighborbased approach to time-series classification,' Decision Support Systems , vol. 53, no. 1, pp. 207 -217, 2012. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S0167923612000097 -
  65. [80][80] P. Kidger, J. Morrill, and T. Lyons, 'Generalised interpretable shapelets for irregular time series,' arXiv preprint arXiv:2005.13948 , 2020. - · arXiv
  66. [81][81] Y. Wang, R. Emonet, E. Fromont, S. Malinowski, E. Menager, L. Mosser, and R. Tavenard, 'Learning interpretable shapelets for time series classification through adversarial regularization,' arXiv preprint arXiv:1906.00917 , 2019. - · arXiv
  67. [82][82] Z. Fang, P. Wang, and W. Wang, 'Efficient learning interpretable shapelets for accurate time series classification,' in 2018 IEEE 34th International Conference on Data Engineering (ICDE) , 2018, pp. 497508. -
  68. [83][83] G. Li, B. K. K. Choi, J. Xu, S. S. Bhowmick, K. Chun, and G. L. Wong, 'Efficient shapelet discovery for time series classification,' IEEE Transactions on Knowledge and Data Engineering , pp. 1-1, 2020. -
  69. [85][85] A. Wolanin, G. Mateo-Garc´ ıa, G. Camps-Valls, L. G´ omez-Chova, M. Meroni, G. Duveiller, L. You, and L. Guanter, 'Estimating and understanding crop yields with explainable deep learning in the indian wheat belt,' Environmental Research Letters , vol. 15, 01 2020. -
  70. [86][86] Y. Hao and H. Cao, 'A new attention mechanism to classify multivariate time series,' in Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI-20 , C. Bessiere, Ed. International Joint Conferences on Artificial Intelligence Organization, 7 2020, pp. 1999-2005, main track. [Online]. Available: https://doi.org/10.24963/ijcai.2020/277 - · DOI
  71. [87][87] S. A. Siddiqui, D. Mercier, A. Dengel, and S. Ahmed, 'Tsinsight: A local-global attribution framework for interpretability in time-series data,' arXiv preprint arXiv:2004.02958 , 2020. - · arXiv
  72. [88][88] Q. Tan, M. Ye, A. J. Ma, B. Yang, T. C. F. Yip, G. L. H. Wong, and P. C. Yuen, 'Explainable uncertainty-aware convolutional recurrent neural network for irregular medical time series,' IEEE Transactions on Neural Networks and Learning Systems , pp. 1-15, 2020. -
  73. [89][89] P. Gao, X. Yang, R. Zhang, and K. Huang, 'Explainable tensorized neural ordinary differential equations forarbitrary-step time series prediction,' arXiv preprint arXiv:2011.13174 , 2020. - · arXiv
  74. [90][90] M. Munir, S. A. Siddiqui, F. K¨ usters, D. Mercier, A. Dengel, and S. Ahmed, 'Tsxplain: Demystification of dnn decisions for time-series using natural language and statistical features,' Lecture Notes in Computer Science , p. 426-439, 2019. [Online]. Available: http://dx.doi.org/10.1007/978-3-030-30493-5 43 - · DOI
  75. [91][91] Q. Pan, W. Hu, and J. Zhu, 'Series saliency: Temporal interpretation for multivariate time series forecasting,' arXiv preprint arXiv:2012.09324 , 2020. - · arXiv
  76. [92][92] R. Assaf, I. Giurgiu, F. Bagehorn, and A. Schumann, 'Mtex-cnn: Multivariate time series explanations for predictions with convolutional neural networks,' in 2019 IEEE International Conference on Data Mining (ICDM) , 2019, pp. 952-957. -
  77. [93][93] M. Augustin, A. Meinke, and M. Hein, 'Adversarial robustness on inand out-distribution improves explainability,' in European Conference on Computer Vision . Springer, 2020, pp. 228-245. -
  78. [94][94] A. H. Gee, D. Garcia-Olano, J. Ghosh, and D. Paydarfar, 'Explaining deep classification of time-series data with learned prototypes,' arXiv preprint arXiv:1904.08935 , 2019. - · arXiv
  79. [95][95] A. Kacem, Z. Hammal, M. Daoudi, and J. Cohn, 'Detecting depression severity by interpretable representations of motion dynamics,' in 2018 13th IEEE International Conference on Automatic Face Gesture Recognition (FG 2018) , 2018, pp. 739-745. -
  80. [96][96] A. Hartl, M. Bachl, J. Fabini, and T. Zseby, 'Explainability and adversarial robustness for rnns,' 2020 IEEE Sixth International Conference on Big Data Computing Service and Applications (BigDataService) , Aug 2020. [Online]. Available: http://dx.doi.org/10. 1109/BigDataService49289.2020.00030 -
  81. [98][98] A. Madry, A. Makelov, L. Schmidt, D. Tsipras, and A. Vladu, 'Towards deep learning models resistant to adversarial attacks,' arXiv preprint arXiv:1706.06083 , 2017. - · arXiv
  82. [99][99] M. Hein, M. Andriushchenko, and J. Bitterwolf, 'Why relu networks yield high-confidence predictions far away from the training data and how to mitigate the problem,' in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2019, pp. 41-50. -
  83. [101][101] H. Arnout, M. El-Assady, D. Oelke, and D. A. Keim, 'Towards a rigorous evaluation of xai methods on time series,' in 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) . IEEE, 2019, pp. 4197-4201. -
  84. [102][102] S. Bach, A. Binder, G. Montavon, F. Klauschen, K.-R. M¨ uller, and W. Samek, 'On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation,' PloS one , vol. 10, no. 7, p. e0130140, 2015. -
  85. [103][103] Y. Yang, V. Tresp, M. Wunderle, and P. A. Fasching, 'Explaining therapy predictions with layer-wise relevance propagation in neural networks,' in 2018 IEEE International Conference on Healthcare Informatics (ICHI) , 2018, pp. 152-162. -
  86. [104][104] H. Suresh, N. Hunt, A. Johnson, L. A. Celi, P. Szolovits, and M. Ghassemi, 'Clinical intervention prediction and understanding using deep networks,' arXiv preprint arXiv:1705.08498 , 2017. - · arXiv
  87. [105][105] A. Binder, G. Montavon, S. Lapuschkin, K.-R. M¨ uller, and W. Samek, 'Layer-wise relevance propagation for neural networks with local renormalization layers,' in International Conference on Artificial Neural Networks . Springer, 2016, pp. 63-71.

Cited by

Sorted by citations

Authors
Rojat, T., Puget, R., Filliat, D., Del Ser, J., Gelin, R., & Díaz-Rodríguez, N.
Affiliations
Renault (France) (FR)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2021
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2104.00950
arXiv
2104.00950
OpenAlex
W3150957536
Cited by
116
References
11
Citations by year
2026: 2 · 2025: 26 · 2024: 38 · 2023: 24 · 2022: 20 · 2021: 6
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
  • Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
Keywords
explainable AI, time series, model interpretability, explanation methods, deep learning interpretability, trust in AI, medical applications, autonomous driving

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review