CoChat
Sign Up
PreprintCited by 227Explainable Artificial Intelligence (XAI)Autonomous Vehicle Technology and SafetySafety Systems Engineering in Autonomy

The DOI matches its DataCite record.

Explainability of deep vision-based autonomous driving systems: Review and challenges

Open access
Zablocki, Éloi, Ben-Younes, Hédi, Pérez, Patrick, Cord, Matthieu·2021·arXiv
DOI 10.48550/arxiv.2101.05307arXiv 2101.05307
Open this paper in CoChat — free accountOpen PDF

Abstract

This survey reviews explainability methods for vision-based self-driving systems trained with behavior cloning. The concept of explainability has several facets and the need for explainability is strong in driving, a safety-critical application. Gathering contributions from several research fields, namely computer vision, deep learning, autonomous driving, explainable AI (X-AI), this survey tackles several points. First, it discusses definitions, context, and motivation for gaining more interpretability and explainability from self-driving systems, as well as the challenges that are specific to this application. Second, methods providing explanations to a black-box self-driving system in a post-hoc fashion are comprehensively organized and detailed. Third, approaches from the literature that aim at building more interpretable self-driving systems by design are presented and discussed in detail. Finally, remaining open-challenges and potential future research directions are identified and examined.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2101.05307

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • There are many initiatives to create automated systems that produce comprehensible justifications on an automobile's pivotal decisions, spurred by contemporary modeling and analysis of automated vehicle technologies.

    “There are many initiatives to create automated systems that produce comprehensible justifications on a automobile's pivotal decisions, spurred by contemporary modeling and analysis of automated vehicle technologies [81].”

    From A Review of Trustworthy and Explainable Artificial Intelligence (XAI) (2023) · cites this paper as [81]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 159

  1. Adadi A, Berrada M (2018) Peeking inside the black- box: A survey on explainable artificial intelligence (XAI). IEEE Access
  2. Adebayo J, Gilmer J, Muelly M, Goodfellow IJ, Hardt M, Kim B (2018) Sanity checks for saliency maps. In: NeurIPS
  3. Agrawal A, Lu J, Antol S, Mitchell M, Zitnick CL, Parikh D, Batra D (2017) VQA: visual question an- swering -www.visualqa.org. IJCV
  4. Agrawal A, Batra D, Parikh D, Kembhavi A (2018) Don't just assume; look and answer: Overcoming pri- ors for visual question answering. In: CVPR
  5. Alhaija HA, Mustikovela SK, Mescheder LM, Geiger A, Rother C (2018) Augmented reality meets com- puter vision: Efficient data generation for urban driv- ing scenes. IJCV
  6. Alipour K, Schulze JP, Yao Y, Ziskind A, Burachas G (2020) A study on multimodal and interac- tive explanations for visual question answering. In: SafeAI@AAAI
  7. Camburu O, Rocktäschel T, Lukasiewicz T, Blunsom P (2018) e-snli: Natural language inference with natural language explanations. In: NeurIPS
  8. Casas S, Sadat A, Urtasun R (2021) MP3: A unified model to map, perceive, predict and plan. In: CVPR
  9. Castrejón L, Aytar Y, Vondrick C, Pirsiavash H, Tor- ralba A (2016) Learning aligned cross-modal repre- sentations from weakly aligned data. In: CVPR
  10. Chang Y, Liu ZY, Hsu WH (2019) Vornet: Spatio- temporally consistent video inpainting for object re- moval. In: CVPR Workshops
  11. Chen C, Li O, Tao D, Barnett A, Rudin C, Su J (2019) This looks like that: Deep learning for interpretable image recognition. In: NeurIPS
  12. Chen J, Li SE, Tomizuka M (2020a) Interpretable end- to-end urban autonomous driving with latent deep reinforcement learning. CoRR
  13. Chen X, Duan Y, Houthooft R, Schulman J, Sutskever I, Abbeel P (2016) Infogan: Interpretable representa- tion learning by information maximizing generative adversarial nets. In: NIPS
  14. Chen X, Zhang Y, Wang Y, Shu H, Xu C, Xu C (2020b) Optical flow distillation: Towards efficient and stable video style transfer. In: ECCV
  15. Chen Y, Rong F, Duggal S, Wang S, Yan X, Mani- vasagam S, Xue S, Yumer E, Urtasun R (2021) Geosim: Realistic video simulation via geometry- aware composition for self-driving. In: CVPR
  16. Chitta K, Prakash A, Geiger A (2021) NEAT: neural attention fields for end-to-end autonomous driving. In: ICCV
  17. Codevilla F, Miiller M, López A, Koltun V, Dosovitskiy A (2018) End-to-end driving via conditional imita- tion learning. In: ICRA
  18. Codevilla F, Santana E, López AM, Gaidon A (2019) Exploring the limitations of behavior cloning for au- tonomous driving. In: ICCV
  19. Cui H, Radosavljevic V, Chou F, Lin T, Nguyen T, Huang T, Schneider J, Djuric N (2019) Multimodal trajectory predictions for autonomous driving using deep convolutional networks. In: ICRA
  20. Cultrera L, Seidenari L, Becattini F, Pala P, Bimbo AD (2020) Explaining autonomous driving by learning end-to-end visual attention. In: CVPR Workshops
  21. Das A, Rad P (2020) Opportunities and challenges in explainable artificial intelligence (XAI): A survey. CoRR
  22. Di X, Shi R (2020) A survey on autonomous vehicle control in the era of mixed-autonomy: From physics- based to ai-guided driving policy learning. CoRR Dickmanns ED (2002) The development of machine vi- sion for road vehicles in the last decade. In: IV
  23. Ding S, Koehn P (2021) Evaluating saliency methods for neural language models. In: NAACL
  24. Djuric N, Radosavljevic V, Cui H, Nguyen T, Chou F, Lin T, Singh N, Schneider J (2020) Uncertainty- aware short-term motion prediction of traffic actors for autonomous driving. In: WACV
  25. Doshi-Velez F, Kim B (2017) Towards a rigorous science of interpretable machine learning. CoRR
  26. Doshi-Velez F, Kortz MA (2017) Accountability of ai under the law: The role of explanation. CoRR
  27. Dosovitskiy A, Ros G, Codevilla F, López A, Koltun V (2017) CARLA: an open urban driving simulator. In: CoRL
  28. Fong RC, Vedaldi A (2017) Interpretable explanations of black boxes by meaningful perturbation. In: ICCV
  29. Frosst N, Hinton GE (2017) Distilling a neural network into a soft decision tree. In: Workshop on Compre- hensibility and Explanation in AI and ML @AI*IA 2017
  30. Gao C, Saraf A, Huang J, Kopf J (2020) Flow-edge guided video completion. In: ECCV
  31. Garfinkel S, Matthews J, Shapiro SS, Smith JM (2017) Toward algorithmic transparency and accountability. Commun ACM
  32. Geng Z, Cao C, Tulyakov S (2020) Towards photo- realistic facial expression manipulation. IJCV
  33. Ghorbani A, Abid A, Zou JY (2019) Interpretation of neural networks is fragile. In: AAAI
  34. Goyal Y, Wu Z, Ernst J, Batra D, Parikh D, Lee S (2019) Counterfactual visual explanations. In: ICML
  35. Guidotti R, Monreale A, Ruggieri S, Turini F, Gian- notti F, Pedreschi D (2018) A survey of methods for explaining black box models. ACM Comput Surv
  36. de Haan P, Jayaraman D, Levine S (2019) Causal con- fusion in imitation learning. In: NeurIPS
  37. Harradon M, Druce J, Ruttenberg BE (2018) Causal learning and explanation of deep neural networks via autoencoded activations. CoRR
  38. Hase P, Zhang S, Xie H, Bansal M (2020) Leakage- adjusted simulatability: Can models generate non- trivial explanations of their behavior in natural lan- guage? In: Cohn T, He Y, Liu Y (eds) EMNLP (Find- ings)
  39. Hecker S, Dai D, Liniger A, Gool LV (2020) Learning accurate and human-like driving using semantic maps and attention. CoRR
  40. Hendricks LA, Akata Z, Rohrbach M, Donahue J, Schiele B, Darrell T (2016) Generating visual expla- nations. In: ECCV
  41. Hendricks LA, Hu R, Darrell T, Akata Z (2018) Grounding visual explanations. In: ECCV
  42. Herman B (2017) The promise and peril of human eval- uation for model interpretability. CoRR
  43. Heusel M, Ramsauer H, Unterthiner T, Nessler B, Hochreiter S (2017) Gans trained by a two time-scale update rule converge to a local nash equilibrium. In: NIPS
  44. Hu R, Andreas J, Rohrbach M, Darrell T, Saenko K (2017) Learning to reason: End-to-end module net- works for visual question answering. In: ICCV
  45. Jacob P, Zablocki É, Ben-Younes H, Chen M, Pérez P, Cord M (2021) STEEX: steering counterfactual explanations with semantics. CoRR abs/2111.09094 · arXiv
  46. Jacovi A, Goldberg Y (2020a) Aligning faithful inter- pretations with their social attribution. TACL
  47. Jacovi A, Goldberg Y (2020b) Towards faithfully in- terpretable NLP systems: How should we define and evaluate faithfulness? In: ACL
  48. Jain S, Wallace BC (2019) Attention is not explanation. In: NAACL
  49. Janai J, Güney F, Behl A, Geiger A (2020b) Computer vision for autonomous vehicles: Problems, datasets and state of the art. Foundations and Trends® in Computer Graphics and Vision 12(1-3):1-308
  50. Jansen P, Smith K, Moreno D, Ortiz H (2021) On the challenges of evaluating compositional explanations in multi-hop inference: Relevance, completeness, and expert ratings. CoRR abs/2109.03334 · arXiv
  51. Johnson J, Hariharan B, van der Maaten L, Fei-Fei L, Zitnick CL, Girshick RB (2017) CLEVR: A diagnos- tic dataset for compositional language and elemen- tary visual reasoning. In: CVPR
  52. Karras T, Laine S, Aila T (2019) A style-based genera- tor architecture for generative adversarial networks. In: CVPR
  53. Kim H, Lee K, Hwang G, Suh C (2019) Crash to not crash: Learn to identify dangerous vehicles using a simulator. In: AAAI
  54. Kim J, Bansal M (2020) Attentional bottleneck: To- wards an interpretable deep driving network. In: CVPR Workshops
  55. Kim J, Canny JF (2017) Interpretable learning for self- driving cars by visualizing causal attention. In: ICCV
  56. Kim J, Rohrbach A, Darrell T, Canny JF, Akata Z (2018) Textual explanations for self-driving vehicles. In: ECCV
  57. Kiran BR, Sobh I, Talpaert V, Mannion P, Sallab AAA, Yogamani SK, Pérez P (2020) Deep reinforcement learning for autonomous driving: A survey. CoRR
  58. Koren M, Alsaif S, Lee R, Kochenderfer MJ (2018) Adaptive stress testing for autonomous vehicles. In: IV Krähenbühl P (2018) Free supervision from video games. In: CVPR
  59. Krizhevsky A, Sutskever I, Hinton GE (2012) Ima- genet classification with deep convolutional neural networks. In: NIPS
  60. Lample G, Zeghidour N, Usunier N, Bordes A, Denoyer L, Ranzato M (2017) Fader networks: Manipulating images by sliding attributes. In: NIPS
  61. Lee JD, Moray N (1994) Trust, self-confidence, and operators' adaptation to automation. International journal of human-computer studies
  62. Lee N, Choi W, Vernaza P, Choy CB, Torr PHS, Chan- draker M (2017) DESIRE: distant future prediction in dynamic scenes with interacting agents. In: CVPR
  63. Leonard J, How J, Teller S, Berger M, Campbell S, Fiore G, Fletcher L, Frazzoli E, Huang A, Karaman S, et al (2008) A perception-driven autonomous ur- ban vehicle. Journal of Field Robotics
  64. Li B, Qi X, Lukasiewicz T, Torr PHS (2020a) Manigan: Text-guided image manipulation. In: CVPR
  65. Li B, Qi X, Torr PHS, Lukasiewicz T (2020b) Lightweight generative adversarial networks for text- guided image manipulation. In: NeurIPS
  66. Li C, Chan SH, Chen Y (2020c) Who make drivers stop? towards driver-centric risk assessment: Risk ob- ject identification via causal inference. In: IROS
  67. Li Q, Tao Q, Joty SR, Cai J, Luo J (2018a) VQA-E: explaining, elaborating, and enhancing your answers for visual questions. In: ECCV
  68. Li Y, Torralba A, Anandkumar A, Fox D, Garg A (2020d) Causal discovery in physical systems from videos. NeurIPS Li Z, Motoyoshi T, Sasaki K, Ogata T, Sugano S (2018b) Rethinking self-driving: Multi-task knowl- edge for better generalization and accident explana- tion ability. CoRR
  69. Lipton ZC (2018) The mythos of model interpretability. Commun ACM
  70. Liu G, Reda FA, Shih KJ, Wang T, Tao A, Catanzaro B (2018) Image inpainting for irregular holes using partial convolutions. In: ECCV
  71. Liu H, Yin Q, Wang WY (2019) Towards explainable NLP: A generative explanation framework for text classification. In: ACL
  72. Liu Y, Hsieh Y, Chen M, Yang CH, Tegnér J, Tsai YJ (2020) Interpretable self-attention temporal reason- ing for driving behavior understanding. In: ICASSP
  73. Lu J, Yang J, Batra D, Parikh D (2016) Hierarchical question-image co-attention for visual question an- swering. In: NIPS
  74. Lu X, Tolmachev A, Yamamoto T, Takeuchi K, Oka- jima S, Takebayashi T, Maruhashi K, Kashima H (2021) Crowdsourcing evaluation of saliency-based XAI methods. In: ECML-PKDD
  75. Lundberg SM, Lee S (2017) A unified approach to in- terpreting model predictions. In: NIPS
  76. Ly AO, Akhloufi MA (2020) Learning to drive by imita- tion: an overview of deep behavior cloning methods. T-IV M JO, Wang K, Tuytelaars T (2019) Visual explanation by interpretation: Improving visual feedback capabil- ities of deep neural networks. In: ICLR
  77. Maaten Lvd, Hinton G (2008) Visualizing data using t-sne. JMLR
  78. Mac Aodha O, Su S, Chen Y, Perona P, Yue Y (2018) Teaching categories to human learners with visual explanations. In: CVPR
  79. Madumal P, Miller T, Sonenberg L, Vetere F (2020) Explainable reinforcement learning through a causal lens. In: AAAI
  80. Makino T, Jastrzebski S, Oleszkiewicz W, Chacko C, Ehrenpreis R, Samreen N, Chhor C, Kim E, Lee J, Pysarenko K, Reig B, Toth H, Awal D, Du L, Kim A, Park J, Sodickson DK, Heacock L, Moy L, Cho K, Geras KJ (2020) Differences between human and machine perception in medical diagnosis. CoRR
  81. Malinowski M, Rohrbach M, Fritz M (2017) Ask your neurons: A deep learning approach to visual question answering. IJCV
  82. Manzo UG, Chiroma H, Aljojo N, Abubakar S, Popoola SI, Al-Garadi MA (2020) A survey on deep learning for steering angle prediction in autonomous vehicles. IEEE Access
  83. Maximov M, Elezi I, Leal-Taixé L (2020) CIAGAN: conditional identity anonymization generative adver- sarial networks. In: CVPR
  84. McAllister R, Gal Y, Kendall A, van der Wilk M, Shah A, Cipolla R, Weller A (2017) Concrete problems for autonomous vehicle safety: Advantages of bayesian deep learning. In: IJCAI
  85. Mehrabi N, Morstatter F, Saxena N, Lerman K, Gal- styan A (2019) A survey on bias and fairness in ma- chine learning. CoRR
  86. Mohseni S, Jagadeesh A, Wang Z (2019) Predicting model failure using saliency maps in autonomous driving systems. Workshop on Uncertainty and Ro- bustness in Deep Learning @ICML
  87. Moing GL, Vu T, Jain H, Pérez P, Cord M (2021) Se- mantic palette: Guiding scene generation with class proportions. In: CVPR
  88. Molnar C (2019) Interpretable Machine Learning Moraffah R, Karami M, Guo R, Raglin A, Liu H (2020) Causal interpretability for machine learning -problems, methods and evaluation. SIGKDD Ex- plorations
  89. Morgulis N, Kreines A, Mendelowitz S, Weisglass Y (2019) Fooling a real car with adversarial traffic signs. CoRR
  90. Müller M, Dosovitskiy A, Ghanem B, Koltun V (2018) Driving policy transfer via modularity and abstrac- tion. In: CoRL
  91. Narendra T, Sankaran A, Vijaykeerthy D, Mani S (2018) Explaining deep learning models using causal inference. CoRR
  92. Nguyen AM, Dosovitskiy A, Yosinski J, Brox T, Clune J (2016) Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. In: NIPS
  93. Omeiza D, Webb H, Jirotka M, Kunze L (2021) Expla- nations in autonomous driving: A survey. CoRR
  94. Papineni K, Roukos S, Ward T, Zhu W (2002) Bleu: a method for automatic evaluation of machine transla- tion. In: ACL
  95. Park DH, Hendricks LA, Akata Z, Rohrbach A, Schiele B, Darrell T, Rohrbach M (2018) Multimodal expla- nations: Justifying decisions and pointing to the evi- dence. In: CVPR
  96. Patro BN, Anupriy, Namboodiri V (2020) Explanation vs attention: A two-player game to obtain attention for VQA. In: AAAI
  97. Pei K, Cao Y, Yang J, Jana S (2019) Deepxplore: au- tomated whitebox testing of deep learning systems. Commun ACM
  98. Phan-Minh T, Grigore EC, Boulton FA, Beijbom O, Wolff EM (2020) Covernet: Multimodal behavior pre- diction using trajectory sets. In: CVPR
  99. Pomerleau D (1988) ALVINN: an autonomous land ve- hicle in a neural network. In: NIPS
  100. Pu Y, Gan Z, Henao R, Yuan X, Li C, Stevens A, Carin L (2016) Variational autoencoder for deep learning of images, labels and captions. In: NIPS
  101. Rajani NF, McCann B, Xiong C, Socher R (2019) Ex- plain yourself! leveraging language models for com- monsense reasoning. In: ACL
  102. Ramakrishnan S, Agrawal A, Lee S (2018) Overcom- ing language priors in visual question answering with adversarial regularization. In: NeurIPS
  103. Ramanishka V, Chen Y, Misu T, Saenko K (2018) Toward driving scene understanding: A dataset for learning driver behavior and causal reasoning. In: CVPR
  104. Rathi S (2019) Generating counterfactual and con- trastive explanations using SHAP. Workshop on Hu- manizing AI (HAI) @IJCAI
  105. Razavian AS, Azizpour H, Sullivan J, Carlsson S (2014) CNN features off-the-shelf: An astounding baseline for recognition. In: CVPR Workshops
  106. Ren Z, Lee YJ, Ryoo MS (2018) Learning to anonymize faces for privacy preserving action detection. In: Fer- rari V, Hebert M, Sminchisescu C, Weiss Y (eds) ECCV Rezvani T, Driggs-Campbell KR, Sadigh D, Sastry SS, Seshia SA, Bajcsy R (2016) Towards trustworthy au- tomation: User interfaces that convey internal and external awareness. In: ITSC
  107. Ribeiro MT, Singh S, Guestrin C (2016) "why should I trust you?": Explaining the predictions of any classi- fier. In: SIGKDD
  108. Ribeiro MT, Singh S, Guestrin C (2018) Anchors: High- precision model-agnostic explanations. In: AAAI
  109. Rodríguez P, Caccia M, Lacoste A, Zamparo L, Laradji IH, Charlin L, Vázquez D (2021) Beyond trivial coun- terfactual explanations with diverse valuable expla- nations. CoRR abs/2103.10226 · arXiv
  110. Sadat A, Casas S, Ren M, Wu X, Dhawan P, Urtasun R (2020) Perceive, predict, and plan: Safe motion plan- ning through interpretable semantic representations. In: ECCV
  111. Salzmann T, Ivanovic B, Chakravarty P, Pavone M (2020) Trajectron++: Dynamically-feasible trajec- tory forecasting with heterogeneous data. In: Vedaldi A, Bischof H, Brox T, Frahm J (eds) ECCV, Lecture Notes in Computer Science
  112. Samek W, Binder A, Montavon G, Lapuschkin S, Müller K (2017) Evaluating the visualization of what a deep neural network has learned. IEEE Trans Neu- ral Networks Learn Syst 28(11):2660-2673, DOI 10.1109/TNNLS.2016.2599820 · DOI · Paper page
  113. Sauer A, Savinov N, Geiger A (2018) Conditional af- fordance learning for driving in urban environments. In: CoRL
  114. Shen Y, Jiang S, Chen Y, Yang E, Jin X, Fan Y, Camp- bell KD (2020) To explain or not to explain: A study on the necessity of explanations for autonomous ve- hicles. CoRR
  115. Shrikumar A, Greenside P, Kundaje A (2017) Learn- ing important features through propagating activa- tion differences. In: ICML
  116. Simonyan K, Vedaldi A, Zisserman A (2014) Deep in- side convolutional networks: Visualising image clas- sification models and saliency maps. In: ICLR
  117. Singla S, Pollack B, Chen J, Batmanghelich K (2020) Explanation by progressive exaggeration. In: ICLR, OpenReview.net
  118. Srikanth S, Ansari JA, R KR, Sharma S, Murthy JK, Krishna KM (2019) INFER: intermediate represen- tations for future prediction. In: IROS
  119. Sun Q, Ma L, Oh SJ, Gool LV, Schiele B, Fritz M (2018) Natural and effective obfuscation by head inpaint- ing. In: CVPR, Computer Vision Foundation / IEEE Computer Society
  120. Sundararajan M, Taly A, Yan Q (2017) Axiomatic at- tribution for deep networks. In: ICML
  121. Suzuki T, Kataoka H, Aoki Y, Satoh Y (2018) Antici- pating traffic accidents with adaptive loss and large- scale incident DB. In: CVPR
  122. Szegedy C, Zaremba W, Sutskever I, Bruna J, Erhan D, Goodfellow IJ, Fergus R (2014) Intriguing properties of neural networks. In: ICLR
  123. Tan S, Wong K, Wang S, Manivasagam S, Ren M, Urta- sun R (2021) Scenegen: Learning to generate realistic traffic scenes. In: CVPR
  124. Thrun S, Montemerlo M, Dahlkamp H, Stavens D, Aron A, Diebel J, Fong P, Gale J, Halpenny M, Hoffmann G, et al (2006) Stanley: The robot that won the darpa grand challenge. Journal of field Robotics
  125. Tian Y, Pei K, Jana S, Ray B (2018) Deeptest: au- tomated testing of deep-neural-network-driven au- tonomous cars. In: ICSE
  126. Tjoa E, Guan C (2019) A survey on explainable artifi- cial intelligence (XAI): towards medical XAI. CoRR
  127. Tomei M, Baraldi L, Bronzin S, Cucchiara R (2021) Estimating (and fixing) the effect of face obfuscation in video recognition. In: CVPR Workshops
  128. Toromanoff M, Wirbel É, Moutarde F (2020) End-to- end model-free reinforcement learning for urban driv- ing using implicit affordances. In: CVPR
  129. Torralba A, Efros AA (2011) Unbiased look at dataset bias. In: CVPR
  130. Tran D, Bourdev LD, Fergus R, Torresani L, Paluri M (2015) Learning spatiotemporal features with 3d convolutional networks. In: ICCV
  131. Tulyakov S, Liu M, Yang X, Kautz J (2018) Mocogan: Decomposing motion and content for video genera- tion. In: CVPR
  132. Urmson C, Anhalt J, Bagnell D, Baker C, Bittner R, Clark M, Dolan J, Duggins D, Galatali T, Geyer C, et al (2008) Autonomous driving in urban environ- ments: Boss and the urban challenge. Journal of Field Robotics
  133. Vedantam R, Zitnick CL, Parikh D (2015) Cider: Consensus-based image description evaluation. In: CVPR
  134. Vilone G, Longo L (2020) Explainable artificial intelli- gence: a systematic review. CoRR
  135. Wachter S, Mittelstadt BD, Russell C (2017) Counter- factual explanations without opening the black box: Automated decisions and the GDPR. CoRR
  136. Wang D, Devin C, Cai Q, Yu F, Darrell T (2019) Deep object-centric policies for autonomous driving. In: ICRA
  137. Wojek C, Walk S, Roth S, Schiele B (2011) Monoc- ular 3d scene understanding with explicit occlusion reasoning. In: CVPR
  138. Wojek C, Walk S, Roth S, Schindler K, Schiele B (2013) Monocular visual scene understanding: Understand- ing multi-object traffic scenes. TPAMI
  139. Xie N, Ras G, van Gerven M, Doran D (2020) Explain- able deep learning: A field guide for the uninitiated. CoRR
  140. Xu H, Saenko K (2016) Ask, attend and answer: Ex- ploring question-guided spatial attention for visual question answering. In: ECCV
  141. Xu H, Gao Y, Yu F, Darrell T (2017) End-to-end learn- ing of driving models from large-scale video datasets. In: CVPR
  142. Xu K, Ba J, Kiros R, Cho K, Courville AC, Salakhutdi- nov R, Zemel RS, Bengio Y (2015) Show, attend and tell: Neural image caption generation with visual at- tention. In: ICML
  143. Xu Y, Yang X, Gong L, Lin H, Wu T, Li Y, Vasconcelos N (2020) Explainable object-induced action decision for autonomous vehicles. In: CVPR
  144. Yang Z, He X, Gao J, Deng L, Smola AJ (2016) Stacked attention networks for image question answering. In: CVPR
  145. Yang Z, Manivasagam S, Liang M, Yang B, Ma W, Urtasun R (2020) Recovering and simulating pedes- trians in the wild. CoRL You T, Han B (2020) Traffic accident benchmark for causality recognition. In: ECCV
  146. Yu F, Chen H, Wang X, Xian W, Chen Y, Liu F, Mad- havan V, Darrell T (2020) BDD100K: A diverse driv- ing dataset for heterogeneous multitask learning. In: CVPR
  147. Zahavy T, Ben-Zrihem N, Mannor S (2016) Graying the black box: Understanding dqns. In: ICML
  148. Zeiler MD, Fergus R (2014) Visualizing and under- standing convolutional networks. In: ECCV
  149. Zellers R, Bisk Y, Farhadi A, Choi Y (2019) From recog- nition to cognition: Visual commonsense reasoning. In: CVPR
  150. Zeng K, Chou S, Chan F, Niebles JC, Sun M (2017) Agent-centric risk assessment: Accident anticipation and risky region localization. In: CVPR
  151. Zeng W, Luo W, Suo S, Sadat A, Yang B, Casas S, Ur- tasun R (2019) End-to-end interpretable neural mo- tion planner. In: CVPR
  152. Zhang H, Geiger A, Urtasun R (2013) Understanding high-level semantics by modeling traffic patterns. In: ICCV
  153. Zhang Q, Cao R, Shi F, Wu YN, Zhu S (2018a) Inter- preting CNN knowledge via an explanatory graph. In: AAAI
  154. Zhang Q, Wu YN, Zhu S (2018b) Interpretable convo- lutional neural networks. In: CVPR
  155. Zhang Q, Yang XJ, Robert LP (2020) Expectations and trust in automated vehicles. In: CHI
  156. Zhao B, Yin W, Meng L, Sigal L (2020) Layout2image: Image generation from layout. IJCV
  157. Zhou B, Khosla A, Lapedriza À, Oliva A, Torralba A (2015a) Object detectors emerge in deep scene cnns. In: ICLR
  158. Zhou B, Khosla A, Lapedriza À, Oliva A, Torralba A (2015b) Object detectors emerge in deep scene cnns. In: ICLR
  159. Zhou B, Khosla A, Lapedriza À, Oliva A, Torralba A (2016) Learning deep features for discriminative lo- calization. In: CVPR

Cited by

Sorted by citations

Metadata

Authors
Zablocki, É., Ben-Younes, H., Pérez, P., & Cord, M.
Affiliations
Valeo (France) (FR)
Corresponding author
Zablocki, Éloi
ORCID
Venue
arXiv
Publisher
arXiv
Published
2021
Volume
130
Issue
10
Pages
2425-2452
ISSN
0920-5691 (ISSN-L)
DOI
10.48550/arxiv.2101.05307
arXiv
2101.05307
OpenAlex
W4290375100
Cited by
227
References
0
Citations by year
2026: 41 · 2025: 58 · 2024: 69 · 2023: 41 · 2022: 16 · 2021: 2
FWCI
15.13
Type
journal article
Language
en
Open access
Licence
Locations
  • International Journal of Computer Vision (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
  • HAL (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
Keywords
explainability, autonomous driving, behavior cloning, explainable AI, interpretability, post-hoc explanation, black-box models, safety-critical systems

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review