CoChat
Sign Up
PreprintCited by 1Explainable Artificial Intelligence (XAI)Digital Media Forensic DetectionMisinformation and Its Impacts

The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.

Quantitative Metrics for Evaluating Explanations of Video DeepFake Detectors

Open access
Baldassarre, Federico, Debard, Quentin, Pontiveros, Gonzalo Fiz, Wijaya, Tri Kurniawan·2022·arXiv
DOI 10.48550/arxiv.2210.03683arXiv 2210.03683
Open this paper in CoChat — free accountOpen PDF

Abstract

The proliferation of DeepFake technology is a rising challenge in today's society, owing to more powerful and accessible generation methods. To counter this, the research community has developed detectors of ever-increasing accuracy. However, the ability to explain the decisions of such models to users is lacking behind and is considered an accessory in large-scale benchmarks, despite being a crucial requirement for the correct deployment of automated tools for content moderation. We attribute the issue to the reliance on qualitative comparisons and the lack of established metrics. We describe a simple set of metrics to evaluate the visual quality and informativeness of explanations of video DeepFake classifiers from a human-centric perspective. With these metrics, we compare common approaches to improve explanation quality and discuss their effect on both classification and explanation performance on the recent DFDC and DFD datasets.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2210.03683

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 86

  1. Samira Abnar and Willem Zuidema. Quantifying Attention Flow in Transformers. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguis- tics, pages 4190-4197, Online, July 2020. Association for Computational Linguistics. doi: 10.18653/v1/2020.acl-main.385. · DOI · Paper page
  2. Darius Afchar, Vincent Nozick, Junichi Yamagishi, and Isao Echizen. Mesonet: A compact facial video forgery detection network. In 2018 IEEE International Workshop on Information Forensics and Security (WIFS), pages 1-7. IEEE, 2018.
  3. Shruti Agarwal, Hany Farid, Yuming Gu, Mingming He, Koki Nagano, and Hao Li. Protecting World Leaders Against Deep Fakes. In IEEE Conference on Computer Vi- sion and Pattern Recognition Workshops (CVPRW), volume 1, 2019.
  4. David Alvarez Melis and Tommi Jaakkola. Towards Robust Interpretability with Self- Explaining Neural Networks. Advances in Neural Information Processing Systems, 31, 2018.
  5. Irene Amerini, Leonardo Galteri, Roberto Caldelli, and Alberto Del Bimbo. Deepfake Video Detection through Optical Flow Based CNN. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, pages 0-0, 2019.
  6. Marco Ancona, Enea Ceolini, Cengiz Öztireli, and Markus Gross. Towards better understanding of gradient-based attribution methods for Deep Neural Networks. In International Conference on Learning Representations, February 2018.
  7. Anurag Arnab, Mostafa Dehghani, Georg Heigold, Chen Sun, Mario Lučić, and Cordelia Schmid. ViViT: A Video Vision Transformer. arXiv:2103.15691 [cs], March 2021. · arXiv
  8. Sebastian Bach, Alexander Binder, Grégoire Montavon, Frederick Klauschen, Klaus- Robert Müller, and Wojciech Samek. On Pixel-Wise Explanations for Non-Linear Clas- sifier Decisions by Layer-Wise Relevance Propagation. PLOS ONE, 10(7):e0130140, July 2015. ISSN 1932-6203. doi: 10.1371/journal.pone.0130140. · DOI · Paper page
  9. Federico Baldassarre, Kevin Smith, Josephine Sullivan, and Hossein Azizpour. Explanation-Based Weakly-Supervised Learning of Visual Relations with Graph Networks. In Andrea Vedaldi, Horst Bischof, Thomas Brox, and Jan-Michael Frahm, editors, ECCV 2020, Lecture Notes in Computer Science, pages 612-630. Springer International Publishing, 2020. ISBN 978-3-030-58604-1. doi: 10.1007/ 978-3-030-58604-1_37. · DOI
  10. Alejandro Barredo Arrieta, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador Garcia, Sergio Gil-Lopez, Daniel Molina, Richard Benjamins, Raja Chatila, and Francisco Herrera. Explainable Artificial In- telligence (XAI): Concepts, taxonomies, opportunities and challenges toward respon- sible AI. Information Fusion, 58:82-115, June 2020. ISSN 1566-2535. doi: 10.1016/j.inffus.2019.12.012. · DOI · Paper page
  11. Luca Bondi, Edoardo Daniele Cannas, Paolo Bestagini, and Stefano Tubaro. Training Strategies and Data Augmentations in CNN-based DeepFake Video Detection. In 2020 IEEE International Workshop on Information Forensics and Security (WIFS), pages 1-6, December 2020. doi: 10.1109/WIFS49906.2020.9360901. · DOI
  12. Nicolò Bonettini, Edoardo Daniele Cannas, Sara Mandelli, Luca Bondi, Paolo Bestagini, and Stefano Tubaro. Video Face Manipulation Detection Through Ensemble of CNNs. In 2020 25th International Conference on Pattern Recognition (ICPR), pages 5012-5019, January 2021. doi: 10.1109/ICPR48806.2021.9412711. · DOI · Paper page
  13. Chunshui Cao, Xianming Liu, Yi Yang, Yinan Yu, Jiang Wang, Zilei Wang, Yongzhen Huang, Liang Wang, Chang Huang, Wei Xu, Deva Ramanan, and Thomas S. Huang. Look and Think Twice: Capturing Top-Down Visual Attention with Feedback Convo- lutional Neural Networks. In 2015 IEEE International Conference on Computer Vision (ICCV), pages 2956-2964, December 2015. doi: 10.1109/ICCV.2015.338. · DOI
  14. Hila Chefer, Shir Gur, and Lior Wolf. Generic Attention-Model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers. In arXiv:2103.15679 [Cs], March 2021. · arXiv
  15. Davide Coccomini, Nicola Messina, Claudio Gennaro, and Fabrizio Falchi. Combining EfficientNet and Vision Transformers for Video Deepfake Detection. arXiv:2107.02612 [cs], July 2021. · arXiv
  16. Robert T. Collins. Mean-shift blob tracking through scale space. In 2003 IEEE Com- puter Society Conference on Computer Vision and Pattern Recognition, 2003. Proceed- ings., volume 2, pages II-234. IEEE, 2003.
  17. Hao Dang, Feng Liu, Joel Stehouwer, Xiaoming Liu, and Anil K. Jain. On the detection of digital face manipulation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5781-5790, 2020.
  18. Terrance DeVries and Graham W. Taylor. Improved Regularization of Convolutional Neural Networks with Cutout. arXiv:1708.04552 [cs], November 2017. · arXiv
  19. Brian Dolhansky, Joanna Bitton, Ben Pflaum, Jikuo Lu, Russ Howes, Menglin Wang, and Cristian Canton Ferrer. The DeepFake Detection Challenge (DFDC) Dataset. arXiv:2006.07397 [cs], October 2020. · arXiv
  20. Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Syl- vain Gelly, Jakob Uszkoreit, and Neil Houlsby. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In arXiv:2010.11929 [Cs], September 2020. · arXiv
  21. Haoqi Fan, Bo Xiong, Karttikeya Mangalam, Yanghao Li, Zhicheng Yan, Jitendra Ma- lik, and Christoph Feichtenhofer. Multiscale Vision Transformers. arXiv:2104.11227 [cs], April 2021. · arXiv
  22. Ruth C. Fong and Andrea Vedaldi. Interpretable Explanations of Black Boxes by Meaningful Perturbation. In 2017 IEEE International Conference on Computer Vision (ICCV), pages 3449-3457, Venice, October 2017. IEEE. ISBN 978-1-5386-1032-9. doi: 10.1109/ICCV.2017.371. · DOI · Paper page
  23. Robert Geirhos, Patricia Rubisch, Claudio Michaelis, Matthias Bethge, Felix A. Wich- mann, and Wieland Brendel. ImageNet-trained CNNs are biased towards texture; in- creasing shape bias improves accuracy and robustness. In International Conference on Learning Representations, September 2018.
  24. Leilani H. Gilpin, David Bau, Ben Z. Yuan, Ayesha Bajwa, Michael Specter, and Lalana Kagal. Explaining Explanations: An Overview of Interpretability of Machine Learn- ing. The 5th IEEE International Conference on Data Science and Advanced Analytics (DSAA 2018)., June 2018.
  25. David Güera and Edward J. Delp. Deepfake Video Detection Using Recurrent Neural Networks. In 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pages 1-6, November 2018. doi: 10.1109/AVSS.2018. 8639163. · DOI · Paper page
  26. Niall Hurley and Scott Rickard. Comparing Measures of Sparsity. IEEE Transactions on Information Theory, 55(10):4723-4741, October 2009. ISSN 1557-9654. doi: 10. 1109/TIT.2009.2027527. · DOI
  27. Sarthak Jain and Byron C. Wallace. Attention is not Explanation. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computa- tional Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 3543-3556, Minneapolis, Minnesota, June 2019. Association for Computational Linguistics. doi: 10.18653/v1/N19-1357. · DOI
  28. Andrei Kapishnikov, Tolga Bolukbasi, Fernanda Viégas, and Michael Terry. XRAI: Better Attributions Through Regions. arXiv:1906.02825 [cs, stat], August 2019. · arXiv
  29. Tero Karras, Samuli Laine, and Timo Aila. A style-based generator architecture for generative adversarial networks. In Proceedings of the IEEE/CVF Conference on Com- puter Vision and Pattern Recognition, pages 4401-4410, 2019.
  30. Will Kay, Joao Carreira, Karen Simonyan, Brian Zhang, Chloe Hillier, Sudheen- dra Vijayanarasimhan, Fabio Viola, Tim Green, Trevor Back, Paul Natsev, Mustafa Suleyman, and Andrew Zisserman. The Kinetics Human Action Video Dataset. arXiv:1705.06950 [cs], May 2017. · arXiv
  31. Minha Kim, Shahroz Tariq, and Simon S. Woo. FReTAL: Generalizing Deepfake De- tection Using Knowledge Distillation and Representation Learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1001- 1012, 2021.
  32. Pieter-Jan Kindermans, Kristof Schütt, Klaus-Robert Müller, and Sven Dähne. Investi- gating the influence of noise and distractors on the interpretation of neural networks. In NIPS 2016 Workshop on Interpretable Machine Learning in Complex Systems, Novem- ber 2016.
  33. Kurt Koffka. Principles of Gestalt Psychology. Routledge, 2013.
  34. Alexander Kolesnikov and Christoph H. Lampert. Seed, Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentation. In ECCV (4), January 2016.
  35. Lingzhi Li, Jianmin Bao, Hao Yang, Dong Chen, and Fang Wen. Advancing High Fidelity Identity Swapping for Forgery Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5074-5083, 2020.
  36. Yuezun Li and Siwei Lyu. Exposing deepfake videos by detecting face warping arti- facts. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018.
  37. Yuezun Li, Ming-Ching Chang, and Siwei Lyu. In ictu oculi: Exposing ai created fake videos by detecting eye blinking. In 2018 IEEE International Workshop on Information Forensics and Security (WIFS), pages 1-7. IEEE, 2018.
  38. Yuezun Li, Xin Yang, Pu Sun, Honggang Qi, and Siwei Lyu. Celeb-DF: A Large- Scale Challenging Dataset for DeepFake Forensics. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3207-3216, 2020.
  39. Ilya Loshchilov and Frank Hutter. Decoupled Weight Decay Regularization. In ICLR 2019, 2019.
  40. Scott M Lundberg and Su-In Lee. A Unified Approach to Interpreting Model Pre- dictions. In Advances in Neural Information Processing Systems, volume 30.
  41. M. Masood, Marriam Nawaz, K. M. Malik, A. Javed, and Aun Irtaza. Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forward. ArXiv, 2021.
  42. Falko Matern, Christian Riess, and Marc Stamminger. Exploiting visual artifacts to ex- pose deepfakes and face manipulations. In 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW), pages 83-92. IEEE, 2019.
  43. Binny Mathew, Punyajoy Saha, Seid Muhie Yimam, Chris Biemann, Pawan Goyal, and Animesh Mukherjee. HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection. arXiv:2012.10289 [cs], December 2020. · arXiv
  44. Tim Miller. Explanation in artificial intelligence: Insights from the social sciences. Artificial Intelligence, 267:1-38, February 2019. ISSN 0004-3702. doi: 10.1016/j. artint.2018.07.007. · DOI · Paper page
  45. Sina Mohseni, Niloofar Zarei, and Eric D. Ragan. A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems. ACM Transactions on Interactive Intelligent Systems, 11(3-4):24:1-24:45, August 2021. ISSN 2160-6455. doi: 10.1145/3387166. · DOI · Paper page
  46. Grégoire Montavon, Sebastian Lapuschkin, Alexander Binder, Wojciech Samek, and Klaus-Robert Müller. Explaining nonlinear classification decisions with deep Taylor decomposition. Pattern Recognition, 65:211-222, May 2017. ISSN 0031-3203. doi: 10.1016/j.patcog.2016.11.008. · DOI · Paper page
  47. Grégoire Montavon, Wojciech Samek, and Klaus-Robert Müller. Methods for inter- preting and understanding deep neural networks. Digital Signal Processing, 73:1-15, February 2018. ISSN 1051-2004. doi: 10.1016/j.dsp.2017.10.011. · DOI · Paper page
  48. Joao C. Neves, Ruben Tolosana, Ruben Vera-Rodriguez, Vasco Lopes, Hugo Proença, and Julian Fierrez. GANprintR: Improved fakes and evaluation of the state of the art in face manipulation detection. IEEE Journal of Selected Topics in Signal Processing, 14 (5):1038-1048, 2020.
  49. Huy H. Nguyen, Fuming Fang, Junichi Yamagishi, and Isao Echizen. Multi-task Learn- ing for Detecting and Segmenting Manipulated Facial Images and Videos. In 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS), pages 1-8. IEEE, 2019.
  50. Y. Nirkin, I. Masi, A. Tran, Tal Hassner, and G. Medioni. On Face Segmentation, Face Swapping, and Face Perception. 2018 13th IEEE International Conference on Auto- matic Face & Gesture Recognition (FG 2018), 2018. doi: 10.1109/FG.2018.00024. · DOI
  51. Yuval Nirkin, Yosi Keller, and Tal Hassner. FSGAN: Subject Agnostic Face Swap- ping and Reenactment. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 7184-7193, 2019.
  52. Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, and Édouard Duchesnay. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 12(85):2825-2830, 2011. ISSN 1533-7928.
  53. Vitali Petsiuk, Abir Das, and Kate Saenko. RISE: Randomized Input Sampling for Explanation of Black-box Models. In British Machine Vision Conference (BMVC), September 2018.
  54. Samuele Pino, Mark James Carman, and Paolo Bestagini. What's wrong with this video? Comparing Explainers for Deepfake Detection. arXiv:2105.05902 [cs], May 2021. · arXiv
  55. Jiameng Pu, Neal Mangaokar, Lauren Kelly, Parantapa Bhattacharya, Kavya Sun- daram, Mobin Javed, Bolun Wang, and Bimal Viswanath. Deepfake Videos in the Wild: Analysis and Detection. arXiv:2103.04263 [cs], March 2021. · arXiv
  56. Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. "Why Should I Trust You?": Explaining the Predictions of Any Classifier. arXiv:1602.04938 [cs, stat], August 2016. · arXiv
  57. Andreas Rossler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, and Matthias Niessner. FaceForensics++: Learning to Detect Manipulated Facial Images. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 1-11, 2019.
  58. Leonid I. Rudin, Stanley Osher, and Emad Fatemi. Nonlinear total variation based noise removal algorithms. Physica D: nonlinear phenomena, 60(1-4):259-268, 1992.
  59. Wojciech Samek, Alexander Binder, Grégoire Montavon, Sebastian Lapuschkin, and Klaus-Robert Müller. Evaluating the Visualization of What a Deep Neural Network Has Learned. IEEE Transactions on Neural Networks and Learning Systems, 28(11): 2660-2673, November 2017. ISSN 2162-2388. doi: 10.1109/TNNLS.2016.2599820. · DOI · Paper page
  60. Wojciech Samek, Grégoire Montavon, Sebastian Lapuschkin, Christopher J. Anders, and Klaus-Robert Müller. Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications. Proceedings of the IEEE, 109(3):247-278, March 2021. ISSN 1558-2256. doi: 10.1109/JPROC.2021.3060483. · DOI · Paper page
  61. Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedan- tam, Devi Parikh, and Dhruv Batra. Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization. International Journal of Computer Vi- sion, 128(2):336-359, February 2020. ISSN 0920-5691, 1573-1405. doi: 10.1007/ s11263-019-01228-7. · DOI · Paper page
  62. C. E. Shannon. A mathematical theory of communication. The Bell System Technical Journal, 27(3):379-423, July 1948. ISSN 0005-8580. doi: 10.1002/j.1538-7305.1948. tb01338.x. · DOI · Paper page
  63. Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. Deep Inside Convo- lutional Networks: Visualising Image Classification Models and Saliency Maps. arXiv:1312.6034 [cs], April 2014. · arXiv
  64. Daniel Smilkov, Nikhil Thorat, Been Kim, Fernanda Viégas, and Martin Wattenberg. SmoothGrad: Removing noise by adding noise. arXiv:1706.03825 [cs, stat], June 2017. · arXiv
  65. Jost Tobias Springenberg, Alexey Dosovitskiy, Thomas Brox, and Martin A. Ried- miller. Striving for Simplicity: The All Convolutional Net. In Yoshua Bengio and Yann LeCun, editors, 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Workshop Track Proceedings, 2015.
  66. Mukund Sundararajan, Ankur Taly, and Qiqi Yan. Axiomatic Attribution for Deep Networks. arXiv:1703.01365 [cs], June 2017. · arXiv
  67. Supasorn Suwajanakorn, Steven M. Seitz, and Ira Kemelmacher-Shlizerman. Synthe- sizing Obama: Learning lip sync from audio. ACM Transactions on Graphics, 36(4): 95:1-95:13, July 2017. ISSN 0730-0301. doi: 10.1145/3072959.3073640. · DOI · Paper page
  68. Justus Thies, Michael Zollhofer, Marc Stamminger, Christian Theobalt, and Matthias Niessner. Face2Face: Real-Time Face Capture and Reenactment of RGB Videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2387-2395, 2016.
  69. Justus Thies, Michael Zollhöfer, and Matthias Nießner. Deferred neural rendering: Image synthesis using neural textures. ACM Transactions on Graphics, 38(4):66:1- 66:12, July 2019. ISSN 0730-0301. doi: 10.1145/3306346.3323035. · DOI
  70. Ruben Tolosana, Ruben Vera-Rodriguez, Julian Fierrez, Aythami Morales, and Javier Ortega-Garcia. Deepfakes and beyond: A Survey of face manipulation and fake de- tection. Information Fusion, 64:131-148, December 2020. ISSN 1566-2535. doi: 10.1016/j.inffus.2020.06.014. · DOI · Paper page
  71. Carlo Tomasi and Roberto Manduchi. Bilateral filtering for gray and color images. In Sixth International Conference on Computer Vision (IEEE Cat. No. 98CH36271), pages 839-846. IEEE, 1998.
  72. Loc Trinh, Michael Tsang, Sirisha Rambhatla, and Yan Liu. Interpretable and Trust- worthy Deepfake Detection via Dynamic Prototypes. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 1973-1983, 2021.
  73. Cristian Vaccari and Andrew Chadwick. Deepfakes and Disinformation: Exploring the Impact of Synthetic Political Video on Deception, Uncertainty, and Trust in News. Social Media + Society, 6(1):2056305120903408, January 2020. ISSN 2056-3051. doi: 10.1177/2056305120903408. · DOI · Paper page
  74. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention Is All You Need. In NIPS, December 2017.
  75. Kaili Wang, Jose Oramas, and Tinne Tuytelaars. Towards Human-Understandable Visual Explanations: Imperceptible High-frequency Cues Can Better Be Removed. arXiv:2104.07954 [cs], April 2021. · arXiv
  76. Mika Westerlund. The emergence of deepfake technology: A review. Technology Inno- vation Management Review, 9(11), 2019. ISSN 1927-0321. doi: 10.22215/timreview/ 1282. · DOI · Paper page
  77. Saining Xie, Chen Sun, Jonathan Huang, Zhuowen Tu, and Kevin Murphy. Rethinking spatiotemporal feature learning: Speed-accuracy trade-offs in video classification. In Proceedings of the European Conference on Computer Vision (ECCV), pages 305-321, 2018.
  78. Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio. Show, Attend and Tell: Neural Image Caption Generation with Visual Attention. In International Conference on Machine Learning, pages 2048-2057. PMLR, June 2015.
  79. Shawn Xu, Subhashini Venugopalan, and Mukund Sundararajan. Attribution in Scale and Space. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 9680-9689, 2020.
  80. Xin Yang, Yuezun Li, and Siwei Lyu. Exposing deep fakes using inconsistent head poses. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 8261-8265. IEEE, 2019.
  81. Changqian Yu, Changxin Gao, Jingbo Wang, Gang Yu, Chunhua Shen, and Nong Sang. Bisenet v2: Bilateral network with guided aggregation for real-time semantic segmen- tation. International Journal of Computer Vision, pages 1-18, 2021.
  82. Matthew D. Zeiler and Rob Fergus. Visualizing and Understanding Convolutional Networks. In David Fleet, Tomas Pajdla, Bernt Schiele, and Tinne Tuytelaars, edi- tors, Computer Vision -ECCV 2014, Lecture Notes in Computer Science, pages 818- 833, Cham, 2014. Springer International Publishing. ISBN 978-3-319-10590-1. doi: 10.1007/978-3-319-10590-1_53. · DOI · Paper page
  83. Kaipeng Zhang, Zhanpeng Zhang, Zhifeng Li, and Yu Qiao. Joint Face Detec- tion and Alignment Using Multitask Cascaded Convolutional Networks. IEEE Sig- nal Processing Letters, 23(10):1499-1503, October 2016. ISSN 1558-2361. doi: 10.1109/LSP.2016.2603342. · DOI · Paper page
  84. Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, and Antonio Torralba. Learning Deep Features for Discriminative Localization. arXiv:1512.04150 [cs], De- cember 2015. · arXiv
  85. Hang Zhou, Yu Liu, Ziwei Liu, Ping Luo, and Xiaogang Wang. Talking face generation by adversarially disentangled audio-visual representation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 33, pages 9299-9306, 2019.
  86. Bojia Zi, Minghao Chang, Jingjing Chen, Xingjun Ma, and Yu-Gang Jiang. WildDeep- fake: A Challenging Real-World Dataset for Deepfake Detection. arXiv:2101.01456 [cs], January 2021. · arXiv

Cited by

Sorted by citations

See all 1

Metadata

Authors
Baldassarre, F., Debard, Q., Pontiveros, G. F., & Wijaya, T. K.
Affiliations
  • KTH Royal Institute of Technology (SE)
  • Huawei Technologies (China) (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2022
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2210.03683
arXiv
2210.03683
OpenAlex
W4304195560
Cited by
1
References
1
Citations by year
2025: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
Keywords
explainable AI, explanation quality metrics, human evaluation, content moderation, DFDC, video classification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review