Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Open accessThe DOI matches its Crossref record; 33 of the 35 references it cites were found in a registry or an index.
Abstract
Deep neural networks (DNNs) have recently been achieving state-of-the-art performance on a variety of pattern-recognition tasks, most notably visual classification problems. Given that DNNs are now able to classify objects in images with near-human-level performance, questions naturally arise as to what differences remain between computer and human vision. A recent study [30] revealed that changing an image (e.g. of a lion) in a way imperceptible to humans can cause a DNN to label the image as something else entirely (e.g. mislabeling a lion a library). Here we show a related result: it is easy to produce images that are completely unrecognizable to humans, but that state-of-the-art DNNs believe to be recognizable objects with 99.99% confidence (e.g. labeling with certainty that white noise static is a lion). Specifically, we take convolutional neural networks trained to perform well on either the ImageNet or MNIST datasets and then find images with evolutionary algorithms or gradient ascent that DNNs label with high confidence as belonging to each dataset class. It is possible to produce images totally unrecognizable to human eyes that DNNs believe with near certainty are familiar objects, which we call “fooling images” (more generally, fooling examples). Our results shed light on interesting differences between human vision and current DNNs, and raise questions about the generality of DNN computer vision.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, some AI weaknesses have proved surprisingly difficult to solve, such as AI being easily fooled41,42 and overconfidently wrong (hallucinations)43, although progress has been made44,45.”
From Towards end-to-end automation of AI research (2026) · cites this paper as [41]
In the citing paper
“Divergence between epistemic standards seems entirely legitimate, for instance, given widespread debates about the soundness and robustness of machine learning models”
From Algorithmic Accountability and Public Reason (2018) · cites this paper as Nguyen, Yosinski, & Clune, 2015
In the citing paper
“This simply implies that domestic legislation must serve as the principal source for the substantive law relating to the use of AI in space [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“Liability under the space law treaty regime is grounded in Outer Space Treaty (OST) Article VIII, which is the genesis of the Liability Convention [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“There are no international or space treaties that address or regulate the use of AI in space.”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Multi-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 17,323
(2010) · International Conference on Machine Learning · Cited by 13,995
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Research works printed but not linked: 2
- erhan, 2009, Visualizing higher-layer features of a deep network, Dept IRO Universite de Montreal Tech Rep
- mouret, 2010, Sferes v2: Evolvin'in the multi-core world, Evolutionary Computation (CEC) 2010 IEEE Congress on, 4079
Cited by
Items 801–900 of 1,015
Watermarking for Out-Of-Distribution Detection
Wang, Q., Liu, T., Zhang, Y., Zhang, J., Gong, C., Liu, T., & Han, B. (2022) · neural information processing systems · doi:10.52202/068431-1131 · Cited by 50
Unifying Adversarial Training Algorithms with Data Gradient Regularization
Ororbia, A. G., Kifer, D., & Giles, C. L. (2017) · Neural Computation · doi:10.1162/neco_a_00928 · Cited by 50
Bayesian Optimization with Automatic Prior Selection for Data-Efficient Direct Policy Search
Pautrat, R., Chatzilygeroudis, K. I., & Mouret, J.-B. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8463197 · Cited by 50
Visual Graphs from Motion (VGfM): Scene Understanding with Object Geometry Reasoning
Gay, P., James, S., & Bue, A. D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20893-6_21 · Cited by 50
Alharbi, R., Tolba, M., Petito, L. C., Hester, J. D., & Alshurafa, N. I. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3351230 · Cited by 50
A feature-vector generative adversarial network for evading PDF malware classifiers
Li, Y., Wang, Y., Wang, Y., Ke, L., & Tan, Y. (2020) · Information Sciences · doi:10.1016/j.ins.2020.02.075 · Cited by 50
A New Workload Prediction Model Using Extreme Learning Machine and Enhanced Tug of War optimization
Nguyen, T., Hoang, B., Nguyen, G., & Nguyen, B. M. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.03.063 · Cited by 50
Understanding Integrated Gradients with SmoothTaylor for Deep Neural Network Attribution
Goh, G. S. W., Lapuschkin, S., Weber, L., Samek, W., & Binder, A. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9413242 · Cited by 50
A Novel Probability Confidence CNN Model and Its Application in Mechanical Fault Diagnosis
Ma, B., Cai, W., Han, Y. M., & Yu, G. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3077965 · Cited by 50
Self-Checking Deep Neural Networks in Deployment
Xiao, Y., Beschastnikh, I., Rosenblum, D. S., Sun, C., Elbaum, S. G., Lin, Y., & Dong, J. S. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00044 · Cited by 50
Zhang, P., Ren, B., Dong, H., & Dai, Q. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3124006 · Cited by 50
The Scientific Method in the Science of Machine LearningPreprint
Forde, J. Z., & Paganini, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.10922 · Cited by 50
Out-of-distribution Detection via Frequency-regularized Generative Models
Cai, M., & Li, Y. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00548 · Cited by 49
Adversarial image detection in deep neural networks
Carrara, F., Falchi, F., Caldelli, R., Amato, G. M., & Becarelli, R. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-5853-4 · Cited by 49
Hierarchical behavioral repertoires with unsupervised descriptors
Cully, A., & Demiris, Y. (2018) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3205455.3205571 · Cited by 49
Anatomical context improves deep learning on the brain age estimation task
Bermudez, C. L., Plassard, A. J., Chaganti, S., Huo, Y., Aboud, K. S., Cutting, L. E., Resnick, S. M., & Landman, B. A. (2019) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2019.06.018 · Cited by 49
Mo, X., Tan, S., Li, B., & Huang, J. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3104140 · Cited by 49
What do AI algorithms actually learn? - On false structures in deep learningPreprint
Thesing, L., Antun, V., & Hansen, A. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.01478 · Cited by 49
The perceived surveillance of conversations through smart devices
Frick, N. R. J., Wilms, K. L., Brachten, F., Hetjens, T., Stieglitz, S., & Ross, B. (2021) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2021.101046 · Cited by 48
Increasing the Interpretability of Recurrent Neural Networks Using Hidden Markov Models
Krakovna, V., & Doshi‐Velez, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05320 · Cited by 48
Yes, we GAN: Applying adversarial techniques for autonomous driving
Uřičář, M., Křížek, P., Hurych, D., Sobh, I., Yogamani, S., & Denny, P. (2019) · Electronic Imaging · doi:10.2352/issn.2470-1173.2019.15.avm-048 · Cited by 48
Artificial Intelligence: Power to the People
Roff, H. M. (2019) · Ethics & International Affairs · doi:10.1017/s0892679419000121 · Cited by 48
Evading Face Recognition via Partial Tampering of Faces
Majumdar, P., Agarwal, A., Singh, R., & Vatsa, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00008 · Cited by 48
Packed-Ensembles for Efficient Uncertainty Estimation
Laurent, O., Lafage, A., Tartaglione, E., Daniel, G., Martinez, J., Bursuc, A., & Franchi, G. (2022) · HAL · doi:10.48550/arxiv.2210.09184 · Cited by 48
Out-of-Distribution Detection with Semantic Mismatch Under Masking
Yang, Y., Gao, R., & Xu, Q. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20053-3_22 · Cited by 48
Is Fine-tuning Needed? Pre-trained Language Models Are Near Perfect for Out-of-Domain Detection
Uppaal, R., Hu, J., & Li, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.717 · Cited by 48
Srinivasan, K., Puliyanda, A., Thosar, D., Bhakte, A., Singh, K., Addo, P., Srinivasan, R., & Prasad, V. (2024) · The Canadian Journal of Chemical Engineering · doi:10.1002/cjce.25525 · Cited by 48
Li, B., Wei, Y. “., Fu, Y., Wang, Z., Li, Y., Zhang, J., Wang, R., & Zhang, T. (2025) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp61157.2025.00073 · Cited by 48
Towards Visually Explaining Video Understanding Networks with Perturbation
Li, Z., Wang, W., Li, Z., Huang, Y., & Sato, Y. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00116 · Cited by 48
From convolutional neural networks to models of higher‐level cognition (and back again)
Battleday, R. M., Peterson, J. C., & Griffiths, T. L. (2021) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14593 · Cited by 48
Learning Adversary-Resistant Deep Neural NetworksPreprint
Wang, Q., Guo, W., Zhang, K., Ororbia, A. G., Xing, X., Liu, X., & Giles, C. L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.01401 · Cited by 48
Confidence estimation in Deep Neural networks via density modellingPreprint
Subramanya, A., Srinivas, S., & Babu, R. V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.07013 · Cited by 48
A Target-Agnostic Attack on Deep Models: Exploiting Security Vulnerabilities of Transfer LearningPreprint
Rezaei, S., & Liu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04334 · Cited by 48
GAT: Generative Adversarial Training for Adversarial Example Detection and Robust ClassificationPreprint
Yin, X., Kolouri, S., & Rohde, G. K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11475 · Cited by 48
GNNInterpreter: A Probabilistic Generative Model-Level Explanation for Graph Neural NetworksPreprint
Wang, X., & Shen, H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.07924 · Cited by 48
Advancing Fusion with Machine Learning Research Needs Workshop Report
Humphreys, D., Kupresanin, A., Boyer, M. D., Canik, J., Chang, C. S., Cyr, E. C., Granetz, R., Hittinger, J., Kolemen, E., Lawrence, E., et al. (2020) · Journal of Fusion Energy · doi:10.1007/s10894-020-00258-1 · Cited by 47
Sibai, F. N. (2020) · International Conference on Cyber Security and Protection of Digital Services (Cyber Security) · doi:10.1109/cybersecurity49315.2020.9138891 · Cited by 47
Academic Emotion Classification Using FER: A Systematic Review
Lek, J. X.-Y., & Teo, J. (2023) · Human Behavior and Emerging Technologies · doi:10.1155/2023/9790005 · Cited by 47
Ethics and Transparency Issues in Digital Platforms: An Overview
Mirghaderi, L., Sziron, M., & Hildt, E. (2023) · AI · doi:10.3390/ai4040042 · Cited by 47
Improving Interpretability and Regularization in Deep Learning
Wu, C., Gales, M., Ragni, A., Karanasou, P., & Sim, K. C. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2774919 · Cited by 47
A flexible machine vision system for small part inspection based on a hybrid SVM/ANN approach
Joshi, K. D., Chauhan, V., & Surgenor, B. W. (2018) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-018-1438-3 · Cited by 47
Interpreting Deep Models for Text Analysis via Optimization and Regularization Methods
Yuan, H., Chen, Y., Hu, X., & Ji, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015717 · Cited by 47
Jia, X., Yang, J., Liu, R., Wang, X., Cotöfană, S., & Zhao, W. S. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2987760 · Cited by 47
Improving the Adversarial Robustness of NLP Models by Information Bottleneck
Zhang, C., Zhou, X. S., Wan, Y., Zheng, X., Chang, K., & Hsieh, C. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.284 · Cited by 47
Decision-Based Black-Box Attack Against Vision Transformers Via Patch-Wise Adversarial Removal
Shi, Y., Han, Y., Tan, Y., & Kuang, X. (2022) · neural information processing systems · doi:10.52202/068431-0939 · Cited by 47
Adversarial Robustness: Softmax versus Openmax
Rozsa, A., Günther, M., & Boult, T. E. (2017) · British Machine Vision Conference (BMVC) · doi:10.5244/c.31.156 · Cited by 47
Unsupervised learning of object semantic parts from internal states of CNNs by population encodingPreprint
Wang, J., Zhang, Z., Xie, C., Premachandran, V., & Yuille, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06855 · Cited by 47
Gal, Y., & Smith, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.00667 · Cited by 47
TrojDRL: Trojan Attacks on Deep Reinforcement Learning AgentsPreprint
Kiourti, P., Wardega, K., Jha, S., & Li, W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.06638 · Cited by 47
Regularizing deep networks with prior knowledge: A constraint-based approach
Roychowdhury, S., Diligenti, M., & Gori, M. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106989 · Cited by 46
Systemic Oversimplification Limits the Potential for Human-AI Partnership
Metcalfe, J. S., Perelman, B. S., Boothe, D. L., & McDowell, K. (2021) · IEEE Access · doi:10.1109/access.2021.3078298 · Cited by 46
Liu, Y., Kelley, K. P., Funakubo, H., Kalinin, S. V., & Ziatdinov, M. A. (2022) · Advanced Science · doi:10.1002/advs.202203957 · Cited by 46
Guo, L., Liu, C., Liu, Y., Lin, Y., & Gui, G. (2024) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2024.3408417 · Cited by 46
Zhu, L., Yang, Y., Xu, F., Lu, X., Shuai, M., An, Z., Chen, X., Li, H., Martin, F. L., Vikesland, P. J., et al. (2025) · Science Advances · doi:10.1126/sciadv.adp7991 · Cited by 46
Physics‐Informed, Differentiable Hydrologic Models for Capturing Unseen Extreme Events
Song, Y., Sawadekar, K., Frame, J., Pan, M., Clark, M., Knoben, W. J. M., Wood, A. W., Lawson, K., Patel, T., & Shen, C. (2026) · Water Resources Research · doi:10.1029/2025wr040414 · Cited by 46
Deep transfer learning of virtual endoluminal views for the detection of polyps in CT colonography
Näppi, J. J., Hironaka, T., Regge, D., & Yoshida, H. (2016) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2217260 · Cited by 46
Selectivity and robustness of sparse coding networks
Paiton, D. M., Frye, C. G., Lundquist, S. Y., Bowen, J. D., Zarcone, R. V., & Olshausen, B. A. (2020) · Journal of Vision · doi:10.1167/jov.20.12.10 · Cited by 46
Task-Driven Deep Image Enhancement Network for Autonomous Driving in Bad Weather
Lee, Y., Jeon, J., Ko, Y., Jeon, B., & Jeon, M. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561076 · Cited by 46
Hossain, M. T., Teng, S. W., Zhang, D., Lim, S., & Lu, G. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803787 · Cited by 46
ZhuSuan: A Library for Bayesian Deep LearningPreprint
Shi, J., Chen, J., Zhu, J., Sun, S., Luo, Y., Gu, Y., & Zhou, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.05870 · Cited by 46
Learnable Bernoulli Dropout for Bayesian Deep LearningPreprint
Boluki, S., Ardywibowo, R., Dadaneh, S. Z., Zhou, M., & Qian, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05155 · Cited by 46
Maximum Mean Discrepancy Test is Aware of Adversarial AttacksPreprint
Gao, R., Liu, F., Zhang, J., Han, B., Liu, T., Niu, G., & Sugiyama, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11415 · Cited by 46
Bayesian Variational Autoencoders for Unsupervised Out-of-Distribution Detection
Daxberger, E., & Hernández-Lobato, J. M. (2019) · arXiv · doi:10.48550/arxiv.1912.05651 · Cited by 45
“As a result, discriminative models p(y|x, θ∗) trained via MLE tend to be overconfident in their predictions, especially on OoD data [52, 27].”
BackgroundNguyen, A., Yosinski, J., & Clune, J. (2016) · Evolutionary Computation · doi:10.1162/evco_a_00189 · Cited by 45
Self-citationGrandmother cells and localist representations: a review of current thinking
Bowers, J. S. (2017) · Language Cognition and Neuroscience · doi:10.1080/23273798.2016.1267782 · Cited by 45
Multilayer Perceptron and Bayesian Neural Network-Based Elastic Implicit Full Waveform Inversion
Zhang, T., Sun, J., Trad, D. O., & Innanen, K. A. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3265657 · Cited by 45
From Machine Learning to Artificial General Intelligence: A Roadmap and Implications
Obaid, O. I. (2023) · Mesopotamian Journal of Big Data · doi:10.58496/mjbd/2023/012 · Cited by 45
Rongala, U. B., Spanne, A., Mazzoni, A., Bengtsson, F., Oddo, C. M., & Jörntell, H. (2018) · Frontiers in Cellular Neuroscience · doi:10.3389/fncel.2018.00210 · Cited by 45
Burton, S., Gauerhof, L., Sethy, B. B., Habli, I., & Hawkins, R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-26250-1_30 · Cited by 45
Learning to Generate Levels From Nothing
Bontrager, P., & Togelius, J. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619131 · Cited by 45
Defending against Universal Adversarial Patches by Clipping Feature Norms
Cheng, Y., Chen, J., Xue, Y., Liu, Y., Wan, W., Bao, J., & Ma, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01612 · Cited by 45
Generative Metric Learning for Adversarially Robust Open-world Person Re-Identification
Liu, D., Wu, L. Y., Hong, R., Ge, Z., Shen, J., Boussaïd, F., & Bennamoun, M. (2023) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3522714 · Cited by 45
A Survey on Intelligent-Reflecting-Surface-Assisted UAV Communications
Park, K.-W., Kim, H. M., & Shin, O. (2022) · Energies · doi:10.3390/en15145143 · Cited by 45
Calibrating Deep Neural Networks by Pairwise Constraints
Cheng, J., & Vasconcelos, N. M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01334 · Cited by 45
A Theoretical Framework for Robustness of (Deep) Classifiers against Adversarial ExamplesPreprint
Wang, B., Gao, J., & Qi, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00334 · Cited by 45
Security Matters: A Survey on Adversarial Machine LearningPreprint
Li, G., Zhu, P., Li, J., Yang, Z., Ning, C., & Chen, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.07339 · Cited by 45
Detecting Out-of-Distribution Examples with In-distribution Examples and Gram MatricesPreprint
Sastry, C. S., & Oore, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.12510 · Cited by 45
Contrastive Training for Improved Out-of-Distribution Detection
Winkens, J., Bunel, R., Roy, A. G., Stanforth, R., Natarajan, V., Ledsam, J. R. E., MacWilliams, P., Kohli, P., Karthikesalingam, A., Köhl, S., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05566 · Cited by 44
ShapeWorld - A new test methodology for multimodal language understanding
Kuhnle, A., & Copestake, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.04517 · Cited by 44
SAM: The Sensitivity of Attribution Methods to Hyperparameters
Bansal, N., Agarwal, C., & Nguyen, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00870 · Cited by 44
Self-citationWhat do adversarial images tell us about human vision?
Dujmović, M., Malhotra, G., & Bowers, J. S. (2020) · eLife · doi:10.7554/elife.55978 · Cited by 44
Bayesian continual learning via spiking neural networks
Skatchkovsky, N., Jang, H., & Simeone, O. (2022) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2022.1037976 · Cited by 44
Regression Fuzzing for Deep Learning Systems
You, H., Wang, Z., Chen, J., Liu, S., & Li, S. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00019 · Cited by 44
Interpretable Task-inspired Adaptive Filter Pruning for Neural Networks Under Multiple Constraints
Guo, Y., Gao, W., & Li, G. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-023-01972-x · Cited by 44
Yang, T., Qiao, Y., & Lee, B. (2024) · Computers & Security · doi:10.1016/j.cose.2024.103909 · Cited by 44
Koehler, J. (2018) · European Business & Management · doi:10.11648/j.ebm.20180402.12 · Cited by 44
Krig, S. (2014) · Apress eBooks · doi:10.1007/978-1-4302-5930-5_2 · Cited by 44
ROSA: Robust Salient Object Detection Against Adversarial Attacks
Li, H., Li, G., & Yu, Y. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2914099 · Cited by 44
A Geometry-Inspired Attack for Generating Natural Language Adversarial Examples
Zhao, M., & Wattenhofer, R. P. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.585 · Cited by 44
An Effective Baseline for Robustness to Distributional Shift
Thulasidasan, S., Thapa, S., Dhaubhadel, S., Chennupati, G., Bhattacharya, T., & Bilmes, J. (2021) · International Conference on Machine Learning and Applications · doi:10.1109/icmla52953.2021.00050 · Cited by 44
Revisiting model’s uncertainty and confidences for adversarial example detection
Aldahdooh, A., Hamidouche, W., & Déforges, O. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03373-y · Cited by 44
Wang, R., Qi, L., Shi, Y., & Gao, Y. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108987 · Cited by 44
Learning motifs and their hierarchies in atomic resolution microscopy
Dan, J., Zhao, X., Ning, S., Lu, J., Loh, K. P., He, Q., Loh, N. D., & Pennycook, S. J. (2022) · Science Advances · doi:10.1126/sciadv.abk1005 · Cited by 44
How do Different Encodings Influence the Performance of the MAP-Elites Algorithm?
Tarapore, D., Clune, J., Cully, A., & Mouret, J.-B. (2016) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2908812.2908875 · Cited by 44
Self-citationJooshin, H. K., Nangir, M., & Seyedarabi, H. (2024) · IET Image Processing · doi:10.1049/ipr2.13077 · Cited by 43
Negative results in computer vision: A perspective
Borji, A. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.10.001 · Cited by 43
An ADMM-Based Universal Framework for Adversarial Attacks on Deep Neural Networks
Zhao, P., Liu, S., Wang, Y., & Lin, X. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240639 · Cited by 43
Adversarial Attack Type I: Cheat Classifiers by Significant Changes
Tang, S., Huang, X., Chen, M., Sun, C., & Yang, J. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2936378 · Cited by 43
A Deep Learning Method to Accelerate the Disaster Response Process
Antoniou, V., & Potsiou, C. (2020) · Remote Sensing · doi:10.3390/rs12030544 · Cited by 43
Wu, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3018691 · Cited by 43
Metadata
- Authors
- Nguyen, A., Yosinski, J., & Clune, J.
- Affiliations
- University of Wyoming (US)
- Cornell University (US)
- ORCID
- Clune, Jeff
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 427-436
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1932198206
- Cited by
- 3,258
- References
- 35
- Citations by year
- 2026: 73 · 2025: 210 · 2024: 313 · 2023: 323 · 2022: 318 · 2021: 460 · 2020: 401 · 2019: 407 · 2018: 348 · 2017: 211 · 2016: 124 · 2015: 60
- FWCI
- 139.54
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Aeronautics and Space Administration
- University of Wyoming
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- deep neural network robustness, adversarial examples, evolutionary algorithms, gradient ascent, ImageNet, MNIST, visual categorization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.