Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Open accessThe DOI matches its Crossref record; 33 of the 35 references it cites were found in a registry or an index.
Abstract
Deep neural networks (DNNs) have recently been achieving state-of-the-art performance on a variety of pattern-recognition tasks, most notably visual classification problems. Given that DNNs are now able to classify objects in images with near-human-level performance, questions naturally arise as to what differences remain between computer and human vision. A recent study [30] revealed that changing an image (e.g. of a lion) in a way imperceptible to humans can cause a DNN to label the image as something else entirely (e.g. mislabeling a lion a library). Here we show a related result: it is easy to produce images that are completely unrecognizable to humans, but that state-of-the-art DNNs believe to be recognizable objects with 99.99% confidence (e.g. labeling with certainty that white noise static is a lion). Specifically, we take convolutional neural networks trained to perform well on either the ImageNet or MNIST datasets and then find images with evolutionary algorithms or gradient ascent that DNNs label with high confidence as belonging to each dataset class. It is possible to produce images totally unrecognizable to human eyes that DNNs believe with near certainty are familiar objects, which we call “fooling images” (more generally, fooling examples). Our results shed light on interesting differences between human vision and current DNNs, and raise questions about the generality of DNN computer vision.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, some AI weaknesses have proved surprisingly difficult to solve, such as AI being easily fooled41,42 and overconfidently wrong (hallucinations)43, although progress has been made44,45.”
From Towards end-to-end automation of AI research (2026) · cites this paper as [41]
In the citing paper
“Divergence between epistemic standards seems entirely legitimate, for instance, given widespread debates about the soundness and robustness of machine learning models”
From Algorithmic Accountability and Public Reason (2018) · cites this paper as Nguyen, Yosinski, & Clune, 2015
In the citing paper
“This simply implies that domestic legislation must serve as the principal source for the substantive law relating to the use of AI in space [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“Liability under the space law treaty regime is grounded in Outer Space Treaty (OST) Article VIII, which is the genesis of the Liability Convention [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“There are no international or space treaties that address or regulate the use of AI in space.”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Multi-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 17,323
(2010) · International Conference on Machine Learning · Cited by 13,995
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Research works printed but not linked: 2
- erhan, 2009, Visualizing higher-layer features of a deep network, Dept IRO Universite de Montreal Tech Rep
- mouret, 2010, Sferes v2: Evolvin'in the multi-core world, Evolutionary Computation (CEC) 2010 IEEE Congress on, 4079
Cited by
Items 401–500 of 1,015
Prahs, P., Radeck, V. M. M., Mayer, C. S., Cvetkov, Y., Cvetkova, N., Helbig, H., & Märker, D. (2017) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-017-3839-y · Cited by 118
Structure and performance of fully connected neural networks: Emerging complex network properties
Scabini, L. F. D. S., & Bruno, O. M. (2023) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2023.128585 · Cited by 118
An uncertainty-informed framework for trustworthy fault diagnosis in safety-critical applications
Zhou, T., Zhang, L., Han, T., Droguett, E. L., Mosleh, A., & Chan, F. T. S. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.108865 · Cited by 118
Constructing Unrestricted Adversarial Examples with Generative Models
Song, Y., Shu, R., Kushman, N., & Ermon, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07894 · Cited by 117
On the Limitation of Convolutional Neural Networks in Recognizing Negative Images
Hosseini, H., Xiao, B., Jaiswal, M., & Poovendran, R. (2017) · 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2017.0-136 · Cited by 117
Improving Automatic Polyp Detection Using CNN by Exploiting Temporal Dependency in Colonoscopy Video
Qadir, H. A., Balasingham, I., Solhusvik, J., Bergsland, J., Aabakken, L., & Shin, Y. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2907434 · Cited by 117
A comparative review on deep learning models for text classification
Zulqarnain, M., Ghazali, R., Hassim, Y. M. M., & Rehan, M. (2020) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v19.i1.pp325-335 · Cited by 117
Towards end-to-end automation of AI research
Lu, C., Lu, C., Lange, R. T., Yamada, Y., Hu, S., Foerster, J., Ha, D., & Clune, J. (2026) · Nature · doi:10.1038/s41586-026-10265-5 · Cited by 116
“However, some AI weaknesses have proved surprisingly difficult to solve, such as AI being easily fooled 41,42 and overconfidently wrong (hallucinations) 43 , although progress has been made 44,45 .”
Self-citationJacob, G., Pramod, R. T., Katti, H., & Arun, S. P. (2021) · Nature Communications · doi:10.1038/s41467-021-22078-3 · Cited by 116
Sequence to Better Sequence: Continuous Revision of Combinatorial Structures.
Mueller, J. W., Gifford, D. K., & Jaakkola, T. (2017) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 116
Pereira, S., Meier, R., McKinley, R., Wiest, R., Alves, V., Silva, C. A., & Reyes, M. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.12.009 · Cited by 116
Deep Residual Flow for Out of Distribution Detection
Zisselman, E., & Tamar, A. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01401 · Cited by 116
Provable Guarantees for Understanding Out-of-Distribution Detection
Morteza, P., & Li, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20752 · Cited by 115
Depth Uncertainty in Neural NetworksPreprint
Antorán, J., Allingham, J. U., & Hernández-Lobato, J. M. (2020) · arXiv (Cornell University) · doi:10.17863/cam.69875 · Cited by 115
Tackling prediction uncertainty in machine learning for healthcare
Chua, M., Kim, D., Choi, J., Lee, N. G., Deshpande, V., Schwab, J., Lev, M. H., Gonzalez, R. G., Gee, M. S., & Do, S. (2022) · Nature Biomedical Engineering · doi:10.1038/s41551-022-00988-x · Cited by 114
Optimization and abstraction: a synergistic approach for analyzing neural network robustness
Anderson, G., Pailoor, S., Dillig, I., & Chaudhuri, S. (2019) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3314221.3314614 · Cited by 114
Interference Suppression Using Deep Learning: Current Approaches and Open Challenges
Oyedare, T., Shah, V. K., Jakubisin, D. J., & Reed, J. H. (2022) · IEEE Access · doi:10.1109/access.2022.3185124 · Cited by 114
Ziatdinov, M. A., Liu, Y., Kelley, K. P., Vasudevan, R. K., & Kalinin, S. V. (2022) · ACS Nano · doi:10.1021/acsnano.2c05303 · Cited by 114
Continual Learning: A Review of Techniques, Challenges, and Future Directions
Wickramasinghe, B., Saha, G., & Roy, K. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3339091 · Cited by 114
How morphological development can guide evolution
Kriegman, S., Cheney, N., & Bongard, J. (2018) · Scientific Reports · doi:10.1038/s41598-018-31868-7 · Cited by 114
(2018) · arXiv (Cornell University) · Cited by 113
Convolution by Evolution: Differentiable Pattern Producing Networks
Fernando, C., Banarse, D., Reynolds, M., Besse, F., Pfau, D., Jaderberg, M., Lanctot, M., & Wierstra, D. (2016) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2908812.2908890 · Cited by 113
Invisible Mask: Practical Attacks on Face Recognition with InfraredPreprint
Zhou, Z. G., Tang, D., Wang, X., Han, W., Liu, X., & Zhang, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04683 · Cited by 113
Scenic: a language for scenario specification and data generation
Fremont, D. J., Kim, E., Dreossi, T., Ghosh, S., Yue, X., Sangiovanni-Vincentelli, A. L., & Seshia, S. A. (2023) · Machine Learning · doi:10.1007/s10994-021-06120-5 · Cited by 112
How Organisms Come to Know the World: Fundamental Limits on Artificial General Intelligence
Roli, A., Jaeger, J., & Kauffman, S. A. (2022) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2021.806283 · Cited by 112
Differentiable Image Parameterizations
Mordvintsev, A., Pezzotti, N., Schubert, L., & Olah, C. (2018) · Distill · doi:10.23915/distill.00012 · Cited by 112
Adversarial Robustness on In- and Out-Distribution Improves Explainability
Augustin, M., Meinke, A., & Hein, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58574-7_14 · Cited by 112
Gnanasambandam, A., Sherman, A. M., & Chan, S. H. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00016 · Cited by 112
RbA: Segmenting Unknown Regions Rejected by All
Nayal, N., Yavuz, M., Henriques, J. F., & Güney, F. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00072 · Cited by 112
Recent Advances in Deep Learning: An Overview
Minar, M. R., & Naher, J. (2018) · arXiv (Cornell University) · doi:10.13140/rg.2.2.24831.10403 · Cited by 111
End-to-End Latent Fingerprint Search
Cao, K., Nguyen, D.-L., Tymoszek, C., & Jain, A. K. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2930487 · Cited by 111
A convolutional neural network based cascade reconstruction for the IceCube Neutrino Observatory
Abbasi, R., Ackermann, M., Adams, J., Aguilar, J. A., Ahlers, M., Ahrens, M., Alispach, C. M., Alves, A. A., Amin, N. M., An, R., et al. (2021) · Journal of Instrumentation · doi:10.1088/1748-0221/16/07/p07041 · Cited by 111
Fooling Vision and Language Models Despite Localization and Attention Mechanism
Xu, X., Chen, X., Liu, C., Rohrbach, A., Darrell, T., & Song, D. X. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00520 · Cited by 111
Local minima in training of neural networksPreprint
Świrszcz, G., Czarnecki, W. M., & Pascanu, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.06310 · Cited by 111
The Origins and Prevalence of Texture Bias in Convolutional Neural Networks
Hermann, K. L., Chen, T., & Kornblith, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.09071 · Cited by 110
CLIPDraw: Exploring Text-To-Drawing Synthesis Through Language-Image Encoders
Frans, K., Soros, L. B., & Witkowski, O. (2022) · neural information processing systems · doi:10.52202/068431-0376 · Cited by 110
Foundations of Trusted Autonomy
Abbass, H. A., Scholz, J., & Reid, D. J. (2018) · Studies in systems, decision and control · doi:10.1007/978-3-319-64816-3 · Cited by 110
Ranjan, A., Janai, J., Geiger, A., & Black, M. J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00249 · Cited by 109
Why is the Mahalanobis Distance Effective for Anomaly Detection?Preprint
Kamoi, R., & Kobayashi, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.00402 · Cited by 109
Discovering the elite hypervolume by leveraging interspecies correlation
Vassiliades, V., & Mouret, J.-B. (2018) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3205455.3205602 · Cited by 108
Deep Neural Networks in Computational NeurosciencePreprint
Kietzmann, T. C., McClure, P., & Kriegeskorte, N. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/133504 · Cited by 108
Machine Learning for Security in Vehicular Networks: A Comprehensive Survey
Talpur, A., & Gurusamy, M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3129079 · Cited by 107
Measuring Neural Net Robustness with Constraints
Bastani, O., Ioannou, Y., Lampropoulos, L., Vytiniotis, D., Nori, A., & Criminisi, A. (2016) · arXiv (Cornell University) · doi:10.17863/cam.26484 · Cited by 107
Yuan, X., Shu, H., Huang, W., Ye, H., Kong, X., & Zhang, F. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103644 · Cited by 107
Learning Transferable Negative Prompts for Out-of-Distribution Detection
Li, T., Pang, G., Bai, X. P., Miao, W., & Zheng, J. G. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01665 · Cited by 107
Applications of machine learning in real-time control systems: a review
Zhao, X., Sun, Y., Li, Y., Jia, N., & Xu, J. (2024) · Measurement Science and Technology · doi:10.1088/1361-6501/ad8947 · Cited by 107
Raith, S., Vogel, E. P., Anees, N., Keul, C., Güth, J., Edelhoff, D., & Fischer, H. (2016) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2016.11.013 · Cited by 107
Dense Associative Memory Is Robust to Adversarial Inputs
Krotov, D., & Hopfield, J. (2018) · Neural Computation · doi:10.1162/neco_a_01143 · Cited by 106
“These are the rubbish minima of [2].”
BackgroundResultInfluentialControversial stimuli: Pitting neural networks against each other as models of human cognition
Golan, T., Raju, P. C., & Kriegeskorte, N. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912334117 · Cited by 106
Input Prioritization for Testing Neural Networks
Byun, T., Sharma, V., Vijayakumar, A., Rayadurgam, S., & Cofer, D. D. (2019) · IEEE International Conference on Artificial Intelligence Testing (AITest) · doi:10.1109/aitest.2019.000-6 · Cited by 106
Artificial Intelligence in Clinical Neuroscience: Methodological and Ethical Challenges
Ienca, M., & Ignatiadis, K. (2020) · AJOB Neuroscience · doi:10.1080/21507740.2020.1740352 · Cited by 106
Federated Learning with Privacy-preserving and Model IP-right-protection
Yang, Q., Huang, A., Fan, L., Chan, C. S., Lim, J. H., Ng, K. W., Ong, D. S., & Li, B. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1343-2 · Cited by 106
A Transfer Residual Neural Network Based on ResNet-50 for Detection of Steel Surface Defects
Zhang, L., Bian, Y., Jiang, P., & Zhang, F. (2023) · Applied Sciences · doi:10.3390/app13095260 · Cited by 106
Data Augmentation for Deep Neural Networks Model in EEG Classification Task: A Review
He, C., Liu, J., Zhu, Y., & Du, W. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.765525 · Cited by 105
“One promising approach is regularization (Yu et al., 2008; Xie et al., 2015), which could effectively improve the generalization ability and robustness for DNNs.”
BackgroundInfluentialAdministration by Algorithm? Public Management Meets Public Sector Machine Learning
Veale, M., & Brass, I. (2019) · Algorithmic Regulation · doi:10.1093/oso/9780198838494.003.0006 · Cited by 105
Perfectly parallel fairness certification of neural networks
Urban, C., Christakis, M., Wüstholz, V., & Zhang, F. (2020) · Proceedings of the ACM on Programming Languages · doi:10.1145/3428253 · Cited by 105
Towards neural networks that provably know when they don't knowPreprint
Meinke, A., & Hein, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.12180 · Cited by 105
A Survey on Gradient Inversion: Attacks, Defenses and Future Directions
Zhang, R., Guo, S., Wang, J., Xie, X. N., & Tao, D. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/791 · Cited by 104
A System-Driven Taxonomy of Attacks and Defenses in Adversarial Machine Learning
Sadeghi, K., Banerjee, A., & Gupta, S. K. S. (2020) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2020.2968933 · Cited by 103
Wang, S., Mo, B., Zheng, Y., Hess, S., & Zhao, J. (2024) · Transportation Research Part B Methodological · doi:10.1016/j.trb.2024.103061 · Cited by 103
Adversarial deep learning against intrusion detection classifiers
Rigaki, M. (2017) · DiVA (Luleå University of Technology) · Cited by 103
A 3-D Atrous Convolution Neural Network for Hyperspectral Image Denoising
Liu, W., & Lee, J. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2901737 · Cited by 102
Privacy Intelligence: A Survey on Image Privacy in Online Social Networks
Liu, C., Zhu, T., Zhang, J., & Zhou, W. (2022) · ACM Computing Surveys · doi:10.1145/3547299 · Cited by 102
A systematic survey of attack detection and prevention in Connected and Autonomous Vehicles
Limbasiya, T., Teng, K. Z., Chattopadhyay, S., & Zhou, J. (2022) · Vehicular Communications · doi:10.1016/j.vehcom.2022.100515 · Cited by 102
Nguyen, G., Kim, D., & Nguyen, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.14944 · Cited by 102
Self-citationReinforcement Learning for Autonomous Defence in Software-Defined Networking
Han, Y., Rubinstein, B. I. P., Abraham, T., Alpcan, T., de Vel, O. Y., Erfani, S., Hubczenko, D., Leckie, C. A., & Montague, P. S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01554-1_9 · Cited by 101
Li, J., Liu, J., Yang, P., Chen, L., Huang, X., & Zhang, L. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32304-2_15 · Cited by 101
Out-of-Distribution Detection for Automotive Perception
Nitsch, J., Itkina, M., Senanayake, R., Nieto, J. I., Schmidt, M. T., Siegwart, R., Kochenderfer, M. J., & Cadena, C. (2021) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc48978.2021.9564545 · Cited by 101
On the Impact of Spurious Correlation for Out-of-Distribution Detection
Ming, Y., Yin, H., & Li, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i9.21244 · Cited by 101
On denoising autoencoders trained to minimise binary cross-entropyPreprint
Creswell, A., Arulkumaran, K., & Bharath, A. A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.08487 · Cited by 101
DeepFool: a simple and accurate method to fool deep neural networks
Moosavi-Dezfooli, S.-M., Fawzi, A., & Pascal Frossard, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.04599 · Cited by 100
Application of artificial intelligence in ophthalmology
(2018) · International Journal of Ophthalmology · doi:10.18240/ijo.2018.09.21 · Cited by 100
Decoupling MaxLogit for Out-of-Distribution Detection
Zhang, Z., & Xiang, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00330 · Cited by 100
Out-of-distribution Detection in Classifiers via GenerationPreprint
Vernekar, S., Gaurav, A., Abdelzad, V., Denouden, T. A., Salay, R., & Czarnecki, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.04241 · Cited by 100
A Control Strategy of Autonomous Vehicles Based on Deep Reinforcement Learning
Xia, W., Li, H., & Li, B. (2016) · International Symposium on Computational Intelligence and Design · doi:10.1109/iscid.2016.2054 · Cited by 99
MSCryptoNet: Multi-Scheme Privacy-Preserving Deep Learning in Cloud Computing
Kwabena, O.-A., Qin, Z., Zhuang, T., & Qin, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2901219 · Cited by 99
Kuo, C. ‐. J., & Chen, Y. (2017) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2017.11.023 · Cited by 99
Lu, Y., Chen, Y., Zhao, D., Liu, B., Lai, Z., & Chen, M. (2020) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.2998497 · Cited by 99
Cui, K., Li, R., Polk, S. L., Lin, Y., Zhang, H., Murphy, J. M., Plemmons, R. J., & Chan, R. H. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3385202 · Cited by 99
Adversarial Attacks Against Medical Deep Learning Systems
Finlayson, S. G., Chung, H. W., Kohane, I. S., & Beam, A. L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.05296 · Cited by 98
Sample-level Deep Convolutional Neural Networks for Music Auto-tagging Using Raw Waveforms
Lee, J., Park, J. Y., Kim, K. L., & Nam, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01789 · Cited by 98
Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-Based Recruitment
Peña, A., Serna, I., Morales, A., Fiérrez, J., Ortega, A., Sánchez, A. H., Saéz, M. A., & Ortega-García, J. (2023) · SN Computer Science · doi:10.1007/s42979-023-01733-0 · Cited by 98
Deep generative-contrastive networks for facial expression recognitionPreprint
Kim, Y., Yoo, B., Kwak, Y., Choi, C., & Kim, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07140 · Cited by 98
Artificial intelligence in medicine and the disclosure of risks
Kiener, M. (2021) · AI & SOCIETY · doi:10.1007/s00146-020-01085-w · Cited by 97
Rechkemmer, A., & Yin, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501967 · Cited by 97
“learning community that the raw confidence scores produced by an ML model can be poorly calibrated [25, 33, 42].”
BackgroundControlling gene expression with deep generative design of regulatory DNA
Zrimec, J., Fu, X., Muhammad, A. S., Skrekas, C., Jauniskis, V., Speicher, N. K., Börlin, C. S., Verendel, V., Chehreghani, M. H., Dubhashi, D., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-32818-8 · Cited by 97
Adversarial Example Detection Using Latent Neighborhood Graph
Abusnaina, A., Wu, Y., Arora, S. S., Wang, Y., Wang, F., Yang, H., & Mohaisen, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00759 · Cited by 97
Coloring Molecules with Explainable Artificial Intelligence for Preclinical Relevance Assessment
Jiménez-Luna, J., Skalic, M., Weskamp, N., & Schneider, G. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c01344 · Cited by 96
A Survey of Deep Learning Applications to Autonomous Vehicle Control
Kuutti, S., Bowden, R., Jin, Y., Barber, P., & Fallah, S. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2962338 · Cited by 96
Inkawhich, N., Liang, K. J., Wang, B., Inkawhich, M. J., Carin, L., & Chen, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.14861 · Cited by 96
Li, X., Fang, J., & Li, H. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.05.008 · Cited by 95
Texture and art with deep neural networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.08.019 · Cited by 95
Deep divergence-based approach to clustering
Kampffmeyer, M., Løkse, S., Bianchi, F. M., Livi, L., Salberg, A.-B., & Jenssen, R. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.01.015 · Cited by 95
Neurlux: dynamic malware analysis without feature engineering
Jindal, C., Salls, C., Aghakhani, H., Long, K., Kruegel, C., & Vigna, G. (2019) · Annual Computer Security Applications Conference · doi:10.1145/3359789.3359835 · Cited by 95
Toward Interpretable Machine Learning: Transparent Deep Neural Networks and BeyondPreprint
Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Müller, K. (2020) · arXiv (Cornell University) · Cited by 95
Bayesian Deep Learning via Subnetwork InferencePreprint
Daxberger, E., Nalisnick, E., Allingham, J. U., Antorán, J., & Hernández-Lobato, J. M. (2020) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.2010.14689 · Cited by 95
Boon, I. S., Yong, T. P. T. A., & Boon, C. S. (2018) · Medicines · doi:10.3390/medicines5040131 · Cited by 94
Adversarial Examples for CNN-Based SAR Image Classification: An Experience Study
Li, H., Huang, H., Chen, L., Peng, J., Huang, H., Cui, Z., Mei, X., & Wu, G. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3038683 · Cited by 94
Schwarzer, M., Rogan, B., Ruan, Y., Song, Z., Lee, D. Y., Percus, A. G., Chau, V. T., Moore, B. A., Rougier, E., Viswanathan, H., et al. (2019) · Computational Materials Science · doi:10.1016/j.commatsci.2019.02.046 · Cited by 94
Global Model Interpretation Via Recursive Partitioning
Yang, C., Rangarajan, A., & Ranka, S. (2018) · 2018 IEEE 20th International Conference on High Performance Computing and Communications; IEEE 16th International Conference on Smart City; IEEE 4th International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc/smartcity/dss.2018.00256 · Cited by 93
Metadata
- Authors
- Nguyen, A., Yosinski, J., & Clune, J.
- Affiliations
- University of Wyoming (US)
- Cornell University (US)
- ORCID
- Clune, Jeff
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 427-436
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1932198206
- Cited by
- 3,258
- References
- 35
- Citations by year
- 2026: 73 · 2025: 210 · 2024: 313 · 2023: 323 · 2022: 318 · 2021: 460 · 2020: 401 · 2019: 407 · 2018: 348 · 2017: 211 · 2016: 124 · 2015: 60
- FWCI
- 139.54
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Aeronautics and Space Administration
- University of Wyoming
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- deep neural network robustness, adversarial examples, evolutionary algorithms, gradient ascent, ImageNet, MNIST, visual categorization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.