Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Open accessThe DOI matches its Crossref record; 33 of the 35 references it cites were found in a registry or an index.
Abstract
Deep neural networks (DNNs) have recently been achieving state-of-the-art performance on a variety of pattern-recognition tasks, most notably visual classification problems. Given that DNNs are now able to classify objects in images with near-human-level performance, questions naturally arise as to what differences remain between computer and human vision. A recent study [30] revealed that changing an image (e.g. of a lion) in a way imperceptible to humans can cause a DNN to label the image as something else entirely (e.g. mislabeling a lion a library). Here we show a related result: it is easy to produce images that are completely unrecognizable to humans, but that state-of-the-art DNNs believe to be recognizable objects with 99.99% confidence (e.g. labeling with certainty that white noise static is a lion). Specifically, we take convolutional neural networks trained to perform well on either the ImageNet or MNIST datasets and then find images with evolutionary algorithms or gradient ascent that DNNs label with high confidence as belonging to each dataset class. It is possible to produce images totally unrecognizable to human eyes that DNNs believe with near certainty are familiar objects, which we call “fooling images” (more generally, fooling examples). Our results shed light on interesting differences between human vision and current DNNs, and raise questions about the generality of DNN computer vision.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, some AI weaknesses have proved surprisingly difficult to solve, such as AI being easily fooled41,42 and overconfidently wrong (hallucinations)43, although progress has been made44,45.”
From Towards end-to-end automation of AI research (2026) · cites this paper as [41]
In the citing paper
“Divergence between epistemic standards seems entirely legitimate, for instance, given widespread debates about the soundness and robustness of machine learning models”
From Algorithmic Accountability and Public Reason (2018) · cites this paper as Nguyen, Yosinski, & Clune, 2015
In the citing paper
“This simply implies that domestic legislation must serve as the principal source for the substantive law relating to the use of AI in space [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“Liability under the space law treaty regime is grounded in Outer Space Treaty (OST) Article VIII, which is the genesis of the Liability Convention [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“There are no international or space treaties that address or regulate the use of AI in space.”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Multi-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 17,323
(2010) · International Conference on Machine Learning · Cited by 13,995
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Research works printed but not linked: 2
- erhan, 2009, Visualizing higher-layer features of a deep network, Dept IRO Universite de Montreal Tech Rep
- mouret, 2010, Sferes v2: Evolvin'in the multi-core world, Evolutionary Computation (CEC) 2010 IEEE Congress on, 4079
Cited by
Items 601–700 of 1,015
Guha Roy, A., Ren, J., Azizi, S., Loh, A., Natarajan, V., Mustafa, B., Pawlowski, N., Freyberg, J., Liu, Y., Beaver, Z., et al. (2022) · Medical Image Analysis · doi:10.1016/j.media.2021.102274 · Cited by 77
“It has been shown that deep learning models often produce over-confident predictions for OOD inputs (Goodfellow et al., 2014; Nguyen et al., 2015) suggesting that there remains room for improvement.”
BackgroundInterpretable confidence measures for decision support systems
Waa, J. V. D., Schoonderwoerd, T., Diggelen, J. V., & Neerincx, M. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102493 · Cited by 77
Universal adversarial perturbations
Moosavi-Dezfooli, S.-M., Fawzi, A., Fawzi, O., & Pascal Frossard, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.08401 · Cited by 76
AIR5: Five Pillars of Artificial Intelligence Research
Ong, Y.-S., & Gupta, A. (2019) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2019.2928344 · Cited by 76
RL-Duet: Online Music Accompaniment Generation Using Deep Reinforcement Learning
Jiang, N., Jin, S., Duan, Z., & Zhang, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5413 · Cited by 76
Smith, G. (2020) · Journal of Information Technology · doi:10.1177/0268396220915600 · Cited by 76
Kubik, C., Knauer, S. M., & Groche, P. (2021) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-021-01789-w · Cited by 76
Efficient disease detection in gastrointestinal videos – global features versus neural networks
Pogorelov, K., Riegler, M. A., Eskeland, S. L., de Lange, T., Johansen, D., Griwodz, C., Schmidt, P. T., & Halvorsen, P. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-4989-y · Cited by 76
Robust Training under Linguistic Adversity
Li, Y., Cohn, T., & Baldwin, T. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2004 · Cited by 76
Experimental methods in chemical engineering: Artificial neural networks–ANNs
Panerati, J., Schnellmann, M. A., Patience, C. A., Beltrame, G., & Patience, G. S. (2019) · The Canadian Journal of Chemical Engineering · doi:10.1002/cjce.23507 · Cited by 76
Performance Evaluation of Deep Learning Tools in Docker Containers
Xu, P., Shi, S., & Chu, X. (2017) · International Conference on Big Data Computing and Communications (BigCom) · doi:10.1109/bigcom.2017.32 · Cited by 76
Deep learning for geometric and semantic tasks in photogrammetry and remote sensing
Heipke, C., & Rottensteiner, F. (2020) · Geo-spatial Information Science · doi:10.1080/10095020.2020.1718003 · Cited by 76
Hsu, C.-Y., & Li, W. (2023) · International Journal of Geographical Information Science · doi:10.1080/13658816.2023.2191256 · Cited by 75
ES Attack: Model Stealing Against Deep Neural Networks Without Data Hurdles
Yuan, X., Ding, L., Zhang, L., Li, X., & Wu, D. O. (2022) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3147508 · Cited by 75
Towards Interpretable Deep Neural Networks by Leveraging Adversarial Examples
Dong, Y., Bao, F., Su, H., & Zhu, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09035 · Cited by 74
Fine-grained TLS services classification with reject option
Luxemburk, J., & Čejka, T. (2022) · Computer Networks · doi:10.1016/j.comnet.2022.109467 · Cited by 74
Quality-Diversity through AI Feedback
Bradley, H., Dai, A. M., Teufel, H., Zhang, J., Oostermeijer, K., Bellagente, M., Clune, J., Stanley, K. O., Schott, G., & Lehman, J. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2310.13032 · Cited by 74
Self-citationZhang, X., Wang, C., Zhou, W., Xu, J., & Han, T. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3387481 · Cited by 74
Eigen-Distortions of Hierarchical RepresentationsPreprint
Berardino, A., Ballé, J., Laparra, V., & Simoncelli, E. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.02266 · Cited by 74
Iacucci, M., Santacroce, G., Zammarchi, I., Maeda, Y., Del Amor, R., Meseguer, P., Kolawole, B. B., Chaudhari, U., Di Sabatino, A., Danese, S., et al. (2024) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(24)00053-0 · Cited by 73
Humans can decipher adversarial images
Zhou, Z., & Firestone, C. (2019) · Nature Communications · doi:10.1038/s41467-019-08931-6 · Cited by 73
APE-GAN: Adversarial Perturbation Elimination with GAN
Shen, S., Jin, G., Gao, K., & Zhang, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05474 · Cited by 73
Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safety
Houben, S., Abrecht, S., Akila, M., Bär, A., Brockherde, F., Feifel, P., Fingscheidt, T., Gannamaneni, S. S., Ghobadi, S. E., Hammam, A., et al. (2022) · Springer eBooks · doi:10.1007/978-3-031-01233-4_1 · Cited by 73
Adversarial NLP for Social Network Applications: Attacks, Defenses, and Research Directions
Alsmadi, I. M., Ahmad, K., Nazzal, M., Alam, F., Al‐Fuqaha, A., Khreishah, A. A., & Algosaibi, A. A. (2022) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2022.3218743 · Cited by 73
An End-to-End Framework for Joint Denoising and Classification of Hyperspectral Images
Li, X., Ding, M., Gu, Y., & Pižurica, A. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3264587 · Cited by 73
Block Selection Method for Using Feature Norm in Out-of-Distribution Detection
Yu, Y., Shin, S., Lee, S., Jun, C., & Lee, K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01507 · Cited by 73
Learning to Defend by Learning to AttackPreprint
Jiang, H., Chen, Z., Shi, Y., Dai, B., & Zhao, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.01213 · Cited by 73
Variational Model Inversion AttacksPreprint
Wang, K.-C. J., Fu, Y., Li, K., Khisti, A. J., Zemel, R. S., & Makhzani, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.10787 · Cited by 73
Out-of-distribution Detection in Medical Image Analysis: A surveyPreprint
Hong, Z., Yue, Y., Chen, Y., Cong, L., Lin, H., Luo, Y., Wang, H., Wang, W., Xu, J., Yang, X., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.18279 · Cited by 73
Cross-Domain Transferability of Adversarial Perturbations
Naseer, M., Khan, S. H., Khan, M. H., Khan, F. S., & Porikli, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11736 · Cited by 72
Adversarial Example Defenses: Ensembles of Weak Defenses are not Strong
He, W., Wei, J., Chen, X., Carlini, N., & Song, D. X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04701 · Cited by 72
Quantifying the resilience of machine learning classifiers used for cyber security
Katzir, Z., & Elovici, Y. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.09.053 · Cited by 72
Attacking convolutional neural network using differential evolution
Su, J., Vargas, D. V., & Sakurai, K. (2019) · IPSJ Transactions on Computer Vision and Applications · doi:10.1186/s41074-019-0053-3 · Cited by 72
Role of deep learning in infant brain MRI analysis
Mostapha, M., & Styner, M. A. (2019) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2019.06.009 · Cited by 72
Analyse de données géométriques, au delà des convolutions
Feydy, J. (2020) · theses.fr (ABES) · doi:10.70675/e788178aze133z4951zb8b4zf9614c9e629c · Cited by 71
TrojDRL: Evaluation of Backdoor Attacks on Deep Reinforcement Learning
Kiourti, P., Wardega, K., Jha, S., & Li, W. (2020) · 2020 57th ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18072.2020.9218663 · Cited by 70
CarePre: An Intelligent Clinical Decision Assistance System
Jin, Z., Cui, S., Guo, S., Gotz, D., Sun, J., & Cao, N. (2020) · ACM Transactions on Computing for Healthcare · doi:10.1145/3344258 · Cited by 70
A review of data-driven modelling in drinking water treatment
Aliashrafi, A., Zhang, Y., Groenewegen, H., & Peleato, N. M. (2021) · Reviews in Environmental Science and Bio/Technology · doi:10.1007/s11157-021-09592-y · Cited by 70
Learning with Mixture of Prototypes for Out-of-Distribution Detection
Lu, H., Gong, D., Wang, S., Xue, J., Yao, L., & Moore, K. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2402.02653 · Cited by 70
Malware Images Classification Using Convolutional Neural Network
Kabanga, E. K., & Kim, C. (2017) · Journal of Computer and Communications · doi:10.4236/jcc.2018.61016 · Cited by 70
On the Robustness of Deep K-Nearest Neighbors
Sitawarin, C., & Wagner, D. (2019) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw.2019.00014 · Cited by 70
Explaining Image Classifiers by Removing Input Features Using Generative Models
Agarwal, C., & Nguyen, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69544-6_7 · Cited by 70
Self-citationTuning Convolutional Spiking Neural Network With Biologically Plausible Reward Propagation
Zhang, T., Jia, S., Cheng, X., & Xu, B. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3085966 · Cited by 70
Adversarial Examples - A Complete Characterisation of the PhenomenonPreprint
Serban, A. C., Poll, E., & Visser, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.01185 · Cited by 70
Can multi-label classification networks know what they don't know?Preprint
Wang, H., Liu, W., Bocchieri, A. E., & Li, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.14162 · Cited by 70
Analyzing the Robustness of Open-World Machine Learning
Sehwag, V., Bhagoji, A. N., Song, L., Sitawarin, C., Cullina, D., Chiang, M., & Mittal, P. (2019) · Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3338501.3357372 · Cited by 69
PsyPhy: A Psychophysics Driven Evaluation Framework for Visual Recognition
RichardWebster, B., Anthony, S. E., & Scheirer, W. J. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2849989 · Cited by 69
Representation and Computation in Cognitive Models
Forbus, K. D., Liang, C., & Rabkina, I. (2017) · Topics in Cognitive Science · doi:10.1111/tops.12277 · Cited by 69
Computational Neuroscience: Mathematical and Statistical Perspectives
Kass, R. E., Amari, S., Arai, K., Brown, E. N., Diekman, C. O., Diesmann, M., Doiron, B., Eden, U. T., Fairhall, A. L., Fiddyment, G. M., et al. (2017) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-041715-033733 · Cited by 69
Autoencoder Based Image Compression: Can the Learning be Quantization Independent?
Dumas, T., Roumy, A., & Guillemot, C. M. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462263 · Cited by 69
Zheng, S., Chen, S., Yang, L., Zhu, J., Luo, Z., Hu, J., & Yang, X. (2018) · IEEE Access · doi:10.1109/access.2018.2872769 · Cited by 69
Improving variational autoencoder with deep feature consistent and generative adversarial training
Hou, X., Sun, K., Shen, L., & Qiu, G. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.03.013 · Cited by 69
Defending against Backdoor Attack on Deep Neural NetworksPreprint
Cheng, H., Xu, K., Liu, S., Chen, P., Zhao, P., & Lin, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.12162 · Cited by 69
Applications and Challenges of Artificial Intelligence in Space Missions
Oche, P. A., Ewa, G. A., & Ibekwe, N. (2024) · IEEE Access · doi:10.1109/access.2021.3132500 · Cited by 68
“For instance, if a robot‘s vision system (object detection) is fooled by data outside of its training data distribution [244], the consequences of acting on false but high-confidence detections can be disastrous.”
BackgroundBackground Data Resampling for Outlier-Aware Classification
Li, Y., & Vasconcelos, N. M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01323 · Cited by 68
Besnier, V., Bursuc, A., Picard, D., & Briot, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01541 · Cited by 68
Explainability and white box in drug discovery
Kırboğa, K. K., Abbasi, S. W., & Küçüksille, E. U. (2023) · Chemical Biology & Drug Design · doi:10.1111/cbdd.14262 · Cited by 68
Choi, S., Cho, S. I., Jung, W., Lee, T., Choi, S. J., Song, S., Park, G., Park, S., Ma, M., Pereira, S., et al. (2023) · npj Breast Cancer · doi:10.1038/s41523-023-00577-4 · Cited by 68
A survey of practical adversarial example attacks
Sun, L., Tan, M., & Zhou, Z. G. (2018) · Cybersecurity · doi:10.1186/s42400-018-0012-9 · Cited by 68
Deep Learning for Detecting Building Defects Using Convolutional Neural NetworksPreprint
Perez, H., Tah, J. H. M., & Mosavi, A. (2019) · Preprints.org · doi:10.20944/preprints201908.0068.v1 · Cited by 68
Learning Privacy Preserving Encodings Through Adversarial Training
Pittaluga, F., Koppal, S., & Chakrabarti, A. (2019) · 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2019.00089 · Cited by 67
Mohamed, E., Sirlantzis, K., & Howells, G. (2022) · Displays · doi:10.1016/j.displa.2022.102239 · Cited by 67
Deep Learning for Cognitive Neuroscience
Storrs, K. R., & Kriegeskorte, N. (2020) · The Cognitive Neurosciences · doi:10.7551/mitpress/11442.003.0077 · Cited by 67
The signature-testing approach to mapping biological and artificial intelligences
Taylor, A. H., Bastos, A. P. M., Brown, R. L., & Allen, C. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.06.002 · Cited by 67
Imagination Machines: A New Challenge for Artificial Intelligence
Mahadevan, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12214 · Cited by 67
MAAD-Face: A Massively Annotated Attribute Dataset for Face Images
Terhörst, P., Fährmann, D., Kolf, J. N., Damer, N., Kirchbuchner, F., & Kuijper, A. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3096120 · Cited by 67
Adversarially Robust Neural Architectures
Dong, M., Li, Y., Wang, Y., & Xu, C. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3542350 · Cited by 67
POEM: Out-of-Distribution Detection with Posterior SamplingPreprint
Ming, Y., Fan, Y., & Li, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.13687 · Cited by 67
Tellamekala, M. K., Amiriparian, S., Schuller, B. W., André, E., Giesbrecht, T., & Valstar, M. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3325770 · Cited by 66
Haj‐Hosseini, N., Lindblad, J., Hasséus, B., Kumar, V. V., Subramaniam, N., & Hirsch, J. (2022) · Journal of Maxillofacial and Oral Surgery · doi:10.1007/s12663-022-01710-9 · Cited by 66
Emanuel, R. H. K., Docherty, P. D., Lunt, H., & Möller, K. (2023) · The Journal of Supercomputing · doi:10.1007/s11227-023-05441-7 · Cited by 66
Nonparametric Uncertainty Quantification for Single Deterministic Neural Network
Kotelevskii, N., Artemenkov, A., Fedyanin, K., Noskov, F., Fishkov, A., Shelmanov, A., Vazhentsev, A., Petiushko, A., & Panov, M. (2022) · neural information processing systems · doi:10.52202/068431-2631 · Cited by 66
Age and gender classification from speech and face images by jointly fine-tuned deep neural networks
Qawaqneh, Z., Mallouh, A. A., & Barkana, B. D. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.05.037 · Cited by 66
Gaier, A., Asteroth, A., & Mouret, J.-B. (2017) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3071178.3071282 · Cited by 66
Principal Component Adversarial Example
Zhang, Y., Tian, X., Li, Y., Wang, X., & Tao, D. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2975918 · Cited by 66
A Novel Multi-Branch Channel Expansion Network for Garbage Image Classification
Shi, C., Xia, R., & Wang, L. (2020) · IEEE Access · doi:10.1109/access.2020.3016116 · Cited by 66
Extreme value theory for anomaly detection – the GPD classifier
Vignotto, E., & Engelke, S. (2020) · Extremes · doi:10.1007/s10687-020-00393-0 · Cited by 66
Weakly Supervised Object Detection via Object-Specific Pixel Gradient
Shen, Y., Ji, R., Wang, C., Li, X., & Li, X. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2816021 · Cited by 65
Turing learning: a metric-free approach to inferring behavior and its application to swarms
Li, W., Gauci, M., & Groß, R. (2016) · Swarm Intelligence · doi:10.1007/s11721-016-0126-1 · Cited by 65
Capsule networks for image classification: A review
Pawan, S. J., & Rajan, J. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.08.073 · Cited by 65
Don't Knock! Rowhammer at the Backdoor of DNN Models
Tol, M. C., Islam, S., Adiletta, A., Sunar, B., & Zhang, Z. (2023) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn58367.2023.00023 · Cited by 65
A framework for the extraction of Deep Neural Networks by leveraging public dataPreprint
Pal, S., Gupta, Y., Shukla, A., Kanade, A., Shevade, S., & Ganapathy, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.09165 · Cited by 65
A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-AwarenessPreprint
Liu, J. Z., Padhy, S., Ren, J., Zi, L., Wen, Y., Jerfel, G., Nado, Z., Snoek, J., Tran, D., & Lakshminarayanan, B. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.00403 · Cited by 65
AT-GAN: An Adversarial Generator Model for Non-constrained Adversarial ExamplesPreprint
Wang, X., He, K., Song, C., Wang, L., & Hopcroft, J. E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.07793 · Cited by 65
Turner, O. C., Aeffner, F., Bangari, D. S., High, W., Knight, B., Forest, T., Cossic, B., Himmel, L. E., Rudmann, D. G., Bawa, B., et al. (2020) · Toxicologic Pathology · doi:10.1177/0192623319881401 · Cited by 64
Robustness to Adversarial Perturbations in Learning from Incomplete Data
Najafi, A., Maeda, S., Koyama, M., & Miyato, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13021 · Cited by 64
Towards Practical Verification of Machine Learning: The Case of Computer Vision Systems
Pei, K., Zhu, L., Cao, Y., Yang, J., Vondrick, C., & Jana, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.01785 · Cited by 64
Uncovering and Correcting Shortcut Learning in Machine Learning Models for Skin Cancer Diagnosis
Nauta, M., Walsh, R., Dubowski, A., & Seifert, C. (2021) · Diagnostics · doi:10.3390/diagnostics12010040 · Cited by 64
Contextual Explanation Networks
Al-Shedivat, M., Dubey, A., & Xing, E. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10301 · Cited by 64
Robust Convolutional Neural Networks under Adversarial Noise
Jin, J., Dündar, A., & Culurciello, E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06306 · Cited by 64
Interpreting Neural Networks with Nearest Neighbors
Wallace, E., Feng, S., & Boyd-Graber, J. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5416 · Cited by 64
Toward Robust Neural Image Compression: Adversarial Attack and Model Finetuning
Chen, T., & Ma, Z. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3276442 · Cited by 64
Barandas, M., Famiglini, L., Campagner, A., Folgado, D., Simão, R., Cabitza, F., & Gamboa, H. F. S. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101978 · Cited by 64
Visual Correspondence-Based Explanations Improve AI Robustness and human-AI Team Accuracy
Taesiri, M. R., Nguyen, G., & Nguyen, A. K. (2022) · neural information processing systems · doi:10.52202/068431-2485 · Cited by 64
Self-citationExploring and Exploiting Decision Boundary Dynamics for Adversarial RobustnessPreprint
Xu, Y., Sun, Y., Goldblum, M., Goldstein, T., & Huang, F. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.03015 · Cited by 64
Unrestricted Adversarial Examples
Brown, T. B., Carlini, N., Zhang, C., Olsson, C., Christiano, P. F., & Goodfellow, I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.08352 · Cited by 63
Adversarial Attack and Defense on Deep Learning for Air Transportation Communication Jamming
Liu, M., Zhang, Z., Chen, Y., Ge, J., & Zhao, N. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3262347 · Cited by 63
Trustworthiness of Autonomous Systems
Devitt, S. K. (2018) · Studies in systems, decision and control · doi:10.1007/978-3-319-64816-3_9 · Cited by 63
UnrealStereo: Controlling Hazardous Factors to Analyze Stereo Vision
Zhang, Y., Qiu, W., Chen, Q., Hu, X., & Yuille, A. (2018) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2018.00035 · Cited by 63
The Classification of Minor Gait Alterations Using Wearable Sensors and Deep Learning
Turner, A. P., & Hayes, S. C. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2900863 · Cited by 63
Metadata
- Authors
- Nguyen, A., Yosinski, J., & Clune, J.
- Affiliations
- University of Wyoming (US)
- Cornell University (US)
- ORCID
- Clune, Jeff
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 427-436
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1932198206
- Cited by
- 3,258
- References
- 35
- Citations by year
- 2026: 73 · 2025: 210 · 2024: 313 · 2023: 323 · 2022: 318 · 2021: 460 · 2020: 401 · 2019: 407 · 2018: 348 · 2017: 211 · 2016: 124 · 2015: 60
- FWCI
- 139.54
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Aeronautics and Space Administration
- University of Wyoming
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- deep neural network robustness, adversarial examples, evolutionary algorithms, gradient ascent, ImageNet, MNIST, visual categorization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.