Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Open accessThe DOI matches its Crossref record; 33 of the 35 references it cites were found in a registry or an index.
Abstract
Deep neural networks (DNNs) have recently been achieving state-of-the-art performance on a variety of pattern-recognition tasks, most notably visual classification problems. Given that DNNs are now able to classify objects in images with near-human-level performance, questions naturally arise as to what differences remain between computer and human vision. A recent study [30] revealed that changing an image (e.g. of a lion) in a way imperceptible to humans can cause a DNN to label the image as something else entirely (e.g. mislabeling a lion a library). Here we show a related result: it is easy to produce images that are completely unrecognizable to humans, but that state-of-the-art DNNs believe to be recognizable objects with 99.99% confidence (e.g. labeling with certainty that white noise static is a lion). Specifically, we take convolutional neural networks trained to perform well on either the ImageNet or MNIST datasets and then find images with evolutionary algorithms or gradient ascent that DNNs label with high confidence as belonging to each dataset class. It is possible to produce images totally unrecognizable to human eyes that DNNs believe with near certainty are familiar objects, which we call “fooling images” (more generally, fooling examples). Our results shed light on interesting differences between human vision and current DNNs, and raise questions about the generality of DNN computer vision.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, some AI weaknesses have proved surprisingly difficult to solve, such as AI being easily fooled41,42 and overconfidently wrong (hallucinations)43, although progress has been made44,45.”
From Towards end-to-end automation of AI research (2026) · cites this paper as [41]
In the citing paper
“Divergence between epistemic standards seems entirely legitimate, for instance, given widespread debates about the soundness and robustness of machine learning models”
From Algorithmic Accountability and Public Reason (2018) · cites this paper as Nguyen, Yosinski, & Clune, 2015
In the citing paper
“This simply implies that domestic legislation must serve as the principal source for the substantive law relating to the use of AI in space [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“Liability under the space law treaty regime is grounded in Outer Space Treaty (OST) Article VIII, which is the genesis of the Liability Convention [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“There are no international or space treaties that address or regulate the use of AI in space.”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Multi-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 17,323
(2010) · International Conference on Machine Learning · Cited by 13,995
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Research works printed but not linked: 2
- erhan, 2009, Visualizing higher-layer features of a deep network, Dept IRO Universite de Montreal Tech Rep
- mouret, 2010, Sferes v2: Evolvin'in the multi-core world, Evolutionary Computation (CEC) 2010 IEEE Congress on, 4079
Cited by
Items 201–300 of 1,015
The neuroconnectionist research programme
Doerig, A., Sommers, R. P., Seeliger, K., Richards, B., Ismael, J., Lindsay, G. W., Kording, K. P., Konkle, T., van Gerven, M. A. J., Kriegeskorte, N., et al. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00705-w · Cited by 233
Understanding Neural Networks via Feature Visualization: A Survey
Nguyen, A., Yosinski, J., & Clune, J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_4 · Cited by 233
Self-citationA Survey of Uncertainty in Deep Neural Networks
Gawlikowski, J., Tassi, C. R. N., Ali, M., Lee, J., Humt, M., Feng, J., Kruspe, A., Triebel, R., Jung, P., Roscher, R., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.03342 · Cited by 232
iVideoGPT: Interactive VideoGPTs are Scalable World Models
Wu, J., Yin, S., Feng, N., He, X., Li, D., Hao, J., & Long, M. (2024) · neural information processing systems · doi:10.52202/079017-2173 · Cited by 232
When Image Denoising Meets High-Level Vision Tasks: A Deep Learning Approach
Liu, D., Wen, B., Liu, X., Wang, Z., & Huang, T. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/117 · Cited by 231
Synthesizing the preferred inputs for neurons in neural networks via deep generator networks
Nguyen, A., Dosovitskiy, A., Yosinski, J., Brox, T., & Clune, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.09304 · Cited by 230
Self-citationAdversarial Examples for Generative Models
Kos, J., Fischer, I., & Song, D. (2018) · 2018 IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw.2018.00014 · Cited by 230
Transferable Adversarial Perturbations
Zhou, W., Hou, X., Chen, Y., Tang, M., Huang, X., Gan, X., & Yang, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_28 · Cited by 230
Adversarial and Clean Data Are Not Twins
Gong, Z., & Wang, W. (2023) · Proceedings of the Sixth International Workshop on Exploiting Artificial Intelligence Techniques for Data Management · doi:10.1145/3593078.3593935 · Cited by 229
Maximum Resilience of Artificial Neural Networks
Cheng, C.-H., Nührenberg, G., & Ruess, H. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-68167-2_18 · Cited by 227
Sharma, S., Henderson, J., & Ghosh, J. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375812 · Cited by 226
Towards the first adversarially robust neural network model on MNIST
Schott, L., Rauber, J., Bethge, M., & Brendel, W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09190 · Cited by 225
Learning to Attack: Adversarial Transformation Networks
Baluja, S., & Fischer, I. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11672 · Cited by 225
Automatically Evading Classifiers: A Case Study on PDF Malware Classifiers
Xu, W., Qi, Y., & Evans, D. (2016) · Proceedings 2016 Network and Distributed System Security Symposium · doi:10.14722/ndss.2016.23115 · Cited by 218
Generalizable Data-Free Objective for Crafting Universal Adversarial Perturbations
Mopuri, K. R., Ganeshan, A., & Babu, R. V. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2861800 · Cited by 218
Enhancing robustness of machine learning systems via data transformations
Bhagoji, A. N., Cullina, D., Sitawarin, C., & Mittal, P. (2018) · 2018 52nd Annual Conference on Information Sciences and Systems (CISS) · doi:10.1109/ciss.2018.8362326 · Cited by 217
Mueller, S. T., Hoffman, R. R., Clancey, W., Emrey, A., & Klein, G. (2019) · arXiv · doi:10.48550/arxiv.1902.01876 · Cited by 215
Interpretability research of deep learning: A literature survey
Xu, B., & Yang, G. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102721 · Cited by 214
Anomaly Detection in Medical Imaging With Deep Perceptual Autoencoders
Shvetsova, N., Bakker, B., Fedulova, I., Schulz, H., & Dylov, D. V. (2021) · IEEE Access · doi:10.1109/access.2021.3107163 · Cited by 213
Addressing Failure Prediction by Learning Model Confidence
Corbière, C., Thome, N., Bar-Hen, A., Cord, M., & Pérez, P. (2019) · arXiv · doi:10.48550/arxiv.1910.04851 · Cited by 211
“Another important issue related to MCP, which we specifically address in this work, relates to ranking of confidence scores: this ranking is unreliable for the task of failure prediction [41, 20].”
BackgroundSajjad, M., Nasir, M., Muhammad, K., Khan, S., Jan, Z., Sangaiah, A. K., Elhoseny, M., & Baik, S. W. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2017.11.013 · Cited by 211
Kubota, K. J., Chen, J. A., & Little, M. A. (2016) · Movement Disorders · doi:10.1002/mds.26693 · Cited by 210
Defense Against Universal Adversarial Perturbations
Akhtar, N., Liu, J., & Mian, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00357 · Cited by 210
Dupoux, E. (2018) · Cognition · doi:10.1016/j.cognition.2017.11.008 · Cited by 208
Opportunities and Challenges in Deep Learning Adversarial Robustness: A SurveyPreprint
Silva, S. H., & Najafirad, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00753 · Cited by 208
REVITALISE: viRtual bEhaVioral skIlls TrAining for pubLIc SpEaking
Ochs, M., Ristorcelli, M., D’Ambra, A., Casanova, R., & Pergandi, J.-M. (2024) · Proceedings of the ACM International Conference on Intelligent Virtual Agents · doi:10.1145/3652988.3696202 · Cited by 207
Qin, Z., G. M. U., Yu, F., Liu, C., Chen, X., & C. U. (2018) · Mathematical Foundations of Computing · doi:10.3934/mfc.2018008 · Cited by 205
Class Anchor Clustering: A Loss for Distance-based Open Set Recognition
Miller, D., Sünderhauf, N., Milford, M. J., & Dayoub, F. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00361 · Cited by 205
Deep problems with neural network models of human vision
Bowers, J. S., Malhotra, G., Dujmović, M., Llera Montero, M., Tsvetkov, C., Biscione, V., Puebla, G., Adolfi, F., Hummel, J. E., Heaton, R. F., et al. (2023) · Behavioral and Brain Sciences · doi:10.1017/s0140525x22002813 · Cited by 204
Connecting Image Denoising and High-Level Vision Tasks via Deep Learning
Liu, D., Wen, B., Jiao, J., Liu, X., Wang, Z., & Huang, T. S. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2964518 · Cited by 204
Automatic sleep staging of EEG signals: recent development, challenges, and future directions
Phan, H., & Mikkelsen, K. B. (2022) · Physiological Measurement · doi:10.1088/1361-6579/ac6049 · Cited by 203
Towards Adversarially Robust Object Detection
Zhang, H., & Wang, J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00051 · Cited by 202
Ruiz, N., Bargal, S. A., & Sclaroff, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-66823-5_14 · Cited by 202
Security and Privacy for Artificial Intelligence: Opportunities and ChallengesPreprint
Oseni, A., Moustafa, N., Janicke, H., Liu, P., Tari, Z., & Vasilakos, A. V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.04661 · Cited by 202
Machine Learning with Neural Networks: An Introduction for Scientists and Engineers
Mehlig, B. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108860604 · Cited by 201
Combating Label Noise in Deep Learning Using AbstentionPreprint
Thulasidasan, S., Bhattacharya, T., Bilmes, J., Chennupati, G., & Mohd-Yusof, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10964 · Cited by 201
Evasion and Hardening of Tree Ensemble ClassifiersPreprint
Kantchelian, A., Tygar, J. D., & Joseph, A. D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.07892 · Cited by 201
Task-Driven Super Resolution: Object Detection in Low-Resolution Images
Haris, M., Shakhnarovich, G., & Ukita, N. (2021) · Communications in Computer and Information Science · doi:10.1007/978-3-030-92307-5_45 · Cited by 200
The Robustness of Deep Networks: A Geometrical Perspective
Fawzi, A., Moosavi-Dezfooli, S.-M., & Frossard, P. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2740965 · Cited by 200
Towards Robust Pattern Recognition: A Review
Zhang, X.-Y., Liu, C., & Suen, C. Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2989782 · Cited by 200
Do Convolutional Neural Networks Learn Class Hierarchy?
Bilal, A., Jourabloo, A., Ye, M., Liu, X., & Ren, L. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2744683 · Cited by 199
EEG-based mental workload estimation using deep BLSTM-LSTM network and evolutionary algorithm
Das Chakladar, D., Dey, S., Roy, P. P., & Dogra, D. P. (2020) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2020.101989 · Cited by 197
A baseline for detecting misclassified and out-of-distribution examples in neural networks
Hendrycks, D. (2025) · arXiv (Cornell University) · doi:10.57702/9gs720u1 · Cited by 196
Adversarial Transformation Networks: Learning to Generate Adversarial Examples
Baluja, S., & Fischer, I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.09387 · Cited by 194
The security of machine learning in an adversarial setting: A survey
Wang, X., Li, J., Kuang, X., Tan, Y.-A., & Li, J. (2019) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2019.03.003 · Cited by 194
Towards the Science of Security and Privacy in Machine Learning
Papernot, N., McDaniel, P. D., Sinha, A., & Wellman, M. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.03814 · Cited by 192
Perceptual Underwater Image Enhancement With Deep Learning and Physical Priors
Chen, L., Jiang, Z., Tong, L., Liu, Z., Zhao, A., Zhang, Q., Dong, J., & Zhou, H. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3035108 · Cited by 191
Learning long-range spatial dependencies with horizontal gated-recurrent units
Linsley, D. A., Kim, J., Veerabadran, V., & Serre, T. (2018) · Conference on Cognitive Computational Neuroscience (CCN) · doi:10.32470/ccn.2018.1116-0 · Cited by 191
CRADLE: Cross-Backend Validation to Detect and Localize Bugs in Deep Learning Libraries
Pham, H. V., Lutellier, T., Qi, W., & Tan, L. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2019.00107 · Cited by 190
Evaluating Adversarial Evasion Attacks in the Context of Wireless Communications
Flowers, B., Buehrer, R. M., & Headley, W. C. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2934069 · Cited by 189
A deep learning framework for identifying children with ADHD using an EEG-based brain network
Chen, H., Song, Y., & Li, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.04.058 · Cited by 189
Cang, R., Xu, Y., Chen, S., Liu, Y., Jiao, Y., & Yi Ren, M. (2017) · Journal of Mechanical Design · doi:10.1115/1.4036649 · Cited by 188
Practical Hidden Voice Attacks against Speech and Speaker Recognition Systems
Abdullah, H., García, W., Peeters, C., Traynor, P., Butler, K. R. B., & Wilson, J. N. (2019) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2019.23362 · Cited by 187
Deep neural networks in computational neuroscience
Kietzmann, T. C., McClure, P., & Kriegeskorte, N. (2019) · Oxford Research Encyclopedia of Neuroscience · doi:10.1093/acrefore/9780190264086.013.46 · Cited by 186
NO Need to Worry about Adversarial Examples in Object Detection in Autonomous Vehicles
Lu, J., Sibai, H., Fabry, E., & Forsyth, D. A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.03501 · Cited by 186
Everything You Wanted to Know about Deep Learning for Computer Vision but Were Afraid to Ask
Ponti, M. A., Ribeiro, L. S. F., de Nazaré, T. S., Bui, T., & Collomosse, J. P. (2017) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi-t.2017.12 · Cited by 186
Robotic Process Automation: A Case Study in the Banking Industry
Rom�ão, M., Costa, J. P., & Costa, C. J. D. C. (2019) · Iberian Conference on Information Systems and Technologies (CISTI) · doi:10.23919/cisti.2019.8760733 · Cited by 186
Adversarial Examples that Fool DetectorsPreprint
Lu, J., Sibai, H., & Fabry, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.02494 · Cited by 186
Active Learning on a Budget: Opposite Strategies Suit High and Low BudgetsPreprint
Hacohen, G., Dekel, A., & Weinshall, D. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.02794 · Cited by 185
Osadchy, M., Hernandez-Castro, J., Gibson, S., Dunkelman, O., & Perez-Cabo, D. (2017) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2017.2718479 · Cited by 184
Adversarial example detection for DNN models: a review and experimental comparison
Aldahdooh, A., Hamidouche, W., Fezza, S. A., & Déforges, O. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10125-w · Cited by 183
Confronting the Challenge of Quality Diversity
Pugh, J. K., Soros, L. B., Szerlip, P., & Stanley, K. O. (2015) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2739480.2754664 · Cited by 183
Understanding Softmax Confidence and UncertaintyPreprint
Pearce, T., Brintrup, A. M., & Zhu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.04972 · Cited by 183
Wang, X., Oxholm, G., Zhang, D., & Wang, Y.-F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.759 · Cited by 182
“Similar optimization procedure is also adopted in other cases [23, 20].”
MethodSqueeze, Recover and Relabel: Dataset Condensation at ImageNet Scale From A New Perspective
Yin, Z., Xing, E., & Shen, Z. (2023) · neural information processing systems · doi:10.52202/075280-3219 · Cited by 182
Adversarial Machine Learning in Image Classification: A Survey Toward the Defender’s Perspective
Machado, G. R., Silva, E., & Goldschmidt, R. R. (2023) · ACM Computing Surveys · doi:10.1145/3485133 · Cited by 180
Detecting Malware with an Ensemble Method Based on Deep Neural Network
Yan, J., Qi, Y., & Rao, Q. (2018) · Security and Communication Networks · doi:10.1155/2018/7247095 · Cited by 180
Semi-Supervised Learning under Class Distribution Mismatch
Chen, Y., Zhu, X., Li, W., & Gong, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5763 · Cited by 180
Non-iterative and Fast Deep Learning: Multilayer Extreme Learning Machines
Zhang, J., Li, Y., Xiao, W., & Zhang, Z. (2020) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2020.04.033 · Cited by 179
Towards Privacy-Preserving Visual Recognition via Adversarial Training: A Pilot Study
Wu, Z., Wang, Z., Wang, Z., & Jin, H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01270-0_37 · Cited by 179
Metric Learning for Adversarial RobustnessPreprint
Mao, C., Zhong, Z., Yang, J., Vondrick, C., & Ray, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.00900 · Cited by 179
Boosting Adversarial Training with Hypersphere EmbeddingPreprint
Pang, T., Yang, X. H., Dong, Y., Xu, K., Zhu, J., & Su, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08619 · Cited by 178
Lee, J., Park, J., Kim, K., & Nam, J. (2018) · Applied Sciences · doi:10.3390/app8010150 · Cited by 177
Black-box Adversarial Attacks on Video Recognition Models
Jiang, L., Ma, X., Chen, S., Bailey, J., & Jiang, Y. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3351088 · Cited by 177
Confidence-Aware Learning for Deep Neural NetworksPreprint
Moon, J., Kim, J., Shin, Y., & Hwang, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.01458 · Cited by 177
Deep learning: Evolution and expansion
Wason, R. (2018) · Cognitive Systems Research · doi:10.1016/j.cogsys.2018.08.023 · Cited by 174
Making the Case for Safety of Machine Learning in Highly Automated Driving
Burton, S., Gauerhof, L., & Heinzemann, C. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66284-8_1 · Cited by 174
Measuring the tendency of CNNs to Learn Surface Statistical Regularities
Jo, J., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11561 · Cited by 173
The roles of supervised machine learning in systems neuroscience
Glaser, J. I., Benjamin, A. S., Farhoodi, R., & Kording, K. P. (2019) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2019.01.008 · Cited by 173
How to Exploit Hyperspherical Embeddings for Out-of-Distribution Detection?Preprint
Ming, Y., Sun, Y., Dia, O., & Li, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.04450 · Cited by 172
A Taxonomy of Deep Convolutional Neural Nets for Computer Vision
Srinivas, S., Sarvadevabhatla, R. K., Mopuri, K. R., Prabhu, N., Kruthiventi, S. S. S., & Babu, R. V. (2016) · Frontiers in Robotics and AI · doi:10.3389/frobt.2015.00036 · Cited by 171
Learning and the Unknown: Surveying Steps toward Open World Recognition
Boult, T. E., Cruz, S. S., Dhamija, A. R., Günther, M., Henrydoss, J., & Scheirer, W. J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019801 · Cited by 171
Towards Robust Detection of Adversarial ExamplesPreprint
Pang, T., Du, C., Dong, Y., & Zhu, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.00633 · Cited by 171
Adversarial attacks and defenses in explainable artificial intelligence: A survey
Baniecki, H., & Biecek, P. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102303 · Cited by 170
Deep Learning for Source Code Modeling and Generation: Models, Applications, and Challenges
Le, T. H. M., Chen, H., & Babar, M. A. (2021) · ACM Computing Surveys · doi:10.1145/3383458 · Cited by 170
Sparse Adversarial Perturbations for Videos
Wei, X., Zhu, J., Yuan, S., & Su, H. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018973 · Cited by 170
Quality-Diversity Optimization: A Novel Branch of Stochastic Optimization
Chatzilygeroudis, K. I., Cully, A., Vassiliades, V., & Mouret, J.-B. (2021) · Springer optimization and its applications · doi:10.1007/978-3-030-66515-9_4 · Cited by 170
A Unified Gradient Regularization Family for Adversarial Examples
Lyu, C., Huang, K., & Liang, H.-N. (2015) · 2015 IEEE International Conference on Data Mining · doi:10.1109/icdm.2015.84 · Cited by 169
Probabilistic Object Detection: Definition and Evaluation
Hall, D., Dayoub, F., Skinner, J., Zhang, H., Miller, D., Corke, P., Carneiro, G., Angelova, A., & Sünderhauf, N. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093599 · Cited by 169
Artificial intelligence in cardiology: Hope for the future and power for the present
Karatzia, L., Aung, N., & Aksentijević, D. (2022) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2022.945726 · Cited by 169
DARTS: Deceiving Autonomous Cars with Toxic Signs
Sitawarin, C., Bhagoji, A. N., Mosenia, A., Chiang, M., & Mittal, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.06430 · Cited by 168
Exploring the space of adversarial images
Tabacof, P., & Valle, E. (2016) · 2016 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727230 · Cited by 168
Xu, Y., Du, B., & Zhang, L. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2999962 · Cited by 168
Thomson, T. J., Angus, D. J., Dootson, P., Hurcombe, E., & Smith, A. (2020) · Journalism Practice · doi:10.1080/17512786.2020.1832139 · Cited by 168
Rudd, E. M., Rozsa, A., Gunther, M., & Boult, T. E. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2636078 · Cited by 167
Joint Attention in Autonomous Driving (JAAD)Preprint
Kotseruba, I., Rasouli, A., & Tsotsos, J. K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.04741 · Cited by 166
Artificial Intelligence in Nephrology: Core Concepts, Clinical Applications, and Perspectives
Niel, O., & Bastard, P. (2019) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2019.05.020 · Cited by 165
SirenAttack: Generating Adversarial Audio for End-to-End Acoustic Systems
Du, T., Ji, S., Li, J., Gu, Q., Wang, T., & Beyah, R. (2020) · ACM Asia Conference on Computer and Communications Security (ASIA CCS) · doi:10.1145/3320269.3384733 · Cited by 165
Artificial Intelligence and Health Technology Assessment: Anticipating a New Level of Complexity
Alami, H., Lehoux, P., Auclair, Y., de Guise, M., Gagnon, M.-P., Shaw, J., Roy, D., Fleet, R., Ag Ahmed, M. A., & Fortin, J.-P. (2020) · Journal of Medical Internet Research · doi:10.2196/17707 · Cited by 164
Monkey Says, Monkey Does: Security and Privacy on Voice Assistants
Alepis, E., & Patsakis, C. (2017) · IEEE Access · doi:10.1109/access.2017.2747626 · Cited by 164
Metadata
- Authors
- Nguyen, A., Yosinski, J., & Clune, J.
- Affiliations
- University of Wyoming (US)
- Cornell University (US)
- ORCID
- Clune, Jeff
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 427-436
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1932198206
- Cited by
- 3,258
- References
- 35
- Citations by year
- 2026: 73 · 2025: 210 · 2024: 313 · 2023: 323 · 2022: 318 · 2021: 460 · 2020: 401 · 2019: 407 · 2018: 348 · 2017: 211 · 2016: 124 · 2015: 60
- FWCI
- 139.54
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Aeronautics and Space Administration
- University of Wyoming
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- deep neural network robustness, adversarial examples, evolutionary algorithms, gradient ascent, ImageNet, MNIST, visual categorization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.