Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Open accessThe DOI matches its Crossref record; 33 of the 35 references it cites were found in a registry or an index.
Abstract
Deep neural networks (DNNs) have recently been achieving state-of-the-art performance on a variety of pattern-recognition tasks, most notably visual classification problems. Given that DNNs are now able to classify objects in images with near-human-level performance, questions naturally arise as to what differences remain between computer and human vision. A recent study [30] revealed that changing an image (e.g. of a lion) in a way imperceptible to humans can cause a DNN to label the image as something else entirely (e.g. mislabeling a lion a library). Here we show a related result: it is easy to produce images that are completely unrecognizable to humans, but that state-of-the-art DNNs believe to be recognizable objects with 99.99% confidence (e.g. labeling with certainty that white noise static is a lion). Specifically, we take convolutional neural networks trained to perform well on either the ImageNet or MNIST datasets and then find images with evolutionary algorithms or gradient ascent that DNNs label with high confidence as belonging to each dataset class. It is possible to produce images totally unrecognizable to human eyes that DNNs believe with near certainty are familiar objects, which we call “fooling images” (more generally, fooling examples). Our results shed light on interesting differences between human vision and current DNNs, and raise questions about the generality of DNN computer vision.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, some AI weaknesses have proved surprisingly difficult to solve, such as AI being easily fooled41,42 and overconfidently wrong (hallucinations)43, although progress has been made44,45.”
From Towards end-to-end automation of AI research (2026) · cites this paper as [41]
In the citing paper
“Divergence between epistemic standards seems entirely legitimate, for instance, given widespread debates about the soundness and robustness of machine learning models”
From Algorithmic Accountability and Public Reason (2018) · cites this paper as Nguyen, Yosinski, & Clune, 2015
In the citing paper
“This simply implies that domestic legislation must serve as the principal source for the substantive law relating to the use of AI in space [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“Liability under the space law treaty regime is grounded in Outer Space Treaty (OST) Article VIII, which is the genesis of the Liability Convention [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“There are no international or space treaties that address or regulate the use of AI in space.”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Multi-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 17,323
(2010) · International Conference on Machine Learning · Cited by 13,995
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Research works printed but not linked: 2
- erhan, 2009, Visualizing higher-layer features of a deep network, Dept IRO Universite de Montreal Tech Rep
- mouret, 2010, Sferes v2: Evolvin'in the multi-core world, Evolutionary Computation (CEC) 2010 IEEE Congress on, 4079
Cited by
Items 301–400 of 1,015
A data-driven approach to referable diabetic retinopathy detection
Pires, R., Avila, S., Wainer, J., Valle, E., Abramoff, M. D., & Rocha, A. (2019) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.03.009 · Cited by 164
Layer-Wise Relevance Propagation for Deep Neural Network Architectures
Binder, A., Bach, S., Montavon, G., Müller, K.-R., & Samek, W. (2016) · Lecture Notes in Electrical Engineering · doi:10.1007/978-981-10-0557-2_87 · Cited by 163
Understanding Measures of Uncertainty for Adversarial Example Detection
Smith, L., & Gal, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.08533 · Cited by 162
Adversarial examples for models of code
Yefet, N., Alon, U., & Yahav, E. (2020) · Proceedings of the ACM on Programming Languages · doi:10.1145/3428230 · Cited by 161
Watermarking deep neural networks for embedded systems
Guo, J., & Potkonjak, M. (2018) · Proceedings of the International Conference on Computer-Aided Design · doi:10.1145/3240765.3240862 · Cited by 161
Enabling AI in Future Wireless Networks: A Data Life Cycle Perspective
Nguyen, D. C., Cheng, P., Ding, M., Lopez-Perez, D., Pathirana, P. N., Li, J., Seneviratne, A., Li, Y., & Poor, H. V. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3024783 · Cited by 160
Vision-Based Parking-Slot Detection: A DCNN-Based Approach and a Large-Scale Benchmark Dataset
Zhang, L., Huang, J., Li, X., & Xiong, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2857407 · Cited by 160
A Comprehensive Review of Deep-Learning-Based Methods for Image Forensics
Camacho, I. C., & Wang, K. (2021) · Journal of Imaging · doi:10.3390/jimaging7040069 · Cited by 160
Unravelling Robustness of Deep Learning Based Face Recognition Against Adversarial Attacks
Goswami, G., Ratha, N., Agarwal, A., Singh, R., & Vatsa, M. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12341 · Cited by 159
Okewu, E., Adewole, P., Misra, S., Maskeliūnas, R., & Damaševičius, R. (2021) · Applied Artificial Intelligence · doi:10.1080/08839514.2021.1922847 · Cited by 159
Parseval Networks: Improving Robustness to Adversarial Examples
Cissé, M., Bojanowski, P., Grave, É., Dauphin, Y., & Usunier, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.08847 · Cited by 158
Deep Open Intent Classification with Adaptive Decision Boundary
Zhang, H., Xu, H., & Lin, T.-E. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17690 · Cited by 157
Outlier exposure with confidence control for out-of-distribution detection
Papadopoulos, A.-A., Rajati, M. R., Shaikh, N., & Wang, J. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.02.007 · Cited by 155
Leveraging Uncertainty in Machine Learning Accelerates Biological Discovery and Design
Hie, B., Bryson, B. D., & Berger, B. (2020) · Cell Systems · doi:10.1016/j.cels.2020.09.007 · Cited by 154
“While notions of biochemical ‘‘similarity’’ or ‘‘uncertainty’’ might be obvious to a human expert, a standard machine learning algorithm has no corresponding notion of uncertainty, potentially leading to biased, overconfident, or pathological predictions (Figure 1A) (Amodei et al., 2016; Chen et al., 2018; Guo et al.,…”
BackgroundOpen-world Machine Learning: Applications, Challenges, and Opportunities
Parmar, J., Chouhan, S., Raychoudhury, V., & Rathore, S. (2023) · ACM Computing Surveys · doi:10.1145/3561381 · Cited by 154
On failure modes in molecule generation and optimization
Renz, P., Van Rompaey, D., Wegner, J. K., Hochreiter, S., & Klambauer, G. (2019) · Drug Discovery Today: Technologies · doi:10.1016/j.ddtec.2020.09.003 · Cited by 154
Wang, S., Wang, Q., & Zhao, J. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.102701 · Cited by 154
Categorical Foundations of Gradient-Based Learning
Cruttwell, G. S. H., Gavranović, B., Ghani, N., Wilson, P., & Zanasi, F. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-99336-8_1 · Cited by 154
A Review on Deep Learning Techniques for IoT Data
Lakshmanna, K., Kaluri, R., Gundluru, N., Alzamil, Z. S., Rajput, D. S., Khan, A. A., Haq, M. A., & Alhussen, A. (2022) · Electronics · doi:10.3390/electronics11101604 · Cited by 154
Copycat CNN: Stealing Knowledge by Persuading Confession with Random Non-Labeled Data
Correia-Silva, J. R., Berriel, R. F., Badue, C., de Souza, A. F., & Oliveira-Santos, T. (2018) · 2018 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489592 · Cited by 153
Spatio-Contextual Deep Network-Based Multimodal Pedestrian Detection for Autonomous Driving
Dasgupta, K., Das, A., Das, S. K., Bhattacharya, U., & Yogamani, S. K. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3146575 · Cited by 153
Nguyen, A. M., Yosinski, J., & Clune, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.03616 · Cited by 152
Self-citationLearning to Discriminate Perturbations for Blocking Adversarial Attacks in Text Classification
Zhou, Y., Jiang, J., Chang, K.-W., & Wang, W. W. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1496 · Cited by 152
Monte Carlo DropBlock for modeling uncertainty in object detection
Yelleni, S. H., Kumari, D., Srijith, P. K., & Mohan, C. K. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110003 · Cited by 152
FedIPR: Ownership Verification for Federated Deep Neural Network Models
Li, B., Fan, L., Gu, H., Li, J., & Yang, Q. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3195956 · Cited by 152
Vassiliades, V., Chatzilygeroudis, K., & Mouret, J.-B. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2735550 · Cited by 151
Universal Adversarial Training
Shafahi, A., Najibi, M., Xu, Z., Dickerson, J., Davis, L. S., & Goldstein, T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6017 · Cited by 151
Performance vs. competence in human–machine comparisons
Firestone, C. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1905334117 · Cited by 150
“Indeed, throughout this discussion, I ’ ll speak generally of “ human – machine similarity ” (or dissimilarity classified as a “ crossword puzzle ” or “ armadillo ” (52).”
BackgroundInfluentialLearning What Makes a Difference from Counterfactual Examples and Gradient Supervision
Teney, D., Abbasnedjad, E., & van den Hengel, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58607-2_34 · Cited by 150
An improved YOLO-based road traffic monitoring system
Al‐qaness, M. A. A., Abbasi, A. A., Fan, H. M., Ibrahim, R. A., Alsamhi, S. H., & Hawbani, A. (2021) · Computing · doi:10.1007/s00607-020-00869-8 · Cited by 150
Learning in high-dimensional multimedia data: the state of the art
Gao, L., Song, J., Liu, X., Shao, J., Liu, J., & Shao, J. (2015) · Multimedia Systems · doi:10.1007/s00530-015-0494-1 · Cited by 149
Motivating the Rules of the Game for Adversarial Example Research
Gilmer, J., Adams, R. P., Goodfellow, I., Andersen, D., & Dahl, G. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.06732 · Cited by 148
Rethinking Reconstruction Autoencoder-Based Out-of-Distribution Detection
Zhou, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00723 · Cited by 148
Huang, Q., Peng, S., Deng, J., Zeng, H., Zhang, Z., Liu, Y., & Yuan, P. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e13883 · Cited by 148
Out-of-Distribution Detection and Selective Generation for Conditional Language ModelsPreprint
Ren, J., Luo, J., Zhao, Y., Krishna, K. S., Saleh, M., Lakshminarayanan, B., & Liu, P. J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.15558 · Cited by 148
Carter, S., Armstrong, Z., Schubert, L., Johnson, I., & Olah, C. (2019) · Distill · doi:10.23915/distill.00015 · Cited by 147
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation
Pan, X., Zhan, X., Dai, B., Lin, D., Loy, C. C., & Luo, P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_16 · Cited by 147
SDE-Net: Equipping Deep Neural Networks with Uncertainty EstimatesPreprint
Kong, L., Sun, J., & Zhang, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.10546 · Cited by 146
A Comprehensive Review of Explainable Artificial Intelligence (XAI) in Computer Vision
Cheng, Z. Q., Wu, Y. P., Li, Y., Cai, L., & Ihnaini, B. (2025) · Sensors · doi:10.3390/s25134166 · Cited by 145
Mehrotra, S., Degachi, C., Vereschak, O., Jonker, C. M., & Tielman, M. L. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3696449 · Cited by 144
Quantum adversarial machine learning
Lu, S., Duan, L.-M., & Deng, D.-L. (2020) · Physical Review Research · doi:10.1103/physrevresearch.2.033212 · Cited by 144
Structured Adversarial Attack: Towards General Implementation and Better InterpretabilityPreprint
Xu, K., Liu, S., Zhao, P., Chen, P., Zhang, H., Fan, Q., Erdogmus, D., Wang, Y., & Lin, X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.01664 · Cited by 143
Towards Verified Artificial Intelligence
Seshia, S. A., Sadigh, D., & Sastry, S. S. (2016) · arXiv · doi:10.48550/arxiv.1606.08514 · Cited by 142
“Can the testing of AI-based systems leverage formal methods in a similar manner? Recent efforts have shown that various machine learning algorithms can fail under small adversarial perturbations [36, 18, 34, 21].”
BackgroundExploring the Limits of Out-of-Distribution Detection
Fort, S., Ren, J., & Lakshminarayanan, B. (2021) · arXiv · doi:10.48550/arxiv.2106.03004 · Cited by 142
Mid-level perceptual features contain early cues to animacy
Long, B., Störmer, V. S., & Alvarez, G. A. (2017) · Journal of Vision · doi:10.1167/17.6.20 · Cited by 142
Artificial intelligence and crime: A primer for criminologists
Hayward, K. J., & Maas, M. M. (2021) · Crime, Media, Culture: An International Journal · doi:10.1177/1741659020917434 · Cited by 141
Model-Agnostic Interpretability with Shapley Values
Messalas, A., Kanellopoulos, Y., & Makris, C. H. (2019) · International Conference on Information, Intelligence, Systems & Applications (IISA) · doi:10.1109/iisa.2019.8900669 · Cited by 141
Self-taught object localization with deep networks
Bazzani, L., Bergamo, A., Anguelov, D., & Torresani, L. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477688 · Cited by 140
PyTorchFI: A Runtime Perturbation Tool for DNNs
Mahmoud, A., Aggarwal, N., Nobbe, A., Vicarte, J. R. S., Adve, S. V., Fletcher, C. W., Frosio, I., & Hari, S. K. S. (2020) · 2020 50th Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W) · doi:10.1109/dsn-w50199.2020.00014 · Cited by 140
Salient Deconvolutional Networks
Mahendran, A., & Vedaldi, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46466-4_8 · Cited by 140
With Great Training Comes Great Vulnerability: Practical Attacks against Transfer Learning
Wang, B., Yao, Y., Viswanath, B., Zheng, H.-T., & Zhao, B. Y. (2018) · USENIX Security Symposium · Cited by 139
Explainable, Domain-Adaptive, and Federated Artificial Intelligence in Medicine
Chaddad, A., Lu, Q., Li, J., Katib, Y., Kateb, R., Tanougast, C., Bouridane, A., & Abdulkadir, A. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123123 · Cited by 139
Uncertainty-aware credit card fraud detection using deep learning
Habibpour, M., Gharoun, H., Mehdipour, M., Tajally, A., Asgharnezhad, H., Shamsi, A., Khosravi, A., & Nahavandi, S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106248 · Cited by 138
Capsule Networks With Residual Pose Routing
Liu, Y., Cheng, D., Zhang, D., Xu, S., & Han, J. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3347722 · Cited by 138
WAIC, but Why? Generative Ensembles for Robust Anomaly Detection
Choi, H., Jang, E., & Alemi, A. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.01392 · Cited by 137
Evaluating Merging Strategies for Sampling-based Uncertainty Techniques in Object Detection
Miller, D., Dayoub, F., Milford, M. J., & Sünderhauf, N. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793821 · Cited by 137
Neural ODE Control for Classification, Approximation, and Transport
Ruiz-Balet, D., & Zuazua, E. (2023) · SIAM Review · doi:10.1137/21m1411433 · Cited by 137
Adversarial Examples on Object Recognition: A Comprehensive Survey
Serban, A., Poll, E., & Visser, J. (2021) · ACM Computing Surveys · doi:10.1145/3398394 · Cited by 136
Learning a Discriminative Model for the Perception of Realism in Composite Images
Zhu, J.-Y., Krahenbuhl, P., Shechtman, E., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.449 · Cited by 136
Shapley explainability on the data manifoldPreprint
Frye, C., de Mijolla, D., Begley, T., Cowton, L. R., Stanley, M. J., & Feige, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01272 · Cited by 136
Adversarial Attacks Beyond the Image Space
Zeng, X., Liu, C., Wang, Y.-S., Qiu, W., Xie, L., Tai, Y.-W., Tang, C.-K., & Yuille, A. L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00443 · Cited by 135
Reset-free Trial-and-Error Learning for Robot Damage Recovery
Chatzilygeroudis, K. I., Vassiliades, V., & Mouret, J.-B. (2017) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2017.11.010 · Cited by 135
Abdullah, H., Rahman, M. S., García, W., Warren, K., Yadav, A. S., Shrimpton, T., & Traynor, P. (2021) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp40001.2021.00009 · Cited by 134
Adversarial Robustness vs. Model Compression, or Both?
Ye, S., Xu, K., Liu, S., Cheng, H., Lambrechts, J.-H., Zhang, H., Zhou, A., Ma, K., Wang, Y., & Lin, X. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00020 · Cited by 133
UPSET and ANGRI : Breaking High Performance Image ClassifiersPreprint
Sarkar, S., Bansal, A., Mahbub, U., & Chellappa, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.01159 · Cited by 133
Deep Learning and Music Adversaries
Kereliuk, C., Sturm, B. L., & Larsen, J. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2478068 · Cited by 131
Jozwik, K. M., Kriegeskorte, N., Storrs, K. R., & Mur, M. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01726 · Cited by 131
Understanding the four types of AI, from reactive robots to self-aware beings
Hintze, A. (2016) · The Conversation · doi:10.64628/aai.ar4dfgrcg · Cited by 131
Label Refinery: Improving ImageNet Classification through Label Progression
Bagherinezhad, H., Horton, M., Rastegari, M., & Farhadi, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.02641 · Cited by 130
INPUT COMPLEXITY AND OUT-OF-DISTRIBUTION DETECTION WITH LIKELIHOOD-BASED GENERATIVE MODELS
Serrà, J., Álvarez, D., Gómez, V., Slizovskaia, O., Núñez, J. F., & Luque, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11480 · Cited by 130
Taylor, J. E. T., & Taylor, G. W. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01825-5 · Cited by 130
Improving Interpretability of Deep Neural Networks with Semantic Information
Dong, Y., Su, H., Zhu, J., & Zhang, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.110 · Cited by 130
Artificial Intelligence Security Threat, Crime, and Forensics: Taxonomy and Open Issues
Jeong, D. (2020) · IEEE Access · doi:10.1109/access.2020.3029280 · Cited by 129
Deep Learning and Big Data in Healthcare: A Double Review for Critical Beginners
Bote-Curiel, L., Muñoz-Romero, S., Guerrero-Curieses, A., & Rojo‐Álvarez, J. L. (2019) · Applied Sciences · doi:10.3390/app9112331 · Cited by 128
Detecting Overfitting of Deep Generative Networks via Latent Recovery
Webster, R., Rabin, J., Simon, L., & Jurie, F. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01153 · Cited by 128
Hahn, T., Pyeon, M., & Kim, G. (2019) · Seoul National University Open Repository (Seoul National University) · Cited by 128
Convergent Learning: Do different neural networks learn the same representations?
Li, Y., Yosinski, J., Clune, J., Lipson, H., & Hopcroft, J. E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.07543 · Cited by 127
Self-citationDetecting and Mitigating Adversarial Perturbations for Robust Face Recognition
Goswami, G., Agarwal, A., Ratha, N., Singh, R., & Vatsa, M. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01160-w · Cited by 127
3D CNN Design for the Classification of Alzheimer’s Disease Using Brain MRI and PET
Khagi, B., & Kwon, G.-R. (2020) · IEEE Access · doi:10.1109/access.2020.3040486 · Cited by 127
Dream the Impossible: Outlier Imagination with Diffusion Models
Du, X., Sun, Y., Zhu, J., & Li, Y. (2023) · neural information processing systems · doi:10.52202/075280-2660 · Cited by 127
Effect of AI Explanations on Human Perceptions of Patient-Facing AI-Powered Healthcare Systems
Zhang, Z., Genc, Y., Wang, D., Ahsen, M. E., & Fan, X. (2021) · Journal of Medical Systems · doi:10.1007/s10916-021-01743-6 · Cited by 126
Gómez-Guillén, D., & Rojas‐Domínguez, A. (2015) · Neural Computation · doi:10.1162/neco_a_00793 · Cited by 125
Understanding Human Object Vision: A Picture Is Worth a Thousand Representations
Bracci, S., & de Beeck, H. O. (2022) · Annual Review of Psychology · doi:10.1146/annurev-psych-032720-041031 · Cited by 125
Robustness to Adversarial Examples through an Ensemble of SpecialistsPreprint
Abbasi, M., & Gagné, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.06856 · Cited by 125
Compositional Falsification of Cyber-Physical Systems with Machine Learning Components
Dreossi, T., Donzé, A., & Seshia, S. A. (2019) · Journal of Automated Reasoning · doi:10.1007/s10817-018-09509-5 · Cited by 124
“…a given input) or robustness [15,7] (i.e., a minimal perturbation leading to a misclassification), while others proposed methods to generate pictures [29,12] or perturbations [27,29] including methods based on satisfiability modulo theories (SMT) (e.g., [18]) in such a way to “fool” neural networks.”
Tuckute, G., Feather, J., Boebinger, D., & McDermott, J. H. (2023) · PLoS Biology · doi:10.1371/journal.pbio.3002366 · Cited by 124
Using human brain activity to guide machine learning
Fong, R., Scheirer, W. J., & Cox, D. (2018) · Scientific Reports · doi:10.1038/s41598-018-23618-6 · Cited by 124
Interpretable Deep Learning under FirePreprint
Zhang, X., Wang, N., Shen, H., Ji, S., Luo, X., & Wang, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00891 · Cited by 123
Such, F. P., Rawal, A., Lehman, J., Stanley, K. O., & Clune, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.07768 · Cited by 123
Self-citationDeepCorrect: Correcting DNN Models Against Image Distortions
Borkar, T. S., & Karam, L. J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2924172 · Cited by 122
Attacks and defenses in user authentication systems: A survey
Wang, X., Yan, Z., Zhang, R., & Zhang, P. (2021) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2021.103080 · Cited by 122
A Deeper Look at 3D Shape Classifiers
Su, J.-C., Gadelha, M., Wang, R., & Maji, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11015-4_49 · Cited by 121
DeepFault: Fault Localization for Deep Neural Networks
Enişer, H. F., Gerasimou, S., & Şen, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-16722-6_10 · Cited by 120
Machine learning and blockchain technologies for cybersecurity in connected vehicles
Ahmad, J., Zia, M. U., Naqvi, I. H., Chattha, J. N., Butt, F. A., Huang, T., & Xiang, W. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1515 · Cited by 120
On the Suitability of Lp-Norms for Creating and Preventing Adversarial Examples
Sharif, M., Bauer, L., & Reiter, M. K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00211 · Cited by 119
Aspect based sentiment analysis by a linguistically regularized CNN with gated mechanism
Zeng, D., Dai, Y., Li, F., Wang, J., & Sangaiah, A. K. (2019) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-169958 · Cited by 119
Compositional Falsification of Cyber-Physical Systems with Machine Learning Components
Dreossi, T., Donzé, A., & Seshia, S. A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-57288-8_26 · Cited by 119
Structure learning and the posterior parietal cortex
Summerfield, C., Luyckx, F., & Sheahan, H. (2020) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2019.101717 · Cited by 118
Security of CCTV and Video Surveillance Systems: Threats, Vulnerabilities, Attacks, and Mitigations
Costin, A. (2016) · Workshop on Trustworthy Embedded Devices · doi:10.1145/2995289.2995290 · Cited by 118
Metadata
- Authors
- Nguyen, A., Yosinski, J., & Clune, J.
- Affiliations
- University of Wyoming (US)
- Cornell University (US)
- ORCID
- Clune, Jeff
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 427-436
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1932198206
- Cited by
- 3,258
- References
- 35
- Citations by year
- 2026: 73 · 2025: 210 · 2024: 313 · 2023: 323 · 2022: 318 · 2021: 460 · 2020: 401 · 2019: 407 · 2018: 348 · 2017: 211 · 2016: 124 · 2015: 60
- FWCI
- 139.54
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Aeronautics and Space Administration
- University of Wyoming
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- deep neural network robustness, adversarial examples, evolutionary algorithms, gradient ascent, ImageNet, MNIST, visual categorization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.