Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Open accessThe DOI matches its Crossref record; 33 of the 35 references it cites were found in a registry or an index.
Abstract
Deep neural networks (DNNs) have recently been achieving state-of-the-art performance on a variety of pattern-recognition tasks, most notably visual classification problems. Given that DNNs are now able to classify objects in images with near-human-level performance, questions naturally arise as to what differences remain between computer and human vision. A recent study [30] revealed that changing an image (e.g. of a lion) in a way imperceptible to humans can cause a DNN to label the image as something else entirely (e.g. mislabeling a lion a library). Here we show a related result: it is easy to produce images that are completely unrecognizable to humans, but that state-of-the-art DNNs believe to be recognizable objects with 99.99% confidence (e.g. labeling with certainty that white noise static is a lion). Specifically, we take convolutional neural networks trained to perform well on either the ImageNet or MNIST datasets and then find images with evolutionary algorithms or gradient ascent that DNNs label with high confidence as belonging to each dataset class. It is possible to produce images totally unrecognizable to human eyes that DNNs believe with near certainty are familiar objects, which we call “fooling images” (more generally, fooling examples). Our results shed light on interesting differences between human vision and current DNNs, and raise questions about the generality of DNN computer vision.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, some AI weaknesses have proved surprisingly difficult to solve, such as AI being easily fooled41,42 and overconfidently wrong (hallucinations)43, although progress has been made44,45.”
From Towards end-to-end automation of AI research (2026) · cites this paper as [41]
In the citing paper
“Divergence between epistemic standards seems entirely legitimate, for instance, given widespread debates about the soundness and robustness of machine learning models”
From Algorithmic Accountability and Public Reason (2018) · cites this paper as Nguyen, Yosinski, & Clune, 2015
In the citing paper
“This simply implies that domestic legislation must serve as the principal source for the substantive law relating to the use of AI in space [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“Liability under the space law treaty regime is grounded in Outer Space Treaty (OST) Article VIII, which is the genesis of the Liability Convention [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“There are no international or space treaties that address or regulate the use of AI in space.”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Multi-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 17,323
(2010) · International Conference on Machine Learning · Cited by 13,995
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Research works printed but not linked: 2
- erhan, 2009, Visualizing higher-layer features of a deep network, Dept IRO Universite de Montreal Tech Rep
- mouret, 2010, Sferes v2: Evolvin'in the multi-core world, Evolutionary Computation (CEC) 2010 IEEE Congress on, 4079
Cited by
Items 101–200 of 1,015
Artificial intelligence in drug discovery: recent advances and future perspectives
Jiménez-Luna, J., Grisoni, F., Weskamp, N., & Schneider, G. (2021) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2021.1909567 · Cited by 464
Algorithmic Accountability and Public Reason
Binns, R. (2018) · Philosophy & Technology · doi:10.1007/s13347-017-0263-5 · Cited by 457
Wang, G. (2016) · IEEE Access · doi:10.1109/access.2016.2624938 · Cited by 455
Deep Learning in Mining Biological Data
Mahmud, M., Kaiser, M. S., McGinnity, T. M., & Hussain, A. (2021) · Cognitive Computation · doi:10.1007/s12559-020-09773-x · Cited by 446
Explainable Deep Learning: A Field Guide for the Uninitiated
Ras, G., Xie, N., Van Gerven, M., & Doran, D. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13200 · Cited by 446
Robust Physical-World Attacks on Deep Learning Models
Eykholt, K., Evtimov, I., Fernandes, E., Li, B., Rahmati, A., Xiao, C., Prakash, A., Kohno, T., & Song, D. X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.08945 · Cited by 444
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
Bai, Y., Jones, A., Ndousse, K., Askell, A., Chen, A., DasSarma, N., Drain, D., Fort, S., Ganguli, D., Henighan, T., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.05862 · Cited by 442
See through Gradients: Image Batch Recovery via GradInversion
Yin, H., Mallya, A., Vahdat, A., Alvarez, J. M., Kautz, J., & Molchanov, P. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01607 · Cited by 440
Characterizing Adversarial Subspaces Using Local Intrinsic Dimensionality
Ma, X., Li, B., Wang, Y., Erfani, S., Wijewickrema, S. N. R., Schoenebeck, G. R., Song, D. X., Houle, M. E., & Bailey, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.02613 · Cited by 440
Hein, M., Andriushchenko, M., & Bitterwolf, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00013 · Cited by 428
VOS: Learning What You Don't Know by Virtual Outlier SynthesisPreprint
Du, X., Wang, Z., Cai, M., & Li, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.01197 · Cited by 424
A Survey on Security Threats and Defensive Techniques of Machine Learning: A Data Driven View
Liu, Q., Li, P., Zhao, W., Cai, W., Yu, S., & Leung, V. C. M. (2018) · IEEE Access · doi:10.1109/access.2018.2805680 · Cited by 421
Selecting training sets for support vector machines: a review
Nalepa, J., & Kawulok, M. (2019) · Artificial Intelligence Review · doi:10.1007/s10462-017-9611-1 · Cited by 419
Morocho-Cayamcela, M. E., Lee, H., & Lim, W. (2019) · IEEE Access · doi:10.1109/access.2019.2942390 · Cited by 418
Energy-based Out-of-distribution Detection
Liu, W., Wang, X., Owens, J. D., & Li, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03759 · Cited by 412
Understanding Neural Networks through Representation Erasure
Li, J., Monroe, W., & Jurafsky, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.08220 · Cited by 412
Analysis of Explainers of Black Box Deep Neural Networks for Computer Vision: A Survey
Buhrmester, V., Münch, D., & Arens, M. (2021) · Machine Learning and Knowledge Extraction · doi:10.3390/make3040048 · Cited by 403
Toward an Ethics of Algorithms: Convening, Observation, Probability, and Timeliness
Ananny, M. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915606523 · Cited by 395
“Computer scientists recently produced ‘‘images that are completely unrecognizable to humans, but that state-of-the art [deep neural networks] believe to be recognizable objects with 99.99 % confidence’’ (Nguyen, Yosinski, and Clune 2014, 1).”
BackgroundInfluentialSafetyNet: Detecting and Rejecting Adversarial Examples Robustly
Lu, J., Issaranon, T., & Forsyth, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.56 · Cited by 384
Deep Text Classification Can be Fooled
Liang, B., Li, H., Su, M., Bian, P., Li, X., & Shi, W. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/585 · Cited by 370
Structural Test Coverage Criteria for Deep Neural Networks
Sun, Y., Huang, X., Kroening, D., Sharp, J. J., Hill, M., & Ashmore, R. (2019) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3358233 · Cited by 363
Rajalingham, R., Issa, E. B., Bashivan, P., Kar, K., Schmidt, K., & DiCarlo, J. J. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0388-18.2018 · Cited by 358
Shaham, U., Yamada, Y., & Negahban, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.04.027 · Cited by 355
Multiscale Modeling Meets Machine Learning: What Can We Learn?
Peng, G. C. Y., Alber, M., Buganza Tepole, A., Cannon, W. R., De, S., Dura-Bernal, S., Garikipati, K., Karniadakis, G., Lytton, W. W., Perdikaris, P., et al. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-020-09405-5 · Cited by 353
Generative Adversarial Perturbations
Poursaeed, O., Katsman, I., Gao, B., & Belongie, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00465 · Cited by 352
Adversarial Examples Detection in Deep Networks with Convolutional Filter Statistics
Li, X., & Li, F. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.615 · Cited by 347
Deep convolutional networks do not classify based on global object shape
Baker, N., Lu, H., Erlikhman, G., & Kellman, P. J. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006613 · Cited by 345
TextBugger: Generating Adversarial Text Against Real-world Applications
Li, J., Ji, S., Du, T., Li, B., & Wang, T. (2019) · Proceedings 2019 Network and Distributed System Security Symposium · doi:10.14722/ndss.2019.23138 · Cited by 343
Why deep-learning AIs are so easy to fool
Heaven, D. (2019) · Nature · doi:10.1038/d41586-019-03013-5 · Cited by 342
Ecoffet, A., Huizinga, J., Lehman, J., Stanley, K. O., & Clune, J. (2021) · Nature · doi:10.1038/s41586-020-03157-9 · Cited by 330
Self-citationMultimodal Neurons in Artificial Neural Networks
Goh, G., Cammarata, N., Voss, C., Carter, S., Petrov, M., Schubert, L., Radford, A., & Olah, C. (2021) · Distill · doi:10.23915/distill.00030 · Cited by 330
On the (Statistical) Detection of Adversarial Examples
Grosse, K., Manoharan, P., Papernot, N., Michael Backes, A., & McDaniel, P. D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.06280 · Cited by 330
Interpreting Deep Visual Representations via Network Dissection
Zhou, B., Bau, D., Oliva, A., & Torralba, A. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858759 · Cited by 330
Robustness May Be at Odds with Accuracy
Tsipras, D., Santurkar, S., Engstrom, L., Turner, A., & Mądry, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12152 · Cited by 327
DICE: Leveraging Sparsification for Out-of-Distribution Detection
Sun, Y., & Li, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20053-3_40 · Cited by 327
Learning Confidence for Out-of-Distribution Detection in Neural Networks
DeVries, T., & Taylor, G. W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04865 · Cited by 326
Deep Variational Information Bottleneck
Alemi, A. A., Fischer, I., Dillon, J. V., & Murphy, K. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00410 · Cited by 321
Recent advances in deep learning
Wang, X., Zhao, Y., & Pourpanah, F. (2020) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-020-01096-5 · Cited by 321
A Review on Conventional Machine Learning vs Deep Learning
Chauhan, N. K., & Singh, K. (2018) · 2018 International Conference on Computing, Power and Communication Technologies (GUCON) · doi:10.1109/gucon.2018.8675097 · Cited by 319
Administration by Algorithm? Public Management meets Public Sector Machine Learning
Veale, M., & Brass, I. (2019) · doi:10.31235/osf.io/mwhnb · Cited by 316
“Given that models can fail in unexpected ways (such as being ‘fooled’, as the domain of adversarial machine learning shows; see Nguyen et al. (2014)), it is unlikely that all potential aspects of salience and interest could be preempted in any set of metadata.”
Efficient Defenses Against Adversarial Attacks
Zantedeschi, V., Nicolae, M.-I., & Rawat, A. (2017) · Proceedings of the 10th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3128572.3140449 · Cited by 312
Deflecting Adversarial Attacks with Pixel Deflection
Prakash, A., Moran, N., Garber, S., DiLillo, A., & Storer, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00894 · Cited by 310
On the Performance of GoogLeNet and AlexNet Applied to Sketches
Ballester, P., & Araujo, R. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10171 · Cited by 308
Extremely Simple Activation Shaping for Out-of-Distribution DetectionPreprint
Djurisic, A., Bozanic, N., Ashok, A., & Liu, R. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.09858 · Cited by 308
Certifying Some Distributional Robustness with Principled Adversarial Training
Sinha, A., Namkoong, H., Volpi, R., & Duchi, J. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.10571 · Cited by 307
AI and the Future of Skills, Volume 1: Capabilities and Assessments
OECD (2021) · Educational research and innovation · doi:10.1787/5ee71f34-en · Cited by 307
Survey on deep learning for radiotherapy
Meyer, P., Noblet, V., Mazzara, C., & Lallement, A. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2018.05.018 · Cited by 302
A Survey of Algorithmic Recourse: Contrastive Explanations and Consequential Recommendations
Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2023) · ACM Computing Surveys · doi:10.1145/3527848 · Cited by 301
Detecting Out-of-Distribution Examples with Gram Matrices
Sastry, C. S., & Oore, S. (2020) · International Conference on Machine Learning · Cited by 299
Byra, M., Styczynski, G., Szmigielski, C., Kalinowski, P., Michałowski, Ł., Paluszkiewicz, R., Ziarkiewicz-Wróblewska, B., Zieniewicz, K., Sobieraj, P., & Nowicki, A. (2018) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-018-1843-2 · Cited by 294
CNN-Based Adversarial Embedding for Image Steganography
Tang, W., Li, B., Tan, S., Barni, M., & Huang, J. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2891237 · Cited by 292
Zoom In: An Introduction to Circuits
Olah, C., Cammarata, N., Schubert, L., Goh, G., Petrov, M., & Carter, S. (2020) · Distill · doi:10.23915/distill.00024.001 · Cited by 288
Analysis of classifiers’ robustness to adversarial perturbations
Fawzi, A., Fawzi, O., & Frossard, P. (2018) · Machine Learning · doi:10.1007/s10994-017-5663-3 · Cited by 287
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Bansal, G., Nushi, B., Kamar, E., Weld, D. S., Lasecki, W. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33012429 · Cited by 284
“Unfortunately, confidence scores of ML classifiers are often not calibrated (Nguyen, Yosinski, and Clune 2015) or a meaningful confidence definition may not exist due to the complexity of the task.”
BackgroundAdversarial Robustness as a Prior for Learned RepresentationsPreprint
Engstrom, L., Ilyas, A., Santurkar, S., Tsipras, D., Tran, B., & Mądry, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00945 · Cited by 284
Experimental evidence of effective human–AI collaboration in medical decision-making
Reverberi, C., Rigon, T., Solari, A., Hassan, C., Cherubini, P., GI Genius CADx Study Group, Antonelli, G., Awadie, H., Bernhofer, S., Carballal, S., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-18751-2 · Cited by 281
Mitigating Neural Network Overconfidence with Logit NormalizationPreprint
Wei, H., Xie, R., Cheng, H., Feng, L., An, B., & Li, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.09310 · Cited by 280
A Trilateral Weighted Sparse Coding Scheme for Real-World Image Denoising
Xu, J., Zhang, L., & Zhang, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_2 · Cited by 278
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation
Pan, X., Zhan, X., Dai, B., Lin, D., Loy, C. C., & Luo, P. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3115428 · Cited by 277
Machine Learning in Genomic Medicine: A Review of Computational Problems and Data Sets
Leung, M. K. K., Delong, A., Alipanahi, B., & Frey, B. J. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494198 · Cited by 275
Artificial Intelligence and Patient-Centered Decision-Making
Bjerring, J. C., & Busch, J. (2021) · Philosophy & Technology · doi:10.1007/s13347-019-00391-6 · Cited by 274
XGNN: Towards Model-Level Explanations of Graph Neural Networks
Yuan, H., Tang, J., Hu, X., & Ji, S. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403085 · Cited by 272
Adversarial Attacks Against Automatic Speech Recognition Systems via Psychoacoustic Hiding
Schonherr, L., Kohls, K., Zeiler, S., Holz, T., & Kolossa, D. (2019) · Proceedings 2019 Network and Distributed System Security Symposium · doi:10.14722/ndss.2019.23288 · Cited by 270
Lambert, B., Forbes, F., Doyle, S., Dehaene, H., & Dojat, M. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102830 · Cited by 269
A deep learning approach to traffic lights: Detection, tracking, and classification
Behrendt, K., Novak, L., & Botros, R. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989163 · Cited by 269
Deep Learning: The Good, the Bad, and the Ugly
Serre, T. (2019) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091718-014951 · Cited by 267
SVM or deep learning? A comparative study on remote sensing image classification
Liu, P., Choo, K.-K. R., Wang, L., & Huang, F. (2017) · Soft Computing · doi:10.1007/s00500-016-2247-2 · Cited by 267
Formal Security Analysis of Neural Networks using Symbolic Intervals
Wang, S., Pei, K., Whitehouse, J., Yang, J., & Jana, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.10829 · Cited by 265
Combustion machine learning: Principles, progress and prospects
Ihme, M., Chung, W. T., & Mishra, A. A. (2022) · Progress in Energy and Combustion Science · doi:10.1016/j.pecs.2022.101010 · Cited by 265
A taxonomy and survey of attacks against machine learning
Pitropakis, N., Panaousis, E., Giannetsos, T., Anastasiadis, E., & Loukas, G. (2019) · Computer Science Review · doi:10.1016/j.cosrev.2019.100199 · Cited by 263
Waytowich, N., Lawhern, V. J., Garcia, J. O., Cummings, J., Faller, J., Sajda, P., & Vettel, J. M. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aae5d8 · Cited by 262
To Trust Or Not To Trust A Classifier
Jiang, H., Kim, B., Guan, M. Y., & Gupta, M. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.11783 · Cited by 262
Towards trustworthy machine fault diagnosis: A probabilistic Bayesian deep learning framework
Zhou, T., Han, T., & Droguett, E. L. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.108525 · Cited by 260
Quality and Diversity Optimization: A Unifying Modular Framework
Cully, A., & Demiris, Y. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2704781 · Cited by 258
Qayyum, A., Usama, M., Qadir, J., & Al-Fuqaha, A. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2975048 · Cited by 257
“In another study, the authors demonstrated that adversarial images are very easy to be constructed using evolutionary algorithms or gradient ascent [100].”
BackgroundA review of hybrid deep learning applications for streamflow forecasting
Ng, K. W., Huang, Y. F., Koo, C. H., Chong, K. L., El‐Shafie, A., & Ahmed, A. N. (2023) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.130141 · Cited by 257
Explainable AI for Designers: A Human-Centered Perspective on Mixed-Initiative Co-Creation
Zhu, J., Liapis, A., Risi, S., Bidarra, R., & Youngblood, G. M. (2018) · 2018 IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2018.8490433 · Cited by 255
Han, T., & Li, Y.-F. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.108648 · Cited by 255
Deep Learning for Detecting Building Defects Using Convolutional Neural Networks
Perez, H., Tah, J. H. M., & Mosavi, A. (2019) · Sensors · doi:10.3390/s19163556 · Cited by 253
Explainable Reinforcement Learning: A Survey
Puiutta, E., & Veith, E. M. S. P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-57321-8_5 · Cited by 252
Adversarial machine learning in Network Intrusion Detection Systems
Alhajjar, E., Maxwell, P., & Bastian, N. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115782 · Cited by 251
Medical deep learning—A systematic meta-review
Egger, J., Gsaxner, C., Pepe, A., Pomykala, K. L., Jonske, F., Kurz, M., Li, J., & Kleesiek, J. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106874 · Cited by 251
Strike (With) a Pose: Neural Networks Are Easily Fooled by Strange Poses of Familiar Objects
Alcorn, M. A., Li, Q., Gong, Z., Wang, C., Mai, L., Ku, W.-S., & Nguyen, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00498 · Cited by 250
Self-citationBag of Tricks for Adversarial TrainingPreprint
Pang, T., Yang, X. H., Dong, Y., Su, H., & Zhu, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.00467 · Cited by 249
Geometry-aware Instance-reweighted Adversarial TrainingPreprint
Zhang, J., Zhu, J., Niu, G., Han, B., Sugiyama, M., & Kankanhalli, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01736 · Cited by 249
Fast Feature Fool: A data independent approach to universal adversarial perturbations
Reddy, K. R., Garg, U., & Babu, R. V. (2017) · British Machine Vision Conference (BMVC) · doi:10.5244/c.31.30 · Cited by 248
Reachability Analysis of Deep Neural Networks with Provable Guarantees
Ruan, W., Huang, X., & Kwiatkowska, M. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/368 · Cited by 246
Deep learning and radiomics in precision medicine
Parekh, V. S., & Jacobs, M. A. (2019) · Expert Review of Precision Medicine and Drug Development · doi:10.1080/23808993.2019.1585805 · Cited by 246
Pathologies of Neural Models Make Interpretations Difficult
Feng, S., Wallace, E., Grissom II, A., Iyyer, M., Rodriguez, P., & Boyd-Graber, J. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1407 · Cited by 245
Knowledge Transfer for Rotary Machine Fault Diagnosis
Yan, R., Shen, F., Sun, C., & Chen, X. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2949057 · Cited by 245
Scenic: a language for scenario specification and scene generation
Fremont, D. J., Dreossi, T., Ghosh, S., Yue, X., Sangiovanni-Vincentelli, A. L., & Seshia, S. A. (2019) · Proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/3314221.3314633 · Cited by 241
Hallucinating symmetric protein assemblies
Wicky, B. I. M., Milles, L. F., Courbet, A., Ragotte, R. J., Dauparas, J., Kinfu, E., Tipps, S., Kibler, R. D., Baek, M., DiMaio, F., et al. (2022) · Science · doi:10.1126/science.add1964 · Cited by 240
Toward Intelligent Vehicular Networks: A Machine Learning Framework
Liang, L., Ye, H., & Li, G. Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2872122 · Cited by 240
Seq2seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Models
Strobelt, H., Gehrmann, S., Behrisch, M., Perer, A., Pfister, H., & Rush, A. M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2865044 · Cited by 239
On the Importance of Gradients for Detecting Distributional Shifts in the WildPreprint
Huang, R., Geng, A., & Li, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.00218 · Cited by 239
Self-Knowledge Distillation with Progressive Refinement of Targets
Kim, K., Ji, B., Yoon, D., & Hwang, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00650 · Cited by 237
CLIPN for Zero-Shot OOD Detection: Teaching CLIP to Say No
Wang, H., Li, Y., Yao, H., & Li, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00173 · Cited by 236
NIC: Detecting Adversarial Samples with Neural Network Invariant Checking
Ma, S., Liu, Y., Tao, G., Lee, W.-C., & Zhang, X. (2019) · Proceedings 2019 Network and Distributed System Security Symposium · doi:10.14722/ndss.2019.23415 · Cited by 235
Adversarial Texture for Fooling Person Detectors in the Physical World
Hu, Z., Huang, S., Zhu, X., Sun, F., Zhang, B., & Hu, X. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01295 · Cited by 235
Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encoderPreprint
Xiao, Z., Yan, Q. Y., & Amit, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.02977 · Cited by 234
Metadata
- Authors
- Nguyen, A., Yosinski, J., & Clune, J.
- Affiliations
- University of Wyoming (US)
- Cornell University (US)
- ORCID
- Clune, Jeff
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 427-436
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1932198206
- Cited by
- 3,258
- References
- 35
- Citations by year
- 2026: 73 · 2025: 210 · 2024: 313 · 2023: 323 · 2022: 318 · 2021: 460 · 2020: 401 · 2019: 407 · 2018: 348 · 2017: 211 · 2016: 124 · 2015: 60
- FWCI
- 139.54
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Aeronautics and Space Administration
- University of Wyoming
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- deep neural network robustness, adversarial examples, evolutionary algorithms, gradient ascent, ImageNet, MNIST, visual categorization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.