Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Open accessThe DOI matches its Crossref record; 33 of the 35 references it cites were found in a registry or an index.
Abstract
Deep neural networks (DNNs) have recently been achieving state-of-the-art performance on a variety of pattern-recognition tasks, most notably visual classification problems. Given that DNNs are now able to classify objects in images with near-human-level performance, questions naturally arise as to what differences remain between computer and human vision. A recent study [30] revealed that changing an image (e.g. of a lion) in a way imperceptible to humans can cause a DNN to label the image as something else entirely (e.g. mislabeling a lion a library). Here we show a related result: it is easy to produce images that are completely unrecognizable to humans, but that state-of-the-art DNNs believe to be recognizable objects with 99.99% confidence (e.g. labeling with certainty that white noise static is a lion). Specifically, we take convolutional neural networks trained to perform well on either the ImageNet or MNIST datasets and then find images with evolutionary algorithms or gradient ascent that DNNs label with high confidence as belonging to each dataset class. It is possible to produce images totally unrecognizable to human eyes that DNNs believe with near certainty are familiar objects, which we call “fooling images” (more generally, fooling examples). Our results shed light on interesting differences between human vision and current DNNs, and raise questions about the generality of DNN computer vision.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, some AI weaknesses have proved surprisingly difficult to solve, such as AI being easily fooled41,42 and overconfidently wrong (hallucinations)43, although progress has been made44,45.”
From Towards end-to-end automation of AI research (2026) · cites this paper as [41]
In the citing paper
“Divergence between epistemic standards seems entirely legitimate, for instance, given widespread debates about the soundness and robustness of machine learning models”
From Algorithmic Accountability and Public Reason (2018) · cites this paper as Nguyen, Yosinski, & Clune, 2015
In the citing paper
“This simply implies that domestic legislation must serve as the principal source for the substantive law relating to the use of AI in space [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“Liability under the space law treaty regime is grounded in Outer Space Treaty (OST) Article VIII, which is the genesis of the Liability Convention [245].”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
In the citing paper
“There are no international or space treaties that address or regulate the use of AI in space.”
From Applications and Challenges of Artificial Intelligence in Space Missions (2024) · cites this paper as [245]
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Multi-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 17,323
(2010) · International Conference on Machine Learning · Cited by 13,995
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Research works printed but not linked: 2
- erhan, 2009, Visualizing higher-layer features of a deep network, Dept IRO Universite de Montreal Tech Rep
- mouret, 2010, Sferes v2: Evolvin'in the multi-core world, Evolutionary Computation (CEC) 2010 IEEE Congress on, 4079
Cited by
Items 701–800 of 1,015
Adaptive iterative attack towards explainable adversarial robustness
Shi, Y., Han, Y., Zhang, Q., & Kuang, X. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107309 · Cited by 63
The Future Role of Machine Learning in Clinical Transplantation
Connor, K. L., O'Sullivan, E. D., Marson, L., Wigmore, S. J., & Harrison, E. M. (2020) · Transplantation · doi:10.1097/tp.0000000000003424 · Cited by 63
Ignorance and the regulation of artificial intelligence
White, J. M., & Lidskog, R. (2021) · Journal of Risk Research · doi:10.1080/13669877.2021.1957985 · Cited by 62
Fairify: Fairness Verification of Neural Networks
Biswas, S., & Rajan, H. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00134 · Cited by 62
On the vulnerability of deep learning to adversarial attacks for camera model identification
Marra, F., Gragnaniello, D., & Verdoliva, L. (2018) · Signal Processing Image Communication · doi:10.1016/j.image.2018.04.007 · Cited by 62
The Limitations of Deep Learning in Adversarial Settings
Papernot, N., McDaniel, P. D., Jha, S., Fredrikson, M., Celik, Z. B., & Swami, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.07528 · Cited by 61
Identify Susceptible Locations in Medical Records via Adversarial Attacks on Deep Predictive Models
Sun, M., Tang, F., Yi, J., Wang, F., & Zhou, J. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219909 · Cited by 61
Diversified Outlier Exposure for Out-of-Distribution Detection via Informative Extrapolation
Zhu, J., Geng, Y., Yao, J., Liu, T., Niu, G., Sugiyama, M., & Han, B. (2023) · neural information processing systems · doi:10.52202/075280-0985 · Cited by 61
With Friends Like These, Who Needs Adversaries?
Jetley, S., Lord, N. A., & Torr, P. H. S. (2018) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.1807.04200 · Cited by 61
Standard detectors aren't (currently) fooled by physical adversarial stop signsPreprint
Lu, J., Sibai, H., Fabry, E., & Forsyth, D. A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.03337 · Cited by 61
How Well do Feature Visualizations Support Causal Understanding of CNN Activations?Preprint
Zimmermann, R. S., Borowski, J., Geirhos, R., Bethge, M., Wallis, T. S. A., & Brendel, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12447 · Cited by 61
Adversarial Manipulation of Deep Representations
Sabour, S., Cao, Y., Faghri, F., & Fleet, D. J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05122 · Cited by 60
Generative Adversarial Frontal View to Bird View Synthesis
Zhu, X., Yin, Z., Shi, J., Li, H., & Lin, D. (2018) · 2018 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2018.00059 · Cited by 60
Multimedia and Medicine: Teammates for Better Disease Detection and Survival
Riegler, M. A., Lux, M., Griwodz, C., Spampinato, C., de Lange, T., Eskeland, S. L., Pogorelov, K., Tavanapong, W., Schmidt, P. T., Gurrin, C. G., et al. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2976760 · Cited by 60
Pal, B., Gupta, D., Rashed-Al-Mahfuz, M., Alyami, S. A., & Moni, M. A. (2021) · Applied Sciences · doi:10.3390/app11094233 · Cited by 60
Tian, J., Han, D., Karimi, H. R., Zhang, Y., & Shi, P. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106167 · Cited by 60
Optimizing Relevance Maps of Vision Transformers Improves Robustness
Chefer, H., Schwartz, I., & Wolf, L. (2022) · neural information processing systems · doi:10.52202/068431-2436 · Cited by 60
Deep Knowledge Training and Heterogeneous CNN for Handwritten Chinese Text Recognition
Wang, S., Chen, L., Xu, L., Fan, W., Sun, J., & Naoi, S. (2016) · International Conference on Frontiers in Handwriting Recognition · doi:10.1109/icfhr.2016.0028 · Cited by 60
Machine learning will transform radiology significantly within the next 5 years
Wang, G., Kalra, M. K., & Orton, C. G. (2017) · Medical Physics · doi:10.1002/mp.12204 · Cited by 60
Adversarial Defense Through Network Profiling Based Path Extraction
Qiu, Y., Leng, J., Guo, C., Chen, Q., Li, C., Guo, M., & Zhu, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00491 · Cited by 60
Pan, W., Torres‐Verdín, C., & Pyrcz, M. J. (2020) · Natural Resources Research · doi:10.1007/s11053-020-09778-1 · Cited by 60
Recent advances in deep learning theoryPreprint
He, F., & Tao, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.10931 · Cited by 60
Model metamers reveal divergent invariances between biological and artificial neural networks
Feather, J., Leclerc, G., Mądry, A., & McDermott, J. H. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01442-0 · Cited by 59
Mixup Inference: Better Exploiting Mixup to Defend Adversarial Attacks
Pang, T., Xu, K., & Zhu, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11515 · Cited by 59
Alignment for Advanced Machine Learning Systems
Taylor, J., Yudkowsky, E., LaVictoire, P., & Critch, A. (2020) · Ethics of Artificial Intelligence · doi:10.1093/oso/9780190905033.003.0013 · Cited by 59
A Powerful Generative Model Using Random Weights for the Deep Image Representation
He, K., Wang, Y., & Hopcroft, J. (2016) · arXiv · doi:10.48550/arxiv.1606.04801 · Cited by 59
Probabilistic photonic computing with chaotic light
Brückerhoff‐Plückelmann, F., Borras, H., Klein, B., Varri, A., Becker, M., Dijkstra, J., Brückerhoff, M., Wright, C. D., Salinga, M., Bhaskaran, H., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-54931-6 · Cited by 59
Xie, P., Bie, Y., Mao, J., Song, Y., Wang, Y., Chen, H., & Chen, K. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01368 · Cited by 59
Treant: training evasion-aware decision trees
Calzavara, S., Lucchese, C., Tolomei, G., Abebe, S. A., & Orlando, S. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00694-9 · Cited by 59
Explanations for Attributing Deep Neural Network Predictions
Fong, R., & Vedaldi, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_8 · Cited by 59
Zang, B., Lin, Y., Liu, Z., & Gao, X. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac1610 · Cited by 59
Adversarial robustness assessment: Why in evaluation both L0 and L∞ attacks are necessary
Kotyan, S., & Vargas, D. V. (2022) · PLoS ONE · doi:10.1371/journal.pone.0265723 · Cited by 59
Gradient-Based Uncertainty for Monocular Depth Estimation
Hornauer, J., & Belagiannis, V. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20044-1_35 · Cited by 59
Max-Mahalanobis Linear Discriminant Analysis NetworksPreprint
Pang, T., Du, C., & Zhu, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09308 · Cited by 59
Detecting Out-of-Distribution Inputs in Deep Neural Networks Using an Early-Layer OutputPreprint
Abdelzad, V., Czarnecki, K., Salay, R., Denounden, T., Vernekar, S., & Phan, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.10307 · Cited by 59
Boundary thickness and robustness in learning modelsPreprint
Yang, Y. L., Khanna, R., Yu, Y., Gholami, A., Keutzer, K., Gonzalez, J. E., Ramchandran, K., & Mahoney, M. W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05086 · Cited by 59
MetaFinger: Fingerprinting the Deep Neural Networks with Meta-training
Yang, K., Wang, R., & Wang, L. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/109 · Cited by 58
AI: Unexplainable, Unpredictable, Uncontrollable
Yampolskiy, R. V. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003440260 · Cited by 58
Fundamental limits on adversarial robustness
Fawzi, A., Fawzi, O., & Frossard, P. (2015) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 58
Attack and Defense of Dynamic Analysis-Based, Adversarial Neural Malware Detection Models
Stokes, J. W., De, W., Marinescu, M., Marino, M., & Bussone, B. (2018) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom.2018.8599855 · Cited by 58
Are open set classification methods effective on large-scale datasets?
Roady, R., Hayes, T. L., Kemker, R., Gonzales, A., & Kanan, C. (2020) · PLoS ONE · doi:10.1371/journal.pone.0238302 · Cited by 58
SINVAD: Search-based Image Space Navigation for DNN Image Classifier Test Input Generation
Kang, S., FELDT, R. H., & Yoo, S. (2020) · doi:10.1145/3387940.3391456 · Cited by 57
Kim, H., Crow, W. T., Li, X., Wagner, W., Hahn, S., & Lakshmi, V. (2023) · Remote Sensing of Environment · doi:10.1016/j.rse.2023.113776 · Cited by 57
NeuroDiff: scalable differential verification of neural networks using fine-grained approximation
Paulsen, B., Wang, J., Wang, J., & Wang, C. (2020) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3324884.3416560 · Cited by 57
AVN: An Adversarial Variation Network Model for Handwritten Signature Verification
Li, H., Wei, P., & Hu, P. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3056217 · Cited by 57
Visual Representations: Defining Properties and Deep ApproximationsPreprint
Soatto, S., & Chiuso, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.7676 · Cited by 57
Learning Visually-Grounded Semantics from Contrastive Adversarial SamplesPreprint
Shi, H., Mao, J., Xiao, T., Jiang, Y., & Sun, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.10348 · Cited by 57
Saha, M., Fiannaca, A. J., Kneisel, M., Cutrell, E., & Morris, M. R. (2019) · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3308561.3353776 · Cited by 56
Spurious Features Everywhere - Large-Scale Detection of Harmful Spurious Features in ImageNet
Neuhaus, Y., Augustin, M., Boreiko, V., & Hein, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01851 · Cited by 56
Allah, M. A.-A., Toor, I., Shams, A., & Siddiqui, O. K. (2024) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-024-09388-6 · Cited by 56
Malhotra, G., Evans, B. D., & Bowers, J. S. (2020) · Vision Research · doi:10.1016/j.visres.2020.04.013 · Cited by 56
A Hybrid Deep Learning Construct for Detecting Keratoconus From Corneal Maps
Al-Timemy, A. H., Mosa, Z. M., Alyasseri, Z. A. A., Lavric, A., Lui, M. M., Hazarbassanov, R. M., & Yousefi, S. (2021) · Translational Vision Science & Technology · doi:10.1167/tvst.10.14.16 · Cited by 56
Continual Learning in Neural NetworksPreprint
Aljundi, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.02718 · Cited by 56
Adversarial Training Helps Transfer Learning via Better RepresentationsPreprint
Deng, Z., Zhang, L., Vodrahalli, K., Kawaguchi, K., & Zou, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.10189 · Cited by 56
Automating Ambiguity: Challenges and Pitfalls of Artificial IntelligencePreprint
Birhane, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.04179 · Cited by 56
From Global to Local: Multi-Scale Out-of-Distribution Detection
Zhang, J., Gao, L., Hao, B., Huang, H., Song, J., & Shen, H. T. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3328478 · Cited by 55
Xu, Y., Tang, J., Men, A., & Chen, Q. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3482175 · Cited by 55
From Transparency to Accountability and Back: A Discussion of Access and Evidence in AI Auditing
Cen, S. H., & Alur, R. (2024) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3689904.3694711 · Cited by 55
Unlocking Feature Visualization for Deep Network with MAgnitude Constrained Optimization
Fel, T., Boissin, T., Boutin, V., Picard, A. M., Novello, P., Colin, J., Linsley, D. A., Rousseau, T., Cadène, R., Goetschalckx, L., et al. (2023) · neural information processing systems · doi:10.52202/075280-1646 · Cited by 55
Enhancing camera surveillance using computer vision: a research note
Idrees, H., Shah, M. A., & Surette, R. (2018) · Policing An International Journal · doi:10.1108/pijpsm-11-2016-0158 · Cited by 55
Trentesaux, D., Dahyot, R., Ouedraogo, K. A., Arenas, D., Lefebvre, S., Schön, W., Lussier, B., & Cheritel, H. (2018) · International Conference on System of Systems Engineering · doi:10.1109/sysose.2018.8428771 · Cited by 55
Automated OCT angiography image quality assessment using a deep learning algorithm
Lauermann, J. L., Treder, M., Alnawaiseh, M., Clemens, C. R., Eter, N., & Alten, F. (2019) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-019-04338-7 · Cited by 55
Density Estimation in Representation Space to Predict Model Uncertainty
Ramalho, T., & Miranda, M. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-62144-5_7 · Cited by 55
Testing DNN image classifiers for confusion & bias errors
Tian, Y., Zhong, Z., Ordóñez, V., Kaiser, G. E., & Ray, B. (2020) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3377811.3380400 · Cited by 55
Detection of gravitational waves using Bayesian neural networks
Lin, Y.-C., & Wu, J.-H. P. (2021) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.103.063034 · Cited by 55
Increasing stimulus similarity drives nonmonotonic representational change in hippocampus
Wammes, J. D., Norman, K. A., & Turk‐Browne, N. B. (2022) · eLife · doi:10.7554/elife.68344 · Cited by 55
PyTorch-OOD: A Library for Out-of-Distribution Detection based on PyTorch
Kirchheim, K., Filax, M., & Ortmeier, F. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00481 · Cited by 55
End-to-end learning of multiple sequence alignments with differentiable Smith–Waterman
Petti, S., Bhattacharya, N., Rao, R., Dauparas, J., Thomas, N., Zhou, J., Rush, A. M., Koo, P., & Ovchinnikov, S. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btac724 · Cited by 54
Graying the black box: Understanding DQNs
Zahavy, T., Ben-Zrihem, N., & Mannor, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02658 · Cited by 54
Benchmarking Deep Learning Frameworks: Design Considerations, Metrics and Beyond
Liu, L., Wu, Y., Wei, W., Cao, W., Sahin, S., & Zhang, Q. (2018) · 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2018.00125 · Cited by 54
Explaining Explanation, Part 4: A Deep Dive on Deep Nets
Hoffman, R., Miller, T., Mueller, S. T., Klein, G., & Clancey, W. J. (2018) · IEEE Intelligent Systems · doi:10.1109/mis.2018.033001421 · Cited by 54
A task-and-technique centered survey on visual analytics for deep learning model engineering
Garcia, R., Telea, A. C., Castro da Silva, B., Tørresen, J., & Dihl Comba, J. L. (2018) · Computers & Graphics · doi:10.1016/j.cag.2018.09.018 · Cited by 54
Out-of-distribution Detection Learning with Unreliable Out-of-distribution Sources
Zheng, H., Wang, Q., Fang, Z., Xia, X., Liu, T., Liu, T., & Han, B. (2023) · neural information processing systems · doi:10.52202/075280-3156 · Cited by 54
Rodner, E., Simon, M., Fisher, R. B., & Denzler, J. (2016) · British Machine Vision Conference (BMVC) · doi:10.5244/c.30.60 · Cited by 54
Visual shape perception as Bayesian inference of 3D object-centered shape representations.
Erdogan, G., & Jacobs, R. A. (2017) · Psychological Review · doi:10.1037/rev0000086 · Cited by 54
Visualizing deep neural network by alternately image blurring and deblurring
Feng, W., Liu, H., & Cheng, J. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.09.007 · Cited by 54
SPLASH: Learnable activation functions for improving accuracy and adversarial robustness
Tavakoli, M., Agostinelli, F., & Baldi, P. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.02.023 · Cited by 54
The effect of machine learning explanations on user trust for automated diagnosis of COVID-19
Goel, K., Sindhgatta, R., Kalra, S., Goel, R., & Mutreja, P. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105587 · Cited by 54
Expert Gate: Lifelong Learning with a Network of ExpertsPreprint
Aljundi, R., Chakravarty, P., & Tuytelaars, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.06194 · Cited by 54
Samanta, R. K., Sadhukhan, B., Samaddar, H., Sarkar, S., Koner, C., & Ghosh, M. (2022) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.12114 · Cited by 53
OpenMix+: Revisiting Data Augmentation for Open Set Recognition
Jiang, G., Zhu, P., Wang, Y., & Hu, Q. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3268680 · Cited by 53
A Context Integrated Model for Multi-label Emotion Detection
Samy, A. E., El-Beltagy, S. R., & Hassanien, E. E. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.461 · Cited by 53
Open-Set Recognition with Gaussian Mixture Variational Autoencoders
Cao, A., Luo, Y., & Klabjan, D. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16848 · Cited by 53
ASTRAEA: Grammar-based Fairness Testing
Soremekun, E., Udeshi, S., & Chattopadhyay, S. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3141758 · Cited by 53
Robustifying models against adversarial attacks by Langevin dynamics
Srinivasan, V., Rohrer, C., Marbán, A., Müller, K., Samek, W., & Nakajima, S. (2021) · Neural Networks · doi:10.1016/j.neunet.2020.12.024 · Cited by 53
Multilayered review of safety approaches for machine learning-based systems in the days of AI
Dey, S., & Lee, S.-W. (2021) · Journal of Systems and Software · doi:10.1016/j.jss.2021.110941 · Cited by 53
Neuro-inspired edge feature fusion using Choquet integrals
Marco-Detchart, C., Lucca, G., López-Molina, C., Miguel, L. D., Dimuro, G. P., & Bustince, H. (2021) · Information Sciences · doi:10.1016/j.ins.2021.10.016 · Cited by 53
Hierarchical VAEs Know What They Don't KnowPreprint
Havtorn, J. D., Frellsen, J., Hauberg, S., & Maaløe, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.08248 · Cited by 53
Novel Class Discovery: an Introduction and Key ConceptsPreprint
Troisemaine, C., Lemaire, V., Gosselin, S., Reiffers-Masson, A., Flocon-Cholet, J., & Vaton, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.12028 · Cited by 53
Handling annotation uncertainty in human activity recognition
Kwon, H., Abowd, G. D., & Plötz, T. (2019) · Proceedings of the 23rd International Symposium on Wearable Computers · doi:10.1145/3341163.3347744 · Cited by 52
Carrle, F. P., Hollenbenders, Y., & Reichenbach, A. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1219133 · Cited by 52
Enhancing trustworthiness in ML-based network intrusion detection with uncertainty quantification
Talpini, J., Sartori, F., & Savi, M. (2024) · Journal of Reliable Intelligent Environments · doi:10.1007/s40860-024-00238-8 · Cited by 52
Ground Truth Data, Content, Metrics, and Analysis
Krig, S. (2014) · Apress eBooks · doi:10.1007/978-1-4302-5930-5_7 · Cited by 52
Ko, Y. S., Parkinson, J., Liu, C., & Wang, W. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae359 · Cited by 51
Wang, H., Cao, L., Huang, C., Jia, J., Dong, Y., Fan, C., & de Albuquerque, V. H. C. (2023) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2023.3297654 · Cited by 51
Adversarial Bayesian Augmentation for Single-Source Domain Generalization
Cheng, S., Gokhale, T., & Yang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01047 · Cited by 51
Understanding the Feature Norm for Out-of-Distribution Detection
Park, J., Chai, J. C. L., Yoon, J., & Teoh, A. B. J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00150 · Cited by 51
Design and Interpretation of Universal Adversarial Patches in Face Detection
Yang, X. H., Wei, F., Zhang, H., & Zhu, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58520-4_11 · Cited by 51
What have We Learned from Deep Representations for Action Recognition?
Pinz, A. J., Zisserman, A., Wildes, R. P., & Feichtenhofer, C. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00818 · Cited by 50
Nassar, I., Hayat, M., Abbasnejad, E., Rezatofighi, H., & Haffari, G. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01120 · Cited by 50
Metadata
- Authors
- Nguyen, A., Yosinski, J., & Clune, J.
- Affiliations
- University of Wyoming (US)
- Cornell University (US)
- ORCID
- Clune, Jeff
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 427-436
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1932198206
- Cited by
- 3,258
- References
- 35
- Citations by year
- 2026: 73 · 2025: 210 · 2024: 313 · 2023: 323 · 2022: 318 · 2021: 460 · 2020: 401 · 2019: 407 · 2018: 348 · 2017: 211 · 2016: 124 · 2015: 60
- FWCI
- 139.54
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Aeronautics and Space Administration
- University of Wyoming
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- deep neural network robustness, adversarial examples, evolutionary algorithms, gradient ascent, ImageNet, MNIST, visual categorization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.