Cited by 8,859Adversarial Robustness in Machine LearningSecurity and Verification in ComputingSoftware Testing and Debugging Techniques

The DOI matches its Crossref record; 43 of the 45 references it cites were found in a registry or an index.

Towards Evaluating the Robustness of Neural Networks

Open access
Carlini, Nicholas, Wagner, David·2017·2017 IEEE Symposium on Security and Privacy (SP)

Abstract

Neural networks provide state-of-the-art results for most machine learning tasks. Unfortunately, neural networks are vulnerable to adversarial examples: given an input x and any target classification t, it is possible to find a new input x' that is similar to x but classified as t. This makes it difficult to apply neural networks in security-critical areas. Defensive distillation is a recently proposed approach that can take an arbitrary neural network, and increase its robustness, reducing the success rate of current attacks' ability to find adversarial examples from 95% to 0.5%. In this paper, we demonstrate that defensive distillation does not significantly increase the robustness of neural networks by introducing three new attack algorithms that are successful on both distilled and undistilled neural networks with 100% probability. Our attacks are tailored to three distance metrics used previously in the literature, and when compared to previous adversarial example generation algorithms, our attacks are often much more effective (and never worse). Furthermore, we propose using high-confidence adversarial examples in a simple transferability test we show can also be used to break defensive distillation. We hope our attacks will be used as a benchmark in future defense attempts to create neural networks that resist adversarial examples.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/sp.2017.49

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Show all 45 references

2 of the 45 references couldn’t be matched to a known paper.

Research works printed but not linked: 9

  1. papernot, 0, cleverhans v1 0 0 an adversarial machine learning library
  2. goodfellow, 2014, Explaining and Harnessing Adversarial Examples
  3. 10.1109/MSP.2012.2205597 · DOI · Paper page
  4. lecun, 1998, The MNIST Database of Handwritten Digits
  5. bringing, 2016, big neural networks to self-driving cars smartphones and drones
  6. maas, 2013, Rectifier nonlinearities improve neural network acoustic models, Proc ICML, 30
  7. szegedy, 2015, Rethinking the inception architecture for computer vision
  8. warde-farley, 2016, Advanced Structured Prediction
  9. huang, 2016, Safety verification of deep neural networks

Cited by

Sorted by citations

Items 101–200 of 1,019

Metadata

Authors
Carlini, N., & Wagner, D.
Affiliations
University of California, Berkeley (US)
Venue
2017 IEEE Symposium on Security and Privacy (SP)
Publisher
IEEE
Published
2017-05
Pages
39-57
ISSN
1081-6011 (ISSN-L)
OpenAlex
W2516574342
Cited by
8,859
References
45
Citations by year
2026: 566 · 2025: 983 · 2024: 1222 · 2023: 1200 · 2022: 1111 · 2021: 1308 · 2020: 1181 · 2019: 801 · 2018: 393 · 2017: 86
FWCI
306.99
Type
conference paper
Language
en
Open access
Locations
  • IEEE Symposium on Security and Privacy (S&P) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • Cisco Systems
  • International Science and Technology Center
  • Multidisciplinary University Research Initiative (FA9550-12–1-0040)
  • Air Force Office of Scientific Research (FA9550-, FA9550-12, FA9550‐12‐1, FA9550-12-1-0040)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Hardware and Architecture › Security and Verification in Computing
  • Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
Keywords
adversarial examples, defensive distillation, adversarial attacks, neural network robustness, attack transferability, distance measures, robustness analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review