The DOI matches its Crossref record, with a small difference in title or year; 31 of the 31 references it cites were found in a registry or an index; 2 of the 14 sources its claims cite were checked for support.
ImageNet classification with deep convolutional neural networks
Open accessAbstract
We trained a large, deep convolutional neural network to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes. On the test data, we achieved top-1 and top-5 error rates of 37.5% and 17.0%, respectively, which is considerably better than the previous state-of-the-art. The neural network, which has 60 million parameters and 650,000 neurons, consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully connected layers with a final 1000-way softmax. To make training faster, we used non-saturating neurons and a very efficient GPU implementation of the convolution operation. To reduce overfitting in the fully connected layers we employed a recently developed regularization method called "dropout" that proved to be very effective. We also entered a variant of this model in the ILSVRC-2012 competition and achieved a winning top-5 test error rate of 15.3%, compared to 26.2% achieved by the second-best entry.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 of 14 cited sources checked · 2 supported · 0 flagged
Every source the paper cites for this claim was checked and supports it.
In the paper
“This technique reduces complex co adaptations of neurons, since a neuron cannot rely on the presence of particular other neurons.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.2. Dropout
What the sources say
- Supportedcites [12] 12. Hinton, G., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R. Improving neural networks by preventing co-adaptation of feature detectors. arXiv preprint arXiv:1207.0580 (2012). source
The paper states on p. 1 that dropout prevents complex co-adaptations by randomly omitting hidden units, so a hidden unit cannot rely on other hidden units being present. This directly supports the citing sentence. (LLM, conf=0.95)
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“There is, however, a very efficient version of model combination that only costs about a factor of two during training.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.2. Dropout
What the sources say
- Supportedcites [12] 12. Hinton, G., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R. Improving neural networks by preventing co-adaptation of feature detectors. arXiv preprint arXiv:1207.0580 (2012). source
The paper describes dropout as an efficient way to combine many neural-network models (p. 1). In F.6 Training (p. 17), it reports that ImageNet training took roughly four days with dropout versus two days without it, supporting the approximate factor-of-two training cost. (LLM, conf=0.88)
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This scheme reduces our top-1 and top-5 error rates by 1.7% and 1.2%, respectively, as compared with a net with half as many kernels in each convolutional layer trained on one GPU.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.2. Training on multiple GPUs
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The size of our network made overfitting a significant problem, even with 1.2 million labeled training examples”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“So these data augmentation schemes are, in effect, computationally free.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.1. Data augmentation
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we found that removing any convolutional layer (each of which contains no more than 1% of the model's parameters) resulted in inferior performance.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This scheme reduces the top-1 and top-5 error rates by 0.4% and 0.3%, respectively, as compared with the non overlapping scheme s = 2, z = 2, which produces output of equivalent dimensions.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.1. Data augmentation
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This increases the size of our training set by a factor of 2048”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.1. Data augmentation
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Deep CNNs with ReLUs train several times faster than their equivalents with tanh units.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.1. Rectified Linear Unit nonlinearity
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, we still find that the following local normalization scheme aids generalization.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.3. Local response normalization
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes
- It may state two separate claims as one. 18
- Probably not a substantial claim. 26
- The quote only partly states this claim. 2
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Although the 1000 classes of ILSVRC make each training example impose 10 bits of constraint on the mapping from image to label, this turns out to be insufficient to learn so many parameters without considerable overfitting.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5. REDUCING OVERFITTING
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“though the resulting training examples are, of course, highly inter dependent.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.1. Data augmentation
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On the test data, we achieved top-1 and top-5 error rates of 37.5% and 17.0%, respectively”
§ ImageNet Classification with Deep Convolutional Neural Networks > Abstract
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We generally observe during training that models with overlapping pooling find it slightly more difficult to overfit.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.1. Data augmentation
Strength:plain· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“a four-layer CNN achieved a 13% test e r r o r r a t e w i t h o u t n o r m a l i z a t i o n a n d 1 1 % w i t h normalization.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.3. Local response normalization
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“so we used several effective techniques for preventing overfitting”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Response normalization reduces our top-1 and top-5 error rates by 1.4% and 1.2%, respectively.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.3. Local response normalization
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The two-GPU net takes slightly less time to train than the one-GPU net.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.2. Training on multiple GPUs
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Our network contains a number of new and unusual features which improve its performance and reduce its training time”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Without this scheme, our network suffers from substantial overfitting, which would have forced us to use much smaller networks.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.1. Data augmentation
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For example, only other types of cat are considered plausible labels for the leopard.”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
Strength:plain· not yet calibratedSingle caseTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This initialization accelerates the early stages of learning by providing the ReLUs with positive inputs.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 6. DETAILS OF LEARNING
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Notice that at the pixel level, the retrieved training images are generally not close in L2 to the query images in the first column.”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Training one CNN, with an extra sixth convolutional layer over the last pooling layer, to classify the entire ImageNet Fall 2011 release (15M images, 22K categories), and then”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our top-1 and top-5 error rates on this dataset are 67.4% and 40.9%, attained by the net described above but with an additional, sixth convolutional layer over the last pooling layer.”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The Fall 2009 ImageNet split used by the authors, which differs from previous authors' splits, does not affect the results appreciably.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This kind of specialization occurs during every run and is independent of any particular random weight initialization (modulo a renumbering of the GPUs).”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The magnitude of the effect demonstrated here varies with network architecture, but networks with ReLUs consistently learn several times faster than equivalents with saturating neurons.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 9. EPILOGUE
Strength:boosted· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our network achieves top-1 and top-5 test set error rates of 37.5% and 17.0%, respectively.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 7. RESULTS
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Averaging the predictions of five similar CNNs gives an error rate of 16.4%.”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In the remainder of this paragraph, we use validation and test error rates interchangeably because in our experience they do not differ by more than 0.1% (see Table 2).”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Notice that even off-center objects, such as the mite in the top-left, can be recognized by the net.”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
Strength:plain· not yet calibratedSingle caseTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All of our experiments suggest that our results can be improved simply by waiting for faster GPUs and bigger datasets to become available.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
Strength:hedged· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“ReLUs have the desirable property that they do not require input normalization to prevent them from saturating.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.3. Local response normalization
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Convolutional neural networks (CNNs) constitute one such class of models.9,15,17,19,21,26,32”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites [9] 9. Fukushima, K. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36, 4 (1980), 193-202. source
- Not checked yetcites [15] 15. Krizhevsky, A. Convolutional deep belief networks on cifar-10. Unpublished manuscript, 2010.
- Not checked yetcites [17] 17. LeCun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W., Jackel, L., et al. Handwritten digit recognition with a back-propagation network. In Advances in Neural Information Processing Systems (1990).
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the immense complexity of the object recognition task means that this problem cannot be specified even by a dataset as large as ImageNet, so our model should also have lots of prior knowledge to compensate for all the data we do not have.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Thus, compared to standard feedforward neural networks with similarly sized layers, CNNs have much fewer connections and parameters and so they are easier to train, while their theoretically best performance is likely to be only slightly worse.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“methods that require careful hand-engineering by a programmer who understands the domain do not scale as well as methods that replace the programmer with a powerful general-purpose learning procedure.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 1. PROLOGUE
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Luckily, current GPUs, paired with a highly optimized implementation of 2D convolution, are powerful enough to facilitate the training of interestinglylarge CNNs”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“they also make strong and mostly correct assumptions about the nature of images (namely, stationarity of statistics and locality of pixel dependencies).”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
Load-bearingStrength:boosted· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Despite the attractive qualities of CNNs, and despite the relative efficiency of their local architecture, they have still been prohibitively expensive to apply in large scale to highresolution images.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
In the paper
“ImageNet, 7 which consists of over 15 million labeled high-resolution images in over 22,000 categories.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites [7] 7. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L. ImageNet: A large-scale hierarchical image database. In CVPR09 (2009). source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“which is considerably better than the previous state-of-the-art”
§ ImageNet Classification with Deep Convolutional Neural Networks > Abstract
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With enough computation and enough data, learning beats programming for complicated tasks that require the integration of many different, noisy cues.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 1. PROLOGUE
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“and recent datasets such as ImageNet contain enough labeled examples to train such models without severe overfitting.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“for deep neural networks to shine, they needed far more labeled data and hugely more computation.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 1. PROLOGUE
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If at least some training examples produce a positive input to a ReLU, learning will happen in that neuron.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.3. Local response normalization
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“To learn about thousands of objects from millions of images, we need a model with a large learning capacity.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The constants k, n, α, and β are hyperparameters whose values are determined using a validation set”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.3. Local response normalization
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, on this dataset the primary concern is preventing overfitting, so the effect they are observing is different from the accelerated ability to fit the training set which we report when using ReLUs.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.1. Rectified Linear Unit nonlinearity
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“since then the best published results are 45.7% and 25.7% with an approach that averages the predictions of two classifiers trained on Fisher Vectors (FVs) computed from two types of densely sampled features.29”
§ ImageNet Classification with Deep Convolutional Neural Networks > 7. RESULTS
What the sources say
- Not checked — no full text of the sourcecites [29] 29. Sánchez, J., Perronnin, F. High- dimensional signature compression for large-scale image classification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011 (2011). IEEE, 1665-1672. source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“Combining the predictions of many different models is a very successful way to reduce test errors, 1, 3”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.2. Dropout
What the sources say
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“but it appears to be too expensive for big neural networks that already take several days to train.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.2. Dropout
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“The best published results on this dataset are 78.1% and 60.9%.23”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
What the sources say
- Not checked — no full text of the sourcecites [23] 23. Mensink, T., Verbeek, J., Perronnin, F., Csurka, G. Metric learning for large scale image classification: Generalizing to new classes at near-zero cost. In ECCV -European Conference on Computer Vision (Florence, Italy, Oct. 2012). source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper relies on this without support.
Objects in realistic settings exhibit considerable variability.
“But objects in realistic settings exhibit considerable variability”
The paper relies on this without support.
Object identity is invariant to changes in the intensity and color of illumination.
“object identity is invariant to changes in the intensity and color of the illumination.”
The paper relies on this without support.
The Fall 2009 ImageNet split used by the authors, which differs from previous authors' splits, does not affect the results appreciably.
“Since there is no established test set, our split necessarily differs from the splits used by previous authors, but this does not affect the results appreciably.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In the field of DL, the CNN is the most famous and commonly employed algorithm [30, 71–75].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [30]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Fully convolutional neural networks (fCNNs) have provided state-of-the-art performance for object classification and image segmentation (1).”
From Fully automated, real-time 3D ultrasound segmentation to estimate first trimester placental volume using deep learning (2018) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The first wave saw the emergence of deep learning as the dominant paradigm for analyzing high-dimensional biological data.”
From The next paradigm in bioinformatics: a review of multi-agent systems and foundational models for end-to-end scientific discovery (2026) · cites this paper as [1]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Krizhevesky et al. [30] first proposed AlexNet and consequently improved the CNN learning ability by increasing its depth and implementing several parameter optimization strategies.”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“In deep CNN architecture, AlexNet is highly respected [30], as it achieved innovative results in the fields of image recognition and classification.”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“Many CNN models, e.g. AlexNet [30], GoogleNet [103], and ResNet [37], have been trained on large datasets such as ImageNet for image recognition purposes.”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“To avoid model-specific biases, two different AI models, AlexNet [22] and VGG16 [38], were selected for classification.”
From Study on the Helpfulness of Explainable Artificial Intelligence (2024) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“In particular, the choice of this specific size is based on the fact that the AlexNet 34 (and also similar CNN architectures) has been shown to offer satisfactory performances with an input matrix of that size or very similar, albeit for different types of problems with respect to the one presented in this work (e.g., image classification).”
The cited source says what the claim attributes to it.
In the citing paper
“Jung et al. [21] found that a reduction in accuracy does not occur when using only four bits for both weight and activation parameters, even for the ImageNet dataset [32].”
From Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object Detectors (2021) · cites this paper as [32]
The cited source says what the claim attributes to it.
In the citing paper
“Feature-based approaches [17,18,19] commonly employ networks pre-trained on ImageNet [20] to map original images into a more distinguishable feature space. These methods are typically characterized by low training costs and outstanding performance.”
From An Unsupervised Method for Industrial Image Anomaly Detection with Vision Transformer-Based Autoencoder (2024) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“Over the past several years, the successes of deep learning on visual tasks has critically relied on convolutional neural networks [20, 16].”
From Do Vision Transformers See Like Convolutional Neural Networks? (2021) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“A common perception metric is the Learned Perceptual Image Patch Similarity (LPIPS) which uses pre-trained deep neural network backbones such as VGG [9] and AlexNet [22].”
From MTReD: 3D Reconstruction Dataset for Fly-over Videos of Maritime Domain (2025) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“Starting with the the success of AlexNet [5] in the ILSVRC challenge [6] in 2012, deep learning models have been outperforming traditional approaches on a number of computer vision problems.”
From Satellite Pose Estimation Challenge: Dataset, Competition Design, and Results (2020) · cites this paper as [5]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Unfortunately, it has been acknowledged that the performance of those hashing schemes may degrade significantly if the projected dimensions are imbalanced [4], [6], [13], i.e., their variances vary a lot.”
From Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval (2019) · cites this paper as [6]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“When convolutional RBMs are stacked together, they form convolutional deep belief networks [22].”
From Multimodal emotion recognition using deep learning architectures (2016) · cites this paper as [22]
Experimental — accuracy not yet measuredIn the citing paper
“Convolutional neural networks (CNNs), built for spatial data, have demonstrated performance comparable to that of specialists in cancer detection and tumor segmentation [15,16,17,18,19,20].”
From Artificial Intelligence in Clinical Oncology: From Productivity Enhancement to Creative Discovery (2025) · cites this paper as [16]
In the citing paper
“When a low-capacity model, such as AlexNet, is used for pre-training, little improvement can be obtained when compared to the Resnet50 family [26].”
From Self-supervised learning: A succinct review (2023) · cites this paper as [26]
In the citing paper
“Since its introduction by Krizhevsky et al. [7] in 2012, the CNN model has been successfully applied to a wide range of multimodal applications, such as image dehazing [239, 240] and human activity recognition [241].”
From A survey on deep multimodal learning for computer vision: advances, trends, applications, and datasets (2022) · cites this paper as [7]
In the citing paper
“The AlexNet architecture was published in [4], achieved significantly improved performance over the other non-deep learning methods for ImageNet Large Scale Visual Recognition Challenge (ILSVRC) 2012.”
From Deep convolutional neural networks for computer-aided detection: cnn architectures, dataset characteristics and transfer learning (2016) · cites this paper as [4]
In the citing paper
“Deep CNN architectures with 8, even 22 layers [4], [33], can be useful even for CADe problems where the available training datasets are limited.”
From Deep convolutional neural networks for computer-aided detection: cnn architectures, dataset characteristics and transfer learning (2016) · cites this paper as [4]
In the citing paper
“focusing on AI and deep learning architectures that have already become the de facto approach.”
From AI in Medical Imaging Informatics: Current Challenges and Future Directions (2020) · cites this paper as [101]
In the citing paper
“Since then, fueled by the revolutionary results of AlexNet [101] and incarnations of patch-based adaptations of Deep Boltzmann Machines and stacked autoencoders, deep learning based segmentation of anatomy and pathology has witnessed a revolution (see also Table II), where for some tasks now we observe human level performance [102].”
From AI in Medical Imaging Informatics: Current Challenges and Future Directions (2020) · cites this paper as [101]
In the citing paper
“ReLU significantly increases the rate of con-vergence of stochastic gradient descent in comparison with the sigmoid [26].”
From Real-time system for automatic cold strip surface defect detection (2019) · cites this paper as [26]
In the citing paper
“Real-time volume estimation has been achieved using fully convolutional neural networks (FCNNs) [11] to produce state-of-the-art performance in a range of medical imaging modalities [12].”
From Fully Automated 3-D Ultrasound Segmentation of the Placenta, Amniotic Fluid, and Fetus for Early Pregnancy Assessment (2021) · cites this paper as [11]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Third convolutional layer exceeds the stated 1% parameter limit
MinorThe third layer alone has 384 × 3 × 3 × 256 = 884,736 kernel weights. That is about 1.47% of the network's stated 60 million parameters, contradicting the claim that every convolutional layer contains no more than 1%.
“we found that removing any convolutional layer (each of which contains no more than 1% of the model's parameters) resulted in inferior performance.”
“The third convolutional layer has 384 kernels of size 3 × 3 × 256”
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Self-citationLearning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,501
Self-citation(2010) · International Conference on Machine Learning · Cited by 13,995
Self-citationImproving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Self-citationFukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
LabelMe: A Database and Web-Based Tool for Image Annotation
Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0090-8 · Cited by 4,210
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Flagged first, then by citations
Research works printed but not linked: 13
- Berg A., 2010, Large scale visual recognition challenge
- Deng J., 2009, CVPR09
- Krizhevsky A., 2009, Department of Computer Science
- Krizhevsky A., 2010, Convolutional deep belief networks on cifar-10. Unpublished manuscript
- Krizhevsky A., 2011, ESANN
- LeCun Y., 1990, Advances in Neural Information Processing Systems
- LeCun Y., 1985, Une procedure d'apprentissage pour reseau a seuil asymmetrique (a learning scheme for asymmetric threshold networks)
- 10.5555/1896300.1896315 · DOI
- Mensink T., 2012, Italy
- 10.5555/3104322.3104425 · DOI
- Rumelhart D.E., 1985, DTIC Document
- 10.5555/938980.939477 · DOI
- Werbos P., 1974, Beyond regression: New tools for prediction and analysis in the behavioral sciences
Cited by
Sorted by citations
Items 1,601–1,700 of 108,435
Object Classification Using CNN-Based Fusion of Vision and LIDAR in Autonomous Vehicle Environment
Gao, H., Cheng, B., Wang, J., Li, K., Zhao, J., & Li, D. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2822828 · Cited by 529
DeepWeeds: A Multiclass Weed Species Image Dataset for Deep Learning
Olsen, A., Konovalov, D. A., Philippa, B. W., Ridd, P., Wood, J., Johns, J., Banks, W., Girgenti, B., Kenny, O. P., Whinney, J., et al. (2019) · Scientific Reports · doi:10.1038/s41598-018-38343-3 · Cited by 576
Feature Extraction using Convolution Neural Networks (CNN) and Deep Learning
Jogin, M., Mohana, Madhulika, M. S., Divya, G., Meghana, R., & Apoorva, S. (2018) · IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology · doi:10.1109/rteict42901.2018.9012507 · Cited by 605
3D Graph Neural Networks for RGBD Semantic Segmentation
Qi, X., Liao, R., Jia, J., Fidler, S., & Urtasun, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.556 · Cited by 482
Wang, Y., Fang, Z., & Hong, H. (2019) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2019.02.263 · Cited by 547
Shahid, N., Rappon, T., & Berta, W. B. (2019) · PLoS ONE · doi:10.1371/journal.pone.0212356 · Cited by 559
Generalized Out-of-Distribution Detection: A Survey
Yang, J., Zhou, K., Li, Y., & Liu, Z. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02117-4 · Cited by 884
RankIQA: Learning from Rankings for No-Reference Image Quality Assessment
Liu, X., van de Weijer, J., & Bagdanov, A. D. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.118 · Cited by 560
Diabetic retinopathy detection through deep learning techniques: A review
Alyoubi, W. L., Shalash, W. M., & Abulkhair, M. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100377 · Cited by 574
Zhao, Z., Zhang, Q., Yu, X., Sun, C., Wang, S., Yan, R., & Chen, X. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3116309 · Cited by 606
Dropout improves Recurrent Neural Networks for Handwriting RecognitionPreprint
(2016) · Cited by 533
Multiple Instance Detection Network with Online Instance Classifier Refinement
Tang, P., Wang, X., Bai, X., & Liu, W. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.326 · Cited by 503
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision
Kim, W., Son, B., & Kim, I. (2021) · arXiv · doi:10.48550/arxiv.2102.03334 · Cited by 951
Edge Machine Learning for AI-Enabled IoT Devices: A Review
Merenda, M., Porcaro, C., & Iero, D. (2020) · Sensors · doi:10.3390/s20092533 · Cited by 523
A Configurable Cloud-Scale DNN Processor for Real-Time AI
Fowers, J., Ovtcharov, K., Papamichael, M. K., Massengill, T., Liu, M., Lo, D., Alkalay, S., Haselman, M., Adams, L., Ghandi, M., et al. (2018) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca.2018.00012 · Cited by 561
Ellefsen, A. L., Bjørlykhaug, E., Æsøy, V., Ushakov, S., & Zhang, H. (2018) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2018.11.027 · Cited by 550
Unsupervised Deep Change Vector Analysis for Multiple-Change Detection in VHR Images
Saha, S., Bovolo, F., & Bruzzone, L. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2886643 · Cited by 542
Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and GaugesPreprint
Bronstein, M. M., Bruna, J., Cohen, T., & Veličković, P. (2021) · arXiv (Cornell University) · doi:10.4230/oasics.dx.2026.1 · Cited by 2,094
TransFG: A Transformer Architecture for Fine-Grained Recognition
He, J., Chen, J.-N., Liu, S., Kortylewski, A., Yang, C., Bai, Y., & Wang, C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19967 · Cited by 551
Deep Learning of Representations: Looking Forward
Bengio, Y. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39593-2_1 · Cited by 568
Salient object detection: A survey
Borji, A., Cheng, M.-M., Hou, Q., Jiang, H., & Li, J. (2019) · Computational Visual Media · doi:10.1007/s41095-019-0149-9 · Cited by 650
Visualizing Deep Convolutional Neural Networks Using Natural Pre-images
Mahendran, A., & Vedaldi, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-016-0911-8 · Cited by 500
Predicting citywide crowd flows using deep spatio-temporal residual networks
Zhang, J., Zheng, Y., Qi, D., Li, R., Yi, X., & Li, T. (2018) · Artificial Intelligence · doi:10.1016/j.artint.2018.03.002 · Cited by 534
MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted LabelsPreprint
Jiang, L., Zhou, Z., Leung, T., Li, L.-J., & Fei-Fei, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.05055 · Cited by 865
Deep Count: Fruit Counting Based on Deep Simulated Learning
Rahnemoonfar, M., & Sheppard, C. (2017) · Sensors · doi:10.3390/s17040905 · Cited by 540
Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning
Cui, Y., Song, Y., Sun, C., Howard, A., & Belongie, S. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00432 · Cited by 538
Deep Learning for EEG motor imagery classification based on multi-layer CNNs feature fusion
Amin, S. U., Alsulaiman, M., Muhammad, G., Mekhtiche, M. A., & Shamim Hossain, M. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.06.027 · Cited by 523
Learning to Hash for Indexing Big Data—A Survey
Wang, J., Liu, W., Kumar, S., & Chang, S. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2487976 · Cited by 534
Model-based Reinforcement Learning: A Survey
Moerland, T. M., Broekens, J., Plaat, A., & Jonker, C. M. (2023) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000086 · Cited by 871
Abdeljaber, O., Avci, O., Kiranyaz, M. S., Boashash, B., Sodano, H., & Inman, D. J. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.09.069 · Cited by 521
A deep learning approach to detection of splicing and copy-move forgeries in images
Rao, Y., & Ni, J. (2016) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs.2016.7823911 · Cited by 554
Xing, F., & Yang, L. (2016) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2016.2515127 · Cited by 527
Multi-scale object detection in remote sensing imagery with convolutional neural networks
Deng, Z., Sun, H., Zhou, S., Zhao, J., Lei, L., & Zou, H. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.04.003 · Cited by 532
Deep image mining for diabetic retinopathy screening
Quellec, G., Charrière, K., Boudi, Y., Cochener, B., & Lamard, M. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.04.012 · Cited by 537
Depth-Induced Multi-Scale Recurrent Attention Network for Saliency Detection
Piao, Y., Ji, W., Li, J., Zhang, M., & Lu, H. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00735 · Cited by 526
Large-scale vehicle re-identification in urban surveillance videos
Liu, X., Liu, W., Ma, H., & Fu, H. (2016) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2016.7553002 · Cited by 548
Deep convolutional neural network model based chemical process fault diagnosis
Wu, H., & Zhao, J. (2018) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2018.04.009 · Cited by 534
Xu, D., Ouyang, W., Wang, X., & Sebe, N. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00077 · Cited by 551
A mean field view of the landscape of two-layer neural networks
Mei, S., Andrea Montanari, A., & Nguyen, P.-M. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806579115 · Cited by 649
Zheng, Z., Zhong, Y., Wang, J., Ma, A., & Zhang, L. (2021) · Remote Sensing of Environment · doi:10.1016/j.rse.2021.112636 · Cited by 562
From Facial Parts Responses to Face Detection: A Deep Learning Approach
Yang, S., Luo, P., Loy, C. C., & Tang, X. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.419 · Cited by 574
Convolutional Neural Network Architecture for Geometric Matching
Rocco, I., Arandjelović, R., & Šivic, J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.12 · Cited by 542
Generic decoding of seen and imagined objects using hierarchical visual features
Horikawa, T., & Kamitani, Y. (2017) · Nature Communications · doi:10.1038/ncomms15037 · Cited by 550
Attention Branch Network: Learning of Attention Mechanism for Visual Explanation
Fukui, H., Hirakawa, T., Yamashita, T., & Fujiyoshi, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01096 · Cited by 547
A comprehensive survey on model compression and acceleration
Choudhary, T., Mishra, V. K., Goswami, A., & Jagannathan, S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09816-7 · Cited by 555
DCAN: Deep contour-aware networks for object instance segmentation from histology images
Chen, H., Qi, X., Yu, L., Dou, Q., Qin, J., & Heng, P. (2016) · Medical Image Analysis · doi:10.1016/j.media.2016.11.004 · Cited by 514
An ensemble of fine-tuned convolutional neural networks for medical image classification
Kumar, A., Kim, J., Lyndon, D., Fulham, M., & Feng, D. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2635663 · Cited by 515
Polymer Genome: A Data-Powered Polymer Informatics Platform for Property Predictions
Kim, C., Chandrasekaran, A. R., Huan, T. D., Das, D., & Ramprasad, R. (2018) · The Journal of Physical Chemistry C · doi:10.1021/acs.jpcc.8b02913 · Cited by 549
Solving Current Limitations of Deep Learning Based Approaches for Plant Disease Detection
Arsenović, M., Karanovic, M., Sladojević, S., Anderla, A., & Stefanović, D. (2019) · Symmetry · doi:10.3390/sym11070939 · Cited by 562
Reddi, V. J., Cheng, C., Kanter, D. E., Mattson, P. R., Schmuelling, G., Wu, C.-J., Anderson, B., Breughe, M. B., Charlebois, M., Chou, W., et al. (2020) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca45697.2020.00045 · Cited by 740
Classification of Hyperspectral Image Based on Double-Branch Dual-Attention Mechanism Network
Li, R., Zheng, S., Duan, C., Yang, Y., & Wang, X. (2020) · Remote Sensing · doi:10.3390/rs12030582 · Cited by 522
Probabilistic Backpropagation for Scalable Learning of Bayesian Neural NetworksPreprint
Hernández-Lobato, J. M., & Adams, R. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.05336 · Cited by 563
Salahuddin, Z., Woodruff, H. C., Chatterjee, A., & Lambin, P. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.105111 · Cited by 508
Deep MRI brain extraction: A 3D convolutional neural network for skull stripping
Kleesiek, J., Urban, G., Hubert, A., Schwarz, D., Maier-Hein, K., Bendszus, M., & Biller, A. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.01.024 · Cited by 505
Deep Learning the City: Quantifying Urban Perception at a Global Scale
Dubey, A., Naik, N., Parikh, D., Raskar, R., & Hidalgo, C. A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46448-0_12 · Cited by 583
Neural scene representation and rendering
Eslami, S. M. A., Rezende, D. J., Besse, F., Viola, F., Morcos, A. S., Garnelo, M., Ruderman, A., Rusu, A. A., Danihelka, I., Gregor, K., et al. (2018) · Science · doi:10.1126/science.aar6170 · Cited by 537
A review of the use of convolutional neural networks in agriculture
Kamilaris, A., & Prenafeta-Boldú, F. X. (2018) · The Journal of Agricultural Science · doi:10.1017/s0021859618000436 · Cited by 553
Rodríguez-Pérez, R., & Bajorath, J. (2019) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.9b01101 · Cited by 536
Flowing ConvNets for Human Pose Estimation in Videos
Pfister, T., Charles, J., & Zisserman, A. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.222 · Cited by 530
The Marabou Framework for Verification and Analysis of Deep Neural Networks
Katz, G., Huang, D. A., Ibeling, D., Julian, K., Lazarus, C., Lim, R., Shah, P., Thakoor, S., Wu, H., Zeljić, A., et al. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-25540-4_26 · Cited by 517
“Their performance can often surpass that of manually created software as demonstrated in fields such as image classification [16], speech recognition [8], and game playing [21].”
BackgroundMaterial recognition in the wild with the Materials in Context Database
Bell, S., Upchurch, P., Snavely, N., & Bala, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298970 · Cited by 516
Learning from Synthetic Data: Addressing Domain Shift for Semantic Segmentation
Sankaranarayanan, S., Balaji, Y., Jain, A., Lim, S. N., & Chellappa, R. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00395 · Cited by 488
Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons
Heo, B., Lee, M., Yun, S., & Choi, J. Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013779 · Cited by 562
DeepMVS: Learning Multi-view Stereopsis
Huang, P., Matzen, K., Kopf, J., Ahuja, N., & Huang, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00298 · Cited by 514
Improving Computer-Aided Detection UsingConvolutional Neural Networks and Random View Aggregation
Roth, H. R., Lu, L., Liu, J., Yao, J., Seff, A., Cherry, K., Kim, L., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2482920 · Cited by 608
“In order to increase the variation of the training data and to avoid overfitting analogous to the data augmentation approach in [14], [17] and [18], multiple 2D or 2.”
BackgroundMethodInfluentialIMCFN: Image-based malware classification using fine-tuned convolutional neural network architecture
Vasan, D., Alazab, M., Wassan, S., et al. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107138 · Cited by 515
COVID-19 identification in chest X-ray images on flat and hierarchical classification scenarios
Pereira, R. M., Bertolini, D. S., Teixeira, L., Junior, C. N. S., & Costa, Y. M. G. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105532 · Cited by 527
A review of the-state-of-the-art in data-driven approaches for building energy prediction
Sun, Y., Haghighat, F., & Fung, B. C. M. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.110022 · Cited by 511
Accurate brain age prediction with lightweight deep neural networks
Peng, H., Gong, W., Beckmann, C. F., Vedaldi, A., & Smith, S. M. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101871 · Cited by 527
A CNN Regression Approach for Real-Time 2D/3D Registration
Miao, S., Wang, Z. J., & Liao, R. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2521800 · Cited by 514
DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation
Wang, G., Zuluaga, M. A., Li, W., Pratt, R., Patel, P. A., Aertsen, M., Doel, T., David, A. L., Deprest, J., Ourselin, S., et al. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2840695 · Cited by 502
“Typical CNNs [16], [17], [18] were originally designed for image classification tasks.”
BackgroundLightenNet: A Convolutional Neural Network for weakly illuminated image enhancement
Li, C., Guo, J., Porikli, F., & Pang, Y. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.01.010 · Cited by 510
Applications, promises, and pitfalls of deep learning for fluorescence image reconstruction
Belthangady, C., & Royer, L. A. (2019) · Nature Methods · doi:10.1038/s41592-019-0458-z · Cited by 515
Learning a Neural Solver for Multiple Object Tracking
Braso, G., & Leal-Taixe, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00628 · Cited by 504
Towards Better Analysis of Deep Convolutional Neural Networks
Liu, M., Shi, J., Li, Z., Li, C., Zhu, J., & Liu, S. (2016) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2598831 · Cited by 513
A new image classification method using CNN transfer learning and web data augmentation
Han, D., Liu, Q., & Fan, W. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.11.028 · Cited by 530
Deep neural networks for bot detection
Kudugunta, S., & Ferrara, E. (2018) · Information Sciences · doi:10.1016/j.ins.2018.08.019 · Cited by 506
Neural Networks for Postprocessing Ensemble Weather Forecasts
Rasp, S., & Lerch, S. (2018) · Monthly Weather Review · doi:10.1175/mwr-d-18-0187.1 · Cited by 554
INet: Convolutional Networks for Biomedical Image Segmentation
Weng, W., & Zhu, X. (2021) · IEEE Access · doi:10.1109/access.2021.3053408 · Cited by 569
ElemNet: Deep Learning the Chemistry of Materials From Only Elemental Composition
Jha, D., Ward, L. T., Paul, A., Liao, W., Choudhary, A., Wolverton, C. M., & Agrawal, A. (2018) · Scientific Reports · doi:10.1038/s41598-018-35934-y · Cited by 557
Crop pest classification based on deep convolutional neural network and transfer learning
Thenmozhi, K., & Reddy, U. S. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.104906 · Cited by 512
EMCAD: Efficient Multi-Scale Convolutional Attention Decoding for Medical Image Segmentation
Rahman, M. M., Munir, M., & Marculescu, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01118 · Cited by 594
Online Tracking by Learning Discriminative Saliency Map with Convolutional Neural NetworkPreprint
Hong, S., You, T., Kwak, S., & Han, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.06796 · Cited by 784
Deep learning for image-based cancer detection and diagnosis − A survey
Hu, Z., Tang, J., Wang, Z., Zhang, K., Zhang, L., & Sun, Q. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.05.014 · Cited by 520
Lu, Z., Whalen, I., Boddeti, V. N., Dhebar, Y., Deb, K., Goodman, E. D., & Banzhaf, W. (2019) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3321707.3321729 · Cited by 574
SmaAt-UNet: Precipitation nowcasting using a small attention-UNet architecture
Trebing, K., Staǹczyk, T., & Mehrkanoon, S. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.01.036 · Cited by 551
Leveraging uncertainty information from deep neural networks for disease detection
Leibig, C., Allken, V., Ayhan, M. S., Berens, P., & Wahl, S. (2017) · Scientific Reports · doi:10.1038/s41598-017-17876-z · Cited by 510
Revisiting multiple instance neural networks
Wang, X., Yan, Y., Tang, P., Bai, X., & Liu, W. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.08.026 · Cited by 506
Polarimetric SAR Image Classification Using Deep Convolutional Neural Networks
Zhou, Y., Wang, H., Xu, F., & Jin, Y. Q. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2016.2618840 · Cited by 521
Application of Deep Learning for Object Detection
Pathak, A. R., Pandey, M., & Rautaray, S. S. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.05.144 · Cited by 539
Deep learning for chest X-ray analysis: A survey
Çallı, E., Sogancioglu, E., van Ginneken, B., van Leeuwen, K. G., & Murphy, K. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102125 · Cited by 565
Deep convolutional neural networks for Raman spectrum recognition: a unified solution
Liu, J., Osadchy, M., Ashton, L., Foster, M., Solomon, C. J., & Gibson, S. J. (2017) · The Analyst · doi:10.1039/c7an01371j · Cited by 507
Training Deep Nets with Sublinear Memory Cost
Chen, T., Xu, B., Zhang, C., & Guestrin, C. (2016) · arXiv · doi:10.48550/arxiv.1604.06174 · Cited by 561
Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space
Nguyen, A., Clune, J., Bengio, Y., Dosovitskiy, A., & Yosinski, J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.374 · Cited by 627
Artificial intelligence for education: Knowledge and its assessment in AI-enabled learning ecologies
Cope, B., Kalantzis, M., & Searsmith, D. (2021) · Educational Philosophy and Theory · doi:10.1080/00131857.2020.1728732 · Cited by 518
Diverse Branch Block: Building a Convolution as an Inception-like Unit
Ding, X., Zhang, X., Han, J., & Ding, G. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01074 · Cited by 578
A scoping review of transfer learning research on medical image analysis using ImageNet
Morid, M. A., Borjali, A., & Del Fiol, G. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104115 · Cited by 508
Kar, K., Kubilius, J., Schmidt, K., Issa, E. B., & DiCarlo, J. J. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0392-5 · Cited by 496
A genetic programming approach to designing convolutional neural network architectures
Suganuma, M., Shirakawa, S., & Nagao, T. (2017) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3071178.3071229 · Cited by 554
EKT: Exercise-Aware Knowledge Tracing for Student Performance Prediction
Liu, Q., Huang, Z., Yin, Y., Chen, E., Xiong, H., Su, Y., & Hu, G. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2924374 · Cited by 562
Metadata
- Authors
- Krizhevsky, A., Sutskever, I., & Hinton, G. E.
- Affiliations
- Google (United States) (US)
- University of Toronto (CA)
- Venue
- Communications of the ACM
- Published
- 2017-05-24
- Volume
- 60
- Issue
- 6
- Pages
- 84-90
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2163605009
- Cited by
- 112,155
- References
- 27
- Citations by year
- 2026: 2710 · 2025: 7710 · 2024: 10211 · 2023: 12267 · 2022: 12280 · 2021: 15497 · 2020: 14538 · 2019: 13976 · 2018: 9999 · 2017: 6661
- FWCI
- 5127.18
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Communications of the ACM (publishedVersion)
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- ImageNet, image classification, deep convolutional neural networks, dropout regularization, overfitting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
