The DOI matches its Crossref record, with a small difference in title or year; 31 of the 31 references it cites were found in a registry or an index; 2 of the 14 sources its claims cite were checked for support.
ImageNet classification with deep convolutional neural networks
Open accessAbstract
We trained a large, deep convolutional neural network to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes. On the test data, we achieved top-1 and top-5 error rates of 37.5% and 17.0%, respectively, which is considerably better than the previous state-of-the-art. The neural network, which has 60 million parameters and 650,000 neurons, consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully connected layers with a final 1000-way softmax. To make training faster, we used non-saturating neurons and a very efficient GPU implementation of the convolution operation. To reduce overfitting in the fully connected layers we employed a recently developed regularization method called "dropout" that proved to be very effective. We also entered a variant of this model in the ILSVRC-2012 competition and achieved a winning top-5 test error rate of 15.3%, compared to 26.2% achieved by the second-best entry.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
29 No basis given · 22 Own result · 19 Own interpretation · 4 No full text of the sources · 3 Sources not found · 2 Supported · 2 Not checked yet · 1 Own method
Every source the paper cites for this claim was checked and supports it.
In the paper
“This technique reduces complex co adaptations of neurons, since a neuron cannot rely on the presence of particular other neurons.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.2. Dropout
What the sources say
- Supportedcites [12] 12. Hinton, G., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R. Improving neural networks by preventing co-adaptation of feature detectors. arXiv preprint arXiv:1207.0580 (2012). source
The paper states on p. 1 that dropout prevents complex co-adaptations by randomly omitting hidden units, so a hidden unit cannot rely on other hidden units being present. This directly supports the citing sentence. (LLM, conf=0.95)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“There is, however, a very efficient version of model combination that only costs about a factor of two during training.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.2. Dropout
What the sources say
- Supportedcites [12] 12. Hinton, G., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R. Improving neural networks by preventing co-adaptation of feature detectors. arXiv preprint arXiv:1207.0580 (2012). source
The paper describes dropout as an efficient way to combine many neural-network models (p. 1). In F.6 Training (p. 17), it reports that ImageNet training took roughly four days with dropout versus two days without it, supporting the approximate factor-of-two training cost. (LLM, conf=0.88)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This scheme reduces our top-1 and top-5 error rates by 1.7% and 1.2%, respectively, as compared with a net with half as many kernels in each convolutional layer trained on one GPU.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.2. Training on multiple GPUs
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The size of our network made overfitting a significant problem, even with 1.2 million labeled training examples”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“So these data augmentation schemes are, in effect, computationally free.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.1. Data augmentation
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we found that removing any convolutional layer (each of which contains no more than 1% of the model's parameters) resulted in inferior performance.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This scheme reduces the top-1 and top-5 error rates by 0.4% and 0.3%, respectively, as compared with the non overlapping scheme s = 2, z = 2, which produces output of equivalent dimensions.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.1. Data augmentation
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This increases the size of our training set by a factor of 2048”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.1. Data augmentation
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Deep CNNs with ReLUs train several times faster than their equivalents with tanh units.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.1. Rectified Linear Unit nonlinearity
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, we still find that the following local normalization scheme aids generalization.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.3. Local response normalization
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 26
- The quote only partly states this claim. 2
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Although the 1000 classes of ILSVRC make each training example impose 10 bits of constraint on the mapping from image to label, this turns out to be insufficient to learn so many parameters without considerable overfitting.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5. REDUCING OVERFITTING
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“though the resulting training examples are, of course, highly inter dependent.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.1. Data augmentation
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On the test data, we achieved top-1 and top-5 error rates of 37.5% and 17.0%, respectively”
§ ImageNet Classification with Deep Convolutional Neural Networks > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We generally observe during training that models with overlapping pooling find it slightly more difficult to overfit.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.1. Data augmentation
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“a four-layer CNN achieved a 13% test e r r o r r a t e w i t h o u t n o r m a l i z a t i o n a n d 1 1 % w i t h normalization.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.3. Local response normalization
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“so we used several effective techniques for preventing overfitting”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Response normalization reduces our top-1 and top-5 error rates by 1.4% and 1.2%, respectively.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.3. Local response normalization
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The two-GPU net takes slightly less time to train than the one-GPU net.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.2. Training on multiple GPUs
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Our network contains a number of new and unusual features which improve its performance and reduce its training time”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Without this scheme, our network suffers from substantial overfitting, which would have forced us to use much smaller networks.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.1. Data augmentation
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For example, only other types of cat are considered plausible labels for the leopard.”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This initialization accelerates the early stages of learning by providing the ReLUs with positive inputs.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 6. DETAILS OF LEARNING
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Notice that at the pixel level, the retrieved training images are generally not close in L2 to the query images in the first column.”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Training one CNN, with an extra sixth convolutional layer over the last pooling layer, to classify the entire ImageNet Fall 2011 release (15M images, 22K categories), and then”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our top-1 and top-5 error rates on this dataset are 67.4% and 40.9%, attained by the net described above but with an additional, sixth convolutional layer over the last pooling layer.”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The Fall 2009 ImageNet split used by the authors, which differs from previous authors' splits, does not affect the results appreciably.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This kind of specialization occurs during every run and is independent of any particular random weight initialization (modulo a renumbering of the GPUs).”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The magnitude of the effect demonstrated here varies with network architecture, but networks with ReLUs consistently learn several times faster than equivalents with saturating neurons.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 9. EPILOGUE
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our network achieves top-1 and top-5 test set error rates of 37.5% and 17.0%, respectively.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 7. RESULTS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Averaging the predictions of five similar CNNs gives an error rate of 16.4%.”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In the remainder of this paragraph, we use validation and test error rates interchangeably because in our experience they do not differ by more than 0.1% (see Table 2).”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Notice that even off-center objects, such as the mite in the top-left, can be recognized by the net.”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All of our experiments suggest that our results can be improved simply by waiting for faster GPUs and bigger datasets to become available.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“ReLUs have the desirable property that they do not require input normalization to prevent them from saturating.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.3. Local response normalization
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Convolutional neural networks (CNNs) constitute one such class of models.9,15,17,19,21,26,32”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites [9] 9. Fukushima, K. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36, 4 (1980), 193-202. source
- Not checked yetcites [15] 15. Krizhevsky, A. Convolutional deep belief networks on cifar-10. Unpublished manuscript, 2010.
- Not checked yetcites [17] 17. LeCun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W., Jackel, L., et al. Handwritten digit recognition with a back-propagation network. In Advances in Neural Information Processing Systems (1990).
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the immense complexity of the object recognition task means that this problem cannot be specified even by a dataset as large as ImageNet, so our model should also have lots of prior knowledge to compensate for all the data we do not have.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Thus, compared to standard feedforward neural networks with similarly sized layers, CNNs have much fewer connections and parameters and so they are easier to train, while their theoretically best performance is likely to be only slightly worse.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“methods that require careful hand-engineering by a programmer who understands the domain do not scale as well as methods that replace the programmer with a powerful general-purpose learning procedure.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 1. PROLOGUE
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Luckily, current GPUs, paired with a highly optimized implementation of 2D convolution, are powerful enough to facilitate the training of interestinglylarge CNNs”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“they also make strong and mostly correct assumptions about the nature of images (namely, stationarity of statistics and locality of pixel dependencies).”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Despite the attractive qualities of CNNs, and despite the relative efficiency of their local architecture, they have still been prohibitively expensive to apply in large scale to highresolution images.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
In the paper
“ImageNet, 7 which consists of over 15 million labeled high-resolution images in over 22,000 categories.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites [7] 7. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L. ImageNet: A large-scale hierarchical image database. In CVPR09 (2009). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“which is considerably better than the previous state-of-the-art”
§ ImageNet Classification with Deep Convolutional Neural Networks > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With enough computation and enough data, learning beats programming for complicated tasks that require the integration of many different, noisy cues.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 1. PROLOGUE
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“and recent datasets such as ImageNet contain enough labeled examples to train such models without severe overfitting.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“for deep neural networks to shine, they needed far more labeled data and hugely more computation.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 1. PROLOGUE
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If at least some training examples produce a positive input to a ReLU, learning will happen in that neuron.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.3. Local response normalization
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“To learn about thousands of objects from millions of images, we need a model with a large learning capacity.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The constants k, n, α, and β are hyperparameters whose values are determined using a validation set”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.3. Local response normalization
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, on this dataset the primary concern is preventing overfitting, so the effect they are observing is different from the accelerated ability to fit the training set which we report when using ReLUs.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.1. Rectified Linear Unit nonlinearity
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“since then the best published results are 45.7% and 25.7% with an approach that averages the predictions of two classifiers trained on Fisher Vectors (FVs) computed from two types of densely sampled features.29”
§ ImageNet Classification with Deep Convolutional Neural Networks > 7. RESULTS
What the sources say
- Not checked — no full text of the sourcecites [29] 29. Sánchez, J., Perronnin, F. High- dimensional signature compression for large-scale image classification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011 (2011). IEEE, 1665-1672. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“Combining the predictions of many different models is a very successful way to reduce test errors, 1, 3”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.2. Dropout
What the sources say
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“but it appears to be too expensive for big neural networks that already take several days to train.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 5.2. Dropout
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“The best published results on this dataset are 78.1% and 60.9%.23”
§ ImageNet Classification with Deep Convolutional Neural Networks > Model
What the sources say
- Not checked — no full text of the sourcecites [23] 23. Mensink, T., Verbeek, J., Perronnin, F., Csurka, G. Metric learning for large scale image classification: Generalizing to new classes at near-zero cost. In ECCV -European Conference on Computer Vision (Florence, Italy, Oct. 2012). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper relies on this without support.
Objects in realistic settings exhibit considerable variability.
“But objects in realistic settings exhibit considerable variability”
The paper relies on this without support.
Object identity is invariant to changes in the intensity and color of illumination.
“object identity is invariant to changes in the intensity and color of the illumination.”
The paper relies on this without support.
The Fall 2009 ImageNet split used by the authors, which differs from previous authors' splits, does not affect the results appreciably.
“Since there is no established test set, our split necessarily differs from the splits used by previous authors, but this does not affect the results appreciably.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In the field of DL, the CNN is the most famous and commonly employed algorithm [30, 71–75].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [30]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Fully convolutional neural networks (fCNNs) have provided state-of-the-art performance for object classification and image segmentation (1).”
From Fully automated, real-time 3D ultrasound segmentation to estimate first trimester placental volume using deep learning (2018) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The first wave saw the emergence of deep learning as the dominant paradigm for analyzing high-dimensional biological data.”
From The next paradigm in bioinformatics: a review of multi-agent systems and foundational models for end-to-end scientific discovery (2026) · cites this paper as [1]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Krizhevesky et al. [30] first proposed AlexNet and consequently improved the CNN learning ability by increasing its depth and implementing several parameter optimization strategies.”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“In deep CNN architecture, AlexNet is highly respected [30], as it achieved innovative results in the fields of image recognition and classification.”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“Many CNN models, e.g. AlexNet [30], GoogleNet [103], and ResNet [37], have been trained on large datasets such as ImageNet for image recognition purposes.”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“To avoid model-specific biases, two different AI models, AlexNet [22] and VGG16 [38], were selected for classification.”
From Study on the Helpfulness of Explainable Artificial Intelligence (2024) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“In particular, the choice of this specific size is based on the fact that the AlexNet 34 (and also similar CNN architectures) has been shown to offer satisfactory performances with an input matrix of that size or very similar, albeit for different types of problems with respect to the one presented in this work (e.g., image classification).”
The cited source says what the claim attributes to it.
In the citing paper
“Jung et al. [21] found that a reduction in accuracy does not occur when using only four bits for both weight and activation parameters, even for the ImageNet dataset [32].”
From Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object Detectors (2021) · cites this paper as [32]
The cited source says what the claim attributes to it.
In the citing paper
“Feature-based approaches [17,18,19] commonly employ networks pre-trained on ImageNet [20] to map original images into a more distinguishable feature space. These methods are typically characterized by low training costs and outstanding performance.”
From An Unsupervised Method for Industrial Image Anomaly Detection with Vision Transformer-Based Autoencoder (2024) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“Over the past several years, the successes of deep learning on visual tasks has critically relied on convolutional neural networks [20, 16].”
From Do Vision Transformers See Like Convolutional Neural Networks? (2021) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“A common perception metric is the Learned Perceptual Image Patch Similarity (LPIPS) which uses pre-trained deep neural network backbones such as VGG [9] and AlexNet [22].”
From MTReD: 3D Reconstruction Dataset for Fly-over Videos of Maritime Domain (2025) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“Starting with the the success of AlexNet [5] in the ILSVRC challenge [6] in 2012, deep learning models have been outperforming traditional approaches on a number of computer vision problems.”
From Satellite Pose Estimation Challenge: Dataset, Competition Design, and Results (2020) · cites this paper as [5]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Unfortunately, it has been acknowledged that the performance of those hashing schemes may degrade significantly if the projected dimensions are imbalanced [4], [6], [13], i.e., their variances vary a lot.”
From Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval (2019) · cites this paper as [6]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“When convolutional RBMs are stacked together, they form convolutional deep belief networks [22].”
From Multimodal emotion recognition using deep learning architectures (2016) · cites this paper as [22]
Experimental — accuracy not yet measuredIn the citing paper
“Convolutional neural networks (CNNs), built for spatial data, have demonstrated performance comparable to that of specialists in cancer detection and tumor segmentation [15,16,17,18,19,20].”
From Artificial Intelligence in Clinical Oncology: From Productivity Enhancement to Creative Discovery (2025) · cites this paper as [16]
In the citing paper
“When a low-capacity model, such as AlexNet, is used for pre-training, little improvement can be obtained when compared to the Resnet50 family [26].”
From Self-supervised learning: A succinct review (2023) · cites this paper as [26]
In the citing paper
“Since its introduction by Krizhevsky et al. [7] in 2012, the CNN model has been successfully applied to a wide range of multimodal applications, such as image dehazing [239, 240] and human activity recognition [241].”
From A survey on deep multimodal learning for computer vision: advances, trends, applications, and datasets (2022) · cites this paper as [7]
In the citing paper
“The AlexNet architecture was published in [4], achieved significantly improved performance over the other non-deep learning methods for ImageNet Large Scale Visual Recognition Challenge (ILSVRC) 2012.”
From Deep convolutional neural networks for computer-aided detection: cnn architectures, dataset characteristics and transfer learning (2016) · cites this paper as [4]
In the citing paper
“Deep CNN architectures with 8, even 22 layers [4], [33], can be useful even for CADe problems where the available training datasets are limited.”
From Deep convolutional neural networks for computer-aided detection: cnn architectures, dataset characteristics and transfer learning (2016) · cites this paper as [4]
In the citing paper
“focusing on AI and deep learning architectures that have already become the de facto approach.”
From AI in Medical Imaging Informatics: Current Challenges and Future Directions (2020) · cites this paper as [101]
In the citing paper
“Since then, fueled by the revolutionary results of AlexNet [101] and incarnations of patch-based adaptations of Deep Boltzmann Machines and stacked autoencoders, deep learning based segmentation of anatomy and pathology has witnessed a revolution (see also Table II), where for some tasks now we observe human level performance [102].”
From AI in Medical Imaging Informatics: Current Challenges and Future Directions (2020) · cites this paper as [101]
In the citing paper
“ReLU significantly increases the rate of con-vergence of stochastic gradient descent in comparison with the sigmoid [26].”
From Real-time system for automatic cold strip surface defect detection (2019) · cites this paper as [26]
In the citing paper
“Real-time volume estimation has been achieved using fully convolutional neural networks (FCNNs) [11] to produce state-of-the-art performance in a range of medical imaging modalities [12].”
From Fully Automated 3-D Ultrasound Segmentation of the Placenta, Amniotic Fluid, and Fetus for Early Pregnancy Assessment (2021) · cites this paper as [11]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ ImageNet Classification with Deep Convolutional Neural Networks > 2. INTRODUCTION
“we found that removing any convolutional layer (each of which contains no more than 1% of the model's parameters) resulted in inferior performance.”
§ ImageNet Classification with Deep Convolutional Neural Networks > 4.5. Overall architecture
“The third convolutional layer has 384 kernels of size 3 × 3 × 256”
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Self-citationLearning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,501
Self-citation(2010) · International Conference on Machine Learning · Cited by 13,995
Self-citationImproving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Self-citationFukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
LabelMe: A Database and Web-Based Tool for Image Annotation
Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0090-8 · Cited by 4,210
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Research works printed but not linked: 13
- Berg A., 2010, Large scale visual recognition challenge
- Deng J., 2009, CVPR09
- Krizhevsky A., 2009, Department of Computer Science
- Krizhevsky A., 2010, Convolutional deep belief networks on cifar-10. Unpublished manuscript
- Krizhevsky A., 2011, ESANN
- LeCun Y., 1990, Advances in Neural Information Processing Systems
- LeCun Y., 1985, Une procedure d'apprentissage pour reseau a seuil asymmetrique (a learning scheme for asymmetric threshold networks)
- 10.5555/1896300.1896315 · DOI
- Mensink T., 2012, Italy
- 10.5555/3104322.3104425 · DOI
- Rumelhart D.E., 1985, DTIC Document
- 10.5555/938980.939477 · DOI
- Werbos P., 1974, Beyond regression: New tools for prediction and analysis in the behavioral sciences
Cited by
Sorted by citations
Items 2,701–2,800 of 108,435
Data Augmentation for Brain-Tumor Segmentation: A Review
Nalepa, J., Marcinkiewicz, M., & Kawulok, M. (2019) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2019.00083 · Cited by 340
A Real-Time Detection Algorithm for Kiwifruit Defects Based on YOLOv5
Yao, J., Qi, J., Zhang, J., Shao, H., Yang, J., & Li, X. (2021) · Electronics · doi:10.3390/electronics10141711 · Cited by 349
Deep Convolutional Neural Networks Enable Discrimination of Heterogeneous Digital Pathology Images
Khosravi, P., Kazemi, E., Imielinski, M., Elemento, O., & Hajirasouliha, I. (2018) · EBioMedicine · doi:10.1016/j.ebiom.2017.12.026 · Cited by 334
A survey on deep learning-based fine-grained object classification and semantic segmentation
Zhao, B., Feng, J., Wu, X., & Yan, S. (2017) · International Journal of Automation and Computing · doi:10.1007/s11633-017-1053-3 · Cited by 339
Deeply Learning Deformable Facial Action Parts Model for Dynamic Expression Analysis
Liu, M., Li, S., Shan, S., Wang, R., & Chen, X. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16817-3_10 · Cited by 333
Deep Region and Multi-label Learning for Facial Action Unit Detection
Zhao, K., Chu, W.-S., & Zhang, H. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.369 · Cited by 346
vDNN: Virtualized deep neural networks for scalable, memory-efficient neural network design
Rhu, M., Gimelshein, N. E., Clemons, J., Zulfiqar, A., & Keckler, S. W. (2016) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783721 · Cited by 442
Automated plant species identification—Trends and future directions
Wäldchen, J., Rzanny, M., Seeland, M., & Mäder, P. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005993 · Cited by 365
Attention Gate ResU-Net for Automatic MRI Brain Tumor Segmentation
Zhang, J., Jiang, Z., Dong, J., Hou, Y., & Liu, B. (2020) · IEEE Access · doi:10.1109/access.2020.2983075 · Cited by 359
Detection of PCB Surface Defects With Improved Faster-RCNN and Feature Pyramid Network
Hu, B., & Wang, J. (2020) · IEEE Access · doi:10.1109/access.2020.3001349 · Cited by 364
Takahashi, S., Sakaguchi, Y., Kouno, N., Takasawa, K., Ishizu, K., Akagi, Y., Aoyama, R., Teraya, N., Bolatkan, A., Shinkai, N., et al. (2024) · Journal of Medical Systems · doi:10.1007/s10916-024-02105-8 · Cited by 440
Deep Filter Banks for Texture Recognition, Description, and Segmentation
Cimpoi, M., Maji, S., Kokkinos, I., & Vedaldi, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0872-3 · Cited by 349
Seeing it all: Convolutional network layers map the function of the human visual system
Eickenberg, M., Gramfort, A., Varoquaux, G., & Thirion, B. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.001 · Cited by 338
TapNet: Multivariate Time Series Classification with Attentional Prototypical Network
Zhang, X., Gao, Y., Lin, J., & Lu, C.-T. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6165 · Cited by 352
Interactive deep learning method for segmenting moving objects
Wang, Y., Luo, Z., & Jodoin, P. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.09.014 · Cited by 331
Visualizing Dataflow Graphs of Deep Learning Models in TensorFlow
Wongsuphasawat, K., Smilkov, D., Wexler, J., Wilson, J., Mané, D., Fritz, D., Krishnan, D., Viégas, F. B., & WATTENBERG, M. P. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2744878 · Cited by 342
Plissiti, M. E., Dimitrakopoulos, P., Sfikas, G., Nikou, C., Krikoni, O., & Charchanti, A. V. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451588 · Cited by 381
Autoencoder and Its Various Variants
Zhai, J., Zhang, S., Chen, J., & He, Q. (2018) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2018.00080 · Cited by 385
Line-CNN: End-to-End Traffic Line Detection With Line Proposal Unit
Li, X., Li, J., Hu, X., & Yang, J. J. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2890870 · Cited by 344
Grotjahn, R., Black, R. X., Leung, L.-Y. R., Wehner, M. F., Barlow, M., Bosilovich, M. G., Gershunov, A., Gutowski, W. J., Gyakum, J. R., Katz, R. W., et al. (2015) · Climate Dynamics · doi:10.1007/s00382-015-2638-6 · Cited by 355
3D Human pose estimation: A review of the literature and analysis of covariates
Sarafianos, N., Boteanu, B. A., Ionescu, B. E., & Kakadiaris, I. A. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.09.002 · Cited by 342
FlexFlow: A Flexible Dataflow Accelerator Architecture for Convolutional Neural Networks
Lü, W., Yan, G., Li, J., Gong, S., Han, Y., & Li, X. (2017) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2017.29 · Cited by 349
Li, Z., Wang, Y., Yu, J., Guo, Y., & Cao, W. (2017) · Scientific Reports · doi:10.1038/s41598-017-05848-2 · Cited by 346
Remote Sensing Image Scene Classification Using Bag of Convolutional Features
Cheng, G., Li, Z., Yao, X., Guo, L., & Wei, Z. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2731997 · Cited by 335
Zhang, Y., Hong, G. S., Ye, D., Zhu, K., & Fuh, J. Y. H. (2018) · Materials & Design · doi:10.1016/j.matdes.2018.07.002 · Cited by 352
HESS Opinions: Incubating deep-learning-powered hydrologic science advances as a community
Shen, C., Laloy, E., ELSHORBAGY, A. A., Albert, A., Bales, J. D., Chang, F., Ganguly, S., Hsu, K., Kifer, D., Fang, Z. N., et al. (2018) · Hydrology and earth system sciences · doi:10.5194/hess-22-5639-2018 · Cited by 353
Conditional BERT Contextual Augmentation
Wu, X. C., Lv, S., Zang, L., Han, J., & Hu, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22747-0_7 · Cited by 367
Wei, X., Yang, Z., Liu, Y., Wei, D., Jia, L., & Li, Y. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2019.01.008 · Cited by 338
Chen, H., Zhang, K., Lyu, P., Li, H., Zhang, L., Wu, J. Y., & Lee, C. (2019) · Scientific Reports · doi:10.1038/s41598-019-40414-y · Cited by 358
A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothing
Fan, Q., Yang, J., Hua, G., Chen, B., & Wipf, D. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.351 · Cited by 333
Sambasivam, G., & Opiyo, G. D. (2020) · Egyptian Informatics Journal · doi:10.1016/j.eij.2020.02.007 · Cited by 365
Chen, H., Chen, A., Xu, L., Xie, H., Qiao, H., Lin, Q., & Cai, K. (2020) · Agricultural Water Management · doi:10.1016/j.agwat.2020.106303 · Cited by 354
TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentation
Zhang, W., Huang, Z., Luo, G., Chen, T., Wang, X., Liu, W., Yu, G., & Shen, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01177 · Cited by 374
Liu, C., Cao, Y., Luo, Y., Chen, G., Vokkarane, V., Yunsheng, M., Chen, S., & Hou, P. (2018) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2017.2662008 · Cited by 333
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4
Kalyan, K. S. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100048 · Cited by 335
DeepMon: Mobile GPU-based Deep Learning Framework for Continuous Vision Applications
Huynh, L. N., Lee, Y., & Balan, R. K. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081360 · Cited by 329
Emotion Recognition in the Wild via Convolutional Neural Networks and Mapped Binary Patterns
Levi, G., & Hassner, T. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2830587 · Cited by 336
Deep features to classify skin lesions
Kawahara, J., BenTaieb, A., & Hamarneh, G. (2016) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493528 · Cited by 356
Deep Feature Consistent Variational Autoencoder
Hou, X., Shen, L., Sun, K., & Qiu, G. (2017) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2017.131 · Cited by 374
Deep learning features at scale for visual place recognition
Chen, Z., Jacobson, A., Sünderhauf, N., Upcroft, B., Liu, L., Shen, C., Reid, I. D., & Milford, M. J. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989366 · Cited by 350
Deep Learning Advances in Computer Vision with 3D Data
Ioannidou, A., Chatzilari, E., Nikolopoulos, S., & Kompatsiaris, I. Y. (2017) · ACM Computing Surveys · doi:10.1145/3042064 · Cited by 334
Bilinear Convolutional Neural Networks for Fine-Grained Visual Recognition
Lin, T., RoyChowdhury, A., & Maji, S. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2723400 · Cited by 408
Han, X., Zhong, Y., Cao, L., & Zhang, L. (2017) · Remote Sensing · doi:10.3390/rs9080848 · Cited by 340
Remote Sensing Image Fusion With Deep Convolutional Neural Network
Shao, Z., & Cai, J. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2018.2805923 · Cited by 347
Person Re-identification with Deep Similarity-Guided Graph Neural Network
Shen, Y., Li, H., Yi, S., Chen, D., & Wang, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_30 · Cited by 341
Buda, M., Saha, A., & Mazurowski, M. A. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.05.002 · Cited by 360
Review on remote sensing methods for landslide detection using machine and deep learning
Mohan, A., Singh, A. K., Kumar, B., & Dwivedi, R. S. (2020) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.3998 · Cited by 360
LSTM Networks Using Smartphone Data for Sensor-Based Human Activity Recognition in Smart Homes
Mekruksavanich, S., & Jitpattanakul, A. (2021) · Sensors · doi:10.3390/s21051636 · Cited by 356
Clipper: A Low-Latency Online Prediction Serving System
Crankshaw, D., Wang, X., Zhou, G., Franklin, M. J., Gonzalez, J. E., & Stoica, I. (2016) · arXiv · doi:10.48550/arxiv.1612.03079 · Cited by 415
Optimal Wireless Resource Allocation With Random Edge Graph Neural Networks
Eisen, M., & Ribeiro, A. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2988255 · Cited by 327
DeepFL: integrating multiple fault diagnosis dimensions for deep fault localization
Li, X., Li, W., Zhang, Y., & Zhang, L. (2019) · Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3293882.3330574 · Cited by 336
Picking Deep Filter Responses for Fine-Grained Image Recognition
Zhang, X., Xiong, H., Zhou, W., Lin, W., & Tian, Q. C. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.128 · Cited by 332
Hu, W., Singh, R. R. P., & Scalettar, R. T. (2017) · Physical review. E · doi:10.1103/physreve.95.062122 · Cited by 350
Wei, H., Zhao, S., Rong, Q., & Bao, H. (2018) · International Journal of Heat and Mass Transfer · doi:10.1016/j.ijheatmasstransfer.2018.08.082 · Cited by 340
Gomez-Villa, A., Salazar, A., & Vargas‐Bonilla, J. F. (2017) · Ecological Informatics · doi:10.1016/j.ecoinf.2017.07.004 · Cited by 371
MUREL: Multimodal Relational Reasoning for Visual Question Answering
Cadene, R., Ben-younes, H., Cord, M., & Thome, N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00209 · Cited by 330
Regionlets for Generic Object Detection
Wang, X., Yang, M., Shenghuo Zhu, B., & Lin, Y. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.10 · Cited by 325
Identity-Aware Convolutional Neural Network for Facial Expression Recognition
Meng, Z., Liu, P., Cai, J., Han, S., & Tong, Y. (2017) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2017.140 · Cited by 335
Seismic fault detection with convolutional neural network
Xiong, W., Ji, X., Ma, Y., Wang, Y.-X., AlBinHassan, N. M., Al-Ali, M. N., & Luo, Y. (2018) · Geophysics · doi:10.1190/geo2017-0666.1 · Cited by 333
Transfer Learning for Image Classification
Manali, S., & Pawar, M. M. (2018) · International Conference on Electronics, Communication and Aerospace Technology (ICECA) · doi:10.1109/iceca.2018.8474802 · Cited by 358
Machine learning directed drug formulation development
Bannigan, P., Aldeghi, M., Bao, Z., Häse, F., Aspuru‐Guzik, A., & Allen, C. J. (2021) · Advanced Drug Delivery Reviews · doi:10.1016/j.addr.2021.05.016 · Cited by 366
Uncertainty-Guided Transformer Reasoning for Camouflaged Object Detection
Yang, F., Zhai, Q., Li, X., Huang, R., Luo, A., Cheng, H., & Fan, D.-P. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00411 · Cited by 364
Lines, J., Taylor, S., & Bagnall, A. (2018) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3182382 · Cited by 333
Webly Supervised Learning of Convolutional Networks
Chen, X., & Gupta, A. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.168 · Cited by 370
Local Learning With Deep and Handcrafted Features for Facial Expression Recognition
Georgescu, M.-I., Ionescu, R. T., & Popescu, M. (2019) · IEEE Access · doi:10.1109/access.2019.2917266 · Cited by 351
Inverting the Generator of a Generative Adversarial Network
Creswell, A., & Bharath, A. A. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2875194 · Cited by 332
SRM: A Style-Based Recalibration Module for Convolutional Neural Networks
Lee, H., Kim, H., & Nam, H. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00194 · Cited by 379
HarDNet: A Low Memory Traffic Network
Chao, P., Kao, C.-Y., Ruan, Y.-S., Huang, C., & Lin, Y.-L. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00365 · Cited by 366
The Role of Artificial Intelligence in Early Cancer Diagnosis
Hunter, B., Hindocha, S., & Lee, R. W. (2022) · Cancers · doi:10.3390/cancers14061524 · Cited by 384
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and TextPreprint
Akbari, H., Yuan, L., Qian, R., Chuang, W.-H., Chang, S., Cui, Y., & Gong, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.11178 · Cited by 469
Deep Multi-patch Aggregation Network for Image Style, Aesthetics, and Quality Estimation
Lu, X., Lin, Z., Shen, X., Měch, R., & Wang, J. Z. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.119 · Cited by 326
Vetrivel, A., Gerke, M., Kerle, N., Nex, F., & George Vosselman, A. (2017) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.03.001 · Cited by 332
Interpreting Deep Visual Representations via Network Dissection
Zhou, B., Bau, D., Oliva, A., & Torralba, A. B. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858759 · Cited by 347
Multi-label Image Recognition by Recurrently Discovering Attentional Regions
Wang, Z., Chen, T., Li, G., Xu, R., & Lin, L. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.58 · Cited by 337
A Proof of Local Convergence for the Adam Optimizer
Bock, S., & Weis, M. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852239 · Cited by 364
Development of Efficient CNN model for Tomato crop disease identification
Agarwal, M., Gupta, S. K., & Biswas, K. K. (2020) · Sustainable Computing Informatics and Systems · doi:10.1016/j.suscom.2020.100407 · Cited by 335
Rudd, E. M., Jain, L. P., Scheirer, W. J., & Boult, T. E. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2707495 · Cited by 352
Image driven machine learning methods for microstructure recognition
Chowdhury, A., Kautz, E. J., Yener, B., & Lewis, D. (2016) · Computational Materials Science · doi:10.1016/j.commatsci.2016.05.034 · Cited by 331
Machine Learning for Neural Decoding
Glaser, J. I., Benjamin, A. S., Chowdhury, R. H., Perich, M. G., Miller, L. E., & Kording, K. P. (2020) · eNeuro · doi:10.1523/eneuro.0506-19.2020 · Cited by 361
Li, S., Niu, D., Malladi, K. T., Zheng, H., Brennan, B. A., & Xie, Y. (2017) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3123939.3123977 · Cited by 329
Distinguishing computer graphics from natural images using convolution neural networks
Rahmouni, N., Nozick, V., Yamagishi, J., & Echizen, I. (2017) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs.2017.8267647 · Cited by 333
QuadricSLAM: Dual Quadrics From Object Detections as Landmarks in Object-Oriented SLAM
Nicholson, L., Milford, M. J., & Sünderhauf, N. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2866205 · Cited by 337
Flow Prediction in Spatio-Temporal Networks Based on Multitask Deep Learning
Zhang, J., Zheng, Y., Sun, J., & Qi, D. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2891537 · Cited by 334
Potato Leaf Diseases Detection Using Deep Learning
Tiwari, D., Ashish, M., Gangwar, N., et al. (2020) · International Conference on Intelligent Computing and Control Systems (ICICCS) · doi:10.1109/iciccs48265.2020.9121067 · Cited by 331
Towards Better Decoding and Language Model Integration in Sequence to Sequence Models
Chorowski, J., & Jaitly, N. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-343 · Cited by 358
Cang, Z., & Wei, G.-W. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005690 · Cited by 330
Deep neural networks for anatomical brain segmentation
de Brebisson, A., & Montana, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301312 · Cited by 330
Vocal Tract Length Perturbation (VTLP) improves speech recognition
Jaitly, N., & Hinton, E. (2013) · Cited by 348
Deep semantic understanding of high resolution remote sensing image
Qu, B., Li, X., Tao, D., & Lu, X. (2016) · 2016 International Conference on Computer, Information and Telecommunication Systems (CITS) · doi:10.1109/cits.2016.7546397 · Cited by 350
Deep Learning for Multi-task Medical Image Segmentation in Multiple Modalities
Moeskops, P., Wolterink, J. M., van der Velden, B. H. M., Gilhuijs, K. G. A., Leiner, T., Viergever, M. A., & Išgum, I. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_55 · Cited by 354
Roth, H. R., Lu, L., Lay, N., Harrison, A. P., Farag, A., Sohn, A., & Summers, R. M. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.01.006 · Cited by 325
A Comprehensive Analysis of Deep Regression
Lathuilière, S., Mesejo, P., Alameda-Pineda, X., & Horaud, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2910523 · Cited by 358
Residual networks behave like ensembles of relatively shallow networks
Veit, A., Wilber, M. J., & Belongie, S. (2016) · neural information processing systems · Cited by 326
Depthwise separable convolution architectures for plant disease classification
Kamal, K. C., Yin, Z., Wu, M., & Wu, Z. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.104948 · Cited by 348
A survey on data‐efficient algorithms in big data era
Adadi, A. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00419-9 · Cited by 331
Med3D: Transfer Learning for 3D Medical Image AnalysisPreprint
Chen, S., Ma, K., & Zheng, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.00625 · Cited by 656
Aljundi, R., Kelchtermans, K., & Tuytelaars, T. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01151 · Cited by 335
Sadaei, H. J., Silva, P. C. D. L. E., Guimarães, F. G., & Lee, M. H. (2019) · Energy · doi:10.1016/j.energy.2019.03.081 · Cited by 327
Class-incremental Learning via Deep Model Consolidation
Zhang, J., Zhang, J., Ghosh, S., Li, D., Taşcı, Ş., Heck, L. P., Zhang, H., & Kuo, C. ‐. J. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093365 · Cited by 361
Deep reinforcement learning in smart manufacturing: A review and prospects
Li, C., Zheng, P., Yin, Y., Wang, B., & Wang, L. (2022) · CIRP journal of manufacturing science and technology · doi:10.1016/j.cirpj.2022.11.003 · Cited by 358
Metadata
- Authors
- Krizhevsky, A., Sutskever, I., & Hinton, G. E.
- Affiliations
- Google (United States) (US)
- University of Toronto (CA)
- Venue
- Communications of the ACM
- Published
- 2017-05-24
- Volume
- 60
- Issue
- 6
- Pages
- 84-90
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2163605009
- Cited by
- 112,155
- References
- 27
- Citations by year
- 2026: 2710 · 2025: 7710 · 2024: 10211 · 2023: 12267 · 2022: 12280 · 2021: 15497 · 2020: 14538 · 2019: 13976 · 2018: 9999 · 2017: 6661
- FWCI
- 5127.18
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Communications of the ACM (publishedVersion)
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- ImageNet, image classification, deep convolutional neural networks, dropout regularization, overfitting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
