Speeding up Convolutional Neural Networks with Low Rank Expansions
Open accessThe DOI matches its OpenAlex record; 34 of the 34 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382 · cited 1×
“However, this does not actually result in better classification accuracy than doing L2 data reconstruction optimization – in practice, optimizing the separable basis within the full network leads to overfitting of the training data, and attempts to minimize this overfitting through regularization methods like dropout…”
BackgroundCNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
DeepPose: Human Pose Estimation via Deep Neural Networks
Toshev, A., & Szegedy, C. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.214 · Cited by 3,185
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 1×
“The increasing use of these networks for detection in sliding window approaches [9, 28, 33] and the desire to apply CNNs in real-world systems means the speed of inference becomes an important factor for applications.”
BackgroundOverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680 · cited 4×
“The increasing use of these networks for detection in sliding window approaches [9, 28, 33] and the desire to apply CNNs in real-world systems means the speed of inference becomes an important factor for applications.”
BackgroundMethodInfluentialLee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
Denton, R., Zaremba, W., Bruna, J., LeCun, Y., & Fergus, R. (2014) · arXiv · doi:10.48550/arxiv.1404.0736 · Cited by 1,414 · cited 4×
“We also don’t approximate Conv1 due to the fact that it acts on raw pixels from natural images – the filters in Conv1 are very different to those found in the rest of the network and experimentally we found that they cannot be approximated well by separable filters (also observed in [7]).”
BackgroundMethodInfluentialEnd-to-end scene text recognition
Wang, K., Babenko, B., & Belongie, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126402 · Cited by 1,060
End-to-End Text Recognition with Convolutional Neural Networks
Wang, T., Wu, D. J., Coates, A., & Ng, A. Y. (2012) · Cited by 1,047
Goodfellow, I. J., Warde-Farley, D., Mirza, M., Courville, A., & Bengio, Y. (2013) · arXiv · doi:10.48550/arxiv.1302.4389 · Cited by 935
Predicting Parameters in Deep Learning
Denil, M., Shakibi, B., Dinh, L., Ranzato, M., & de Freitas, N. (2013) · arXiv · doi:10.48550/arxiv.1306.0543 · Cited by 853 · cited 1×
“While a few other CNN acceleration methods exist, our key insight is to exploit the redundancy that exists between different feature channels and filters [6].”
BackgroundReal-time scene text localization and recognition
Neumann, L., & Matas, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248097 · Cited by 827
Segmentation as selective search for object recognition
van de Sande, K. E. A., Uijlings, J. R. R., Gevers, T., & Smeulders, A. W. M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126456 · Cited by 739 · cited 1×
“Furthermore, search space reduction techniques such as selective search [39] drastically cut down the number of times a full forward pass of the CNN must be computed by cheaply identifying a small number of candidate object locations in the image.”
(2011) · Cited by 713
DenseNet: Implementing Efficient ConvNet Descriptor Pyramids
Iandola, F., Moskewicz, M. W., Karayev, S., Girshick, R., Darrell, T. J., & Keutzer, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.1869 · Cited by 629
Learning Convolutional Feature Hierarchies for Visual Recognition
Kavukcuoglu, K., Sermanet, P., Boureau, Y.-L., Gregor, K., Mathieu, M., & LeCun, Y. (2010) · neural information processing systems · Cited by 604
Multi-digit Number Recognition from Street View Imagery using Deep Convolutional Neural Networks
Goodfellow, I. J., Bulatov, Y., Ibarz, J., Arnoud, S., & Shet, V. (2013) · arXiv · doi:10.48550/arxiv.1312.6082 · Cited by 582 · cited 1×
“The combination of an endto-end learning system with minimal need for human design decisions, and the ability to efficiently train large and complex models, have allowed them to achieve state-of-the-art performance in a number of benchmarks [10, 14, 19, 33, 37, 38].”
BackgroundA Method for Text Localization and Recognition in Real-World Images
Neumann, L., & Matas, J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-19318-7_60 · Cited by 487
PhotoOCR: Reading Text in Uncontrolled Conditions
Bissacco, A., Cummins, M., Netzer, Y., & Neven, H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.102 · Cited by 457
CHARACTER RECOGNITION IN NATURAL IMAGES
de Campos, T. E., Babu, B. R., & Varma, M. (2009) · Cited by 448
ICDAR 2005 text locating competition results
Lucas, S. M. (2005) · Eighth International Conference on Document Analysis and Recognition (ICDAR'05) · doi:10.1109/icdar.2005.231 · Cited by 284
Fast Training of Convolutional Networks through FFTs
Mathieu, M., Henaff, M., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.5851 · Cited by 273 · cited 4×
“[23] performs convolutions in the Fourier domain through FFTs computed efficiently over batches of images on a GPU.”
BackgroundMethodInfluentialAre sparse representations really relevant for image classification?
Rigamonti, R., Brown, M. A., & Lepetit, V. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995313 · Cited by 200
Simplifying ConvNets for Fast Learning
Mamalet, F., & García, C. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33266-1_8 · Cited by 154
Text Localization in Real-World Images Using Efficiently Pruned Exhaustive Search
Neumann, L., & Matas, J. (2011) · 2011 International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2011.144 · Cited by 148
End-to-End Text Recognition with Hybrid HMM Maxout ModelsPreprint
Alsharif, O., & Pineau, J. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1310.1811 · Cited by 123
Large-Scale FPGA-Based Convolutional Networks
Farabet, C., Lecun, Y., Kavukcuoglu, K., Martini, B., Akselrod, P., Talay, S., & Culurciello, E. (2011) · Scaling up Machine Learning · doi:10.1017/cbo9781139042918.020 · Cited by 121
A framework for improved video text detection and recognition
Yang, H., Quehl, B., & Sack, H. (2012) · Multimedia Tools and Applications · doi:10.1007/s11042-012-1250-6 · Cited by 50
Using text-spotting to query the world
Posner, I., Corke, P., & Newman, P. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5653151 · Cited by 39
Discriminatively Activated Sparselets
Girshick, R., Song, H. O., & Darrell, T. (2013) · International Conference on Machine Learning · Cited by 27
Scene Parsing with Multiscale Feature Learning, Purity Trees, and Optimal Covers
Farabet, C., Couprie, C., Najman, L. A., & LeCun, Y. (2012) · HAL · Cited by 22
Scene Text Localization and Recognition with Oriented Stroke Detection
Ji, N. (2013) · Cited by 6
Large-scale mining and retrieval of visual data in a multimodal context
Quack, T. (2008) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-005791511 · Cited by 5
Cited by
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01083 · Cited by 9,982
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Ma, N., Zhang, X., Zheng, H.-T., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_8 · Cited by 7,356
Metadata
- Authors
- Jaderberg, M., Vedaldi, A., & Zisserman, A.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2014-05-15
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1405.3866
- OpenAlex
- W2950967261
- Cited by
- 447
- References
- 34
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.