The DOI matches its Crossref record; 37 of the 44 references it cites were found in a registry or an index.
HD-CNN: Hierarchical Deep Convolutional Neural Networks for Large Scale Visual Recognition
Abstract
In image classification, visual separability between different object categories is highly uneven, and some categories are more difficult to distinguish than others. Such difficult categories demand more dedicated classifiers. However, existing deep convolutional neural networks (CNN) are trained as flat N-way classifiers, and few efforts have been made to leverage the hierarchical structure of categories. In this paper, we introduce hierarchical deep CNNs (HD-CNNs) by embedding deep CNNs into a two-level category hierarchy. An HD-CNN separates easy classes using a coarse category classifier while distinguishing difficult classes using fine category classifiers. During HDCNN training, component-wise pretraining is followed by global fine-tuning with a multinomial logistic loss regularized by a coarse category consistency term. In addition, conditional executions of fine category classifiers and layer parameter compression make HD-CNNs scalable for largescale visual recognition. We achieve state-of-the-art results on both CIFAR100 and large-scale ImageNet 1000-class benchmark datasets. In our experiments, we build up three different two-level HD-CNNs, and they lower the top-1 error of the standard CNNs by 2:65%, 3:1%, and 1:1%.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Convolutional neural networks (CNNs or ConvNets) are a class of deep feed-forward neural networks whose main purpose is to extract spatial patterns from visual input signals [20, 22].”
From A survey on deep multimodal learning for computer vision: advances, trends, applications, and datasets (2022) · cites this paper as [22]
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
Product Quantization for Nearest Neighbor Search
Jégou, H., Douze, M., & Schmid, C. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.57 · Cited by 2,956 · cited 1×
“Specifically, we choose product quantization [14] to compress the parameter matrix W ∈ Rm×n.”
MethodImageNet: A large-scale hierarchical image database
Deng, J., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461
Stochastic Pooling for Regularization of Deep Convolutional Neural NetworksPreprint
Zeiler, M. D., & Fergus, R. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3557 · Cited by 1,010
Goodfellow, I. J., Warde-Farley, D., Mirza, M., Courville, A., & Bengio, Y. (2013) · arXiv · doi:10.48550/arxiv.1302.4389 · Cited by 935
Large-Scale Object Classification Using Label Relation Graphs
Deng, J., Ding, N., Jia, Y., Frome, A., Murphy, K. P., Samy Bengio, A., Li, Y., Neven, H., & Adam, H. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10590-1_4 · Cited by 371
Learning to share visual appearance for multiclass object detection
Salakhutdinov, R., Torralba, A. B., & Tenenbaum, J. B. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995720 · Cited by 330
Label Embedding Trees for Large Multi-Class Tasks
Samy Bengio, A., Weston, J., & Grangier, D. (2010) · Cited by 298
Semantic Hierarchies for Visual Object Recognition
Marszałek, M., & Schmid, C. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383272 · Cited by 293
Xiao, T., Zhang, J., Yang, K., Peng, Y., & Zhang, Z. (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2654926 · Cited by 235
Deep Networks with Internal Selective Attention through Feedback ConnectionsPreprint
Stollenga, M., Masci, J., Gomez, F. J., & Schmidhuber, J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1407.3068 · Cited by 212
Unsupervised discovery of visual object class hierarchies
Šivic, J., Russell, B. C., Zisserman, A., Freeman, W. T., & Efros, A. A. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587622 · Cited by 211
Learning and using taxonomies for fast visual categorization
Griffin, G., & Perona, P. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587410 · Cited by 209
Hedging your bets: Optimizing accuracy-specificity trade-offs in large scale visual recognition
Deng, J., Krause, J., Berg, A., & Fei-Fei, L. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248086 · Cited by 180
Discriminative Transfer Learning with Tree-based Priors
Srivastava, N., & Salakhutdinov, R. (2013) · Cited by 171
Semantic hierarchies for image annotation: A survey
Tousch, A.-M., Herbin, S., & Audibert, J.-Y. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.05.017 · Cited by 157
Constructing Category Hierarchies for Visual Recognition
Marszałek, M., & Schmid, C. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88693-8_35 · Cited by 156
Discriminative learning of relaxed hierarchy for large-scale visual recognition
Gao, T., & Koller, D. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126481 · Cited by 145
Fast and Balanced: Efficient Label Tree Learning for Large Scale Object Recognition
Deng, J., Satheesh, S., Berg, A. C., & Fei-Fei, L. (2011) · Cited by 144
Learning hierarchical similarity metrics
Verma, N., Mahajan, D. K., Sellamanickam, S., & Nair, V. B. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247938 · Cited by 121
Semantic Label Sharing for Learning with Many Categories
Fergus, R., Bernal, H. J., Weiss, Y., & Torralba, A. B. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_55 · Cited by 117
Building and using a semantivisual image hierarchy
Li, L.-J., Wang, C., Lim, Y., Blei, D. M., & Fei-Fei, L. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540027 · Cited by 112
Exploiting Object Hierarchy: Combining Models from Different Category Levels
Zweig, A., & Weinshall, D. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4409064 · Cited by 111
Improving Deep Neural Networks with Probabilistic Maxout UnitsPreprint
Springenberg, J. T., & Riedmiller, M. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.6116 · Cited by 94
Probabilistic Label Trees for Efficient Large Scale Image Classification
Liu, B., Sadeghi, F., Tappen, M. F., Shamir, O., & Liu, C. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.114 · Cited by 78
Large-Scale Category Structure Aware Image Categorization
Zhao, B., Fei-Fei, L., & Xing, E. P. (2011) · Cited by 74
Hierarchical image annotation using semantic hierarchies
Bannour, H., & Hudelot, C. (2012) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2396761.2398659 · Cited by 32
Flagged first, then by citations
7 of the 44 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- jia, 2013, Caffe An Open Source Convolutional Architecture for Fast Feature Embedding
- jia, 2013, Visual concept learning: Combining machine vision and bayesian generalization on concept hierarchies, NIPS
- lee, 2014, Deeply-supervised nets arXiv preprint arXiv 1409 5185
- lin, 2013, Network in network, CoRR
Cited by
Sorted by citations
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
Deep learning for visual understanding: A review
Guo, Y., Liu, Y., Oerlemans, A., Lao, S., Wu, S., & Lew, M. S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.09.116 · Cited by 2,504
Contrastive Learning for Unpaired Image-to-Image Translation
Park, T., Efros, A. A., Zhang, R., & Zhu, J.-Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58545-7_19 · Cited by 1,663
The iNaturalist Species Classification and Detection Dataset
Van Horn, G., Mac Aodha, O., Song, Y., Cui, Y., Sun, C., Shepard, A., Adam, H., Perona, P., & Belongie, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00914 · Cited by 1,451
“This direction would encourage new error measures that incorporate taxonomic rank [25, 47].”
BackgroundDynamic Neural Networks: A Survey
Han, Y., Huang, G., Song, S., Yang, L., Wang, H., & Wang, Y. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3117837 · Cited by 848
“For instance, a small CNN is first executed to classify each sample into coarse categories, and specific sub-networks are conditionally activated based on the coarse predictions [103].”
Background
Metadata
- Authors
- Yan, Z., Zhang, H., Piramuthu, R., Jagadeesh, V., DeCoste, D., Di, W., & Yu, Y.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Carnegie Mellon University (US)
- eBay (Ireland) (IE)
- Venue
- 2015 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2015-12
- Pages
- 2740-2748
- OpenAlex
- W2962860144
- Cited by
- 936
- References
- 44
- Citations by year
- 2026: 19 · 2025: 79 · 2024: 310 · 2023: 142 · 2022: 42 · 2021: 79 · 2020: 103 · 2019: 61 · 2018: 41 · 2017: 43 · 2016: 16 · 2015: 1
- FWCI
- 13.68
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- The HKU Scholars Hub (University of Hong Kong) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- coarse-to-fine classification, large-scale image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
