The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
The application of two-level attention models in deep convolutional neural network for fine-grained image classification
Open accessAbstract
Fine-grained classification is challenging because categories can only be discriminated by subtle and local differences. Variances in the pose, scale or rotation usually make the problem more difficult. Most fine-grained classification systems follow the pipeline of finding foreground object or object parts (where) to extract discriminative features (what). In this paper, we propose to apply visual attention to fine-grained classification task using deep neural network. Our pipeline integrates three types of attention: the bottom-up attention that propose candidate patches, the object-level top-down attention that selects relevant patches to a certain object, and the part-level top-down attention that localizes discriminative parts. We combine these attentions to train domain-specific deep nets, then use it to improve both the what and where aspects. Importantly, we avoid using expensive annotations like bounding box or part information from end-to-end. The weak supervision constraint makes our work easier to generalize. We have verified the effectiveness of the method on the subsets of ILSVRC2012 dataset and CUB200 2011 dataset. Our pipeline delivered significant improvements and achieved the best accuracy under the weakest supervision condition. The performance is competitive against other methods that rely on additional annotations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019
Caltech-UCSD Birds-200-2011 Dataset
Wah, C. (2024) · CaltechAUTHORS (California Institute of Technology) · doi:10.57702/i9oeewf6 · Cited by 3,525
Automated Flower Classification over a Large Number of Classes
Nilsback, M.-E., & Zisserman, A. (2008) · 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing · doi:10.1109/icvgip.2008.47 · Cited by 3,442
Part-Based R-CNNs for Fine-Grained Category Detection
Zhang, N., Donahue, J., Girshick, R., & Darrell, T. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_54 · Cited by 1,150
Research works printed but not linked: 3
- khosla, 2011, Dataset for fine-grained image categorization, First Workshop on Fine-Grained Visual Categorization CVPR
- 10.1145/2502081.2502129 · DOI
- welinder, 2010, Caltech-UCSD Birds 200
Cited by
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
“In the same line, [278] presented a three-level attention model to perform a fine-grained classifi-cation task.”
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
Residual Attention Network for Image Classification
Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., & Tang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.683 · Cited by 4,073
Social LSTM: Human Trajectory Prediction in Crowded Spaces
Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.110 · Cited by 3,483
A review on the attention mechanism of deep learning
Niu, Z., Zhong, G., & Yu, H. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.03.091 · Cited by 3,379
Explaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507
Fu, J., Zheng, H., & Mei, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.476 · Cited by 1,400
Attention to Scale: Scale-Aware Semantic Image Segmentation
Chen, L.-C., Yang, Y., Wang, J., Xu, W., & Yuille, A. L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.396 · Cited by 1,377
Rotate to Attend: Convolutional Triplet Attention Module
Misra, D., Nalamada, T., Arasanipalai, A. U., & Hou, Q. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00318 · Cited by 1,147
Learning Multi-attention Convolutional Neural Network for Fine-Grained Image Recognition
Zheng, H., Fu, J., Mei, T., & Luo, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.557 · Cited by 1,045
ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs
Yin, W., Schütze, H., Xiang, B., & Zhou, B. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00097 · Cited by 924
Dynamic Neural Networks: A Survey
Han, Y., Huang, G., Song, S., Yang, L., Wang, H., & Wang, Y. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3117837 · Cited by 848
Multi-context Attention for Human Pose Estimation
Chu, X., Yang, W., Ouyang, W., Ma, C., Yuille, A. L., & Wang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.601 · Cited by 737
On the Detection of Digital Face Manipulation
Dang, H., Liu, F., Stehouwer, J., Liu, X., & Jain, A. K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00582 · Cited by 764
This Looks Like That: Deep Learning for Interpretable Image Recognition
Chen, C., Li, O., Tao, C., Barnett, A. J., Su, J., & Rudin, C. (2018) · arXiv · doi:10.48550/arxiv.1806.10574 · Cited by 702
HydraPlus-Net: Attentive Deep Features for Pedestrian Analysis
Liu, X., Zhao, H., Tian, M., Sheng, L., Shao, J., Yi, S., Yan, J., & Wang, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.46 · Cited by 567
Destruction and Construction Learning for Fine-Grained Image Recognition
Chen, Y., Bai, Y., Zhang, W., & Mei, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00530 · Cited by 532
Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning
Cui, Y., Song, Y., Sun, C., Howard, A., & Belongie, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00432 · Cited by 503
Hierarchical Deep Click Feature Prediction for Fine-Grained Image Recognition
Yu, J., Tan, M., Zhang, H., Rui, Y., & Tao, D. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2932058 · Cited by 498
Zheng, H., Fu, J., Zha, Z.-J., & Luo, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00515 · Cited by 488
Part-Stacked CNN for Fine-Grained Visual Categorization
Huang, S., Xu, Z., Tao, D., & Zhang, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.132 · Cited by 468
Selective Convolutional Descriptor Aggregation for Fine-Grained Image Retrieval
Wei, X.-S., Luo, J.-H., Wu, J., & Zhou, Z.-H. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2688133 · Cited by 464
Deep Representation Learning With Part Loss for Person Re-Identification
Yao, H., Zhang, S., Hong, R., Zhang, Y., Xu, C., & Tian, Q. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2891888 · Cited by 439
Learning a Discriminative Filter Bank Within a CNN for Fine-Grained Recognition
Wang, Y., Morariu, V. I., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00436 · Cited by 439
Neural Activation Constellations: Unsupervised Part Model Discovery with Convolutional Networks
Simon, M., & Rodner, E. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.136 · Cited by 394
Object-Part Attention Model for Fine-Grained Image Classification
Peng, Y., He, X., & Zhao, J. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2774041 · Cited by 393
Self-citationMask-CNN: Localizing parts and selecting descriptors for fine-grained bird species categorization
Wei, X.-S., Xie, C.-W., Wu, J., & Shen, C. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.002 · Cited by 392
A survey on deep learning-based fine-grained object classification and semantic segmentation
Zhao, B., Feng, J., Wu, X., & Yan, S. (2017) · International Journal of Automation and Computing · doi:10.1007/s11633-017-1053-3 · Cited by 339
Picking Deep Filter Responses for Fine-Grained Image Recognition
Zhang, X., Xiong, H., Zhou, W., Lin, W., & Tian, Q. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.128 · Cited by 321
Deep Image: Scaling up Image Recognition
Wu, R., Yan, S., Shan, Y., Dang, Q., & Sun, G. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1501.02876 · Cited by 313
Attention, please! A survey of neural attention models in deep learning
de Santana Correia, A., & Colombini, E. L. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10148-x · Cited by 298
SPDA-CNN: Unifying Semantic Part Detection and Abstraction for Fine-Grained Recognition
Zhang, H., Xu, T., Elhoseiny, M., Huang, X., Zhang, S., Elgammal, A., & Metaxas, D. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.129 · Cited by 297
Speech Emotion Classification Using Attention-Based LSTM
Xie, Y., Liang, R., Liang, Z., Huang, C., Zou, C., & Schuller, B. (2019) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2019.2925934 · Cited by 282
Cross-X Learning for Fine-Grained Visual Categorization
Luo, W., Yang, X., Mo, X., Lu, Y., Davis, L., Li, J., Yang, J., & Lim, S.-N. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00833 · Cited by 278
Selective Sparse Sampling for Fine-Grained Image Recognition
Ding, Y., Zhou, Y., Zhu, Y., Ye, Q., & Jiao, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00670 · Cited by 278
Deep Learning Attention Mechanism in Medical Image Analysis: Basics and Beyonds
Li, X., Li, M., Yan, P., Li, G., Jiang, Y., Luo, H., & Yin, S. (2023) · International Journal of Network Dynamics and Intelligence · doi:10.53941/ijndi0201006 · Cited by 269
Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image Retrieval
Song, J., Yu, Q., Song, Y.-Z., Xiang, T., & Hospedales, T. M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.592 · Cited by 261
A Benchmark for Automatic Visual Classification of Clinical Skin Disease Images
Sun, X., Yang, J., Sun, M., & Wang, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_13 · Cited by 197
Human-Centered Artificial Intelligence for Designing Accessible Cultural Heritage
Pisoni, G., Díaz-Rodríguez, N., Gijlers, H., & Tonolli, L. (2021) · Applied Sciences · doi:10.3390/app11020870 · Cited by 183
Presence-Only Geographical Priors for Fine-Grained Image Classification
Aodha, O. M., Cole, E., & Perona, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00969 · Cited by 149
(2018) · arXiv (Cornell University) · Cited by 113
Multi-attention Network for One Shot Learning
Wang, P., Liu, L., Shen, C., Huang, Z., Van Den Hengel, A., & Shen, H. T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.658 · Cited by 91
e-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language Tasks
Kayser, M., Camburu, O.-M., Salewski, L., Emde, C., Do, V., Akata, Z., & Lukasiewicz, T. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00128 · Cited by 68
Metadata
- Authors
- Xiao, T., Xu, Y., Yang, K., Zhang, J., Peng, Y., & Zhang, Z.
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 842-850
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1928906481
- Cited by
- 771
- References
- 26
- FWCI
- 27.85
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.