The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-Grained Image Recognition
Abstract
Recognizing fine-grained categories (e.g., bird species) is difficult due to the challenges of discriminative region localization and fine-grained feature learning. Existing approaches predominantly solve these challenges independently, while neglecting the fact that region detection and fine-grained feature learning are mutually correlated and thus can reinforce each other. In this paper, we propose a novel recurrent attention convolutional neural network (RA-CNN) which recursively learns discriminative region attention and region-based feature representation at multiple scales in a mutual reinforced way. The learning at each scale consists of a classification sub-network and an attention proposal sub-network (APN). The APN starts from full images, and iteratively generates region attention from coarse to fine by taking previous prediction as a reference, while the finer scale network takes as input an amplified attended region from previous scale in a recurrent way. The proposed RA-CNN is optimized by an intra-scale classification loss and an inter-scale ranking loss, to mutually learn accurate region attention and fine-grained representation. RA-CNN does not need bounding box/part annotations and can be trained end-to-end. We conduct comprehensive experiments and show that RA-CNN achieves the best performance in three fine-grained tasks, with relative accuracy gains of 3.3%, 3.7%, 3.8%, on CUB Birds, Stanford Dogs and Stanford Cars, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Research works printed but not linked: 30
- zhang, 2014, Part-based R-CNNs for fine-grained category detection, ECCV, 1173
- 10.1109/CVPR.2016.129 · DOI · Paper page
- xiao, 2015, The application of two-level attention models in deep convolutional neural network for fine-grained image classification, CVPR, 842
- welinder, 2010, Caltech-UCSD Birds 200, Technical Report CNS-TR-2010-001
- zhao, 2016, Diversified visual attention networks for fine-grained object classification
- 10.1109/CVPR.2016.128 · DOI · Paper page
- huang, 2016, Part-stacked CNN for fine-grained visual categorization, CVPR, 1173
- jaderberg, 2015, Spatial transformer networks, NIPS, 2017
- 10.1109/CVPR.2016.494 · DOI · Paper page
- khosla, 2011, Novel dataset for fine-grained image categorization, ICCV Workshop
- 10.1109/CVPR.2015.7299194 · DOI · Paper page
- krause, 2016, The unreasonable effectiveness of noisy data for fine-grained recognition, ECCV, 301
- 10.1109/ICCVW.2013.77 · DOI · Paper page
- 10.1109/CVPR.2015.7298775 · DOI · Paper page
- 10.1109/ICCV.2015.170 · DOI · Paper page
- 10.1109/ICCV.2015.276 · DOI · Paper page
- 10.1145/2736277.2741112 · DOI
- simonyan, 2015, Very deep convolutional networks for large-scale image recognition, ICLRE, 1409
- 10.1109/ICCV.2015.230 · DOI
- wang, 2016, Beyond object recognition: Visual sentiment analysis with deep coupled adjective and noun neural networks, IJCAI
- 10.1109/TCSVT.2014.2380211 · DOI
- 10.1109/CVPR.2014.81 · DOI · Paper page
- branson, 2014, Bird species categorization using pose normalized deep convolutional nets, BMVC
- anne, 2016, Deep compositional captioning: Describing novel object categories without paired training data, CVPR
- liu, 2016, Fully convolutional attention localization networks Efficient attention localization for fine-grained recognition
- 10.1109/ICCV.2011.6126398 · DOI
- 10.1109/CVPR.2006.42 · DOI · Paper page
- 10.1109/CVPR.2016.13 · DOI · Paper page
- 10.1109/CVPR.2015.7298998 · DOI
- 10.1109/ICCV.2015.136 · DOI · Paper page
Cited by
Attention mechanisms in computer vision: A survey
Guo, M.-H., Xu, T.-X., Liu, J.-J., Liu, Z.-N., Jiang, P.-T., Mu, T.-J., Zhang, S.-H., Martin, R. R., Cheng, M.-M., & Hu, S.-M. (2022) · Computational Visual Media · doi:10.1007/s41095-022-0271-y · Cited by 2,566
“[97, 46, 139, 70, 128, 36, 11, 156] , [137, 143, 63, 161, 159, 6, 177, 80] , [67, 180, 10, 23, 24, 163, 155, 151] , [44, 49, 106, 64, 168, 18, 11, 36] , [48, 16, 169, 153, 174, 127, 53, 92] , [89, 21, 5, 134, 65, 171, 2, 109] , [45, 82, 157, 91, 100, 129, 146, 131] , [138, 85, 175, 76, 166, 133, 167, 172] , [41, 1, 17…”
Learning Multi-attention Convolutional Neural Network for Fine-Grained Image Recognition
Zheng, H., Fu, J., Mei, T., & Luo, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.557 · Cited by 1,045
Self-citationMulti-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019
“Fine-grained classification [50, 49, 13, 37, 12, 52, 47, 17, 10] is a challenging research task in computer vision, which captures the local discriminative features to distinguish different fine-grained categories.”
BackgroundDynamic Neural Networks: A Survey
Han, Y., Huang, G., Song, S., Yang, L., Wang, H., & Wang, Y. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3117837 · Cited by 848
This Looks Like That: Deep Learning for Interpretable Image Recognition
Chen, C., Li, O., Tao, C., Barnett, A. J., Su, J., & Rudin, C. (2018) · arXiv · doi:10.48550/arxiv.1806.10574 · Cited by 702
TransFG: A Transformer Architecture for Fine-Grained Recognition
He, J., Chen, J.-N., Liu, S., Kortylewski, A., Yang, C., Bai, Y., & Wang, C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19967 · Cited by 551
Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identification
Rao, Y., Chen, G., Lu, J., & Zhou, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00106 · Cited by 380
Min, W., Jiang, S., Liu, L., Rui, Y., & Jain, R. (2020) · ACM Computing Surveys · doi:10.1145/3329168 · Cited by 341
RAIM: Recurrent Attentive and Intensive Model of Multimodal Patient Monitoring Data
Xu, Y., Biswal, S., Deshpande, S. R., Maher, K. O., & Sun, J. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220051 · Cited by 144
“Extensive attention-based deep models have been developed for images [14, 21, 36, 48], audios and videos [23, 49], machine translations [1, 30, 46].”
BackgroundMultimodal Recurrent Neural Networks With Information Transfer Layers for Indoor Scene Labeling
Abdulnabi, A. H., Shuai, B., Zuo, Z., Chau, L.-P., & Wang, G. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2774007 · Cited by 33
Multiscale ensemble of convolutional neural networks for skin lesion classification
Liu, Y., Wang, Z., Li, Z., Li, J., Li, T., Chen, P., & Liang, R. (2021) · IET Image Processing · doi:10.1049/ipr2.12214 · Cited by 18
Metadata
- Authors
- Fu, J., Zheng, H., & Mei, T.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 4476-4484
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2737725206
- Cited by
- 1,400
- References
- 5
- FWCI
- 39.07
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.