The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Bilinear CNN Models for Fine-Grained Visual Recognition
Open accessAbstract
We propose bilinear models, a recognition architecture that consists of two feature extractors whose outputs are multiplied using outer product at each location of the image and pooled to obtain an image descriptor. This architecture can model local pairwise feature interactions in a translationally invariant manner which is particularly useful for fine-grained categorization. It also generalizes various orderless texture descriptors such as the Fisher vector, VLAD and O2P. We present experiments with bilinear models where the feature extractors are based on convolutional neural networks. The bilinear form simplifies gradient computation and allows end-to-end training of both networks using image labels only. Using networks initialized from the ImageNet dataset followed by domain specific fine-tuning we obtain 84.1% accuracy of the CUB-200-2011 dataset requiring only category labels at training time. We present experiments and visualizations that analyze the effects of fine-tuning and the choice two networks on the speed and accuracy of the models. Results show that the architecture compares favorably to the existing state of the art on a number of fine-grained datasets while being substantially simpler and easier to train. Moreover, our most accurate model is fairly efficient running at 8 frames/sec on a NVIDIA Tesla K40 GPU. The source code for the complete system will be made available at http://vis-www.cs.umass.edu/bcnn.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019
Describing Textures in the Wild
Cimpoi, M., Maji, S., Kokkinos, I., Mohamed, S., & Vedaldi, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.461 · Cited by 2,438
Self-citationHypercolumns for object segmentation and fine-grained localization
Hariharan, B., Arbelaez, P., Girshick, R., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298642 · Cited by 1,511
Separating Style and Content with Bilinear Models
Tenenbaum, J. B., & Freeman, W. T. (2000) · Neural Computation · doi:10.1162/089976600300015349 · Cited by 840 · cited 2×
“Bilinear models were proposed by Tanenbaum and Freeman [33] to model two-factor variations, such as “style” and “content”, for images.”
Method
Cited by
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
Second-Order Attention Network for Single Image Super-Resolution
Dai, T., Cai, J., Zhang, Y., Xia, S.-T., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01132 · Cited by 2,010
Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
Fukui, A., Park, D. H., Yang, D., Rohrbach, A., Darrell, T., & Rohrbach, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1044 · Cited by 1,582
Do Better ImageNet Models Transfer Better?
Kornblith, S., Shlens, J., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00277 · Cited by 1,325
Learning Multi-attention Convolutional Neural Network for Fine-Grained Image Recognition
Zheng, H., Fu, J., Mei, T., & Luo, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.557 · Cited by 1,045
Machine Learning Methods for Histopathological Image Analysis
Komura, D., & Ishikawa, S. (2018) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2018.01.001 · Cited by 937
Review of Image Classification Algorithms Based on Convolutional Neural Networks
Chen, L., Li, S., Bai, Q., Yang, J., Jiang, S., & Miao, Y. (2021) · Remote Sensing · doi:10.3390/rs13224712 · Cited by 789
X-Linear Attention Networks for Image Captioning
Pan, Y., Yao, T., Li, Y., & Mei, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01098 · Cited by 720
This Looks Like That: Deep Learning for Interpretable Image Recognition
Chen, C., Li, O., Tao, C., Barnett, A. J., Su, J., & Rudin, C. (2018) · arXiv · doi:10.48550/arxiv.1806.10574 · Cited by 702
Global Second-Order Pooling Convolutional Networks
Gao, Z., Xie, J., Wang, Q., & Li, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00314 · Cited by 524
Multiscale Feature Extraction and Fusion of Image and Text in VQA
Lu, S., Ding, Y., Liu, M., Yin, Z., Yin, L., & Zheng, W. (2023) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-023-00233-6 · Cited by 422
Low-Rank Bilinear Pooling for Fine-Grained Classification
Kong, S., & Fowlkes, C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.743 · Cited by 367
A survey on deep learning-based fine-grained object classification and semantic segmentation
Zhao, B., Feng, J., Wu, X., & Yan, S. (2017) · International Journal of Automation and Computing · doi:10.1007/s11633-017-1053-3 · Cited by 339
Bilinear Convolutional Neural Networks for Fine-Grained Visual Recognition
Lin, T.-Y., RoyChowdhury, A., & Maji, S. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2723400 · Cited by 328
Self-citationVibration‐based structural state identification by a 1‐dimensional convolutional neural network
Zhang, Y., Miyamori, Y., Mikami, S., & Saito, T. (2019) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12447 · Cited by 303
Attention-Based 3D-CNNs for Large-Vocabulary Sign Language Recognition
Huang, J., Zhou, W., Li, H., & Li, W. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2870740 · Cited by 232
METransformer: Radiology Report Generation by Transformer with Multiple Learnable Expert Tokens
Wang, Z., Liu, L., Wang, L., & Zhou, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01112 · Cited by 184
“Further, in the bilinear transformer encoder, to enable each “expert” to capture fine-grained image information, we compute higher-order attention between expert tokens and visual tokens, which has proved to be effective in fine-grained classification tasks [20].”
BackgroundMethodWang, Y., Yu, K., Chen, C., Hu, X., & Peng, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00703 · Cited by 161
Mai, S., Hu, H., & Xing, S. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1046 · Cited by 153
Presence-Only Geographical Priors for Fine-Grained Image Classification
Aodha, O. M., Cole, E., & Perona, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00969 · Cited by 149
Feature Fusion for Online Mutual Knowledge Distillation
Kim, J., Hyun, M., Chung, I., & Kwak, N. (2021) · 2020 25th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr48806.2021.9412615 · Cited by 106
Multimodal spatio-temporal deep learning approach for neonatal postoperative pain assessment
Salekin, M. S., Zamzmi, G., Goldgof, D., Kasturi, R., Ho, T., & Sun, Y. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104150 · Cited by 94
Object Detection with Transformers: A Review
Shehzadi, T., Hashmi, K. A., Liwicki, M., Stricker, D., & Afzal, M. Z. (2025) · Sensors · doi:10.3390/s25196025 · Cited by 93
Mai, S., Xing, S., & Hu, H. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2925966 · Cited by 89
Zhou, H., Du, J., Zhang, Y., Wang, Q., Liu, Q.-F., & Lee, C.-H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3096037 · Cited by 85
Body Joint Guided 3-D Deep Convolutional Descriptors for Action Recognition
Cao, C., Zhang, Y., Zhang, C., & Lu, H. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2756840 · Cited by 78
Development of an automatic monitoring system for rice light-trap pests based on machine vision
YAO, Q., FENG, J., TANG, J., XU, W.-G., ZHU, X.-H., YANG, B.-J., LÜ, J., XIE, Y.-Z., YAO, B., WU, S.-Z., et al. (2020) · Journal of Integrative Agriculture · doi:10.1016/s2095-3119(20)63168-9 · Cited by 76
Deepfake forensics analysis: An explainable hierarchical ensemble of weakly supervised models
Silva, S. H., Bethany, M., Votto, A. M., Scarff, I. H., Beebe, N., & Najafirad, P. (2022) · Forensic Science International: Synergy · doi:10.1016/j.fsisyn.2022.100217 · Cited by 66
Weakly Supervised Deep Detection Networks
Bilen, H., & Vedaldi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.311 · Cited by 144
“It is more difficult to clearly assess the nature of the two streams in [22].”
BackgroundInfluentialDing, J., Lin, Q., Zhang, J., Young, G. M., Jiang, C., Zhong, Y., & Zhang, J. (2021) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-021-03332-5 · Cited by 61
A Generic Automated Surface Defect Detection Based on a Bilinear Model
Zhou, F., Liu, G., Xu, F., & Deng, H. (2019) · Applied Sciences · doi:10.3390/app9153159 · Cited by 47
Fundus Disease Image Classification based on Improved Transformer
Yang, H., Chen, J., & Xu, M. (2021) · 2021 International Conference on Neuromorphic Computing (ICNC) · doi:10.1109/icnc52316.2021.9608181 · Cited by 31
Kwon, H., Abowd, G. D., & Plötz, T. (2021) · Sensors · doi:10.3390/s21248337 · Cited by 30
Prakash, A., Thejaswin, S., Nambiar, A., & Bernardino, A. (2023) · 2023 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb57857.2023.10448765 · Cited by 5
Metadata
- Authors
- Lin, T.-Y., RoyChowdhury, A., & Maji, S.
- Venue
- 2015 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2015-12
- Pages
- 1449-1457
- OpenAlex
- W2104657103
- Cited by
- 2,135
- References
- 8
- FWCI
- 47.52
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
