The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Hierarchical Deep Click Feature Prediction for Fine-Grained Image Recognition
Abstract
The click feature of an image, defined as the user click frequency vector of the image on a predefined word vocabulary, is known to effectively reduce the semantic gap for fine-grained image recognition. Unfortunately, user click frequency data are usually absent in practice. It remains challenging to predict the click feature from the visual feature, because the user click frequency vector of an image is always noisy and sparse. In this paper, we devise a Hierarchical Deep Word Embedding (HDWE) model by integrating sparse constraints and an improved RELU operator to address click feature prediction from visual features. HDWE is a coarse-to-fine click feature predictor that is learned with the help of an auxiliary image dataset containing click information. It can therefore discover the hierarchy of word semantics. We evaluate HDWE on three dog and one bird image datasets, in which Clickture-Dog and Clickture-Bird are utilized as auxiliary datasets to provide click data, respectively. Our empirical studies show that HDWE has 1) higher recognition accuracy, 2) a larger compression ratio, and 3) good one-shot learning ability and scalability to unseen categories.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Caltech-UCSD Birds-200-2011 Dataset
Wah, C. (2024) · CaltechAUTHORS (California Institute of Technology) · doi:10.57702/i9oeewf6 · Cited by 3,525
Fu, J., Zheng, H., & Mei, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.476 · Cited by 1,400
Part-Based R-CNNs for Fine-Grained Category Detection
Zhang, N., Donahue, J., Girshick, R., & Darrell, T. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_54 · Cited by 1,150
Learning Multi-attention Convolutional Neural Network for Fine-Grained Image Recognition
Zheng, H., Fu, J., Mei, T., & Luo, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.557 · Cited by 1,045
Wang, J., Zhang, T., Song, J., Sebe, N., & Shen, H. T. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699960 · Cited by 971
Gao, Y., Beijbom, O., Zhang, N., & Darrell, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.41 · Cited by 871
Adversarial Cross-Modal Retrieval
Wang, B., Yang, Y., Xu, X., Hanjalic, A., & Shen, H. T. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123326 · Cited by 779
Xiao, T., Xu, Y., Yang, K., Zhang, J., Peng, Y., & Zhang, Z. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298685 · Cited by 771
Learning Deep Structure-Preserving Image-Text Embeddings
Wang, L., Li, Y., & Lazebnik, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.541 · Cited by 760
Learning to Navigate for Fine-Grained Classification
Yang, Z., Luo, T., Wang, D., Hu, Z., Gao, J., & Wang, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_26 · Cited by 616
Generalizing Pooling Functions in CNNs: Mixed, Gated, and Tree
Lee, C., Gallagher, P., & Tu, Z. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2703082 · Cited by 579
Bird Species Categorization Using Pose Normalized Deep Convolutional Nets
Branson, S., Horn, G. V., Belongie, S., & Perona, P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2952 · Cited by 559
Click Prediction for Web Image Reranking Using Multimodal Sparse Coding
Yu, J., Rui, Y., & Tao, D. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2311377 · Cited by 550
Self-citationSelective Convolutional Descriptor Aggregation for Fine-Grained Image Retrieval
Wei, X.-S., Luo, J.-H., Wu, J., & Zhou, Z.-H. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2688133 · Cited by 464
Diversified Visual Attention Networks for Fine-Grained Object Classification
Zhao, B., Wu, X., Feng, J., Peng, Q., & Yan, S. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2648498 · Cited by 368
Low-Rank Bilinear Pooling for Fine-Grained Classification
Kong, S., & Fowlkes, C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.743 · Cited by 367
Hierarchical Bilinear Pooling for Fine-Grained Visual Recognition
Yu, C., Zhao, X., Zheng, Q., Zhang, P., & You, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01270-0_35 · Cited by 353
Kernel Pooling for Convolutional Neural Networks
Cui, Y., Zhou, F., Wang, J., Liu, X., Lin, Y., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.325 · Cited by 339
Bilinear Convolutional Neural Networks for Fine-Grained Visual Recognition
Lin, T.-Y., RoyChowdhury, A., & Maji, S. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2723400 · Cited by 328
Joint Feature Selection and Subspace Learning for Cross-Modal Retrieval
Wang, K., He, R., Wang, L., Wang, W., & Tan, T. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2505311 · Cited by 318
SPDA-CNN: Unifying Semantic Part Detection and Abstraction for Fine-Grained Recognition
Zhang, H., Xu, T., Elhoseiny, M., Huang, X., Zhang, S., Elgammal, A., & Metaxas, D. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.129 · Cited by 297
Self-citationPairwise Confusion for Fine-Grained Visual Classification
Dubey, A., Gupta, O., Guo, P., Raskar, R., Farrell, R., & Naik, N. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01258-8_5 · Cited by 234
Fine-Grained Image Classification via Combining Vision and Language
He, X., & Peng, Y. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.775 · Cited by 220
Hierarchical Multimodal LSTM for Dense Visual-Semantic Embedding
Niu, Z., Zhou, M., Wang, L., Gao, X., & Hua, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.208 · Cited by 161
Deep Transfer Network: Unsupervised Domain AdaptationPreprint
Zhang, X., Yu, F. X., Chang, S.-F., & Wang, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.00591 · Cited by 154
Attribute-Aware Attention Model for Fine-grained Representation Learning
Han, K., Guo, J., Zhang, C., & Zhu, M. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240550 · Cited by 140
Boosted Convolutional Neural Networks
Moghimi, M. K., Belongie, S., Saberian, M., Yang, J. W., Vasconcelos, N. M., & Li, L.-J. (2016) · British Machine Vision Conference (BMVC) · doi:10.5244/c.30.24 · Cited by 136
Clickage: towards bridging semantic and intent gaps via mining click logs of search engines
Hua, X., Yang, L., Wang, J., Wang, J., Ye, M., Wang, K., Rui, Y., & Li, J. (2013) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2502081.2502283 · Cited by 116
Self-citationKnowledge-Embedded Representation Learning for Fine-Grained Image Recognition
Chen, T., Lin, L., Chen, R., Yang, W., & Luo, X. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/87 · Cited by 98
Weakly Supervised Metric Learning for Traffic Sign Recognition in a LIDAR-Equipped Vehicle
Tan, M., Wang, B., Wu, Z., Wang, J., & Pan, G. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2506182 · Cited by 81
Self-citationAutomatic Image Dataset Construction from Click-through Logs Using Deep Neural Network
Bai, Y., Yang, K., Yu, W., Xu, C. X., Ma, W., & Zhao, T. (2015) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2733373.2806243 · Cited by 31
Image Recognition by Predicted User Click Feature With Multidomain Multitask Transfer Deep Network
Tan, M., Yu, J., Zhang, H., Rui, Y., & Tao, D. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2921861 · Cited by 26
Self-citationL1-norm latent SVM for compact features in object detection
Tan, M., Pan, G., Wang, Y., Zhang, Y., & Wu, Z. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.09.054 · Cited by 22
Self-citationUser-Click-Data-Based Fine-Grained Image Recognition via Weakly Supervised Metric Learning
Tan, M., Yu, J., Zhou, Y., Gao, F., Rui, Y., & Tao, D. (2018) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3209666 · Cited by 21
Self-citationFine-grained image recognition via weakly supervised click data guided bilinear CNN model
Zheng, G., Tan, M., Yu, J., Wu, Q., & Jianping Fan, B. (2017) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019407 · Cited by 19
Self-citationLearning Semantic Hierarchies: A Continuous Vector Space Approach
Fu, R., Guo, J., Qin, B., Che, W., Wang, H., & Liu, T. (2015) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2014.2377580 · Cited by 17
Fine-Grained Image Recognition from Click-Through Logs Using Deep Siamese Network
Wu, F., & Liu, D. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-51811-4_11 · Cited by 5
Fine-grained Categorization -- Short Summary of our Entry for the ImageNet Challenge 2012Preprint
Göring, C., Freytag, A., Rodner, E., & Denzler, J. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1310.4759 · Cited by 3
Cited by
Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks
Fan, D.-P., Lin, Z., Zhang, Z., Zhu, M., & Cheng, M.-M. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2996406 · Cited by 702
Deep CNN for Brain Tumor Classification
Ayadi, W., Elhamzi, W., Charfi, I., & Atri, M. (2021) · Neural Processing Letters · doi:10.1007/s11063-020-10398-2 · Cited by 448
An Edge Traffic Flow Detection Scheme Based on Deep Learning in an Intelligent Transportation System
Chen, C., Liu, B., Wan, S., Qiao, P., & Pei, Q. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3025687 · Cited by 429
Elharrouss, O., Almaadeed, N., Al-Maadeed, S., & Akbari, Y. (2020) · Neural Processing Letters · doi:10.1007/s11063-019-10163-0 · Cited by 341
Adaptive Fusion of Multi-Scale YOLO for Pedestrian Detection
Hsu, W.-Y., & Lin, W.-Y. (2021) · IEEE Access · doi:10.1109/access.2021.3102600 · Cited by 80
Metadata
- Authors
- Yu, J., Tan, M., Zhang, H., Rui, Y., & Tao, D.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2022-02-01
- Volume
- 44
- Issue
- 2
- Pages
- 563-578
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2965898445
- Cited by
- 498
- References
- 41
- FWCI
- 36.31
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.