The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Deep Sketch Hashing: Fast Free-Hand Sketch-Based Image Retrieval
Open accessAbstract
Free-hand sketch-based image retrieval (SBIR) is a specific cross-view retrieval task, in which queries are abstract and ambiguous sketches while the retrieval database is formed with natural images. Work in this area mainly focuses on extracting representative and shared features for sketches and natural images. However, these can neither cope well with the geometric distortion between sketches and images nor be feasible for large-scale SBIR due to the heavy continuous-valued distance computation. In this paper, we speed up SBIR by introducing a novel binary coding method, named Deep Sketch Hashing (DSH), where a semi-heterogeneous deep architecture is proposed and incorporated into an end-to-end binary coding framework. Specifically, three convolutional neural networks are utilized to encode free-hand sketches, natural images and, especially, the auxiliary sketch-tokens which are adopted as bridges to mitigate the sketch-image geometric distortion. The learned DSH codes can effectively capture the cross-view similarities as well as the intrinsic semantic correlations between different categories. To the best of our knowledge, DSH is the first hashing work specifically designed for category-level SBIR with an end-to-end deep architecture. The proposed DSH is comprehensively evaluated on two large-scale datasets of TU-Berlin Extension and Sketchy, and the experiments consistently show DSHs superior SBIR accuracies over several state-of-the-art methods, while achieving significantly reduced retrieval time and memory footprint.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
(1999) · Cited by 3,186
Weiss, Y., Torralba, A. B., & Fergus, R. (2008) · neural information processing systems · Cited by 2,389
Person re-identification by Local Maximal Occurrence representation and metric learning
Liao, S., Hu, Y., Zhu, X., & Li, S. Z. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298832 · Cited by 2,091
Gong, Y., Lazebnik, S., Gordo, A., & Perronnin, F. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.193 · Cited by 1,834
Wold, H. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1914.pub2 · Cited by 1,524
Supervised hashing with kernels
Liu, W., Wang, J., Ji, R., Jiang, Y.-G., & Chang, S.-F. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247912 · Cited by 1,351
Shen, F., Shen, C., Liu, W., & Shen, H. T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298598 · Cited by 1,231
Self-citationKernelized locality-sensitive hashing for scalable image search
Kulis, B., & Grauman, K. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459466 · Cited by 890
Jiang, Q.-Y., & Li, W.-J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.348 · Cited by 880
Eitz, M., Hays, J., & Alexa, M. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185540 · Cited by 868
Collective Matrix Factorization Hashing for Multimodal Data
Ding, G., Guo, Y., & Zhou, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.267 · Cited by 680
Deep Hashing Network for Efficient Similarity Retrieval
Zhu, H., Long, M., Wang, J., & Cao, Y. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10235 · Cited by 664
The sketchy database: learning to retrieve badly drawn bunnies
Sangkloy, P., Burnell, N., Ham, C., & Hays, J. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925954 · Cited by 622
Inter-media hashing for large-scale retrieval from heterogeneous data sources
Song, J., Yang, Y., Yang, Y., Huang, Z., & Shen, H. T. (2013) · Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data · doi:10.1145/2463676.2465274 · Cited by 620
Large-Scale Supervised Multimodal Hashing with Semantic Correlation Maximization
Zhang, D., & Li, W.-J. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8995 · Cited by 616
Locality-sensitive binary codes from shift-invariant kernels
Raginsky, M., & Lazebnik, S. (2009) · Cited by 600
Deep hashing for compact binary codes learning
Liong, V. E., Lu, J., Wang, G., Moulin, P., & Zhou, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298862 · Cited by 545
Semantics-preserving hashing for cross-view retrieval
Lin, Z., Ding, G., Hu, M., & Wang, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299011 · Cited by 542
Liu, W., Mu, C., Kumar, S., & Chang, S. (2014) · Cited by 525
Learning Hash Functions for Cross-View Similarity Search
Kumar, S., & Udupa, R. (2012) · Cited by 490
Latent semantic sparse hashing for cross-modal similarity search
Zhou, J., Ding, G., & Guo, Y. (2014) · Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval · doi:10.1145/2600428.2609610 · Cited by 467
Canonical Correlation Analysis
Thompson, B. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa068 · Cited by 457
Data fusion through cross-modality metric learning using similarity-sensitive hashing
Bronstein, M. M., Bronstein, A. M., Michel, F., & Paragios, N. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539928 · Cited by 455
Sketch Tokens: A Learned Mid-level Representation for Contour and Object Detection
Lim, J. J., Zitnick, C. L., & Dollar, P. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.406 · Cited by 427
Sketch-Based Image Retrieval: Benchmark and Bag-of-Features Descriptors
Eitz, M., Hildebrand, K., Boubekeur, T., & Alexa, M. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2010.266 · Cited by 413
Yu, Q., Liu, F., Song, Y.-Z., Xiang, T., Hospedales, T. M., & Loy, C. C. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.93 · Cited by 413
Learning Compact Binary Face Descriptor for Face Recognition
Lu, J., Liong, V. E., Zhou, X., & Zhou, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2408359 · Cited by 399
Learning Compact Binary Descriptors with Unsupervised Deep Neural Networks
Lin, K., Lu, J., Chen, C.-S., & Zhou, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.133 · Cited by 363
A performance evaluation of gradient field HOG descriptor for sketch based image retrieval
Hu, R., & Collomosse, J. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.02.005 · Cited by 353
Sketch-based 3D shape retrieval using Convolutional Neural Networks
Wang, F., Kang, L., & Li, Y. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298797 · Cited by 344
Linear cross-modal hashing for efficient multimedia search
Zhu, X., Huang, Z., Shen, H. T., & Zhao, X. (2013) · Proceedings of the 21st ACM international conference on Multimedia · doi:10.1145/2502081.2502107 · Cited by 282
Deep Visual-Semantic Hashing for Cross-Modal Retrieval
Cao, Y., Long, M., Wang, J., Yang, Q., & Yu, P. S. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939812 · Cited by 250
Edgel index for large-scale sketch-based image search
Cao, Y., Wang, C., Zhang, L., & Zhang, L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995460 · Cited by 222
Sketch-based image retrieval via Siamese convolutional neural network
Qi, Y., Song, Y.-Z., Zhang, H., & Liu, J. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532801 · Cited by 214
Sketch-a-Net that Beats Humans
Yu, Q., Yang, Y., Song, Y.-Z., Xiang, T., & Hospedales, T. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.7 · Cited by 201
Co-Regularized Hashing for Multimodal Data
Zhen, Y., & Yeung, D. (2012) · Cited by 190
Multiview Alignment Hashing for Efficient Image Search
Liu, L., Yu, M., & Shao, L. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2390975 · Cited by 160
Self-citationA Fast Optimization Method for General Binary Code Learning
Shen, F., Zhou, X., Yang, Y., Song, J., Shen, H. T., & Tao, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2612883 · Cited by 159
Self-citationSketchNet: Sketch Classification with Web Images
Zhang, H., Liu, S., Zhang, C., Ren, W., Wang, R., & Cao, X. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.125 · Cited by 152
An evaluation of descriptors for large-scale image retrieval from sketched feature lines
Eitz, M., Hildebrand, K., Boubekeur, T., & Alexa, M. (2010) · Computers & Graphics · doi:10.1016/j.cag.2010.07.002 · Cited by 144
Learning Binary Codes for Maximum Inner Product Search
Shen, F., Liu, W., Zhang, S., Yang, Y., & Shen, H. T. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.472 · Cited by 142
Self-citationGradient field descriptor for sketch based retrieval and localization
Hu, R. S., Barnard, M., & Collomosse, J. P. (2010) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2010.5649331 · Cited by 140
Efficient Training of Very Deep Neural Networks for Supervised Hashing
Zhang, Z., Chen, Y., & Saligrama, V. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.165 · Cited by 109
Saavedra, J. M. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025606 · Cited by 84
Sequential Discrete Hashing for Scalable Cross-Modality Similarity Retrieval
Liu, L., Lin, Z., Shao, L., Shen, F., Ding, G., & Han, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2619262 · Cited by 74
Self-citationCorrelation Hashing Network for Efficient Cross-Modal Retrieval
Cao, Y., Long, M., & Wang, J. (2017) · British Machine Vision Conference (BMVC) · doi:10.5244/c.31.128 · Cited by 65
SYM-FISH: A Symmetry-Aware Flip Invariant Sketch Histogram Shape Descriptor
Cao, X., Zhang, H., Liu, S., Guo, X., & Lin, L. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.46 · Cited by 61
A bag-of-regions approach to sketch-based image retrieval
Hu, R. S., Wang, T., & Collomosse, J. P. (2011) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2011.6116513 · Cited by 57
Sketch-based image retrieval on a large scale database
Zhou, R. F., Chen, L., & Zhang, L. (2012) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2393347.2396360 · Cited by 55
Indexing billions of images for sketch-based retrieval
Sun, X., Wang, C., Xu, C., et al. (2013) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2502081.2502281 · Cited by 53
Sequential Compact Code Learning for Unsupervised Image Hashing
Liu, L., & Shao, L. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2495345 · Cited by 52
Self-citationSimilarity-Invariant Sketch-Based Image Retrieval in Large Databases
Parui, S., & Mittal, A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10599-4_26 · Cited by 49
Notice of Removal: MDL-CW: A Multimodal Deep Learning Framework with CrossWeights
Rastegar, S., Baghshah, M. S., Rabiee, H. R., & Shojaee, S. M. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.285 · Cited by 49
Large Scale Sketch Based Image Retrieval Using Patch Hashing
Bozas, K., & Ebroul Izquierdo, M. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33179-4_21 · Cited by 34
Simultaneous Local Binary Feature Learning and Encoding for Face Recognition
Lu, J., Liong, V. E., & Zhou, J. (2015) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.424 · Cited by 34
Fine-grained sketch-based image retrieval: The role of part-aware attributes
Li, K., Pang, K., Song, Y.-Z., Hospedales, T. M., Zhang, H., & Hu, Y. (2016) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2016.7477615 · Cited by 29
Multi-Modal Image Retrieval for Complex Queries using Small Codes
Siddiquie, B., White, B., Sharma, A., & Davis, L. S. (2014) · International Conference on Multimedia Retrieval · doi:10.1145/2578726.2578767 · Cited by 25
James, S., Fonseca, M. J., & Collomosse, J. P. (2014) · International Conference on Multimedia Retrieval · doi:10.1145/2578726.2578766 · Cited by 24
Projection Bank: From High-Dimensional Data to Medium-Length Binary Codes
Liu, L., Yu, M., & Shao, L. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.323 · Cited by 24
Self-citationHashing Cross-Modal Manifold for Scalable Sketch-Based 3D Model Retrieval
Furuya, T., & Ohbuchi, R. (2014) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2014.72 · Cited by 14
Cross-View Feature Learning for Scalable Social Image Analysis
Xie, W., Peng, Y., & Xiao, J. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8727 · Cited by 14
Sketch2Manga: Sketch-based manga retrieval
Matsui, Y., Aizawa, K., & Jing, Y. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025626 · Cited by 13
Cited by
Unsupervised Deep Hashing with Similarity-Adaptive and Discrete Optimization
Shen, F., Xu, Y., Liu, L., Yang, Y., Huang, Z., & Shen, H. T. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2789887 · Cited by 407
Self-citationA Decade Survey of Content Based Image Retrieval Using Deep Learning
Dubey, S. R. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3080920 · Cited by 356
Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrieval
Saito, K., Sohn, K., Zhang, X., Li, C.-L., Lee, C.-Y., Saenko, K., & Pfister, T. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01850 · Cited by 145
Huang, Z., & Liu, S. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3027001 · Cited by 56
Deep Self-Supervised Representation Learning for Free-Hand Sketch
Xu, P., Song, Z., Yin, Q., Song, Y.-Z., & Wang, L. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3003048 · Cited by 53
Metadata
- Authors
- Liu, L., Shen, F., Shen, Y., Liu, X., & Shao, L.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 2298-2307
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2603445054
- Cited by
- 286
- References
- 68
- FWCI
- 10.68
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.