Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval
Open accessThe DOI matches its Crossref record; 81 of the 96 references it cites were found in a registry or an index; 6 of the 38 sources its claims cite were checked for support.
Abstract
This paper proposes a deep hashing framework, namely Unsupervised Deep Video Hashing (UDVH), for largescale video similarity search with the aim to learn compact yet effective binary codes. Our UDVH produces the hash codes in a self-taught manner by jointly integrating discriminative video representation with optimal code learning, where an efficient alternating approach is adopted to optimize the objective function. The key differences from most existing video hashing methods lie in 1) UDVH is an unsupervised hashing method that generates hash codes by cooperatively utilizing feature clustering and a specifically-designed binarization with the original neighborhood structure preserved in the binary space; 2) a specific rotation is developed and applied onto video features such that the variance of each dimension can be balanced, thus facilitating the subsequent quantization step. Extensive experiments performed on three popular video datasets show that UDVH is overwhelmingly better than the state-of-the-arts in terms of various evaluation metrics, which makes it practical in real-world applications.
Overview
CoChat Summary
TL;DR
The paper proposes Unsupervised Deep Video Hashing (UDVH), a self-taught deep hashing framework that jointly learns video representations and balanced binary codes via feature clustering, CCA, and a balanced rotation. On FCVID, YFCC, and ActivityNet, UDVH-TSN outperforms state-of-the-art video hashing baselines in retrieval accuracy and training efficiency.
Key findings
- UDVH-TSN achieves mAP@20 of 50.4% on FCVID at 128 bits, 4.8% higher than UDVH-LSTM (45.6%) and 8.9% over SSTH; on YFCC it reaches 29.8% vs. 26.1% and 24%; on ActivityNet it reaches 26.2% vs. 20.7% and 17.8%.
- Precision@100 at 64 bits is 51% on FCVID (at least about 3.6% higher than comparable baselines), 30.2% on YFCC vs. SSTH’s 26.3%, and 26.1% on ActivityNet vs. SSTH’s 20.4%.
- The balanced rotation (CCA-BR) outperforms CCA-ITQ and PCA-BR, producing flatter per-dimension variance; cluster number around 400 gives best mAP@20 at 128 bits (FCVID 0.504, YFCC 0.293, ActivityNet 0.262).
- Training is efficient: UDVH-TSN takes about 0.74–0.81 hours per loop and less than 4.5 hours total, versus over 8 hours for SSTH; balanced rotation costs only seconds.
Methods
- UDVH uses k-means on 10,000 sampled FC7 1024-d video features to generate C pseudo-labels, CCA to project features to k dimensions, and a balanced rotation solved as an orthogonality-constrained l2,1-norm maximization; it alternates updating R, B = sign(H × R), and deep parameters Θ via SGD minimizing ||F(Z; Θ) − B||_F^2, with t = 3–5 loops.
- The deep architecture uses modified Temporal Segment Networks (TSNs) with spatial and temporal ConvNets, fused global-pool features, and two fully connected layers (FC7 and FC8); 20 frames are uniformly sampled per video.
- Experiments use FCVID (91,223 videos, 239 categories; 45,611 train), YFCC (0.7M processed videos; 0.6M unlabeled train, 0.1M labeled test), and ActivityNet (~20,000 clips, 200 categories; ~10,000 train/test; 1,000 queries), comparing against AGH, SubMod, ITQ, SP, MFH, DH, SSTH, and UDVH-LSTM with mAP@K, PR, and Precision@100 at 16/32/64/128 bits.
Limitations
- The paper states ActivityNet gives the worst performance due to many untrimmed videos and large intra-class variance, with improvement there described as “a bit limited”; YFCC performance drops because many videos are low-quality amateur mobile clips; loss-function effects are not obvious (less than 3% improvement).
- Evident from the text: cluster number C, iteration count t, and other hyperparameters are chosen empirically, and the alternating optimization may only find a local optimum.
- Evident from the text: evaluation is limited to three video datasets and a selected set of baselines, and the method is unsupervised, relying on pseudo-labels rather than manual labels.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 8 Not valid · 22 Not checked · 75 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“In contrast to Principle Component Analysis (PCA), CCA is more effective in extracting discriminative information with the robustness in anti-noise [3], thus obtaining more discriminative video features after the projection.”
§ IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval > A. Feature Embedding with Pseudo Labels
What the sources say
- Could not verifycites [3] sourceExperimental — accuracy not yet measured
Section III describes a kernelized correlation-filter tracker, and the Experimental Settings section says it uses HOG features. Searches for CCA, PCA, and their full names found no passage comparing their discriminative information or noise robustness. The copy therefore does not address the attributed claim. (LLM, conf=0.77)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Unfortunately, it has been acknowledged that the performance of those hashing schemes may degrade significantly if the projected dimensions are imbalanced [4], [6], [13], i.e., their variances vary a lot.”
§ IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval > I. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites [4] source
- Could not verifycites [6] sourceExperimental — accuracy not yet measured
Section 7.1 discusses compressing image features into short binary codes for retrieval, but does not address imbalanced projected dimensions or their effect on hashing performance. Searches for hashing, projected dimensions, and variance found no passage in our copy that makes the attributed claim. (LLM, conf=0.76)
- Could not verifycites [13] sourceExperimental — accuracy not yet measured
The Introduction (p. 1) discusses features that may be incompatible with hash coding, while Section 3.3 (p. 4) discusses redundancy among hash bits. Neither addresses whether unequal variances across projected dimensions significantly degrade hashing performance (searched: projected dimensions, imbalanced, variance). (LLM, conf=0.74)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“More importantly, our optimization approach transforms the hash function learning into a regression problem with binary code B as the regression target, thus avoiding the use of a relaxation strategy to solve the nonconvex equation with binary constraints in most published works [3], [8], [18], [35], [48], [57], [58].”
§ IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval > C. Objective Function and Optimization
What the sources say
- Could not verifycites [3] sourceExperimental — accuracy not yet measured
The cited paper’s Introduction and Weighted Interpolation Updating section describe a visual-tracking method, not hash-function learning. Searches for binary-code regression and relaxation of binary constraints found no passage addressing the point for which this paper is cited. (LLM, conf=0.76)
- Not checked — no full text of the sourcecites [8] source
- Not checked — no full text of the sourcecites [18] source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results show that the combination of CCA and BR outperforms the other methods on the datasets substantially.”
§ IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval > E. Results and Analysis 1) Parameter Analysis:
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Again, it is pretty clear that our BR scheme can always guarantee the flat variance of each dimension, regardless of which video features are used.”
§ IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval > E. Results and Analysis 1) Parameter Analysis:
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
53 more claims
Create a free account to see all 105 claims and every source verdict.
- It may state two separate claims as one. 42
- Probably not a substantial claim. 7
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval > 5) Comparison with State-of-The-Arts:
“the mAP@20 values of UDVH-TSN (29.8%) and UDVH-LSTM (26.1%) at 128 bits”
§ IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval > C. Implementation Details
“YFCC [64] 0.201 0.274 0.293 0.289 0.291”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval > D. Complexity Analysis
“the time complexity is O(k 3 ) in (15) in solving B”
§ IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval > C. Objective Function and Optimization
“B = sign(H × R), s.t. H ∈ R N ×k , R ∈ R k×k . (15”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval > III. UNSUPERVISED DEEP VIDEO HASHING
“Those network parameters will be updated automatically during each iteration of hash function learning”
§ IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval > C. Implementation Details
“the mini-batch back-propagation is only performed in the FC7 and FC8 layers”
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795 · cited 2×
“(16) This minimization problem can be solved by fine-tuning the deep network with Stochastic Gradient Descent (SGD) [61] until it gets converged, where the Euclidean loss is minimized via mini-batch back-propagation and the low bound can be found (See IV-C).”
BackgroundUcf101: A dataset of 101 human actions classes from videos in the wild
Soomro, K., Zamir, A. R., & Shah, M. (2012) · arXiv · doi:10.48550/arxiv.1212.0402 · Cited by 4,575
Approximate nearest neighbors: towards removing the curse of dimensionality
Indyk, P., & Motwani, R. (1998) · Proceedings of the thirtieth annual ACM symposium on Theory of computing - STOC '98 · doi:10.1145/276698.276876 · Cited by 4,188
Temporal Segment Networks: Towards Good Practices for Deep Action Recognition
Wang, L., Xiong, Y., Wang, Z., Qiao, Y., Lin, D., Tang, X., & Van Gool, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_2 · Cited by 3,958
Action Recognition with Improved Trajectories
Wang, H., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.441 · Cited by 3,407
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
Weiss, Y., Torralba, A. B., & Fergus, R. (2008) · neural information processing systems · Cited by 2,767
Aggregating local descriptors into a compact image representation
Jegou, H., Douze, M., Schmid, C., & Perez, P. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540039 · Cited by 2,692
ActivityNet: A large-scale video benchmark for human activity understanding
Heilbron, F. C., Escorcia, V., Ghanem, B., & Niebles, J. C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298698 · Cited by 2,578
Beyond short snippets: Deep networks for video classification
Ng, J. Y.-H., Hausknecht, M., Vijayanarasimhan, S., Vinyals, O., Monga, R., & Toderici, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299101 · Cited by 2,062
Unsupervised Learning of Video Representations using LSTMs
Srivastava, N., Mansimov, E., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1502.04681 · Cited by 1,861
Sequential quadratic programming
Boggs, P. T., & Tolle, J. W. (1995) · Acta Numerica · doi:10.1017/s0962492900002518 · Cited by 1,858
Gong, Y., Lazebnik, S., Gordo, A., & Perronnin, F. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.193 · Cited by 1,834
A Duality Based Approach for Realtime TV-L 1 Optical Flow
Zach, C., Pock, T., & Bischof, H. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74936-3_22 · Cited by 1,658 · cited 1×
“Particularly in this case, we utilize the original RGB frames and extract their optical flow8 [66] images from videos in above benchmark datasets by OpenCV as the”
MethodYFCC100M: the new data in multimedia research
Thomee, B., Shamma, D. A., Friedland, G., Elizalde, B., Ni, K., Poland, D., Borth, D., & Li, L.-J. (2016) · Communications of the ACM · doi:10.1145/2812802 · Cited by 1,541
Aggregating Local Image Descriptors into Compact Codes
Jegou, H., Perronnin, F., Douze, M., Sanchez, J., Perez, P., & Schmid, C. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.235 · Cited by 1,503
Supervised hashing with kernels
Liu, W., Wang, J., Ji, R., Jiang, Y.-G., & Chang, S.-F. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247912 · Cited by 1,351
Supervised Hashing for Image Retrieval via Image Representation Learning
Xia, R., Pan, Y., Lai, H., Liu, C., & Yan, S. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8952 · Cited by 952
Temporal Segment Networks for Action Recognition in Videos
Wang, L., Xiong, Y., Wang, Z., Qiao, Y., Lin, D., Tang, X., & Van Gool, L. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2868668 · Cited by 918
Simultaneous feature learning and hash coding with deep neural networks
Lai, H., Pan, Y., Liu, Y., & Yan, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298947 · Cited by 884
A feasible method for optimization with orthogonality constraints
Wen, Z., & Yin, W. (2013) · Mathematical Programming · doi:10.1007/s10107-012-0584-1 · Cited by 849
Visualizing and Understanding Recurrent Networks
Karpathy, A., Johnson, J., & Fei-Fei, L. (2015) · arXiv · doi:10.48550/arxiv.1506.02078 · Cited by 845 · cited 1×
“, optical flow and RGB) [20], [24], [25].”
Video Summarization with Long Short-Term Memory
Zhang, K., Chao, W.-L., Sha, F., & Grauman, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_47 · Cited by 739
Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection: A Survey
Han, J., Zhang, D., Cheng, G., Liu, N., & Xu, D. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2749125 · Cited by 621
Self-citationLDAHash: Improved Matching with Smaller Descriptors
Strecha, C., Bronstein, A. M., Bronstein, M. M., & Fua, P. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.103 · Cited by 605
Semi-supervised hashing for scalable image retrieval
Wang, J., Kumar, S., & Chang, S.-F. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539994 · Cited by 601
Deep hashing for compact binary codes learning
Liong, V. E., Lu, J., Wang, G., Moulin, P., & Zhou, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298862 · Cited by 545 · cited 5×
“Several existing hashing methods are adopted as baselines in the experiment, which are Anchor Graph Hashing (AGH) [6], Submodular video hashing (SubMod) [43], Iterative Quantization (ITQ) [3] Spectral Hashing (SP) [7], Multiple Feature Hashing (MFH) [42], Deep Hashing (DH) [35], Self-Supervised Temporal Hashing (SSTH)…”
BackgroundMethodResultInfluentialLearning to Hash for Indexing Big Data—A Survey
Wang, J., Liu, W., Kumar, S., & Chang, S.-F. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2487976 · Cited by 519
Zhang, Q., Liu, Y., Blum, R. S., Han, J., & Tao, D. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.05.006 · Cited by 499
Self-citationZhang, R., Lin, L., Zhang, R., Zuo, W., & Zhang, L. (2015) · IEEE Transactions on Image Processing · doi:10.48550/arxiv.1508.04535 · Cited by 497
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2011) · Chapman & Hall/CRC Computer Science & Data Analysis · doi:10.1201/b11429-4 · Cited by 460
Zhang, R., Lin, L., Zhang, R., Zuo, W., & Zhang, L. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2467315 · Cited by 448
K-Means Hashing: An Affinity-Preserving Quantization Method for Learning Binary Compact Codes
He, K., Wen, F., & Sun, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.378 · Cited by 395
Differentially Private High-Dimensional Approximate Range Counting, Revisited
Wang, J., Shen, H. T., Song, J., & Ji, J. (2014) · arXiv (Cornell University) · doi:10.4230/lipics.cpm.2023.20 · Cited by 370
Self-taught hashing for fast similarity search
Zhang, D., Wang, J., Cai, D., & Lu, J. (2010) · Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1835449.1835455 · Cited by 347
Multiple feature hashing for real-time large scale near-duplicate video retrieval
Song, J., Yang, Y., Huang, Z., Shen, H. T., & Hong, R. (2011) · Proceedings of the 19th ACM international conference on Multimedia · doi:10.1145/2072298.2072354 · Cited by 334 · cited 3×
“Multiple Feature Hashing (MFH) [42] and Submodular Video Hashing (Submod) [43] are the most representative ones in those algorithms.”
MethodKong, W., & Li, W.-J. (2012) · neural information processing systems · Cited by 306
Sequential Quadratic Programming
(2006) · Springer Series in Operations Research and Financial Engineering · doi:10.1007/978-0-387-40065-5_18 · Cited by 297
Self-Supervised Video Hashing With Hierarchical Binary Auto-Encoder
Song, J., Zhang, H., Li, X., Gao, L., Wang, M., & Hong, R. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2814344 · Cited by 276
Fast Supervised Discrete Hashing
Gui, J., Liu, T., Sun, Z., Tao, D., & Tan, T. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2678475 · Cited by 272
Supervised hashing with latent factor models
Zhang, P., Zhang, W., Li, W.-J., & Guo, M. (2014) · Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval · doi:10.1145/2600428.2609600 · Cited by 271
Two-Stream 3-D convNet Fusion for Action Recognition in Videos With Arbitrary Size and Length
Wang, X., Gao, L., Wang, P., Sun, X., & Liu, X. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2749159 · Cited by 263 · cited 1×
“The contents within those frames are less correlated, especially for the cases of long videos, implying the features in terms of distributions are quite different [22], [23].”
BackgroundSupervised Hash Coding With Deep Neural Network for Environment Perception of Intelligent Vehicles
Yan, C., Xie, H., Yang, D., Yin, J., Zhang, Y., & Dai, Q. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2749965 · Cited by 248
Large-Scale Cross-Modality Search via Collective Matrix Factorization Hashing
Ding, G., Guo, Y., Zhou, J., & Gao, Y. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2607421 · Cited by 218 · cited 1×
“At the projection stage, certain linear projection functions, which are usually learned from the original data to preserve important properties, such as global Euclidean structure or manifold structure, are built and such functions, in turn, are exploited to project the data from the original feature space to a low-di…”
BackgroundSelf-citationCross-View Retrieval via Probability-Based Semantics-Preserving Hashing
Lin, Z., Ding, G., Han, J., & Wang, J. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2608906 · Cited by 188
Self-citationYan, C., Xie, H., Liu, S., Yin, J., Zhang, Y., & Dai, Q. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2749977 · Cited by 176 · cited 1×
“[20], [27], regardless of the imbalanced features.”
Robust Object Co-Segmentation Using Background Prior
Han, J., Quan, R., Zhang, D., & Nie, F. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2781424 · Cited by 169
Self-citationAn Image-Based Approach to Video Copy Detection With Spatio-Temporal Post-Filtering
Douze, M., Jegou, H., & Schmid, C. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2046265 · Cited by 165
Fast saliency-aware multi-modality image fusion
Han, J., Pauwels, E., & de Zeeuw, P. M. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.12.015 · Cited by 148
Self-citationTwo-Stream Collaborative Learning With Spatial-Temporal Attention for Video Classification
Peng, Y., Zhao, Y., & Zhang, J. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2808685 · Cited by 143
Deep Hashing for Scalable Image Search
Lu, J., Liong, V. E., & Zhou, J. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2678163 · Cited by 134
Deep Local Video Feature for Action Recognition
Lan, Z., Zhu, Y., Hauptmann, A. G., & Newsam, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.161 · Cited by 114
Liong, V. E., Lu, J., Tan, Y.-P., & Zhou, J. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2645404 · Cited by 113
State-of-the-Art in Content-Based Image and Video Retrieval
(2001) · Computational imaging and vision · doi:10.1007/978-94-015-9664-0 · Cited by 113
Learning to Hash With Optimized Anchor Embedding for Scalable Retrieval
Guo, Y., Ding, G., Liu, L., Han, J., & Shao, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2652730 · Cited by 108 · cited 1×
“Consequently, most existing methods adopt a twostage framework, consisting of projection stage and quantization stage [10].”
MethodSelf-citationStochastic Multiview Hashing for Large-Scale Near-Duplicate Video Retrieval
Hao, Y., Mu, T., Hong, R., Wang, M., An, N., & Goulermas, J. Y. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2610324 · Cited by 105
Han, J., Pauwels, E. J., de Zeeuw, P. M., & de With, P. H. N. (2012) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2012.6227420 · Cited by 104
Play and Rewind: Optimizing Binary Representations of Videos by Self-Supervised Temporal Hashing
Zhang, H., Wang, M., Hong, R., & Chua, T. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2964308 · Cited by 104
Unsupervised Deep Hashing With Pseudo Labels for Scalable Image Retrieval
Zhang, H., Liu, L., Long, Y., & Shao, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2781422 · Cited by 97
Self-citationDouble-Bit Quantization for Hashing
Kong, W., & Li, W.-J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v26i1.8208 · Cited by 87
Large-Scale Video Hashing via Structure Learning
Ye, G., Liu, D., Wang, J., & Chang, S.-F. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.282 · Cited by 81
YFCC100M: The New Data in Multimedia Research
Thomee, B., Shamma, D. A., Friedland, G., Elizalde, B., Ni, K., Poland, D., Borth, D., & Li, L.-J. (2015) · arXiv · doi:10.48550/arxiv.1503.01817 · Cited by 69
Robust Quantization for General Similarity Search
Guo, Y., Ding, G., & Han, J. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2766445 · Cited by 65
Self-citationSubmodular video hashing: a unified framework towards video pooling and indexing
Cao, L., Li, Z., Mu, Y., & Chang, S.-F. (2012) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2393347.2393393 · Cited by 58
Unsupervised t-Distributed Video Hashing and Its Deep Hashing Extension
Hao, Y., Mu, T., Goulermas, J. Y., Jiang, J., Hong, R., & Wang, M. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2737329 · Cited by 57
Real-Time Scalable Visual Tracking via Quadrangle Kernelized Correlation Filters
Ding, G., Chen, W., Zhao, S., Han, J., & Liu, Q. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2774778 · Cited by 54 · cited 1×
“[70], object tracking [71], [72], and feature fusion [73], [74].”
BackgroundSelf-citationNonlinear Structural Hashing for Scalable Video Search
Chen, Z., Lu, J., Feng, J., & Zhou, J. (2017) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2669095 · Cited by 53
Temporal Segment Networks for Action Recognition in Videos
Wang, L., Xiong, Y., Wang, Z., et al. (2017) · Lirias · doi:10.48550/arxiv.1705.02953 · Cited by 51
Robust Video Hashing via Multilinear Subspace Projections
Li, M., & Monga, V. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2206036 · Cited by 48
Chen, Z., Lu, J., Feng, J., & Zhou, J. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2620604 · Cited by 43
Self-Taught Hashing for Fast Similarity SearchPreprint
Zhang, D., Wang, J., Cai, D., & Lu, J. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1004.5370 · Cited by 39
Unsupervised Deep Video Hashing with Balanced Rotation
Wu, G., Liu, L., Guo, Y., Ding, G., Han, J., Shen, J., & Shao, L. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/429 · Cited by 32
Self-citationDual-Resolution Dual-Path Convolutional Neural Networks for Fast Object Detection
Pan, J. S., Sun, H., Song, Z., & Han, J. (2019) · Sensors · doi:10.3390/s19143111 · Cited by 8
Self-citationHashing for Similarity Search: A Survey
Wang, J., Shen, H. T., Song, J., & Ji, J. (2014) · arXiv · doi:10.48550/arxiv.1408.2927
Research works printed but not linked: 3
- over, 2014, enot, “TRECVID 2014—An overview of the goals, tasks, data, evaluation mechanisms and metrics, Proc TRECVID, 52
- xu, 2013, Harmonious hashing, Proc IJCAI, 1820
- liu, 2011, Hashing with graphs, Proc ICML, 1
Cited by
RGB-T Salient Object Detection via Fusing Multi-Level CNN Features
Zhang, Q., Huang, N., Yao, L., Zhang, D., Shan, C., & Han, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2959253 · Cited by 247
“classification [72], object tracking [73], [74] and instance-level object retrieval [75], [76].”
BackgroundSelf-citationLearning Modality-Consistency Feature Templates: A Robust RGB-Infrared Tracking System
Lan, X., Ye, M., Shao, R., Zhong, B., Yuen, P. C., & Zhou, H. (2019) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2019.2898618 · Cited by 128
“Efforts have been made in this field, and the decade has witnessed numerous tracking algorithms proposed to handle a variety of research issues [1]–[29].”
BackgroundRethinking Triplet Loss for Domain Adaptation
Deng, W., Zheng, L., Sun, Y., & Jiao, J. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2968484 · Cited by 108
Adaptive Label Correlation Based Asymmetric Discrete Hashing for Cross-modal Retrieval
Li, H., Zhang, C., Jia, X., Gao, Y., & Chen, C. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3102119 · Cited by 99
“More recently, the great success of deep learning has inspired the study of deep hashing methods [21], [22], [23], [24], [25], [26], [27].”
BackgroundDeep Salient Object Detection With Contextual Information Guidance
Liu, Y., Han, J., Zhang, Q., & Shan, C. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2930906 · Cited by 96
“Besides, we will apply our salient object detector to facilitate the representation ability of existing deep networks [73], [74] and real-world applications, including image retrieval [75], [76] and image classification [77].”
MethodSelf-citation
Metadata
- Authors
- Wu, G., Han, J., Guo, Y., Liu, L., Ding, G., Ni, Q., & Shao, L.
- Affiliations
- Lancaster University (GB)
- Tsinghua University (CN)
- Inception Institute of Artificial Intelligence (AE)
- Venue
- IEEE Transactions on Image Processing
- Published
- 2019-04
- Volume
- 28
- Issue
- 4
- Pages
- 1993-2007
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2900790473
- Cited by
- 148
- References
- 96
- Citations by year
- 2026: 2 · 2025: 9 · 2024: 9 · 2023: 21 · 2022: 24 · 2021: 22 · 2020: 29 · 2019: 32
- FWCI
- 10.38
- Type
- journal article
- Language
- en
- Open access
- green
- eprints.lancs.ac.uk
- Licence
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- Lancaster EPrints (Lancaster University) (acceptedVersion)
- Warwick Research Archive Portal (University of Warwick) (submittedVersion)
- Funders
- Royal Society (IE150997)
- Shenzhen Government (GJHZ20180419190732022)
- National Natural Science Foundation of China (61773301, 61571269)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
- Keywords
- video hashing, binary codes, feature clustering, binarization, quantization, alternating optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.