Cited by 1Digital Media Forensic DetectionVideo Analysis and SummarizationAdvanced Image and Video Retrieval Techniques

Perceptual Robust Hashing for Video Copy Detection with Unsupervised Learning

Open access
Zhao, Gejian, Qin, Chuan, Luo, Xiangyang, Zhang, Xinpeng, Chang, Chin-Chen·2023·Proceedings of the 2023 ACM Workshop on Information Hiding and Multimedia Security

Abstract

In this paper, we propose an end-to-end perceptual robust hashing scheme for video copy detection based on unsupervised learning. Firstly, the spatio-temporal information in videos is effectively fused and condensed into high-dimensional features through a 3D self-attention, multi-scale feature fusion model based on 3D-CNN, in which the Inception block and the 3D self-attention mechanism are integrated. Then, we calculate the correlation distances between the extracted features to differentiate perceptual contents. Based on the similarity relationship, we can dynamically generate the pseudo-labels and exploit them to further guide the model training for video hash generation. In addition, we design the dual constraints to make the hash code obtain satisfactory robustness and discrimination. Extensive experiments demonstrate that the proposed scheme achieves superior performance of copy detection compared with existing schemes and performs well even in the case of untrained manipulations.

Integrity signals

Registry

Crossref · 10.1145/3577163.3595110

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

2 of 13 cited sources checked · 0 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    Deep learning techniques can effectively extract the features of videos as long as a proper model and loss function are designed.

    “Numerous studies [14,15] have shown that deep learning techniques can effectively extract the features of videos as long as a proper model and loss function are designed.”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites [14] 14. X. Luo, H. Wang, D. Wu, et al.. "A survey on deep hashing methods." ACM Transactions on Knowledge Discovery from Data (TKDD), 2022, pp. 1556-4681. source

      The Introduction and §3.1 say that deep supervised hashing depends on network architecture and loss-function design, and §5.3 includes video among the modalities addressed by multi-modal deep hashing. The paper does not establish the more specific claim that a suitable model and loss function are sufficient to extract video features effectively; its discussion concerns learning hash codes for retrieval. The indexed passages provide section labels but no page numbers. (LLM, conf=0.81)

      Experimental — accuracy not yet measured
    • cites [15] 15. C. Qin, E. Liu, G. Feng, and X. Zhang. "Perceptual image hashing for content authentication based on convolutional neural network with multiple constraints. " IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 11, pp. 4523-4537, 2021. source
  • Findingown data

    For most manipulations, the F1 scores of the proposed scheme are greater than those of the other compared schemes.

    “We can find that, for most manipulations, the 𝐹 1 scores of our scheme are greater than those of other compared schemes.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [23] 23. R. Anuranji and H. Srimathi. "A supervised deep convolutional based bidirectional long short term memory video hashing for large scale video retrieval applications. " Digital Signal Processing, vol. 102, pp. 102729, 2020. source
    • cites [24] 24. K. Wang, C. Cheng, Y. Chen, Y. Song, and S. Lai. "Attention-based deep metric learning for near-duplicate video retrieval. " In 2020 25th International Conference on Pattern Recognition (ICPR), 2021, pp. 5360-5367. source
    • cites [25] 25. Y. Hu and X. Lu. "Learning spatial-temporal features for video copy detection by the combination of CNN and RNN. " Journal of Visual Communication and Image Representation, vol. 55, pp. 21-29, 2018. source
  • Findingown data

    When eta is set to 2, the performance of the proposed video hashing reaches the best.

    “when 𝜂 is set as 2, the performance of our video hashing reaches the best at this situation.”
    Quote in the paperNot a substantial claim
  • Findingown data

    The hash distance of distinct videos is significantly larger than that of identical videos.

    “Compared with the statistics of robustness results in Table 1, we can see that the hash distance of distinct videos is significantly larger than that of identical videos, thus proving the discrimination performance of our scheme.”
    Quote in the paperSubstantial claim
  • Findingown data

    The proposed scheme performs well even in the case of untrained manipulations.

    “Extensive experiments demonstrate that the proposed scheme achieves superior performance of copy detection compared with existing schemes and performs well even in the case of untrained manipulations.”
    • Also stated in: § 4.3 Performance Comparison · hedged
      “It should be noted that the performance of our scheme does not degrade much in the case of untrained manipulations, which indicates the strong generalization ability.”
    Quote in the paperSubstantial claim
  • May combine two claims. 9
  • Classified as probably not a substantial claim. 3
  • May combine two claims.

    Premisecitation

    Current perceptual hashing schemes often require manual annotation of video samples and their similarity relationships, and these methods may not have enough generalization capability to deal with massive video and emerging video manipulations.

    “But, current perceptual hashing schemes often require manual annotation of video samples and their similarity relationships, and these methods may not have enough generalization capability to deal with massive video and emerging video manipulations [16].”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [16] 16. N. Behrmann, J. Gall, and M. Noroozi. "Unsupervised video representation learn- ing by bidirectional feature prediction." In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2021, pp. 1670-1679. source

      Split into 2 atoms — 0 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 2 unverifiable. Expand the claim to see per-atom verdicts.

      Experimental — accuracy not yet measured
  • May combine two claims.

    Findingnone given

    The proposed scheme has satisfactory robustness and discrimination.

    “Overall, our scheme has satisfactory robustness and discrimination, and can be effectively used for video copy detection.”
    • Also stated in: § Hash Code · plain
      “Our scheme can not only achieve satisfactory robustness and discrimination, but also adapts to more video contentpreserving manipulations without labeling and training.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The hash distances between perceptual distinct videos have a mean of 11.29 and a standard deviation of 5.37.

    “From the statistical results of hash distances between perceptual distinct videos, we can find that the mean value is 11.29 and the standard deviation is 5.37.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The ROC curve of 32-bit hash length is the worst, and the ROC curve of 128 bits is the best, but it is not much different from that of 64 bits.

    “It can be seen from Fig. 6(b), the ROC curve of 32 bits is the worst, and the ROC curve of 128 bits is the best, but it is not much different from that of 64 bits.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The two strategies, the 3D self-attention multi-scale feature fusion model and pseudo-label generation, both lead to a certain performance gain.

    “From Fig. 6(a), it can be found that the two strategies both lead to a certain gain.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    The designed 3D self-attention multi-scale feature fusion model can extract compact perceptual feature and highlight the important parts.

    “we design a 3D selfattention multi-scale feature fusion model, which can extract compact perceptual feature and highlight the important parts.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    The SHMB scheme is supervised and its hash length is 96 bits.

    “Although the effect of SHMB [23] is approximate to ours, it is worth noting that SHMB scheme is supervised, and its hash length is 96 bits.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [23] 23. R. Anuranji and H. Srimathi. "A supervised deep convolutional based bidirectional long short term memory video hashing for large scale video retrieval applications. " Digital Signal Processing, vol. 102, pp. 102729, 2020. source
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    The above schemes divided feature extraction and hash mapping into two parts, and both were designed artificially and empirically, which may not achieve the global optimal result.

    “The above schemes divided feature extraction and hash mapping into two parts, and both were designed artificially and empirically, which may not achieve the global optimal result.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The proposed scheme greatly saves labor cost, and its hash code has low redundancy, saving storage and computation cost.

    “That is to say, our video hashing scheme not only has excellent performance for copy detection, but also greatly saves labor cost, while the hash code has low redundancy, saving storage and computation cost.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    The model training can be better guided and constrained due to the employment of pseudo-labels.

    “In addition, the model training can be better guided and constrained due to the employment of pseudo-labels.”
    Quote in the paperNot a substantial claim
10 of 10
  • The paper relies on this without support.

    The correlation distance between video-level features reflects perceptual similarity, such that a larger absolute correlation coefficient means higher perceptual similarity of the two videos.

    “𝜌 ∈ [-1, 1] is the correlation coefficient, and the larger the absolute value of 𝜌, the higher perceptual similarity of the two videos.”
  • The paper relies on this without support.

    The pseudo-label matrix generated from correlation distances can serve as ground truth for similarity judgment.

    “We exploit the obtained pseudo-label matrix S as the ground truth for similarity judgment.”
  • The paper relies on this without support.

    The training set has a scarcity of perceptual identical videos.

    “Due to the scarcity of perceptual identical videos in the training set, there is an extremely rare possibility that 𝑡 𝑟 ⩽ 𝑡 𝑙 or 𝑡 𝑙 ⩽ 0, in which case this batch does not participate in the training.”
3 of 3

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Stated correlation-distance range excludes negative correlations

    Major

    The paper permits correlations as low as −1, but its definition d = 1 − ρ then permits distances as high as 2. The stated [0, 1] range is therefore inconsistent with the definition.

  • Negative correlations receive the opposite similarity treatment

    Minor

    The paper says a larger absolute correlation means greater similarity. Yet d = 1 − ρ makes strongly negative correlations large distances, which its labeling rule classifies as perceptually distinct.

2 of 2

Cites

Flagged first, then by citations

3 of the 31 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Zhao, G., Qin, C., Luo, X., Zhang, X., & Chang, C.-C.
Affiliations
  • University of Shanghai for Science and Technology (CN)
  • State Key Laboratory of Mathematical Engineering and Advanced Computing, Zhengzhou, China
  • Shanghai University (CN)
  • Feng Chia University (TW)
Venue
Proceedings of the 2023 ACM Workshop on Information Hiding and Multimedia Security
Publisher
ACM
Published
2023-06-28
Pages
13-18
OpenAlex
W4381187965
Cited by
1
References
31
Citations by year
2025: 1
FWCI
0.11
Type
conference paper
Language
en
Open access
Locations
ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec) (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
Keywords
video copy detection, unsupervised hashing, multi-scale feature fusion, 3D convolutional neural networks, pseudo-label generation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review