Perceptual Video Hashing for Content Identification and Authentication
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Perceptual hashing has been broadly used in the literature to identify similar contents for video copy detection. It has also been adopted to detect malicious manipulations for video authentication. However, targeting both applications with a single system using the same hash would be highly desirable as this saves the storage space and reduces the computational complexity. This paper proposes a perceptual video hashing system for content identification and authentication. The objective is to design a hash extraction technique that can withstand signal processing operations on one hand and detect malicious attacks on the other hand. The proposed system relies on a new signal calibration technique for extracting the hash using the discrete cosine transform (DCT) and the discrete sine transform (DST). This consists of determining the number of samples, called the normalizing shift, that is required for shifting a digital signal so that the shifted version matches a certain pattern according to DCT/DST coefficients. The rationale for the calibration idea is that the normalizing shift resists signal processing operations while it exhibits sensitivity to local tampering (i.e., replacing a small portion of the signal with a different one). While the same hash serves both applications, two different similarity measures have been proposed for video identification and authentication, respectively. Through intensive experiments with various types of video distortions and manipulations, the proposed system has been shown to outperform related state-of-the art video hashing techniques in terms of identification and authentication with the advantageous ability to locate tampered regions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
High confidence visual recognition of persons by a test of statistical independence
Daugman, J. G. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.244676 · Cited by 3,252
Mathematical Statistics A Decision Theoretic Approach
Rogers, G. S. (1968) · Technometrics · doi:10.1080/00401706.1968.10490555 · Cited by 1,488
Geometric hashing: an overview
Wolfson, H. J., & Rigoutsos, I. (1997) · IEEE Computational Science and Engineering · doi:10.1109/99.641604 · Cited by 557
A robust content based digital signature for image authentication
Schneider, M., & Chang, S.-F. (2002) · Proceedings of 3rd IEEE International Conference on Image Processing · doi:10.1109/icip.1996.560425 · Cited by 421
Perceptual Image Hashing Via Feature Points: Performance Evaluation and Tradeoffs
Monga, V., & Evans, B. L. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881948 · Cited by 363 · cited 1×
“We acknowledge a related work on still images using feature points [33] where the system has been shown to deliver better authentication results when compared to transform-based hashing techniques (DWT and DCT).”
MethodSpatio–Temporal Transform Based Video Hashing
Coskun, B., Sankur, B., & Memon, N. (2006) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2006.884614 · Cited by 206
Robust video fingerprinting for content-based video identification
Lee, S., & Yoo, C. D. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.920739 · Cited by 183
Feature Extraction and a Database Strategy for Video Fingerprinting
Oostveen, J., Kalker, T., & Haitsma, J. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45925-1_11 · Cited by 179
Robust video hashing based on radial projections of key frames
De Roover, C., De Vleeschouwer, C., Lefebvre, F., & Macq, B. (2005) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2005.855414 · Cited by 177
Robust image authentication method surviving JPEG lossy compression
Lin, C., & Chang, S. (1997) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.298462 · Cited by 168
An Image-Based Approach to Video Copy Detection With Spatio-Temporal Post-Filtering
Douze, M., Jegou, H., & Schmid, C. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2046265 · Cited by 165
A Robust and Fast Video Copy Detection System Using Content-Based Fingerprinting
Esmaeili, M. M., Fatourechi, M., & Ward, R. K. (2011) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2010.2097593 · Cited by 155
Mathematical Statistics: A Decision Theoretic Approach.
Stone, M., & Ferguson, T. S. (1968) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2343847 · Cited by 118
Perceptual image hashing based on virtual watermark detection
Khelifi, F., & Jiang, J. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2038637 · Cited by 107
Self-citationVisual hashing of digital video: applications and techniques
Oostveen, J. C., Kalker, T., & Haitsma, J. (2001) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.449746 · Cited by 83
Video fingerprinting for copy identification: from research to industry applications
Lu, J. Y. (2009) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.805709 · Cited by 71
Spectral Embedded Hashing for Scalable Image Retrieval
Chen, L., Xu, D., Tsang, I. W.-H., & Li, X. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2281366 · Cited by 68
Medical image registration using geometric hashing
Gueziec, A. P., Pennec, X., & Ayache, N. (1997) · IEEE Computational Science and Engineering · doi:10.1109/99.641607 · Cited by 68
On the shift property of DCT's and DST's
Yip, P. C. Y., & Rao, K. R. (1987) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1987.1165127 · Cited by 63
Audio Fingerprinting: Nearest Neighbor Search in High Dimensional Binary Spaces
Miller, M. L., Rodriguez, M. A., & Cox, I. J. (2005) · The Journal of VLSI Signal Processing Systems for Signal Image and Video Technology · doi:10.1007/s11265-005-4152-2 · Cited by 60
A Framework for Handling Spatiotemporal Variations in Video Copy Detection
Chiu, C., Chen, C., & Chien, L. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.918447 · Cited by 56
Comprehensive Feature-Based Robust Video Fingerprinting Using Tensor Model
Nie, X., Yin, Y., Sun, J., Liu, J., & Cui, C. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2629758 · Cited by 56
Robust Video Hashing via Multilinear Subspace Projections
Li, M., & Monga, V. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2206036 · Cited by 48
A robust hashing algorithm based on SURF for video copy detection
Yang, G., Chen, N., & Jiang, Q. (2012) · Computers & Security · doi:10.1016/j.cose.2011.11.004 · Cited by 48
Robust Video Fingerprinting Based on Symmetric Pairwise Boosting
Lee, S., Yoo, C. D., & Kalker, T. (2009) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2009.2022801 · Cited by 36
Sarkar, A., Ghosh, P., Moxley, E., & Manjunath, B. S. (2007) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.766171 · Cited by 32
Audio fingerprinting: nearest neighbor search in high dimensional binary spaces
Miller, M. L., Rodriguez, M. A., & Cox, I. J. (2004) · IEEE Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2002.1203277 · Cited by 28
Fragility Analysis of Adaptive Quantization-Based Image Hashing
Zhu, G., Huang, J., Kwong, S., & Yang, J. (2009) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2009.2038742 · Cited by 27
Online hash tracking with spatio-temporal saliency auxiliary
Fang, J., Xu, H., Wang, Q., & Wu, T. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.03.006 · Cited by 24
Compact Video Fingerprinting via Structural Graphical Models
Li, M., & Monga, V. (2013) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2013.2278100 · Cited by 21
Video copy detection based on Speeded Up Robust Features and Locality Sensitive Hashing
Zhang, Z., Cao, C., Zhang, R., & Zou, J. (2010) · IEEE International Conference on Automation and Logistics (ICAL) · doi:10.1109/ical.2010.5585375 · Cited by 21
Visual hashing of digital video : applications and techniques
Oostveen, J. C., Kalker, A. T., & Haitsma, J. J. (2001) · TU/e Research Portal · Cited by 21
Video Hashing Algorithm With Weighted Matching Based on Visual Saliency
Sun, J., Wang, J., Zhang, J., Nie, X., & Liu, J. (2012) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2192271 · Cited by 20
Authentication of MPEG-4-based surveillance video
Pramateftakis, M., Oelbaum, T., & Diepold, K. J. (2005) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2004.1418683 · Cited by 19
Twofold Video Hashing With Automatic Synchronization
Li, M., & Monga, V. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2425362 · Cited by 19
Su, P.-C., Chen, C., & Chang, H. C. (2009) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2009.2017404 · Cited by 18
Fast and robust video copy detection scheme using full DCT coefficients
Xu, Z., Ling, H., Zou, F., Lu, Z., Li, P., & Wang, T. (2009) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2009.5202527 · Cited by 17
Two dimensional hashing for visual tracking
Ma, C., & Liu, C. (2015) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.01.003 · Cited by 15
Weber Binarized Statistical Image Features (WBSIF) based video copy detection
Boukhari, A., & Serir, A. (2015) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.10.015 · Cited by 15
Video fingerprinting based on orientation of luminance centroid
Lee, S., & Suh, Y. H. (2009) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2009.5202762 · Cited by 9
Authenticating Lossy Surveillance Video
Ren, Y. J., O’Gorman, L., Wu, L. J., Chang, F., Wood, T. L., & Zhang, J. R. (2013) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2013.2279542 · Cited by 8
Video Copy Detection Based On Temporal Contextual Hashing
Wang, R. B., Chen, H., Yao, J. L., & Guo, Y. (2016) · IEEE International Conference on Multimedia Big Data · doi:10.1109/bigmm.2016.12 · Cited by 7
Video authentication using spatio-temporal signature for surveillance system
Kroputaponchai, T., & Suvonvorn, N. (2015) · International Joint Conference on Computer Science and Software Engineering · doi:10.1109/jcsse.2015.7219764 · Cited by 6
Compact and robust video fingerprinting using sparse represented features
Wu, B., Krishnan, S., Zhang, N., & Su, L. (2016) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2016.7552954 · Cited by 4
Research works printed but not linked: 5
- piva, 1998, Threshold selection for correlation-based watermark detection, Proc COST Workshop Intell Commun, 67
- 2015, MATLAB Implementation of Video Fingerprinting via Structural Graphical Models
- 2015, ReefVid A Resource of Free Coral Reef Video Clips for Educational Use
- 2015, Open Video Project
- 2015, Free Stock Video Footage
Cited by
Deep Multiscale Fusion Hashing for Cross-Modal Retrieval
Nie, X., Wang, B., Li, J., Hao, F., Jian, M., & Yin, Y. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2974877 · Cited by 108
Deep Semantic Reconstruction Hashing for Similarity Retrieval
Wang, Y., Ou, X., Liang, J., & Sun, Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2974768 · Cited by 47
ARCHANGEL: Tamper-Proofing Video Archives Using Temporal Content Hashes on the Blockchain
Bui, T., Cooper, D., Collomosse, J. P., Bell, M. R., Green, A., Sheridan, J., Higgins, J., Das, A., Keller, D. J. R., Thereaux, O., et al. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00338 · Cited by 36
Learning to Hash for Personalized Image Authentication
Su, Z., Yao, L., Mei, J., Zhou, L., & Li, W. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3002146 · Cited by 27
Attention-Based Video Hashing for Large-Scale Video Retrieval
Wang, Y., Nie, X., Shi, Y., Zhou, X., & Yin, Y. (2019) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2019.2963339 · Cited by 30
Metadata
- Authors
- Khelifi, F., & Bouridane, A.
- Affiliations
- Northumbria University (GB)
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2019-01
- Volume
- 29
- Issue
- 1
- Pages
- 50-67
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W2769924993
- Cited by
- 56
- References
- 44
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 8 · 2023: 12 · 2022: 5 · 2021: 7 · 2020: 6 · 2019: 5
- FWCI
- 1.36
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Circuits and Systems for Video Technology (publishedVersion)
- Northumbria Research Link (Northumbria University) (acceptedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/T009543/1)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Steganography and Watermarking Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
- Keywords
- video authentication, content identification, video copy detection, signal calibration, discrete cosine transform, discrete sine transform, tamper detection, similarity measures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.