A Video Forensic Framework for the Unsupervised Analysis of MP4-Like File Container
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Video forensics keeps developing new technologies to verify the authenticity and the integrity of digital videos. While most of the existing methods rely on the analysis of the video data stream, recently, a new line of research was introduced to investigate video life cycle based on the analysis of the video container. Anyway, existing contributions in this field are based on manual comparison of video container structure and content, which is time demanding and error-prone. In this paper, we introduce a method for unsupervised analysis of video file containers, and present two main forensic applications of such method: the first one deals with video integrity verification, based on the dissimilarity between a reference and a query file container; the second one focuses on the identification and classification of the source device brand, based on the analysis of containers structure and content. Noticeably, the latter application relies on the likelihood-ratio framework, which is more and more approved by the forensic community as the appropriate way to exhibit findings in court. We tested and proved the effectiveness of both applications on a dataset composed by 578 videos taken with modern smartphones from major brands and models. The proposed approaches are proved to be valuable also for requiring an extremely small computational cost as opposed to all available techniques based on the video stream analysis or manual inspection of file containers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Zhang et al. [78] used the bag of words method to extract a set of compact features and fed it into various classifiers such as SVM [79], random forest (RF) [80] and multi-layer perceptrons (MLP) [81] for discriminat- ing swapped face images from the genuine.”
From Deep learning for deepfakes creation and detection: A survey (2022) · cites this paper as [79]
Citations
Cites
MODELTEST: testing the model of DNA substitution.
Posada, D., & Crandall, K. A. (1998) · Bioinformatics · doi:10.1093/bioinformatics/14.9.817 · Cited by 19,820 · cited 1×
“Noticeably, this application is defined in the likelihood-ratio (LR) framework, which is more and more approved from the forensic community as an effective way to report findings: LR is already used in fields such as DNA matching [19], [20], Speaker Verification [21], Speaker Recognition [22], as well as in new promis…”
MethodEvolutionary trees from DNA sequences: A maximum likelihood approach.
Felsenstein, J. (1981) · Journal of Molecular Evolution · doi:10.1007/bf01734359 · Cited by 14,571 · cited 1×
“Noticeably, this application is defined in the likelihood-ratio (LR) framework, which is more and more approved from the forensic community as an effective way to report findings: LR is already used in fields such as DNA matching [19], [20], Speaker Verification [21], Speaker Recognition [22], as well as in new promis…”
MethodSpeaker Verification Using Adapted Gaussian Mixture Models
Reynolds, D. A., Quatieri, T. F., & Dunn, R. B. (2000) · Digital Signal Processing · doi:10.1006/dspr.1999.0361 · Cited by 4,268
An Overview on Image Forensics
Piva, A. (2013) · ISRN Signal Processing · doi:10.1155/2013/496701 · Cited by 426
Self-citationVISION: a video and image dataset for source identification
Shullani, D., Fontani, M., Iuliani, M., Shaya, O. A., & Piva, A. (2017) · EURASIP Journal on Information Security · doi:10.1186/s13635-017-0067-2 · Cited by 280
Self-citationAnti-forensics of digital image compression
Stamm, M. C., & Liu, K. J. R. (2011) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2011.2119314 · Cited by 218
Digital Image Authentication From JPEG Headers
Kee, E., Johnson, M. K., & Farid, H. (2011) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2011.2128309 · Cited by 194
ENFSI guideline for evaluative reporting in forensic science
Aitken, C., Barrett, A. A., Berger, C. E. H., Biedermann, A., Champod, C., Hicks, T., Lucena-Molina, J. J., Lunt, L., McDermott, S., McKenna, L., et al. (2015) · Leiden Repository (Leiden University) · Cited by 179
Digital image integrity – a survey of protection and verification techniques
Korus, P. (2017) · Digital Signal Processing · doi:10.1016/j.dsp.2017.08.009 · Cited by 170
A guideline for the validation of likelihood ratio methods used for forensic evidence evaluation
Meuwly, D., Ramos, D., & Haraksim, R. (2017) · Forensic Science International · doi:10.1016/j.forsciint.2016.03.048 · Cited by 131
Autoencoder with recurrent neural networks for video forgery detection
D'Avino, D., Cozzolino, D., Poggi, G., & Verdoliva, L. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.7.mwsf-330 · Cited by 109
Detection of video double encoding with GOP size estimation
Vázquez-Padín, D., Fontani, M., Bianchi, T., Comesaña, P., Piva, A., & Barni, M. (2012) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs.2012.6412641 · Cited by 105
Self-citationA Fast Forgery Detection Algorithm Based on Exponential-Fourier Moments for Video Region Duplication
Su, L., Li, C., Lai, Y., & Yang, J. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2760098 · Cited by 100
A video forensic technique for detecting frame deletion and insertion
Gironi, A., Fontani, M., Bianchi, T., Piva, A., & Barni, M. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6854801 · Cited by 98
Self-citationDetection of frame deletion for digital video forensics
Shanableh, T. (2013) · Digital Investigation · doi:10.1016/j.diin.2013.10.004 · Cited by 86
Forensic analysis of video file formats
Gloe, T., Fischer, A., & Kirchner, M. (2014) · Digital Investigation · doi:10.1016/j.diin.2014.03.009 · Cited by 67
Identification of Motion-Compensated Frame Rate Up-Conversion Based on Residual Signals
Ding, X., Yang, G., Li, R., Zhang, L., Li, Y., & Sun, X. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2676162 · Cited by 51
Digital Image Ballistics from JPEG Quantization: A Followup Study
Farid, H. (2008) · Cited by 45
Forensic analysis of ordered data structures on the example of JPEG files
Gloe, T. (2012) · 2012 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2012.6412639 · Cited by 42
Detecting video frame rate up-conversion based on frame-level analysis of average texture variation
Xia, M., Yang, G., Li, L., Li, R., & Sun, X. (2016) · Multimedia Tools and Applications · doi:10.1007/s11042-016-3468-1 · Cited by 36
Forensic Automatic Speaker Recognition [Exploratory DSP]
Drygajlo, A. (2007) · IEEE Signal Processing Magazine · doi:10.1109/msp.2007.323278 · Cited by 35
A Universal Attack Against Histogram-Based Image Forensics
Barni, M., Fontani, M., & Tondi, B. (2013) · International Journal of Digital Crime and Forensics · doi:10.4018/jdcf.2013070103 · Cited by 22
Self-citationNordgaard, A., & Höglund, T. (2011) · Journal of Forensic Sciences · doi:10.1111/j.1556-4029.2010.01665.x · Cited by 20
Image counter-forensics based on feature injection
Iuliani, M., Rossetto, S., Bianchi, T., Rosa, A. D., Piva, A., & Barni, M. (2014) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2042234 · Cited by 6
Self-citation
Research works printed but not linked: 12
- 2018, Clip Grab
- 2017, SWGDE Best Practices for Maintaining the Integrity of Imagery Version 1 0
- 2018, Java MP4 Parser
- 2008, Information Technology - Coding of Audio-Visual Objects - Part 12 ISO Base Media File Format
- 1992, Information Technology Digital Compression and Coding of Continuous-Tone Still Images
- 2002, Exchangeable Image File Format for Digital Still Cameras EXIF Version 2 2
- 2003, Information Technology Coding of Audio-Visual Objects Part 14 MP4 File Format
- 2001, Quicktime File Format
- 2017, Best Practices for Image Content Authentication Version 1 0
- beck, 2015, Reversal of Facebook Photo Posts Now Drive Lowest Organic Reach
- 2016, Forecast and Methodology 2015–2020, 1
- 2013, The Development of a Statistical Software Package for Likelihood Ratio Calculations
Cited by
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
“useless, otherwise they would provide precious information towards authenticity verification both for images and videos [15], [16], [17].”
BackgroundDeep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2019) · arXiv · doi:10.48550/arxiv.1909.11573 · Cited by 464
“Machine learning and AI algorithms can be used to support the determination of the authenticity of digital media and have obtained accurate and reliable results, e.g. [104–106], but most of these algorithms are unexplainable.”
Deep learning for deepfakes creation and detection: A survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103525 · Cited by 464
Deep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, M. C., Nguyen, D. T., Nguyen, D. T., & Nahavandi, S. (2020) · Figshare · doi:10.6084/m9.figshare.12731039.v1 · Cited by 121
Deep Learning for Deepfakes Creation and Detection.Preprint
Nguyen, T. T., Nguyen, C. M., Nguyen, D. T., Nguyen, T. T., & Nahavandi, S. (2019) · arXiv (Cornell University) · Cited by 125
Metadata
- Authors
- Iuliani, M., Shullani, D., Fontani, M., Meucci, S., & Piva, A.
- Affiliations
- University of Florence (IT)
- Venue
- IEEE Transactions on Information Forensics and Security
- Published
- 2019-03
- Volume
- 14
- Issue
- 3
- Pages
- 635-645
- ISSN
- 1556-6013 (ISSN-L)
- 1556-6021
- OpenAlex
- W2887134435
- Cited by
- 54
- References
- 24
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 7 · 2023: 6 · 2022: 6 · 2021: 11 · 2020: 9 · 2019: 4
- FWCI
- 3.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Information Forensics and Security (publishedVersion)
- Florence Research (University of Florence) (submittedVersion)
- Funders
- Air Force Research Laboratory
- Defense Advanced Research Projects Agency (FA8750-16-2-0188)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Information Systems › Digital and Cyber Forensics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Steganography and Watermarking Techniques
- Keywords
- video forensics, MP4, video integrity verification, unsupervised analysis, likelihood ratios, smartphone video
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.