FIVR: Fine-Grained Incident Video Retrieval
Open accessThe DOI matches its Crossref record; 55 of the 59 references it cites were found in a registry or an index; none of the 10 sources its claims cite is checked for support yet.
Abstract
This paper introduces the problem of Fine-grained Incident Video Retrieval (FIVR). Given a query video, the objective is to retrieve all associated videos, considering several types of associations that range from duplicate videos to videos from the same incident. FIVR offers a single framework that contains several retrieval tasks as special cases. To address the benchmarking needs of all such tasks, we construct and present a large-scale annotated video dataset, which we call FIVR-200K, and it comprises 225,960 videos. To create the dataset, we devise a process for the collection of YouTube videos based on major news events from recent years crawled from Wikipedia and deploy a retrieval pipeline for the automatic selection of query videos based on their estimated suitability as benchmarks. We also devise a protocol for the annotation of the dataset with respect to the four types of video associations defined by FIVR. Finally, we report the results of an experimental study on the dataset comparing five state-of-the-art methods developed based on a variety of visual descriptors, highlighting the challenges of the current problem.
Overview
CoChat Summary
TL;DR
This paper introduces Fine-grained Incident Video Retrieval (FIVR), a unified retrieval problem covering duplicate, complementary-viewpoint, and same-incident video associations. It presents FIVR-200K, a 225,960-video benchmark built from Wikipedia news events, and benchmarks five state-of-the-art retrieval methods across three FIVR tasks.
Key findings
- FIVR-200K contains 225,960 YouTube videos, 4,687 Wikipedia news events, 100 queries, and 7,100 hours of video; selected queries average 13 NDV, 57 DSV, 18 CSV, and 35 ISV annotations.
- The best benchmarked method, LBoW, achieves mAP scores of 0.710 for DSVR, 0.675 for CSVR, and 0.572 for ISVR; GV performs worst at 0.165, 0.153, and 0.118, respectively.
- All methods perform much better on CC WEB VIDEO, with mAP values as high as 0.976, showing FIVR-200K is substantially more challenging, especially for ISVR.
- Deep features outperform handcrafted features; LBoW with VGG features is best for DSVR/CSVR, while ISVR remains the hardest task with most queries below 0.6 mAP.
Methods
- Dataset construction: crawled Wikipedia “Current Events” from Jan 1, 2013 to Dec 31, 2017, retained “Armed conflicts and attacks” or “Disasters and accidents” categories (9,431 collected, 4,687 retained), then used YouTube API with event headlines, filtering to videos published from event start up to one week after and duration up to five minutes.
- Query selection: computed visual and textual similarity via tf-idf BoW representations, built a video graph with threshold 0.7, discarded components with uploader ratio below 0.75, retained components within a two-week publication window, selected videos under 90 seconds, chose earliest-published video per component, and kept the top 100 queries by component size.
- Annotation and evaluation: annotated videos in three phases using labels ND, DS, CS, IS, and DI; benchmarked GV, BoW, LBoW, DML, and HC with handcrafted, CNN, and 3D CNN features; evaluated DSVR, CSVR, and ISVR using interpolated PR curves and mAP.
Limitations
- Stated: global video representations have strong performance limits; suggested improvements such as frame-level matching, end-to-end CNN/3D CNN training, and query expansion are computationally complex and need careful design for large-scale use.
- Stated: the dataset annotation covers four labels, and the authors plan to extend it for related problems such as event reconstruction and synchronization.
- Evident from the text: annotation was split between two annotators with only the lead author revisiting non-distractor labels for consistency; the query set is limited to 100 selected from 635 candidates, and the dataset is restricted to two Wikipedia event categories, YouTube videos up to five minutes, and events from 2013–2017.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 6 Not checked · 98 Own results and interpretations
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“To accurately represent the problem, this dataset is composed of user-generated videos related to a large number of real-world events.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“FIVR-200K | 100 | 225,960 | 7,100 | ✓ | Fine-grained Incident Video Retrieval”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“however, the performance gap with deep features is considerable.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In particular, LBoW achieves a mAP score of 0.710 in the DSVR task”
- Also stated in: § B. Experiments · p. 12 · plain
“the LBoW aggregation scheme in combination with the VGG CNN features achieves the best result (mAP = 0 : 710 )”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § B. Experiments · p. 12 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and 3KB per video to store the video representations.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
54 more claims
Create a free account to see all 104 claims and every source verdict.
- Probably not a substantial claim. 30
- It may state two separate claims as one. 12
- The quote only partly states this claim. 3
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ B. Experiments · p. 13
“The results of all methods have been measured using the open source library Scikit-learn [47] in Python, on a Linux PC with a 4-core i7-4770K and 32GB of RAM.”
§ REFERENCES · p. 15
“[47] S. Van der Walt, J. L. Sch¨ onberger, J. Nunez-Iglesias, F. Boulogne, J. D. Warner, N. Yager, E. Gouillart, and T. Yu, 'scikit-image: image processing in python,' PeerJ , vol. 2, p. e453, 2014.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A. Video Datasets · p. 3
“A more recent dataset that is relevant to our problem is VCDB [20].”
§ REFERENCES · p. 14
“[20] Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, 'Caffe: Convolutional architecture for fast feature embedding,' in Proceedings of the 22nd ACM international conference on Multimedia . ACM, 2014, pp. 675-678.”
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 2×
“• Intermediate CNN Features: We employ three popular architectures for the extraction of intermediate CNN features [27]: VGG-16 (VGG) [40], ResNet-152 (RES) [17] and Inception-V4 (INC) [44].”
MethodVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589 · cited 1×
“Early approaches employed handcrafted features including HSV Colour Histograms [16], [25], [42], [49], Local Binary Patterns (LBP) [25], [37], [42], [50], [51] fuzzy multidimensional histograms of colour and motion video segments [10], Auto Colour Correlograms (ACC) [7], [18], and several keypoint descriptors (such as…”
MethodSURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077 · cited 8×
“More specifically, related datasets include CC WEB VIDEO [49], UQ VIDEO [42], MUSCLEVCD [30], TRECVID-CBCD 2011 [29], VCDB [21] and EVVE [35].”
BackgroundInfluentialQuo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1705.07750 · Cited by 10,485
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593 · cited 2×
“3D CNN Features: We employ two popular architectures for the extraction of 3D CNN features: C3D [46] and I3D [8].”
MethodQuo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570 · cited 6×
“• 3D CNN Features: We employ two popular architectures for the extraction of 3D CNN features: C3D [46] and I3D [8].”
MethodInfluentialscikit-image: image processing in Python
van der Walt, S., Schönberger, J. L., Nunez-Iglesias, J., Boulogne, F., Warner, J. D., Yager, N., Gouillart, E., & Yu, T. (2014) · PeerJ · doi:10.7717/peerj.453 · Cited by 6,794
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752 · cited 8×
“More specifically, related datasets include CC WEB VIDEO [49], UQ VIDEO [42], MUSCLEVCD [30], TRECVID-CBCD 2011 [29], VCDB [21] and EVVE [35].”
BackgroundInfluentialNLTK: the Natural Language Toolkit
Loper, E., & Bird, S. (2002) · Proceedings of the ACL-02 Workshop on Effective tools and methodologies for teaching natural language processing and computational linguistics - · doi:10.3115/1118108.1118117 · Cited by 3,218
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
Zhao, G., & Pietikainen, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1110 · Cited by 2,846
Aggregating local descriptors into a compact image representation
Jegou, H., Douze, M., Schmid, C., & Perez, P. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540039 · Cited by 2,692 · cited 5×
“Among the handcrafted features, VLADSURF provides the best results (mAP= 0.323); however, the performance gap with deep features is considerable.”
MethodInfluentialNLTK: The Natural Language Toolkit
Loper, E., & Bird, S. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0205028 · Cited by 1,844
Image indexing using color correlograms
Huang, J., Kumar, S. R., Mitra, M., Zhu, W.-J., & Zabih, R. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609412 · Cited by 1,646 · cited 6×
“• Hand-crafted Features: We experiment with four widely used hand-crafted features in the literature: HSV histograms, LBP [51], ACC [18] and VLAD-SURF [19].”
MethodInfluentialParticular object retrieval with integral max-pooling of CNN activations
Tolias, G., Sicre, R., & Jégou, H. (2015) · arXiv · doi:10.48550/arxiv.1511.05879 · Cited by 744 · cited 2×
“Convolutions (RMAC) [45] based on the output of a Region Of Interest (ROI) pooling layer applied on the final convolutional layer [2], [14].”
Towards optimal bag-of-features for object categorization and semantic video retrieval
Jiang, Y.-G., Ngo, C.-W., & Yang, J. (2007) · Proceedings of the 6th ACM international conference on Image and video retrieval · doi:10.1145/1282280.1282352 · Cited by 637 · cited 3×
“Early approaches employed handcrafted features including HSV Colour Histograms [16], [25], [42], [49], Local Binary Patterns (LBP) [51] [25], [37], [42], [50], fuzzy multidimensional histograms of colour and motion video segments [10], Auto Colour Correlograms (ACC) [7], [18], and several keypoint descriptors (such as…”
MethodVideo-Based Abnormal Human Behavior Recognition—A Review
Popoola, O. P., & Wang, K. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2178594 · Cited by 505 · cited 1×
“Other application scenarios and use cases that may benefit from solutions to the FIVR problem include safety and security applications [31], [34], [36].”
BackgroundNovel Visual and Statistical Image Features for Microblogs News Verification
Jin, Z., Cao, J., Zhang, Y., Zhou, J., & Tian, Q. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2617078 · Cited by 476 · cited 1×
“2905741 tion [11], [29] to event reconstruction[6], [13], [33] and news verification[24], [39].”
NLTK: the natural language toolkit
Bird, S., & Loper, E. (2004) · Proceedings of the ACL 2004 on Interactive poster and demonstration sessions - · doi:10.3115/1219044.1219075 · Cited by 403
Practical elimination of near-duplicates from web video search
Wu, X., Hauptmann, A. G., & Ngo, C.-W. (2007) · Proceedings of the 15th ACM international conference on Multimedia · doi:10.1145/1291233.1291280 · Cited by 340 · cited 9×
“CC WEB VIDEO [49] 24 12,790 551 X Near-Duplicate Video Retrieval UQ VIDEO [42] 24 169,952 N/A X Near-Duplicate Video Retrieval MUSCLE-VCD [30] 18 101 100 7 Video Copy Detection TRECVID 2011 [29] 11,256 11,503 420 7 Video Copy Detection VCDB [20] 528 100,528 2,038 X Partial Video Copy Detection EVVE [35] 620 102,375 5,…”
BackgroundMethodInfluentialMultiple feature hashing for real-time large scale near-duplicate video retrieval
Song, J., Yang, Y., Huang, Z., Shen, H. T., & Hong, R. (2011) · Proceedings of the 19th ACM international conference on Multimedia · doi:10.1145/2072298.2072354 · Cited by 334 · cited 5×
“The most well-known and publicly available dataset that has been created through this process is UQ_VIDEO [42].”
InfluentialNatural Language Processing with Python [analyzing text with the natural language toolkit]
Bird, S., Klein, E. 1., & Loper, E. (2009) · Cited by 304
Lire: lucene image retrieval: an extensible java CBIR library
Lux, M., & Chatzichristofis, S. A. (2008) · Proceedings of the 16th ACM international conference on Multimedia · doi:10.1145/1459359.1459577 · Cited by 281 · cited 1×
“OpenCV [15], LIRE [26], Scikit-image [37] and Tensorflow [2] in Python and Java.”
MethodAutomated high-level movie segmentation for advanced video-retrieval systems
Hanjalic, A., Lagendijk, R. L., & Biemond, J. (1999) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.767124 · Cited by 272 · cited 1×
“Also, as defined in the field of temporal video segmentation [11], a video can be decomposed in a sequence of scenes or temporal”
BackgroundEffective Multiple Feature Hashing for Large-Scale Near-Duplicate Video Retrieval
Song, J., Yang, Y., Huang, Z., Shen, H. T., & Luo, J. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2271746 · Cited by 257 · cited 2×
“Some representative approaches include [16], [25], [41]–[43], [48].”
BackgroundMethodQuantization-based hashing: a general framework for scalable image and video retrieval
Song, J., Gao, L., Liu, L., Zhu, X., & Sebe, N. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.03.021 · Cited by 182
An Image-Based Approach to Video Copy Detection With Spatio-Temporal Post-Filtering
Douze, M., Jegou, H., & Schmid, C. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2046265 · Cited by 165 · cited 1×
“2905741 tion [11], [29] to event reconstruction[6], [13], [33] and news verification[24], [39].”
Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval
Wu, G., Han, J., Guo, Y., Liu, L., Ding, G., Ni, Q., & Shao, L. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2882155 · Cited by 148 · cited 2×
“Some representative approaches include [16], [25], [41]–[43], [48].”
BackgroundMethodMultimedia Information Retrieval and Management: Technological Fundamentals and Applications
Feng, D. D., Siu, W. C., & Zhang, H. J. (2010) · Cited by 135
Event Retrieval in Large Video Collections with Circulant Temporal Encoding
Revaud, J., Douze, M., Schmid, C., & Jegou, H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.318 · Cited by 133 · cited 7×
“clude CC_WEB_VIDEO [49], UQ_VIDEO [42], MUSCLEVCD [30], TRECVID-CBCD 2011 [29], VCDB [21] and EVVE [35].”
BackgroundMethodInfluentialScale-Rotation Invariant Pattern Entropy for Keypoint-Based Near-Duplicate Detection
Zhao, W., & Ngo, C. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2008900 · Cited by 133 · cited 2×
“Early approaches employed handcrafted features including HSV Colour Histograms [16], [25], [42], [49], Local Binary Patterns (LBP) [51] [25], [37], [42], [50], fuzzy multidimensional histograms of colour and motion video segments [10], Auto Colour Correlograms (ACC) [7], [18], and several keypoint descriptors (such as…”
MethodReal-time large scale near-duplicate web video retrieval
Shang, L., Yang, L., Wang, F., Chan, K.-P., & Hua, X.-S. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874021 · Cited by 124 · cited 3×
“developed by researchers in the NDVR field [7], [9], [37], [42].”
BackgroundMethodA fuzzy video content representation for video summarization and content-based retrieval
Doulamis, A. D., Doulamis, N. D., & Kollias, S. (2000) · Signal Processing · doi:10.1016/s0165-1684(00)00019-0 · Cited by 123 · cited 1×
“Early approaches employed handcrafted features including HSV Colour Histograms [16], [25], [42], [49], Local Binary Patterns (LBP) [25], [37], [42], [50], [51] fuzzy multidimensional histograms of colour and motion video segments [10], Auto Colour Correlograms (ACC) [7], [18], and several keypoint descriptors (such as…”
MethodPattern-Based Near-Duplicate Video Retrieval and Localization on Web-Scale Videos
Chou, C.-L., Chen, H.-T., & Lee, S.-Y. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2391674 · Cited by 106 · cited 4×
“developed by researchers in the NDVR field [7], [9], [37], [42].”
BackgroundMethodInfluentialStochastic Multiview Hashing for Large-Scale Near-Duplicate Video Retrieval
Hao, Y., Mu, T., Hong, R., Wang, M., An, N., & Goulermas, J. Y. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2610324 · Cited by 105 · cited 3×
“Early approaches employed handcrafted features including HSV Colour Histograms [16], [25], [42], [49], Local Binary Patterns (LBP) [51] [25], [37], [42], [50], fuzzy multidimensional histograms of colour and motion video segments [10], Auto Colour Correlograms (ACC) [7], [18], and several keypoint descriptors (such as…”
BackgroundMethodNear-Duplicate Video Retrieval with Deep Metric Learning
Kordopatis-Zilos, G., Papadopoulos, S., Patras, I., & Kompatsiaris, Y. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.49 · Cited by 99 · cited 4×
“the NDVR method described in [28] and modified based on a Bag-of-Word (BoW) scheme.”
BackgroundMethodInfluentialSelf-citationContent based video matching using spatiotemporal volumes
Basharat, A., Zhai, Y., & Shah, M. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.016 · Cited by 94 · cited 1×
“the same event [35] or with the same semantics [3] are labelled as related.”
BackgroundNear-Duplicate Video Retrieval by Aggregating Intermediate CNN Layers
Kordopatis-Zilos, G., Papadopoulos, S., Patras, I., & Kompatsiaris, Y. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-51811-4_21 · Cited by 83 · cited 6×
“For instance, Layer Bagof-Words (LBoW) [27] is a variant of the BoW scheme based”
InfluentialSelf-citationVCDB: A Large-Scale Database for Partial Copy Detection in Videos
Jiang, Y.-G., Jiang, Y., & Wang, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_24 · Cited by 82 · cited 10×
“clude CC_WEB_VIDEO [49], UQ_VIDEO [42], MUSCLEVCD [30], TRECVID-CBCD 2011 [29], VCDB [21] and EVVE [35].”
MethodInfluentialPartial Copy Detection in Videos: A Benchmark and an Evaluation of Popular Methods
Jiang, Y.-G., & Wang, J. (2016) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2016.2530714 · Cited by 72 · cited 2×
“techniques include the extraction from the activations of one of the fully connected layers of CNN architectures [23], [48], the application of the Maximum Activation of Convolution (MAC)”
LAMV: Learning to Align and Match Videos with Kernelized Temporal Layers
Baraldi, L., Douze, M., Cucchiara, R., & Jeǵou, H. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00814 · Cited by 63 · cited 2×
“Convolutions (RMAC) [45] based on the output of a Region Of Interest (ROI) pooling layer applied on the final convolutional layer [2], [14].”
BackgroundMethodMillion-scale near-duplicate video retrieval system
Cai, Y., Yang, L., Ping, W., Wang, F., Mei, T., Hua, X.-S., & Li, S. (2011) · Proceedings of the 19th ACM international conference on Multimedia · doi:10.1145/2072298.2072484 · Cited by 53 · cited 7×
“• Hand-crafted Features: We experiment with four widely used hand-crafted features in the literature: HSV histograms, LBP [51], ACC [18] and VLAD-SURF [19].”
BackgroundMethodInfluentialTREC video retrieval evaluation TRECVID
Over, P., Smeaton, A. F., Awad, G., et al. (2008) · TNO Repository · Cited by 43
Geotagging Text Content With Language Models and Feature Mining
Kordopatis-Zilos, G., Papadopoulos, S., & Kompatsiaris, I. Y. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2688799 · Cited by 39 · cited 1×
“We extracted the nouns using the NLTK toolkit [5] and the mentioned countries using the method described in [26].”
MethodSelf-citationSelf-similarity-based partial near-duplicate video retrieval and alignment
Wu, Z., & Aizawa, K. (2013) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-013-0049-1 · Cited by 19 · cited 1×
“Early approaches employed handcrafted features including HSV Colour Histograms [16], [25], [42], [49], Local Binary Patterns (LBP) [25], [37], [42], [50], [51] fuzzy multidimensional histograms of colour and motion video segments [10], Auto Colour Correlograms (ACC) [7], [18], and several keypoint descriptors (such as…”
MethodLipton, A. J. (2004) · doi:10.1049/ic:20040099 · Cited by 16 · cited 1×
“Other application scenarios and use cases that may benefit from solutions to the FIVR problem include safety and security applications [31], [34], [36].”
BackgroundGlobal-view hashing: harnessing global relations in near-duplicate video retrieval
Jing, W., Nie, X., Cui, C., Xi, X., Yang, G., & Yin, Y. (2018) · World Wide Web · doi:10.1007/s11280-018-0536-7 · Cited by 16 · cited 2×
“Early approaches employed handcrafted features including HSV Colour Histograms [16], [25], [42], [49], Local Binary Patterns (LBP) [51] [25], [37], [42], [50], fuzzy multidimensional histograms of colour and motion video segments [10], Auto Colour Correlograms (ACC) [7], [18], and several keypoint descriptors (such as…”
BackgroundMethodSabeur, Z. A., Doulamis, N. D., Middleton, L., et al. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-27857-5_15 · Cited by 15 · cited 1×
“Other application scenarios and use cases that may benefit from solutions to the FIVR problem include safety and security applications [31], [34], [36].”
BackgroundEvent Video Mashup: From Hundreds of Videos to Minutes of Skeleton
Gao, L., Wang, P., Song, J., et al. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10725 · Cited by 7 · cited 2×
“2905741 tion [11], [29] to event reconstruction[6], [13], [33] and news verification[24], [39].”
BackgroundAsymmetric Spatio-Temporal Embeddings for Large-Scale Image-to-Video Retrieval
García, N., & Vogiatzis, G. (2018) · Aston Publications Explorer (Aston University) · Cited by 7
Efficient video summarization based on a fuzzy video content representation
Doulamis, A. D., Doulamis, N. D., & Kollias, S. D. (n.d.) · 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353) · doi:10.1109/iscas.2000.858748
scikit-image: Image processing in Python
van der Walt, S., Schönberger, J. L., Nunez-Iglesias, J., et al. (2014) · doi:10.7287/peerj.preprints.336v1
Research works printed but not linked: 2
- [39] C. Silverman, 'Verification handbook,' 2013. -
- [29] W. Kraaij and G. Awad, 'Trecvid 2011 content-based copy detection: Task overview,' Online Proceedings of TRECVid 2010 , 2011. -
Cited by
ViSiL: Fine-Grained Spatio-Temporal Video Similarity Learning
Kordopatis-Zilos, G., Papadopoulos, S., Patras, I., & Kompatsiaris, I. Y. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00645 · Cited by 109
Self-citationTemporal Context Aggregation for Video Retrieval with Contrastive Learning
Shao, J., Wen, X., Zhao, B., & Xue, X. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00331 · Cited by 91
“Extensive experiments are conducted on multi video retrieval datasets, such as CC WEB VIDEO [61], FIVR [30], and EVVE [45].”
MethodInfluentialA hierarchical network-oriented analysis of user participation in misinformation spread on WhatsApp
Nobre, G. P., Ferreira, C. H. G., & Almeida, J. M. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102757 · Cited by 81
“As future work, we intend to explore more sophisticated heuristics, such as word [43] and sentence embeddings [44] (for textual messages), product quantization [45] (for images) and techniques based on audio and video content analysis [46].”
BackgroundCooper, N., Bernal-Cárdenas, C., Chaparro, O., Moran, K., & Poshyvanyk, D. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00091 · Cited by 81
DnS: Distill-and-Select for Efficient and Accurate Video Indexing and Retrieval
Kordopatis-Zilos, G., Tzelepis, C., Papadopoulos, S., Kompatsiaris, I. Y., & Patras, I. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01651-3 · Cited by 52
Self-citation
Metadata
- Authors
- Kordopatis-Zilos, G., Papadopoulos, S., Patras, I., & Kompatsiaris, I.
- Affiliations
- Information Technologies Institute (GR)
- Queen Mary University of London (GB)
- Venue
- IEEE Transactions on Multimedia
- Published
- 2019-10
- Volume
- 21
- Issue
- 10
- Pages
- 2638-2652
- ISSN
- 1520-9210 (ISSN-L)
- 1941-0077
- OpenAlex
- W2949298458
- Cited by
- 79
- References
- 59
- Citations by year
- 2026: 12 · 2025: 6 · 2024: 12 · 2023: 13 · 2022: 10 · 2021: 15 · 2020: 5 · 2019: 6
- FWCI
- 3.57
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Multimedia (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion)
- Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- InVID and WeVerify Projects
- European Commission (687786, 825297)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- benchmark dataset, news events, video annotation, image descriptors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.