CoChat

FIVR: Fine-Grained Incident Video Retrieval

Open access

The DOI matches its Crossref record; 55 of the 59 references it cites were found in a registry or an index; none of the 10 sources its claims cite is checked for support yet.

Abstract

This paper introduces the problem of Fine-grained Incident Video Retrieval (FIVR). Given a query video, the objective is to retrieve all associated videos, considering several types of associations that range from duplicate videos to videos from the same incident. FIVR offers a single framework that contains several retrieval tasks as special cases. To address the benchmarking needs of all such tasks, we construct and present a large-scale annotated video dataset, which we call FIVR-200K, and it comprises 225,960 videos. To create the dataset, we devise a process for the collection of YouTube videos based on major news events from recent years crawled from Wikipedia and deploy a retrieval pipeline for the automatic selection of query videos based on their estimated suitability as benchmarks. We also devise a protocol for the annotation of the dataset with respect to the four types of video associations defined by FIVR. Finally, we report the results of an experimental study on the dataset comparing five state-of-the-art methods developed based on a variety of visual descriptors, highlighting the challenges of the current problem.

Overview

CoChat Summary

TL;DR

This paper introduces Fine-grained Incident Video Retrieval (FIVR), a unified retrieval problem covering duplicate, complementary-viewpoint, and same-incident video associations. It presents FIVR-200K, a 225,960-video benchmark built from Wikipedia news events, and benchmarks five state-of-the-art retrieval methods across three FIVR tasks.

Key findings

  • FIVR-200K contains 225,960 YouTube videos, 4,687 Wikipedia news events, 100 queries, and 7,100 hours of video; selected queries average 13 NDV, 57 DSV, 18 CSV, and 35 ISV annotations.
  • The best benchmarked method, LBoW, achieves mAP scores of 0.710 for DSVR, 0.675 for CSVR, and 0.572 for ISVR; GV performs worst at 0.165, 0.153, and 0.118, respectively.
  • All methods perform much better on CC WEB VIDEO, with mAP values as high as 0.976, showing FIVR-200K is substantially more challenging, especially for ISVR.
  • Deep features outperform handcrafted features; LBoW with VGG features is best for DSVR/CSVR, while ISVR remains the hardest task with most queries below 0.6 mAP.

Methods

  • Dataset construction: crawled Wikipedia “Current Events” from Jan 1, 2013 to Dec 31, 2017, retained “Armed conflicts and attacks” or “Disasters and accidents” categories (9,431 collected, 4,687 retained), then used YouTube API with event headlines, filtering to videos published from event start up to one week after and duration up to five minutes.
  • Query selection: computed visual and textual similarity via tf-idf BoW representations, built a video graph with threshold 0.7, discarded components with uploader ratio below 0.75, retained components within a two-week publication window, selected videos under 90 seconds, chose earliest-published video per component, and kept the top 100 queries by component size.
  • Annotation and evaluation: annotated videos in three phases using labels ND, DS, CS, IS, and DI; benchmarked GV, BoW, LBoW, DML, and HC with handcrafted, CNN, and 3D CNN features; evaluated DSVR, CSVR, and ISVR using interpolated PR curves and mAP.

Limitations

  • Stated: global video representations have strong performance limits; suggested improvements such as frame-level matching, end-to-end CNN/3D CNN training, and query expansion are computationally complex and need careful design for large-scale use.
  • Stated: the dataset annotation covers four labels, and the authors plan to extend it for related problems such as event reconstruction and synchronization.
  • Evident from the text: annotation was split between two annotators with only the lead author revisiting non-distractor labels for consistency; the query set is limited to 100 selected from 635 candidates, and the dataset is restricted to two Wikipedia event categories, YouTube videos up to five minutes, and events from 2013–2017.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/tmm.2019.2905741

Cites

55 of 55 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 Valid · 0 Not valid · 6 Not checked · 98 Own results and interpretations

54 more claims

Create a free account to see all 104 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 30
  • It may state two separate claims as one. 12
  • The quote only partly states this claim. 3

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 55 references

Research works printed but not linked: 2

  1. silverman, 2013, Verification handbook
  2. kraaij, 0, TRECVID 2011 content-based copy detection: Task overview, Online Proc TRECVid 2010

Cited by

See all 79

Metadata

Authors
Kordopatis-Zilos, G., Papadopoulos, S., Patras, I., & Kompatsiaris, I.
Affiliations
  • Information Technologies Institute (GR)
  • Queen Mary University of London (GB)
Venue
IEEE Transactions on Multimedia
Published
2019-10
Volume
21
Issue
10
Pages
2638-2652
ISSN
  • 1520-9210 (ISSN-L)
  • 1941-0077
OpenAlex
W2949298458
Cited by
79
References
59
Citations by year
2026: 12 · 2025: 6 · 2024: 12 · 2023: 13 · 2022: 10 · 2021: 15 · 2020: 5 · 2019: 6
FWCI
3.57
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Multimedia (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Queen Mary Research Online (Queen Mary University of London) (submittedVersion)
  • Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, cc-by)
  • arXiv (Cornell University)
Funders
  • InVID and WeVerify Projects
  • European Commission (687786, 825297)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
Keywords
benchmark dataset, news events, video annotation, image descriptors

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: FIVR: Fine-Grained Incident Video Retrieval. https://app.cochat.ai/papers/10.1109/tmm.2019.2905741
The paper
Kordopatis-Zilos, G., Papadopoulos, S., Patras, I., & Kompatsiaris, I. (2019). FIVR: Fine-Grained Incident Video Retrieval. IEEE Transactions on Multimedia. https://doi.org/10.1109/tmm.2019.2905741

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.