CoChat
Sign Up
PreprintCited by 779Video Surveillance and Tracking MethodsAutonomous Vehicle Technology and SafetyAdvanced Neural Network Applications

MOT20: A benchmark for multi object tracking in crowded scenes

Open access
Dendorfer, Patrick, Rezatofighi, Hamid, Milan, Anton, Shi, Javen, Cremers, Daniel, Reid, Ian, Roth, Stefan, Schindler, Konrad +1 more·2020·arXiv
DOI 10.48550/arxiv.2003.09003arXiv 2003.09003
Open this paper in CoChat — free accountOpen PDF

Abstract

Standardized benchmarks are crucial for the majority of computer vision applications. Although leaderboards and ranking tables should not be over-claimed, benchmarks often provide the most objective measure of performance and are therefore important guides for research. The benchmark for Multiple Object Tracking, MOTChallenge, was launched with the goal to establish a standardized evaluation of multiple object tracking methods. The challenge focuses on multiple people tracking, since pedestrians are well studied in the tracking community, and precise tracking and detection has high practical relevance. Since the first release, MOT15, MOT16, and MOT17 have tremendously contributed to the community by introducing a clean dataset and precise framework to benchmark multi-object trackers. In this paper, we present our MOT20benchmark, consisting of 8 new sequences depicting very crowded challenging scenes. The benchmark was presented first at the 4thBMTT MOT Challenge Workshop at the Computer Vision and Pattern Recognition Conference (CVPR) 2019, and gives to chance to evaluate state-of-the-art methods for multiple object tracking when handling extremely crowded scenarios.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2003.09003

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • On MOT20, TrackFormer is the first method only pretrained on CrowdHuman (CH).

    “On MOT20 [13], we introduce the first method only pretrained on CrowdHuman [45] (CH).”

    From TrackFormer: Multi-Object Tracking with Transformers (2022) · cites this paper as [13]

  • TrackFormer achieves state-of-the-art performance on MOT17 and MOT20 for public and private detections.

    “We evaluate TrackFormer on the MOT17 [30] and MOT20 [13] benchmarks where it achieves state-of-the-art performance for public and private detections.”

    From TrackFormer: Multi-Object Tracking with Transformers (2022) · cites this paper as [13]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 12

  1. [1][1] S.-H. Bae and K.-J. Yoon. Robust online multi-object tracking based on tracklet confidence and online discriminative appearance learning. In CVPR 2014 . -
  2. [2][2] K. Bernardin and R. Stiefelhagen. Evaluating multiple object tracking performance: The CLEAR MOT metrics. Image and Video Processing , 2008(1):1-10, May 2008. -
  3. [5][5] L. Leal-Taix´ e, A. Milan, I. Reid, S. Roth, and K. Schindler. MOTChallenge 2015: Towards a benchmark for multi-target tracking. arXiv:1504.01942 , 2015. - · arXiv
  4. [6][6] Y. Li, C. Huang, and R. Nevatia. Learning to associate: Hybridboosted multi-target tracker for crowded scene. In CVPR 2009 . -
  5. [7][7] M. Mathias, R. Benenson, M. Pedersoli, and L. V. Gool. Face detection without bells and whistles. In ECCV 2014 , 2014. -
  6. [9][9] A. Milan, S. Roth, and K. Schindler. Continuous energy minimization for multitarget tracking. PAMI , 36(1):58-72, 2014. -
  7. [10][10] A. Milan, K. Schindler, and S. Roth. Challenges of ground truth evaluation of multi-target tracking. In 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) , pages 735-742, June 2013. -
  8. [11][11] S. Ren, K. He, R. Girshick, and J. Sun. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. arXiv e-prints , page arXiv:1506.01497, Jun 2015. - · arXiv
  9. [12][12] D. Schuhmacher, B.-T. Vo, and B.-N. Vo. A consistent metric for performance evaluation of multi-object filters. IEEE Transactions on Signal Processing , 56(8):3447-3457, Aug. 2008. -
  10. [13][13] K. Smith, D. Gatica-Perez, J.-M. Odobez, and S. Ba. Evaluating multi-object tracking. In Workshop on Empirical Evaluation Methods in Computer Vision (EEMCV) . -
  11. [15][15] L. Wen, W. Li, J. Yan, Z. Lei, D. Yi, and S. Z. Li. Multiple target tracking based on undirected hierarchical relation hypergraph. In CVPR 2014 . -
  12. [16][16] B. Wu and R. Nevatia. Tracking of multiple, partially occluded humans based on static body part detection. In CVPR 2006 , pages 951-958, 2006.

Cited by

Sorted by citations

Authors
Dendorfer, P., Rezatofighi, H., Milan, A., Shi, J., Cremers, D., Reid, I., Roth, S., Schindler, K., & Leal-Taixé, L.
Affiliations
Technical University of Munich (DE)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2003.09003
arXiv
2003.09003
OpenAlex
W3012922853
Cited by
779
References
3
Citations by year
2026: 83 · 2025: 123 · 2024: 182 · 2023: 170 · 2022: 135 · 2021: 68 · 2020: 18
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
multi-target tracking, crowded scenes, pedestrian tracking, benchmark dataset

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review