The DOI matches its DataCite record; 47 of the 47 references it cites were found in a registry or an index.
MOT16: A Benchmark for Multi-Object Tracking
Open accessAbstract
Standardized benchmarks are crucial for the majority of computer vision applications. Although leaderboards and ranking tables should not be over-claimed, benchmarks often provide the most objective measure of performance and are therefore important guides for reseach. Recently, a new benchmark for Multiple Object Tracking, MOTChallenge, was launched with the goal of collecting existing and new data and creating a framework for the standardized evaluation of multiple object tracking methods. The first release of the benchmark focuses on multiple people tracking, since pedestrians are by far the most studied object in the tracking community. This paper accompanies a new release of the MOTChallenge benchmark. Unlike the initial release, all videos of MOT16 have been carefully annotated following a consistent protocol. Moreover, it not only offers a significant increase in the number of labeled boxes, but also provides multiple object classes beside pedestrians and the level of visibility for every single object of interest.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“We evaluate TrackFormer on the MOT17 [30] and MOT20 [13] benchmarks where it achieves state-of-the-art performance for public and private detections.”
From TrackFormer: Multi-Object Tracking with Transformers (2022) · cites this paper as [30]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 2×
“Recently, the KITTI benchmark [19] was introduced for challenges in autonomous driving, which included stereo/flow, odometry, road and lane estimation, object detection and orientation estimation, as well as tracking.”
BackgroundObject Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853 · cited 1×
“Note that the deformable part-based model (DPM) v5 [15], [22] outperforms the other detectors in the task of pedestrian detection.”
BackgroundThe Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
Scharstein, D., & Szeliski, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014573219977 · Cited by 6,740 · cited 1×
“…past, the computer vision community has developed centralized benchmarks for numerous tasks including object detection [14], pedestrian detection [12], 3D reconstruction [39], optical flow [7], [19], visual odometry [19], single-object short-term tracking [26], and stereo estimation [19], [37].”
BackgroundLabeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,445
Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Bernardin, K., & Stiefelhagen, R. (2008) · EURASIP Journal on Image and Video Processing · doi:10.1155/2008/246309 · Cited by 2,918
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., & Szeliski, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.19 · Cited by 2,457 · cited 1×
“…past, the computer vision community has developed centralized benchmarks for numerous tasks including object detection [14], pedestrian detection [12], 3D reconstruction [39], optical flow [7], [19], visual odometry [19], single-object short-term tracking [26], and stereo estimation [19], [37].”
BackgroundTorralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440 · cited 1×
“[42]), they have proven to be extremely helpful to advance the state of the art in the respective area.”
BackgroundA Database and Evaluation Methodology for Optical Flow
Baker, S., Scharstein, D., Lewis, J. P., Roth, S., Black, M. J., & Szeliski, R. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0390-2 · Cited by 2,205 · cited 1×
“In the recent past, the computer vision community has developed centralized benchmarks for numerous tasks including object detection [14], pedestrian detection [12], 3D reconstruction [39], optical flow [7], [19], visual odometry [19], singleobject short-term tracking [26], and stereo estimation [19], [37].”
BackgroundSelf-citation
Research works printed but not linked: 3
- [2][2] [1st Workshop on Benchmarking Multi-Target Tracking, 2015. http: //www.igp.ethz.ch/photogrammetry/bmtt2015/home.html.](http://www.igp.ethz.ch/photogrammetry/bmtt2015/home.html) -
- [4][4] A. Alahi, V. Ramanathan, and L. Fei-Fei. Socially-aware largescale crowd forecasting. In CVPR , 2014. -
- [20][20] R. Girshick. Fast R-CNN. In ICCV 2015 , 2015. -
Cited by
Sorted by citations
Items 301–400 of 1,003
Towards Nonlinear Disentanglement in Natural Data with Temporal Sparse Coding
Klindt, D. A., Schott, L., Sharma, Y., Ustyuzhaninov, I., Brendel, W., Bethge, M., & Paiton, D. M. (2020) · Cold Spring Harbor Laboratory Institutional Repository (Cold Spring Harbor Laboratory) · doi:10.48550/arxiv.2007.10930 · Cited by 88
“In order to construct our dataset and to inform our model prior, we extract segmentation masks from YouTube-VOS [17, 18] and KITTI-MOTS [19–21].”
BackgroundMethodInfluentialOnline multiple object tracking using joint detection and embedding network
Chan, S., Jia, Y., Zhou, X., Bai, C., Chen, S., & Zhang, X. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108793 · Cited by 42
Ma, C., Li, Y., Yang, F., Zhang, Z., Zhuang, Y., Jia, H., & Xie, X. (2019) · International Conference on Multimedia Retrieval · doi:10.1145/3323873.3325010 · Cited by 38
“Although the performance is gradually improving at the MOT Challenges [26] and DukeMTMCT [27], so far feature extraction and graph optimization are still independent tasks, They still havent been combined as an end-to-end model to be trained together, which causes the model not to learn the…”
BackgroundMethodInfluentialTrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the WildPreprint
Müller, M., Bibi, A., Giancola, S., Alsubaihi, S., & Ghanem, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.10794 · Cited by 53
“Recent benchmarks [11, 16] now consider putting aside a sequestered test set to provide a fair comparison.”
BackgroundMethodYıldız, S., Aydemir, O., Memiş, A., & Varlı, S. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105032 · Cited by 47
Dong, Y., Wang, D., Pan, Y., & Ma, Y. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.104985 · Cited by 38
Chen, X., Wang, Y., Wang, J., Bouferguène, A., & Al‐Hussein, M. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105389 · Cited by 37
A Review of Multi‐Object Tracking in Recent Times
Li, S., Ren, H., Xie, X., & Cao, Y. (2025) · IET Computer Vision · doi:10.1049/cvi2.70010 · Cited by 44
CTMC: Cell Tracking with Mitosis Detection Dataset Challenge
Anjum, S., & Gurari, D. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00499 · Cited by 37
“ject Tracking Accuracy (MOTA) and ID F1 Score (IDF1) [24].”
BackgroundMethodInfluentialDistractor-Aware Fast Tracking via Dynamic Convolutions and MOT Philosophy
Zhang, Z., Zhong, B., Zhang, S., Tang, Z., Liu, X., & Zhang, Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00108 · Cited by 38
“As there are no multiple objects annotations in single object tracking dataset, we introduce MOT datasets [7, 25, 36, 44] to train our re-id branch alternatively.”
MethodBaisa, N. L. (2021) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2021.103279 · Cited by 41
Shen, H., Huang, L., Huang, C., & Xu, W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.01562 · Cited by 46
“MOT2016 offers a variety of 14 video sequences (7 for training and 7 for testing) [22] which are captured by static or moving cameras indoors and outdoors.”
Automatic vehicle trajectory data reconstruction at scale
Wang, Y., Gloudemans, D., Ji, J., Teoh, Z. N., Liu, L., Zachár, G., Barbour, W., & Work, D. B. (2024) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2024.104520 · Cited by 36
Joint Detection and Online Multi-object Tracking
Kieritz, H., Hübner, W., & Arens, M. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00195 · Cited by 37
“We test our method on the DETRAC[26] and on the MOT16[15] benchmarks.”
BackgroundMethodInfluentialPose estimator and tracker using temporal flow maps for limbs
Hwang, J., Lee, J., Park, S., & Kwak, N. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851734 · Cited by 36
“MOTA, MOTP and mAP are used to evaluate the performance [32].”
MethodOnline Multi-object Visual Tracking using a GM-PHD Filter with Deep Appearance Learning
Baisa, N. L. (2019) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion43075.2019.9011441 · Cited by 34
“In the second step, we fine-tune again the pre-trained network on DukeMTMC dataset to MOT15 [26] and MOT16/17 [27] training datasets (MOT16 and MOT17 have the same training dataset though MOT17 is claimed to have more accurate ground truth and is used in our experiment).”
BackgroundMethodPerformance Evaluation Methodology for Long-Term Single-Object Tracking
Lukežič, A., Zajc, L. Č., Vojir, T., Matas, J., & Kristan, M. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2980618 · Cited by 40
Zero-VIRUS: Zero-shot Vehicle Route Understanding System for Intelligent Transportation
Yu, L., Feng, Q., Qian, Y., Liu, W., & Hauptmann, A. G. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00305 · Cited by 34
“Facing the dire need of algorithms tackling the vehicle counts task, the poor quality of data comparing to the well-formed and fully annotated tracking datasets [10, 35, 22] sets a considerably high threshold.”
BackgroundIdentity-Quantity Harmonic Multi-Object Tracking
He, Y., Wei, X., Hong, X., Ke, W., & Gong, Y. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3154286 · Cited by 36
Hypothesis Testing Based Tracking With Spatio-Temporal Joint Interaction Modeling
Sheng, H., Zhang, Y., Wu, Y., Wang, S., Lyu, W., Ke, W., & Xiong, Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2988649 · Cited by 35
“Dataset: Our method is tested on both MOT16 [26], MOT17 and MOT20 [14] benchmarks.”
MethodChallenges on Large Scale Surveillance Video Analysis
Feng, W., Ji, D., Wang, Y., Chang, S., Ren, H., & Gan, W. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00017 · Cited by 35
“In this section, we include the performance evaluation of two individual components: multiple object tracking and vehicle re-identification, on two public available Algorithm 2 MTMC matching Input: Distance matrix G Output: Trajectory result list R 1: procedure MATCHTRACK(G) 2: Trajectory candidate list Rc 3: for each…”
MethodInfluentialExploit the Connectivity: Multi-Object Tracking with TrackletNetPreprint
Wang, G., Wang, Y., Zhang, H., Gu, R., & Hwang, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.07258 · Cited by 35
“We use MOT16 and MOT17 [21] datasets to train and evaluate our tracking performance.”
MethodSemi-TCL: Semi-Supervised Track Contrastive Representation LearningPreprint
Li, W., Xiong, Y., Yang, S., Xu, M., Wang, Y., & Xia, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.02396 · Cited by 35
“By combining the MEVA and AVA100 dataset, we found the joint video dataset can boost the MOT17 evaluation results further to IDF1 78.4 and MOTA to 78.0.”
MethodInfluentialVNVC: A Versatile Neural Video Coding Framework for Efficient Human-Machine Vision
Sheng, X., Li, L., Liu, D., & Li, H. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3356548 · Cited by 34
“Video Multiple Object Tracking: We train video multiple object tracking networks on the MOT17 dataset [72].”
MethodWang, R., Cui, Y. J., Song, X., Chen, K., & Fang, H. (2021) · Image and Vision Computing · doi:10.1016/j.imavis.2021.104110 · Cited by 34
Extracting Accurate Long-term Behavior Changes from a Large Pig Dataset
Bergamini, L., Pini, S., Simoni, A., Vezzani, R., Calderara, S., D’Eath, R. B., & Fisher, R. B. (2021) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0010288405240533 · Cited by 33
“Validation Avg. tracklet sequence MOTA (”
BackgroundMethodInfluentialEfficient tracking of team sport players with few game-specific annotations
Maglo, A., Orcesi, A., & Pham, Q.-C. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00390 · Cited by 37
“ByteTrack achieves a very high performance on the MOT 2017 challenge [38].”
BackgroundTracklets Predicting Based Adaptive Graph TrackingPreprint
Shan, C., Wei, C., Deng, B., Huang, J., Hua, X., Cheng, X., & Liang, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.09015 · Cited by 52
“And even the appearance of objects is very similar, objects are too small, deformed, and very dense, and so on, which brings great challenges to multi-object tracking[4].”
Non-Semantics Suppressed Mask Learning for Unsupervised Video Semantic Compression
Tian, Y., Lu, G. S., Zhai, G., & Gao, Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01252 · Cited by 36
Dai, P., Wang, X., Zhang, W., & Chen, J. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2885922 · Cited by 33
“We evaluate the performance of our approach and compare with state-of-the-art methods on the MOT17 Challenge dataset [68].”
MethodMicroscopic behavioural analysis of cyclist and pedestrian interactions in shared spaces
Alsaleh, R., Hussein, M., & Sayed, T. (2019) · Canadian Journal of Civil Engineering · doi:10.1139/cjce-2018-0777 · Cited by 33
“Other tracking techniques and a benchmark for the evaluation of Page 9 of 45 https://mc06.manuscriptcentral.com/cjce-pubs Canadian Journal of Civil Engineering Draft Alsaleh, Hussein, Sayed 10 1 different multi-object tracking methods can be found in (Milan et al. 2016).”
MethodExploiting Spatial Invariance for Scalable Unsupervised Object Tracking
Crawford, E., & Pineau, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5777 · Cited by 7
Chen, K., Song, X., & Ren, X. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3013254 · Cited by 33
“This work evaluates the proposed method PK-CEN with three public benchmarks: Multiple Object Tracking Benchmark 2016, 2017 and 2020 (MOT16, MOT17 and MOT20) [21].”
MethodCOSMOS Smart Intersection: Edge Compute and Communications for Bird's Eye Object Tracking
Yang, S., Bailey, E., Yang, Z., Ostrometzky, J., Zussman, G., Seskar, I., & Kostić, Z. (2020) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops48775.2020.9156225 · Cited by 33
“In choosing the metrics, we paid particular attention to those used by several widely-known challenges: for detection, the Pascal Visual Object Classes (VOC) Challenge [25] and the Common Objects in Context (COCO) Challenge [22]; for tracking, the MOT Challenge [26].”
MethodInfluentialMultiple Object Tracking by Flowing and FusingPreprint
Zhang, J., Zhou, S., Chang, X., Wan, F., Wang, J., Wu, Y., & Huang, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.11180 · Cited by 33
“Extensive experiments have been conducted on the MOT benchmarks, including the 2DMOT2015 [35], MOT16 [41], and MOT17 [41].”
MethodJoint Detection and Multi-Object Tracking with Graph Neural NetworksPreprint
Wang, Y., Weng, X., & Kitani, K. (2020) · arXiv (Cornell University) · Cited by 34
Mora, M., Piles, M., David, I., & Rosa, G. J. M. (2024) · Journal of Animal Science · doi:10.1093/jas/skae174 · Cited by 32
Underwater Object Tracking Benchmark and Dataset
Kezebou, L., Oludare, V., Panetta, K. A., & Agaian, S. С. (2019) · IEEE Conference on Technologies for Homeland Security (HST) · doi:10.1109/hst47167.2019.9032954 · Cited by 32
“Competitions such as VOT challenge [3], the MOT challenge [5], NUSPRO VOT challenge [6], and the Thermal Infrared Object Tracking challenge [7], have helped push the boundaries of these benchmarks with consistent improvement in speed, precision and success rate.”
BackgroundVideoDP: A Flexible Platform for Video Analytics with Differential Privacy
Wang, H., Xie, S., & Hong, Y. (2020) · Proceedings on Privacy Enhancing Technologies · doi:10.2478/popets-2020-0073 · Cited by 34
“The example queries are set as “the number of frames with more than 15 pedestrians in each video of MOT, 10 pedestrians in each video of UAD, and 10 vehicles in each video of BVD, respectively” where the results are averaged in each video dataset (similar performance can be derived from other similar queries).”
BackgroundInfluentialDetection and Tracking on Automotive Radar Data with Deep Learning
Tilly, J. F., Haag, S., Schumann, O., Weishaupt, F., Duraisamy, B., Dickmann, J., & Fritzsche, M. (2020) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion45008.2020.9190261 · Cited by 32
“For example, [3] provides a standardized benchmark data set for multiple object tracking methods on camera data.”
BackgroundMulti-Pedestrian Tracking with Clusters
Stadler, D., & Beyerer, J. (2021) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss52988.2021.9663829 · Cited by 31
Mhalla, A., Château, T., & Amara, N. E. B. (2019) · Image and Vision Computing · doi:10.1016/j.imavis.2019.03.002 · Cited by 32
Wang, P., Wang, Y., & Li, D. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610941 · Cited by 32
Delving into the Trajectory Long-tail Distribution for Muti-object Tracking
Chen, S., Yu, E., Li, J., & Tao, W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01830 · Cited by 33
“We apply our tailored solution to the SOTA Fair-MOT [58] and CSTrack [30] of multi-object tracking networks and evaluate them on four public MOT benchmarks, ie., MOT15 [27], MOT16 [34], MOT17 [34] and MOT20 [12].”
MethodMulti-Object Tracking in the Dark
Wang, X., Ma, K., Liu, Q., Zou, Y., & Fu, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00044 · Cited by 36
“It can be seen that LMOT is approximately three times larger than MOT17 [34].”
BackgroundHigh-Resolution Traffic Sensing with Probe Autonomous Vehicles: A Data-Driven Approach
Ma, W., & Qian, S. (2021) · Sensors · doi:10.3390/s21020464 · Cited by 31
“As of today, the detection technology is fairly mature, while the tracking technology is still not ready for real-world applications [69].”
BackgroundJin, Y., Gao, F., Yu, J., Wang, J., & Shuang, F. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3249162 · Cited by 32
“As shown in Table III, FDTrack gives MOTA of 76.8 on MOT17, which improves by 1.9 and 1.6 respectively compared with the latest CSTrack and TransTrack.”
BackgroundInfluentialJRDB-Pose: A Large-Scale Dataset for Multi-Person Pose Estimation and Tracking
Vendrow, E. B., Lê, D., Cai, J., & Rezatofighi, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00466 · Cited by 32
“MOT has attracted significant attention from the community with large-scale challenges [12, 25, 30], and MPPT is increasingly becoming recognized for its significance in human activity understanding and human-object interaction.”
BackgroundGao, X., & Jiang, T. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240548 · Cited by 30
“Many benchmarks are built for MOT evaluation, such as 2D MOT 2015 [17], MOT16 [22] and DukeMTMC [26].”
MethodSuchan, J., Bhatt, M., & Varadarajan, S. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/260 · Cited by 50
Suchan, J., Bhatt, M., & Varadarajan, S. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103522 · Cited by 31
Real-Time Multiple Object Visual Tracking for Embedded GPU Systems
Fernández-Sanjurjo, M., Mucientes, M., & Brea, V. M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3056239 · Cited by 34
“In this case, we have selected the MOT16 data set [54] for several reasons.”
BackgroundMethodDG-Labeler and DGL-MOTS Dataset: Boost the Autonomous Driving Perception
Cui, Y., Cao, Z., Xie, Y., Jiang, X., Tao, F., Chen, Y., Li, L., & Liu, D. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00347 · Cited by 31
Adiabatic Quantum Computing for Multi Object Tracking
Zaech, J.-N., Liniger, A., Danelljan, M., Dai, D., & Gool, L. V. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00861 · Cited by 34
“Multi-object tracking describes the problem of tracking all objects belonging to a predefined set of object types in 2D [14, 38, 41, 43] or 3D [10, 11, 23].”
BackgroundImage amodal completion: A survey
Ao, J., Ke, Q., & Ehinger, K. A. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103661 · Cited by 29
LDS-Inspired Residual Networks
Dimou, A., Ataloglou, D., Dimitropoulos, K., Álvarez, F., & Daras, P. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2869680 · Cited by 29
“Experiments on image classification and object detection using the CIFAR-10/100, ImageNet, PASCAL VOC and MOT2017Det datasets have demonstrated the outstanding performance and robustness of the proposed approach.”
MethodInfluentialA Multiple Object Tracking Algorithm Based on YOLO Detection
Tan, L., Xu, D., Ma, Y., & Yu, C. (2018) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei.2018.8633009 · Cited by 29
“Experiments on the open multi-target tracking data set MOT-16 [5] and Microsoft MSR data sets [6] demonstrate the effectiveness of this method.”
MethodBull Sperm Tracking and Machine Learning-Based Motility Classification
Hidayatullah, P., Mengko, T. L., Munir, R., & Barlian, A. (2021) · IEEE Access · doi:10.1109/access.2021.3074127 · Cited by 32
“This table contains Deep SORT and Tracking-Grid results with standard multi-object tracking metrics MOT-16 [41].”
MethodDeep visual social distancing monitoring to combat COVID-19: A comprehensive survey
Himeur, Y., Al-Maadeed, S. A., Almaadeed, N., Abualsaud, K., Mohamed, A. M. S., Khattab, T. M., & Elharrouss, O. (2022) · Sustainable Cities and Society · doi:10.1016/j.scs.2022.104064 · Cited by 29
Learning of Global Objective for Network Flow in Multi-Object Tracking
Li, S., Kong, Y., & Rezatofighi, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00865 · Cited by 29
“For fair comparison with other methods, the tracking performance is reported in MOT16, MOT17 and MOT20 test set using the provided public detections.”
BackgroundMethodResultInfluentialTransformer-based assignment decision network for multiple object tracking
Psalta, A., Tsironis, V., & Karantzalos, K. G. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.103957 · Cited by 33
Saraceni, L., Motoi, I. M., Nardi, D., & Ciarfuglia, T. A. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610231 · Cited by 28
“Evaluations were performed according to a combination of widely accepted metrics defined by [33, 30, 4].”
MethodRaTrack: Moving Object Detection and Tracking with 4D Radar Point Cloud
Pan, Z., Ding, F., Zhong, H., & Lu, C. X. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610368 · Cited by 35
“As an uplift of 2D MOT [22]–[26] in the 3D space, 3D MOT has attracted increasing interests due to its significant application to autonomous systems.”
BackgroundDeconfuseTrack: Dealing with Confusion for Multi-Object Tracking
Huang, C., Han, S., He, M., Zheng, W., & Wei, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01825 · Cited by 28
“For example, the MOT17 dataset [32] uses DPM [15], Faster-RCNN [38], and SDP [50].”
MethodMultiple-target tracking in human and machine vision
Kamkar, S., Ghezloo, F., Moghaddam, H. A., Borji, A., & Lashgari, R. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007698 · Cited by 28
Segment as Points for Efficient and Effective Online Multi-Object Tracking and Segmentation
Xu, Z., Yang, W., Zhang, W., Tan, X., Huang, H., & Huang, L. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3087898 · Cited by 29
“Built on MOT16 [26], MOTSChallenge has more crowded scenes as well as more dynamic view points.”
BackgroundMethodMulti-Object Tracking With Spatial-Temporal Topology-Based Detector
You, S., Yao, H., & Xu, C. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3096237 · Cited by 28
Tezcan, M. O., Duan, Z., Cokbas, M., Ishwar, P., & Konrad, J. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00145 · Cited by 29
“Video Multi-Object Tracking: The performance of multi-object tracking (MOT) algorithms has increased significantly over the last few years thanks to the extensive datasets such as MOT15 [22], MOT16 [28], MOT19 [12] and MOT20 [13].”
BackgroundGM-PHD Filter Based Online Multiple Human Tracking Using Deep Discriminative Correlation Matching
Fu, Z., Angelini, F., Naqvi, S. M., & Chambers, J. A. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461946 · Cited by 26
“In this section, we validate the proposed method denoted by PHD-DCM on the test set of the MOT2017 Challenge Benchmark [1].”
MethodVisible–thermal multiple object tracking: Large-scale video dataset and progressive fusion approach
Zhu, Y., Wang, Q., Li, C., Tang, J., Gu, C., & Huang, Z. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.111330 · Cited by 32
Learning Pedestrian Detection from Virtual Worlds
Amato, G. M., Ciampi, L., Falchi, F., Gennaro, C., & Messina, N. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30642-7_27 · Cited by 26
“Then, we test the trained detector on the MOT17 detection dataset (MOT17Det) [5], a real-world dataset suited for pedestrian detection, in order to measure the generalization capabilities of the proposed solution with respect to real-world scenarios.”
BackgroundMethodInfluentialReal-time citywide reconstruction of traffic flow from moving cameras on lightweight edge devices
Kumar, A., Kashiyama, T., Maeda, H., Omata, H., & Sekimoto, Y. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.07.022 · Cited by 27
Multi-Object Tracking with Multiple Cues and Switcher-Aware Classification
Feng, W., Li, B., & Ouyang, W. (2022) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta56598.2022.10034575 · Cited by 28
“In the third stage, the whole network is trained on MOT16 [66] dataset supervised by the losses mentioned in Sec.”
MethodAlikhanov, J., & Kim, H. (2023) · IEEE Access · doi:10.1109/access.2023.3292539 · Cited by 30
“Also note the less intuitive ID switch, which is counted because blue is the closest target in frame 5 that is not in conflict with the mapping in frame 4 (adapted from [15]). moving cameras in various outdoor environments, including parking lots, roads, and airport tarmacs.”
BackgroundMethodUncertainty-aware Unsupervised Multi-Object Tracking
Liu, K., Jin, S., Fu, Z., Chen, Z., Jiang, R., & Ye, J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00917 · Cited by 29
“Multi-object tracking (MOT) [31, 4, 46] has been widely deployed in real-world applications, including surveillance analysis [32, 56], autonomous driving [13, 38], intelligent robots [34, 3], etc .”
BackgroundMethodOne-Shot Multiple Object Tracking With Robust ID Preservation
Lv, W., Zhang, N., Zhang, J., & Zeng, D. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3339609 · Cited by 26
“Besidesthe aforementioned theoretic analysis, we also investigate the MOT17 [21] and MOT20 [22] datasets and found that occlusion occurs with high frequency along the video sequence.”
BackgroundContrastive Learning for Multi-Object Tracking with Transformers
Plaen, P.-F. D., Marinello, N., Proesmans, M., Tuytelaars, T., & Gool, L. V. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00672 · Cited by 30
“MOT17 [26] is a widely used benchmark to evaluate MOT methods.”
BackgroundMethodInfluentialLTTrack: Rethinking the Tracking Framework for Long-Term Multi-Object Tracking
Lin, J., Liang, G., & Zhang, R. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3404275 · Cited by 31
“Never-theless, compared to the performance of LTTrack on the pedestrian tracking benchmarks [16], [17], [29], its performance on VisDrone2019 is notably inferior.”
BackgroundMethodInfluentialVisDrone-MOT2020: The Vision Meets Drone Multiple Object Tracking Challenge Results
Fan, H., Du, D., Wen, L., Zhu, P., Hu, Q., Ling, H., Shah, M. A., Pan, J., Schumann, A., Dong, B., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-66823-5_43 · Cited by 26
“To this end, many MOT benchmarks have been proposed in recent years, such as UA-DETRAC [42], MOT challenge [13,32], TAO [12], and KITTI [17].”
BackgroundMethodOn the Performance of Crowd-Specific Detectors in Multi-Pedestrian Tracking
Stadler, D., & Beyerer, J. (2021) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss52988.2021.9663836 · Cited by 26
LMOT: Efficient Light-Weight Detection and Tracking in Crowds
Mostafa, R., Baraka, H., & Bayoumi, A. (2022) · IEEE Access · doi:10.1109/access.2022.3197157 · Cited by 26
Deng, K., Zhang, C., Chen, Z., Hu, W., Li, B., & Lu, F. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3238716 · Cited by 28
“Since CalTech [49], CUHK-SYSU [61], PRW [50], and MOT17 [33] donate identity annotations and boxes, they can be used to train the detection and Re-ID branches.”
BackgroundMethodInfluentialNgeni, F., Mwakalonge, J., & Siuhi, S. (2024) · Journal of Traffic and Transportation Engineering (English Edition) · doi:10.1016/j.jtte.2023.05.006 · Cited by 34
Beyer, L., Breuers, S., Kurin, V., & Leibe, B. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.187 · Cited by 25
“Many datasets are available to evaluate tracking, such as the MOTChallenge benchmarks [19, 25], KITTI [10] for”
Self-supervised Multi-view Person Association and Its Applications
Vo, M. P., Yumer, E., Sunkavalli, K., Hadap, S., Sheikh, Y. A., & Narasimhan, S. G. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2974726 · Cited by 25
Multi-Metric Re-Identification for Online Multi-Person Tracking
Nodehi, H., & Shahbahrami, A. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3059250 · Cited by 25
Synthehicle: Multi-Vehicle Multi-Camera Tracking in Virtual Cities
Herzog, F., Chen, J., Teepe, T., Gilg, J., Hörmann, S., & Rigoll, G. (2023) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw58289.2023.00005 · Cited by 25
“Tracking We store the tracking ground truth for 2D and 3D boxes in COCO and MOTChallenge [41] format.”
BackgroundMethodObservation Centric and Central Distance Recovery for Athlete Tracking
Huang, H.-W., Yang, C.-Y., Ramkumar, S., Huang, C.-I., Hwang, J., Kim, P.-K., Lee, K., & Kim, K. (2023) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw58289.2023.00050 · Cited by 25
Accelerating Live Single-Cell Signalling Studies
Cooper, S., & Bakal, C. (2017) · Trends in biotechnology · doi:10.1016/j.tibtech.2017.01.002 · Cited by 26
Simultaneous Identification and Tracking of Multiple People Using Video and IMUs
Henschel, R. D., von Marcard, T., & Rosenhahn, B. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00106 · Cited by 27
“Similar to MOT16[32], we interpolated ground-truth detections for occluded persons.”
MethodSTAT: Multi-Object Tracking Based on Spatio-Temporal Topological Constraints
Zhang, J., Wang, M., Jiang, H., Zhang, X., Yan, C. C., & Zeng, D. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3323852 · Cited by 25
Küçükkeçeci, C., & Yazıcı, A. (2019) · IEEE Access · doi:10.1109/access.2019.2918765 · Cited by 24
“[11] X. Zou and B. Bhanu, ‘‘Tracking humans using multi-modal fusion,’’ in Proc.”
BackgroundInfluentialSuchan, J., Bhatt, M., Wałęga, P. A., & Schultz, C. P. L. (2018) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v32i1.11569 · Cited by 24
Countor: count without bells and whistles
OSPINA, A., & Figueroa, F. T. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00308 · Cited by 24
“The review started on the different benchmarks for MTSC such as [16, 8, 19].”
BackgroundMethodAVOT: Audio-Visual Object Tracking of Multiple Objects for Robotics
Wilson, J., & Lin, M. C. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197528 · Cited by 24
“For an Object Detection/Tracking Datasets Dataset # Class # Img/Vid COCO [37] 80 330K img DAVIS [10] 384 10.5K img ILSVRC [51] 1000 1.4M img KITTI [42], [58] 8 10.9K img OTB [60] 100 100 vid PASCAL VOC [15] 20 21K img Sound-20K [63] 55+ 20K vid VOT2018 [32] 35 147K img YouTube–VOS [61] 7800+ 4K+…”
Continuous Copy-Paste for One-stage Multi-object Tracking and Segmentation
Xu, Z., Meng, A., Shi, Z., Yang, W., Chen, Z., & Huang, L. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01504 · Cited by 24
“MOTS20, which is built on MOT16 [14], is a very challenging MOTS dataset with many crowded scenarios.”
BackgroundMa, C., Yang, F., Li, Y., Jia, H., Xie, X., & Gao, W. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01527-y · Cited by 24
“Although the performance is gradually improving at the MOT Challenges Milan et al. (2016), the effectiveness of MOT is still limited by object detection quality, long-term occlusion and scene complexity.”
BackgroundMethodInfluentialPi, Y., Duffield, N. G., Behzadan, A. H., & Lomax, T. (2022) · Computational Urban Science · doi:10.1007/s43762-021-00031-w · Cited by 27
“This study uses the standardized multi-object tracking accuracy (MOTA) established by the multiple object tracking (MOT) challenge (Milan et al., 2016) to measure the tracking performance.”
MethodBellocchio, E., Crocetti, F., Costante, G., Fravolini, M. L., & Valigi, P. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104615 · Cited by 24
Real-time Streaming Video Denoising with Bidirectional Buffers
Qi, C., Chen, J., Yang, X., & Chen, Q. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547934 · Cited by 24
“It is composed of one synthetic dataset (SRVD) generated fromMOT [17] and one captured dataset (CRVD).”
Method
Metadata
- Authors
- Milan, A., Leal-Taixe, L., Reid, I., Roth, S., & Schindler, K.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1603.00831
- OpenAlex
- W2291627510
- Cited by
- 1,309
- References
- 47
- Citations by year
- 2026: 6 · 2025: 45 · 2024: 178 · 2023: 192 · 2022: 179 · 2021: 219 · 2020: 192 · 2019: 135 · 2018: 96 · 2017: 55 · 2016: 12
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- MOT16, multi-target tracking, benchmark, pedestrian tracking, video annotation, object visibility, evaluation protocol
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
