The DOI matches its DataCite record; 47 of the 47 references it cites were found in a registry or an index.
MOT16: A Benchmark for Multi-Object Tracking
Open accessAbstract
Standardized benchmarks are crucial for the majority of computer vision applications. Although leaderboards and ranking tables should not be over-claimed, benchmarks often provide the most objective measure of performance and are therefore important guides for reseach. Recently, a new benchmark for Multiple Object Tracking, MOTChallenge, was launched with the goal of collecting existing and new data and creating a framework for the standardized evaluation of multiple object tracking methods. The first release of the benchmark focuses on multiple people tracking, since pedestrians are by far the most studied object in the tracking community. This paper accompanies a new release of the MOTChallenge benchmark. Unlike the initial release, all videos of MOT16 have been carefully annotated following a consistent protocol. Moreover, it not only offers a significant increase in the number of labeled boxes, but also provides multiple object classes beside pedestrians and the level of visibility for every single object of interest.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“We evaluate TrackFormer on the MOT17 [30] and MOT20 [13] benchmarks where it achieves state-of-the-art performance for public and private detections.”
From TrackFormer: Multi-Object Tracking with Transformers (2022) · cites this paper as [30]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 2×
“Recently, the KITTI benchmark [19] was introduced for challenges in autonomous driving, which included stereo/flow, odometry, road and lane estimation, object detection and orientation estimation, as well as tracking.”
BackgroundObject Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853 · cited 1×
“Note that the deformable part-based model (DPM) v5 [15], [22] outperforms the other detectors in the task of pedestrian detection.”
BackgroundThe Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
Scharstein, D., & Szeliski, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014573219977 · Cited by 6,740 · cited 1×
“…past, the computer vision community has developed centralized benchmarks for numerous tasks including object detection [14], pedestrian detection [12], 3D reconstruction [39], optical flow [7], [19], visual odometry [19], single-object short-term tracking [26], and stereo estimation [19], [37].”
BackgroundLabeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,445
Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Bernardin, K., & Stiefelhagen, R. (2008) · EURASIP Journal on Image and Video Processing · doi:10.1155/2008/246309 · Cited by 2,918
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., & Szeliski, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.19 · Cited by 2,457 · cited 1×
“…past, the computer vision community has developed centralized benchmarks for numerous tasks including object detection [14], pedestrian detection [12], 3D reconstruction [39], optical flow [7], [19], visual odometry [19], single-object short-term tracking [26], and stereo estimation [19], [37].”
BackgroundTorralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440 · cited 1×
“[42]), they have proven to be extremely helpful to advance the state of the art in the respective area.”
BackgroundA Database and Evaluation Methodology for Optical Flow
Baker, S., Scharstein, D., Lewis, J. P., Roth, S., Black, M. J., & Szeliski, R. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0390-2 · Cited by 2,205 · cited 1×
“In the recent past, the computer vision community has developed centralized benchmarks for numerous tasks including object detection [14], pedestrian detection [12], 3D reconstruction [39], optical flow [7], [19], visual odometry [19], singleobject short-term tracking [26], and stereo estimation [19], [37].”
BackgroundSelf-citation
Research works printed but not linked: 3
- [2][2] [1st Workshop on Benchmarking Multi-Target Tracking, 2015. http: //www.igp.ethz.ch/photogrammetry/bmtt2015/home.html.](http://www.igp.ethz.ch/photogrammetry/bmtt2015/home.html) -
- [4][4] A. Alahi, V. Ramanathan, and L. Fei-Fei. Socially-aware largescale crowd forecasting. In CVPR , 2014. -
- [20][20] R. Girshick. Fast R-CNN. In ICCV 2015 , 2015. -
Cited by
Sorted by citations
Items 201–300 of 1,003
Kalake, L., Wan, W., & Hou, L. (2021) · IEEE Access · doi:10.1109/access.2021.3060821 · Cited by 68
“Then optimizes the sequential states by modeling the maximum posterior estimation from the conditional for all sequential states of all objects from the first frame to the last frame [25].”
MethodMulti-Camera Multi-Target Tracking with Space-Time-View Hyper-graph
Wen, L., Lei, Z., Chang, M., Qi, H., & Lyu, S. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-016-0943-0 · Cited by 66
Mandal, M., Dhar, V., Mishra, A., Vipparthi, S. K., & Abdel-Mottaleb, M. S. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3037472 · Cited by 68
“More recent benchmark datasets for other video-based applications [50], [51] already ensure such scene independency in their evaluation schemes.”
BackgroundFuSSI-Net: Fusion of Spatio-temporal Skeletons for Intention Prediction Network
Piccoli, F., Balakrishnan, R., Perez, M. J., Sachdeo, M., Nunez, C., Tang, M., Andreasson, K., Bjurek, K., Raj, R. D., Davidsson, E., et al. (2020) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf51394.2020.9443552 · Cited by 67
“In particular, one of the object trackers in the proposed system is benchmarked on the MOT16 dataset [11].”
MethodPeri, N., Khorramshahi, P., Rambhatla, S. S., Shenoy, V., Rawat, S., Chen, J.-C., & Chellappa, R. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00319 · Cited by 64
“Other popular evaluation measures adopted by the MOT challenge [25], such as Multiple Object Tracking Accuracy (MOTA), Multiple Object Tracking Precision (MOTP), mostly tracked targets (MT), and false alarm rate (FAR) are also provided by the evaluation server.”
MethodAn Improved Association Pipeline for Multi-Person Tracking
Stadler, D., & Beyerer, J. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00319 · Cited by 72
“Our design choices are validated with comprehensive ablative experiments and the superiority of ImprAsso w.r.t. other existing methods is demonstrated on the two MPT benchmarks MOT17 [20] and MOT20 [6], where state-of-the-art results are achieved.”
MethodOne More Check: Making “Fake Background” Be Tracked Again
Liang, C., Zhang, Z., Xue, Z., Li, B., & Hu, W. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20045 · Cited by 65
PathTrack: Fast Trajectory Annotation with Path Supervision
Manén, S., Gygli, M., Dai, D., & Gool, L. V. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.40 · Cited by 64
“[29, 35] have become the standard benchmarks for MOT, containing complex pedestrian scenes with static or moving cameras.”
BackgroundInfluentialA Survey of Scene Understanding by Event Reasoning in Autonomous Driving
Xue, J., Fang, J., & Zhang, P. (2018) · Machine Intelligence Research · doi:10.1007/s11633-018-1126-y · Cited by 63
“Actually, it is the same for the general computer vision domain, such as PASCAL VOC [26] , ImageNet challenge [27] , Middlebury for stereo and optical flow , MOT for tracking [28] , ActivityNet [29] , etc.”
BackgroundAggregate Tracklet Appearance Features for Multi-Object Tracking
Chen, L., Ai, H., Chen, R., & Zhuang, Z. (2019) · IEEE Signal Processing Letters · doi:10.1109/lsp.2019.2940922 · Cited by 63
“The comparison on MOT16 and MOT17 test sets is shown in Table I.”
MethodInfluentialCVPR19 Tracking and Detection Challenge: How crowded can it get?Preprint
Dendorfer, P., Rezatofighi, H., Milan, A., Shi, Q., Cremers, D., Reid, I. D., Roth, S., Schindler, K., & Leal-Taixé, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.04567 · Cited by 63
“Since the first release, MOT15 [5], MOT16 [8],”
BackgroundMethodInfluentialSelf-citationYu, E., Li, Z., & Han, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00863 · Cited by 63
“Incorporating all the above proposed techniques, the resulting model, namely multi-view tracker (MTrack), has been evaluated on four public benchmarks, i.e., MOT15 [24], MOT16 [27], MOT17 [27] and MOT20 [13].”
MethodInfluentialCAVBench: A Benchmark Suite for Connected and Autonomous Vehicles
Wang, Y., Liu, S., Wu, X., & Shi, W. (2018) · 2018 IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec.2018.00010 · Cited by 63
3D-ZeF: A 3D Zebrafish Tracking Benchmark Dataset
Pedersen, M., Haurum, J. B., Bengtson, S. H., & Moeslund, T. B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00250 · Cited by 63
“The significant development experienced in other fields of MOT has not yet translated to 3D zebrafish tracking.”
BackgroundMethodInfluentialRobust and efficient post-processing for video object detection
Sabater, A., Montesano, L., & Murillo, A. C. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341600 · Cited by 61
“These are often applied to specific domains like person re-identification, where persons have to be detected and tracked in videos [18], [19] extracted”
BackgroundSCGTracker: Spatio-temporal correlation and graph neural networks for multiple object tracking
Zhang, Y., Liang, Y., Leng, J., & Wang, Z. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2023.110249 · Cited by 60
Wang, X., Sun, Z., Chehri, A., Jeon, G., & Song, Y. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102247 · Cited by 67
Online multi-object tracking using multi-function integration and tracking simulation training
Yang, J., Ge, H., Yang, J., Tong, Y., & Su, S. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02457-5 · Cited by 60
“First, the proposed method was evaluated on datasets 2DMOT2015 [52], MOT16 [53], MOT17, and MOT20 from MOTChallenge, a multi-object tracking benchmark website.”
MethodSplit and Connect: A Universal Tracklet Booster for Multi-Object Tracking
Wang, G., Wang, Y., Gu, R., Hu, W., & Hwang, J. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3140919 · Cited by 59
“We employ ID F1 measure (IDF1) [33], multiple object tracking accuracy (MOTA), mostly tracked targets (MT), mostly lost targets (ML), fragments (FM) and identity switches (IDS) [32] as the evaluation metrics of the tracking performance, which are widely used in MOT.”
MethodSuper-High-Purity Seed Sorter Using Low-Latency Image-Recognition Based on Deep Learning
Heo, Y. J., Kim, S. J., Kim, D., Lee, K., & Chung, W. K. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2849513 · Cited by 59
“Standard metrics to evaluate the tracking performance are multiple object tracking precision (MOTP) and multiple object tracking accuracy (MOTC) [25], [26].”
BackgroundDEFT: Detection Embeddings for TrackingPreprint
Chaâbane, M. A., Zhang, P., Beveridge, J. R., & O′Hara, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.02267 · Cited by 103
“KITTI uses the same tracking metrics as the MOT Challenge benchmarks. nuScenes. nuScenes is a large-scale data set for autonomous driving. nuScenes is composed of 1000 sequences, with 700, 150, 150 sequences for train, validation, and testing, respectively.”
BackgroundMethodInfluentialWu, X., Tan, G., Zhu, N., Chen, Z., Yang, Y., Wen, H., & Li, K. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3084962 · Cited by 61
Iterative Scale-Up ExpansionIoU and Deep Features Association for Multi-Object Tracking in Sports
Huang, H.-W., Yang, C.-Y., Sun, J., Kim, P.-K., Kim, K., Lee, K., Huang, C., & Hwang, J. (2024) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw60836.2024.00024 · Cited by 66
“Different from MOT of pedestrian [20], MOT in sports scenarios is much more challenging due to several reasons including targets’ faster and irregular motions, similar appearance among players in the same team, and more severe occlusion problem due to the sport’s intense characteristic.”
BackgroundMethodInfluentialUniformity and deformation: A benchmark for multi-fish real-time tracking in the farming
Huang, J., Yu, X., An, D. U., Ning, X., Liu, J., & Tiwari, P. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125653 · Cited by 60
Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentation
Ke, L., Li, X., Danelljan, M., Tai, Y., Tang, C., & Yu, F. (2021) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000517118 · Cited by 61
A survey of detection-based video multi-object tracking
Dai, Y., Hu, Z., Zhang, S., & Liu, L. (2022) · Displays · doi:10.1016/j.displa.2022.102317 · Cited by 59
3DMOTFormer: Graph Transformer for Online 3D Multi-Object Tracking
Ding, S., Rehder, E., Schneider, L., Cordts, M., & Gall, J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00897 · Cited by 65
“MOTA, MOTP, IDS and FRAG from CLEAR MOT [5] and MT/ML from MOT Challenges [29, 11].”
MethodSimple Unsupervised Multi-Object TrackingPreprint
Karthik, S., Prabhu, A., & Gandhi, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02609 · Cited by 84
“Availability of labeled datasets[36,37] has alleviated the problem.”
BackgroundInfluentialMultimotion Visual Odometry (MVO): Simultaneous Estimation of Camera and Third-Party Motions
Judd, K. M., Gammell, J. D., & Newman, P. M. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594213 · Cited by 55
“The constituent aspects of the multimotion estimation problem are often referred to as multiple object tracking (MOT) [4] and multibody structure from motion (MBSfM) [5].”
BackgroundPlayer tracking and identification in ice hockey
Vats, K., Walters, P., Fani, M., Clausi, D. A., & Zelek, J. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119250 · Cited by 63
Tsai, C., Shen, G.-Y., & Nisar, H. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105770 · Cited by 54
MotionTrack: Learning motion predictor for multiple object tracking
Xiao, C., Cao, Q., Zhong, Y., Lan, L., Zhang, X., Luo, Z., & Tao, D. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106539 · Cited by 60
Variational Bayesian Inference for Audio-Visual Tracking of Multiple Speakers
Ban, Y., Alameda-Pineda, X., Laurent Girin, B., & Horaud, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2953020 · Cited by 54
“We used standard multi-object tracking metrics [42] to quantitatively evaluate the performance of the proposed tracking algorithm.”
The MTA Dataset for Multi Target Multi Camera Pedestrian Tracking by Weighted Distance Aggregation
Kohl, P., Specker, A., Schumann, A., & Beyerer, J. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00529 · Cited by 53
“Most existing tracking datasets focus on the multi target aspect but do not provide synchronized multi camera data [27, 14].”
BackgroundMOANA: An Online Learned Adaptive Appearance Model for Robust Multiple Object Tracking in 3D
Tang, Z., & Hwang, J. (2019) · IEEE Access · doi:10.1109/access.2019.2903121 · Cited by 53
“benchmark [20], [30], MOTChallenge 2015 3D is the only one dedicated for the evaluation of 3D tracking performance, in which all the videos are taken by static cameras, so that our camera self-calibration scheme can be applied.”
BackgroundVisual-LiDAR Based 3D Object Detection and Tracking for Embedded Systems
Sualeh, M., & Kim, G.-W. (2020) · IEEE Access · doi:10.1109/access.2020.3019187 · Cited by 57
“To evaluate the true potential and fair comparison with state-of-the-art systems, MODT is evaluated on the KITTI datasets with ground truths [44], based on the MOT16 evaluation metrics proposed in [41].”
MethodSoccerTrack: A Dataset and Tracking Algorithm for Soccer with Fish-eye and Drone Videos
Scott, A., Uchida, I., Onishi, M., Kameda, Y., Fukui, K., & Fujii, K. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00401 · Cited by 52
Online-Learning-Based Human Tracking Across Non-Overlapping Cameras
Lee, Y., Tang, Z., & Hwang, J. (2017) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2707399 · Cited by 52
“In [4], most of the state-of-the-art methods are in the tracking-by-detection school, in which they exploit the continuity in space and time, but the information of object appearance is seldom considered to facilitate tracking.”
BackgroundSimultaneous Detection and Tracking with Motion Modelling for Multiple Object Tracking
Sun, S., Akhtar, N., Song, X., Song, H., Mian, A. S., & Shah, M. A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58586-0_37 · Cited by 53
STEP: Segmenting and Tracking Every PixelPreprint
Weber, M., Xie, J., Collins, M. D., Zhu, Y., Voigtlaender, P., Adam, H., Green, B., Geiger, A., Leibe, B., Cremers, D., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.11859 · Cited by 59
“It became the standard in many tracking benchmarks [25, 46].”
BackgroundDo Different Tracking Tasks Require Different Appearance Models?
Wang, Z., Zhao, H., Li, Y., Wang, S., Torr, P. H. S., & Bertinetto, L. (2021) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.2107.02156 · Cited by 56
“Instead, in multiple object tracking settings (MOT [47], MOTS [69] and PoseTrack [1]), tracking means connecting sets of (often given) detections across video frames to address the problem of identity association and form trajectories.”
BackgroundMethodInfluentialMulti-object tracking with discriminant correlation filter based deep learning tracker
Yang, T., Cappelle, C., Ruichek, Y., & Bagdouri, M. E. (2019) · Integrated Computer-Aided Engineering · doi:10.3233/ica-180596 · Cited by 51
“Furthermore, we submit our method to the MOT17 benchmark [19].”
Snower, M., Kadav, A., Lai, F., & Graf, H. P. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00677 · Cited by 50
Customized Multi-person Tracker
Ma, L., Tang, S., Black, M. J., & Gool, L. V. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20890-5_39 · Cited by 49
“Following the MOT16 Benchmark, we apply the standard CLEAR MOT metrics [1].”
BackgroundMethodInfluentialConfTrack: Kalman Filter-based Multi-Person Tracking by Utilizing Confidence Score of Detection Box
Jung, H., Kang, S., Kim, T. K., & Kim, H. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00645 · Cited by 50
“To demonstrate the reliability of the proposed method, diverse domains of datasets are utilized for verification, including the MOT17, MOT20, DanceTrack, and HiEve dataset [10, 22, 26, 32].”
BackgroundMethodDynamic center point learning for multiple object tracking under Severe occlusions
Hu, Y., Niu, A., Sun, J., Zhu, Y., Yan, Q., Dong, W., Woźniak, M., & Zhang, Y. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112130 · Cited by 49
Real-Time Online Multi-Object Tracking in Compressed Domain
Liu, Q., Liu, B., Wu, Y., Li, W., & Yu, N. (2019) · IEEE Access · doi:10.1109/access.2019.2921975 · Cited by 49
“Performance-speed of some online trackers on MOT17 test split.”
MethodInfluentialSpatio-Temporal Point Process for Multiple Object Tracking
Wang, T., Chen, K., Lin, W., See, J., Zhang, Z., Xu, Q., & Jia, X. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2997006 · Cited by 48
“Our approach also produces the lowest FN on both MOT16/MOT17 and highest MT in MOT17 (second highest on MOT16), which shows that the proposed method can accurately associate the tracklets and the interpolation process is effectively in generating missing detections.”
BackgroundMethodInfluential1 st Workshop on Maritime Computer Vision (MaCVi) 2023: Challenge Results
Kiefer, B., Kristan, M., Perš, J., Žust, L., Poiesi, F., Andrade, F. A. A., Bernardino, A. J. M., Dawkins, M., Raitoharju, J., Quan, Y., et al. (2023) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw58289.2023.00033 · Cited by 54
“Compared to the pedestrian tracking task in MOT challenge [68], we decrease detection threshold from 0.7 to 0.6 and tracking threshold from 0.6 to 0.5 to adapt smaller and sparser objects.”
BackgroundMethodInfluentialTracking People by Detection Using CNN Features
Chahyati, D., Fanany, M. I., & Arymurthy, A. M. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.12.143 · Cited by 48
Learning Attentional Recurrent Neural Network for Visual Tracking
Wang, Q., Yuan, C., Wang, J., & Zeng, W. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2869277 · Cited by 48
Robust Privacy-Preserving Motion Detection and Object Tracking in Encrypted Streaming Video
Tian, X., Zheng, P., & Huang, J. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3128817 · Cited by 48
A Vehicle Counts by Class Framework using Distinguished Regions Tracking at Multiple Intersections
Bui, K. N., Yi, H., & Cho, J.-H. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00297 · Cited by 45
“Regarding the object tracking process, SORT [29] is the well-known method which was ranked as the best open-source on the multiple object tracking (MOT) benchmark [20].”
MethodDeep High-Resolution Representation Learning for Human Pose EstimationPreprint
Sun, K., Xiao, B., Liu, D., & Wang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.09212 · Cited by 81
“and multiperson pose tracking. Pose estimation is evaluated by the mean Average Precision (mAP) as done in [51,28]. Multiperson pose tracking is evaluated by the multi-object tracking accuracy (MOTA) [38,28]. Details are given in [28]. Training. We train our HRNet-W48 for single person pose estimation on the PoseTrack…”
MethodMultitarget Tracking Using Siamese Neural Networks
An, N., & Yan, W. Q. (2021) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3441656 · Cited by 47
“Additionally, for the tracking, we took advantage of our own dataset and the MOT16 dataset [56].”
MethodGMOT-40: A Benchmark for Generic Multiple Object Tracking
Bai, H., Cheng, W., Chu, P., Liu, J., Zhang, K., & Ling, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00665 · Cited by 46
“Later, MOT16 [40] was published with 14 sequences, devoted to people and vehicle tracking.”
BackgroundDeepSetNet: Predicting Sets with Deep Neural Networks
Rezatofighi, S. H., B. G., V. K., Milan, A., Abbasnejad, E., Dick, A., & Reid, I. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.561 · Cited by 45
“To this end, we perform experiments on two widely used datasets, Caltech Pedestrians [8] and MOT16 from the MOTChallenge benchmark [29].”
MethodSelf-citationA Sport Athlete Object Tracking Based on Deep Sort and Yolo V4 in Case of Camera Movement
Zhang, Y., Chen, Z., & Wei, B. (2020) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc51575.2020.9345010 · Cited by 45
“The Table 1 shows the result on MOT16 [8].”
BackgroundA Coding Framework and Benchmark Towards Low-Bitrate Video Understanding
Tian, Y., Lu, G. S., Yan, Y., Zhai, G., Chen, L., & Gao, Z. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3367879 · Cited by 45
“For the multiple object tracking (MOT) task, we use the MOT17 [122] and SFU-HW-Tracks-v1 [123] datasets.”
MethodAdvanced computer vision for extracting georeferenced vehicle trajectories from drone imagery
Fónod, R., Cho, H., Yeo, H., & Geroliminis, N. (2025) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2025.105205 · Cited by 55
“Newer multi-object tracking (MOT) algorithms, such as simple online and realtime tracking (SORT) [77], observation-centric SORT (OC-SORT) [78], ByteTrack [79], and “bag of tricks” SORT (BoT-SORT) [80], follow the “separate detection and tracking” paradigm.”
On the detection-to-track association for online multi-object tracking
Lin, X., Li, C., Sánchez, V., & Maple, C. R. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.03.022 · Cited by 45
“For the evaluation of tracking performance, we use three MOT benchmark datasets: 2D MOT15 [31], MOT16 [22], and MOT17 [22].”
InfluentialDeep Temporal Model-Based Identity-Aware Hand Detection for Space Human–Robot Interaction
Yu, J., Gao, H., Zhou, D., Liu, J., Gao, Q. H., & Ju, Z. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3114031 · Cited by 45
“…of trajectory prediction [22]; 2) a study on the detector in the MOT task is carried out, and a model, called POI, is proposed, including offline and online versions [23]; and 3) a large-scale dataset is collected, called the MOT Challenge, which is a benchmark for MOT performance evaluation [24].”
MethodTraffic-Informed Multi-Camera Sensing (TIMS) System Based on Vehicle Re-Identification
Yang, H., Cai, J., Zhu, M., Liu, C., & Wang, Y. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3154368 · Cited by 45
“The TrackletNet Tracker (TNT) network [6] is used for SCT due to the encouraging performance on MOT16 and MOT17 [35].”
MethodA Multi-Object Tracking Algorithm With Center-Based Feature Extraction and Occlusion Handling
Cao, Z., Li, J., Zhang, D., Zhou, M., & Abusorrah, A. M. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3229978 · Cited by 45
“We first use public benchmarks including MOT17 [31], KITTI [32], and COCO [33] for training and evaluating the performance of our proposed method.”
MethodCFTracker: Multi-Object Tracking With Cross-Frame Connections in Satellite Videos
Kong, L., Yan, Z., Zhang, Y., Diao, W., Zhu, Z., & Wang, L. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3278107 · Cited by 44
“For accuracy, we adopt the same MOT metrics set [28] as the MOTChallenge [29] and KITTI Tracking [30], including multi-object tracking accuracy (MOTA), multi-object tracking precision (MOTP), ID precision (IDP), ID recall (IDR), ID F1 score (IDF1), the number of false positives (FP), false…”
MethodMatching Anything by Segmenting Anything
Li, S., Ke, L., Danelljan, M., Piccinelli, L., Segù, M., Gool, L. V., & Yu, F. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01794 · Cited by 52
“However, current video datasets [6, 45, 71] contain only a limited range of fixed categories.”
BackgroundObject tracking and counting in a zone using YOLOv4, DeepSORT and TensorFlow
Kumar, S., Vishal, Sharma, P. R., & Pal, N. (2021) · International Conference on Artificial Intelligence and Smart Energy (ICAIS) · doi:10.1109/icais50930.2021.9395971 · Cited by 44
“The dataset is formulated by extending version of MOT16 [16] and MOT15 datasets [17], which has various image sequences including sequences with moving cameras shot from a bus, pedestrian scenes at night, people walking in large square etc. Evaluating Multi-Object Tracking causes some problems as: ● Datasets are chall…”
MethodVision and Trajectory–Based Dynamic Collision Prewarning Mechanism for Tower Cranes
Zhang, M., & Ge, S. (2022) · Journal of Construction Engineering and Management · doi:10.1061/(asce)co.1943-7862.0002309 · Cited by 46
Global Tracking via Ensemble of Local Trackers
Zhou, Z., Chen, J., Pei, W., Mao, K., Wang, H., & He, Z. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00856 · Cited by 44
“However, this Re-ID embedding is learned using only pedestrian datasets [11,28,38,45], limiting the generalization ability for tracking an arbitrary target object.”
Yao, F., Lu, W., Yang, H., Xu, L., Liu, C., Hu, L., Yu, H., Liu, N., Deng, C., Tang, D., et al. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3316166 · Cited by 51
“2) Dataset Introduction: As described in Section V-E2, the detection results are achieved on AIR-MOT [84]; after performing the association algorithm, we can obtain the values of corresponding tracking indicators using the original tracking annotations, whose format is similar to MOT benchmark [92].”
MethodLee, S.-H., Kim, M.-Y., & Bae, S. (2018) · IEEE Access · doi:10.1109/access.2018.2879535 · Cited by 42
“To evaluate our method, we use the 2016 and 2017 multiple object tracking (MOT16/17) challenge benchmark sets [35]”
MethodOnline Multi-Object Tracking With GMPHD Filter and Occlusion Group Management
Song, Y.-M., Yoon, K., Yoon, Y.-C., Yow, K., & Jeon, M. (2019) · IEEE Access · doi:10.1109/access.2019.2953276 · Cited by 41
“We evaluated the proposed tracking method on the MOT15 [5] and MOT17 [6] benchmarks.”
BackgroundMethodInfluentialMultiple Object Forecasting: Predicting Future Object Locations in Diverse Environments
Styles, O., Guha, T., & Sánchez, V. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093446 · Cited by 43
“In order to evaluate the generalizability of models trained on Citywalks, we use the popular MOT-17 dataset [28].”
BackgroundMethodInfluentialOneShotDA: Online Multi-Object Tracker With One-Shot-Learning-Based Data Association
Yoon, K., Gwak, J., Song, Y.-M., Yoon, Y.-C., & Jeon, M. (2020) · IEEE Access · doi:10.1109/access.2020.2975912 · Cited by 41
“To train the network, we generated training samples from the training sets in the MOTchallenge datasets [8].”
MethodInfluentialKhurana, T., Dave, A., & Ramanan, D. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00316 · Cited by 43
“We ask 10 in-house annotators to label fully occluded people in the MOT-17 [36] training set.”
InfluentialGCNNMatch: Graph Convolutional Neural Networks for Multi-Object Tracking via Sinkhorn NormalizationPreprint
Papakis, I., Sarkar, A., & Karpatne, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.00067 · Cited by 58
“After training the model, we apply our proposed model on the test set using the online evaluation server [25].”
BackgroundMethodInfluentialTarViS: A Unified Approach for Target-Based Video Segmentation
Athar, A., Hermans, A., Luiten, J., Ramanan, D., & Leibe, B. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01797 · Cited by 55
“Unlike TarViS, however, UNICORN follows the task-specific output head approach and is generally oriented towards box-level tracking tasks [22, 47, 49, 77], thus requiring non-trivial modifications to tackle VPS or PET.”
MethodThe Oxford Multimotion Dataset: Multiple SE(3) Motions With Ground Truth
Judd, K. M., & Gammell, J. D. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2892656 · Cited by 42
“motions using these chains of detections [12].”
VisDrone-MOT2019: The Vision Meets Drone Multiple Object Tracking Challenge Results
Wen, L., Zhu, P., Du, D., Bian, X., Ling, H., Hu, Q., Zheng, J., Peng, T., Wang, X., Zhang, Y., et al. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00028 · Cited by 45
“The ReID part of our model3 is trained on MOT16 [38], Market1501 [62], CUHK01 and CUHK03 [30] datasets.”
BackgroundMethodCai, J., & Cai, H. (2020) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000901 · Cited by 42
Su, J., He, X., Qing, L., Niu, T., Cheng, Y., & Peng, Y. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.102765 · Cited by 42
Computer Vision–Based Disruption Management for Prefabricated Building Construction Schedule
Yan, X., & Hong, Z. (2021) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000990 · Cited by 42
VisDrone-MOT2021: The Vision Meets Drone Multiple Object Tracking Challenge Results
Chen, G., Wang, W., He, Z., Wang, L., Yuan, Y., Zhang, D., Zhang, J., Zhu, P., Gool, L. V., Han, J., et al. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00318 · Cited by 42
“Although many benchmark datasets, such as UA-DETRAC [25, 26], KITTI [12], MOT20 [8, 18], TAO [7] and GMOT-40 [1], have been proposed and greatly advanced the field of MOT, most of them are only aware of tracking pedes-trians and vehicles, captured by surveillance or hand-hold cameras.”
BackgroundTowards Generalizable Multi-Object Tracking
Qin, Z., Wang, L., Zhou, S., Fu, P., Hua, G., & Tang, W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01797 · Cited by 47
“We analyze the datasets [8, 9, 33, 49, 58] commonly used in MOT based on these attributes, and find that these attributes vary drastically across different datasets.”
MethodAutomated daily report generation from construction videos using ChatGPT and computer vision
Xiao, B., Wang, Y., Zhang, Y., Chen, C., & Darko, A. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105874 · Cited by 50
A survey on leveraging deep neural networks for object tracking
Krebs, S., Duraisamy, B., & Flohr, F. B. (2017) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317904 · Cited by 40
“Starting in the early 1960’s with the development of aerospace applications the research field of modern object tracking has grown steadily [1], [2].”
BackgroundXiang, J., Zhang, G., & Hou, J. (2019) · IEEE Access · doi:10.1109/access.2019.2901520 · Cited by 41
“When faced with MOTChallenge benchmarks [16], [17], where more challenging scene is presented such like great appearance deformation, very low illumination and severe occlusions, the discriminability of the above representation learning methods is often limited due to their shallow representation models.”
BackgroundChu, Q., Ouyang, W., Liu, B., Zhu, F., & Yu, N. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6694 · Cited by 42
“We evaluate our online MOT algorithm on MOT16 and MOT17 benchmark datasets.”
MethodInfluentialVideo Object Segmentation and Tracking: A SurveyPreprint
Yao, R., Lin, G., Xia, S., Zhao, J., & Zhou, Y. Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.09172 · Cited by 41
“MOT 2016 (multiple object tracking) dataset [116] consists of 14 sequences with 11,000 frames which contain crowded scenarios, different viewpoints, camera and object motions and weather conditions.”
BackgroundLettuceTrack: Detection and tracking of lettuce for robotic precision spray in agriculture
Hu, N., Su, D., Wang, S., Nyamsuren, P., Qiao, Y., Jiang, Y. S., & Cai, Y. (2022) · Frontiers in Plant Science · doi:10.3389/fpls.2022.1003243 · Cited by 40
Kim, H.-S., Seong, J., & Jung, H. (2023) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-5238 · Cited by 40
Development of a N-type GM-PHD filter for multiple target, multiple type visual tracking
Baisa, N. L., & Wallace, A. M. (2019) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2019.01.026 · Cited by 36
End-to-End Face Detection and Cast Grouping in Movies Using Erdös-Rényi Clustering
Jin, S., Su, H., Stauffer, C., & Miller, E. G. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.564 · Cited by 40
“Some researchers have attempted to overcome this problem by providing a reference set of detections with suggested metrics [20], but this approach precludes optimizing complete system performance.”
BackgroundLearning Non-Uniform Hypergraph for Multi-Object Tracking
Wen, L., Du, D., Li, S., Bian, X., & Lyu, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018981 · Cited by 40
Joint Flow: Temporal Flow Fields for Multi Person TrackingPreprint
Doering, A., Iqbal, U., & Gall, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.04596 · Cited by 53
“To this extend, each model was trained for 40 epochs on the PoseTrack dataset [2] and we rely on the metrics proposed in [22] in order to measure pose tracking performance.”
MethodMOTFR: Multiple Object Tracking Based on Feature Recoding
Kong, J., Mo, E., Jiang, M., & Liu, T. (2022) · IEEE transactions on circuits and systems for video technology (Print) · doi:10.1109/tcsvt.2022.3182709 · Cited by 37
“We evaluate our model on three benchmark datasets: MOT16 [42], MOT17 and MOT20 [1].”
MethodBPMTrack: Multi-Object Tracking With Detection Box Application Pattern Mining
Gao, Y., Xu, H., Li, J., & Gao, X. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3364828 · Cited by 42
“The MOT task imposes requirements on the algorithm for stability prediction and long-distance identity preservation [52], [53].”
BackgroundMethodEchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Driving
Lin, J., Chen, J., Peng, K., He, X., Li, Z., Stiefelhagen, R., & Yang, K. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3437645 · Cited by 48
“Furthermore, we incorporate MOTA and IDF1 following the [6], [78], [79] to evaluate the effectiveness of AR-MOT.”
MethodMandal, M., & Vipparthi, S. K. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3030801 · Cited by 39
“More recent benchmark datasets for other video-based applications [53], [54] already ensure such scene independency in their evaluation schemes.”
BackgroundMulti-Target Multi-Camera Tracking With Optical-Based Pose Association
You, S., Yao, H., & Xu, C. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3036467 · Cited by 39
Metadata
- Authors
- Milan, A., Leal-Taixe, L., Reid, I., Roth, S., & Schindler, K.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1603.00831
- OpenAlex
- W2291627510
- Cited by
- 1,309
- References
- 47
- Citations by year
- 2026: 6 · 2025: 45 · 2024: 178 · 2023: 192 · 2022: 179 · 2021: 219 · 2020: 192 · 2019: 135 · 2018: 96 · 2017: 55 · 2016: 12
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- MOT16, multi-target tracking, benchmark, pedestrian tracking, video annotation, object visibility, evaluation protocol
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
