The DOI matches its DataCite record; 47 of the 47 references it cites were found in a registry or an index.
MOT16: A Benchmark for Multi-Object Tracking
Open accessAbstract
Standardized benchmarks are crucial for the majority of computer vision applications. Although leaderboards and ranking tables should not be over-claimed, benchmarks often provide the most objective measure of performance and are therefore important guides for reseach. Recently, a new benchmark for Multiple Object Tracking, MOTChallenge, was launched with the goal of collecting existing and new data and creating a framework for the standardized evaluation of multiple object tracking methods. The first release of the benchmark focuses on multiple people tracking, since pedestrians are by far the most studied object in the tracking community. This paper accompanies a new release of the MOTChallenge benchmark. Unlike the initial release, all videos of MOT16 have been carefully annotated following a consistent protocol. Moreover, it not only offers a significant increase in the number of labeled boxes, but also provides multiple object classes beside pedestrians and the level of visibility for every single object of interest.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“We evaluate TrackFormer on the MOT17 [30] and MOT20 [13] benchmarks where it achieves state-of-the-art performance for public and private detections.”
From TrackFormer: Multi-Object Tracking with Transformers (2022) · cites this paper as [30]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 2×
“Recently, the KITTI benchmark [19] was introduced for challenges in autonomous driving, which included stereo/flow, odometry, road and lane estimation, object detection and orientation estimation, as well as tracking.”
BackgroundObject Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853 · cited 1×
“Note that the deformable part-based model (DPM) v5 [15], [22] outperforms the other detectors in the task of pedestrian detection.”
BackgroundThe Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
Scharstein, D., & Szeliski, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014573219977 · Cited by 6,740 · cited 1×
“…past, the computer vision community has developed centralized benchmarks for numerous tasks including object detection [14], pedestrian detection [12], 3D reconstruction [39], optical flow [7], [19], visual odometry [19], single-object short-term tracking [26], and stereo estimation [19], [37].”
BackgroundLabeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,445
Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Bernardin, K., & Stiefelhagen, R. (2008) · EURASIP Journal on Image and Video Processing · doi:10.1155/2008/246309 · Cited by 2,918
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., & Szeliski, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.19 · Cited by 2,457 · cited 1×
“…past, the computer vision community has developed centralized benchmarks for numerous tasks including object detection [14], pedestrian detection [12], 3D reconstruction [39], optical flow [7], [19], visual odometry [19], single-object short-term tracking [26], and stereo estimation [19], [37].”
BackgroundTorralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440 · cited 1×
“[42]), they have proven to be extremely helpful to advance the state of the art in the respective area.”
BackgroundA Database and Evaluation Methodology for Optical Flow
Baker, S., Scharstein, D., Lewis, J. P., Roth, S., Black, M. J., & Szeliski, R. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0390-2 · Cited by 2,205 · cited 1×
“In the recent past, the computer vision community has developed centralized benchmarks for numerous tasks including object detection [14], pedestrian detection [12], 3D reconstruction [39], optical flow [7], [19], visual odometry [19], singleobject short-term tracking [26], and stereo estimation [19], [37].”
BackgroundSelf-citation
Research works printed but not linked: 3
- [2][2] [1st Workshop on Benchmarking Multi-Target Tracking, 2015. http: //www.igp.ethz.ch/photogrammetry/bmtt2015/home.html.](http://www.igp.ethz.ch/photogrammetry/bmtt2015/home.html) -
- [4][4] A. Alahi, V. Ramanathan, and L. Fei-Fei. Socially-aware largescale crowd forecasting. In CVPR , 2014. -
- [20][20] R. Girshick. Fast R-CNN. In ICCV 2015 , 2015. -
Cited by
Sorted by citations
Items 401–500 of 1,003
TinyNS: Platform-aware Neurosymbolic Auto Tiny Machine Learning
Saha, S. S., Sandha, S. S., Aggarwal, M., Wang, B., Han, L., Briseno, J. D. G., & Srivastava, M. B. (2023) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3603171 · Cited by 30
“We use the MOT17 dataset [113] for this case study.”
MethodInterpolation-Based Object Detection Using Motion Vectors for Embedded Real-time Tracking Systems
Ujiie, T., Hiromoto, M., & Sato, T. G. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00104 · Cited by 23
“We evaluate MVint with MOT16 [19], which is a benchmark for multiple object tracking.”
BackgroundMethodInfluentialSadiq, A. M., Ahn, H., & Choi, Y. B. (2020) · Sensors · doi:10.3390/s20247115 · Cited by 24
“We evaluate the performance of deep human count and tracking in disastrous related visual contents based on MOT16 (Moving Objects Tracking) [63] described as follows: • MOTA (Multi-object tracking accuracy) is the primary metric that summarizes cumulative detection accuracy in terms of false…”
MethodMulti-Object Tracking with Siamese Track-RCNNPreprint
Shuai, B., Berneshawi, A., Modolo, D., & Tighe, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.07786 · Cited by 24
“While Tracktor achieves state-of-the-art performance on the MOTChallenge [40], it suffers from two limitations: (i) it does not capture the appearance of the target object during tracking, which causes the model to become uncertain when the object is occluded or there are multiple of the same type…”
BackgroundInfluentialFusion detection and ReID embedding with hybrid attention for multi-object tracking
Chan, S., Qiu, C., Wu, D., Hu, J., Heidari, A. A., & Chen, H. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127328 · Cited by 23
Modeling social interaction and intention for pedestrian trajectory prediction
Chen, K., Song, X., & Ren, X. (2021) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2021.125790 · Cited by 23
Chen, C., Zhu, Z., Hammad, A., & Akbarzadeh, M. (2021) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000981 · Cited by 23
Deep Maximum a Posterior Estimator for Video Denoising
Sun, L., Dong, W., Li, X., Wu, J., Li, L., & Shi, G. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01510-7 · Cited by 23
“…the sRGB domain loss in Yue et al. (2020), and we follow the training setting in Yue et al. (2020) that first pretrain a denoiser using an additional MOT Challenge dataset (Milan et al. 2016) and then keep the predenoising network fixed when training the RViDeNet on the same CRVD training dataset.”
MethodViTT: Vision Transformer Tracker
Zhu, X., Jia, Y., Sun, J., Gu, L., & Zhang, P. (2021) · Sensors · doi:10.3390/s21165608 · Cited by 25
“We evaluated our model on MOT16 [42] benchmarks.”
BackgroundMethodInfluentialDrone-Based Position Detection in Sports—Validation and Applications
Russomanno, T. G., Blauberger, P., Kolbinger, O., Lam, H., Schmid, M., & Lames, M. (2022) · Frontiers in Physiology · doi:10.3389/fphys.2022.850512 · Cited by 23
“Figure 2 presents the block diagram of the tracking system, in which multiple object tracking was performed (Bewley et al., 2016; Milan et al., 2016).”
BackgroundSCTracker: Multi-Object Tracking With Shape and Confidence Constraints
Mao, H., Chen, Y., Li, Z., Chen, P., & Chen, F. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3339212 · Cited by 23
“To evaluate the performance of the proposed method, we use MOT 17 [17] as a unified benchmark dataset for experiments.”
MethodIntegrating Boxes and Masks: A Multi-Object Framework for Unified Visual Tracking and Segmentation
Xu, Y., Yang, Z., & Yang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00893 · Cited by 23
“In our context, we use visual object tracking (VOT) as a union of single object tracking (SOT) and multi-object VOT, preventing confusion with multi-object tracking (MOT) [56] which mainly considers object association between two detected object sets.”
BackgroundMethodMa, C., Wang, N., Chen, Q. A., & Shen, C. Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28200 · Cited by 23
Accurate Long-Term Multiple People Tracking Using Video and Body-Worn IMUs
Henschel, R. D., von Marcard, T., & Rosenhahn, B. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3013801 · Cited by 23
“FWT is among the top performing trackers of the MOT17 [22] benchmark, DeepSORT is an online tracker using a sophisticated motion model, and DeepCC focuses on re-identifying persons across different cameras.”
BackgroundMethodInfluentialA novel vehicle tracking and speed estimation with varying UAV altitude and video resolution
Chen, Y., Zhao, D., Er, M. J., Zhuang, Y., & Hu, H. (2021) · International Journal of Remote Sensing · doi:10.1080/01431161.2021.1895449 · Cited by 24
“To evaluate the algorithm after adding vehicle depth features, the indicators of multi-object tracking evaluation can be used (Milan et al. 2016 (FM) and ID Switch (IDSW).”
MethodSimilarity Mapping with Enhanced Siamese Network for Multi-Object TrackingPreprint
Kim, M., Alletto, S., & Rigazio, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.09156 · Cited by 30
“MOT16 [12] and KITTI tracking benchmarks [3] provide well established evaluation protocols with good quality annotations, and are widely used by researchers.”
BackgroundGraph Neural Based End-to-end Data Association Framework for Online Multiple-Object TrackingPreprint
Jiang, X., Li, P., Li, Y., & Zhen, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.05315 · Cited by 23
“In this section, we present our experimental results on 2D MOT 2015 [45] and MOT17 [49] benchmark datasets with ablation studies and comparisons with selected base-lines.”
MethodResultUniRTL: A universal RGBT and low-light benchmark for object tracking
Zhang, L., Wang, L., Wu, Y., Chen, M., Zheng, D., Cao, L., Zeng, B., & Cai, Y. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110984 · Cited by 24
NetTrack: Tracking Highly Dynamic Objects with a Net
Zheng, G., Lin, S., Zuo, H., Fu, C., & Pan, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01811 · Cited by 27
“Open-world multi-object tracking benchmarks Classical MOT benchmarks mainly focus on limited object categories and scenarios, where objects typically maintain stable appearances or poses and undergo relatively simple motion, e.g ., tracking pedestrian [9, 10, 30, 49] or vehicles [18, 60, 67].”
BackgroundAdvancing multi-object tracking through occlusion-awareness and trajectory optimization
Li, M., Zhang, Y., Jia, Y., & Yang, Y. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112930 · Cited by 24
Near-Online Multi-Pedestrian Tracking via Combining Multiple Consistent Appearance Cues
Feng, W., Lan, L., Luo, Y., Yu, Y., Zhang, X., & Luo, Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3005662 · Cited by 22
“Experimental results on challenging MOT16 and MOT17 benchmarks [35] demonstrate the effectiveness of the proposed”
BackgroundKong, L., Huang, D., & Wang, Y. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3009034 · Cited by 23
“During the last decade, along with the release of some major benchmarks, e.g. , PET [11], MOTChallenge [12], and UA-DETRAC [13], large progress has been made in MOT and many methods have been proposed.”
BackgroundMVmed: Fast Multi-Object Tracking in the Compressed Domain
Bommes, L., Lin, X., & Zhou, J. (2020) · IEEE Conference on Industrial Electronics and Applications (ICIEA) · doi:10.1109/iciea48937.2020.9248145 · Cited by 22
“We validate the effectiveness of our MVmed tracker on the MOT Challenge benchmark [27] and analyze its tracking performance for different codecs and frame types.”
MethodDeep Learning Video Analytics on Edge Computing Devices
Tan, T., & Cao, G. (2021) · IEEE International Conference on Sensing, Communication, and Networking (SECON) · doi:10.1109/secon52354.2021.9491614 · Cited by 22
“We use videos from the newest dataset in Multiple Object Tracking Benchmark (MOT) [24].”
MethodWhose Hands are These? Hand Detection and Hand-Body Association in the Wild
Narasimhaswamy, S., Nguyen, T., Huang, M., & Hoai, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00484 · Cited by 22
“To evaluate hand tracking performance, we use the standard multi-object-tracking evaluation metrics [4, 29]: False Positives (FP), False Negatives (FN), Identity Switches (IDs), and Multiple Object Tracking Accuracy (MOTA).”
MethodBrackishMOT: The Brackish Multi-Object Tracking Dataset
Pedersen, M., Lehotský, D., Nikolov, I. A., & Moeslund, T. B. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-31435-3_2 · Cited by 28
MF-SORT: Simple Online and Realtime Tracking with Motion Features
Fu, H., Wu, L., Jian, M., Yang, Y., & Wang, X. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-34120-6_13 · Cited by 22
Tracking Beyond Detection: Learning a Global Response Map for End-to-End Multi-Object Tracking
Wan, X., Cao, J., Zhou, S., Wang, J., & Zheng, N. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3113169 · Cited by 23
Multiple-Kernel Based Vehicle Tracking Using 3D Deformable Model and Camera Self-CalibrationPreprint
Tang, Z., Wang, G., Liu, T., Lee, Y., Jahn, A., Liu, X., He, X., & Hwang, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.06831 · Cited by 22
“The standard metrics used in MOT Challenge [1] are adopted to evaluate each method.”
BackgroundMethodInfluentialNeural Production Systems: Learning Rule-Governed Visual DynamicsPreprint
Goyal, A., Didolkar, A., Ke, N. R., Blundell, C., Beaudoin, P., Heess, N., Mozer, M. C., & Bengio, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.01937 · Cited by 24
“We use the same evaluation protocol as followed by Weis et al. (2020) which is based on the MOT (Multi-object tracking) challenge (Milan et al., 2016).”
MethodPerson Re-Identification for Robot Person Following With Online Continual Learning
Ye, H., Zhao, J., Zhan, Y., Chen, W., He, L., & Zhang, H. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3438042 · Cited by 22
“For our proposed ReID module, we use ResNet18 as our feature extractor, pre-trained on the MOT16 dataset [28].”
MethodTASM: A Tile-Based Storage Manager for Video Analytics
Daum, M., Haynes, B. M., He, D., Mazumdar, A., & Bałazińska, M. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00156 · Cited by 21
“All experiments populate the semantic index with object detections from YOLOv3 [36], except for the MOT16 videos where we use the detections from the dataset [32].”
MethodChen, K., Song, X., Yuan, H., & Ren, X. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3170874 · Cited by 21
AOH: Online Multiple Object Tracking With Adaptive Occlusion Handling
Jiang, M., Zhou, C., & Kong, J. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3191549 · Cited by 21
Siamese-DETR for Generic Multi-Object Tracking
Liu, Q., Li, Y., Jiang, Y., & Fu, Y. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3416880 · Cited by 22
Zhou, X.-H., Zhang, Y. J., Jiang, X., Riaz, K., Rosenbaum, P., Lefsrud, M. G., & Sun, S. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124587 · Cited by 21
LSTM Multiple Object Tracker Combining Multiple Cues
Liang, Y., & Zhou, Y. F. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451739 · Cited by 23
“MOT17 contains the same set of sequences as MOT16 with SDP [19], FasterRCNN [20] and DPM [21] detections.”
MethodInfluentialBlind Image Quality Prediction for Object Detection
Kong, L., Ikusan, A., Dai, R., & Zhu, J. (2019) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2019.00046 · Cited by 21
“Among them, 5 videos are chosen from the Multiple Object Tracking (MOT) dataset [13], and 5 videos are chosen from the Duke Multi-Target Multi-Camera Tracking (DM) dataset [16].”
MethodAdvances in Deep Learning Methods for Visual Tracking: Literature Review and Fundamentals
Zhang, X., Jiang, R.-H., Fan, C., Tong, T.-Y., Wang, T., & Huang, P. (2021) · Machine Intelligence Research · doi:10.1007/s11633-020-1274-8 · Cited by 22
Globally Consistent Multi-People Tracking using Motion PatternsPreprint
Maksai, A., Wang, X., Fleuret, F., & Fua, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00604 · Cited by 21
“In most state-of-the-art approaches [71, 21, 53, 77], this involves detecting people in each frame independently, grouping detections into short but reliable trajectory segments (tracklets), and then further grouping those into full trajectories.”
BackgroundLearning Human Optical FlowPreprint
Ranjan, A., Romero, J., & Black, M. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05666 · Cited by 21
“We use DPM [12] for detecting people and compute bounding box regions in two frames using the ground truth of the MOT16 dataset [32].”
MethodLocality Aware Appearance Metric for Multi-Target Multi-Camera TrackingPreprint
Hou, Y., Zheng, L., Wang, Z., & Wang, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.12037 · Cited by 24
“In MTMCT, the SCT step is inspired by multi-object tracking (MOT) [27, 33, 28].”
Improving Generative Imagination in Object-Centric World ModelsPreprint
Lin, Z., Wu, Y., Peri, S. V., Fu, B., Jiang, J., & Ahn, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02054 · Cited by 24
“For tracking, we report the Multi-Object Tracking Accuracy (MOTA) (Milan et al., 2016), with an IoU threshold of 0.5.”
MethodInfluentialMudassar, B. A., Ko, J. H., & Mukhopadhyay, S. (2018) · Proceedings of the 55th Annual Design Automation Conference · doi:10.1145/3195970.3196036 · Cited by 20
“We characterize the performance of our approach quantitatively on the MOT Multi-Object Tracking Dataset [8] and achieve an improvement of 5% in Average Precision for the Pedestrian Detection task while operating at a bandwidth of 2 Mbps.”
MethodDensePeds: Pedestrian Tracking in Dense Crowds Using Front-RVO and Sparse Features
Chandra, R., Bhattacharya, U., Bera, A., & Manocha, D. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968470 · Cited by 20
“For an up-to-date review of tracking-by-detection algorithms, we refer the reader to methods submitted to the MOT [8] benchmark.”
MethodInfluentialReidentification-Based Automated Matching for 3D Localization of Workers in Construction Sites
Zhang, Q., Wang, Z., Yang, B., Lei, K., Zhang, B., & Liu, B. (2021) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000975 · Cited by 20
Multiple Object Detection and Tracking in the Thermal Spectrum
Ahmar, W. E., Kolhatkar, D., Nowruzi, F. E., AlGhamdi, H., Hou, J., & Laganière, R. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00042 · Cited by 21
“Of the systems utilizing the tracking-by-detection paradigm, ByteTrack [25] has achieved state-of-the-art performance on the test data of the benchmark MOT17 dataset [16] with an MOTA of 80.”
MethodAn Object Point Set Inductive Tracker for Multi-Object Tracking and Segmentation
Gao, Y., Xu, H., Zheng, Y., Li, J., & Gao, X. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3203607 · Cited by 23
“a 2D JMT method FairMOT [45] in MOT17 [48].”
MethodTarget-referenced Reactive Grasping for Dynamic Objects
Liu, J., Zhang, R., Fang, H.-S., Gou, M., Fang, H., Wang, C., Xu, S., Yan, H., & Lu, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00852 · Cited by 20
“Evaluation Metric We propose a new Multiple Grasp Pose Tracking (MGTA) metric which follows the idea of Multiple Object Tracking Accuracy (MOTA) [21] in multi-object tracking task, except that the similarity measure between two grasps is computed using Eq.”
MethodZhao, Y., Luo, C., Tang, C., Chen, D., Codella, N., & Zha, Z.-J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01403 · Cited by 20
“For multiple object tracking, we use MOT17 [40] dataset for evaluation with additional data sources MOTSynth [15] and CrowdHuman [48].”
BackgroundMethodIndoor scene multi-object tracking based on region search and memory buffer pool
Li, Y., Yang, G., Su, Z., Li, S., Yang, J., & He, L. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111623 · Cited by 21
Realtime Multi-Diver Tracking and Re-identification for Underwater Human-Robot Collaboration
de Langis, K., & Sattar, J. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197308 · Cited by 20
“Most MOT research has focused on tracking pedestrians [1]–[3].”
BackgroundA Predictor of Moving Objects for First-Person Vision
Sánchez-Matilla, R., & Cavallaro, A. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803140 · Cited by 19
“We use three publicly available datasets: Multiple Object Tracking Benchmark 2015 (MOTB15 [26]), 2016 (MOTB16 [27]) and 2017 (MOTB17 [28]).”
MethodInteractive Labeling for Human Pose Estimation in Surveillance Videos
Cormier, M., Ropke, F., Golda, T., & Beyerer, J. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00190 · Cited by 19
“Due to the high cost of such highlevel annotation only few datasets provide bounding box annotations [11, 29], video instance segmentation [38] or Pose Tracking [1] with action recognition for surveillance videos [25] and remain comparatively small.”
BackgroundMultiple Object Tracking and Forecasting: Jointly Predicting Current and Future Object Locations
Kesa, O., Styles, O., & Sánchez, V. (2022) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw54805.2022.00062 · Cited by 20
“• We use PRW [49], MOT17 [24], and CalTech [10] to train the detection, re-ID, and trajectory forecast branches because these datasets provide both bounding box and identity annotations.”
MethodCompensation Tracker: Reprocessing Lost Object for Multi-Object Tracking
Zou, Z., Huang, J., & Luo, P. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00273 · Cited by 20
“We carry out extensive evaluations on MOT2015[26] dataset, MOT2016[31] dataset, MOT2017[31] dataset and the latest MOT2020[15] dataset.”
MethodAn embedded toolset for human activity monitoring in critical environments
Benedetto, M. D., Carrara, F., Ciampi, L., Falchi, F., Gennaro, C., & Amato, G. M. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117125 · Cited by 19
Mudassar, B. A., Ko, J. H., & Mukhopadhyay, S. (2018) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac.2018.8465862 · Cited by 19
Counting people inside a region-of-interest in CCTV footage with deep learning
Pardamean, B., Abid, F., Cenggoro, T. W., Elwirehardja, G. N., & Muljo, H. H. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.1067 · Cited by 21
“We used three datasets in this study, MOT17-09 ( Milan et al., 2016 ; Leal-Taixé et al., 2015 ; Ess, Leibe & Van Gool, 2007 ), MOT20-02 ( Dendorfer et al., 2020 ), and Room Human datasets which are originally used for object detection of people.”
MethodA Simple but Effective Method for Balancing Detection and Re-Identification in Multi-Object Tracking
Yang, P., Luo, X., & Sun, J. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3222614 · Cited by 19
“3) We compare the DPANet with several advanced models on two MOT challenges [13], i.e., MOT16 and MOT17.”
MethodTrackFlow: Multi-Object Tracking with Normalizing Flows
Mancusi, G., Panariello, A., Porrello, A., Fabbri, M., Calderara, S., & Cucchiara, R. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00874 · Cited by 21
“Extensive experiments on MOTSynth [25], MOT17 [57], and MOT20 [17] show that the naive cost metric – i.e ., the 2D intersection between predicted and candidate bounding boxes – can be replaced by the score provided by our approach, with a remarkable performance gain in exchange.”
MethodRethinking Joint Detection and Embedding for Multiobject Tracking in Multiscenario
Xu, L., & Huang, Y. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3366983 · Cited by 19
“These datasets include MOT17 [31] and MOT20 [32] for the surveillance scenario, KITTI [8] for the driving scenario, Vis-Drone2019 [9] for the drone scenario, and DanceTrack [33] for the sport scenario.”
BackgroundJoint detection and tracking in videos with identification features
Munjal, B., Aftab, A. R., Amin, S., Brandlmaier, M. D., Tombari, F., & Galasso, F. (2020) · Image and Vision Computing · doi:10.1016/j.imavis.2020.103932 · Cited by 19
“Of equal importance is tracking, which is often necessary to deal with dynamic scenes in the aforementioned application scenarios [2].”
BackgroundMethodInfluentialUsing synthetic data for person tracking under adverse weather conditions
Kerim, A., Çelikcan, U., Erdem, E., & Erdem, A. (2021) · Image and Vision Computing · doi:10.1016/j.imavis.2021.104187 · Cited by 19
“[13, 14, 15, 16] and synthetic (bottom-left quarter) [17, 18, 19, 11] visual object tracking datasets demonstrate the lack of adverse weather conditions.”
BackgroundMulti-Class Multi-Movement Vehicle Counting Based on CenterTrack
Kocur, V., & Ftáčnik, M. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00452 · Cited by 19
“Even though the principle behind the tracking mechanism is simple CenterTrack achieves state of the art perfomance on multi-object tracking benchmarks [8, 15].”
BackgroundMultiple Object Tracking with GRU Association and Kalman Prediction
Lit, Z., Cai, S., Wang, X., Shao, H., Niu, L., & Xue, N. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533828 · Cited by 19
“The MOTchallenge benchmark includes MOT2015, MOT2016 and MOT2017 [29].”
BackgroundMethodInfluentialMultiple People Tracking Using Hierarchical Deep Tracklet Re-identificationPreprint
Babaee, M., Athar, A., & Rigoll, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.04091 · Cited by 19
“The performance metrics for each video sequence in the MOT16 [40] test dataset are provided in Table 4.”
MethodAHOR: Online Multi-Object Tracking With Authenticity Hierarchizing and Occlusion Recovery
Jin, H., Nie, X., Yan, Y., Chen, X., Zhu, Z., & Qi, D. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3392939 · Cited by 19
“A. Experimental Settings 1) Datasets: We conduct comprehensive experiments on MOT17 [47] and MOT20 [48] datasets under the “private detection” protocol.”
MethodCascaded matching based on detection box area for multi-object tracking
Gu, S., Zhang, M., Xiao, Q., & Shi, W. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112075 · Cited by 18
A Multi Object Tracking Framework Based on YOLOv8s and Bytetrack Algorithm
Wang, Y., & Mariano, V. Y. (2024) · IEEE Access · doi:10.1109/access.2024.3450370 · Cited by 23
“In this paper, MOT17 [26] and MOT20 [27] data are selected as experimental data sets, and the experimental results demonstrate that the suggested framework has higher robustness and better precision when compared to the current multi-target tracking system.”
ResultZipfl, M., Fleck, T., Zofka, M. R., & Zöllner, J. M. (2020) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc45102.2020.9294539 · Cited by 18
“…to give a comprehensive summary of datasets, we just list some that are commonly applied in the automotive domain: The KITTI Vision Benchmark Suite [4] [5], nuScenes [6], Cityscapes [7], Berkeley DeepDrive [8] or the MOT Challenge datasets for multi target tracking in image data [9] [10] [11].”
MethodFast and Lightweight Human Pose Estimation
Ren, H., Wang, W., Zhang, K., Wei, D., Gao, Y., & Sun, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3069102 · Cited by 18
Pig Health Abnormality Detection Based on Behavior Patterns in Activity Periods using Deep Learning
Tran, D. D., & Thanh, N. D. (2023) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2023.0140564 · Cited by 18
“2) Tracking evaluation: The tracking performance metric used in our experiments is MOTA (Multi-Object Tracking Accuracy) [24].”
MethodPast Information Aggregation for Multi-Person Tracking
Stadler, D., & Beyerer, J. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10223159 · Cited by 18
“Our tracker is analyzed with ablative experiments and its competitiveness is shown on the MOT17 [9] and MOT20 [10] datasets, where state-of-the-art results are obtained.”
MethodMP2Net: Mask Propagation and Motion Prediction Network for Multiobject Tracking in Satellite Videos
Zhao, M., Li, S., Wang, H., Yang, J. B., Sun, Y., & Gu, Y. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3385406 · Cited by 18
“For evaluation, we use the MOT metrics [42], [43] to analyze tracking performance quantitively.”
MethodSea You Later: Metadata-Guided Long-Term Re-Identification for UAV-Based Multi-Object Tracking
Yang, C.-Y., Huang, H.-W., Jiang, Z., Kuo, H.-C., Mei, J., Huang, C., & Hwang, J. (2024) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw60836.2024.00093 · Cited by 19
“Several popular existing MOT datasets include MOT [19] and BDD [24].”
MethodWu, C.-W., Zhong, M.-T., Tsao, Y., Yang, S.-W., Chen, Y.-K., & Chien, S.-Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.184 · Cited by 18
“Illumination changes, view angle variation and object appearance inconsistency all contribute to making T-MCT much more difficult than SCT, a problem considerably improved over the past few years in the MOT challenge [12].”
BackgroundSelf-Supervised Multi-Object Tracking with Cross-Input ConsistencyPreprint
Bastani, F., He, S., & Madden, S. R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05943 · Cited by 18
“We use Multi-Object Tracking Accuracy (MOTA) [21] and ID F1 Score (IDF1) [22] on MOT17, and Higher Order Tracking Accuracy (HOTA) [19] for KITTI.”
BackgroundMethodFoundation Models for Video Understanding: A SurveyPreprint
Madan, N., Møgelmose, A., Modi, R., Rawat, Y. S., & Moeslund, T. B. (2024) · doi:10.36227/techrxiv.171769139.99464428/v1 · Cited by 24
Motion-guided and occlusion-aware multi-object tracking with hierarchical matching
Zheng, Y., Qi, H., Li, L., Li, S., Huang, Y., He, C., & Wang, D. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110369 · Cited by 18
Decision Controller for Object Tracking With Deep Reinforcement Learning
Zhong, Z., Yang, Z., Feng, W., Wu, W., Hu, Y., & Liu, C. (2019) · IEEE Access · doi:10.1109/access.2019.2900476 · Cited by 17
“We also compare our algorithm with trackers in MOT2016 challenge [43]: SMOT [48], DP_NMS [26], CEM [49], TBD [50], AMIR [51], STAM16 [27], and DMMOT [52].”
MethodEnd-to-end Learning Improves Static Object Geo-localization from Video
Chaâbane, M. A., Gueguen, L., Trabelsi, A., Beveridge, R., & O′Hara, S. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00211 · Cited by 23
“The “Multi-Traffic Lights Tracking” (MTLT) data provides a detection and annotation file for each video following the format of [18].”
BackgroundRank-Based Verification for Long-Term Face Tracking in Crowded Scenes
Barquero, G., Hupont, I., & Fernández, C. (2021) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2021.3099568 · Cited by 17
“Two of these metrics revisit and extend those commonly used in multi-object tracking, namely mismatch errors (number of ID switches produced across tracks) and track fragmentations [48].”
Tracking more than 100 arbitrary objects at 25 FPS through deep learning
Vaquero, L., Brea, V. M., & Mucientes, M. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108205 · Cited by 20
Yan, X., Zhang, H., & Gao, H. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104491 · Cited by 21
UMOTMA: Underwater multiple object tracking with memory aggregation
Hao, Z., Qiu, J., Zhang, H., Ren, G., & Liu, C. (2022) · Frontiers in Marine Science · doi:10.3389/fmars.2022.1071618 · Cited by 17
“The experimental results for the MOT17 datasets also showed that our method has a tracking accuracy comparable to other state-of-the-art MOT methods for pedestrian scenes.”
MethodInfluentialKnowledge Combination to Learn Rotated Detection without Rotated Annotation
Zhu, T., Ferenczi, B., Purkait, P., Drummond, T. W., Rezatofighi, H., & van den Hengel, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01489 · Cited by 17
“However, there are only a handful of datasets with rotated annotations [16,27,32] comparing to large number of readily available large-scale axis-aligned datasets [4,11,13,19].”
BackgroundGloudemans, D., Zachár, G., Wang, Y., Ji, J., Nice, M. W., Bunting, M., Barbour, W., Sprinkle, J. M., Piccoli, B., Monache, M. L. D., et al. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00447 · Cited by 17
“Much concerted work has been spent on multiple object tracking benchmarks in recent years, primarily from the perspective of pedestrian tracking in crowds [11, 35] or vehicle tracking from an AV perspective [8,16].”
BackgroundSystem-on-a-chip (SoC)-based hardware acceleration for foreground and background identification
Safaei, A., Wu, Q. M. J., & Yang, Y. (2017) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2017.07.037 · Cited by 17
Accounting for Room Acoustics in Audio-Visual Multi-Speaker Tracking
Ban, Y., Li, X., Alameda-Pineda, X., Laurent Girin, B., & Horaud, R. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462100 · Cited by 17
“We evaluate the performance of the proposed method using standard MOT (multi-object tracking) metrics [22]: MOT accuracy (MOTA), which combines false positives (FP), missed targets = false negative (FN), and identity switches (ID); the false alarm per frame (FAF); the tracking recall (Rcll) and tracking precision (Prc…”
MethodA Framework for Knowing Who is Doing What in Aerial Surveillance Videos
Yang, F., Sakti, S., Wu, Y., & Nakamura, S. (2019) · IEEE Access · doi:10.1109/access.2019.2924188 · Cited by 17
Robust Counting of Soft Fruit Through Occlusions with Re-identification
Kirk, R., Mangan, M., & Cielniak, G. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87156-7_17 · Cited by 17
Liu, C.-J., & Lin, T.-N. (2022) · IEEE Access · doi:10.1109/access.2022.3144153 · Cited by 17
“The MOT16 [8] tracking dataset contains pedestrian videos, the KITTI [9] autonomous driving dataset contains car view videos, and UA-DETRAC [10] contains traffic videos.”
BackgroundMethodInfluentialSDOF-Tracker: Fast and Accurate Multiple Human Tracking by Skipped-Detection and Optical-Flow
NISHIMURA, H., Komorita, S., Kawanishi, Y., & Murase, H. (2022) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2022edp7022 · Cited by 17
“Dataset: For the experiments, we used two major datasets, MOT17 [27] and MOT20 [28].”
MethodOnline relational tracking with camera motion suppression
Nasseri, M. H., Babaee, M., Moradi, H., & Hosseini, R. (2022) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2022.103750 · Cited by 20
Simple online and realtime tracking with spherical panoramic camera
Liu, K.-C., Shen, Y., & Chen, L. (2018) · International Conference on Consumer Electronics · doi:10.1109/icce.2018.8326132 · Cited by 17
“6) and carefully annotated by following a consistent protocol suggested in [4].”
BackgroundMethodInfluentialModel-Free Tracker for Multiple Objects Using Joint Appearance and Motion Inference
Liu, C., Yao, R., Rezatofighi, S. H., Reid, I. D., & Shi, Q. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2928123 · Cited by 17
“Please note that the proposed algorithm assumes the objects of interest are within the image throughout the whole sequence, which means targets initiation and termination in common MOT methods, such as [27], are not incorporated.”
InfluentialSelf-citationTowards Performance Clarity of Edge Video AnalyticsPreprint
Xiao, Z., Xia, Z., Zheng, H.-T., Zhao, B. Y., & Jiang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.08694 · Cited by 16
“5 hours of traffic videos from multiple sources: YouTube (32 long videos, 10-47 minutes each), Waymo [83] (5 hours), KITTI [42] (20 minutes), and MOT [70] (8 minutes).”
BackgroundInfluentialSaeedizadeh, N., Jalali, S. M. J., Khan, B., & Mohamed, S. M. K. (2025) · Expert Systems · doi:10.1111/exsy.70020 · Cited by 18
“After their first release, MOT15 (Leal-Taixé et al. 2015) and MOT16 (Milan et al. 2016) have all made significant contributions to benchmarking multi-object trackers by providing clean datasets and precise methodologies.”
Citywide reconstruction of cross-sectional traffic flow from moving camera videos
Kumar, A., Kashiyama, T., Maeda, H., & Sekimoto, Y. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671751 · Cited by 18
Metadata
- Authors
- Milan, A., Leal-Taixe, L., Reid, I., Roth, S., & Schindler, K.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1603.00831
- OpenAlex
- W2291627510
- Cited by
- 1,309
- References
- 47
- Citations by year
- 2026: 6 · 2025: 45 · 2024: 178 · 2023: 192 · 2022: 179 · 2021: 219 · 2020: 192 · 2019: 135 · 2018: 96 · 2017: 55 · 2016: 12
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- MOT16, multi-target tracking, benchmark, pedestrian tracking, video annotation, object visibility, evaluation protocol
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
