The DOI matches its DataCite record; 47 of the 47 references it cites were found in a registry or an index.
MOT16: A Benchmark for Multi-Object Tracking
Open accessAbstract
Standardized benchmarks are crucial for the majority of computer vision applications. Although leaderboards and ranking tables should not be over-claimed, benchmarks often provide the most objective measure of performance and are therefore important guides for reseach. Recently, a new benchmark for Multiple Object Tracking, MOTChallenge, was launched with the goal of collecting existing and new data and creating a framework for the standardized evaluation of multiple object tracking methods. The first release of the benchmark focuses on multiple people tracking, since pedestrians are by far the most studied object in the tracking community. This paper accompanies a new release of the MOTChallenge benchmark. Unlike the initial release, all videos of MOT16 have been carefully annotated following a consistent protocol. Moreover, it not only offers a significant increase in the number of labeled boxes, but also provides multiple object classes beside pedestrians and the level of visibility for every single object of interest.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“We evaluate TrackFormer on the MOT17 [30] and MOT20 [13] benchmarks where it achieves state-of-the-art performance for public and private detections.”
From TrackFormer: Multi-Object Tracking with Transformers (2022) · cites this paper as [30]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 2×
“Recently, the KITTI benchmark [19] was introduced for challenges in autonomous driving, which included stereo/flow, odometry, road and lane estimation, object detection and orientation estimation, as well as tracking.”
BackgroundObject Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853 · cited 1×
“Note that the deformable part-based model (DPM) v5 [15], [22] outperforms the other detectors in the task of pedestrian detection.”
BackgroundThe Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
Scharstein, D., & Szeliski, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014573219977 · Cited by 6,740 · cited 1×
“…past, the computer vision community has developed centralized benchmarks for numerous tasks including object detection [14], pedestrian detection [12], 3D reconstruction [39], optical flow [7], [19], visual odometry [19], single-object short-term tracking [26], and stereo estimation [19], [37].”
BackgroundLabeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,445
Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Bernardin, K., & Stiefelhagen, R. (2008) · EURASIP Journal on Image and Video Processing · doi:10.1155/2008/246309 · Cited by 2,918
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., & Szeliski, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.19 · Cited by 2,457 · cited 1×
“…past, the computer vision community has developed centralized benchmarks for numerous tasks including object detection [14], pedestrian detection [12], 3D reconstruction [39], optical flow [7], [19], visual odometry [19], single-object short-term tracking [26], and stereo estimation [19], [37].”
BackgroundTorralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440 · cited 1×
“[42]), they have proven to be extremely helpful to advance the state of the art in the respective area.”
BackgroundA Database and Evaluation Methodology for Optical Flow
Baker, S., Scharstein, D., Lewis, J. P., Roth, S., Black, M. J., & Szeliski, R. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0390-2 · Cited by 2,205 · cited 1×
“In the recent past, the computer vision community has developed centralized benchmarks for numerous tasks including object detection [14], pedestrian detection [12], 3D reconstruction [39], optical flow [7], [19], visual odometry [19], singleobject short-term tracking [26], and stereo estimation [19], [37].”
BackgroundSelf-citation
Research works printed but not linked: 3
- [2][2] [1st Workshop on Benchmarking Multi-Target Tracking, 2015. http: //www.igp.ethz.ch/photogrammetry/bmtt2015/home.html.](http://www.igp.ethz.ch/photogrammetry/bmtt2015/home.html) -
- [4][4] A. Alahi, V. Ramanathan, and L. Fei-Fei. Socially-aware largescale crowd forecasting. In CVPR , 2014. -
- [20][20] R. Girshick. Fast R-CNN. In ICCV 2015 , 2015. -
Cited by
Sorted by citations
Items 101–200 of 1,003
Learning a Proposal Classifier for Multiple Object Tracking
Dai, P., Weng, R., Choi, W., Zhang, C., He, Z., & Ding, W. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00247 · Cited by 132
“While for the final benchmark evaluation, we add the training sequences in MOT17 [37] and MOT20 [16] to finetune the ResNet50IBN model.”
MethodResultInfluentialMultiple Object Tracking With Attention to Appearance, Structure, Motion and Size
Karunasekera, H., Wang, H., & Zhang, H. (2019) · IEEE Access · doi:10.1109/access.2019.2932301 · Cited by 129
“The proposedmethod is compared with the best tracking frameworks in the KITTI [11] and MOT17 [10] benchmarks that are published and are vision based online multiple object tracking methods.”
BackgroundMethodMOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?
Fabbri, M., Brasó, G., Maugeri, G., Cetintas, O., Gasparini, R., Ošep, A., Calderara, S., Leal-Taixé, L., & Cucchiara, R. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01067 · Cited by 135
“Since the advent of deep learning, the community has been investigating how to effectively leverage neural networks [41, 45, 54, 69, 13, 65, 42, 25, 75, 6, 10, 78, 80, 38] to advance the field.”
BackgroundSpatio-temporal fall event detection in complex scenes using attention guided LSTM
Feng, Q., Gao, C., Wang, L., Zhao, Y., Song, T., & Li, Q. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.08.031 · Cited by 134
Monocular Quasi-Dense 3D Object Tracking
Hu, H.-N., Yang, Y.-H., Fischer, T., Darrell, T., Yu, F., & Sun, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3168781 · Cited by 140
“KITTI-D [3] and KAIST [94] are mainly detection datasets, while KITTI-T [3], MOT15 [95], MOT16 [2], and UA-DETRAC [1] are primarily 2D tracking benchmarks.”
BackgroundTPM: Multiple object tracking with tracklet-plane matching
Peng, J., Wang, T., Lin, W., Wang, J., See, J., Wen, S., & Ding, E. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107480 · Cited by 127
“We perform experiments on two benchmark datasets: MOT16 [28] and MOT17.”
A Unified Object Motion and Affinity Model for Online Multi-Object Tracking
Yin, J., Wang, W., Meng, Q., Yang, R., & Shen, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00680 · Cited by 127
TesseTrack: End-to-End Learnable Multi-Person Articulated 3D Pose Tracking
Reddy, N. D., Guigues, L., Pishchulin, L., Eledath, J., & Narasimhan, S. G. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01494 · Cited by 127
“Evaluation is performed on the Panoptic dataset using the proposed 3D MOTA metric.”
MethodInfluentialDeep-learning-based in-field citrus fruit detection and tracking
Zhang, W., Wang, J., Liu, Y., Chen, K., Li, H., Duan, Y., Wu, W., Shi, Y., & Guo, W. (2022) · Horticulture Research · doi:10.1093/hr/uhac003 · Cited by 127
“Although these methods have been validated in the MOT dataset [38] and have yielded satisfactory tracking results, they do not work well for fruit counting.”
Multi-Object Tracking in Satellite Videos With Graph-Based Multitask Modeling
He, Q., Sun, X., Yan, Z., Li, B., & Fu, K. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3152250 · Cited by 127
“Note that MOTA, IDF1, IDP, IDR, FP, FN, IDs, MT and ML are used to evaluate accuracy; Params, Multi-adds and FPS are used for efficiency.”
BackgroundMethodInfluentialUCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensation
Yi, K., Luo, K., Luo, X., Huang, J., Wu, H., Hu, R., & Hao, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28493 · Cited by 140
Heterogeneous Association Graph Fusion for Target Association in Multiple Object Tracking
Sheng, H., Zhang, Y., Chen, J., Xiong, Z., & Zhang, J. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2882192 · Cited by 123
“We test our tracking method on both the MOT Challenge 2016 [39] and 2017.”
MethodSimple Cues Lead to a Strong Multi-Object Tracker
Seidenschwarz, J., Brasó, G., Serrano, V. C., Elezi, I., & Leal-Taixé, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01327 · Cited by 133
“We evaluate our approach on the MOTChallenge benchmark [16], in particular, on the MOT17 [38] and MOT20 [17] datasets.”
MethodAutomated Individual Pig Localisation, Tracking and Behaviour Metric Extraction Using Deep Learning
Cowton, J., Kyriazakis, I., & Bacardit, J. (2019) · IEEE Access · doi:10.1109/access.2019.2933060 · Cited by 124
“We used the widely accepted metrics outlined in the 2016 MOT Challenge [24] in order to evaluate the performance of our tracker, implemented using the py-motmetrics library [25].”
BackgroundMethodDeep learning for multiple object tracking: a survey
Xu, Y., Zhou, X., Chen, S., & Li, F. (2019) · IET Computer Vision · doi:10.1049/iet-cvi.2018.5598 · Cited by 126
“The benchmarks for MOT challenge proposed by Milan et al. [84, 85] are widely used in state-of-the-art multi-object tracking methods [30–44, 87, 101].”
BackgroundMethodInfluentialGSM: Graph Similarity Model for Multi-Object Tracking
Liu, Q., Chu, Q., Liu, B., & Yu, N. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/74 · Cited by 123
“Third, we apply the proposed graph similarity model (GSM) to Tracktor [Bergmann et al. , 2019], the current state-of-the-art online MOT tracker, and achieve the best performance on MOT benchmarks [Milan et al. , 2016] in most metrics including MOTA and IDF1.”
MethodVDO-SLAM: A Visual Dynamic Object-aware SLAM SystemPreprint
Zhang, J., Henein, M., Mahony, R. E., & Ila, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.11052 · Cited by 165
“To incorporate such information in existing geometric SLAM algorithms, either a dataset of 3Dmodels of every object in the scene must be available a priori ([23], [25]) or the front end must explicitly provide object pose information in addition to detection and segmentation ([26]–[28]) adding a layer of complexity to…”
MethodA Systematic Review of Drone Based Road Traffic Monitoring System
Bisio, I., Garibotto, C., Haleem, H., Lavagetto, F., & Sciarrone, A. (2022) · IEEE Access · doi:10.1109/access.2022.3207282 · Cited by 139
“For MOT-a (no prior object detection results), AP-based evaluating metrics were employed [63], while con-448 cerning MOT-b, evaluating metrics from [64] were used (with prior detection results).”
MethodSupervised Raw Video Denoising With a Benchmark Dataset on Dynamic Scenes
Yue, H., Cao, C., Liao, L., Chu, R., & Yang, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00237 · Cited by 119
“We choose four videos from MOTChallenge dataset [25], which contains scene motion, camera motion, or both.”
MethodWang, K., Zhang, X., Qin, W., Li, X., Gao, J., Yang, L., Li, Z., Li, J., Zhu, L., Wang, H., et al. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3285651 · Cited by 136
“It establishes object associations in the network and considers both the appearance and loss of objects, achieving competitive results for the MOT16 dataset [34].”
BackgroundVision-Based Method Integrating Deep Learning Detection for Tracking Multiple Construction Machines
Xiao, B., & Kang, S.-C. (2020) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000957 · Cited by 121
Mandal, M., & Vipparthi, S. K. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3077883 · Cited by 121
Vision-Based Construction Worker Activity Analysis Informed by Body Posture
Roberts, D., Calderon, W. T., Tang, S., & Golparvar‐Fard, M. (2020) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000898 · Cited by 120
Dynamic SLAM: The Need For Speed
Henein, M., Zhang, J., Mahony, R. E., & Ila, V. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196895 · Cited by 108
“information in a geometric SLAM formulation then either a 3D-model of the object must be available [4], [5] or the front end must explicitly provide pose information in addition to detection and segmentation [6], [7], [8].”
MethodRobust Multi-Drone Multi-Target Tracking to Resolve Target Occlusion: A Benchmark
Liu, Z., Shang, Y., Li, T., Chen, G., Wang, Y., Hu, Q., & Zhu, P. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3234822 · Cited by 113
“Patrick Dendorfer et al. integrated MOT15 [20], MOT16 [15], MOT17 [15], and MOT20 [17] into MOTChallenge [21], which classifies all targets into 12 categories.”
BackgroundSecuring Augmented Reality Output
Lebeck, K., Ruth, K., Kohno, T., & Roesner, F. (2017) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp.2017.13 · Cited by 110
“, [9, 22, 31]), and to support controlled experiments, we abstract away the input handling part of Arya for our prototype.”
MethodTracking Pedestrian Heads in Dense Crowd
Sundararaman, R., Braga, C. D. A., Marchand, É., & Pettré, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00386 · Cited by 120
“Standardization of MOT benchmarks were later proposed in [40] and since then, it has been updated with yearly challenges involving more complex scenarios and increasingly crowded environments [13, 45].”
BackgroundMethodInfluentialSemantics for Robotic Mapping, Perception and Interaction: A Survey
Garg, S., Sünderhauf, N., Dayoub, F., Morrison, D., Cosgun, A., Carneiro, G., Wu, Q., Chin, T.-J., Reid, I. D., Gould, S. J., et al. (2020) · Foundations and Trends in Robotics · doi:10.1561/2300000059 · Cited by 122
Self-citationPedestrian Trajectory Prediction in Pedestrian-Vehicle Mixed Environments: A Systematic Review
Golchoubian, M., Ghafurian, M., Dautenhahn, K., & Azad, N. L. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3291196 · Cited by 108
“RounD [92] [45] Bird’s-eye view Three Roundabouts in Germany Cars, Trucks, Vans, Trailers, Buses Pedestrians, Bicycle, Motorcycles MOT16/17/20 [93] [37], [41] Ego-entric / Bird’s-eye view Unconstrained environments including Pedestrian street and urban intersection Pedestrians, Cars, Bicycles, Motorbike, Non-motorized…”
BackgroundLong-Term Tracking With Deep Tracklet Association
Zhang, Y., Sheng, H., Wu, Y., Wang, S., Lyu, W., Ke, W., & Xiong, Z. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2993073 · Cited by 108
“We evaluate our tracker on MOT 2017 [53] which is the latest public benchmark for MOT.”
MethodAlameer, A., Kyriazakis, I., & Bacardit, J. (2020) · Scientific Reports · doi:10.1038/s41598-020-70688-6 · Cited by 119
Iterative Multiple Hypothesis Tracking With Tracklet-Level Association
Sheng, H., Chen, J., Zhang, Y., Ke, W., Xiong, Z., & Jingyi Yu, A. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2881123 · Cited by 108
“against published trackers, we used the public object detection responses on the MOT16 and MOT17 benchmarks [31].”
BackgroundMethodMulti-Level Cooperative Fusion of GM-PHD Filters for Online Multiple Human Tracking
Fu, Z., Angelini, F., Chambers, J. A., & Naqvi, S. M. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2902480 · Cited by 106
“The MOT16 Challenge [48], consists of 7 training and 7 testing fully annotated video sequences, as well as providing public object detections”
BackgroundMethodInfluentialModelling Ambiguous Assignments for Multi-Person Tracking in Crowds
Stadler, D., & Beyerer, J. (2022) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw54805.2022.00019 · Cited by 106
“The MOT17 dataset [27] comprises 14 diverse sequences for multi-person tracking, 7 for training and testing each, including videos with both static as well as moving cameras.”
BackgroundProbabilistic Tracklet Scoring and Inpainting for Multiple Object Tracking
Saleh, F. S., Aliakbarian, S., Rezatofighi, H., Salzmann, M., & Gould, S. J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01410 · Cited by 104
“We report our results on the three benchmarks of this challenge, MOT16 [40], MOT17 [40], and the recently introduced MOT20 [13].”
MethodResultInfluentialEdge Video Analytics: A Survey on Applications, Systems and Enabling Techniques
Xu, R., Razavi, S., & Zheng, R. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3323091 · Cited by 115
“Several variants were released each year, including MOT15 [264], MOT16 [265], MOT17 [265], MOT20 [266].”
BackgroundStanojevic, V. D., & Todorović, B. T. (2024) · Machine Vision and Applications · doi:10.1007/s00138-024-01531-5 · Cited by 108
“WeusestandardMOTbenchmarkdatasets,MOT17 [41] and MOT20 [14], to conduct experiments.”
JRMOT: A Real-Time 3D Multi-Object Tracker and a New Large-Scale Dataset
Shenoi, A., Patel, M., Gwak, J., Goebel, P., Sadeghian, A., Rezatofighi, H., Martín-Martín, R., & Savarese, S. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341635 · Cited by 104
“supported by multiple 2D annotated video datasets [10], [11], [12], [13] and boosted by popular 2D tracking challenges, e.”
MethodGraph Networks for Multiple Object Tracking
Li, J., Gao, X., & Jiang, T. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093347 · Cited by 101
“Specifically, MOT16 [28] and MOT17 are the most popular benchmarks in MOTChallenge.”
BackgroundInfluentialSMILEtrack: SiMIlarity LEarning for Occlusion-Aware Multiple Object Tracking
Wang, Y.-H., Hsieh, J.-W., Chen, P.-Y., Chang, M., So, H.-H., & Li, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i6.28386 · Cited by 120
“Table 4 shows the effects of different patch layouts on performance improvements evaluated on the MOT17 val set [21].”
BackgroundMethodInfluentialMa, C., Yang, C., Yang, F., Zhuang, Y., Zhang, Z., Jia, H., & Xie, X. (2018) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2018.8486454 · Cited by 103
Real-time multiple object tracking using deep learning methods
Meimetis, D., Daramouskas, I., Perikos, I., & Hatzilygeroudis, I. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06391-y · Cited by 106
“The MOT16 [21] is a widely used dataset for object tracking procedures.”
Method2D Pose-Based Real-Time Human Action Recognition With Occlusion-Handling
Angelini, F., Fu, Z., Long, Y., Shao, L., & Naqvi, S. M. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2944745 · Cited by 99
“8-(b) also shows the performance on a famous dataset for tracking in public environments, i.e. MOT16 [40], and other traditional datasets, i.e. KTH [41], IXMAS [42], Weizmann [43] and i3DPost [44].”
BackgroundMultiplex Labeling Graph for Near-Online Tracking in Crowded Scenes
Zhang, Y., Sheng, H., Wu, Y., Wang, S., Ke, W., & Xiong, Z. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2996609 · Cited by 100
“We evaluate our tracker on MOT16 [9] and MOT17, which is the popular benchmarks for MOT.”
BackgroundMethodLi, Y., Yabuki, N., & Fukuda, T. (2022) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2022.104603 · Cited by 105
ReMOT: A model-agnostic refinement for multiple object tracking
Yang, F., Chang, X., Sakti, S., Wu, Y., & Nakamura, S. (2020) · Image and Vision Computing · doi:10.1016/j.imavis.2020.104091 · Cited by 99
“To evaluate the effective-ness of reducing Mix-up Errors and Cut-off Errors, we use metrics MOTA (MOT accuracy), IDF1 (ratio of correctly identified detections), MT (mostly tracked targets), ML (mostly lost targets), and ID Switches, which are defined in [17, 24].”
MethodJoint Graph Decomposition & Node Labeling: Problem, Algorithms, Applications
Levinkov, E., Uhrig, J., Tang, S., Omran, M., Insafutdinov, E., Kirillov, A., Rother, C., Brox, T., Schiele, B., & Andres, B. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.206 · Cited by 99
“We compare the feasible solutions output by KLj/r and KLj∗r to the state-of-the-art for the benchmark [21].”
MethodPANDA: A Gigapixel-Level Human-Centric Video Dataset
Wang, X., Zhang, X., Zhu, Y., Guo, Y., Yuan, X., Xiang, L., Wang, Z., Ding, G., Brady, D. J., Dai, Q., et al. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00333 · Cited by 107
Online Multi-Object Tracking Using Joint Domain Information in Traffic Scenarios
Tian, W., Lauer, M., & Chen, L. F. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2892413 · Cited by 97
“three challenging benchmarks: KITTI [23], MOT16 [6] and”
BackgroundInfluentialOnline multi-person tracking using Integral Channel Features
Kieritz, H., Becker, S., Hübner, W., & Arens, M. (2016) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2016.7738059 · Cited by 96
“Because the tracking performance of a multi-object tracker is highly dependent on the quality of the detection, we report the performance on MOT15 [17] and MOT16 [18] test set (see table 5 and 6) using the provided detections for comparability.”
MethodResultNon-Markovian Globally Consistent Multi-object Tracking
Maksai, A., Wang, X., Fleuret, F., & Fua, P. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.278 · Cited by 94
“Furthermore, unlike Id-Aware metrics [94, 10], it does not require knowing the true identity of the objects being tracked, making it more widely applicable.”
BackgroundDynamic Multi-LiDAR Based Multiple Object Detection and Tracking
Sualeh, M., & Kim, G.-W. (2019) · Sensors · doi:10.3390/s19061474 · Cited by 99
“The key operation of JPDAF is the definition of marginal events θ j , q and evaluation of corresponding conditional joint probabilities.”
BackgroundMultiple People Tracking Using Body and Joint Detections
Henschel, R. D., Zou, Y., & Rosenhahn, B. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00105 · Cited by 96
“Then, we evaluate the tracking performance using the state-of-theart MOT17 benchmark [25].”
MethodResultNeedles in a Haystack: Tracking City-Scale Moving Vehicles From Continuously Moving Satellite
Ao, W., Fu, Y., Hou, X., & Xu, F. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2944097 · Cited by 96
“MOTP: Multiple object tracking precision (MOTP) is adopted to measure the positioning precision of the detecting algorithms, which can be written as [25], [31], [32]”
BackgroundMethodOvercoming Occlusion in the Automotive Environment—A Review
Gilroy, S., Jones, E., & Glavin, M. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2956813 · Cited by 96
“The KITTI [12], KAIST [94] and Multi Object Tracking (MOT) [95] datasets also contain occlusion-specific annotation of cyclists.”
BackgroundFocus On Details: Online Multi-Object Tracking with Diverse Fine-Grained Representation
Ren, H., Han, S., Ding, H., Zhang, Z., Wang, H., & Wang, F. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01086 · Cited by 97
“Since the MOT Challenge does not provide validation sets, we split the MOT17 dataset into two parts.”
MethodInfluentialUTM: A Unified Multiple Object Tracking Model with Identity-Aware Feature Enhancement
You, S., Yao, H., Bao, B., & Xu, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02095 · Cited by 94
“We conduct all the experiments on three MOT benchmarks, e.g. , MOT16 [31], MOT17 [31], and MOT20 [9].”
MethodOn-Road Object Detection and Tracking Based on Radar and Vision Fusion: A Review
Tang, X., Zhang, Z., & Qin, Y. (2021) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2021.3093379 · Cited by 100
Cross-View Tracking for Multi-Human 3D Pose Estimation at Over 100 FPS
Chen, L., Ai, H., Chen, R., Zhuang, Z., & Liu, S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00334 · Cited by 93
“Particularly, we project the estimated 3D poses onto each camera and follow the same evaluation protocol as MOTChallenge [24].”
MethodDeep Alignment Network Based Multi-Person Tracking With Occlusion and Motion Reasoning
Zhou, Q., Zhong, B., Zhang, Y., Li, J., & Fu, Y. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2875360 · Cited by 92
“MOT16 dataset: The MOT16 dataset [41] contains seven training and testing video sequences, respectively.”
BackgroundMethodInfluentialA Multimodality Fusion Deep Neural Network and Safety Test Strategy for Intelligent Vehicles
Nie, J., Yan, J., Yin, H., Ren, L., & Meng, Q. (2020) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2020.3027319 · Cited by 94
“Model-based approach such as joint probabilistic data association (JPDA) [9], multi-hypothesis trackers (MHT) [10] and Unscented Kalman Filter (UKF) [11] have been the typical methods for data association and object positioning.”
MethodXiao, B., Xiao, H., Wang, J., & Chen, Y. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104148 · Cited by 92
SpaceNet MVOI: A Multi-View Overhead Imagery Dataset
Weir, N., Lindenbaum, D., Bastidas, A., Etten, A., Kumar, V., Mcpherson, S., Shermeyer, J., & Tang, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00108 · Cited by 95
“PASCAL3D [34], autonomous driving datasets such as KITTI [14], CityScapes [7], existing multi-view datasets [29, 30], and tracking datasets such as MOT2017[24] or OBT [36] contains different views, but they are confined to a narrow range of angles, lack sufficient heterogeneity to test generalization between views, and…”
UA-DETRAC 2017: Report of AVSS2017 & IWT4S Challenge on Advanced Traffic Monitoring
Lyu, S., Chang, M., Du, D., Wen, L., Qi, H., Li, Y., Wei, Y., Ke, L., Hu, T., Coco, M. D., et al. (2017) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2017.8078560 · Cited by 95
“, PETS2009 [18], MOT15 [25], and MOT16 [28]).”
SPOT Poachers in Action: Augmenting Conservation Drones With Automatic Detection in Near Real Time
Bondi, E., Fang, F., Hamilton, M., Kar, D., Dmello, D., Choi, J., Hannaford, R., Iyer, A., Joppa, L., Tambe, M., et al. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11414 · Cited by 89
“More complex algorithms to track moving objects throughout videos rely on high resolution, visible spectrum videos or videos taken from a fixed camera (Kristan et al. 2015; Milan et al. 2016).”
BackgroundCrowd-SLAM: Visual SLAM Towards Crowded Environments using Object Detection
Soares, J. C. V., Gattass, M., & Meggiolaro, M. A. (2021) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-021-01414-1 · Cited by 89
“The Multiple Object Tracking (MOT) Challenge dataset [38, 41] is used to evaluate the improvements of the newly trained network in crowded environments.”
MethodSatSOT: A Benchmark Dataset for Satellite Video Single Object Tracking
Zhao, M., Li, S., Xuan, S., Kou, L., Gong, S., & Zhou, Z. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3140809 · Cited by 94
“According to the number of targets, object tracking includes single object tracking and multiobject tracking [5], [24].”
BackgroundDiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Prediction
Lv, W., Huang, Y., Zhang, N., Lin, R.-S., Han, M., & Zeng, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01828 · Cited by 104
“These aforementioned approaches mainly focus on the pedestrian-dominant MOT17 [22] dataset whose objects possess linear motion patterns in terms of a constant-speed and mono-direction.”
BackgroundZhou, H., Ouyang, W., Cheng, J., Wang, X., & Li, H. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2825679 · Cited by 84
“We conduct experiments on the 2DMOT15 [29] and 2DMOT16 [28] benchmarks, which are widely used to evaluate the performance of MOT methods.”
MethodPTP: Parallelized Tracking and Prediction With Graph Neural Networks and Diversity Sampling
Weng, X., Yuan, Y., & Kitani, K. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3068925 · Cited by 96
“We do not evaluate on 2D MOT datasets such as MOTChallenges [58] as they do not provide LiDAR data or 3D bounding box ground truth and are thus not directly applicable to our method.”
MethodDiscriminative Appearance Modeling with Multi-track Pooling for Real-time Multi-object Tracking
Kim, C., Li, F., Alotaibi, M. B., & Rehg, J. M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00943 · Cited by 89
“We explain the method that generates our training data consisting of both actual multi-object tracking episodes and random tracking episodes from public multi-object tracking datasets [20, 26] and then present our choice of loss function.”
MethodInteracting Tracklets for Multi-Object Tracking
Lan, L., Wang, X., Zhang, S. S., Tao, D., Gao, W., & Huang, T. S. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2843129 · Cited by 86
“We use the PETS09 [1] and the MOT16 dataset [29], the two most popular and challenging MOT datasets for validation, and compare our results with those of the stateof-the-art trackers.”
MethodYoon, Y.-C., Boragule, A., Song, Y.-M., Yoon, K., & Jeon, M. (2018) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639078 · Cited by 83
Online Multiple Object Tracking with Cross-Task Synergy
Guo, S., Wang, J., Wang, X., & Tao, D. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00804 · Cited by 81
“Compared with DeepMOT [57] that also employed an integrated identity embedding optimization, we have lower IDS on both MOT16 and MOT17 with much higher IDF1 on both datasets.”
MethodInfluentialMulti-Object Tracking with Multiple Cues and Switcher-Aware ClassificationPreprint
Feng, W., Hu, Z., Wu, W., Yan, J., & Ouyang, W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.06129 · Cited by 95
“Extensive experimental results on both MOT16 and MOT17 benchmarks[26] clearly show the effectiveness of the proposed framework.”
BackgroundMethodLearning Multi-Object Tracking and Segmentation From Automatic Annotations
Porzi, L., Hofinger, M., Ruiz, I., Serrat, J., Bulo, S. R., & Kontschieder, P. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00688 · Cited by 82
Learnable Online Graph Representations for 3D Multi-Object Tracking
Zaech, J.-N., Liniger, A., Dai, D., Danelljan, M., & Gool, L. V. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3145952 · Cited by 93
VisDrone-VDT2018: The Vision Meets Drone Video Detection and Tracking Challenge Results
Zhu, P., Wen, L., Du, D., Bian, X., Ling, H., Hu, Q., Wu, H., Nie, Q., Cheng, H., Liu, C., et al. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11021-5_29 · Cited by 80
“For the MOT-b task, we follow the evaluation protocol of [32] to evaluate the performance of the submitted algorithms.”
MethodLooking Beyond Two Frames: End-to-End Multi-Object Tracking Using Spatial and Temporal Transformers
Zhu, T., Hiller, M., Ehsanpour, M., Ma, R., Drummond, T. W., Reid, I. D., & Rezatofighi, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3213073 · Cited by 82
“We evaluate MO3TR on the challenging MOT16 and MOT17 benchmark test datasets [70] using the provided public detections and report our results in Tables 1 and 2, respectively.”
MethodSelf-citationZhang, S., Abdel-Aty, M. A., Cai, Q., Li, P., & Ugan, J. (2020) · Accident Analysis & Prevention · doi:10.1016/j.aap.2020.105799 · Cited by 86
Recent trends in crowd analysis: A review
Bendali-Braham, M., Weber, J., Forestier, G., Idoumghar, L., & Müller, P.-A. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100023 · Cited by 86
CAMEL Dataset for Visual and Thermal Infrared Multiple Object Detection and Tracking
Gebhardt, E., & Wolf, M. (2018) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639094 · Cited by 77
“Imagenet exists for the purpose of visual object recognition [8], MS COCO provides a benchmark for object detection, instance segmentation, and keypoint analysis [15], and MOT challenge for visible object detection and multiple object tracking [14, 18].”
Deep Learning Methods for Multi-Species Animal Re-identification and Tracking – a Survey
Ravoor, P. C., & Sudarshan, T. S. B. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100289 · Cited by 80
Detection Recovery in Online Multi-Object Tracking with Sparse Graph Tracker
Hyun, J., Kang, M., Wee, D., & Yeung, D. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00483 · Cited by 78
“We train and evaluate the proposed method using MOT16/17/20 and HiEve Challenge datasets [27, 10, 25]”
MethodParticle PHD Filter Based Multiple Human Tracking Using Online Group-Structured Dictionary Learning
Fu, Z., Feng, P., Angelini, F., Chambers, J. A., & Naqvi, S. M. (2018) · IEEE Access · doi:10.1109/access.2018.2816805 · Cited by 76
“In this section, we test the proposed method denoted by PHD-GSDL on the test set of the 2D MOTChallenge 2015 Benchmark [48] and MOT17 Challenge [1].”
MethodInfluentialFast Video Object Segmentation With Temporal Aggregation Network and Dynamic Template Matching
Huang, X., Xu, J., Tai, Y., & Tang, C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00890 · Cited by 76
Xiao, B., Lin, Q., & Chen, Y. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103721 · Cited by 66
Wang, G., Gu, R., Liu, Z., Hu, W., Song, M., & Hwang, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00973 · Cited by 76
“The metrics include Higher Order Tracking Accuracy (HOTA) [34], Association Accuracy (AssA), Multiple Object Tracking Accuracy (MOTA) [36], ID F1 score (IDF1), Multiple Object Tracking Precision (MOTP) [36], the number of ID Switches (IDS), the percentage of Mostly Tracked targets (MT), the percentage of Mostly Lost t…”
BackgroundTemporally Identity-Aware SSD With Attentional LSTM
Chen, X., Yu, J., & Wu, Z. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2894261 · Cited by 79
“In addition, another three video sequences in MOT17Det [42] dataset are employed for training.”
MethodEnhanced camera-based individual pig detection and tracking for smart pig farms
Guo, Q., Sun, Y., Orsini, C., Bolhuis, J. E., de Vlieg, J., Bijma, P., & de With, P. H. N. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.108009 · Cited by 77
DiffusionTrack: Diffusion Model for Multi-Object Tracking
Luo, R., Song, Z., Ma, L., Wei, J., Yang, W., & Yang, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28192 · Cited by 90
Computer Vision – ECCV 2016 Workshops
Lee, B., Erdenee, E., Jin, S., & Rhee, P. K. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48881-3 · Cited by 79
Multiple Object Tracking via Feature Pyramid Siamese Networks
Lee, S., & Kim, E. (2018) · IEEE Access · doi:10.1109/access.2018.2889442 · Cited by 71
“8188 VOLUME 7, 2019 The MOT17 dataset is the latest to be released since MOTChallenge published the 2D MOT 2015 dataset [55].”
MethodInfluentialMarkerless tracking of an entire honey bee colony
Bożek, K., Hebert, L., Portugal, Y., Mikheyev, A. S., & Stephens, G. J. (2021) · Nature Communications · doi:10.1038/s41467-021-21769-1 · Cited by 70
“However, most existing solutions and benchmark datasets for multi-object tracking as well as for posture and activity recognition, are dedicated to human behavior and crowds 30 – 34 .”
BackgroundEnd-to-End Learning Deep CRF Models for Multi-Object Tracking Deep CRF Models
Xiang, J., Xu, G., Ma, C., & Hou, J. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2975842 · Cited by 78
“We follow the standard MOT2D Benchmark challenge [49], [50] for evaluating multi-object tracking performance.”
Online multiple pedestrians tracking using deep temporal appearance matching association
Yoon, Y.-C., Kim, D. Y., Song, Y.-M., Yoon, K., & Jeon, M. (2020) · Information Sciences · doi:10.1016/j.ins.2020.10.002 · Cited by 72
Graininess-Aware Deep Feature Learning for Robust Pedestrian Detection
Lin, C., Lu, J., Wang, G., & Zhou, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2966371 · Cited by 71
“We comprehensively evaluated our proposed method on five benchmarks: Caltech [20], INRIA [2], KITTI [21], MOT17Det [22] and CityPersons [23].”
MethodInfluentialEliminating Exposure Bias and Metric Mismatch in Multiple Object Tracking
Maksai, A., & Fua, P. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00477 · Cited by 69
“Increasing availability of annotated training data and benchmarks, such as MOT15-17 [29, 38], DukeMTMC [45], PathTrack [37], and Wildtrack [10] now makes it possible to learn the data association models required to leverage this knowledge.”
BackgroundMEVA: A Large-Scale Multiview, Multimodal Video Dataset for Activity Detection
Corona, K., Osterdahl, K., Collins, R., & Hoogs, A. J. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00110 · Cited by 69
“Fundamental progress is often spurred by datasets such as ImageNet [15] and MS COCO [8] for object recognition and MOT16 [10] and Caltech Pedestrian [2] for pedestrian detection and tracking.”
STDFormer: Spatial-Temporal Motion Transformer for Multiple Object Tracking
Hu, M., Zhu, X., Wang, H., Cao, S., Liu, C., & Song, Q. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3263884 · Cited by 71
“A. Datasets and Metrics 1) Datasets: We evaluate STDFormer on the MOT17 [62], MOT20 [63] and DanceTrack [64] datasets in accordance with the “private detection” protocol.”
Method
Metadata
- Authors
- Milan, A., Leal-Taixe, L., Reid, I., Roth, S., & Schindler, K.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1603.00831
- OpenAlex
- W2291627510
- Cited by
- 1,309
- References
- 47
- Citations by year
- 2026: 6 · 2025: 45 · 2024: 178 · 2023: 192 · 2022: 179 · 2021: 219 · 2020: 192 · 2019: 135 · 2018: 96 · 2017: 55 · 2016: 12
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- MOT16, multi-target tracking, benchmark, pedestrian tracking, video annotation, object visibility, evaluation protocol
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
