The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
A Metric for Performance Evaluation of Multi-Target Tracking Algorithms
Abstract
Performance evaluation of multi-target tracking algorithms is of great practical importance in the design, parameter optimization and comparison of tracking systems. The goal of performance evaluation is to measure the distance between two sets of tracks: the ground truth tracks and the set of estimated tracks. This paper proposes a mathematically rigorous metric for this purpose. The basis of the proposed distance measure is the recently formulated consistent metric for performance evaluation of multi-target filters, referred to as the OSPA metric. Multi-target filters sequentially estimate the number of targets and their position in the state space. The OSPA metric is therefore defined on the space of finite sets of vectors. The distinction between filtering and tracking is that tracking algorithms output tracks and a track represents a labeled temporal sequence of state estimates, associated with the same target. The metric proposed in this paper is therefore defined on the space of finite sets of tracks and incorporates the labeling error. Numerical examples demonstrate that the proposed metric behaves in a manner consistent with our expectations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Design and Analysis of Modern Tracking Systems
Blackman, S. S., & Populi, R. (1999) · Cited by 3,509
Introductory functional analysis with applications
Kreyszig, E. (1978) · Cited by 2,889
Statistical Multisource-Multitarget Information Fusion
Mahler, R. (2007) · Cited by 2,024
A Consistent Metric for Performance Evaluation of Multi-Object Filters
Schuhmacher, D., Vo, B.-T., & Vo, B.-N. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.920469 · Cited by 1,855
Self-citationOn performance evaluation of multi-object filters
Schuhmacher, D., Vo, B.-T., & Vo, B. (2008) · UWA Profiles and Research Repository (UWA) · Cited by 753
Self-citationMultitarget Miss Distance via Optimal Assignment
Hoffman, J. R., & Mahler, R. P. S. (2004) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2004.824848 · Cited by 210
Multi-target tracking in clutter without measurement assignment
Mušicki, D., & Scala, B. L. (2008) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2008.4655350 · Cited by 140
Performance evaluation of multi-target tracking using the OSPA metric
Ristić, B., Vo, B., & Clark, D. E. (2010) · International Conference on Information Fusion (FUSION) · doi:10.1109/icif.2010.5712055 · Cited by 66
Self-citationSet JPDA algorithm for tracking unordered sets of targets
Svensson, L., Svensson, D., & Willett, P. (2009) · Chalmers Publication Library (Chalmers University of Technology) · Cited by 33
Cited by
Multiple object tracking: A literature review
Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., & Kim, T.-K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2020.103448 · Cited by 1,099
Joint Probabilistic Data Association Revisited
Rezatofighi, S. H., Milan, A., Zhang, Z., Shi, Q., Dick, A., & Reid, I. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.349 · Cited by 350
Stellet, J. E., Zofka, M. R., Schumacher, J., Schamm, T., Niewels, F., & Zollner, J. M. (2015) · 2015 IEEE 18th International Conference on Intelligent Transportation Systems · doi:10.1109/itsc.2015.236 · Cited by 124
Belief propagation based AIS/radar data fusion for multi-target tracking
Gaglione, D., Braca, P., & Soldi, G. (2018) · 2018 21st International Conference on Information Fusion (FUSION) · doi:10.23919/icif.2018.8455217 · Cited by 37
Metadata
- Authors
- Ristic, B., Vo, B.-N., Clark, D., & Vo, B.-T.
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2011-07
- Volume
- 59
- Issue
- 7
- Pages
- 3452-3457
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W2101295974
- Cited by
- 311
- References
- 9
- FWCI
- 15.67
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Metric for Performance Evaluation of Multi-Target Tracking Algorithms. https://app.cochat.ai/papers/10.1109/tsp.2011.2140111
- The paper
- Ristic, B., Vo, B.-N., Clark, D., & Vo, B.-T. (2011). A Metric for Performance Evaluation of Multi-Target Tracking Algorithms. IEEE Transactions on Signal Processing. https://doi.org/10.1109/tsp.2011.2140111
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.