Stable multi-target tracking in real-time surveillance video
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
The majority of existing pedestrian trackers concentrate on maintaining the identities of targets, however systems for remote biometric analysis or activity recognition in surveillance video often require stable bounding-boxes around pedestrians rather than approximate locations. We present a multi-target tracking system that is designed specifically for the provision of stable and accurate head location estimates. By performing data association over a sliding window of frames, we are able to correct many data association errors and fill in gaps where observations are missed. The approach is multi-threaded and combines asynchronous HOG detections with simultaneous KLT tracking and Markov-Chain Monte-Carlo Data Association (MCM-CDA) to provide guaranteed real-time tracking in high definition video. Where previous approaches have used ad-hoc models for data association, we use a more principled approach based on a Minimal Description Length (MDL) objective which accurately models the affinity between observations. We demonstrate by qualitative and quantitative evaluation that the system is capable of providing precise location estimates for large crowds of pedestrians in real-time. To facilitate future performance comparisons, we make a new dataset with hand annotated ground truth head locations publicly available.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
(1981) · Cited by 11,963
Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Bernardin, K., & Stiefelhagen, R. (2008) · EURASIP Journal on Image and Video Processing · doi:10.1155/2008/246309 · Cited by 2,918
Detection and Tracking of Point Features
Tomasi, C. (1991) · Cited by 2,231
Learning to associate: HybridBoosted multi-target tracker for crowded scene
Li, Y., Huang, C., & Nevatia, R. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206735 · Cited by 633
Robust tracking-by-detection using a detector confidence particle filter
Breitenstein, M. D., Reichlin, F., Leibe, B., Koller-Meier, E., & Van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459278 · Cited by 545
Robust Object Tracking by Hierarchical Association of Detection Responses
Huang, C., Wu, B., & Nevatia, R. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_58 · Cited by 497
Coupled Detection and Trajectory Estimation for Multi-Object Tracking
Leibe, B., Schindler, K., & Van Gool, L. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408936 · Cited by 272
Markov chain Monte Carlo data association for general multiple-target tracking problems
Oh, S., Russell, S., & Sastry, S. (2004) · 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601) · doi:10.1109/cdc.2004.1428740 · Cited by 241
Tracking many objects with many sensors
Pasula, H., Russell, S., Ostland, M., & Ritov, Y. (1999) · Cited by 165
Cited by
Items 601–659 of 659
Rule-Based Multiple Target Monitoring in Robot Vision Using Partitioning
Barfeh, D. P. Y., Lim, T. A., Jose, E. C., Lansigan, F. P., Mendoza, E., & Mariano, V. Y. (2018) · Journal of Physics Conference Series · doi:10.1088/1742-6596/976/1/012003
Object Tracking Based on Position Vectors and Pattern Matching
Reddy, V. P., & Fathima, A. A. (2018) · Lecture notes in electrical engineering · doi:10.1007/978-981-10-8354-9_37
Qualitative Performance Metrics For Object Tracking Algorithms
Dadi, H. S. (2018) · i-manager’s Journal on Image Processing · doi:10.26634/jip.4.4.14164
Multiple moving object capturing in autonomous robot-camera
Barfeh, D. P. Y., Esmailian, H., Mirzaee, M. R., & Mariano, V. Y. (2018) · International Conference on Control and Robotics Engineering (ICCRE) · doi:10.1109/iccre.2018.8376426
Multi-Target Tracking in Video
Poiesi, F., & Cavallaro, A. (2014) · Academic press library in signal processing · doi:10.1016/b978-0-12-396501-1.00019-4
Computer Model for Evaluating Multi-Target Tracking Algorithms
Vo, G., & Park, C. (2018) · Open Journal of Modelling and Simulation · doi:10.4236/ojmsi.2019.71001
An Improved Multi-Pedestrian Tracking System Based on Deep Neural Network
Gong, Y., Chi, J., Yu, X., Wu, C., Zhang, Y., & Gao, N. (2019) · SAE technical papers on CD-ROM/SAE technical paper series · doi:10.4271/2019-01-1055
Visual detection and tracking of unknown number of objects with nonparametric clustering methods
Topkaya, İ. S. (2016) · Sabanci University
Modeling human behaviour to improve retail efficiency and health monitoring
González, M. Q. (2019) · UPM Digital Archive (Technical University of Madrid) · doi:10.20868/upm.thesis.55207
Performance Evaluation of Random Set Based Pedestrian Tracking AlgorithmsPreprint
Ristić, B., Sherrah, J., & García‐Fernández, Á. F. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1211.0191
Target Tracking Based on SAGBA Optimized Particle Filter
Lv, S., Zhang, Y., Zhou, W., & Li, L. (2019) · Lecture notes in electrical engineering · doi:10.1007/978-981-32-9682-4_14
Understanding and Guiding Pedestrian and Crowd Motion
Yang, D., Redmill, K., & Özgüner, Ü. (2020)
Farmland human-shape obstacles identification based on Viola-Jones Algorithm
Wang, L., Xiao, W., Qi, Y., Gao, Q., Li, L., Yan, K., Zhang, Y., & Lan, Y. (2018) · International Journal of Precision Agricultural Aviation · doi:10.33440/j.ijpaa.20200303.99
Algorithm for Counting Cars in Large-scale Video Surveillance Systems
Shirokov, A., Kuplyakov, D., & Konushin, A. (2020) · International Conference on Computer Graphics and Vision (GraphiCon) · doi:10.51130/graphicon-2020-1-100-108
Quispe, W., Tinoco, J., Quispe, G., & Raymundo, C. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-68017-6_16
Exemplar Loss for Siamese Network in Visual Tracking
Chang, S., Lu, H., Huang, S., & Zhang, Y. (2020) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/ispa-bdcloud-socialcom-sustaincom51426.2020.00210
Rudenko, A., Kucner, T. P., Swaminathan, C. S., Chadalavada, R. T., Arras, K. O., & Lilienthal, A. J. (2019) · Figshare · doi:10.5281/zenodo.3382144
Efficient Online Vehicle Tracking for Real—Virtual Mapping Systems
Chen, J., Li, L., & Yang, X. (2021) · Journal of Shanghai Jiaotong University (Science) · doi:10.1007/s12204-021-2349-6
Multi-pedestrian tracking based on hierarchical Siamese Neural Network
Ma, M., Wang, Y., Pan, H., & Stolkin, R. (2021) · International Conference on Intelligent Equipment and Special Robots (ICIESR) · doi:10.1117/12.2625430
Smart CCTV and the Management of Urban Space
Han, J. H., Hawken, S., & Williams, A. M. (2017) · IGI Global eBooks · doi:10.4018/978-1-5225-2589-9.ch023
A Survey for Long-Term Multi-Person Tracking for Surveillance VideoPreprint
Selvage, J., Humphries, C., Mcclanahan, F., Rhodarmer, A., & Gosman, A. (2020) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/fh5nj
Bouarara, H. A., Hamou, R. M., & Amine, A. (2016) · IGI Global eBooks · doi:10.4018/978-1-5225-0983-7.ch076
Dual Reconstructive Autoencoder for Crowd Localization and Estimation in Density and FIDT Maps
Lamas, F., Pezoa, J. E. E., Godoy, S. E., Saavedra, G., Torres, S. N., Montalva, G. A., & Meng, W. (2022) · IEEE Access · doi:10.1109/access.2022.3219839
Intelligent Centralized Autonomous System for Multiple Mobile Spherical Robots
Quan, W., Xu, Z.-Y., Zhu, Y., Wang, C., & Kubota, N. (2023) · Lecture notes in electrical engineering · doi:10.1007/978-981-99-0479-2_172
Pedestrian Trajectory Forecasting in Videos
Dadwaria, B., & Choudhary, A. (2022) · IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI) · doi:10.1109/soli57430.2022.10294678
Chandrakanth, V., Singh, S., Channappayya, S. S., & Palaniappan, K. (2023) · IEEE Applied Imagery Pattern Recognition Workshop · doi:10.1109/aipr60534.2023.10440696
Pedestrian ranging algorithm based on improved YOLOv7 and DeepSORT
Xu, T., Huang, B., Yin, Y., & Ye, Q. (2023) · International Conference on Artificial Intelligence and Computer Engineering (ICAICE) · doi:10.1145/3652628.3652645
Action and trajectory prediction for Autonomous Driving
Calem, L. (2024) · theses.fr (ABES) · doi:10.70675/1ec4b0bdzcb6fz4e52z8c5bz44c5e20e8672
SceNDD++: An Enhanced Scenario-based Naturalistic Driving Dataset
Ranjan, N., Prabu, A., He, Z., & Li, L. (2024) · International Conference on Cyber-Physical Social Intelligence (ICCSI) · doi:10.1109/iccsi62669.2024.10799423
Watanabe, K., Masuda, S., Xiao, L., & Yamasaki, T. (2025) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg61629.2025.11099276
Pattern Learning for Trajectory Anomaly Detection: Recent Developments and Emerging Challenges
Li, C., Wang, X., Wang, X., Chen, S., Ji, Y., & Zhao, S. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227964
Overview of the motion trajectories datasets
Chakravarthi, B. (2022) · Open Research Knowledge Graph (ORKG) · doi:10.48366/r209290
Domain alignment with geometry priors for pedestrian trajectory prediction
Martins, S. D. S., Aldea, E., & Hégarat‐Mascle, S. L. (2025) · EPJ Web of Conferences · doi:10.1051/epjconf/202533404019
Tube Arrangement Using a Mesh-Based Sorting Approach in Video Synopsis
Vyasdev, Saha, K., Patel, J., Mahapatra, A., & Priyadharshini, S. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3631432
Enhancing data association in Multi-Object Tracking via learning-based Human Trajectory Prediction
Carreras, A., Velázquez, J. M. R., & Hayet, J.-B. (2025) · International Conference on Pattern Recognition Systems (ICPRS) · doi:10.1109/icprs66293.2025.11302821
Modular Framework for Cluster Analysis in Surveillance Cameras
Soares, D. L., Takecian, P. L., Schwerz, A. L., Padilha, B., & Ferreira, J. E. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-12930-7_25
Heterogeneous network multi-target tracking algorithm based on PHD filter
Wang, K., Zhang, Q., Wan, P., Hu, X., Jin, Z., & Yu, X. (2025) · International Conference on Signal Processing, Computer Networks and Communications (SPCNC) · doi:10.1109/spcnc68200.2025.11406717
Yadav, R., Mitra, A., & Kala, R. (2026) · IEEE International Conference on Industrial and Information Systems (ICIIS) · doi:10.1109/iciis69028.2026.11450819
Exploiting scene context for on-line object tracking in unconstrained environments
Moujtahid, S. (2016) · theses.fr (ABES) · doi:10.70675/d4f02d17zeee0z43a8za6d0z77128d6027ed
Représenter pour suivre : exploitation de représentations parcimonieuses pour le suivi multi-objets
Fagot-Bouquet, L. (2017) · theses.fr (ABES) · doi:10.70675/f7418da7z170fz466fz93e3zc226398cf445
Sélection de cibles en mouvement : contexte, modèles, et paradigmes d'aide à la sélection
Kouyoumdjian, A. (2018) · theses.fr (ABES) · doi:10.70675/b2916c46z84e7z4961za946z67c3412aed52 · Cited by 1
Multi-object detection and tracking in video sequences
Mhalla, A. (2018) · theses.fr (ABES) · doi:10.70675/6d64f9c8ze926z44d0zb444z11cb37d67638
Long term people trackers for video monitoring systems
Nguyen, T. H. T. (2018) · theses.fr (ABES) · doi:10.70675/d0339541z989ez49caz9970z1b3af6e514db
Tackling pedestrian detection in large scenes with multiple views and representations
Pellicanò, N. (2018) · theses.fr (ABES) · doi:10.70675/5c5998d3zad03z43e8za0acza2dacc2cf0c8
Instantiation of a textual description schema of video surveillance scenes
Youssef, W. F. (2019) · theses.fr (ABES) · doi:10.70675/701db432zbd9bz44c9zaa1fz8d9a9e50cea1
Étude de la classification des vidéos de foule par apprentissage profond
Bendali-Braham, M. (2022) · theses.fr (ABES) · doi:10.70675/9f147444z638dz4f51zb977zfb1ba80dec49
Suivi multi-objets basé sur des tracklets dans un réseau de caméras
Dorai, Y. (2021) · theses.fr (ABES) · doi:10.70675/dc13ed92z675az4e45zbb53zd02b4117bef8
Cross-Domain Logistic Loss Based Siamese Network for Visual Tracking
Li, Z., Ji, X., Lu, W., Wang, P., Sun, C., & Chang, S. (2025) · Asia Pacific Workshop on Data Science and Information Theory (APWDSIT) · doi:10.1109/apwdsit64675.2025.11478554
Multimodal Motion Tracking: A Review
Aidoo, E., Custance, O., Tenagyei, E. K., Dai, C., Chen, M., & Xu, Z. (2026) · IEEE Sensors Journal · doi:10.1109/jsen.2026.3701620
Multiscan Multiple Target Tracking Based on a Node Ranking Message-Passing Method
Song, J., Xu, H. B., & Quan, Y. (2026) · IEEE Sensors Journal · doi:10.1109/jsen.2026.3708978
Real-Time Social Distancing Monitoring with CLAHE-Enhanced YOLOv8 Detection
Kaharuddin, S., Yong, F. T. J., Abdullah, M. N., Hassan, S. S. N. A. S., & Mamat, M. N. (2026) · International Conference on Frontiers of Engineering and Emerging Technologies (FET) · doi:10.1109/fet68771.2026.11601518
Calibration-free grid-based pedestrian tracking with shortcut edge for video surveillance
Chen, L., Zhu, W., Huang, C., & Lou, J. (2026) · Egyptian Informatics Journal · doi:10.1016/j.eij.2026.101031
On-Camera Surveillance Video Compression via ROI Extraction
Yan, J., Zhu, H., Wang, J., Huang, H., Chang, S., & Guo, M. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3724294 · Cited by 1
Adaptive Thresholding Technique for Motion-Tracking DVS & DNF Systems
Le, Y., Li, Y., & Lee, I. (2026) · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas67364.2026.11680637
PEDRA: Evaluating the Realism of Pedestrian Dynamics in Video Generation
Appelle, A., & Lynch, J. P. (2026) · doi:10.1109/cvprf71909.2026.00430 · Cited by 1
Metadata
- Authors
- Benfold, B., & Reid, I.
- Affiliations
- University of Oxford (GB)
- ORCID
- Reid, Ian
- Venue
- CVPR 2011
- Publisher
- IEEE
- Published
- 2011-06
- Pages
- 3457-3464
- OpenAlex
- W2061773916
- Cited by
- 651
- References
- 22
- Citations by year
- 2026: 10 · 2025: 15 · 2024: 12 · 2023: 20 · 2022: 37 · 2021: 45 · 2020: 42 · 2019: 53 · 2018: 60 · 2017: 53 · 2016: 79 · 2015: 66 · 2014: 72 · 2013: 53 · 2012: 28
- FWCI
- 37.96
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Surveillance and Tracking Methods
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- multi-target tracking, pedestrian tracking, surveillance video, data association, sliding window, minimum description length, real-time tracking, crowd tracking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.