Model-free detection and tracking of dynamic objects with 2D lidar
The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
Abstract
We present a new approach to detection and tracking of moving objects with a 2D laser scanner for autonomous driving applications. Objects are modelled with a set of rigidly attached sample points along their boundaries whose positions are initialized with and updated by raw laser measurements, thus allowing a non-parametric representation that is capable of representing objects independent of their classes and shapes. Detection and tracking of such object models are handled in a theoretically principled manner as a Bayes filter where the motion states and shape information of all objects are represented as a part of a joint state which includes in addition the pose of the sensor and geometry of the static part of the world. We derive the prediction and observation models for the evolution of the joint state, and describe how the knowledge of the static local background helps in identifying dynamic objects from static ones in a principled and straightforward way. Dealing with raw laser points poses a significant challenge to data association. We propose a hierarchical approach, and present a new variant of the well-known Joint Compatibility Branch and Bound algorithm to respect and take advantage of the constraints of the problem introduced through correlations between observations. Finally, we calibrate the system systematically on real world data containing 7,500 labelled object examples and validate on 6,000 test cases. We demonstrate its performance over an existing industry standard targeted at the same problem domain as well as a classical approach to model-free object tracking.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Tracking in monocular images was achieved in real-time through a CNN-based method [194], [195].”
From A Survey of Autonomous Driving: Common Practices and Emerging Technologies (2020) · cites this paper as [194]
Citations
Cites
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“Specifically, precision and recall are computed over the detected object boxes against the hand-labelled ground truth object boxes using the overlapping criterion as is commonly used in the computer vision community (Everingham et al., 2010).”
MethodA method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103 · cited 9×
“Provided the initial clustering is correct and ICP with outlier rejection gives a reasonable performance, the remaining measurements in the cluster can safely be assumed to be previously unobserved boundary points on the same object and be used to extend the object boundary.”
MethodInfluentialEstimation with Applications to Tracking and Navigation: Theory, Algorithms and Software
Bar‐Shalom, Y., Li, X. ‐., & Kirubarajan, T. (2002) · doi:10.1002/0471221279 · Cited by 6,782 · cited 7×
“Biswas et al. (2002) also take an occupancy grid representation, and detect non-stationary objects by map differencing. The individual objects are then identified with an expectation–maximization (EM) algorithm. Wolf and Sukhatme (2005) keep two occupancy grid maps, one for the static part and one for the dynamic part…”
BackgroundInfluentialPractical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691 · cited 3×
“To find this frontier parameter set, we apply a Bayesian parameter tuning algorithm developed by Snoek et al. (2012) to bias the search in the high-dimensional parameter space to look for satisfactory parameter settings, and obtain an approximation to the frontier parameter set by finding the upper…”
MethodInfluentialEfficient Graph-Based Image Segmentation
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000022288.19776.77 · Cited by 6,176
Neural Information Processing Systems
(2018) · The Deep Learning Revolution · doi:10.7551/mitpress/11474.003.0014 · Cited by 3,730
Graph-Theoretical Methods for Detecting and Describing Gestalt Clusters
Zahn, C. T. (1971) · IEEE Transactions on Computers · doi:10.1109/t-c.1971.223083 · Cited by 1,759 · cited 2×
“Euclidean Minimum Spanning Tree (EMST)-based clustering algorithms have a long history (Zahn, 1971; Asano et al., 1988; Wang et al., 2012), and is known for being capable of detecting clusters with irregular boundaries (Zahn, 1971).”
BackgroundData association in stochastic mapping using the joint compatibility test
Neira, J., & Tardos, J. D. (2001) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.976019 · Cited by 772 · cited 13×
“JCBB (Neira and Tardos, 2001) is a well-known data association algorithm that takes into account the correlations between observations.”
BackgroundMethodInfluentialMulti-cue Pedestrian Detection and Tracking from a Moving Vehicle
Gavrila, D. M., & Munder, S. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-9038-7 · Cited by 524 · cited 1×
“To train the system for best performing parameter sets, we follow an approach similar to that described by Gavrila and Munder (2007) as follows: both precision P and recall R are functions of system parameters, thus if the number of system parameters exceeds one, the set of all feasible (R,P) pairs…”
Method2011 IEEE International Conference on Robotics and Automation (ICRA 2011)
(2010) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2010.2047467 · Cited by 503
A perception‐driven autonomous urban vehicle
Leonard, J., How, J., Teller, S., Berger, M., Campbell, S., Fiore, G., Fletcher, L., Frazzoli, E., Huang, A., Karaman, S., et al. (2008) · Journal of Field Robotics · doi:10.1002/rob.20262 · Cited by 429 · cited 4×
“To take advantage of the multilayered scanner, we follow a standard procedure to remove ground strike measurements given multiple scanning layers described by Leonard et al. (2008). Specifically, a grid is first built over the 2D scanning plane, measurements from each scanning layer are projected down to the scanning…”
MethodInfluentialUsing Boosted Features for the Detection of People in 2D Range Data
Arras, K. O., Mozos, O. M., & Burgard, W. (2007) · Proceedings 2007 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2007.363998 · Cited by 381 · cited 1×
“The line of works by Arras et al. (2007, 2008) focus on people detection.”
Schulz, D., Burgard, W., Fox, D., & Cremers, A. B. (2002) · Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164) · doi:10.1109/robot.2001.932850 · Cited by 370 · cited 4×
“The work by Schulz et al. (2001) is similar in that they also identify legs of people in 2D range scans and apply the joint probabilistic data association filter (JPDAF) for robust tracking.”
BackgroundInfluentialWang, C.-C., Thorpe, C., & Thrun, S. (2004) · 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422) · doi:10.1109/robot.2003.1241698 · Cited by 316 · cited 3×
“We note there exists a large body of work on similar application domains (for example, Miyasaka et al., 2009; Mertz et al., 2013; Wang et al., 2003), however it is often difficult to obtain a fair quantitative comparison with the methods due to either a lack of quantitative results or difficulty of a direct comparison…”
BackgroundMap building with mobile robots in dynamic environments
Hahnel, D., Triebel, R., Burgard, W., & Thrun, S. (2004) · 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422) · doi:10.1109/robot.2003.1241816 · Cited by 266 · cited 1×
“Finally, the work by Hahnel et al. (2003) is also relevant where the authors formulate an EM algorithm to solve for a set of hidden indicator variables for each laser point to determine whether it is static or dynamic.”
BackgroundMobile Robot Simultaneous Localization and Mapping in Dynamic Environments
Wolf, D. F., & Sukhatme, G. S. (2005) · Autonomous Robots · doi:10.1007/s10514-005-0606-4 · Cited by 248 · cited 1×
“Wolf and Sukhatme (2005) keep two occupancy grid maps, one for the static part and one for the dynamic part of the environment.”
BackgroundThe 2011 IEEE International Conference on Robotics and Automation (ICRA2011)
Wang, Z.-D. (2012) · Journal of the Robotics Society of Japan · doi:10.7210/jrsj.30.332 · Cited by 195
Arras, K. O., Grzonka, S., Luber, M., & Burgard, W. (2008) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2008.4543447 · Cited by 177 · cited 1×
“The line of works by Arras et al. (2007, 2008) focus on people detection.”
Moving object detection with laser scanners
Mertz, C., Navarro‐Serment, L. E., MacLachlan, R. A., Rybski, P. E., Steinfeld, A. M., Suppé, A. J., Urmson, C., Vandapel, N., Hebert, M., Thorpe, C. E., et al. (2012) · Journal of Field Robotics · doi:10.1002/rob.21430 · Cited by 167 · cited 4×
“We note there exists a large body of work on similar application domains (for example, Miyasaka et al., 2009; Mertz et al., 2013; Wang et al., 2003), however it is often difficult to obtain a fair quantitative comparison with the methods due to either a lack of quantitative results or difficulty of a direct comparison…”
BackgroundMethodInfluentialClustering algorithms based on minimum and maximum spanning trees
Asano, T., Bhattacharya, B. K., Keil, M., & Yao, F. (1988) · Annual Symposium on Computational Geometry (SoCG) · doi:10.1145/73393.73419 · Cited by 153 · cited 1×
“Euclidean Minimum Spanning Tree (EMST)-based clustering algorithms have a long history (Zahn, 1971; Asano et al., 1988; Wang et al., 2012), and is known for being capable of detecting clusters with irregular boundaries (Zahn, 1971).”
BackgroundEfficient Solutions to Autonomous Mapping and Navigation Problems
Williams, S. B. (2009) · The Sydney eScholarship Repository (The University of Sydney) · Cited by 147
Online Localization and Mapping with Moving Object Tracking in Dynamic Outdoor Environments
Vu, T. D., Aycard, O., & Appenrodt, N. (2007) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2007.4290113 · Cited by 147 · cited 1×
“Examples include Toyota’s tracking system (Miyasaka et al., 2009) and Wang et al.’s (2003) system (later extended by Montesano et al. (2005) and Vu et al. (2007)) that combines SLAM with dynamic object tracking.”
MethodTracking for following and passing persons
Topp, E. A., & Christensen, H. I. (2005) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2005.1544961 · Cited by 137 · cited 1×
“Topp and Christensen (2005) extend the work by removing this restriction, and extend the model for a person to also include people whose legs are not directly visible.”
BackgroundWhat could move? Finding cars, pedestrians and bicyclists in 3D laser data
Wang, D. Z., Posner, I., & Newman, P. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224734 · Cited by 103 · cited 1×
“Euclidean Minimum Spanning Tree (EMST)-based clustering algorithms have a long history (Zahn, 1971; Asano et al., 1988; Wang et al., 2012), and is known for being capable of detecting clusters with irregular boundaries (Zahn, 1971).”
BackgroundSelf-citationTowards object mapping in non-stationary environments with mobile robots
Biswas, R., Limketkai, B., Sanner, S., & Thrun, S. (2003) · IEEE/RSJ International Conference on Intelligent Robots and System · doi:10.1109/irds.2002.1041523 · Cited by 92 · cited 1×
“Biswas et al. (2002) also take an occupancy grid representation, and detect non-stationary objects by map differencing.”
BackgroundLaser-based detection and tracking moving objects using data-driven Markov chain Monte Carlo
Vu, T. D., & Aycard, O. (2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2009.5152805 · Cited by 92 · cited 1×
“Another example of model-based vehicle detection and tracking is the work presented by Vu and Aycard (2009), where a box model for vehicles is assumed, and detection and tracking are solved simultaneously by optimizing over the best trajectories of the vehicles over a sliding window of laser scans…”
MethodEgo-motion estimation and moving object tracking using multi-layer LIDAR
Miyasaka, T., Ohama, Y., & Ninomiya, Y. (2009) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2009.5164269 · Cited by 79 · cited 6×
“Many authors (for example, Miyasaka et al. (2009) and Wang et al.”
BackgroundMethodInfluentialQualitative and quantitative car tracking from a range image sequence
Zhao, L., & Thorpe, C. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1998.698651 · Cited by 62 · cited 2×
“the interacting multiple model (IMM) filter (Zhao and Thorpe, 1998)) to objects whose class is known with confidence to better account for all complexities of motion the object may exhibit.”
BackgroundModeling the Static and the Dynamic Parts of the Environment to Improve Sensor-based Navigation
Montesano, L., Mínguez, J., & Montano, L. (2006) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2005.1570822 · Cited by 53 · cited 1×
“Examples include Toyota’s tracking system (Miyasaka et al., 2009) and Wang et al.’s (2003) system (later extended by Montesano et al. (2005) and Vu et al. (2007)) that combines SLAM with dynamic object tracking.”
MethodOn Extended Target Tracking Using PHD Filters
Granström, K., Lundquist, C., Gustafsson, F., & Orguner, U. (2012) · DiVA (Linkoping University) · Cited by 48
Motion clustering and estimation with conditional random fields
Tipaldi, G. D., & Ramos, F. T. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354692 · Cited by 29 · cited 1×
“Work by Tipaldi and Ramos (2009) and van de Ven et al. (2010) focuses on the detection part of the problem, and formulates it under a joint conditional random field (CRF) framework for solving both the data association and moving object detection problems.”
BackgroundSimultaneous egomotion estimation, segmentation, and moving object detection
Yang, S., & Wang, C. (2011) · Journal of Field Robotics · doi:10.1002/rob.20392 · Cited by 27 · cited 1×
“Yang and Wang (2011) proposed a system that jointly estimates the vehicle pose and moving object detections using a variant of random sample consensus (RANSAC), and track merging and splits are handled via a decision tree that consists of spatiotemporal consistency tests.”
BackgroundAn integrated probabilistic model for scan-matching, moving object detection and motion estimation
van de Ven, J., Ramos, F. T., & Tipaldi, G. D. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509586 · Cited by 27 · cited 1×
“Work by Tipaldi and Ramos (2009) and van de Ven et al. (2010) focuses on the detection part of the problem, and formulates it under a joint conditional random field (CRF) framework for solving both the data association and moving object detection problems.”
BackgroundA New Approach to Model-Free Tracking with 2D Lidar
Wang, D. Z., Posner, I., & Newman, P. M. (2016) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-28872-7_32 · Cited by 10 · cited 1×
“This paper is a more detailed account of the work previously presented in Wang et al. (2013).”
BackgroundSelf-citation
Research works printed but not linked: 2
- Wang D, 2012, 2012 IEEE international conference on robotics and automation (ICRA)
- Wang D, 2013, Proceedings of the international symposium on robotics research (ISRR)
Cited by
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889
“Various models have been proposed for vehicles and pedestrians, while some models generalize to any dynamic object [190].”
BackgroundBadue, C., Guidolini, R., Carneiro, R. V., Azevedo, P., Cardoso, V. B., Forechi, A., Jesus, L., Berriel, R., Paixão, T. M., Mutz, F., et al. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113816 · Cited by 1,209
Car that Knows Before You Do: Anticipating Maneuvers via Learning Temporal Driving Models
Jain, A., Koppula, H. S., Raghavan, B., Soh, S., & Saxena, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.364 · Cited by 274
“Fortunately, the automobile industry has made significant advances in some of these areas [1, 2, 39] where our work can apply.”
BackgroundCar that Knows Before You Do: Anticipating Maneuvers via Learning Temporal Driving Models
Jain, A., Koppula, H. S., Raghavan, B., Soh, S., & Saxena, A. (2015) · arXiv · doi:10.48550/arxiv.1504.02789 · Cited by 274
“Fortunately, the automobile industry has made significant advances in some of these areas [1, 3, 47] where our work can apply.”
BackgroundMotion-based detection and tracking in 3D LiDAR scans
Dewan, A., Caselitz, T., Tipaldi, G. D., & Burgard, W. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487649 · Cited by 184
“In contrast, we do not build a map, but similar to [16] we only store local static information.”
BackgroundMethod
Metadata
- Authors
- Wang, D. Z., Posner, I., & Newman, P.
- Affiliations
- University of Oxford (GB)
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2015-05-18
- Volume
- 34
- Issue
- 7
- Pages
- 1039-1063
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W1910014366
- Cited by
- 73
- References
- 37
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 4 · 2023: 2 · 2022: 5 · 2021: 9 · 2020: 11 · 2019: 12 · 2018: 7 · 2017: 7 · 2016: 6 · 2015: 4
- FWCI
- 8.25
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- The International Journal of Robotics Research (publishedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/J013501/1, EP/I005021/1)
- Topics
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Target Tracking and Data Fusion in Sensor Networks
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Keywords
- dynamic object tracking, 2D LiDAR, autonomous driving, Bayesian filtering, data association, sensor calibration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.