Stereo-Camera-Based Urban Environment Perception Using Occupancy Grid and Object Tracking
The DOI matches its Crossref record; 37 of the 38 references it cites were found in a registry or an index.
Abstract
This paper deals with environment perception for automobile applications. Environment perception comprises measuring the surrounding field with onboard sensors such as cameras, radar, lidars, etc., and signal processing to extract relevant information for the planned safety or assistance function. Relevant information is primarily supplied using two well-known methods, namely, object based and grid based. In the introduction, we discuss the advantages and disadvantages of the two methods and subsequently present an approach that combines the two methods to achieve better results. The first part outlines how measurements from stereo sensors can be mapped onto an occupancy grid using an appropriate inverse sensor model. We employ the Dempster-Shafer theory to describe the occupancy grid, which has certain advantages over Bayes' theorem. Furthermore, we generate clusters of grid cells that potentially belong to separate obstacles in the field. These clusters serve as input for an object-tracking framework implemented with an interacting multiple-model estimator. Thereby, moving objects in the field can be identified, and this, in turn, helps update the occupancy grid more effectively. The first experimental results are illustrated, and the next possible research intentions are also discussed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Kalman filtering is sufficient for simple linear models, while the extended and and unscented Kalman filters [189] are used to handle nonlinear dynamic models [190].”
From A Survey of Autonomous Driving: Common Practices and Emerging Technologies (2020) · cites this paper as [189]
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
A Mathematical Theory of Evidence
Shafer, G. (2020) · Princeton University Press eBooks · doi:10.2307/j.ctv10vm1qb · Cited by 11,711
A Mathematical Theory of Evidence
Shafer, G. (1976) · Princeton University Press eBooks · doi:10.1515/9780691214696 · Cited by 9,083
Thrun, S. (2002) · Communications of the ACM · doi:10.1145/504729.504754 · Cited by 7,994
Upper and Lower Probabilities Induced by a Multivalued Mapping
Dempster, A. P. (1967) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177698950 · Cited by 6,126
On the generalized distance in statistics
Mahalanobis, P. C. (1936) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 6,068
Upper and Lower Probabilities Induced by a Multivalued Mapping
Dempster, A. P. (2008) · Studies in Fuzziness and Soft Computing · doi:10.1007/978-3-540-44792-4_3 · Cited by 5,296 · cited 1×
“Whereas Bayes' rule relies on evidence being represented by probability functions, the Dempster–Shafer theory represents evidence as a possibilistic belief function [27], [28] .”
BackgroundPerformance of optical flow techniques
Barron, J. L., Fleet, D. J., & Beauchemin, S. S. (1994) · International Journal of Computer Vision · doi:10.1007/bf01420984 · Cited by 4,305 · cited 1×
“Furthermore, using the image sequence, for example, of the left camera, we can compute the optical flow [36].”
MethodDesign and Analysis of Modern Tracking Systems
Blackman, S. S., & Populi, R. (1999) · Cited by 3,509
Bayes, T. (1763) · Philosophical Transactions of the Royal Society of London · doi:10.1098/rstl.1763.0053 · Cited by 2,995
AN ESSAY TOWARDS SOLVING A PROBLEM IN THE DOCTRINE OF CHANCES
BAYES (1958) · Biometrika · doi:10.1093/biomet/45.3-4.296 · Cited by 2,911
The interacting multiple model algorithm for systems with Markovian switching coefficients
Blom, H. A. P., & Bar-Shalom, Y. (1988) · IEEE Transactions on Automatic Control · doi:10.1109/9.1299 · Cited by 2,460 · cited 1×
“We employ the interacting multiplemodel (IMM) approach [9] to track moving objects.”
MethodUsing occupancy grids for mobile robot perception and navigation
Elfes, A. (1989) · Computer · doi:10.1109/2.30720 · Cited by 2,213 · cited 2×
“In [4], it was described for the first time how grid cells can be updated with Bayes' theorem.”
BackgroundMethodAlgorithm for computer control of a digital plotter
Bresenham, J. E. (1965) · IBM Systems Journal · doi:10.1147/sj.41.0025 · Cited by 2,172
Three-Dimensional Computer Vision
Faugeras, O. D. (1993) · Cumulative Index of Computer Aided Architectural Design · Cited by 1,209
Murphy, R. R. (2001) · Industrial Robot: An International Journal · doi:10.1108/ir.2001.28.3.266.1 · Cited by 1,052
Junior: The Stanford entry in the Urban Challenge
Montemerlo, M., Becker, J., Bhat, S., Dahlkamp, H., Dolgov, D., Ettinger, S., Haehnel, D., Hilden, T., Hoffmann, G., Huhnke, B., et al. (2008) · Journal of Field Robotics · doi:10.1002/rob.20258 · Cited by 1,027
Multitarget-Multisensor Tracking: Applications and Advances
Bar‐Shalom, Y. (1992) · Cited by 765
Pedestrian detection using wavelet templates
Oren, M., Papageorgiou, C., Sinha, P., Osuna, E., & Poggio, T. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609319 · Cited by 695 · cited 1×
“In our application, we use a dense stereo camera as a sensor, which offers great potential in terms of pedestrian detection [34], [35].”
MethodThe fundamental matrix: Theory, algorithms, and stability analysis
Luong, Q.-T., & Faugeras, O. D. (1996) · International Journal of Computer Vision · doi:10.1007/bf00127818 · Cited by 677
Simultaneous Localization, Mapping and Moving Object Tracking
Wang, C.-C., Thorpe, C., Thrun, S., Hebert, M., & Durrant-Whyte, H. (2007) · The International Journal of Robotics Research · doi:10.1177/0278364907081229 · Cited by 596 · cited 1×
“Compared with the approaches in [5] and [8], we achieved good results using a sensor other than a laser scanner, namely, a stereo camera.”
MethodMulti-cue Pedestrian Detection and Tracking from a Moving Vehicle
Gavrila, D. M., & Munder, S. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-9038-7 · Cited by 524 · cited 1×
“In our application, we use a dense stereo camera as a sensor, which offers great potential in terms of pedestrian detection [34], [35].”
MethodModel based vehicle detection and tracking for autonomous urban driving
Petrovskaya, A., & Thrun, S. (2009) · Autonomous Robots · doi:10.1007/s10514-009-9115-1 · Cited by 430 · cited 2×
“In [6], [12], and [13], there are more detailed descriptions of how measurements from stereo cameras and laser scanners can be processed to find objects.”
BackgroundMethodTracking a maneuvering target using input estimation versus the interacting multiple model algorithm
Bar-Shalom, Y., Chang, K. C., & Blom, H. A. P. (1989) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/7.18693 · Cited by 327 · cited 1×
“This helps reduce the computing expense of the multiple-model approach [23].”
MethodReasoning with belief functions: An analysis of compatibility
Pearl, J. (1990) · International Journal of Approximate Reasoning · doi:10.1016/0888-613x(90)90013-r · Cited by 200 · cited 1×
“There have been many discussions about the way that Dempster's combination rule handle conflicts [29].”
BackgroundObstacle Detection with Stereo Vision for Off-Road Vehicle Navigation
Broggi, A., Caraffi, C., Fedriga, R. I., & Grisleri, P. (2006) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops · doi:10.1109/cvpr.2005.503 · Cited by 158 · cited 2×
“In [6], [12], and [13], there are more detailed descriptions of how measurements from stereo cameras and laser scanners can be processed to find objects.”
BackgroundFree Space Computation Using Stochastic Occupancy Grids and Dynamic Programming
Badino, H., Franke, U., Mester, R., & Goethe, J. W. (2008) · Cited by 154
Stereo-Based Pedestrian Detection for Collision-Avoidance Applications
Nedevschi, S., Bota, S., & Tomiuc, C. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2008.2012373 · Cited by 132 · cited 1×
“pedestrians [2] but the surrounding driving environment as well have to be measured and analyzed.”
BackgroundProbabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision
Danescu, R., & Nedevschi, S. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2018328 · Cited by 127 · cited 1×
“Based on 3-D reconstruction from dense stereo, detection and tracking of vehicles, lanes [7], and pedestrians is presented.”
BackgroundGrid-based localization and local mapping with moving object detection and tracking
Vu, T. D., Burlet, J., & Aycard, O. (2010) · Information Fusion · doi:10.1016/j.inffus.2010.01.004 · Cited by 113
Real-Time Hierarchical Outdoor SLAM Based on Stereovision and GPS Fusion
Schleicher, D., Bergasa, L. M., Ocana, M., Barea, R., & Lopez, M. E. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2026317 · Cited by 103 · cited 1×
“Another possibility is to integrate Global Positioning System position information, as described in [37].”
BackgroundA Sensor for Urban Driving Assistance Systems Based on Dense Stereovision
Nedevschi, S., Danescu, R. G., Mariţa, T., Oniga, F., Pocol, C., Sobol, S., Tomiuc, C., Vancea, C., Meinecke, M.-M., Graf, T., et al. (2007) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2007.4290127 · Cited by 61 · cited 2×
“In [6], [12], and [13], there are more detailed descriptions of how measurements from stereo cameras and laser scanners can be processed to find objects.”
BackgroundSelf-citationOccupancy Grids from Stereo and Optical Flow Data
Braillon, C., Pradalier, C., Usher, K., Crowley, J. L., & Laugier, C. (2008) · Springer eBooks · doi:10.1007/978-3-540-77457-0_34 · Cited by 22 · cited 1×
“On the other hand, in [10] and [11], the surrounding environment is described as an occupancy grid.”
BackgroundOptimized grid-based environment perception in advanced driver assistance systems
Nguyen, T.-N., Meinecke, M.-M., Tornow, M., & Michaelis, B. (2009) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2009.5164315 · Cited by 15 · cited 1×
“In [18], one approach, which aimed to classify conflict cells as either noise or moving objects, is presented.”
BackgroundSelf-citationMulti-Object Tracking Based on Particle Filter and Data Association in Color Image Sequences
Al-Hamadi, A. K., Pathan, S. S., & Michaelis, B. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02345-3_14 · Cited by 4 · cited 1×
“In [24], a tracking approach with a particle filter based on color image sequences shows good results.”
BackgroundSelf-citationDepth Recovery from Stereo Matching Using Coupled Random Fields
Narasimha, R. (2010) · HAL · Cited by 3
Grid-based Localization and Online Mapping with Moving Object Detection and Tracking
Burlet, J., Vu, T. D., & Aycard, O. (2007) · HAL · Cited by 2
Research works printed but not linked: 4
- nguyen, 2010, Aktive Maßnahmen zur Erhöhung der Sicherheit für Fußgänger, Proc AAET, 258
- meinecke, 2010, Motion model estimation for pedestrians in street-crossing scenarios, Proc 7th Workshop Intell Transp
- jerhot, 2009, Integrated probabilistic approach to environment perception with self-diagnosis capability for advanced driver assistance systems, Proc 12th Int Conf FUSION, 1347
- 0, AKTIVAdaptive and Cooperative Technologies for the Intelligent Traffic
Cited by
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889
“Using occupancy maps as a frame for all sensors to contribute to and then doing data association in that frame is common, especially when using multiple sensors [185].”
MethodBadue, C., Guidolini, R., Carneiro, R. V., Azevedo, P., Cardoso, V. B., Forechi, A., Jesus, L., Berriel, R., Paixão, T. M., Mutz, F., et al. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113816 · Cited by 1,209
Path planning algorithms in the autonomous driving system: A comprehensive review
Reda, M., Onsy, A., Haikal, A. Y., & Ghanbari, A. (2024) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2024.104630 · Cited by 301
Ford Multi-AV Seasonal Dataset
Agarwal, S., Vora, A., Pandey, G., Williams, W., Kourous, H., & McBride, J. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364920961451 · Cited by 186
“Many research groups have relied on camera-based solutions (Davison et al., 2007; Nguyen et al., 2011; Redmon et al., 2016; Schafer et al., 2018; Yogamani et al., 2019) on account of their high resolution and inexpensive nature.”
BackgroundTuray, T., & Vladimirova, T. (2022) · IEEE Access · doi:10.1109/access.2022.3147495 · Cited by 131
Metadata
- Authors
- Nguyen, T.-N., Michaelis, B., Al-Hamadi, A., Tornow, M., & Meinecke, M.-M.
- Affiliations
- Otto-von-Guericke-Universität Magdeburg (DE)
- Volkswagen Group (Germany) (DE)
- ORCID
- Al-Hamadi, Ayoub
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2012-03
- Volume
- 13
- Issue
- 1
- Pages
- 154-165
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2100193157
- Cited by
- 80
- References
- 38
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 3 · 2022: 7 · 2021: 3 · 2020: 7 · 2019: 4 · 2018: 5 · 2017: 5 · 2016: 10 · 2015: 14 · 2014: 16 · 2013: 4
- FWCI
- 13.10
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Intelligent Transportation Systems (publishedVersion)
- Topics
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- stereo camera, urban perception, occupancy grid, object tracking, Dempster-Shafer theory, interacting multiple model estimator, obstacle detection, autonomous driving
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.