The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Head Pose Estimation and Augmented Reality Tracking: An Integrated System and Evaluation for Monitoring Driver Awareness
Abstract
Driver distraction and inattention are prominent causes of automotive collisions. To enable driver-assistance systems to address these problems, we require new sensing approaches to infer a driver's focus of attention. In this paper, we present a new procedure for static head-pose estimation and a new algorithm for visual 3-D tracking. They are integrated into the novel real-time (30 fps) system for measuring the position and orientation of a driver's head. This system consists of three interconnected modules that detect the driver's head, provide initial estimates of the head's pose, and continuously track its position and orientation in six degrees of freedom. The head-detection module consists of an array of Haar-wavelet Adaboost cascades. The initial pose estimation module employs localized gradient orientation (LGO) histograms as input to support vector regressors (SVRs). The tracking module provides a fine estimate of the 3-D motion of the head using a new appearance-based particle filter for 3-D model tracking in an augmented reality environment. We describe our implementation that utilizes OpenGL-optimized graphics hardware to efficiently compute particle samples in real time. To demonstrate the suitability of this system for real driving situations, we provide a comprehensive evaluation with drivers of varying ages, race, and sex spanning daytime and nighttime conditions. To quantitatively measure the accuracy of system, we compare its estimation results to a marker-based cinematic motion-capture system installed in the automotive testbed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,387
Haykin, S. (1986) · Cited by 12,603
A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking
Arulampalam, M. S., Maskell, S., Gordon, N., & Clapp, T. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/78.978374 · Cited by 11,502
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,122
Sequential Monte Carlo Methods in Practice
(2001) · Springer eBooks · doi:10.1007/978-1-4757-3437-9 · Cited by 7,366
A performance evaluation of local descriptors
Mikolajczyk, K., & Schmid, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.188 · Cited by 6,723
Support Vector Regression Machines
Drucker, H., Burges, C. J. C., Kaufman, L., Smola, A. J., & Vapnik, V. N. (1996) · Cited by 4,658
Wittenmark, B. (1993) · Automatica · doi:10.1016/0005-1098(93)90162-m · Cited by 3,056
An extended set of Haar-like features for rapid object detection
Lienhart, R., & Maydt, J. (2003) · Proceedings. International Conference on Image Processing · doi:10.1109/icip.2002.1038171 · Cited by 2,977 · cited 1×
“To detect the location of the driver's head, we use three Adaboost cascades attuned to the left profile, frontal, and right profile faces [30], [31].”
MethodMultiple View Geometry in Computer Vision (2nd ed)
Hartley, R. I., & Zisserman, A. (2003) · Cambridge University Press eBooks · Cited by 2,761
Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning
Айзерман, М. А. (1964) · Automation and Remote Control · Cited by 1,485
Head Pose Estimation in Computer Vision: A Survey
Murphy-Chutorian, E., & Trivedi, M. M. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.106 · Cited by 1,301
Self-citationReal-Time System for Monitoring Driver Vigilance
Bergasa, L. M., Nuevo, J., Sotelo, M. A., Barea, R., & Lopez, M. E. (2006) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2006.869598 · Cited by 714
Looking-In and Looking-Out of a Vehicle: Computer-Vision-Based Enhanced Vehicle Safety
Trivedi, M. M., Gandhi, T., & McCall, J. (2007) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2006.889442 · Cited by 317
Self-citationDetermining driver visual attention with one camera
Smith, P., Shah, M., & da Vitoria Lobo, N. (2003) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2003.821342 · Cited by 316
On the Roles of Eye Gaze and Head Dynamics in Predicting Driver's Intent to Change Lanes
Doshi, A., & Trivedi, M. M. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2026675 · Cited by 297
Self-citationLane Change Intent Analysis Using Robust Operators and Sparse Bayesian Learning
McCall, J. C., Wipf, D. P., Trivedi, M. M., & Rao, B. D. (2007) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2007.902640 · Cited by 254
Self-citationSupport vector regression and classification based multi-view face detection and recognition
Li, Y., Gong, S., & Liddell, H. (2002) · Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580) · doi:10.1109/afgr.2000.840650 · Cited by 235
Parametrized structure from motion for 3D adaptive feedback tracking of faces
Jebara, T. S., & Pentland, A. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609312 · Cited by 225
Modeling focus of attention for meeting indexing based on multiple cues
Stiefelhagen, R., Yang, J., & Waibel, A. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.1021893 · Cited by 171
The influence of head contour and nose angle on the perception of eye-gaze direction
Langton, S. R. H., Honeyman, H., & Tessler, E. (2004) · Perception & Psychophysics · doi:10.3758/bf03194970 · Cited by 163
Kessenich, J., Baldwin, D., & Rost, R. J. (2006) · Cited by 161
A Novel Active Heads-Up Display for Driver Assistance
Doshi, A., Cheng, S. Y., & Trivedi, M. M. (2008) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2008.923527 · Cited by 128
Self-citationAdaptive view-based appearance models
Morency, L., Rahimi, A., & Darrell, T. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2003.1211435 · Cited by 124
Turn-Intent Analysis Using Body Pose for Intelligent Driver Assistance
Cheng, S. Y., & Trivedi, M. M. (2006) · IEEE Pervasive Computing · doi:10.1109/mprv.2006.88 · Cited by 110
Self-citationRecognition of human head orientation based on artificial neural networks
Rae, R., & Ritter, H. J. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.661121 · Cited by 101
The influence of passengers on the risk of the driver causing a car collision in Spain
Rueda-Domingo, T., Lardelli-Claret, P., Luna-del-Castillo, J. D. D., Jiménez-Moleón, J. J., Garcı́a-Martı́n, M., & Bueno-Cavanillas, A. (2004) · Accident Analysis & Prevention · doi:10.1016/s0001-4575(03)00043-5 · Cited by 96
Holistic Sensing and Active Displays for Intelligent Driver Support Systems
Trivedi, M. M., & Cheng, S. Y. (2007) · Computer · doi:10.1109/mc.2007.170 · Cited by 94
Self-citationHammoud, R. I. (2008) · Springer eBooks · doi:10.1007/978-3-540-75412-1 · Cited by 93
Robust real-time detection, tracking, and pose estimation of faces in video streams
Huang, K. S., & Trivedi, M. M. (2004) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2004.1334689 · Cited by 75
Self-citationReal-time non-rigid driver head tracking for driver mental state estimation
Baker, S. (2018) · doi:10.1184/r1/6559916 · Cited by 55
Accurate Head Pose Tracking in Low Resolution Video
Tu, J., Huang, T. S., & Hai, T. (2006) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fgr.2006.19 · Cited by 37
Head Pose Estimation System Based on Particle Filtering with Adaptive Diffusion Control
Oka, K., Sato, Y., Nakanishi, Y., & Koike, H. (2005) · Machine Vision Applications · Cited by 33
Head and Facial Animation Tracking Using Appearance-Adaptive Models and Particle Filters
Davoine, F., & Dornaika, F. (2005) · Springer eBooks · doi:10.1007/0-387-27890-7_8 · Cited by 33
Head and Facial Animation Tracking using Appearance-Adaptive Models and Particle Filters
Dornaika, F., & Davoine, F. (2005) · IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvpr.2004.359 · Cited by 19
Real-Time Modeling of Face Deformation for 3D Head Pose Estimation
Oka, K., & Sato, Y. (2005) · Lecture notes in computer science · doi:10.1007/11564386_24 · Cited by 15
Murphy-Chutorian, E., & Trivedi, M. M. (2008) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4563102 · Cited by 9
Self-citation
Cited by
Detecting Driver Drowsiness Based on Sensors: A Review
Sahayadhas, A., Sundaraj, K., & Murugappan, M. (2012) · Sensors · doi:10.3390/s121216937 · Cited by 782
Driver Activity Recognition for Intelligent Vehicles: A Deep Learning Approach
Xing, Y., Lv, C., Wang, H., Cao, D., Velenis, E., & Wang, F.-Y. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2908425 · Cited by 399
Driver Gaze Tracking and Eyes Off the Road Detection System
Vicente, F., Huang, Z., Xiong, X., De la Torre, F., Zhang, W., & Levi, D. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2396031 · Cited by 362
Liu, H., Liu, T., Zhang, Z., Sangaiah, A. K., Yang, B., & Li, Y. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3143605 · Cited by 288
WONG, I. S., POPKIN, S., & FOLKARD, S. (2019) · Industrial Health · doi:10.2486/indhealth.sw-6 · Cited by 88
Metadata
- Authors
- Murphy-Chutorian, E., & Trivedi, M. M.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2010-06
- Volume
- 11
- Issue
- 2
- Pages
- 300-311
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2142578527
- Cited by
- 290
- References
- 42
- FWCI
- 20.27
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.