Head, Eye, and Hand Patterns for Driver Activity Recognition
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
In this paper, a multiview, multimodal vision framework is proposed in order to characterize driver activity based on head, eye, and hand cues. Leveraging the three types of cues allows for a richer description of the driver's state and for improved activity detection performance. First, regions of interest are extracted from two videos, one observing the driver's hands and one the driver's head. Next, hand location hypotheses are generated and integrated with a head pose and facial landmark module in order to classify driver activity into three states: wheel region interaction with two hands on the wheel, gear region activity, or instrument cluster region activity. The method is evaluated on a video dataset captured in on-road settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
From eye movements to actions: how batsmen hit the ball
Land, M. F., & McLeod, P. (2000) · Nature Neuroscience · doi:10.1038/81887 · Cited by 725 · cited 1×
“…behavior studies involving various natural dynamic activities including driving [5], [6], typing [7], walking ([8]), throwing in basketball [9], batting in cricket ([10]) etc., suggest a common finding that gaze shifts and fixations are controlled pro actively to gather visual information for…”
Background
Cited by
Autonomous Vehicles That Interact With Pedestrians: A Survey of Theory and Practice
Rasouli, A., & Tsotsos, J. K. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2901817 · Cited by 855
Ohn-Bar, E., & Trivedi, M. M. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2337331 · Cited by 455
Self-citationDriver Activity Recognition for Intelligent Vehicles: A Deep Learning Approach
Xing, Y., Lv, C., Wang, H., Cao, D., Velenis, E., & Wang, F.-Y. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2908425 · Cited by 399
Drive&Act: A Multi-Modal Dataset for Fine-Grained Driver Behavior Recognition in Autonomous Vehicles
Martin, M., Roitberg, A., Haurilet, M., Horne, M., ReiB, S., Voit, M., & Stiefelhagen, R. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00289 · Cited by 192
“whether the person is holding the steering wheel, or switching gear [35]).”
BackgroundMethodInfluentialLe, T. H. N., Zheng, Y., Zhu, C., Luu, K., & Savvides, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.13 · Cited by 168
“Unlike the previous hands on wheel detection approaches [13, 14, 12, 22, 16, 21], the proposed method first makes use of deep features extracted from our MS-FRCNN approach to individually detect the hand and the steering wheel.”
MethodDriver-Activity Recognition in the Context of Conditionally Autonomous Driving
Braunagel, C., Kasneci, E., Stolzmann, W., & Rosenstiel, W. (2015) · 2015 IEEE 18th International Conference on Intelligent Transportation Systems · doi:10.1109/itsc.2015.268 · Cited by 109
Federated Learning-based Driver Activity Recognition for Edge Devices
Doshi, K., & Yilmaz, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00377 · Cited by 53
A Comparative Analysis of Decision-Level Fusion for Multimodal Driver Behaviour Understanding
Roitberg, A., Peng, K., Marinov, Z., Seibold, C., Schneider, D., & Stiefelhagen, R. (2022) · 2022 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/iv51971.2022.9827426 · Cited by 20
Metadata
- Authors
- Ohn-Bar, E., Martin, S., Tawari, A., & Trivedi, M. M.
- Venue
- 2014 22nd International Conference on Pattern Recognition
- Publisher
- IEEE
- Published
- 2014-08
- Pages
- 660-665
- ISSN
- 1041-3278 (ISSN-L)
- OpenAlex
- W2152264487
- Cited by
- 139
- References
- 2
- FWCI
- 16.92
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.