Semiautonomous Vehicular Control Using Driver Modeling
The DOI matches its Crossref record; 47 of the 49 references it cites were found in a registry or an index.
Abstract
Threat assessment during semiautonomous driving is used to determine when correcting a driver's input is required. Since current semiautonomous systems perform threat assessment by predicting a vehicle's future state while treating the driver's input as a disturbance, autonomous controller intervention is limited to a restricted regime. Improving vehicle safety demands threat assessment that occurs over longer prediction horizons wherein a driver cannot be treated as a malicious agent. In this paper, we describe a real-time semiautonomous system that utilizes empirical observations of a driver's pose to inform an autonomous controller that corrects a driver's input when possible in a safe manner. We measure the performance of our system using several metrics that evaluate the informativeness of the prediction and the utility of the intervention procedure. A multisubject driving experiment illustrates the usefulness, with respect to these metrics, of incorporating the driver's pose while designing a semiautonomous system.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Algorithm AS 136: A K-Means Clustering Algorithm
Hartigan, J. A., & Wong, M. A. (1979) · Applied Statistics · doi:10.2307/2346830 · Cited by 14,523 · cited 1×
“This marginal distribution, which allows us to determine the VPM, is constructed by first clustering the data using a k-means algorithm [36] and then constructing an empirical distribution within each cluster separately.”
MethodAn Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855
Rajamani, R. (2012) · Mechanical Engineering Series · doi:10.1007/978-1-4614-1433-9 · Cited by 4,401 · cited 1×
“ential equations based on the bicycle model described in [34] to describe the vehicle motion within the lane:”
MethodReal-time human pose recognition in parts from single depth images
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995316 · Cited by 3,491
Stanley: The robot that won the DARPA Grand Challenge
Thrun, S., Montemerlo, M., Dahlkamp, H., Stavens, D., Aron, A., Diebel, J., Fong, P., Gale, J., Halpenny, M., Hoffmann, G., et al. (2006) · Journal of Field Robotics · doi:10.1002/rob.20147 · Cited by 2,237
Klauer, S. G., Dingus, T. A., Neale, V. L., Sudweeks, J. D., & Ramsey, D. J. (2006) · PsycEXTRA Dataset · doi:10.1037/e729262011-001 · Cited by 1,669 · cited 1×
“Several studies have estimated, using data from vehicles instrumented with cameras, that driver distraction contributes to between 22% and 50% of all crashes [2], [3].”
Autonomous driving in urban environments: Boss and the Urban Challenge
Urmson, C., Anhalt, J., Bagnell, D., Baker, C., Bittner, R., Clark, M. N., Dolan, J., Duggins, D., Galatali, T., Geyer, C., et al. (2008) · Journal of Field Robotics · doi:10.1002/rob.20255 · Cited by 1,555
Smart cars on smart roads: problems of control
Varaiya, P. (1993) · IEEE Transactions on Automatic Control · doi:10.1109/9.250509 · Cited by 1,383 · cited 1×
“A potential resolution to the driver distraction problem is the autonomous vehicle [6]–[9].”
Background(2006) · Mechanical Engineering Series · doi:10.1007/0-387-28823-6 · Cited by 1,129
Model predictive control based on linear programming - the explicit solution
Bemporad, A., Borrelli, F., & Morari, M. (2002) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2002.805688 · Cited by 756 · cited 1×
“Here, we formulate the lane-keeping and obstacle-avoidance problem as a model predictive control (MPC) problem [37].”
MethodSelf-citationReal-Time System for Monitoring Driver Vigilance
Bergasa, L. M., Nuevo, J., Sotelo, M. A., Barea, R., & Lopez, M. E. (2006) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2006.869598 · Cited by 714
Driver Distraction: Theory, Effects, and Mitigation
(2008) · CRC Press eBooks · doi:10.1201/9781420007497 · Cited by 439
Constrained Optimal Control of Linear and Hybrid Systems
(2003) · Lecture Notes in Control and Information Sciences · doi:10.1007/3-540-36225-8 · Cited by 429
Morris, B. T., & Trivedi, M. M. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.64 · Cited by 349 · cited 1×
“Trajectory prediction models, on the other hand, restrict themselves to specific maneuvers [24], [25] or scenarios [26] and do not consider the driver state [27], [28].”
BackgroundProbabilistic trajectory prediction with Gaussian mixture models
Wiest, J., Hoffken, M., Kresel, U., & Dietmayer, K. (2012) · 2012 IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2012.6232277 · Cited by 337 · cited 1×
“Trajectory prediction models, on the other hand, restrict themselves to specific maneuvers [24], [25] or scenarios [26] and do not consider the driver state [27], [28].”
BackgroundA Driver Behavior Recognition Method Based on a Driver Model Framework
Kuge, N., Yamamura, T., Shimoyama, O., & Liu, A. (2000) · SAE Technical Paper Series · doi:10.4271/2000-01-0349 · Cited by 278 · cited 1×
“Oftentimes, the high-level driver behavior is linked with hybrid or hidden Markov models to predict driver intentions [29], [30] and incorporate human factors such as comfort and skill level [24], and even day-to-day experiences [31].”
BackgroundGraphical models for driver behavior recognition in a SmartCar
Oliver, N., & Pentland, A. P. (2002) · Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511) · doi:10.1109/ivs.2000.898310 · Cited by 276 · cited 1×
“Oftentimes, the high-level driver behavior is linked with hybrid or hidden Markov models to predict driver intentions [29], [30] and incorporate human factors such as comfort and skill level [24], and even day-to-day experiences [31].”
BackgroundAnderson, S. J., Peters, S. C., Pilutti, T. E., & Iagnemma, K. (2010) · International Journal of Vehicle Autonomous Systems · doi:10.1504/ijvas.2010.035796 · Cited by 255 · cited 1×
“Fortunately, recent advances in numerical optimization have shown that provably safe controllers can be designed rapidly and robustly given a particular circumstance [11], [12].”
BackgroundStanley: The Robot That Won the DARPA Grand Challenge
Thrun, S., Montemerlo, M., Dahlkamp, H., Stavens, D., Aron, A., Diebel, J., Fong, P., Gale, J., Halpenny, M., Hoffmann, G., et al. (2007) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-540-73429-1_1 · Cited by 237
A tube-based robust nonlinear predictive control approach to semiautonomous ground vehicles
Gao, Y., Gray, A., Tseng, H. E., & Borrelli, F. (2014) · Vehicle System Dynamics · doi:10.1080/00423114.2014.902537 · Cited by 219 · cited 1×
“Recent work in [48] has reduced the sampling time”
BackgroundSelf-citationGindele, T., Brechtel, S., & Dillmann, R. (2010) · 13th International IEEE Conference on Intelligent Transportation Systems · doi:10.1109/itsc.2010.5625262 · Cited by 200 · cited 1×
“Trajectory prediction models, on the other hand, restrict themselves to specific maneuvers [24], [25] or scenarios [26] and do not consider the driver state [27], [28].”
BackgroundGraph Degree Linkage: Agglomerative Clustering on a Directed Graph
Zhang, W., Wang, X., Zhao, D., & Tang, X. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33718-5_31 · Cited by 163 · cited 1×
“Future work includes developing and implementing a better unsupervised learning algorithm, such as hierarchical clustering or active learning using convex programming [39], [40].”
MethodLong-term vehicle motion prediction
Hermes, C., Wöhler, C., Schenk, K., & Kümmert, F. (2009) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2009.5164354 · Cited by 163
Modeling and prediction of driver behavior by foot gesture analysis
Tran, C., Doshi, A., & Trivedi, M. M. (2011) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2011.09.008 · Cited by 129
A Convex Optimization Framework for Active Learning
Elhamifar, E., Sapiro, G., Yang, A., & Sasrty, S. S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.33 · Cited by 127
Tactical driver behavior prediction and intent inference: A review
Doshi, A., & Trivedi, M. M. (2011) · 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2011.6083128 · Cited by 123
On-road prediction of driver's intent with multimodal sensory cues
Doshi, A., Morris, B. T., & Trivedi, M. M. (2011) · IEEE Pervasive Computing · doi:10.1109/mprv.2011.38 · Cited by 110 · cited 1×
“head position or attitude and implementing articulated tracking systems such as those proposed in [21], [43], and [44].”
BackgroundRobust Predictive Control for semi-autonomous vehicles with an uncertain driver model
Gray, A., Gao, Y., Hedrick, J. K., & Borrelli, F. (2013) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2013.6629472 · Cited by 99
Self-citationFacial expression analysis for predicting unsafe driving behavior
Jabon, M. E., Bailenson, J. N., Pontikakis, E., Takayama, L., & Nass, C. (2011) · IEEE Pervasive Computing · doi:10.1109/mprv.2010.46 · Cited by 90
Mobile Agent Trajectory Prediction using Bayesian Nonparametric Reachability Trees
Aoude, G. S., Joseph, J., Roy, N., & How, J. P. (2011) · AIAA Infotech@Aerospace Conference · doi:10.2514/6.2011-1512 · Cited by 80 · cited 1×
“or obstacles in the environment, such as those proposed in [45], [46], will be critical.”
BackgroundAn Examination of Driver Distraction as Recorded in NHTSA Databases
Ascone, D. (2009) · PsycEXTRA Dataset · doi:10.1037/e624032011-001 · Cited by 78 · cited 1×
“Alarmingly, a recent report has indicated that the percentage of fatal crashes due to distraction is rising [5].”
BackgroundSafe semi-autonomous control with enhanced driver modeling
Vasudevan, R., Shia, V., Gao, Y., Cervera-Navarro, R., Bajcsy, R., & Borrelli, F. (2012) · 2012 American Control Conference (ACC) · doi:10.1109/acc.2012.6315654 · Cited by 77 · cited 6×
“This component is needed as the poor performance of not incorporating observations and future predictions of the driver was shown in [13].”
BackgroundMethodInfluentialSelf-citationEquilibrium Analysis of Drifting Vehicles for Control Design
Hindiyeh, R. Y., & Gerdes, J. C. (2009) · ASME Dynamic Systems and Control Conference (DSCC) · doi:10.1115/dscc2009-2626 · Cited by 72 · cited 1×
“fc is computed using a modified nonlinear Fiala tire model [35]”
MethodFletcher, L., Apostoloff, N., Petersson, L., & Zelinsky, A. (2003) · IEEE Intelligent Systems · doi:10.1109/mis.2003.1200722 · Cited by 70 · cited 1×
“sors [20]–[22] to predict driver behavior to provide warnings of impending danger.”
BackgroundDriving Safety Monitoring Using Semisupervised Learning on Time Series Data
Wang, J., Zhu, S., & Gong, Y. (2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2050200 · Cited by 63 · cited 1×
“method to perform this operation was proposed in [41].”
MethodVision-based methods for driver monitoring
Wahlstrom, E., Masoud, O., & Papanikolopoulos, N. (2004) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2003.1252617 · Cited by 62
Peeta, S., & Yu, J. W. (2004) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2003.822272 · Cited by 60 · cited 1×
“Oftentimes, the high-level driver behavior is linked with hybrid or hidden Markov models to predict driver intentions [29], [30] and incorporate human factors such as comfort and skill level [24], and even day-to-day experiences [31].”
BackgroundGaze Fixation System for the Evaluation of Driver Distractions Induced by IVIS
Gil-Jiménez, P., Bergasa, L. M., Nuevo, J., Hernández, N., & Daza, I. G. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2012.2187517 · Cited by 59 · cited 1×
“Second, different types of driver distraction, such as those considered in [42], may require the inclusion of additional joints such as”
BackgroundBody sensor networks for driver distraction identification
Sathyanarayana, A., Nageswaren, S., Ghasemzadeh, H., Jafari, R., & Hansen, J. H. L. (2008) · 2008 IEEE International Conference on Vehicular Electronics and Safety · doi:10.1109/icves.2008.4640876 · Cited by 59 · cited 1×
“Other communities have used body sensors on the driver [16], eye trackers [17], facial tracking [18], [19], or other sen-”
Kress‐Gazit, H., Conner, D. C., Choset, H., Rizzi, A. A., & Pappas, G. J. (2008) · IEEE Robotics & Automation Magazine · doi:10.1109/m-ra.2007.914921 · Cited by 58 · cited 1×
“A potential resolution to the driver distraction problem is the autonomous vehicle [6]–[9].”
BackgroundDriver inattention, driver distraction and traffic crashes
Stutts, J. C., & Hunter, W. W. (2003) · Cited by 48
Tran, C., & Trivedi, M. M. (2010) · 2010 IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2010.5547957 · Cited by 46 · cited 1×
“sors [20]–[22] to predict driver behavior to provide warnings of impending danger.”
BackgroundIn-vehicle hand activity recognition using integration of regions
Ohn-Bar, E., & Trivedi, M. M. (2013) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2013.6629602 · Cited by 45
Smartphone Use While Driving: A Simulator Study
Basacik, D., Reed, N., & Robbins, R. (2012) · Cited by 42
Scoping study of driver distraction
Basacik, D., & Stevens, A. (2008) · Project report - Transport Research Laboratory · Cited by 17
Trajectory generation based vehicle action tracking for intersection driving safe
Li, M., & Zhou, T. (2011) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2011.5940512 · Cited by 5 · cited 1×
“Trajectory prediction models, on the other hand, restrict themselves to specific maneuvers [24], [25] or scenarios [26] and do not consider the driver state [27], [28].”
BackgroundDriving course prediction for vehicle handling maneuvers
Liu, R., Yu, H. N., McGee, R. A., & Murphey, Y. L. (2012) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2012.6315104 · Cited by 2
Research works printed but not linked: 6
- brown, 2013, California Driver Handbook—Safe Driving Practices
- hartigan, 1979, A K-means clustering algorithm, J R Stat Soc Ser C Appl Stat, 28, 100
- 2011, Fatality Analysis Reporting System
- knight, 2013, Driverless cars are further away than you think, MIT Technology Review
- coelingh, 2007, Collision warning with auto brake—A real-life safety perspective
- beiker, 2012, CARS—Stanford's Automotive Affiliates Program
Cited by
Planning and Decision-Making for Autonomous Vehicles
Schwarting, W., Alonso-Mora, J., & Rus, D. (2018) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-060117-105157 · Cited by 972
“(26) minimized the difference in steering wheel angle from the human predicted control input, which is necessary to achieve safe trajectories.”
BackgroundCar that Knows Before You Do: Anticipating Maneuvers via Learning Temporal Driving Models
Jain, A., Koppula, H. S., Raghavan, B., Soh, S., & Saxena, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.364 · Cited by 274
“Still in the US alone more than 33,000 people die in road accidents every year, the majority of which are due to inappropriate maneuvers [3].”
BackgroundCar that Knows Before You Do: Anticipating Maneuvers via Learning Temporal Driving Models
Jain, A., Koppula, H. S., Raghavan, B., Soh, S., & Saxena, A. (2015) · arXiv · doi:10.48550/arxiv.1504.02789 · Cited by 274
Li, N., Oyler, D. W., Zhang, M., Yildiz, Y., Kolmanovsky, I., & Girard, A. R. (2018) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2017.2723574 · Cited by 276
Recurrent Neural Networks for driver activity anticipation via sensory-fusion architecture
Jain, A., Singh, A., Koppula, H. S., Soh, S., & Saxena, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487478 · Cited by 271
“Our work is also related to works on driver behavior prediction with different sensors [17, 14, 13, 9], and vehicular controllers which act on these predictions [33, 38, 11].”
Background
Metadata
- Authors
- Shia, V. A., Gao, Y., Vasudevan, R., Campbell, K. D., Lin, T., Borrelli, F., & Bajcsy, R.
- Affiliations
- University of California, Berkeley (US)
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2014-12
- Volume
- 15
- Issue
- 6
- Pages
- 2696-2709
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2016284836
- Cited by
- 114
- References
- 49
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 3 · 2023: 5 · 2022: 7 · 2021: 9 · 2020: 10 · 2019: 18 · 2018: 17 · 2017: 12 · 2016: 12 · 2015: 10 · 2014: 5
- FWCI
- 19.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Intelligent Transportation Systems (publishedVersion)
- Funders
- National Science Foundation (ECCS-0931437, ECCS-1239323, DGE-0903711)
- Hyundai Center for Excellence, University of California at Berkeley
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Engineering › Automotive Engineering › Vehicle Dynamics and Control Systems
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Keywords
- driver modeling, threat assessment, prediction horizon, driver-vehicle interaction, real-time control
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.