Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving
The DOI matches its Crossref record; 21 of the 22 references it cites were found in a registry or an index.
Abstract
To investigate the impact of visualizing car uncertainty on drivers' trust during an automated driving scenario, a simulator study was conducted. A between-group design experiment with 59 Swedish drivers was carried out where a continuous representation of the uncertainty of the car's ability to autonomously drive during snow conditions was displayed to one of the groups, whereas omitted for the control group. The results show that, on average, the group of drivers who were provided with the uncertainty representation took control of the car faster when needed, while they were, at the same time, the ones who spent more time looking at other things than on the road ahead. Thus, drivers provided with the uncertainty information could, to a higher degree, perform tasks other than driving without compromising with driving safety. The analysis of trust shows that the participants who were provided with the uncertainty information trusted the automated system less than those who did not receive such information, which indicates a more proper trust calibration than in the control group.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most commonly, the trust calibration was measured as the statistical diferences of trustworthiness perceptions of systems with high reliability and trustworthiness perceptions of systems with low-reliability groups, examined through analysis of variance (see, e.g., [4, 15, 26, 47, 58, 61, 68-70, 82, 84, 89, 90, 107, 117, 130, 140, 145]).”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [47]
In the citing paper
“For example, it was found that uncertainty information [47], the display of confdence levels [145], and reliability updates [90] facilitated an appropriate trust calibration and performance.”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [47]
Citations
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“Studies from other domains, such as the aviation domain, have shown that the anticipated positive effects of automation might be diminished due to human-automation cooperation related problems, such as automation misuse and disuse [1, 2], automation surprises and mode confusion [3, 4], reduced situation awareness [5],…”
BackgroundHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 1×
“Studies from other domains, such as the aviation domain, have shown that the anticipated positive effects of automation might be diminished due to human-automation cooperation related problems, such as automation misuse and disuse [1, 2], automation surprises and mode confusion [3, 4], reduced situation awareness [5],…”
BackgroundFoundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710 · cited 1×
“Studies from other domains, such as the aviation domain, have shown that the anticipated positive effects of automation might be diminished due to human-automation cooperation related problems, such as automation misuse and disuse [1, 2], automation surprises and mode confusion [3, 4], reduced situation awareness [5],…”
BackgroundKlauer, S. G., Dingus, T. A., Neale, V. L., Sudweeks, J. D., & Ramsey, D. J. (2006) · PsycEXTRA Dataset · doi:10.1037/e729262011-001 · Cited by 1,669
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · cited 3×
“Further, the control group showed tendencies of automation bias, resulting in inappropriate calibrations of trust, which is also in line with research presented by [13], where it was concluded that people generally have positive expectations of unfamiliar automated decision aids.”
BackgroundResultInfluentialTrust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932
Aviation Automation: The Search for A Human-centered Approach
Billings, C. E. (1996) · Medical Entomology and Zoology · Cited by 845
Beggiato, M., & Krems, J. F. (2013) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2012.12.006 · Cited by 327
Research works printed but not linked: 3
- 10.1518/hfes.46.1.50.30392 · doi:10.1518/hfes.46.1.50.30392 · Paper page
- N. B. Sarter , D. D. Woods , and C. E. Billings , " Automation surprises," Handbook of human factors and ergonomics , vol. 2 , pp. 1926 -- 1943 , 1997 . N. B. Sarter, D. D. Woods, and C. E. Billings, "Automation surprises," Handbook of human factors and ergonomics, vol. 2, pp. 1926--1943, 1997.
- A. Schieben , T. Gerald , F. Köster , and F. Flemisch , " How to interact with a highly automated vechible. Generic interaction design schemes and test results of a usability assessment " in Human Centred Automation , D. de Waard, N. Gérard, L. Omnasch, R. Wiczoreck, and D. H. Manzey, Eds., ed: Shaker Publishing , pp. 251 -- 267 , 2011 . A. Schieben, T. Gerald, F. Köster, and F. Flemisch, "How to interact with a highly automated vechible. Generic interaction design schemes and test results of a usability assessment " in Human Centred Automation, D. de Waard, N. Gérard, L. Omnasch, R. Wiczoreck, and D. H. Manzey, Eds., ed: Shaker Publishing, pp. 251--267, 2011.
Cited by
Items 101–200 of 285
Detjen, H., Salini, M., Kronenberger, J., Geisler, S., & Schneegaß, S. (2021) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3447526.3472041 · Cited by 31
“[20] found in an empirical simulator study that displaying continuous support system uncertainty during automated driving better prepares drivers for a take-over situation.”
BackgroundConceptual design and evaluation of a human machine interface for highly automated truck driving
Richardson, N. T., Lehmer, C., Lienkamp, M., & Michel, B. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500520 · Cited by 34
“In terms of trust, information on why automation failed or why automation executes various actions is necessary [15–18].”
BackgroundACLS: Adaptive and Conditional Label Smoothing for Network Calibration
Park, H.-K., Noh, J., Oh, Y., Baek, D., & Ham, B. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00364 · Cited by 36
“On the contrary, deep neural networks (DNNs) often struggle to achieve such levels of calibration, which is problematic particularly in applications involving high levels of uncertainty and reasoning, including autonomous driving [9, 13, 31] and medical diagnosis [1, 14, 23].”
BackgroundTenhundfeld, N. L., Demir, M., & de Visser, E. J. (2022) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434221096261 · Cited by 30
“…various methods such as explicitly communicating performance history (Chen et al., 2018), allowing for the user to verify the system ’ s performance or behaviors (Bahner et al., 2008), conveying uncertainty (Helldin et al., 2013), and explaining the nature of errors made (Dzindolet et al., 2003).”
MethodTrust Calibration through Reliability Displays in Automated Vehicles
Noah, B. E., & Walker, B. N. (2017) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3029798.3034802 · Cited by 25
DeGuzman, C. A., Hopkins, S. A., & Donmez, B. (2020) · Transportation Research Record Journal of the Transportation Research Board · doi:10.1177/0361198120912228 · Cited by 23
“study (6), the participants could understand why the automation might have failed, other studies used system-malfunction failures, in which drivers are presented with automation failures that occur for seemingly no reason.”
BackgroundInfluentialExperiencing Autonomous Vehicles
Meschtscherjakov, A., Tscheligi, M., Szostak, D., Ratan, R., McCall, R., Politis, I., & Krome, S. (2015) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2702613.2702661 · Cited by 23
“In order to gain expertize beyond the automotive domain we like to address issues such as level of automation [5], visualization of uncertainty in autonomous cars [2], automated vehicles in the wild, the transition phase from manually driven cars to autonomous vehicles [3], and driving fun and entertainment in future…”
BackgroundBraun, M., Pfleging, B., & Alt, F. (2018) · Multimodal Technologies and Interaction · doi:10.3390/mti2040075 · Cited by 31
“Previous work has tackled these issues, for example, by featuring system uncertainty in the user interface of autonomous cars to manage trust levels [38] or by involving the passive driver through gamification [39].”
BackgroundHow should autonomous vehicles overtake other drivers?
Ritchie, O. T., Watson, D. G., Griffiths, N., Misyak, J. B., Chater, N., Xu, Z., & Mouzakitis, A. (2019) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2019.09.016 · Cited by 27
Enhancing Driving Safety and User Experience Through Unobtrusive and Function-Specific Feedback
Kunze, A., Summerskill, S. J., Marshall, R., & Filtness, A. (2017) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3131726.3131762 · Cited by 26
“Already, this has shown benefits regarding the practicability of NDRTs [11], but solutions that do not require the driver to glance to the instrument cluster will likely improve this further.”
BackgroundInfluentialTakeover request (TOR) effects during different automated vehicle failures
DeGuzman, C. A., Kanaan, D., Hopkins, S. A., & Donmez, B. (2021) · Journal of Intelligent Transportation Systems · doi:10.1080/15472450.2021.1891536 · Cited by 30
“Displays presenting information about the automation status (e.g., Helldin et al., 2013; Seppelt & Lee, 2019) or the surrounding traffic (e.g., He, Kanaan, & Donmez, 2021) have been found to be helpful to drivers in responding to and anticipating automation failures that require their intervention.”
Kox, E. S., Siegling, L. B., & Kerstholt, J. H. (2022) · International Journal of Social Robotics · doi:10.1007/s12369-022-00871-4 · Cited by 22
“Communicating uncertainty has proved to be effective in calibrating trust prior to a potential trust violation [38], whereas offering an apology has shown to be effective afterwards, in case of a false detection or a miss [23].”
BackgroundInfluentialA Novel Cooperation-Guided Warning of Invisible Danger from AR-HUD to Enhance Driver’s Perception
You, F., Zhang, J., Zhang, J., Shen, L., Fang, W., Cui, W., & Wang, J. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2233734 · Cited by 32
“Some studies have shown that visually presenting the information of reliability or uncertainty of the system can help the driver to form appropriate trust (Helldin et al., 2013; Kunze et al., 2019).”
BackgroundFirst Workshop on Trust in the Age of Automated Driving
Noah, B. E., Wintersberger, P., Mirnig, A. G., Thakkar, S., Yan, F., Gable, T. M., Kraus, J., & McCall, R. (2017) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3131726.3131733 · Cited by 24
“To account for over-trust, proposed methods include presenting system uncertainty and reliance [6], reliability displays [17].”
MethodUsing a Parking Assist System Over Time: Insights on Acceptance and Experiences
Trösterer, S., Wurhofer, D., Rödel, C., & Tscheligi, M. (2014) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/2667317.2667327 · Cited by 23
“[9] show that trust in an autonomous vehicle is negatively affected by the visualization of car uncertainty.”
BackgroundSaito, Y., Watahiki, Y., Leung, C., Zhou, H., & Itoh, M. (2022) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2022.01.003 · Cited by 19
Vasile, L., Seitz, B., Staab, V., Liebherr, M., Daesch, C., & Schramm, D. H. (2023) · Applied Sciences · doi:10.3390/app13158855 · Cited by 26
Colley, M., Speidel, O., Strohbeck, J., Rixen, J. O., Belz, J. H., & Rukzio, E. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3631408 · Cited by 33
“Helldin et al. [41] used bars to indicate certainty.”
BackgroundInitial Trustworthiness Perceptions of a Drone System based on Performance and Process Information
Jensen, T., Albayram, Y., Khan, M. M. H., Buck, R., Coman, E., & Fahim, M. A. A. (2018) · Proceedings of the 6th International Conference on Human-Agent Interaction · doi:10.1145/3284432.3284435 · Cited by 19
“In another similar study, drivers who were shown performance information about an autonomous driving system were found to have lower trust levels than those not shown the information, and were more prepared to take over control from the automation [15].”
BackgroundHelgath, J., Braun, P., Pritschet, A., Schubert, M., Böhm, P., & Isemann, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-91806-8_19 · Cited by 20
Adaptive Trust Calibration for Supervised Autonomous Vehicles
Okamura, K., & Yamada, S. (2018) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3239092.3265948 · Cited by 24
“Studies on visualizing car uncertainty during automated driving [8, 11] have indicated that providing good transparency by constantly presenting the system information is important to maintain continuous trust calibration.”
BackgroundDriving Scenario Perception-Aware Computing System Design in Autonomous Vehicles
Zhao, H., Zhang, Y., Meng, P., Shi, H., Li, L. E., Lou, T., & Zhao, J. (2020) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd50377.2020.00031 · Cited by 25
“Most previous AV system designs focus on developing software module algorithms [3], [12], [17], [18], [20], [26], [27], [32].”
BackgroundMethodHow does relaxing posture influence take-over performance in an automated vehicle?
Yang, Y., Gerlicher, M., & Bengler, K. J. (2018) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931218621157 · Cited by 21
Fereydooni, N., Tenenboim, E., Walker, B. N., & Peeta, S. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3203086 · Cited by 20
“The literature also suggests that the communication between the user and an AI system can improve users’ trust towards the system through the information it conveys [18, 39, 50].”
BackgroundAre You Ready for a Drive? User Perspectives on Autonomous Vehicles
Niculescu, A. I., Dix, A. J., & Yeo, K. H. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3053182 · Cited by 18
“However, while most work has been on technical features, little has been done in the way of UX design and user research [9][4].”
BackgroundA novel membership cloud model‐based trust evaluation model for vehicular ad hoc network of T‐CPS
Sun, D., Zhao, H., & Cheng, S. (2016) · Security and Communication Networks · doi:10.1002/sec.1730 · Cited by 17
Calibrating Trust in Human-Drone Cooperative Navigation
Okamura, K., & Yamada, S. (2020) · IEEE RO-MAN · doi:10.1109/ro-man47096.2020.9223509 · Cited by 24
“This result is not in line with previous studies such as [7], [25] that emphasized the effectiveness of trust calibration with continuous system transparency.”
BackgroundResultEvaluating feedback requirements for trust calibration in automated vehicles
Wintersberger, P., Janotta, F., Peintner, J. B., Löcken, A., & Riener, A. (2021) · it - Information Technology · doi:10.1515/itit-2020-0024 · Cited by 23
Gao, Q., Chen, L., Shi, Y., Luo, Y., Shen, M., & Gao, Z. (2024) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2024.09.019 · Cited by 19
Where we come from and where we are going: a review of automated driving studies
Forster, Y., Frison, A.-K., Wintersberger, P., Geisel, V., Hergeth, S., & Riener, A. (2019) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3349263.3351341 · Cited by 17
“Here, many issues such as trust [12, 13], controllability [18], fatigue [14] or mode awareness [6] have been discovered.”
BackgroundData Fusion in Infrastructure-Augmented Autonomous Driving System: Why? Where? and How?
Wang, J., Wang, Z., Yu, B., Tang, J., Song, S. L., Liu, C., & Hu, Y. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3266247 · Cited by 22
How much do you Trust your Self-Driving Car? Exploring Human-Robot Trust in High-Risk Scenarios
Xu, J. C., & Howard, A. (2020) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc42975.2020.9282866 · Cited by 19
“Helldin et al. [18] examined the relationship between the uncertainty of autonomous driving ability and driver’s trust during snowy conditions.”
BackgroundKox, E. S., van den Boogaard, J., Turjaka, V., & Kerstholt, J. H. (2024) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3702245 · Cited by 19
“Ideally, transparency allows the human teammate to develop and/or maintain realistic expectations regarding the robot and its behaviour [35, 57] and thereby contributes to effective trust calibration [6, 30, 72].”
“Can you rely on me?” Evaluating a Confidence HMI for Cooperative, Automated Driving
Peintner, J. B., Manger, C., & Riener, A. (2022) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3543174.3546976 · Cited by 17
“The concepts used in related literature mostly focus on the use of uncertainty information to prepare the human driver for an imminent automation failure and a resulting TOR [2, 15, 19, 20].”
BackgroundMethodInfluentialVerame, J. K. M., Costanza, E., & Ramchurn, S. D. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858369 · Cited by 15
“Prior work [5, 18] has also investigated the effect of displaying the confidence information of self-driving cars.”
BackgroundResultFrom V2X to Control2Trust: Why Trust and Control Are Major Attributes in Vehicle2X Technologies
Schmidt, T., Philipsen, R., & Ziefle, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20376-8_51 · Cited by 20
“This finding lines to the research of reported by [6], which reported that implications on information is still discussed.”
BackgroundResultTowards Safety-Aware Computing System Design in Autonomous VehiclesPreprint
Zhao, H., Zhang, Y., Meng, P., Shi, H., Li, L. E., Lou, T., & Zhao, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.08453 · Cited by 25
“Previous works also investigate ways of effectively responding to uncertainty at real-time [15,32,39] and path planning to avoid static obstacles [23].”
Figalová, N., Chuang, L. L., Pichen, J., Baumann, M. R. K., & Pollatos, O. (2022) · Multimodal Technologies and Interaction · doi:10.3390/mti6090073 · Cited by 17
Monsaingeon, N., Caroux, L., Langlois, S., & Lemercier, C. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1107847 · Cited by 20
Influences of Level 2 Automated Driving on Driver Behaviors: A Comparison With Manual Driving
Yang, B., Inoue, K., Yan, Z., Wang, Z., Kitazaki, S., & Nakano, K. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3308569 · Cited by 17
“To improve drivers’ OEDR and their understandings of the current states of automated driving systems, previous studies were conducted to develop human machine interfaces for improving the interactions between drivers and vehicles [24], [25], [26], [27], [28].”
MethodMa, J., & Feng, X. (2023) · Sustainability · doi:10.3390/su16010063 · Cited by 16
Guided By AI: Navigating Trust, Bias, and Data Exploration in AI‐Guided Visual Analytics
Ha, S., Monadjemi, S., & Ottley, A. (2024) · Computer Graphics Forum · doi:10.1111/cgf.15108 · Cited by 26
“A common approach to promote transparency is showing uncertainties [HFRD13, ZLB20, BSO15] of the AI .”
Towards a Personalized Trust Model for Highly Automated Driving
Wintersberger, P., Frison, A.-K., Riener, A., & Boyle, L. N. (2016) · Gesellschaft für Informatik (GI) · doi:10.18420/muc2016-ws08-0008 · Cited by 15
Challenges in Partially Automated Driving : A Human Factors Perspective
Marcos, I. S. (2018) · Linköping studies in behavioural science · doi:10.3384/diss.diva-147764 · Cited by 20
Aremyr, E., Jönsson, M., & Strömberg, H. K. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-96074-6_37 · Cited by 19
To See or Not to See: The Effect of Object Recognition on Users' Trust in "Automated Vehicles"
Ekman, F., Johansson, M., & Sochor, J. (2016) · Nordic Conference on Human-Computer Interaction · doi:10.1145/2971485.2971551 · Cited by 15
Second Workshop on Trust in the Age of Automated Driving
Wintersberger, P., Noah, B. E., Kraus, J., McCall, R., Mirnig, A. G., Kunze, A., Thakkar, S., & Walker, B. N. (2018) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3239092.3239099 · Cited by 16
“To account for overtrust, proposed methods include presenting system uncertainty/reliance [3] in form of reliability displays [16].”
Feeling Uncertain—Effects of a Vibrotactile Belt that Communicates Vehicle Sensor Uncertainty
Krüger, M., Driessen, T., Wiebel-Herboth, C. B., de Winter, J., & Wersing, H. (2020) · Information · doi:10.3390/info11070353 · Cited by 14
“Furthermore, it was found that drivers showed a more appropriate trust calibration [13,15,18] and gave higher acceptance ratings for such systems [13] compared to baseline conditions.”
Monsaingeon, N., Caroux, L., Langlois, S., Hurgobin, Y., & Lemercier, C. (2020) · Le travail humain · doi:10.3917/e.th.834.0343 · Cited by 19
Building Collaborative Test Practices: Design Ethnography and WOz in Autonomous Driving Research
Osz, K., Rydström, A., Fors, V., Pink, S., & Broström, R. (2018) · Interaction design & architecture(s)/ID&A Interaction design & architecture(s) · doi:10.55612/s-5002-037-001 · Cited by 23
Schewe, F., & Vollrath, M. (2021) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2021.03.005 · Cited by 13
Influence of meta-information on decision-making: Lessons learned from four case studies
Riveiro, M., Helldin, T., & Falkman, G. (2014) · IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support · doi:10.1109/cogsima.2014.6816534 · Cited by 13
“was conducted (a detailed description of our investigations can be read in [21]).”
BackgroundSelf-citationBoelhouwer, A., van Dijk, J., & Martens, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22666-4_1 · Cited by 16
ATHENA: supporting UX of conditionally automated driving with natural language reliability displays
Frison, A.-K., Wintersberger, P., Oberhofer, A., & Riener, A. (2019) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3349263.3351312 · Cited by 14
“Existing studies could already show the potential of reliability displays in TOR scenarios [14] and we hypothesize that these positive attributes also have positive effects on users’ need fulfillment, and thus overall experience.”
BackgroundDeGuzman, C. A., & Donmez, B. (2024) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2024.09.025 · Cited by 13
1st Workshop on Ethically Inspired User Interfaces for Automated Driving
Riener, A., Jeon, M., Álvarez, I., Pfleging, B., Mirnig, A. G., Tscheligi, M., & Chuang, L. L. (2016) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3004323.3005687 · Cited by 13
Borojeni, S. S., Meschtscherjakov, A., Mirnig, A. G., Boll, S., Naujoks, F., Politis, I., & Alverez, I. (2017) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3131726.3131732 · Cited by 11
“Besides the design of imminent TORs, recent research has started to focus on how on-trip information about the automated ride, such as the reliability of the automated driving feature [4] or the time left in automated mode [2] can be used to further enhance human performance in takeover situations.”
BackgroundA comfort evaluation method based on an intelligent car cockpit
Yang, J., Chen, Y., Xing, S., & Qiu, R. (2022) · Human Factors and Ergonomics in Manufacturing & Service Industries · doi:10.1002/hfm.20973 · Cited by 15
“The real benefits of intelligent cars can only be realized when the human driver is comfortable in the intelligent cockpit and the interaction between the driver and the automated system is at a reasonable level (Helldin et al., 2013).”
BackgroundMethodologies to assess usability and safety of ADAS and automated vehicle
Pauzié, A., & Orfila, O. (2016) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2016.12.192 · Cited by 17
Measuring trust in automated driving using a multi-level approach to human factors
Clement, P., Danzinger, H., Veledar, O., Könczöl, C., Macher, G., & Eichberger, A. (2021) · Euromicro Conference on Digital System Design (DSD) · doi:10.1109/dsd53832.2021.00069 · Cited by 13
“The expression of trust questionnaire is a variation of [21], which is built on the original trust in automation scale [24].”
BackgroundGerber, M. A., Schroeter, R., Johnson, D. M., Janssen, C. P., Rakotonirainy, A., Kuo, J., & Lenné, M. G. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642219 · Cited by 14
Stange, V., Steimle, M., Maurer, M., & Vollrath, M. (2022) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2022.100701 · Cited by 10
“, 2017 for a trust-based framework for HMI design), uncertainty displays (e.g., Beller et al., 2013; Helldin et al., 2013), automation malfunctions (e.”
Background2nd Workshop on User Experience of Autonomous Driving
Meschtscherjakov, A., Ratan, R., Tscheligi, M., McCall, R., Szostak, D., Politis, I., & Krome, S. (2014) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/2667239.2667425 · Cited by 10
Forster, Y., Hergeth, S., Naujoks, F., Krems, J. F., & Keinath, A. (2019) · Multimodal Technologies and Interaction · doi:10.3390/mti3020029 · Cited by 13
“, [35,36]) the influence is not as pervasive in the present study.”
BackgroundZhang, Y., Angell, L., & Bao, S. (2021) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2021.100337 · Cited by 12
Thill, S., Riveiro, M., Lagerstedt, E., Lebram, M., Hemeren, P., Habibovic, A., & Klingegård, M. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.05.009 · Cited by 10
Self-citationDynamic Selection of Reliance Calibration Cues With AI Reliance Model
Fukuchi, Y., & Yamada, S. (2023) · IEEE Access · doi:10.1109/access.2023.3339548 · Cited by 16
“This paper considers the situation of calibrating reliance by explicitly communicating an AI’s capability through RCCs. Previous studies have mainly focused on providing RCCs continuously [13], [14].”
BackgroundHuman-AI Teamwork Interface Design Using Patterns of Interactions
Momose, K., Mehta, R., Moukpe, J., Weekes, T. R., & Eskridge, T. C. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2389350 · Cited by 13
“The precedents include, for instance, presenting uncertainty/confidence information (e.g., (Beller et al., 2013; Helldin et al., 2013; Kunze et al., 2019; Peintner et al., 2022, 2023)) and offering recommended actions when a takeover request is issued (e.g., (Borojeni et al., 2016, 2017; Shi et…”
Peintner, J. B., Manger, C., & Riener, A. (2023) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3580585.3607154 · Cited by 12
Do We Blindly Trust Self-Driving Cars
Andersen, K. E., Köslich, S., Pedersen, B. K. M. K., Weigelin, B. C., & Jensen, L. C. (2017) · Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3029798.3038428 · Cited by 9
“Work by Helldin et al. [3] suggests that drivers, who receive information about an SDCs uncertainty on how to act in a given situation, tend to trust the car less than drivers who did not receive such information.”
BackgroundHanding over the Keys: A Qualitative Study of the Experience of Automation in Driving
Linehan, C., Murphy, G., Hicks, K., Gerling, K., & Morrissey, K. (2019) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2019.1565482 · Cited by 12
“These results reflect the findings of Gempton et al. (2013) work with automated military logistic vehicles and also Helldin et al. (2013) on people ’ s ability to recognize problems with automated systems.”
ResultGerber, M. A., Faramarzian, M., & Schroeter, R. (2022) · Studies in computational intelligence · doi:10.1007/978-3-030-77726-5_18 · Cited by 10
Fröhlich, P., Mirnig, A. G., Falcioni, D., Schrammel, J., Diamond, L. M., Fischer, I., & Tscheligi, M. (2022) · Quality and User Experience · doi:10.1007/s41233-022-00053-0 · Cited by 10
The Human Element in Autonomous Vehicles
Dunbar, J., & Gilbert, J. E. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-58475-1_26 · Cited by 10
Farooq, A., Evreinov, G., & Raisamo, R. (2019) · SN Applied Sciences · doi:10.1007/s42452-019-0923-4 · Cited by 10
“Head up displays (HUDs), continuous information mediation in automated driving, and glasses have been proposed to solve the problem as they seem to be superior to manual driving assisted with dashboard-mounted displays [3, 4].”
BackgroundPractising Appropriate Trust in Human-Centred AI Design
Degachi, C., Mehrotra, S., Yurrita, M., Niforatos, E., & Tielman, M. L. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650825 · Cited by 10
“Researchers have also explored uncertainty communication [16] and verbal assurances [2].”
Hecht, T., Danner, S., Feierle, A., & Bengler, K. J. (2020) · Multimodal Technologies and Interaction · doi:10.3390/mti4030036 · Cited by 8
Bjørner, T. (2015) · VBN Forskningsportal (Aalborg Universitet) · Cited by 17
Trust and Automation: A Systematic Review and Bibliometric Analysis
Zhang, Z. J., Duffy, V. G., & Tian, R. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-90238-4_32 · Cited by 9
Personality Affects Dispositional Trust and History-Based Trust in Different Ways
Liang, J., Gao, Q., Wen-min, L., Shi, Y., Shen, M., & Gao, Z. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2055273 · Cited by 9
“…of transparency and HMI: the levels of driver trust are significantly raised via improving the transparency of the AD system (Forster et al., 2017; Helldin et al., 2013; Kraus et al., 2015), and can be further improved by using social cues in HMI (e.g., anthropomorphism, sharing the goals between…”
BackgroundManchon, J. B., Beaufort, R., Bueno, M., & Navarro, J. (2022) · Information · doi:10.3390/info13100480 · Cited by 8
“, in foggy weather) also supports TiAD calibration [18,19].”
BackgroundEvaluation of Variables for the Communication of Uncertainties Using Peripheral Awareness Displays
Kunze, A., Summerskill, S. J., Marshall, R., & Filtness, A. (2018) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3239092.3265958 · Cited by 12
Auditory Displays for Automated Driving — Challenges and Opportunities
Larsson, P., Maculewicz, J., Fagerlönn, J., & Lachmann, M. (2019) · International Conference on Auditory Display (ICAD) · doi:10.21785/icad2019.038 · Cited by 9
Towards Trustworthy Predictions from Deep Neural Networks with Fast Adversarial Calibration
Tomani, C., & Buettner, F. (2021) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v35i11.17188 · Cited by 26
A Systematic Review of Metrics Measuring Takeover Performance in Conditionally Automated Driving
Han, D. W., Chung, H., Cao, Y., Zhou, F., Molnar, L. J., Robert, L., Tilbury, D. M., & Yang, X. J. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2552863 · Cited by 9
“…lane keeping maneuvers include missing lane mark (Mok et al., 2017b, 2015b; Naujoks et al., 2017), construction zone ahead (e.g., on the road shoulder) (Mok et al., 2015b, 2017a; Van Der Heiden et al., 2017; Wiedemann et al., 2018), special weather such as heavy snow (Helldin et al., 2013).”
Building Transparent and Personalized AI Support in Air Traffic Control
Westin, C., Hilburn, B., Borst, C., Kampen, E.-J. V., & Bång, M. (2020) · IEEE/AIAA Digital Avionics Systems Conference (DASC) · doi:10.1109/dasc50938.2020.9256708 · Cited by 13
“…different reasons, such as to explain abnormal automation behavior [23], why the automation might err [24], the behavior of intelligent agents and autonomous robots [25] [26], as an indication of the automation’s reliability [27], and the automation’s proximity to its performance envelope [28].”
BackgroundJansen, P., Colley, M., Pfeifer, T., & Rukzio, E. (2024) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2024.05.015 · Cited by 10
“Helldin, Falkman, Riveiro and Davidsson (2013) used bars to indicate the operation certainty (they call it “reliability”).”
BackgroundDriving Behavior Analysis: A Human Factors Perspective on Automated Driving Styles
Peintner, J. B., Himmels, C., Rock, T., Manger, C., Jung, O., & Riener, A. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588527 · Cited by 14
“Some research investigated the effects of presenting information about the environment to the driver, while other research [10]–[12] has focused on increasing system transparency.”
BackgroundHolthausen, B. E., Stuck, R. E., & Walker, B. N. (2022) · Studies in computational intelligence · doi:10.1007/978-3-030-77726-5_2 · Cited by 11
Do engineer perceptions about automated vehicles match user trust? Consequences for design
Walker, F., Steinke, J., Martens, M., & Verwey, W. B. (2020) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2020.100251 · Cited by 12
Jansen, P., Colley, M., Krauß, S., Hirschle, D., & Rukzio, E. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713514 · Cited by 20
Doula, A., Mühlhäuser, M., & Guinea, A. S. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00026 · Cited by 12
“Effective visualization of uncertainty can improve user trust [25, 58], decision quality [25, 30], and equalize decision-making capabilities across different expertise levels [27].”
Calibration of Trust in Autonomous Vehicle
Lee, S. C., & Ji, Y. G. (2022) · Automation, collaboration, and e-services · doi:10.1007/978-3-031-10784-9_16 · Cited by 6
Lawson-Guidigbe, C., Louveton, N., Amokrane, K., Blanc, B. L., & André, J. (2023) · International Journal of Mobile Human Computer Interaction · doi:10.4018/ijmhci.330542 · Cited by 11
Ritchie, O. T., Watson, D. G., Griffiths, N., Xu, Z., & Mouzakitis, A. (2021) · Accident Analysis & Prevention · doi:10.1016/j.aap.2021.106385 · Cited by 6
Drivers Quickly Trust Autonomous Cars
Broström, R., Rydström, A., & Kopp, C. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-94947-5_69 · Cited by 7
Human-in-the-Loop Methods for Data-Driven and Reinforcement Learning SystemsPreprint
Goecks, V. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.13221 · Cited by 17
“This is directly correlated with the unpredictability of the robot [139], their rate of success and reliability [140, 141, 142], and how knowledgeable the user is about an autonomous system [143] and the task to be completed [144].”
BackgroundIncreasing system transparency through confidence information in cooperative, automated driving
Peintner, J. B., Manger, C., & Riener, A. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2407018 · Cited by 7
“(3) a ‘Confidence-Bar’ HMI (Figure 5) that on top showed a confidence level for the auto-mation’s current judgment represented as a segmented bar, similar to Helldin et al. (2013).”
InfluentialJansen, P., Colley, M., Rädler, M., Schwedler, J., & Rukzio, E. (2025) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2025.05.013 · Cited by 6
Trust in Automation: The Effects of System Certainty on Decision-Making
Luster, M. S., & Pitts, B. J. (2021) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181321651079 · Cited by 11
“For example, Helldin et al. (2013) presented the level of uncertainty of a semi-autonomous driving system to drivers via a car’s dashboard.”
BackgroundMethodResult
Metadata
- Authors
- Helldin, T., Falkman, G., Riveiro, M., & Davidsson, S.
- Affiliations
- University of Skövde (SE)
- Volvo (Sweden) (SE)
- Venue
- Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
- Publisher
- ACM
- Published
- 2013-10-28
- Pages
- 210-217
- OpenAlex
- W2161054318
- Cited by
- 286
- References
- 22
- Citations by year
- 2026: 13 · 2025: 19 · 2024: 19 · 2023: 22 · 2022: 32 · 2021: 30 · 2020: 41 · 2019: 33 · 2018: 28 · 2017: 19 · 2016: 14 · 2015: 8 · 2014: 8
- FWCI
- 20.10
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) (publishedVersion)
- Funders
- Swedish Knowledge Foundation (2010/0320 (UMIF), Vinnova)
- University of Skövde
- National Aviation Engineering Research Program (NFFP5-2009-01315)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Keywords
- trust calibration, autonomous driving, uncertainty visualization, automotive user interfaces, driver trust in automation, snow conditions, driver workload, driver attention, human-automation interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.