Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving
The DOI matches its Crossref record; 21 of the 22 references it cites were found in a registry or an index.
Abstract
To investigate the impact of visualizing car uncertainty on drivers' trust during an automated driving scenario, a simulator study was conducted. A between-group design experiment with 59 Swedish drivers was carried out where a continuous representation of the uncertainty of the car's ability to autonomously drive during snow conditions was displayed to one of the groups, whereas omitted for the control group. The results show that, on average, the group of drivers who were provided with the uncertainty representation took control of the car faster when needed, while they were, at the same time, the ones who spent more time looking at other things than on the road ahead. Thus, drivers provided with the uncertainty information could, to a higher degree, perform tasks other than driving without compromising with driving safety. The analysis of trust shows that the participants who were provided with the uncertainty information trusted the automated system less than those who did not receive such information, which indicates a more proper trust calibration than in the control group.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most commonly, the trust calibration was measured as the statistical diferences of trustworthiness perceptions of systems with high reliability and trustworthiness perceptions of systems with low-reliability groups, examined through analysis of variance (see, e.g., [4, 15, 26, 47, 58, 61, 68-70, 82, 84, 89, 90, 107, 117, 130, 140, 145]).”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [47]
In the citing paper
“For example, it was found that uncertainty information [47], the display of confdence levels [145], and reliability updates [90] facilitated an appropriate trust calibration and performance.”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [47]
Citations
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“Studies from other domains, such as the aviation domain, have shown that the anticipated positive effects of automation might be diminished due to human-automation cooperation related problems, such as automation misuse and disuse [1, 2], automation surprises and mode confusion [3, 4], reduced situation awareness [5],…”
BackgroundHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 1×
“Studies from other domains, such as the aviation domain, have shown that the anticipated positive effects of automation might be diminished due to human-automation cooperation related problems, such as automation misuse and disuse [1, 2], automation surprises and mode confusion [3, 4], reduced situation awareness [5],…”
BackgroundFoundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710 · cited 1×
“Studies from other domains, such as the aviation domain, have shown that the anticipated positive effects of automation might be diminished due to human-automation cooperation related problems, such as automation misuse and disuse [1, 2], automation surprises and mode confusion [3, 4], reduced situation awareness [5],…”
BackgroundKlauer, S. G., Dingus, T. A., Neale, V. L., Sudweeks, J. D., & Ramsey, D. J. (2006) · PsycEXTRA Dataset · doi:10.1037/e729262011-001 · Cited by 1,669
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · cited 3×
“Further, the control group showed tendencies of automation bias, resulting in inappropriate calibrations of trust, which is also in line with research presented by [13], where it was concluded that people generally have positive expectations of unfamiliar automated decision aids.”
BackgroundResultInfluentialTrust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932
Aviation Automation: The Search for A Human-centered Approach
Billings, C. E. (1996) · Medical Entomology and Zoology · Cited by 845
Beggiato, M., & Krems, J. F. (2013) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2012.12.006 · Cited by 327
Research works printed but not linked: 3
- 10.1518/hfes.46.1.50.30392 · doi:10.1518/hfes.46.1.50.30392 · Paper page
- N. B. Sarter , D. D. Woods , and C. E. Billings , " Automation surprises," Handbook of human factors and ergonomics , vol. 2 , pp. 1926 -- 1943 , 1997 . N. B. Sarter, D. D. Woods, and C. E. Billings, "Automation surprises," Handbook of human factors and ergonomics, vol. 2, pp. 1926--1943, 1997.
- A. Schieben , T. Gerald , F. Köster , and F. Flemisch , " How to interact with a highly automated vechible. Generic interaction design schemes and test results of a usability assessment " in Human Centred Automation , D. de Waard, N. Gérard, L. Omnasch, R. Wiczoreck, and D. H. Manzey, Eds., ed: Shaker Publishing , pp. 251 -- 267 , 2011 . A. Schieben, T. Gerald, F. Köster, and F. Flemisch, "How to interact with a highly automated vechible. Generic interaction design schemes and test results of a usability assessment " in Human Centred Automation, D. de Waard, N. Gérard, L. Omnasch, R. Wiczoreck, and D. H. Manzey, Eds., ed: Shaker Publishing, pp. 251--267, 2011.
Cited by
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
Zhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
“While the concept of trust calibration has been studied for automation [13, 18, 20, 26], as to prevent both automation aversion and automation bias, it is not well understood in the context of AI systems.”
BackgroundAlmost human: Anthropomorphism increases trust resilience in cognitive agents.
de Visser, E. J., Monfort, S. S., McKendrick, R., Smith, M. A. B., McKnight, P. E., Krueger, F., & Parasuraman, R. (2016) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000092 · Cited by 614
Determinants of take-over time from automated driving: A meta-analysis of 129 studies
Zhang, B., de Winter, J., Varotto, S., Happee, R., & Martens, M. (2019) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2019.04.020 · Cited by 431
Introduction matters: Manipulating trust in automation and reliance in automated driving
Körber, M., Baseler, E., & Bengler, K. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2017.07.006 · Cited by 418
Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams
de Visser, E. J., Peeters, M. M. M., Jung, M. F., Kohn, S., Shaw, T. H., Pak, R., & Neerincx, M. A. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-019-00596-x · Cited by 447
“…of the operator [38] \ Convey uncertainty directly Conveying uncertainty directly by providing facial cues [8] or machine confidence indicators [36,57,62,86,97,157] \ Provide verification methods Offering methods for detailed verification of the system’s behavior and performance to reduce the…”
MethodAutonomous Vehicles: Disengagements, Accidents and Reaction Times
Dixit, V. V., Chand, S., & Nair, D. J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0168054 · Cited by 399
Psychosocial factors associated with intended use of automated vehicles: A simulated driving study
Buckley, L., Kaye, S.-A., & Pradhan, A. K. (2018) · Accident Analysis & Prevention · doi:10.1016/j.aap.2018.03.021 · Cited by 345
Towards Autonomous Cars: The Effect of Autonomy Levels on Acceptance and User Experience
Rödel, C., Stadler, S., Meschtscherjakov, A., & Tscheligi, M. (2014) · Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/2667317.2667330 · Cited by 334
“Helldin et al. [12] suggest that visualizing the uncertainty of a car during an automated driving scenario helps drivers to regain control over the vehicle faster.”
BackgroundMeasurement of trust in automation: A narrative review and reference guide
Kohn, S. C., de Visser, E. J., Wiese, E., Lee, Y.-C., & Shaw, T. H. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.604977 · Cited by 315
“High trust results in longer reaction times because over-reliance on the automation causes the operator to be unprepared to respond, requiring greater mental effort and duration to switch tasks (Beller et al., 2013; Helldin et al., 2013; Körber et al., 2018).”
BackgroundKraus, J., Scholz, D., Stiegemeier, D., & Baumann, M. (2020) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819853686 · Cited by 276
“Knowledge about situations leading to a TOR or entailing a higher risk for system malfunctions may reduce uncertainties and therefore help users to calibrate their trust more efficiently (e.g., Helldin et al., 2013) and use the system safely.”
BackgroundThe influence of age on the take-over of vehicle control in highly automated driving
Körber, M., Gold, C., Lechner, D., & Bengler, K. (2016) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2016.03.002 · Cited by 245
Adaptive trust calibration for human-AI collaboration
Okamura, K., & Yamada, S. (2020) · PLOS ONE · doi:10.1371/journal.pone.0229132 · Cited by 239
“Studies on visualizing car uncertainty during autonomous driving [16, 17] have indicated that providing good transparency by constantly presenting the system information helps maintain appropriate trust of the vehicles.”
BackgroundHow to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229
“No source stated - ✗ ✓ ✓ [193] No source stated - ✓ ✗ ✓ [235] No definition: [1, 4, 8, 22, 24, 26, 27, 33, 34, 38, 42, 50, 56, 60, 67, 71, 75, 81, 84, 87, 89, 91, 97, 107, 112, 118, 122, 123, 126, 136, 150, 154, 156, 165, 166, 170, 176, 177, 180, 185, 196–198, 201, 207, 210, 214–216, 219–221, 225,…”
Louw, T., & Merat, N. (2017) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2017.01.001 · Cited by 216
Asleep at the automated wheel—Sleepiness and fatigue during highly automated driving
Vogelpohl, T., Kühn, M., Hummel, T., & Vollrath, M. (2019) · Accident Analysis & Prevention · doi:10.1016/j.aap.2018.03.013 · Cited by 214
Understanding Blind People's Experiences with Computer-Generated Captions of Social Media Images
MacLeod, H., Bennett, C. L., Morris, M. R., & Cutrell, E. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025814 · Cited by 200
“In fact, there is even research on how to encourage people to have more trust in these intelligent systems (e.g., [1,2,15,30]).”
BackgroundRapid Trust Calibration through Interpretable and Uncertainty-Aware AI
Tomsett, R., Preece, A., Braines, D., Cerutti, F., Chakraborty, S., Srivastava, M., Pearson, G., & Kaplan, L. (2020) · Patterns · doi:10.1016/j.patter.2020.100049 · Cited by 186
“…have found that particular non-probabilistic representations of uncertainty or confidence can lead to improved trust calibration in specific settings, 79,80 but further work is needed to understand the best way to represent different kinds of uncertainty under different circum-stances and how best…”
BackgroundCreating Appropriate Trust in Automated Vehicle Systems: A Framework for HMI Design
Ekman, F., Johansson, M., & Sochor, J. (2018) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2017.2776209 · Cited by 169
“Adaptive automation Systems that have the ability to adapt to the user’s preferences [2], [19].”
BackgroundDu, N., Haspiel, J., Zhang, Q., Tilbury, D., Pradhan, A. K., Yang, X. J., & Robert, L. P. (2019) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2019.05.025 · Cited by 167
Kunze, A., Summerskill, S. J., Marshall, R., & Filtness, A. J. (2019) · Ergonomics · doi:10.1080/00140139.2018.1547842 · Cited by 165
“In contrast to previous research (Helldin et al. 2013), TTT values were not significantly affected.”
BackgroundResultInfluentialDu, N., Zhou, F., Pulver, E. M., Tilbury, D. M., Robert, L. P., Pradhan, A. K., & Yang, X. J. (2020) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2020.01.006 · Cited by 161
Situational Awareness, Driver’s Trust in Automated Driving Systems and Secondary Task Performance
Petersen, L., Robert, L., Yang, X. J., & Tilbury, D. (2019) · SAE International Journal of Connected and Automated Vehicles · doi:10.4271/12-02-02-0009 · Cited by 152
“Existing studies have looked primarily at two areas: graphically displaying some sort of “uncertainty” metric to the driver [2, 11, 31, 38] and looking at the effect of missed alarms and false alarms on a driver’s response to feedback from the vehicle [19, 21].”
BackgroundHow to Increase Automated Vehicles’ Acceptance through In-Vehicle Interaction Design: A Review
Detjen, H., Faltaous, S., Pfleging, B., Geisler, S., & Schneegaß, S. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2020.1860517 · Cited by 174
Mehrotra, S., Degachi, C., Vereschak, O., Jonker, C. M., & Tielman, M. L. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3696449 · Cited by 144
“When analyzing the breadth of user studies included in this review ( 𝑛 = 46, 45 .”
Effects of explanation types and perceived risk on trust in autonomous vehicles
Ha, T., Kim, S., Seo, D., & Lee, S. (2020) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2020.06.021 · Cited by 164
Wischnewski, M., Krämer, N., & Müller, E. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581197 · Cited by 146
“For example, Helldin et al. [47] let participants drive an autonomous vehicle in a driving simulator but manipulated the weather conditions (sight was afected by snow) or the terrain of the course (steep climbs & tight turns), which, in turn, afected the system’s reliability.”
BackgroundInfluentialTransitioning to manual driving requires additional time after automation deactivation
Vogelpohl, T., Kuhn, M. G., Hummel, T., Gehlert, T., & Vollrath, M. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.03.019 · Cited by 156
Khastgir, S., Birrell, S., Dhadyalla, G., & Jennings, P. (2018) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.07.001 · Cited by 134
“These results differ from the study in (Helldin et al., 2013) and (Hergeth, 529 Lorenz and Krems, 2017).”
ResultWintersberger, P., Frison, A.-K., Riener, A., & von Sawitzky, T. (2018) · PRESENCE Virtual and Augmented Reality · doi:10.1162/pres_a_00320 · Cited by 144
“…level-5 vehicles (SAE, 2014) have not yet been developed, studies on trust in automated vehicles (AVs) either address lower levels of automation (Helldin, Falkman, Riveiro, & Davidsson, 2013), are purely survey-based (Rödel, Stadler, Meschtscherjakov, & Tscheligi, 2014), or just put automated…”
BackgroundWalch, M., Mühl, K., Kraus, J., Stoll, T., Baumann, M. R. K., & Weber, M. (2017) · Human-computer interaction series · doi:10.1007/978-3-319-49448-7_10 · Cited by 145
Pedestrian Trust in Automated Vehicles: Role of Traffic Signal and AV Driving Behavior
Jayaraman, S. K., Creech, C., Tilbury, D. M., Yang, X. J., Pradhan, A. K., Tsui, K. M., & Robert, L. (2019) · Frontiers in Robotics and AI · doi:10.3389/frobt.2019.00117 · Cited by 133
“Unlike Helldin et al. (2013), we do not quantify uncertainty but use the qualitative relationship between trust and uncertainty from AV driving behavior and/or absence of traffic signal to develop our hypotheses.”
BackgroundTowards guidelines and verification methods for automated vehicle HMIs
Naujoks, F., Wiedemann, K., Schömig, N., Hergeth, S., & Keinath, A. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.10.012 · Cited by 146
Enhancing Trust in Autonomous Vehicles through Intelligent User Interfaces That Mimic Human Behavior
Ruijten, P. A. M., Terken, J. M. B., & Chandramouli, S. N. (2018) · Multimodal Technologies and Interaction · doi:10.3390/mti2040062 · Cited by 142
“[55], and communicated to participants by telling them how certain the system was to drive itself.”
BackgroundLu, Z., Zhang, B., Feldhütter, A., Happee, R., Martens, M., & de Winter, J. (2019) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2019.03.018 · Cited by 121
“Our results align with previous studies (Cohen-Lazry et al., 2017; Dziennus et al., 2016; Gold et al., 2013; Helldin et al., 2013; Yang et al., 2017), which have shown that MRs and other types of uncertainty indicators stimulate driver to allocate attention to the road when encountering an unpredictable driving enviro…”
ResultA Review of Non-driving-related Tasks Used in Studies on Automated Driving
Naujoks, F., Befelein, D., Wiedemann, K., & Neukum, A. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-60441-1_52 · Cited by 143
“Eating Eating sweets that are placed on the passenger seat • • [3; 4] [3; 6] -”
BackgroundWould a robot trust you? Developmental robotics model of trust and theory of mind
Vinanzi, S., Patacchiola, M., Chella, A., & Cangelosi, A. (2019) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2018.0032 · Cited by 130
“Others fields of interest are elderly care [26], robotic-assisted surgery [27], joint-action HRI in the performing arts [28] and autonomous driving [29].”
BackgroundExploring automated vehicle driving styles as a source of trust information
Ekman, F., Johansson, M., Bligård, L., Karlsson, M., & Strömberg, H. K. (2019) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2019.07.026 · Cited by 132
Colley, M., Eder, B., Rixen, J. O., & Rukzio, E. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445351 · Cited by 99
“Helldin et al. [20] also used an abstract representation of uncertainty.”
BackgroundFrom Manual Driving to Automated Driving: A Review of 10 Years of AutoUI
Ayoub, J., Zhou, F., Bao, S., & Yang, X. J. (2019) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3342197.3344529 · Cited by 143
“For example, Helldin et al. [50] showed that drivers trusted in the automated vehicle more when they were provided with uncertainty information of the system.”
BackgroundExploring Personalised Autonomous Vehicles to Influence User Trust
Sun, X. S., Li, J., Tang, P., Zhou, S., Peng, X., Li, H., & Wang, Q. (2020) · Cognitive Computation · doi:10.1007/s12559-020-09757-x · Cited by 107
“For example, Helldin et al. [26] investigated how “ uncertainty information ” about the vehicle ’ s ability to drive by itself, affected the drivers ’ trust in the AV system.”
BackgroundAn Empirical Study of Older Adult’s Voice Assistant Use for Health Information Seeking
Brewer, R., Pierce, C., Upadhyay, P., & Park, L. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3484507 · Cited by 89
“Researchers have noted the need for intelligent systems to help users to uncertainty (e.g., alt-text for people with vision impairments [34], algorithms in autonomous vehicles (i.e., [9, 22]).”
BackgroundSun, X. S., Cao, S. C., & Tang, P. (2020) · Applied Ergonomics · doi:10.1016/j.apergo.2020.103238 · Cited by 99
An interview study exploring Tesla drivers' behavioural adaptation
Lin, R., Ma, L., & Zhang, W. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2018.04.006 · Cited by 101
Driving Style: How Should an Automated Vehicle Behave?
de Oliveira, L. C. R., Proctor, K., Burns, C. G., & Birrell, S. A. (2019) · Information · doi:10.3390/info10060219 · Cited by 99
Naujoks, F., Purucker, C., Neukum, A., Wolter, S. C., & Steiger, R. (2015) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2015.10.022 · Cited by 95
The influence of system transparency on trust: Evaluating interfaces in a highly automated vehicle
de Oliveira, L. C. R., Burns, C. G., Luton, J., Iyer, S., & Birrell, S. A. (2020) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2020.06.001 · Cited by 83
“Studies show that drivers who are provided with information when the system is “uncertain” can take back the control of vehicles faster (Helldin et al., 2013; Lyons, 2013), resulting in safer takeovers (Kunze et al., 2019).”
Background“I’d like an Explanation for That!”Exploring Reactions to Unexpected Autonomous Driving
Wiegand, G., Eiband, M., Haubelt, M., & Hußmann, H. (2020) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3379503.3403554 · Cited by 92
“…different mental models should address the following aspects in particular: • An indication of confidence of the vehicle in the driving decision [23] • Retrievable information from the environment (for example through smart infrastructure or connected cars) and from the vehicle system (for…”
BackgroundColley, M., Rädler, M., Glimmann, J., & Rukzio, E. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534609 · Cited by 75
“Other systems that represent uncertainty in AVs use even more abstract representations (anthropomorphic [2] or abstract levels [34]).”
BackgroundManchon, J.-B., Bueno, M., & Navarro, J. (2021) · PsyArXiv (OSF Preprints) · doi:10.1016/j.trf.2022.02.006 · Cited by 82
Augmented Reality Displays for Communicating Uncertainty Information in Automated Driving
Kunze, A., Summerskill, S. J., Marshall, R., & Filtness, A. (2018) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3239060.3239074 · Cited by 77
“While this has already benefited the practicability of NDRTs [16], solutions that present the information without a”
BackgroundInfluentialTrust in hybrid closed loop among people with diabetes: Perspectives of experienced system users
Tanenbaum, M. L., Iturralde, E., Hanes, S. J., Suttiratana, S. C., Ambrosino, J. M., Ly, T. T., Maahs, D. M., Naranjo, D. M., Walders‐Abramson, N., WEINZIMER, S. A., et al. (2017) · Journal of Health Psychology · doi:10.1177/1359105317718615 · Cited by 68
“Our findings point to a continuum between control and trust that has been highlighted in the literature on trust in other automated systems (e.g. self-driving cars) (Carlson et al., 2014; Heitmeyer and Leonard, 2015; Helldin et al., 2013; Parasuraman and Riley, 1997).”
BackgroundWintersberger, P., Nicklas, H., Martlbauer, T., Hammer, S., & Riener, A. (2020) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3409120.3410659 · Cited by 66
Empirical Evaluations of Framework for Adaptive Trust Calibration in Human-AI Cooperation
Okamura, K., & Yamada, S. (2020) · IEEE Access · doi:10.1109/access.2020.3042556 · Cited by 79
“[24] did experiments with 59 drivers in a simulated autonomous driving environment.”
BackgroundMethodAzevedo-Sa, H., Zhao, H., Esterwood, C. T., Yang, X. J., Tilbury, D. M., & Robert, L. (2021) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2021.102973 · Cited by 70
Wintersberger, P., Riener, A., & Frison, A.-K. (2016) · Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/3003715.3005410 · Cited by 55
“In a similar study, Helldin and colleagues [8] presented confidence of the vehicle’s abilities to study participants and could demonstrate that this leads to a better Take-over performance, even the overall trust in the system was less than in the control group.”
BackgroundA Survey on Trust in Autonomous Systems
Shahrdar, S., Menezes, L., & Nojoumian, M. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-01177-2_27 · Cited by 75
“[40] Drivers who are knowledgeable about risks, when driving in snow conditions, do not trust self-driving cars An autonomous simulator cockpit Knowledge about risks and uncertainties”
BackgroundConveying Uncertainties Using Peripheral Awareness Displays in the Context of Automated Driving
Kunze, A., Summerskill, S. J., Marshall, R., & Filtness, A. (2019) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3342197.3344537 · Cited by 59
“Previous work has indicated the benefits of conveying the inherent uncertainties of the system to help users calibrate their trust [3, 20].”
BackgroundPotential Individual Differences Regarding Automation Effects in Automated Driving
Körber, M., & Bengler, K. J. (2014) · International Conference on Human Computer Interaction (Interacción) · doi:10.1145/2662253.2662275 · Cited by 70
“system’s abilities leads to better takeover reactions in automated driving [25].”
BackgroundCalibrating Trust in Automation Through Familiarity With the Autoparking Feature of a Tesla Model X
Tenhundfeld, N. L., de Visser, E. J., Haring, K. S., Ries, A. J., Finomore, V. S., & Tossell, C. C. (2019) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343419869083 · Cited by 63
“…cues (de Visser, Cohen, Freedy, & Parasuraman, 2014), decision aids (McGuirl & Sarter, 2006), greater transparency (Yang, Unhelkar, Li, & Shah, 2017), causal attributions of automation failures (Pop, Shrews-bury, & Durso, 2015), and system uncertainty (Helldin, Falkman, Riveiro, & Davidsson, 2013).”
Shahini, F., & Zahabi, M. (2022) · Applied Ergonomics · doi:10.1016/j.apergo.2022.103824 · Cited by 58
Effects of User Interfaces on Take-Over Performance: A Review of the Empirical Evidence
Kim, S., van Egmond, R., & Happee, R. (2021) · Information · doi:10.3390/info12040162 · Cited by 57
“In previous work, the automation system’s state was presented with seven levels of capability [21], or the level of uncertainty was indicated as a heart-beat animation with numerical display [23].”
BackgroundMethodResultInfluentialEffects of personality traits on user trust in human–machine collaborations
Zhou, J. J., Luo, S., & Chen, F. (2020) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-020-00329-9 · Cited by 58
“[35] found that the presentation of uncertainty of car’s ability to autonomously drive resulted in the decreased trust in the autonomous system compared to the situation without uncertainty presentation, indicating a more proper trust calibration in automation.”
Lindemann, P., Lee, T. Y., & Rigoll, G. (2018) · Multimodal Technologies and Interaction · doi:10.3390/mti2040071 · Cited by 53
“This indicator can give a single overall rating [39] or sensor-related feedback [37].”
BackgroundToward Immersive Self-Driving Simulations: Reports from a User Study across Six Platforms
Yeo, D., Kim, G., & Kim, S. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376787 · Cited by 59
“For example, they have been used for research on take-over requests [4, 14], trust in autonomous vehicles [13], and driver behavior in self-driving cars [17].”
MethodHöck, P., Kraus, J., Babel, F., Walch, M., Rukzio, E., & Baumann, M. R. K. (2018) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3239060.3239066 · Cited by 72
“To reduce the impact of this error variance to our experimental findings and for standardization and comparability, information prior to experimental interaction with the system should be used to adjust participant’s knowledge [53, 38].”
From manual to automated driving: how does trust evolve?
Manchon, J. B., Bueno, M., & Navarro, J. (2020) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2020.1830450 · Cited by 53
“Similarly, Helldin et al. (2013) used a seven-point uncertainty gauge on the dashboard to display the current AV capability during a simulated drive.”
MethodManchon, J. B., Bueno, M., & Navarro, J. (2021) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208211052804 · Cited by 60
“The discrepancy between subjective trust and measured behavior (compared with results reported in, e.g., Helldin et al., 2013; Hergeth et al., 2016, 2017; Payre et al., 2017; Schwarz et al., 2019; Walker et al., 2019) may also con fi rm that factors linked to dynamic trust produce less in fl uence on…”
ResultIn-vehicle displays to support driver anticipation of traffic conflicts in automated vehicles
He, D., Kanaan, D., & Donmez, B. (2020) · Accident Analysis & Prevention · doi:10.1016/j.aap.2020.105842 · Cited by 52
“…on takeover requests (TORs, i.e. warnings that alert the driver about the need to intervene; e.g., Louw et al., 2015; Melcher et al., 2015) as well as in-vehicle displays that provide information about the automation’s reliability (e.g., Helldin et al., 2013) or limits (e.g., Seppelt & Lee, 2007).”
BackgroundPersonality Openness Predicts Driver Trust in Automated Driving
Wen-min, L., Yao, N., Shi, Y., Nie, W., Zhang, Y., Li, X., Liang, J., Chen, F., & Gao, Z. (2020) · Automotive Innovation · doi:10.1007/s42154-019-00086-w · Cited by 46
“The first line addressed the effect of system transparency on AD trust, where transparency was enhanced by, for instance, visually displaying uncertainty information of the system [14], offering the status of adaptive cruise control (ACC) [15] and explaining the actions of the AD system to drivers [16].”
BackgroundFrison, A.-K., Forster, Y., Wintersberger, P., Geisel, V., & Riener, A. (2020) · Applied Sciences · doi:10.3390/app10248914 · Cited by 47
“Here, many issues such as trust [18,21,97], controllability [12], fatigue [15], or mode awareness [17] have been discovered.”
BackgroundMethodDriving in an Increasingly Automated World – Approaches to Improve the Driver-automation Interaction
Stockert, S., Richardson, N. T., & Lienkamp, M. (2015) · Procedia Manufacturing · doi:10.1016/j.promfg.2015.07.797 · Cited by 41
Pöhler, G., Heine, T., & Deml, B. (2016) · Zeitschrift für Arbeitswissenschaft · doi:10.1007/s41449-016-0024-9 · Cited by 53
Design Guidelines for Reliability Communication in Autonomous Vehicles
Faltaous, S., Baumann, M. R. K., Schneegaß, S., & Chuang, L. L. (2018) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3239060.3239072 · Cited by 47
“These results agree with those reported by Helldin and colleagues who showed that participants were able to shift to manual control faster when presented with variable feedback compared to when no feedback was issued [21].”
ResultS(C)ENTINEL: monitoring automated vehicles with olfactory reliability displays
Wintersberger, P., Dmitrenko, D., Schartmüller, C., Frison, A.-K., Maggioni, E., Obrist, M., & Riener, A. (2019) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3301275.3302332 · Cited by 45
“could show that such displays can also improve performance and comfort in Take-Over scenarios [25].”
BackgroundThe Importance of Interruption Management for Usefulness and Acceptance of Automated Driving
Naujoks, F., Wiedemann, K., & Schömig, N. (2017) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3122986.3123000 · Cited by 50
“Falkman, Riveiro and Davidsson [28], Stockert, Richardson”
BackgroundInfluentialChen, K., & Chen, H.-Y. W. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102518 · Cited by 38
Trust in Automated Vehicle: A Meta-Analysis
Zhang, Z. J., Tian, R., & Duffy, V. G. (2022) · Automation, collaboration, and e-services · doi:10.1007/978-3-031-10784-9_13 · Cited by 38
The Effects of Agent Transparency on Human Interaction with an Autonomous Robotic Agent
Selkowitz, A. R., Lakhmani, S. G., Chen, J. Y. C., & Boyce, M. W. (2015) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931215591246 · Cited by 41
“Uncertainty also influenced performance in a simulated automated driving task; participants who received uncertainty information demonstrated a faster time-to-take-over after automation failure (Helldin, Falkman, Riveiro, & Davidsson, 2013).”
BackgroundRachel, H. Y., Morris, A. P., Herriotts, P., & Birrell, S. A. (2020) · Applied Ergonomics · doi:10.1016/j.apergo.2020.103272 · Cited by 42
Enhancing Acceptance and Trust in Automated Driving trough Virtual Experience on a Driving Simulator
Clement, P., Veledar, O., Könczöl, C., Danzinger, H., Posch, M., Eichberger, A., & Macher, G. (2022) · Energies · doi:10.3390/en15030781 · Cited by 37
“The EOT is a modified version of Helldin et al. [45] and relies on the original questionnaire on trust in automation from Jian et al. [39].”
BackgroundChang, W.-C., & Hasanzadeh, S. (2024) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-5656 · Cited by 42
Advancing Explainable Autonomous Vehicle Systems: A Comprehensive Review and Research Roadmap
Tekkesinoglu, S., Habibovic, A., & Kunze, L. (2025) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3714478 · Cited by 57
“In a study conducted by Helldin et al., the trust analysis showed that participants who received uncertainty information trusted the system less than those who did not, indicating a more proper trust calibration than in the control group [Helldin et al. , 2013].”
InfluentialTrust in Technology as a Safety Aspect in Highly Automated Driving
Wintersberger, P., & Riener, A. (2016) · i-com · doi:10.1515/icom-2016-0034 · Cited by 50
“[37] investigated trust in connection with “Take-Over-Requests” (TORs).”
BackgroundEkman, F., Johansson, M., Karlsson, M., Strömberg, H. K., & Bligård, L. (2020) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2020.10.012 · Cited by 37
Vogelpohl, T., Gehlmann, F., & Vollrath, M. (2019) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819866976 · Cited by 39
Ulahannan, A., Cain, R. L., Thompson, S., Skrypchuk, L., Mouzakitis, A., Jennings, P., & Birrell, S. A. (2019) · Applied Ergonomics · doi:10.1016/j.apergo.2019.102969 · Cited by 34
“This in line with the literature on partially automated vehicles which says that providing more information can help prevent driver inattention (de Winter et al., 2014; Helldin et al., 2013).”
Kalaycı, T. E., Kalaycı, E. G., Lechner, G., Neuhuber, N., Spitzer, M., Westermeier, E., & Stocker, A. (2020) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2020.100186 · Cited by 48
Exploring system wide trust prevalence and mitigation strategies with multiple autonomous agents
Walliser, J. C., de Visser, E. J., & Shaw, T. H. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107671 · Cited by 40
Gao, Z., Wen-min, L., Liang, J., Hanxi, P. A. N., Xu, W., & Shen, M. (2021) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2021.02172 · Cited by 47
Effect of advanced driver-assistance system trainings on driver workload, knowledge, and trust
Zahabi, M., Razak, A. M. A., Mehta, R. K., & Manser, M. (2020) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2020.12.003 · Cited by 38
Tinga, A. M., Cleij, D., Jansen, R. J., van der Kint, S., & van Nes, N. (2022) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2022.03.020 · Cited by 34
Teaming with Your Car: Redefining the Driver–Automation Relationship in Highly Automated Vehicles
Lee, J., Rheem, H., Lee, J. D., Szczerba, J. F., & Tsimhoni, O. (2022) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434221132636 · Cited by 40
“That is, coordination is performed by meta-operations to organize subordinate operations (Hoc, 2001).”
BackgroundRisk and Trust in artificial intelligence technologies: A case study of Autonomous Vehicles
Ajenaghughrure, I. B., Sousa, S., & Lamas, D. (2020) · Conference on Human System Interactions · doi:10.1109/hsi49210.2020.9142686 · Cited by 32
“Therefore, as suggested by prior research [18, 19, 20], future trust researchers can explore more holistic approaches (e.g. Participatory design methods, gamification etc.) to ensure adequate education of users’ and society at large on the pros and cons of AVs’ and most importantly explaining the…”
BackgroundStephenson, A. C., Eimontaite, I., Caleb-Solly, P., Morgan, P. L., Khatun, T., Davis, J., & Alford, C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.571961 · Cited by 38
Matviienko, A., Mehmedovic, D., Müller, F., & Mühlhäuser, M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3546723 · Cited by 34
Miglani, A., Diels, C., & Terken, J. M. B. (2016) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3004323.3004331 · Cited by 29
“With respect to presenting the system confidence level information, similar findings were reported by Helldin et al. [9] in which a vertical bar was used with a critical threshold limit.”
ResultDevelopment and Preliminary Evaluation of Reliability Displays for Automated Lane Keeping
Noah, B. E., Gable, T. M., Chen, S.-Y., Singh, S., & Walker, B. N. (2017) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3122986.3123007 · Cited by 28
“Trend displays indicating the level of reliability of an automated system can lead to more appropriate trust, Session 6 - Automated Driving: Output and Take-Over AutomotiveUI ’17, Oldenburg, Germany specifically in the domain of highly automated driving as in SAE Level 5 [9,18].”
BackgroundInvestigating the Design of Information Presentation in Take-Over Requests in Automated Vehicles
Colley, M., Gruler, L., Woide, M., & Rukzio, E. (2021) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3447526.3472025 · Cited by 32
“[31] X System Uncertainty HDD Inability of the system to maintain autonomous driving [39] X Navigation+Information HDD System activation, action request for transfer of control or take-over (TO) when leaving the platoon.”
BackgroundThe apparent intelligence of a system as a factor in situation awareness
Thill, S., Hemeren, P., & Nilsson, M. (2014) · IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support · doi:10.1109/cogsima.2014.6816540 · Cited by 26
“It is not always the case that higher trust is more desirable; a recent simulator study for instance found that drivers who had information about the degree of confidence of an automated vehicle trusted it less than those who did not [24], which the authors interpret as a more realistic level of trust.”
Background
Metadata
- Authors
- Helldin, T., Falkman, G., Riveiro, M., & Davidsson, S.
- Affiliations
- University of Skövde (SE)
- Volvo (Sweden) (SE)
- Venue
- Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
- Publisher
- ACM
- Published
- 2013-10-28
- Pages
- 210-217
- OpenAlex
- W2161054318
- Cited by
- 286
- References
- 22
- Citations by year
- 2026: 13 · 2025: 19 · 2024: 19 · 2023: 22 · 2022: 32 · 2021: 30 · 2020: 41 · 2019: 33 · 2018: 28 · 2017: 19 · 2016: 14 · 2015: 8 · 2014: 8
- FWCI
- 20.10
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) (publishedVersion)
- Funders
- Swedish Knowledge Foundation (2010/0320 (UMIF), Vinnova)
- University of Skövde
- National Aviation Engineering Research Program (NFFP5-2009-01315)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Keywords
- trust calibration, autonomous driving, uncertainty visualization, automotive user interfaces, driver trust in automation, snow conditions, driver workload, driver attention, human-automation interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.