Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving
The DOI matches its Crossref record; 21 of the 22 references it cites were found in a registry or an index.
Abstract
To investigate the impact of visualizing car uncertainty on drivers' trust during an automated driving scenario, a simulator study was conducted. A between-group design experiment with 59 Swedish drivers was carried out where a continuous representation of the uncertainty of the car's ability to autonomously drive during snow conditions was displayed to one of the groups, whereas omitted for the control group. The results show that, on average, the group of drivers who were provided with the uncertainty representation took control of the car faster when needed, while they were, at the same time, the ones who spent more time looking at other things than on the road ahead. Thus, drivers provided with the uncertainty information could, to a higher degree, perform tasks other than driving without compromising with driving safety. The analysis of trust shows that the participants who were provided with the uncertainty information trusted the automated system less than those who did not receive such information, which indicates a more proper trust calibration than in the control group.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most commonly, the trust calibration was measured as the statistical diferences of trustworthiness perceptions of systems with high reliability and trustworthiness perceptions of systems with low-reliability groups, examined through analysis of variance (see, e.g., [4, 15, 26, 47, 58, 61, 68-70, 82, 84, 89, 90, 107, 117, 130, 140, 145]).”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [47]
In the citing paper
“For example, it was found that uncertainty information [47], the display of confdence levels [145], and reliability updates [90] facilitated an appropriate trust calibration and performance.”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [47]
Citations
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“Studies from other domains, such as the aviation domain, have shown that the anticipated positive effects of automation might be diminished due to human-automation cooperation related problems, such as automation misuse and disuse [1, 2], automation surprises and mode confusion [3, 4], reduced situation awareness [5],…”
BackgroundHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 1×
“Studies from other domains, such as the aviation domain, have shown that the anticipated positive effects of automation might be diminished due to human-automation cooperation related problems, such as automation misuse and disuse [1, 2], automation surprises and mode confusion [3, 4], reduced situation awareness [5],…”
BackgroundFoundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710 · cited 1×
“Studies from other domains, such as the aviation domain, have shown that the anticipated positive effects of automation might be diminished due to human-automation cooperation related problems, such as automation misuse and disuse [1, 2], automation surprises and mode confusion [3, 4], reduced situation awareness [5],…”
BackgroundKlauer, S. G., Dingus, T. A., Neale, V. L., Sudweeks, J. D., & Ramsey, D. J. (2006) · PsycEXTRA Dataset · doi:10.1037/e729262011-001 · Cited by 1,669
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · cited 3×
“Further, the control group showed tendencies of automation bias, resulting in inappropriate calibrations of trust, which is also in line with research presented by [13], where it was concluded that people generally have positive expectations of unfamiliar automated decision aids.”
BackgroundResultInfluentialTrust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932
Aviation Automation: The Search for A Human-centered Approach
Billings, C. E. (1996) · Medical Entomology and Zoology · Cited by 845
Beggiato, M., & Krems, J. F. (2013) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2012.12.006 · Cited by 327
Automation and situation awareness.
Endsley, M. R. (2018) · doi:10.1201/9781315137957-8 · Cited by 282
Improving the Driver–Automation Interaction: An Approach Using Automation Uncertainty
Beller, J., Heesen, M., & Vollrath, M. (2013) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720813482327 · Cited by 281
Verberne, F. M. F., Ham, J., & Midden, C. J. H. (2012) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720812443825 · Cited by 262
Making adaptive cruise control (ACC) limits visible
Seppelt, B. D., & Lee, J. D. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.10.001 · Cited by 241
Drive-by-wire: The case of driver workload and reclaiming control with adaptive cruise control
Stanton, N. A., Young, M., & McCaulder, B. (1997) · Safety Science · doi:10.1016/s0925-7535(97)00054-4 · Cited by 228
McGuirl, J. M., & Sarter, N. B. (2006) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872006779166334 · Cited by 212
Trust and Reliance on an Automated Combat Identification System
Wang, L., Jamieson, G. A., & Hollands, J. G. (2009) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720809338842 · Cited by 154
Flemisch, F. O., Schieben, A., Kelsch, J., & Löper, C. (2008) · elib (German Aerospace Center) · Cited by 116
Utilizing graphical formats to convey uncertainty in a decision-making task
Finger, R., & Bisantz, A. M. (2002) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220110110324 · Cited by 88
Smart collaboration between humans and machines based on mutual understanding
Inagaki, T. (2008) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2008.07.003 · Cited by 86
Trust and the use of adaptive cruise control: a study of a cut-in situation
Rajaonah, B., Anceaux, F., & Vienne, F. (2006) · Cognition Technology & Work · doi:10.1007/s10111-006-0030-3 · Cited by 72
Research works printed but not linked: 3
- 10.1518/hfes.46.1.50.30392 · doi:10.1518/hfes.46.1.50.30392 · Paper page
- N. B. Sarter , D. D. Woods , and C. E. Billings , " Automation surprises," Handbook of human factors and ergonomics , vol. 2 , pp. 1926 -- 1943 , 1997 . N. B. Sarter, D. D. Woods, and C. E. Billings, "Automation surprises," Handbook of human factors and ergonomics, vol. 2, pp. 1926--1943, 1997.
- A. Schieben , T. Gerald , F. Köster , and F. Flemisch , " How to interact with a highly automated vechible. Generic interaction design schemes and test results of a usability assessment " in Human Centred Automation , D. de Waard, N. Gérard, L. Omnasch, R. Wiczoreck, and D. H. Manzey, Eds., ed: Shaker Publishing , pp. 251 -- 267 , 2011 . A. Schieben, T. Gerald, F. Köster, and F. Flemisch, "How to interact with a highly automated vechible. Generic interaction design schemes and test results of a usability assessment " in Human Centred Automation, D. de Waard, N. Gérard, L. Omnasch, R. Wiczoreck, and D. H. Manzey, Eds., ed: Shaker Publishing, pp. 251--267, 2011.
Cited by
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
Zhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
“While the concept of trust calibration has been studied for automation [13, 18, 20, 26], as to prevent both automation aversion and automation bias, it is not well understood in the context of AI systems.”
BackgroundAlmost human: Anthropomorphism increases trust resilience in cognitive agents.
de Visser, E. J., Monfort, S. S., McKendrick, R., Smith, M. A. B., McKnight, P. E., Krueger, F., & Parasuraman, R. (2016) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000092 · Cited by 614
Determinants of take-over time from automated driving: A meta-analysis of 129 studies
Zhang, B., de Winter, J., Varotto, S., Happee, R., & Martens, M. (2019) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2019.04.020 · Cited by 431
Introduction matters: Manipulating trust in automation and reliance in automated driving
Körber, M., Baseler, E., & Bengler, K. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2017.07.006 · Cited by 418
Metadata
- Authors
- Helldin, T., Falkman, G., Riveiro, M., & Davidsson, S.
- Affiliations
- University of Skövde (SE)
- Volvo (Sweden) (SE)
- Venue
- Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
- Publisher
- ACM
- Published
- 2013-10-28
- Pages
- 210-217
- OpenAlex
- W2161054318
- Cited by
- 286
- References
- 22
- Citations by year
- 2026: 13 · 2025: 19 · 2024: 19 · 2023: 22 · 2022: 32 · 2021: 30 · 2020: 41 · 2019: 33 · 2018: 28 · 2017: 19 · 2016: 14 · 2015: 8 · 2014: 8
- FWCI
- 20.10
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) (publishedVersion)
- Funders
- Swedish Knowledge Foundation (2010/0320 (UMIF), Vinnova)
- University of Skövde
- National Aviation Engineering Research Program (NFFP5-2009-01315)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Keywords
- trust calibration, autonomous driving, uncertainty visualization, automotive user interfaces, driver trust in automation, snow conditions, driver workload, driver attention, human-automation interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.