The DOI matches its Crossref record; 86 of the 87 references it cites were found in a registry or an index.
Automation transparency: implications of uncertainty communication for human-automation interaction and interfaces
Open accessAbstract
Operators of highly automated driving systems may exhibit behaviour characteristic for overtrust issues due to an insufficient awareness of automation fallibility. Consequently, situation awareness in critical situations is reduced and safe driving performance following emergency takeovers is impeded. A driving simulator study was used to assess the impact of dynamically communicating system uncertainties on monitoring, trust, workload, takeovers, and physiological responses. The uncertainty information was conveyed visually using a stylised heart beat combined with a numerical display and users were engaged in a visual search task. Multilevel analysis results suggest that uncertainty communication helps operators calibrate their trust and gain situation awareness prior to critical situations, resulting in safer takeovers. In addition, eye tracking data indicate that operators can adjust their gaze behaviour in correspondence with the level of uncertainty. However, conveying uncertainties using a visual display significantly increases operator workload and impedes users in the execution of non-driving related tasks. Practitioner Summary: This article illustrates how the communication of system uncertainty information helps operators calibrate their trust in automation and, consequently, gain situation awareness. Multilevel analysis results of a driving simulator study affirm the benefits for trust calibration and highlight that operators adjust their behaviour according to multiple uncertainty levels.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Most commonly, trust calibration was measured as statistical differences of trustworthiness perceptions between high-reliability and low-reliability groups, examined through analysis of variance.
“Most commonly, the trust calibration was measured as the statistical diferences of trustworthiness perceptions of systems with high reliability and trustworthiness perceptions of systems with low-reliability groups, examined through analysis of variance (see, e.g., [4, 15, 26, 47, 58, 61, 68-70, 82, 84, 89, 90, 107, 117, 130, 140, 145]).”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [70]
Uncertainty cues increased workload in some cases but not others and led to instances of over-trust when cues were not reliable.
“Yet, uncertainty cues also increased workload in some cases [70] but not in others [92] and led to instances of over-trust when the cues were not reliable [140].”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [70]
Citations
Cites
lmerTest Package: Tests in Linear Mixed Effects Models
Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017) · Journal of Statistical Software · doi:10.18637/jss.v082.i13 · Cited by 24,346
Control of goal-directed and stimulus-driven attention in the brain
Corbetta, M., & Shulman, G. L. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn755 · Cited by 12,881
A feature-integration theory of attention.
Treisman, A. M., & Gelade, G. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90005-5 · Cited by 12,366
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Toward a Theory of Situation Awareness in Dynamic Systems
Endsley, M. R. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049543 · Cited by 8,875
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 5×
“Detail describes the entity that is to be trusted, ranging from the overall system to its single functions and modes (Lee and See, 2004).”
BackgroundInfluentialGUIDE TO THE EXPRESSION OF UNCERTAINTY IN MEASUREMENT
Standard, S. (2006) · Cited by 6,460
Linear Mixed-Effects Models using 'Eigen' and S4
Bates, D. M., Maechler, M., Bolker, B. M., & Walker, S. C. (2015) · Cited by 5,924
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
Analyzing and Interpreting Data From Likert-Type Scales
Sullivan, G. M., & Artino, A. R. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-5-4-18 · Cited by 3,044
Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
Aleatory or epistemic? Does it matter?
Kiureghian, A. D., & Ditlevsen, O. (2009) · Structural Safety · doi:10.1016/j.strusafe.2008.06.020 · Cited by 2,454
Situation Awareness Analysis and Measurement
Endsley, M. R., & Garland, D. J. (2000) · CRC Press eBooks · doi:10.1201/b12461 · Cited by 2,053
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710 · cited 6×
“Complacency is a predictor of visual attention (Bailey and Scerbo 2007; Metzger and Parasuraman 2005; Parasuraman and Manzey 2010) and, as a result, affects failure detection.”
BackgroundInfluentialEye Tracking in Human-Computer Interaction and Usability Research
Jacob, R. J. K., & Karn, K. S. (2003) · Elsevier eBooks · doi:10.1016/b978-044451020-4/50031-1 · Cited by 1,575
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle
Waytz, A., Heafner, J., & Epley, N. (2014) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2014.01.005 · Cited by 1,439
The Out-of-the-Loop Performance Problem and Level of Control in Automation
Endsley, M. R., & Kiris, E. O. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779064555 · Cited by 1,406
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276
MUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993
Trust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932
From Here to Autonomy: Lessons Learned From Human–Automation Research
Endsley, M. R. (2017) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816681350 · Cited by 898
Nasa-task load index (NASA-TLX); 20 years later: (577632012-009)
Hart, S. G. (2006) · PsycEXTRA Dataset · doi:10.1037/e577632012-009 · Cited by 838
“Take over!” How long does it take to get the driver back into the loop?
Gold, C., Damböck, D., Lorenz, L., & Bengler, K. J. (2013) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213571433 · Cited by 774
Loeb, M., Davies, D. R., & Parasuraman, R. (1984) · The American Journal of Psychology · doi:10.2307/1422535 · Cited by 716
Designing for Situation Awareness
Endsley, M. R., Bolte, B., & Jones, D. G. (2003) · doi:10.1201/9780203485088 · Cited by 675
Bottom-Up and Top-Down Attention
Katsuki, F., & Constantinidis, C. (2013) · The Neuroscientist · doi:10.1177/1073858413514136 · Cited by 594
Approaches to uncertainty visualization
Pang, A., Wittenbrink, C. M., & Lodha, S. K. (1997) · The Visual Computer · doi:10.1007/s003710050111 · Cited by 548
Visual Attention: Bottom-Up Versus Top-Down
Connor, C. E., Egeth, H. E., & Yantis, S. (2004) · Current Biology · doi:10.1016/j.cub.2004.09.041 · Cited by 528
The ‘problem ’ with automation: inappropriate feedback and interaction, not ‘over-automation’
Norman, D. A. (1990) · Philosophical transactions of the Royal Society of London. Series B, Biological sciences · doi:10.1098/rstb.1990.0101 · Cited by 519
From ‘automation’ to ‘autonomy’: the importance of trust repair in human–machine interaction
de Visser, E. J., Pak, R., & Shaw, T. H. (2018) · Ergonomics · doi:10.1080/00140139.2018.1457725 · Cited by 450
The benefits of imperfect diagnostic automation: a synthesis of the literature
Wickens, C. D., & Dixon, S. R. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500370105 · Cited by 423 · cited 1×
“An additional challenge relevant to automated driving is the presence of concurrent tasks, which further promote the attention allocation away from the automated task (Wickens and Dixon 2007).”
BackgroundIntroduction matters: Manipulating trust in automation and reliance in automated driving
Körber, M., Baseler, E., & Bengler, K. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2017.07.006 · Cited by 418
Intelligent agent transparency in human–agent teaming for multi-UxV management
Mercado, J. E., Rupp, M. A., Chen, J. Y. C., Barnes, M. J., Barber, D., & Procci, K. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815621206 · Cited by 403
An application-oriented view of modeling uncertainty
Zimmermann, H. ‐. (2000) · European Journal of Operational Research · doi:10.1016/s0377-2217(99)00228-3 · Cited by 393
Hergeth, S., Lorenz, L., Vilimek, R., & Krems, J. F. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815625744 · Cited by 355
Situation awareness-based agent transparency and human-autonomy teaming effectiveness
Chen, J. Y. C., Lakhmani, S. G., Stowers, K., Selkowitz, A. R., Wright, J. L., & Barnes, M. (2018) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2017.1315750 · Cited by 341
Control Task Substitution in Semiautomated Driving
Carsten, O., Lai, F. C. H., Barnard, Y. F., Jamson, A. H., & Merat, N. (2012) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720812460246 · Cited by 334
Monitoring an Automated System for a Single Failure: Vigilance and Task Complexity Effects
MOLLOY, R., & Parasuraman, R. (1996) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089606380211 · Cited by 321
Influences of weather phenomena on automotive laser radar systems
Rasshofer, R. H., Spies, M., & Spies, H. F. (2011) · Advances in radio science · doi:10.5194/ars-9-49-2011 · Cited by 317
State-of-science: situation awareness in individuals, teams and systems
Stanton, N. A., Salmon, P. M., Walker, G. H., Salas, E., & Hancock, P. A. (2017) · Ergonomics · doi:10.1080/00140139.2017.1278796 · Cited by 296
Helldin, T., Falkman, G., Riveiro, M., & Davidsson, S. (2013) · Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/2516540.2516554 · Cited by 286 · cited 5×
“In contrast to previous research (Helldin et al. 2013), TTT values were not significantly affected.”
BackgroundResultInfluentialImproving the Driver–Automation Interaction
Beller, J., Heesen, M., & Vollrath, M. (2013) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720813482327 · Cited by 283
Manzey, D., Reichenbach, J., & Onnasch, L. (2012) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343411433844 · Cited by 277
Bailey, N. R., & Scerbo, M. W. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500535301 · Cited by 224
Louw, T. L., & Merat, N. (2017) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2017.01.001 · Cited by 218
Metzger, U., & Parasuraman, R. (2005) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/0018720053653802 · Cited by 217
Evaluating Effects of User Experience and System Transparency on Trust in Automation
Yang, X. J., Unhelkar, V. V., Li, K., & Shah, J. A. (2017) · Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2909824.3020230 · Cited by 208
Pak, R., Fink, N. P., Price, M. M., Bass, B. M., & Sturre, L. (2012) · Ergonomics · doi:10.1080/00140139.2012.691554 · Cited by 204
Attention and automation: New perspectives on mental underload and performance
Young, M. S., & Stanton, N. A. (2002) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220210123789 · Cited by 194
Johns, J. L. (1996) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.1996.16310.x · Cited by 187
Bazilinskyy, P., Petermeijer, S. M., Petrovych, V., Dodou, D., & de Winter, J. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.04.001 · Cited by 184
Development of NASA-TLX(Task Load Index)
Hart, S. G. (1988) · Cited by 163
Trust and Reliance on an Automated Combat Identification System
Wang, L., Jamieson, G. A., & Hollands, J. G. (2009) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720809338842 · Cited by 157
Louw, T., Markkula, G. M., Boer, E. R., Madigan, R., Carsten, O., & Merat, N. (2017) · Accident Analysis & Prevention · doi:10.1016/j.aap.2017.08.011 · Cited by 147
Distraction Becomes Engagement in Automated Driving
Miller, D., Sun, A., Johns, M., Ive, H. P., Sirkin, D. M., Aich, S., & Ju, W. G. (2015) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931215591362 · Cited by 136
Moray, N. P., & Inagaki, T. (2000) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220052399159 · Cited by 129
Driver Behavior in an Emergency Situation in the Automated Highway System
de Waard, D., van der Hulst, M., Hoedemaeker, M., & Brookhuis, K. (1999) · Transportation Human Factors · doi:10.1207/sthf0101_7 · Cited by 122
A Little Anthropomorphism Goes a Long Way
de Visser, E. J., Monfort, S. S., Goodyear, K., Lu, L., O’Hara, M., Lee, M. R., Parasuraman, R., & Krüeger, F. (2017) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816687205 · Cited by 118
Cacciabue, P. C. (2007) · doi:10.1007/978-1-84628-618-6 · Cited by 115
The World is not Enough: Trust in Cognitive Agents
de Visser, E. J., Krueger, F. W., McKnight, P. E., Scheid, S., Smith, M. A. B., Chalk, S., & Parasuraman, R. (2012) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181312561062 · Cited by 107
How do depressed and healthy adults interpret nuanced facial expressions?
Gollan, J. K., McCloskey, M., Hoxha, D., & Coccaro, E. F. (2010) · Journal of Abnormal Psychology · doi:10.1037/a0020234 · Cited by 94
Traffic Augmentation as a Means to Increase Trust in Automated Driving Systems
Wintersberger, P., von Sawitzky, T., Frison, A.-K., & Riener, A. (2017) · Biannual Conference of the Italian SIGCHI Chapter (CHItaly) · doi:10.1145/3125571.3125600 · Cited by 90
Wang, X., Piñol, R. A., Byrne, P., & Mendelowitz, D. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.5093-13.2014 · Cited by 89
Utilizing graphical formats to convey uncertainty in a decision-making task
Finger, R., & Bisantz, A. M. (2002) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220110110324 · Cited by 84
Auditory interfaces in automated driving: an international survey
Bazilinskyy, P., & de Winter, J. (2015) · PeerJ Computer Science · doi:10.7717/peerj-cs.13 · Cited by 83
Glass half-full: On-road glance metrics differentiate crashes from near-crashes in the 100-Car data
Seppelt, B., Seaman, S. R., Lee, J., Angell, L., Mehler, B. L., & Reimer, B. (2017) · Accident Analysis & Prevention · doi:10.1016/j.aap.2017.07.021 · Cited by 79
Advances in Human Aspects of Transportation
(2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-60441-1 · Cited by 78
The impact of context-related reliability on automation failure detection and scanning behaviour
Bagheri, N., & Jamieson, G. A. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1398299 · Cited by 65
Detection of new in-path targets by drivers using Stop & Go Adaptive Cruise Control
Stanton, N. A., Dunoyer, A., & Leatherland, A. (2010) · Applied Ergonomics · doi:10.1016/j.apergo.2010.08.016 · Cited by 63
Handbook of Stress Medicine: An Organ System Approach
Hubbard, J. P., & Workman, E. A. (1997) · Cited by 57
Politis, I., Brewster, S. A., & Pollick, F. E. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702167 · Cited by 57
Measurement of trust in complex and dynamic systems using a quantitative approach
Uggirala, A., Gramopadhye, A. K., Melloy, B. J., & Toler, J. E. (2004) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2004.03.005 · Cited by 55
The role of situation awareness for understanding signalling and control in rail operations
Golightly, D., Wilson, J. R., Lowe, E., & Sharples, S. (2009) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220903009961 · Cited by 48
Wickens, C. D., Sebok, A. L., Li, H., Sarter, N. B., & Gacy, A. M. (2015) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814566454 · Cited by 43
Decision making under uncertainty
Preuschoff, K., Mohr, P. N. C., & Hsu, M. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00218 · Cited by 28
Attention, workload, and performance: A dual-task simulated shooting study
Diekfuss, J. A., Ward, P., & Raisbeck, L. D. (2016) · International Journal of Sport and Exercise Psychology · doi:10.1080/1612197x.2015.1121508 · Cited by 25
Enhancing Driving Safety and User Experience Through Unobtrusive and Function-Specific Feedback
Kunze, A., Summerskill, S. J., Marshall, R., & Filtness, A. (2017) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3131726.3131762 · Cited by 24
Self-citationReply to Comments on "Driver Behavior in an Emergency Situation in the Automated Highway System"
de Waard, D., van der Hulst, M., Hoedemaeker, M., & Brookhuis, K. (1999) · Transportation Human Factors · doi:10.1207/sthf0101_9 · Cited by 11
(1997) · CRC Press eBooks · doi:10.1201/9781420048421 · Cited by 10
Evaluation of Variables for the Communication of Uncertainties Using Peripheral Awareness Displays
Kunze, A., Summerskill, S. J., Marshall, R., & Filtness, A. (2018) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3239092.3265958 · Cited by 8
Self-citationPreliminary Evaluation of Variables for Communicating Uncertainties Using a Haptic Seat
Kunze, A., Summerskill, S. J., Marshall, R., & Filtness, A. (2018) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3239092.3265959 · Cited by 8
Self-citationMcGuirl, J. M., & Sarter, N. B. (2003) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120304700360 · Cited by 5
Situation Awareness Misconceptions and Misunderstandings
Endsley, M. R. (2015) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343415572631
Flagged first, then by citations
1 of the 87 references couldn’t be matched to a known paper.
Research works printed but not linked: 12
- 10.1007/978-1-84628-618-6_141 · DOI
- 10.1007/978-3-642-13505-71 · DOI
- Endsley M. R., 2012, Designing for
- Gal, Y. 2016. “Uncertainty in Deep Learning.” PhD Thesis, University of Cambridge.
- 10.1016/S0166-4115(08)62386-91 · DOI
- 10.1518/hfes.46.1.50.30392 · DOI · Paper page
- May P., 1993, Paper Presented at the Annual Meeting of the Human Factors Society, Santa Monica, CA
- 10.5465/amr.1995.9508080335 · DOI · Paper page
- Nguyen T., 2018, Eprint ArXiv, 1803, 1
- Snijders T. A. B., 2012, Multilevel Analysis
- Steptoe A., 1991, Circulation, 83, 14
- 10.13140/RG.2.2.33648.56326 · DOI
Cited by
Sorted by citations
Langer, M., Oster, D., Speith, T., Hermanns, H., Kästner, L., Schmidt, E., Sesing, A., & Baum, K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103473 · Cited by 652
Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams
de Visser, E. J., Peeters, M. M. M., Jung, M. F., Kohn, S., Shaw, T. H., Pak, R., & Neerincx, M. A. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-019-00596-x · Cited by 447
Physiological Measurements of Situation Awareness: A Systematic Review
Zhang, T., Yang, J., Liang, N., Pitts, B. J., Prakah-Asante, K. O., Curry, R., Duerstock, B. S., Wachs, J. P., & Yu, D. (2020) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820969071 · Cited by 228
Leichtmann, B., Humer, C., Hinterreiter, A., Streit, M., & Mara, M. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107539 · Cited by 200
Liang, N., Yang, J., Yu, D., Prakah-Asante, K. O., Curry, R., Blommer, M., Swaminathan, R., & Pitts, B. J. (2021) · Accident Analysis & Prevention · doi:10.1016/j.aap.2021.106143 · Cited by 175
Wischnewski, M., Krämer, N., & Müller, E. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581197 · Cited by 146
“Yet, uncertainty cues also increased workload in some cases [70] but not in others [92] and led to instances of over-trust when the cues were not reliable [140].”
BackgroundInfluentialA Situation Awareness Perspective on Human-AI Interaction: Tensions and Opportunities
Jiang, J., Karran, A. J., Coursaris, C. K., Léger, P., & Beringer, J. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2093863 · Cited by 140
Driving Style: How Should an Automated Vehicle Behave?
de Oliveira, L. C. R., Proctor, K., Burns, C. G., & Birrell, S. A. (2019) · Information · doi:10.3390/info10060219 · Cited by 90
The influence of system transparency on trust: Evaluating interfaces in a highly automated vehicle
de Oliveira, L. C. R., Burns, C. G., Luton, J., Iyer, S., & Birrell, S. A. (2020) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2020.06.001 · Cited by 79
Hungund, A. P., & Pradhan, A. K. (2023) · Accident Analysis & Prevention · doi:10.1016/j.aap.2023.107076 · Cited by 68
Conveying Uncertainties Using Peripheral Awareness Displays in the Context of Automated Driving
Kunze, A., Summerskill, S. J., Marshall, R., & Filtness, A. (2019) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3342197.3344537 · Cited by 55
Self-citationLi, T., Vorvoreanu, M., DeBellis, D., & Amershi, S. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3511605 · Cited by 70
Li, W., Zhang, J., Minh, T., Cao, J., & Wang, L. (2019) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2019.04.003 · Cited by 51
Effects of User Interfaces on Take-Over Performance: A Review of the Empirical Evidence
Kim, S., van Egmond, R., & Happee, R. (2021) · Information · doi:10.3390/info12040162 · Cited by 50
Effects of personality traits on user trust in human–machine collaborations
Zhou, J. J., Luo, S., & Chen, F. (2020) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-020-00329-9 · Cited by 53
Understanding the Evolvement of Trust Over Time within Human-AI Teams
Duan, W., Zhou, S., Scalia, M. J., Yin, X., Weng, N., Zhang, R., Freeman, G., McNeese, N. J., Gorman, J. C., & Tolston, M. T. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3687060 · Cited by 62
Daronnat, S., Azzopardi, L., Halvey, M., & Dubiel, M. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.642201 · Cited by 45
Hussein, A., Elsawah, S., & Abbass, H. A. (2020) · Ergonomics · doi:10.1080/00140139.2020.1764112 · Cited by 51
Liu, W., Li, Q., Wang, Z., Wang, W., Zeng, C., & Cheng, B. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2074669 · Cited by 42
Roberts, A. P. J., Webster, L. V., Salmon, P. M., Flin, R. H., Salas, E., Cooke, N. J., Read, G. J. M., & Stanton, N. A. (2021) · Ergonomics · doi:10.1080/00140139.2021.2000043 · Cited by 57
Impact of the driver’s visual engagement on situation awareness and takeover quality
Marti, P., Jallais, C., Koustanai, A., Guillaume, A. I., & Mars, F. (2022) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2022.04.018 · Cited by 40
The relationship of trust and dependence
Patton, C. E., & Wickens, C. D. (2024) · Ergonomics · doi:10.1080/00140139.2024.2342436 · Cited by 44
Autopilots in the Operating Room: Safe Use of Automated Medical Technology
Ruskin, K. J., Corvin, C., Rice, S. C., & Winter, S. R. (2020) · Anesthesiology · doi:10.1097/aln.0000000000003385 · Cited by 38
Chen, K., & Chen, H.-Y. W. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102518 · Cited by 38
Xu, L., Guo, L., Ge, P., & Wang, X. (2022) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2022.10.001 · Cited by 37
Bobko, P., Hirshfield, L., Eloy, L., Spencer, C., Doherty, E., Driscoll, J., & Obolsky, H. (2023) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2022.2086644 · Cited by 33
Chang, W.-C., & Hasanzadeh, S. (2024) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-5656 · Cited by 37
Advancing Explainable Autonomous Vehicle Systems: A Comprehensive Review and Research Roadmap
Tekkesinoglu, S., Habibovic, A., & Kunze, L. (2025) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3714478 · Cited by 46
Li, M., Feng, Z., Zhang, W., Wang, L., Wei, L., & Wang, C. (2023) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2023.104324 · Cited by 33
Tan, X., & Zhang, Y. (2024) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208241272071 · Cited by 33
Zheng, H., Zhou, T., Han, T., Li, S., & Yu, C. (2024) · Advanced Engineering Informatics · doi:10.1016/j.aei.2024.102683 · Cited by 32
Gao, Z., Wen-min, L., Liang, J., Hanxi, P. A. N., Xu, W., & Shen, M. (2021) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2021.02172 · Cited by 34
Matviienko, A., Mehmedovic, D., Müller, F., & Mühlhäuser, M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3546723 · Cited by 30
Eloy, L., Doherty, E. J., Spencer, C. A., Bobko, P., & Hirshfield, L. (2022) · Frontiers in Neuroergonomics · doi:10.3389/fnrgo.2022.838625 · Cited by 27
Situational Awareness Assessment of Drivers Boosted by Eye-Tracking Metrics: A Literature Review
Arias-Portela, C. Y., Mora‐Vargas, J., & Caro, M. (2024) · Applied Sciences · doi:10.3390/app14041611 · Cited by 27
Conversational Agents Trust Calibration
Dubiel, M., Daronnat, S., & Leiva, L. A. (2022) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3543829.3544518 · Cited by 32
Impact of Agent Reliability and Predictability on Trust in Real Time Human-Agent Collaboration
Daronnat, S., Azzopardi, L. A., Halvey, M. J., & Dubiel, M. (2020) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3406499.3415063 · Cited by 31
Sargent, R., Walters, B. A., & Wickens, C. D. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35596-7_16 · Cited by 29
Vision-Based Multimodal Interfaces: A Survey and Taxonomy for Enhanced Context-Aware System Design
Hu, Y. '., Tang, J., Gong, X., Zhou, Z., Zhang, S., Elvitigala, D. S., Mueller, F., Hu, W. S., & Quigley, A. J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714161 · Cited by 28
Ali, H., Pham, D.-T., Alam, S., Schultz, M., Li, M. Z., Wang, Y., Itoh, E., & Dương, V. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103256 · Cited by 29
Kox, E. S., Siegling, L. B., & Kerstholt, J. H. (2022) · International Journal of Social Robotics · doi:10.1007/s12369-022-00871-4 · Cited by 22
Li, J., Liu, J., Wang, X., & Liu, L. (2024) · Applied Sciences · doi:10.3390/app14083203 · Cited by 23
Where Failures May Occur in Automated Driving: A Fault Tree Analysis Approach
Chen, K., Chen, H.-Y. W., Bisantz, A. M., Shen, S., & Sahin, E. (2022) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434221116254 · Cited by 22
Automation complacency on the road
Chu, Y., & Liu, P. (2023) · Ergonomics · doi:10.1080/00140139.2023.2210793 · Cited by 22
A Novel Cooperation-Guided Warning of Invisible Danger from AR-HUD to Enhance Driver’s Perception
You, F., Zhang, J., Zhang, J., Shen, L., Fang, W., Cui, W., & Wang, J. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2233734 · Cited by 22
Saghafian, M., Vatn, D. M. K., Moltubakk, S. T., Bertheussen, L. E., Petermann, F. M., Johnsen, S. O., & Alsos, O. A. (2024) · Safety Science · doi:10.1016/j.ssci.2024.106730 · Cited by 23
Kintz, J. R., Banerjee, N., Zhang, J. Y., Anderson, A. P., & Clark, T. (2022) · Hum. Factors · doi:10.1177/00187208221129371 · Cited by 21
Designing Trustworthy User Interfaces
Zieglmeier, V., & Lehene, A. M. (2021) · 33rd Australian Conference on Human-Computer Interaction · doi:10.1145/3520495.3520525 · Cited by 19
Chen, J. Y. C., & Barnes, M. J. (2021) · Wiley eBooks · doi:10.1002/9781119636113.ch44 · Cited by 19
van de Merwe, K., Mallam, S., Nazir, S., & Engelhardtsen, Ø. (2024) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434241240553 · Cited by 17
Gao, Q., Chen, L., Shi, Y., Luo, Y., Shen, M., & Gao, Z. (2024) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2024.09.019 · Cited by 17
How Humans Comply With a (Potentially) Faulty Robot: Effects of Multidimensional Transparency
Simon, L., Guerin, C., Rauffet, P., Chauvin, C., & Martin, É. (2023) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2023.3273773 · Cited by 17
“Can you rely on me?” Evaluating a Confidence HMI for Cooperative, Automated Driving
Peintner, J. B., Manger, C., & Riener, A. (2022) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3543174.3546976 · Cited by 15
A new era for stress research: supporting user performance and experience in the digital age
Matthews, G., Cumings, R., Santos, E. P. D. L., Feng, I. Y., & Mouloua, S. A. (2024) · Ergonomics · doi:10.1080/00140139.2024.2425953 · Cited by 15
The human-factors’ challenges of (tele)drivers of Autonomous Vehicles
Meir, A., Grimberg, E., & Musicant, O. (2024) · Ergonomics · doi:10.1080/00140139.2024.2346552 · Cited by 16
A Survey of Algorithmic Methods for Competency Self-Assessments in Human-Autonomy Teaming
Conlon, N., Ahmed, N. R., & Szafir, D. J. (2023) · ACM Computing Surveys · doi:10.1145/3616010 · Cited by 13
Li, M., Guo, F., Li, Z., Ma, H., & Duffy, V. G. (2024) · Ergonomics · doi:10.1080/00140139.2024.2343954 · Cited by 14
Wischnewski, M., Krämer, N. C., Janiesch, C., Müller, E., Schnitzler, T., & Newen, C. (2024) · Human-Machine Communication · doi:10.30658/hmc.8.7 · Cited by 14
Feeling Uncertain—Effects of a Vibrotactile Belt that Communicates Vehicle Sensor Uncertainty
Krüger, M., Driessen, T., Wiebel-Herboth, C. B., de Winter, J., & Wersing, H. (2020) · Information · doi:10.3390/info11070353 · Cited by 13
Using Human–Machine Interfaces to Convey Feedback in Automated Driving
Shull, E., Gaspar, J., McGehee, D. V., & Schmitt, R. (2022) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434221076827 · Cited by 15
Chen, K., Chen, H.-Y. W., & Bisantz, A. M. (2023) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2023.01.017 · Cited by 13
Lanzer, M., Stoll, T., Colley, M., & Baumann, M. R. K. (2021) · Frontiers in Human Dynamics · doi:10.3389/fhumd.2021.676667 · Cited by 12
Automation failures and patient safety
Ruskin, K. J., Ruskin, A. C., & O’Connor, M. (2020) · Current Opinion in Anaesthesiology · doi:10.1097/aco.0000000000000935 · Cited by 14
Buchner, S., Kintz, J. R., Zhang, J. Y., Banerjee, N. T., Clark, T., & Hayman, A. (2025) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434241310084 · Cited by 9
Kang, S. X., Man, S. S., & Chan, A. H. S. (2022) · Applied Ergonomics · doi:10.1016/j.apergo.2022.103898 · Cited by 10
Trust dampening and trust promoting: A dual-pathway of trust calibration in human-robot interaction
HUANG, X., & Li, Y. (2024) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2024.00527 · Cited by 10
Gerber, M. A., Schroeter, R., Johnson, D. M., Janssen, C. P., Rakotonirainy, A., Kuo, J., & Lenné, M. G. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642219 · Cited by 11
Chang, W.-C., Garcia, N. F. G., & Hasanzadeh, S. (2025) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-6302 · Cited by 10
Zhang, Y., Angell, L., & Bao, S. (2021) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2021.100337 · Cited by 10
Chang, W.-C., Borowiak, A., & Hasanzadeh, S. (2024) · ASCE International Conference on Computing in Civil Engineering (i3CE) · doi:10.1061/9780784485224.099 · Cited by 9
Human-AI Teamwork Interface Design Using Patterns of Interactions
Momose, K., Mehta, R., Moukpe, J., Weekes, T. R., & Eskridge, T. C. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2389350 · Cited by 10
Omeiza, D., Bhattacharyya, R., Jirotka, M. D., Hawes, N., & Kunze, L. (2025) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2025.01.015 · Cited by 9
Han, C., Abeysiriwardhane, A., Chai, S., & Maiti, A. (2021) · Journal of Marine Science and Engineering · doi:10.3390/jmse10010022 · Cited by 9
Manger, C., Peintner, J. B., Hoffmann, M., Probst, M., Wennmacher, R., & Riener, A. (2023) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3581961.3609874 · Cited by 9
Kanaan, D., Powell, M., Lu, M., & Donmez, B. (2024) · Transport Reviews · doi:10.1080/01441647.2024.2336921 · Cited by 9
Tackling Algorithmic Transparency in Communal Energy Accounting through Participatory Design
Cech, F. (2021) · International Conference on Communities and Technologies (C&T) · doi:10.1145/3461564.3461577 · Cited by 11
Gerber, M. A., Faramarzian, M., & Schroeter, R. (2022) · Studies in computational intelligence · doi:10.1007/978-3-030-77726-5_18 · Cited by 9
Oswald, F. L., Endsley, M. R., Chen, J. Z.-J., Chiou, E. K., Draper, M. H., McNeese, N. J., & Roth, E. M. (2022) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181322661007 · Cited by 9
Human-Centered Design in an Automated World
Blackett, C. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-68017-6_3 · Cited by 9
Hecht, T., Danner, S., Feierle, A., & Bengler, K. J. (2020) · Multimodal Technologies and Interaction · doi:10.3390/mti4030036 · Cited by 8
Min, C., Jin, Q., Zhou, J., & Luo, X. (2025) · International Journal of Social Robotics · doi:10.1007/s12369-025-01255-0 · Cited by 9
A Systematic Review of Metrics Measuring Takeover Performance in Conditionally Automated Driving
Han, D. W., Chung, H., Cao, Y., Zhou, F., Molnar, L. J., Robert, L., Tilbury, D. M., & Yang, X. J. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2552863 · Cited by 7
Peintner, J. B., Manger, C., Berger, M., & Riener, A. (2025) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2025.101742 · Cited by 7
Disuse of advanced driver assistance systems (ADAS)
Kim, S., & Oviedo-Trespalacios, Ó. (2025) · Journal of Safety Research · doi:10.1016/j.jsr.2025.09.004 · Cited by 7
Driving Behavior Analysis: A Human Factors Perspective on Automated Driving Styles
Peintner, J. B., Himmels, C., Rock, T., Manger, C., Jung, O., & Riener, A. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588527 · Cited by 7
Xu, X., Yu, R., Yuan, M., & Zheng, J. (2025) · Ergonomics · doi:10.1080/00140139.2025.2456535 · Cited by 6
Holthausen, B. E., Stuck, R. E., & Walker, B. N. (2022) · Studies in computational intelligence · doi:10.1007/978-3-030-77726-5_2 · Cited by 7
Do engineer perceptions about automated vehicles match user trust? Consequences for design
Walker, F., Steinke, J., Martens, M., & Verwey, W. B. (2020) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2020.100251 · Cited by 9
Wickens, C. D., Sargent, R., & Walters, B. (2023) · Ergonomics International Journal · doi:10.23880/eoij-16000312 · Cited by 6
Su, Y., Tan, Z., & Dai, N. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-80091-8_105 · Cited by 6
Automation function and malfunction: effects on human performance in accident handling tasks
Dong, X., & Li, Z. (2024) · Ergonomics · doi:10.1080/00140139.2024.2307964 · Cited by 5
Increasing system transparency through confidence information in cooperative, automated driving
Peintner, J. B., Manger, C., & Riener, A. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2407018 · Cited by 5
Do the Eyes Have It? A Review of Using Eye Tracking for Automation Trust Measurement
Lee, J. R., & Gutzwiller, R. S. (2025) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208251348395 · Cited by 5
Herse, S., Vitale, J., & Williams, M. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-023-01041-w · Cited by 7
Patton, C. E., Wickens, C. D., Smith, C. A. P., Noble, K. M., & Clegg, B. A. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-023-00519-5 · Cited by 5
When Transparency Fails: Compliance with Decision Support in Nautical Collision Avoidance
Pharmer, R. L., Wickens, C. D., & Clegg, B. A. (2022) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181322661321 · Cited by 5
Simon, L., Rauffet, P., & Guérin, C. (2024) · Cognition, Technology & Work · doi:10.1007/s10111-024-00782-6 · Cited by 3
George, M. W., Hass, Z., & Pitts, B. J. (2026) · Applied Ergonomics · doi:10.1016/j.apergo.2025.104719 · Cited by 4
Lee, M., & Pitts, B. J. (2026) · Accident Analysis and Prevention · doi:10.1016/j.aap.2026.108412 · Cited by 3
Transparent systems, opaque results: a study on automation compliance and task performance
Pharmer, R. L., Wickens, C. D., & Clegg, B. A. (2025) · Cognitive Research · doi:10.1186/s41235-025-00619-4 · Cited by 2
Metadata
- Authors
- Kunze, A., Summerskill, S. J., Marshall, R., & Filtness, A. J.
- Affiliations
- Loughborough University (GB)
- Corresponding author
- Kunze, Alexander
- Venue
- Ergonomics
- Publisher
- Informa UK Limited
- Published
- 2019-02-05
- Volume
- 62
- Issue
- 3
- Pages
- 345-360
- ISSN
- 0014-0139 (ISSN-L)
- 1366-5847
- OpenAlex
- W2902480251
- Cited by
- 165
- References
- 87
- Citations by year
- 2026: 19 · 2025: 35 · 2024: 29 · 2023: 18 · 2022: 25 · 2021: 19 · 2020: 14 · 2019: 6
- FWCI
- 13.20
- Type
- journal article
- Language
- en
- Open access
- green
- dspace.lboro.ac.uk
- Licence
- cc-by-nc-nd
- Locations
- Ergonomics (publishedVersion)
- PubMed (publishedVersion)
- Loughborough University Institutional Repository (Loughborough University) (submittedVersion, cc-by-nc-nd)
- Loughborough University Research Repository (Loughborough University) (submittedVersion, cc-by-nc-nd)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Risk and Safety Analysis
- Keywords
- uncertainty communication, human-automation interaction, trust in automation, overtrust, situational awareness, operator workload, gaze behavior, physiological responses, non-driving related tasks
- MeSH terms
- Adult, Attention, Automobile Driving, Communication, Computer Simulation, Eye Movements, Female, Heart Rate, Humans, Male, Man-Machine Systems, Middle Aged, Reaction Time, Task Performance and Analysis, User-Computer Interface, Workload, Uncertainty, Trust, Multilevel Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review