Experience of automation failures in training: effects on trust, automation bias, complacency and performance
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
This work examined the effects of operators' exposure to various types of automation failures in training. Forty-five participants were trained for 3.5 h on a simulated process control environment. During training, participants either experienced a fully reliable, automatic fault repair facility (i.e. faults detected and correctly diagnosed), a misdiagnosis-prone one (i.e. faults detected but not correctly diagnosed) or a miss-prone one (i.e. faults not detected). One week after training, participants were tested for 3 h, experiencing two types of automation failures (misdiagnosis, miss). The results showed that automation bias was very high when operators trained on miss-prone automation encountered a failure of the diagnostic system. Operator errors resulting from automation bias were much higher when automation misdiagnosed a fault than when it missed one. Differences in trust levels that were instilled by the different training experiences disappeared during the testing session. Practitioner Summary: The experience of automation failures during training has some consequences. A greater potential for operator errors may be expected when an automatic system failed to diagnose a fault than when it failed to detect one.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“In addition to its link to the 10-level model of Sheridan and Verplank (1978), AFIRA maps onto the four-stage automation model of Parasuraman, Sheridan, and Wickens (2000).”
MethodFoundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Robert J. Hockey, G. (1997) · Biological Psychology · doi:10.1016/s0301-0511(96)05223-4 · Cited by 1,753
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710 · cited 1×
“…provided no major advantage over training on high-reliability systems with regard to operator performance (Chavaillaz, Wastell, and Sauer 2015). even with extended training and practice, the elimination of complacency and automation bias is difficult to achieve (Parasuraman and Manzey 2010).”
BackgroundThe role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276
ENDSLEY, M. R., & KABER, D. B. (1999) · Ergonomics · doi:10.1080/001401399185595 · Cited by 1,088
The benefits of imperfect diagnostic automation: a synthesis of the literature
Wickens, C. D., & Dixon, S. R. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500370105 · Cited by 423 · cited 1×
“The focus of research on the management of automation failure has been on improving system design (e.g. reliability levels, Wickens and Dixon 2007; message style of warnings, Lee, Gore, and Campbell 1999), whereas the issue of training has been given less attention, even though training is critical…”
BackgroundAccountability and automation bias
SKITKA, L. J., MOSIER, K., & BURDICK, M. D. (2000) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0349 · Cited by 324 · cited 4×
“If the operator follows the advice of the automation (i.e. do nothing), the operator commits an error of omission (e.g. Skitka, Mosier, and Burdick 2000).”
BackgroundInfluential
Research works printed but not linked: 18
- 10.1080/14639220500535301 · DOI · Paper page
- 10.1080/00140130701237345 · DOI
- Chavaillaz A., 2015, Applied Ergonomics
- 10.1177/0018720811435843 · DOI · Paper page
- 10.1518/001872007X215656 · DOI · Paper page
- Goh J., 2005, Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society, 492
- 10.1518/001872098779480479 · DOI · Paper page
- Kroemer K. H. E., 2001, Ergonomics: How to Design for Ease and Efficiency
- 10.1080/00140137908924708 · DOI
- 10.1207/sthf0104_6 · DOI
- 10.1006/ijhc.1994.1007 · DOI · Paper page
- Lorenz B., 2002, Aviation, Space, and Environmental Medicine, 73, 886
- Madsen M., 2000, Proceedings of 11th Australasian Conference on Information Systems, 6
- 10.1016/S0169-8141(02)00194-4 · DOI
- 10.1080/00140139.2012.676673 · DOI · Paper page
- 10.1080/00140139.2011.592606 · DOI
- 10.1016/j.apergo.2012.05.008 · DOI
- 10.21236/ADA057655 · DOI · Paper page
Cited by
Introduction matters: Manipulating trust in automation and reliance in automated driving
Körber, M., Baseler, E., & Bengler, K. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2017.07.006 · Cited by 418
Leichtmann, B., Humer, C., Hinterreiter, A., Streit, M., & Mara, M. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107539 · Cited by 200
User Trust Dynamics: An Investigation Driven by Differences in System Performance
Yu, K., Berkovsky, S., Taib, R., Conway, D., Zhou, J., & Chen, F. (2017) · Proceedings of the 22nd International Conference on Intelligent User Interfaces · doi:10.1145/3025171.3025219 · Cited by 90
Sebok, A., & Wickens, C. D. (2017) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816665201 · Cited by 75
New Information Technology and Implicit Bias
Elsbach, K. D., & Stigliani, I. (2019) · Academy of Management Perspectives · doi:10.5465/amp.2017.0079 · Cited by 74
Metadata
- Authors
- Sauer, J., Chavaillaz, A., & Wastell, D.
- Venue
- Ergonomics
- Publisher
- Informa UK Limited
- Published
- 2015-10-14
- Volume
- 59
- Issue
- 6
- Pages
- 767-780
- ISSN
- 0014-0139 (ISSN-L)
- 1366-5847
- OpenAlex
- W1934515642
- Cited by
- 73
- References
- 15
- FWCI
- 10.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (134566)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Experience of automation failures in training: effects on trust, automation bias, complacency and performance. https://app.cochat.ai/papers/10.1080/00140139.2015.1094577
- The paper
- Sauer, J., Chavaillaz, A., & Wastell, D. (2016). Experience of automation failures in training: effects on trust, automation bias, complacency and performance. Ergonomics. https://doi.org/10.1080/00140139.2015.1094577
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.