Automation Bias and Errors: Are Teams Better than Individuals?
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
A series of recent studies has identified two classes of errors that commonly emerge in highly automated decision environments: (1) omission errors, defined as failures to respond to system irregularities or events because automated devices fail to detect or indicate them; and (2) commission errors, which occur when people incorrectly follow an automated directive or recommendation, without verifying it against other available information, or in spite of contra-indications from other sources of information. These errors are hypothesized to be the result of “automation bias,” the use of automation as a heuristic replacement for vigilant information seeking and processing. Two concurrent studies, using students and professional pilots as participants, demonstrated the persistence of automation bias in crews compared with solo performers, despite display enhancements and explicit training to verify automated functioning. Training that focused on automation bias and associated errors successfully reduced omission errors in students. Pilot performance during the experimental legs was most highly predicted by performance on the control leg and by event importance. The previously found “phantom memory” phenomenon associated with a false engine fire event persisted in crews.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Social Facilitation: A solution is suggested for an old unresolved social psychological problem.
Zajonc, R. B. (1965) · Science · doi:10.1126/science.149.3681.269 · Cited by 2,951
Automation Bias: Decision Making and Performance in High-Tech Cockpits
Mosier, K. L., Skitka, L. J., Heers, S., & Burdick, M. (1998) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0801_3 · Cited by 353 · cited 4×
“Consistent with past findings (e.g., Mosier et al, 1998), air crew behavior was not impacted by external manipulations.”
BackgroundResultSelf-citationAccountability and automation bias
SKITKA, L. J., MOSIER, K., & BURDICK, M. D. (2000) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0349 · Cited by 324
Self-citation
Cited by
Does automation bias decision-making?
SKITKA, L. J., MOSIER, K. L., & BURDICK, M. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0252 · Cited by 694
Self-citationAlon-Barkat, S., & Busuioc, M. (2023) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muac007 · Cited by 469
Disparate Interactions: An Algorithm-in-the-Loop Analysis of Fairness in Risk Assessments
Green, B., & Chen, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287563 · Cited by 275
“Two types of errors are particularly common: omission errors, in which people do not recognize when automated systems err, and commission errors, in which people follow automated systems without considering contradictory information [51].”
BackgroundA Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scores
De-Arteaga, M., Fogliato, R., & Chouldechova, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376638 · Cited by 221
“A significant portion of the literature analyzing automation bias has studied high-tech cockpits [34, 43, 10, 41], while others have looked at health-care diagnosis [31], and automated control systems for fault management in a thermal-hydraulic environment [33].”
BackgroundAutomation use and automation bias
Mosier, K. L., & Skitka, L. J. (1999) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129904300346 · Cited by 69
“Subsequent studies included professional pilots flying event scenarios in a high-fidelity “part-task” simulator, that is, a computer-based flight simulator that incorporated the flight instrumentation and dynamics of a multi-engine glass-cockpit aircraft (Mosier et al., 1998), and student participants performing a low…”
BackgroundInfluentialSelf-citation
Metadata
- Authors
- Mosier, K. L., Dunbar, M., McDonnell, L., Skitka, L. J., Burdick, M., & Rosenblatt, B.
- Venue
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Publisher
- SAGE Publications
- Published
- 1998-10
- Volume
- 42
- Issue
- 3
- Pages
- 201-205
- ISSN
- 0163-5182 (ISSN-L)
- 1071-1813
- 2169-5067
- OpenAlex
- W2033272533
- Cited by
- 28
- References
- 3
- FWCI
- 3.43
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.