Using Modeling and Simulation to Predict Operator Performance and Automation-Induced Complacency With Robotic Automation: A Case Study and Empirical Validation
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Objective: The aim of this study was to develop and validate a computational model of the automation complacency effect, as operators work on a robotic arm task, supported by three different degrees of automation. Background: Some computational models of complacency in human–automation interaction exist, but those are formed and validated within the context of fairly simplified monitoring failures. This research extends model validation to a much more complex task, so that system designers can establish, without need for human-in-the-loop (HITL) experimentation, merits and shortcomings of different automation degrees. Method: We developed a realistic simulation of a space-based robotic arm task that could be carried out with three different levels of trajectory visualization and execution automation support. Using this simulation, we performed HITL testing. Complacency was induced via several trials of correctly performing automation and then was assessed on trials when automation failed. Following a cognitive task analysis of the robotic arm operation, we developed a multicomponent model of the robotic operator and his or her reliance on automation, based in part on visual scanning. Results: The comparison of model predictions with empirical results revealed that the model accurately predicted routine performance and predicted the responses to these failures after complacency developed. However, the scanning models do not account for the entire attention allocation effects of complacency. Applications: Complacency modeling can provide a useful tool for predicting the effects of different types of imperfect automation. The results from this research suggest that focus should be given to supporting situation awareness in automation development.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 2×
“To implement automation both in our model and in the robotic environment, we adopted a slightly simplified version of the stages-and-levels-of-automation taxonomy of Parasuraman et al. (2000; Parasuraman, Sheridan, & Wickens, 2008).”
MethodSelf-citationMultiple resources and performance prediction
Wickens, C. D. (2002) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220210123806 · Cited by 2,621 · cited 1×
“Workload was modeled using a multiple resource approach (Wickens, 2002).”
MethodSelf-citationComplacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710 · cited 3×
“…decrements that occur when automation fails are due to loss of situation awareness or—quite likely—increasing operator compla-cency reflected in a change in monitoring/ attention strategies (Metzger & Parasuraman, 2005; Moray & Inagaki, 2000; Parasuraman et al., 1993; Parasuraman & Manzey, 2010).”
BackgroundPerformance Consequences of Automation-Induced 'Complacency'
Parasuraman, R., Molloy, R., & Singh, I. L. (1993) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0301_1 · Cited by 875 · cited 2×
“…decrements that occur when automation fails are due to loss of situation awareness or—quite likely—increasing operator compla-cency reflected in a change in monitoring/ attention strategies (Metzger & Parasuraman, 2005; Moray & Inagaki, 2000; Parasuraman et al., 1993; Parasuraman & Manzey, 2010).”
BackgroundFlight-deck automation: promises and problems
WIENER, E. L., & CURRY, R. E. (1980) · Ergonomics · doi:10.1080/00140138008924809 · Cited by 599 · cited 1×
“It offers the potential both to significantly improve and to severely impair performance, particularly in conditions where automation fails or behaves in ways that the operator does not expect or understand (Wiener & Curry, 1980).”
BackgroundHuman Performance Consequences of Stages and Levels of Automation: An Integrated Meta-Analysis
Onnasch, L., Wickens, C. D., Li, H., & Manzey, D. (2014) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720813501549 · Cited by 524
Self-citationParasuraman, R. (1987) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088702900609 · Cited by 175 · cited 1×
“…becomes increasingly disengaged from the automated processes under his or her control with higher degrees of automation, he or she ceases to monitor it effectively (e.g., Bagheri & Jamieson, 2004; Metzger & Parasuraman, 2005; Moray & Inagaki, 2000; Parasuraman, 1987; Wickens, Dixon, et al., 2005).”
Background
Cited by
Risko, E. F., & Gilbert, S. J. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.07.002 · Cited by 1,502
From Here to Autonomy: Lessons Learned From Human–Automation Research
Endsley, M. R. (2017) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816681350 · Cited by 898
“TAbLE 2: (continued) • The model is largely consistent with existing models of complacency (Wickens et al., 2015) and trust (Hancock et al., 2011; Hoff & Bashir, 2015) but extends beyond them to place these constructs in the broader context of cognitive constructs and design features affecting…”
MethodResultKunze, A., Summerskill, S. J., Marshall, R., & Filtness, A. J. (2019) · Ergonomics · doi:10.1080/00140139.2018.1547842 · Cited by 165
Sebok, A., & Wickens, C. D. (2017) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816665201 · Cited by 75
Self-citation
Metadata
- Authors
- Wickens, C. D., Sebok, A., Li, H., Sarter, N., & Gacy, A. M.
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2015-01-12
- Volume
- 57
- Issue
- 6
- Pages
- 959-975
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W2108104830
- Cited by
- 43
- References
- 7
- FWCI
- 9.39
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using Modeling and Simulation to Predict Operator Performance and Automation-Induced Complacency With Robotic Automation: A Case Study and Empirical Validation. https://app.cochat.ai/papers/10.1177/0018720814566454
- The paper
- Wickens, C. D., Sebok, A., Li, H., Sarter, N., & Gacy, A. M. (2015). Using Modeling and Simulation to Predict Operator Performance and Automation-Induced Complacency With Robotic Automation: A Case Study and Empirical Validation. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/0018720814566454
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.