CoChat

Using Modeling and Simulation to Predict Operator Performance and Automation-Induced Complacency With Robotic Automation: A Case Study and Empirical Validation

Wickens, Christopher D., Sebok, Angelia, Li, Huiyang, Sarter, Nadine, Gacy, Andrew M. · 2015 · Human Factors: The Journal of the Human Factors and Ergonomics Society
Cited by 43

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Abstract

Objective: The aim of this study was to develop and validate a computational model of the automation complacency effect, as operators work on a robotic arm task, supported by three different degrees of automation. Background: Some computational models of complacency in human–automation interaction exist, but those are formed and validated within the context of fairly simplified monitoring failures. This research extends model validation to a much more complex task, so that system designers can establish, without need for human-in-the-loop (HITL) experimentation, merits and shortcomings of different automation degrees. Method: We developed a realistic simulation of a space-based robotic arm task that could be carried out with three different levels of trajectory visualization and execution automation support. Using this simulation, we performed HITL testing. Complacency was induced via several trials of correctly performing automation and then was assessed on trials when automation failed. Following a cognitive task analysis of the robotic arm operation, we developed a multicomponent model of the robotic operator and his or her reliance on automation, based in part on visual scanning. Results: The comparison of model predictions with empirical results revealed that the model accurately predicted routine performance and predicted the responses to these failures after complacency developed. However, the scanning models do not account for the entire attention allocation effects of complacency. Applications: Complacency modeling can provide a useful tool for predicting the effects of different types of imperfect automation. The results from this research suggest that focus should be given to supporting situation awareness in automation development.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/0018720814566454

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

  • A model for types and levels of human interaction with automation

    Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 2×

    “To implement automation both in our model and in the robotic environment, we adopted a slightly simplified version of the stages-and-levels-of-automation taxonomy of Parasuraman et al. (2000; Parasuraman, Sheridan, & Wickens, 2008).”
    MethodSelf-citation
  • Multiple resources and performance prediction

    Wickens, C. D. (2002) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220210123806 · Cited by 2,621 · cited 1×

    “Workload was modeled using a multiple resource approach (Wickens, 2002).”
    MethodSelf-citation
  • Complacency and Bias in Human Use of Automation: An Attentional Integration

    Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710 · cited 3×

    “…decrements that occur when automation fails are due to loss of situation awareness or—quite likely—increasing operator compla-cency reflected in a change in monitoring/ attention strategies (Metzger & Parasuraman, 2005; Moray & Inagaki, 2000; Parasuraman et al., 1993; Parasuraman & Manzey, 2010).”
    Background
  • Performance Consequences of Automation-Induced 'Complacency'

    Parasuraman, R., Molloy, R., & Singh, I. L. (1993) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0301_1 · Cited by 875 · cited 2×

    “…decrements that occur when automation fails are due to loss of situation awareness or—quite likely—increasing operator compla-cency reflected in a change in monitoring/ attention strategies (Metzger & Parasuraman, 2005; Moray & Inagaki, 2000; Parasuraman et al., 1993; Parasuraman & Manzey, 2010).”
    Background
  • Flight-deck automation: promises and problems

    WIENER, E. L., & CURRY, R. E. (1980) · Ergonomics · doi:10.1080/00140138008924809 · Cited by 599 · cited 1×

    “It offers the potential both to significantly improve and to severely impair performance, particularly in conditions where automation fails or behaves in ways that the operator does not expect or understand (Wiener & Curry, 1980).”
    Background
  • Human Performance Consequences of Stages and Levels of Automation: An Integrated Meta-Analysis

    Onnasch, L., Wickens, C. D., Li, H., & Manzey, D. (2014) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720813501549 · Cited by 524

    Self-citation
  • human-computer monitoring

    Parasuraman, R. (1987) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088702900609 · Cited by 175 · cited 1×

    “…becomes increasingly disengaged from the automated processes under his or her control with higher degrees of automation, he or she ceases to monitor it effectively (e.g., Bagheri & Jamieson, 2004; Metzger & Parasuraman, 2005; Moray & Inagaki, 2000; Parasuraman, 1987; Wickens, Dixon, et al., 2005).”
    Background

Show all 7 references

Cited by

See all 43

Metadata

Authors
Wickens, C. D., Sebok, A., Li, H., Sarter, N., & Gacy, A. M.
Venue
Human Factors: The Journal of the Human Factors and Ergonomics Society
Published
2015-01-12
Volume
57
Issue
6
Pages
959-975
ISSN
  • 0018-7208 (ISSN-L)
  • 1547-8181
OpenAlex
W2108104830
Cited by
43
References
7
FWCI
9.39
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Using Modeling and Simulation to Predict Operator Performance and Automation-Induced Complacency With Robotic Automation: A Case Study and Empirical Validation. https://app.cochat.ai/papers/10.1177/0018720814566454
The paper
Wickens, C. D., Sebok, A., Li, H., Sarter, N., & Gacy, A. M. (2015). Using Modeling and Simulation to Predict Operator Performance and Automation-Induced Complacency With Robotic Automation: A Case Study and Empirical Validation. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/0018720814566454

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.