Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 1,406Human-Automation Interaction and SafetyRisk and Safety AnalysisSocial Robot Interaction and HRI

The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.

The Out-of-the-Loop Performance Problem and Level of Control in Automation

Endsley, Mica R., Kiris, Esin O.·1995·Human Factors: The Journal of the Human Factors and Ergonomics Society

Abstract

The out-of-the-loop performance problem, a major potential consequence of automation, leaves operators of automated systems handicapped in their ability to take over manual operations in the event of automation failure. This is attributed to a possible loss of skills and of situation awareness (SA) arising from vigilance and complacency problems, a shift from active to passive information processing, and change in feedback provided to the operator. We studied the automation of a navigation task using an expert system and demonstrated that low SA corresponded with out-of-the-loop performance decrements in decision time following a failure of the expert system. Level of operator control in interacting with automation is a major factor in moderating this loss of SA. Results indicated that the shift from active to passive processing was most likely responsible for decreased SA under automated conditions.

Overview

Integrity signals

Registry

Crossref · 10.1518/001872095779064555

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 33 references

Research works printed but not linked: 12

  1. Carmody, M. A., 1993, Proceedings of the Seventh International Symposium on Aviation Psychology, 167
  2. 10.1037/0033-2909.104.2.163 · DOI · Paper page
  3. Endsley, M. R., Paper presented at the NASA/FAA Workshop on Artificial Intelligence and Human Factors in Air Traffic Control and Aviation Maintenance
  4. Endsley, M. R. (1993a). Situation awareness and workload: Flip sides of the same coin. In R. S. Jensen and D. Neumeister (Eds.), Proceedings of the Seventh International Symposium on Aviation Psychology (pp. 906–911). Columbus, OH: Ohio State University, Department of Aviation.
  5. Endsley, M. R., Paper presented at the First International Conference on Situational Awareness in Complex Systems
  6. Kiris, E. O., 1993, Proceedings of the Seventh International Symposium on Aviation Psychology, 27
  7. Orlady, H. W., 1989, Proceedings of the Fifth International Symposium on Aviation Psychology, 91
  8. Parasuraman, R., Paper presented at the NASA/FAA Workshop on Artificial Intelligence and Human Factors in Air Traffic Control and Aviation Maintenance
  9. Shiff, B., 1983, An experimental study of the human-computer interface in process control.
  10. Waterman, D. A., 1986, A guide to expert systems
  11. Wempe, T., 1965, Aerospace Medicine, 36, 246
  12. Wiener, E. L., Paper presented at the NASA/FAA Workshop on Artificial Intelligence and Human Factors in Air Traffic Control and Aviation Maintenance

Cited by

See all 1,406

Metadata

Authors
Endsley, M. R., & Kiris, E. O.
Affiliations
Texas Tech University (US)
Venue
Human Factors: The Journal of the Human Factors and Ergonomics Society
Published
1995-06
Volume
37
Issue
2
Pages
381-394
ISSN
  • 0018-7208 (ISSN-L)
  • 1547-8181
OpenAlex
W2124853884
Cited by
1,406
References
33
Citations by year
2026: 126 · 2025: 74 · 2024: 76 · 2023: 70 · 2022: 88 · 2021: 80 · 2020: 75 · 2019: 79 · 2018: 82 · 2017: 91 · 2016: 59 · 2015: 37 · 2014: 44 · 2013: 56 · 2012: 31
FWCI
21.10
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion)
Topics
  • Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Risk and Safety Analysis
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
Keywords
human-automation interaction, situational awareness, operator control, automation failure, expert systems, sustained attention, complacency, decision time, navigation tasks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Out-of-the-Loop Performance Problem and Level of Control in Automation. https://app.cochat.ai/papers/10.1518/001872095779064555
The paper
Endsley, M. R., & Kiris, E. O. (1995). The Out-of-the-Loop Performance Problem and Level of Control in Automation. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1518/001872095779064555

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.