The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
The Out-of-the-Loop Performance Problem and Level of Control in Automation
Abstract
The out-of-the-loop performance problem, a major potential consequence of automation, leaves operators of automated systems handicapped in their ability to take over manual operations in the event of automation failure. This is attributed to a possible loss of skills and of situation awareness (SA) arising from vigilance and complacency problems, a shift from active to passive information processing, and change in feedback provided to the operator. We studied the automation of a navigation task using an expert system and demonstrated that low SA corresponded with out-of-the-loop performance decrements in decision time following a failure of the expert system. Level of operator control in interacting with automation is a major factor in moderating this loss of SA. Results indicated that the shift from active to passive processing was most likely responsible for decreased SA under automated conditions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Results of this study showed that increasing the level of automation reduces the SA level from 98% (in manual driven vehicles) to almost 75% (in fully AVs) [191].”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [191]
In the citing paper
“If under such conditions of system failure the human operator is required to intervene and salvage the situation, the problem of out-the-loop unfamiliarity may prevent the operator from intervening successfully or in a timely manner [8], [47], [55].”
From A model for types and levels of human interaction with automation (2000) · cites this paper as [55]
In the citing paper
“Endsley and Kiris (1995) documented the”
From The Metacognitive Paradox of AI-Assisted Creativity: A Theoretical Extension (2026) · cites this paper as Endsley and Kiris (1995)
In the citing paper
“This research, primarily conducted in aviation and industrial control contexts, demonstrates that skills can atrophy relatively quickly when not regularly exercised, and that regaining proficiency after periods of automation-supported performance requires substantial retraining.”
From The Metacognitive Paradox of AI-Assisted Creativity: A Theoretical Extension (2026) · cites this paper as Endsley and Kiris (1995)
In the citing paper
“Over time, these organizations lose the human skills required to alter their processes (Endsley & Kiris, 1995).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Endsley & Kiris, 1995
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Handbook of perception and human performance
Boff, K. R., Kaufman, L., & Thomas, J. P. (1986) · Wiley eBooks · Cited by 4,031
Rasmussen, J. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313160 · Cited by 3,434
Bainbridge, L. (1983) · Automatica · doi:10.1016/0005-1098(83)90046-8 · Cited by 2,205
Design and Evaluation for Situation Awareness Enhancement
Endsley, M. R. (1988) · Proceedings of the Human Factors Society Annual Meeting · doi:10.1177/154193128803200221 · Cited by 1,930
Self-citationCowan, N. (1988) · Psychological Bulletin · doi:10.1037//0033-2909.104.2.163 · Cited by 1,786
The generation effect: delineation of a phenomenon
Slamecka, N. J., & Graf, P. (1978) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.4.6.592 · Cited by 1,659
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
Performance Consequences of Automation-Induced 'Complacency'
Parasuraman, R., Molloy, R., & Singh, I. L. (1993) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0301_1 · Cited by 875 · cited 2×
“Recent research by Parasuraman et al. (1993) investigated the effects of system reliability on operator detection of system failures.”
BackgroundAviation, space and environmental medicine
(1990) · Journal of Sound and Vibration · doi:10.1016/0022-460x(90)90650-o · Cited by 625
Research works printed but not linked: 12
- Carmody, M. A., 1993, Proceedings of the Seventh International Symposium on Aviation Psychology, 167
- 10.1037/0033-2909.104.2.163 · DOI · Paper page
- Endsley, M. R., Paper presented at the NASA/FAA Workshop on Artificial Intelligence and Human Factors in Air Traffic Control and Aviation Maintenance
- Endsley, M. R. (1993a). Situation awareness and workload: Flip sides of the same coin. In R. S. Jensen and D. Neumeister (Eds.), Proceedings of the Seventh International Symposium on Aviation Psychology (pp. 906–911). Columbus, OH: Ohio State University, Department of Aviation.
- Endsley, M. R., Paper presented at the First International Conference on Situational Awareness in Complex Systems
- Kiris, E. O., 1993, Proceedings of the Seventh International Symposium on Aviation Psychology, 27
- Orlady, H. W., 1989, Proceedings of the Fifth International Symposium on Aviation Psychology, 91
- Parasuraman, R., Paper presented at the NASA/FAA Workshop on Artificial Intelligence and Human Factors in Air Traffic Control and Aviation Maintenance
- Shiff, B., 1983, An experimental study of the human-computer interface in process control.
- Waterman, D. A., 1986, A guide to expert systems
- Wempe, T., 1965, Aerospace Medicine, 36, 246
- Wiener, E. L., Paper presented at the NASA/FAA Workshop on Artificial Intelligence and Human Factors in Air Traffic Control and Aviation Maintenance
Cited by
Toward a Theory of Situation Awareness in Dynamic Systems
Endsley, M. R. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049543 · Cited by 8,875
Self-citationA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195
Artificial Intelligence and Management: The Automation–Augmentation Paradox
Raisch, S., & Krakowski, S. (2021) · Academy of Management Review · doi:10.5465/amr.2018.0072 · Cited by 2,755
ENDSLEY, M. R., & KABER, D. B. (1999) · Ergonomics · doi:10.1080/001401399185595 · Cited by 1,088
Self-citationFrom Here to Autonomy: Lessons Learned From Human–Automation Research
Endsley, M. R. (2017) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816681350 · Cited by 898
Self-citation
Metadata
- Authors
- Endsley, M. R., & Kiris, E. O.
- Affiliations
- Texas Tech University (US)
- ORCID
- Endsley, Mica R.
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 1995-06
- Volume
- 37
- Issue
- 2
- Pages
- 381-394
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W2124853884
- Cited by
- 1,406
- References
- 33
- Citations by year
- 2026: 126 · 2025: 74 · 2024: 76 · 2023: 70 · 2022: 88 · 2021: 80 · 2020: 75 · 2019: 79 · 2018: 82 · 2017: 91 · 2016: 59 · 2015: 37 · 2014: 44 · 2013: 56 · 2012: 31
- FWCI
- 21.10
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Risk and Safety Analysis
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- human-automation interaction, situational awareness, operator control, automation failure, expert systems, sustained attention, complacency, decision time, navigation tasks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Out-of-the-Loop Performance Problem and Level of Control in Automation. https://app.cochat.ai/papers/10.1518/001872095779064555
- The paper
- Endsley, M. R., & Kiris, E. O. (1995). The Out-of-the-Loop Performance Problem and Level of Control in Automation. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1518/001872095779064555
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.