The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Human Performance Consequences of Stages and Levels of Automation: An Integrated Meta-Analysis
Abstract
Objective: We investigated how automation-induced human performance consequences depended on the degree of automation (DOA). Background: Function allocation between human and automation can be represented in terms of the stages and levels taxonomy proposed by Parasuraman, Sheridan, and Wickens. Higher DOAs are achieved both by later stages and higher levels within stages. Method: A meta-analysis based on data of 18 experiments examines the mediating effects of DOA on routine system performance, performance when the automation fails, workload, and situation awareness (SA). The effects of DOA on these measures are summarized by level of statistical significance. Results: We found (a) a clear automation benefit for routine system performance with increasing DOA, (b) a similar but weaker pattern for workload when automation functioned properly, and (c) a negative impact of higher DOA on failure system performance and SA. Most interesting was the finding that negative consequences of automation seem to be most likely when DOA moved across a critical boundary, which was identified between automation supporting information analysis and automation supporting action selection. Conclusion: Results support the proposed cost–benefit trade-off with regard to DOA. It seems that routine performance and workload on one hand, and the potential loss of SA and manual skills on the other hand, directly trade off and that appropriate function allocation can serve only one of the two aspects. Application: Findings contribute to the body of research on adequate function allocation by providing an overall picture through quantitatively combining data from a variety of studies across varying domains.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This creates an automation paradox, where factors that positively influence performance when the automation is working well may undermine performance when the automation errs or fails (Onnasch et al., 2014).”
From Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy (2021) · cites this paper as Onnasch et al., 2014
In the citing paper
“Thus, broad recommendations of 'medium' automation adoption levels are likely to unhelpful as they do not take sufficient account of these important contingencies (Onnasch et al., 2014).”
From Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy (2021) · cites this paper as Onnasch et al., 2014
In the citing paper
“However, higher levels of automation may also reduce the situation awareness of the worker, and increase a tendency to overly rely on automation technology (Onnasch et al., 2014).”
From Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy (2021) · cites this paper as Onnasch et al., 2014
In the citing paper
“Third, the level of automation selected for functional task stages may have impacts on human worker performance. These impacts may be positive or negative.”
From Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy (2021) · cites this paper as Onnasch et al., 2014
In the citing paper
“For example, higher levels of automation may reduce operators' workload and achieve better results.”
From Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy (2021) · cites this paper as Onnasch et al., 2014
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · cited 1×
“A second metavari-able was operators’ subjective workload , typically quantified by the NASA-TLX (Hart & Staveland, 1988) as used, for example, by Ends-ley and Kaber (1999).”
MethodEngineering Psychology and Human Performance
Wickens, C. D., Hollands, J. G., Banbury, S., & Parasuraman, R. (2015) · Psychology Press eBooks · doi:10.4324/9781315665177 · Cited by 4,982
Self-citationMeta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635 · cited 2×
“…by quantitatively combining data from a variety of studies across varying domains (e.g., process control, aviation), an approach analogous to a classic meta-analysis (Fadden, Ververs, & Wick-ens, 1998; Horrey & Wickens, 2006; Rosenthal, 1991; Wickens, Hutchinson, Carolan, & Cum-ming, 2013).”
MethodHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 1×
“These catastrophic effects may result from human’s reduced monitoring of highly reliable automation at the time it fails, trusting it too much (Parasuraman & Riley, 1997) and losing situation awareness (Endsley & Kiris, 1995).”
BackgroundMeta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · The Statistician · doi:10.2307/2348600 · Cited by 4,249
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 3×
“Elaborating on this concept, Parasuraman, Sheridan, and Wickens (2000) and Wickens et al. (1998) proposed a concept in which automation could filter information from the environment (Stage 1: information acquisition), integrate this information, as when forming an assessment based on several…”
BackgroundSelf-citationBainbridge, L. (1983) · Automatica · doi:10.1016/0005-1098(83)90046-8 · Cited by 2,205 · cited 1×
“It has been long known that automation can both hurt and benefit human performance (e.g., Bainbridge, 1983; Ephrath & Young, 1981; Kessel & Wickens, 1982; Rasmussen & Rouse, 1981; Sheridan, 2002; Wickens & Kes-sel, 1979, 1981; Wickens, Mavor, Parasuraman, & McGee, 1998; Wiener & Curry, 1980).”
BackgroundMultiple Resources and Mental Workload
Wickens, C. D. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288394 · Cited by 2,164 · cited 4×
“The hypothetical trade-offs depicted in Figure 2 are critical for task allocation because these trade-offs may not be linear, and in some cases a “flat” function may allow strong recommendations for the optimal task allocation (Wickens, 2008a).”
BackgroundInfluentialSelf-citationSituation Awareness Analysis and Measurement
(2000) · CRC Press eBooks · doi:10.1201/b12461 · Cited by 2,046
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710 · cited 1×
“…operators occasionally over-rely on automation and exhibit complacency because the highly (but not perfectly) reliable automation functioned properly for an extended period prior to this first failure (Parasuraman et al., 1993; Parasuraman & Manzey, 2010; Yeh, Merlo, Wickens, & Brandenburg, 2003).”
BackgroundSelf-citation
Research works printed but not linked: 4
- Li H., An investigation of automation degree in assisting robotic arm control
- Mosier K. L., 1996, Automation and human performance: Theory and applications, 201
- Osgood J., 1949, Psychological Review, 47, 419
- Taylor R. M., 1990, Situational awareness in aerospace operations
Cited by
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611
“This creates an automation paradox, where factors that positively in fl uence performance when the automation is working well may undermine performance when the automation fails (Onnasch et al., 2014).”
BackgroundFrom Here to Autonomy: Lessons Learned From Human–Automation Research
Endsley, M. R. (2017) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816681350 · Cited by 898
“This type of automation significantly reduces workload and can enhance both SA and performance with little negative effects (Endsley et al., 2003; Endsley & Selcon, 1997; Onnasch et al., 2014; Sarter & Schroeder, 2001).”
BackgroundInfluentialHuman–Autonomy Teaming: A Review and Analysis of the Empirical Literature
O’Neill, T., McNeese, N., Barron, A., & Schelble, B. (2022) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820960865 · Cited by 695
Human–Agent Teaming for Multirobot Control: A Review of Human Factors Issues
Chen, J. Y. C., & Barnes, M. J. (2014) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2013.2293535 · Cited by 522
From ‘automation’ to ‘autonomy’: the importance of trust repair in human–machine interaction
de Visser, E. J., Pak, R., & Shaw, T. H. (2018) · Ergonomics · doi:10.1080/00140139.2018.1457725 · Cited by 398
“…between automated systems and systems that exhibit autonomy, previously iden tified problems with automation (e.g. out of the loop syndrome, mode awareness, complacency, trust) are expected to not only exist, but be mag nified , a phenomenon known as the lumberjack eff ect (Onnasch et al. 2014).”
Background
Metadata
- Authors
- Onnasch, L., Wickens, C. D., Li, H., & Manzey, D.
- Affiliations
- Technische Universität Berlin (DE)
- Alion Science and Technology (United States) (US)
- University of Michigan (US)
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2013-08-20
- Volume
- 56
- Issue
- 3
- Pages
- 476-488
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W2135556086
- Cited by
- 524
- References
- 69
- Citations by year
- 2026: 53 · 2025: 45 · 2024: 58 · 2023: 46 · 2022: 48 · 2021: 55 · 2020: 37 · 2019: 32 · 2018: 36 · 2017: 42 · 2016: 32 · 2015: 24 · 2014: 15 · 2013: 1
- FWCI
- 3.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Johnson Space Center
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Human Factors and Ergonomics › Ergonomics and Human Factors
- Keywords
- levels of automation, automation failure, workload, situational awareness, manual skills, cost-benefit trade-off, critical boundary, human performance
- MeSH terms
- Automation, Awareness, Female, Humans, Male, Task Performance and Analysis, Workload
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Human Performance Consequences of Stages and Levels of Automation: An Integrated Meta-Analysis. https://app.cochat.ai/papers/10.1177/0018720813501549
- The paper
- Onnasch, L., Wickens, C. D., Li, H., & Manzey, D. (2014). Human Performance Consequences of Stages and Levels of Automation: An Integrated Meta-Analysis. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/0018720813501549
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.