Stages and Levels of Automation: An Integrated Meta-analysis
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Function allocation between human and automation can be represented in terms of the stages & levels taxonomy proposed by Parasuraman, Sheridan & Wickens (2000). Higher degrees of automation (DOA) are achieved both by later stages (e.g., automation decision aiding rather than diagnostic aiding) and higher levels within stages (e.g. executing a choice unless vetoed, versus offering the human several choices). A meta analysis based on data of 14 experiments examines the mediating effects of DOA on routine system performance, performance when the automation fails, workload and situation awareness. The effects of DOA on these four measures are summarized by level of statistical significance. We found: (1) an inverse relationship between routine performance and workload as automation is introduced and DOA increases. (2) a weak positive relationship between routine performance and failure performance, as mediated by DOA. (3) A strong mediating role of situation awareness in improving both routine and failure performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 1×
“These catastrophic erects may result from human’s reduced monitoring of automation at the time it fails, trusting it too much (Parasuraman and Riley, 1997), and losing situation awareness (Endsley & Kiris, 1995).”
BackgroundA model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 2×
“Importantly, the choice of whether or not, and to what degree, to automate a particular function should involve a tradeoff of the costs and probabilities of automation failures and adverse outcomes (Sheridan & Parasuraman, 2000).”
BackgroundSelf-citationBainbridge, L. (1983) · Automatica · doi:10.1016/0005-1098(83)90046-8 · Cited by 2,205 · cited 3×
“…is certainly consistent with empirical findings on automation monitoring and complacency where more reliable automation supports better performance when correct, but a greater likelihood of missing automation detection failures (Molloy & Parasuraman, 1996, Dixon & Wickens, 2006; Bainbridge, 1983).”
BackgroundMultiple Resources and Mental Workload
Wickens, C. D. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288394 · Cited by 2,164 · cited 3×
“…tradeoff is complicated by the fact that “automation” is not an all-or-none concept, as it was often assumed to be in the classic human-machine task allocation analyses (e.g., the “Fitts List”; for a critique of those analyses, see Dekker &Woods, 2002; Parasuraman, Sheridan, & Wickens, 2008).”
BackgroundSelf-citationENDSLEY, M. R., & KABER, D. B. (1999) · Ergonomics · doi:10.1080/001401399185595 · Cited by 1,088
Performance Consequences of Automation-Induced 'Complacency'
Parasuraman, R., Molloy, R., & Singh, I. L. (1993) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0301_1 · Cited by 875 · cited 1×
“Indeed operators occasionally over-rely on the automation and exhibit complacency because the highly (but not perfectly) reliable automation functions properly for an extended period of time prior to this first failure (Parasuraman, Molloy & Singh, 1993, Yeh, Merlo, Wickens & Brandenburg, 2003).”
BackgroundFlight-deck automation: promises and problems
WIENER, E. L., & CURRY, R. E. (1980) · Ergonomics · doi:10.1080/00140138008924809 · Cited by 599 · cited 1×
“It has been long known that automation can both hurt and benefit human performance (e.g., Bainbridge, 1983; Wiener & Curry, 1980; Sheridan, 2002).”
BackgroundThe benefits of imperfect diagnostic automation: a synthesis of the literature
Wickens, C. D., & Dixon, S. R. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500370105 · Cited by 423 · cited 1×
“A similar approach was applied earlier by Wickens and Dixon (2007) who examined stage 2 automation reliability.”
MethodSelf-citationBahner, J. E., Hüper, A.-D., & Manzey, D. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.06.001 · Cited by 279
Status or Recommendation: Selecting the Type of Information for Decision Aiding
Crocoll, W. M., & Coury, B. G. (1990) · Proceedings of the Human Factors Society Annual Meeting · doi:10.1177/154193129003401922 · Cited by 68
Cited by
Robotics for Customer Service: A Useful Complement or an Ultimate Substitute?
Xiao, L., & Kumar, V. (2021) · Journal of Service Research · doi:10.1177/1094670519878881 · Cited by 358
Manzey, D., Reichenbach, J., & Onnasch, L. (2012) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343411433844 · Cited by 277
Adapt and overcome: Perceptions of adaptive autonomous agents for human-AI teaming
Hauptman, A. I., Schelble, B. G., McNeese, N. J., & Madathil, K. C. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107451 · Cited by 110
Understanding human management of automation errors
McBride, S. E., Rogers, W. A., & Fisk, A. D. (2014) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2013.817625 · Cited by 82
An Occupational Safety and Health Perspective on Human in Control and AI
Niehaus, S., Hartwig, M., Rosen, P. H., & Wischniewski, S. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.868382 · Cited by 47
Metadata
- Authors
- Wickens, C. D., Li, H., Santamaria, A., Sebok, A., & Sarter, N. B.
- Venue
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Publisher
- SAGE Publications
- Published
- 2010-09
- Volume
- 54
- Issue
- 4
- Pages
- 389-393
- ISSN
- 0163-5182 (ISSN-L)
- 1071-1813
- 2169-5067
- OpenAlex
- W2131861022
- Cited by
- 133
- References
- 10
- FWCI
- 8.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Stages and Levels of Automation: An Integrated Meta-analysis. https://app.cochat.ai/papers/10.1177/154193121005400425
- The paper
- Wickens, C. D., Li, H., Santamaria, A., Sebok, A., & Sarter, N. B. (2010). Stages and Levels of Automation: An Integrated Meta-analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. https://doi.org/10.1177/154193121005400425
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.