A Quantitative Measure for Degree of Automation and Its Relation to System Performance and Mental Load
The DOI matches its Crossref record; 18 of the 19 references it cites were found in a registry or an index.
Abstract
In this paper we quantitatively model degree of automation (DofA) in supervisory control as a function of the number and nature of tasks to be performed by the operator and automation. This model uses a task weighting scheme in which weighting factors are obtained from task demand load, task mental load and using an experimental system. Based on controlled experiments using operators, analyses of the task effect on system performance, the prediction and assessment of task demand load, and the prediction of mental load were performed. Each experiment had a different DofA. The effect of a change in DofA on system performance and mental load was investigated. It was found that system performance became less sensitive to changes in DofA at higher levels of DofA. The experimental data showed that when the operator controlled a partly automated system, perceived mental load could be predicted from the task mental load for each task component, as calculated by analyzing a situation in which all tasks were manually controlled. Actual or potential applications of this research include a methodology to balance and optimize the automation of complex industrial systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Bainbridge, L. (1983) · Automatica · doi:10.1016/0005-1098(83)90046-8 · Cited by 2,205 · cited 1×
“Bainbridge (1983) discussed the possible consequences of increasing the level of automation.”
BackgroundTelerobotics, Automation, and Human Supervisory Control
Sheridan, T. B. (1992) · Medical Entomology and Zoology · Cited by 1,949
The Out-of-the-Loop Performance Problem and Level of Control in Automation
Endsley, M. R., & Kiris, E. O. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779064555 · Cited by 1,406 · cited 3×
“The operator’s situation awareness and operational skill can be diminished by full automation (Endsley & Kiris, 1995), so it is important to keep the operator in the control loop and to let him or her have a reasonable level of workload.”
BackgroundMethodResultRecommendations for Mental Workload Measurement in a Test and Evaluation Environment
Wierwille, W. W., & Eggemeier, F. T. (1993) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089303500205 · Cited by 295 · cited 2×
“The rating instruments are among the most sensitive, most transferable, and least intrusive techniques for workload estimation (Wierwille & Eggemeier, 1993).”
MethodWhitfield, D. (1988) · Displays · doi:10.1016/0141-9382(88)90068-6 · Cited by 212
Information and Decision Technologies
Naidu, E., & Viswanadham, N. (1992) · NOT FOUND REPOSITORY (Indian Institute of Science Bangalore) · Cited by 182
The Allocation of Functions in Systems
Price, H. E. (1985) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088502700104 · Cited by 176 · cited 1×
“During the allocation stage, tasks can be broadly categorized into three groups (Price, 1985): Category 1: Tasks that must be allocated to the human operator Category 2: Tasks that can be performed by the operator or by automation Category 3: Tasks that must be automated Consequently, task…”
BackgroundInternal representation, internal model, human performance model and mental workload
STASSEN, H. G., Johannsen, G., & Moray, N. P. (1990) · Automatica · doi:10.1016/0005-1098(90)90057-o · Cited by 140 · cited 3×
“The perceived workload depends on the human and is called task mental load (TML; Stassen et al., 1990).”
BackgroundInfluentialAbsolute Magnitude Estimation and Relative Judgement Approaches to Subjective Workload Assessment
Vidulich, M. A., & Tsang, P. S. (1987) · Proceedings of the Human Factors Society Annual Meeting · doi:10.1177/154193128703100930 · Cited by 81 · cited 1×
“Moreover, a unidimensional rating scale is found to achieve results similar to a multidimensional scale and is simple to use (Veltman & Gaillard, 1993; Vidulich & Tsang, 1987).”
BackgroundTheoretical problems in man-machine systems and their experimental validation
Johannsen, G., Levis, A. H., & STASSEN, H. G. (1994) · Automatica · doi:10.1016/0005-1098(94)90026-4 · Cited by 56
Research works printed but not linked: 6
- Endestad, T., 1991, The Halden Reactor Project workshop on guidelines for design and evaluation of computerized systems for the man-machine interface
- Fitts, P. M., 1951, Human engineering for an effective air navigation and traffic control system
- National Instruments Corp., 1993, LabVIEW for Windows - User manual
- Veldt, R. J. van der. (1984). Looking ahead supervisory control. In Proceedings of the 4th European Annual Conference on Human Decision Making and Manual Control (pp. 249–262). Soesterberg, Netherlands: TNO Institute for Perception.
- Veltman, J. A. & Gaillard, A. W. K. (1993). Measurement of pilot workload with subjective and physiological techniques. In Proceedings of Workload Assessment and Aviation Safety (pp. 3.1–3.13). London: Royal Aeronautical Society.
- Zijlstra, F. R. H., 1993, Efficiency in work behavior
Cited by
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195
Sheridan, T. B., & Parasuraman, R. (2005) · Reviews of Human Factors and Ergonomics · doi:10.1518/155723405783703082 · Cited by 474
Robotics for Customer Service: A Useful Complement or an Ultimate Substitute?
Xiao, L., & Kumar, V. (2021) · Journal of Service Research · doi:10.1177/1094670519878881 · Cited by 358
“Nonetheless, these two methods suffer from information loss or the difficulty of data collection and lack of objectivity (Wei, Macwan, and Wieringa 1998).”
BackgroundAdaptive automation, trust, and self-confidence in fault management of time-critical tasks.
Moray, N., Inagaki, T., & Itoh, M. (2000) · Journal of Experimental Psychology: Applied · doi:10.1037//1076-898x.6.1.44 · Cited by 345
Designing automation for human use: empirical studies and quantitative models
Parasuraman, R. (2000) · Ergonomics · doi:10.1080/001401300409125 · Cited by 293
Metadata
- Authors
- Wei, Z.-G., Macwan, A. P., & Wieringa, P. A.
- Affiliations
- Delft University of Technology, Delft, Netherlands
- Delft University of Technology (NL)
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 1998-06
- Volume
- 40
- Issue
- 2
- Pages
- 277-295
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W1978997690
- Cited by
- 51
- References
- 19
- Citations by year
- 2024: 2 · 2023: 3 · 2019: 2 · 2017: 2 · 2016: 2 · 2015: 4 · 2014: 2 · 2013: 3 · 2012: 1
- FWCI
- 6.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Human Factors and Ergonomics › Ergonomics and Human Factors
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- levels of automation, supervisory control, mental workload, task weighting, system performance, human-automation interaction, industrial control systems, operator workload
- MeSH terms
- Adult, Automation, Humans, Mental Processes, Task Performance and Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Quantitative Measure for Degree of Automation and Its Relation to System Performance and Mental Load. https://app.cochat.ai/papers/10.1518/001872098779480406
- The paper
- Wei, Z.-G., Macwan, A. P., & Wieringa, P. A. (1998). A Quantitative Measure for Degree of Automation and Its Relation to System Performance and Mental Load. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1518/001872098779480406
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.