The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
The Psychometrics of Mental Workload: Multiple Measures Are Sensitive but Divergent
Open accessAbstract
Objective: A study was run to test the sensitivity of multiple workload indices to the differing cognitive demands of four military monitoring task scenarios and to investigate relationships between indices. Background: Various psychophysiological indices of mental workload exhibit sensitivity to task factors. However, the psychometric properties of multiple indices, including the extent to which they intercorrelate, have not been adequately investigated. Method: One hundred fifty participants performed in four task scenarios based on a simulation of unmanned ground vehicle operation. Scenarios required threat detection and/or change detection. Both single- and dual-task scenarios were used. Workload metrics for each scenario were derived from the electroencephalogram (EEG), electrocardiogram, transcranial Doppler sonography, functional near infrared, and eye tracking. Subjective workload was also assessed. Results: Several metrics showed sensitivity to the differing demands of the four scenarios. Eye fixation duration and the Task Load Index metric derived from EEG were diagnostic of single-versus dual-task performance. Several other metrics differentiated the two single tasks but were less effective in differentiating single- from dual-task performance. Psychometric analyses confirmed the reliability of individual metrics but failed to identify any general workload factor. An analysis of difference scores between low- and high-workload conditions suggested an effort factor defined by heart rate variability and frontal cortex oxygenation. Conclusions: General workload is not well defined psychometrically, although various individual metrics may satisfy conventional criteria for workload assessment. Application: Practitioners should exercise caution in using multiple metrics that may not correspond well, especially at the level of the individual operator.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 80,031
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
A Rationale and Test for the Number of Factors in Factor Analysis
Horn, J. L. (1965) · Psychometrika · doi:10.1007/bf02289447 · Cited by 8,714
EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis
Klimesch, W. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00056-3 · Cited by 6,889
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 3×
“The strongest effect sizes were found for the subjective NASA-TLX measure (Hart & Staveland, 1988), which was sensitive to both task type and dual tasking. The psychophysiological measures tended to be sensitive to one or other workload manipulation but not both, suggesting differential diagnosticity. Fixation duratio…”
BackgroundMethodResultFactor Retention Decisions in Exploratory Factor Analysis: a Tutorial on Parallel Analysis
Hayton, J. C., Allen, D. G., & Scarpello, V. (2004) · Organizational Research Methods · doi:10.1177/1094428104263675 · Cited by 3,104
Standards for Educational and Psychological Testing.
García, E. J. (2017) · Revista Española de Pedagogía · doi:10.22550/2174-0909.3051 · Cited by 2,217
Identifying fixations and saccades in eye-tracking protocols
Salvucci, D. D., & Goldberg, J. H. (2000) · Proceedings of the symposium on Eye tracking research & applications - ETRA '00 · doi:10.1145/355017.355028 · Cited by 2,203
Multiple Resources and Mental Workload
Wickens, C. D. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288394 · Cited by 2,164
Cited by
Measuring mental workload using physiological measures: A systematic review
Charles, R. L., & Nixon, J. (2019) · Applied Ergonomics · doi:10.1016/j.apergo.2018.08.028 · Cited by 704
A Systematic Review of Physiological Measures of Mental Workload
Tao, D., Tan, H., Wang, H., Zhang, X., Qu, X., & Zhang, T. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16152716 · Cited by 303
EEG power spectral measures of cognitive workload: A meta‐analysis
Chikhi, S., Matton, N., & Blanchet, S. (2022) · Psychophysiology · doi:10.1111/psyp.14009 · Cited by 258
Electronic Health Record Alert-Related Workload as a Predictor of Burnout in Primary Care Providers
Russo, E., Singh, H., & Gregory, M. E. (2017) · Applied Clinical Informatics · doi:10.4338/aci-2017-01-ra-0003 · Cited by 169
Common Metrics to Benchmark Human-Machine Teams (HMT): A Review
Damacharla, P., Javaid, A. Y., Gallimore, J. J., & Devabhaktuni, V. K. (2020) · arXiv · doi:10.48550/arxiv.2008.04855 · Cited by 97
Metadata
- Authors
- Matthews, G., Reinerman-Jones, L. E., Barber, D. J., & Abich, J.
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2014-06-18
- Volume
- 57
- Issue
- 1
- Pages
- 125-143
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W2129825373
- Cited by
- 265
- References
- 73
- FWCI
- 24.80
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Psychometrics of Mental Workload: Multiple Measures Are Sensitive but Divergent. https://app.cochat.ai/papers/10.1177/0018720814539505
- The paper
- Matthews, G., Reinerman-Jones, L. E., Barber, D. J., & Abich, J. (2015). The Psychometrics of Mental Workload: Multiple Measures Are Sensitive but Divergent. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/0018720814539505
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.