Human Performance Benefits of The Automation Transparency Design Principle: Validation and Variation
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Objective: Test the automation transparency design principle using a full-scope nuclear power plant simulator. Background: Automation transparency is a long-held human factors design principle espousing that the responsibilities, capabilities, goals, activities, and/or effects of automation should be directly observable in the human–system interface. The anticipated benefits of transparency include more effective reliance, more appropriate trust, better understanding, and greater user satisfaction. Transparency has enjoyed a recent upsurge in use in the context of human interaction with agent-oriented automation. Method: Three full-scope nuclear power plant simulator studies were conducted with licensed operating crews. In the first two experiments, transparency was implemented for interlocks, controllers, limitations, protections, and automatic programs that operate at the local component level of the plant. In the third experiment, procedure automation assumed control of plant operations and was represented in dedicated agent displays. Results: Results from Experiments 1 and 2 appear to validate the human performance benefits of automation transparency for automation at the component level. However, Experiment 3 failed to replicate these findings for automation that assumed control for executing procedural actions. Conclusion: Automation transparency appears to yield expected benefits for component-level automation, but caution is warranted in generalizing the design principle to agent-oriented automation. Application: The automation transparency design principle may offer a powerful means of compensating for the detrimental impacts of hidden automation influence at the component level of complex systems. However, system developers should exercise caution in assuming that the principle extends to agent-oriented automation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817 · cited 2×
“Jamieson and Skraaning (2019) introduced RIME to provide integrative summaries of measures and their interpretation, independent variables in statistical models and data aggregation practices, statistical results, direction of effects, and the researchers’ concise holistic interpretations of results. The RIME figures…”
BackgroundMethodIntelligent agent transparency in human–agent teaming for multi-UxV management
Mercado, J. E., Rupp, M. A., Chen, J. Y. C., Barnes, M. J., Barber, D., & Procci, K. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815621206 · Cited by 403 · cited 11×
“…(Mercado et al., 2016; Stowers et al., 2016), but the hypothesized effects on operator workload were statistically insignificant (Chen et al., 2018; Mercado et al., 2016), and the reported effects on trust were restricted to certain subscales of trust and selected blocks of data (Mercado et al.,…”
BackgroundResultInfluentialResearchers Misunderstand Confidence Intervals and Standard Error Bars.
Belia, S., Fidler, F., Williams, J., & Cumming, G. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.389 · Cited by 390
Effect-Size Estimates: Issues and Problems in Interpretation
Fern, E. F., & Monroe, K. B. (1996) · Journal of Consumer Research · doi:10.1086/209469 · Cited by 301 · cited 1×
“However, these are interpreted in light of known limitations to comparison across measures and experiments, as well as susceptibility to the subjective judgment of the experimenter (Fern & Monroe, 1996).”
Background
Research works printed but not linked: 42
- American Psychological Association, 2017, Publication manual of the American Psychological Association
- Billings C. E., 1997, Aviation automation: The search for a human-centered approach
- Braarud P. Ø, 1998, Complexity factors and predictions of crew performance
- Braarud P. Ø, 2000, Subjective task complexity in the control room
- Braarud P. Ø., 2001, Task demand, task management, and teamwork
- 10.1080/1463922x.2017.1315750 · DOI · Paper page
- 10.1016/s1479-3601(02)02003-9 · DOI · Paper page
- 10.1201/b12461 · DOI · Paper page
- 10.1016/j.promfg.2015.07.273 · DOI
- 10.3389/fnins.2014.00150 · DOI · Paper page
- IEEE 1786-2011, 2011, IEEE human factors guide for applications of computerized operating procedure systems at nuclear power generating stations and other nuclear facilities
- 10.1177/0018720819842709 · DOI
- 10.5898/JHRI.3.1.Johnson · DOI · Paper page
- Kirk R. E., 1995, Experimental design: Procedures for the behavioral sciences
- 10.1080/00140139.2015.1080310 · DOI
- 10.1080/00140139.2015.1100329 · DOI
- Lau N., 2011, Situation awareness in monitoring nuclear power plants—The process overview concept and measure
- Lau N., 2011, The process overview measure: Methodological developments to enhance inter-rater reliability
- 10.1021/ja00880a025 · DOI · Paper page
- 10.1177/1064804615611272 · DOI · Paper page
- 10.1007/978-3-319-41959-6_11 · DOI
- 10.1098/rstb.1990.0101 · DOI · Paper page
- 10.1518/001872097778667997 · DOI · Paper page
- 10.1177/1541931213601305 · DOI
- 10.1016/j.ergon.2008.01.007 · DOI · Paper page
- Skjerve A. B. M., 2001, How automation malfunctions influence operator performance. Study plan for the HCA-2000 experiment
- 10.1007/978-0-85729-003-8 · doi:10.1007/978-0-85729-003-8
- 10.1016/j.ijhcs.2004.06.001 · DOI
- Skjerve A. B. M., 2002, The influence of automation malfunctions and interface design on operator performance. The HCA-2001 experiment
- Skjerve A. B. M., 2005, The extended teamwork 2004/2005 exploratory study. Study plan
- Skraaning G., 1998, The operator performance assessment system (OPAS)
- Skraaning G., 2003, Experimental control versus realism: Methodological solutions for simulator studies in complex operating environments
- Skraaning G., 2016, A reanalysis of the work practice experiments in HAMMLAB (2009-2014)
- Skraaning G., 2010, Coping with automation in future plants: Results from the 2009 HAMMLAB experiment
- Skraaning G., 2017, Twenty years of HRP research on human-automation interaction: Insights on automation transparency and levels of automation
- Skraaning G., 2007, The ecological interface design experiment (2005)
- 10.1177/1541931213601392 · DOI · Paper page
- Strand S., 2001, Trust and automation: The influence of automation malfunction and system feedback on operator trust
- Taylor R. M., 1990, AGARD Conference Proceedings No 478: Situational Awareness in Aerospace Operations. Aerospace Medical Panel Symposium
- Trapsilawati F., 2017, Proceedings of the International Symposium on Aviation Psychology, 419
- 10.1177/1555343417727438 · DOI
- 10.1177/1541931213601057 · DOI · Paper page
Cited by
Challenges of human—machine collaboration in risky decision-making
Xiong, W., Fan, H., Ma, L., & Wang, C. (2022) · Frontiers of Engineering Management · doi:10.1007/s42524-021-0182-0 · Cited by 95
Hardi, R., Nurmandi, A., Purwaningsih, T., & Manaf, H. A. (2025) · Frontiers in Political Science · doi:10.3389/fpos.2025.1553177 · Cited by 38
Zhang, M., Cheng, Z., Shiu, S. T. R., Liang, J., Fang, C., Ma, Z., Fang, L., & Wang, S. J. (2023) · Computer Supported Cooperative Work and Social Computing · doi:10.1145/3584931.3607008 · Cited by 26
Calibrating Reliance on Automated Advice: Transparency and Trust Calibration Feedback
Tatasciore, M., & Loft, S. (2025) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2025.2487861 · Cited by 20
Peng, X., Wang, X., Zhang, J., Liang, Y., Jiang, H., & Yang, J. (2026) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2026.104042
Metadata
- Authors
- Skraaning, G., & Jamieson, G. A.
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2019-12-13
- Volume
- 63
- Issue
- 3
- Pages
- 379-401
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W2995871272
- Cited by
- 66
- References
- 4
- FWCI
- 3.93
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Funders
- Natural Sciences and Engineering Research Council of Canada (RGPIN-2019-06773)
- OECD Halden Reactor Project through the Institute for Energy Technology (OECD Halden Reactor Project)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Human Performance Benefits of The Automation Transparency Design Principle: Validation and Variation. https://app.cochat.ai/papers/10.1177/0018720819887252
- The paper
- Skraaning, G., & Jamieson, G. A. (2021). Human Performance Benefits of The Automation Transparency Design Principle: Validation and Variation. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/0018720819887252
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.