CoChat

Human Performance Benefits of The Automation Transparency Design Principle: Validation and Variation

Skraaning, Gyrd, Jamieson, Greg A. · 2021 · Human Factors: The Journal of the Human Factors and Ergonomics Society
Cited by 66

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Abstract

Objective: Test the automation transparency design principle using a full-scope nuclear power plant simulator. Background: Automation transparency is a long-held human factors design principle espousing that the responsibilities, capabilities, goals, activities, and/or effects of automation should be directly observable in the human–system interface. The anticipated benefits of transparency include more effective reliance, more appropriate trust, better understanding, and greater user satisfaction. Transparency has enjoyed a recent upsurge in use in the context of human interaction with agent-oriented automation. Method: Three full-scope nuclear power plant simulator studies were conducted with licensed operating crews. In the first two experiments, transparency was implemented for interlocks, controllers, limitations, protections, and automatic programs that operate at the local component level of the plant. In the third experiment, procedure automation assumed control of plant operations and was represented in dedicated agent displays. Results: Results from Experiments 1 and 2 appear to validate the human performance benefits of automation transparency for automation at the component level. However, Experiment 3 failed to replicate these findings for automation that assumed control for executing procedural actions. Conclusion: Automation transparency appears to yield expected benefits for component-level automation, but caution is warranted in generalizing the design principle to agent-oriented automation. Application: The automation transparency design principle may offer a powerful means of compensating for the detrimental impacts of hidden automation influence at the component level of complex systems. However, system developers should exercise caution in assuming that the principle extends to agent-oriented automation.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/0018720819887252

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 4 references

Research works printed but not linked: 42

  1. American Psychological Association, 2017, Publication manual of the American Psychological Association
  2. Billings C. E., 1997, Aviation automation: The search for a human-centered approach
  3. Braarud P. Ø, 1998, Complexity factors and predictions of crew performance
  4. Braarud P. Ø, 2000, Subjective task complexity in the control room
  5. Braarud P. Ø., 2001, Task demand, task management, and teamwork
  6. 10.1080/1463922x.2017.1315750 · DOI · Paper page
  7. 10.1016/s1479-3601(02)02003-9 · DOI · Paper page
  8. 10.1201/b12461 · DOI · Paper page
  9. 10.1016/j.promfg.2015.07.273 · DOI
  10. 10.3389/fnins.2014.00150 · DOI · Paper page
  11. IEEE 1786-2011, 2011, IEEE human factors guide for applications of computerized operating procedure systems at nuclear power generating stations and other nuclear facilities
  12. 10.1177/0018720819842709 · DOI
  13. 10.5898/JHRI.3.1.Johnson · DOI · Paper page
  14. Kirk R. E., 1995, Experimental design: Procedures for the behavioral sciences
  15. 10.1080/00140139.2015.1080310 · DOI
  16. 10.1080/00140139.2015.1100329 · DOI
  17. Lau N., 2011, Situation awareness in monitoring nuclear power plants—The process overview concept and measure
  18. Lau N., 2011, The process overview measure: Methodological developments to enhance inter-rater reliability
  19. 10.1021/ja00880a025 · DOI · Paper page
  20. 10.1177/1064804615611272 · DOI · Paper page
  21. 10.1007/978-3-319-41959-6_11 · DOI
  22. 10.1098/rstb.1990.0101 · DOI · Paper page
  23. 10.1518/001872097778667997 · DOI · Paper page
  24. 10.1177/1541931213601305 · DOI
  25. 10.1016/j.ergon.2008.01.007 · DOI · Paper page
  26. Skjerve A. B. M., 2001, How automation malfunctions influence operator performance. Study plan for the HCA-2000 experiment
  27. 10.1007/978-0-85729-003-8 · doi:10.1007/978-0-85729-003-8
  28. 10.1016/j.ijhcs.2004.06.001 · DOI
  29. Skjerve A. B. M., 2002, The influence of automation malfunctions and interface design on operator performance. The HCA-2001 experiment
  30. Skjerve A. B. M., 2005, The extended teamwork 2004/2005 exploratory study. Study plan
  31. Skraaning G., 1998, The operator performance assessment system (OPAS)
  32. Skraaning G., 2003, Experimental control versus realism: Methodological solutions for simulator studies in complex operating environments
  33. Skraaning G., 2016, A reanalysis of the work practice experiments in HAMMLAB (2009-2014)
  34. Skraaning G., 2010, Coping with automation in future plants: Results from the 2009 HAMMLAB experiment
  35. Skraaning G., 2017, Twenty years of HRP research on human-automation interaction: Insights on automation transparency and levels of automation
  36. Skraaning G., 2007, The ecological interface design experiment (2005)
  37. 10.1177/1541931213601392 · DOI · Paper page
  38. Strand S., 2001, Trust and automation: The influence of automation malfunction and system feedback on operator trust
  39. Taylor R. M., 1990, AGARD Conference Proceedings No 478: Situational Awareness in Aerospace Operations. Aerospace Medical Panel Symposium
  40. Trapsilawati F., 2017, Proceedings of the International Symposium on Aviation Psychology, 419
  41. 10.1177/1555343417727438 · DOI
  42. 10.1177/1541931213601057 · DOI · Paper page

Cited by

See all 66

Metadata

Authors
Skraaning, G., & Jamieson, G. A.
Venue
Human Factors: The Journal of the Human Factors and Ergonomics Society
Published
2019-12-13
Volume
63
Issue
3
Pages
379-401
ISSN
  • 0018-7208 (ISSN-L)
  • 1547-8181
OpenAlex
W2995871272
Cited by
66
References
4
FWCI
3.93
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Funders
  • Natural Sciences and Engineering Research Council of Canada (RGPIN-2019-06773)
  • OECD Halden Reactor Project through the Institute for Energy Technology (OECD Halden Reactor Project)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Human Performance Benefits of The Automation Transparency Design Principle: Validation and Variation. https://app.cochat.ai/papers/10.1177/0018720819887252
The paper
Skraaning, G., & Jamieson, G. A. (2021). Human Performance Benefits of The Automation Transparency Design Principle: Validation and Variation. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/0018720819887252

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.