CoChat

Implementing lumberjacks and black swans into model-based tools to support human-automation interaction

Sebok, Angelia, Wickens, Christopher D. · 2017 · Human Factors: The Journal of the Human Factors and Ergonomics Society

The DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index.

Abstract

Objective The objectives were to (a) implement theoretical perspectives regarding human-automation interaction (HAI) into model-based tools to assist designers in developing systems that support effective performance and (b) conduct validations to assess the ability of the models to predict operator performance. Background Two key concepts in HAI, the lumberjack analogy and black swan events, have been studied extensively. The lumberjack analogy describes the effects of imperfect automation on operator performance. In routine operations, an increased degree of automation supports performance, but in failure conditions, increased automation results in more significantly impaired performance. Black swans are the rare and unexpected failures of imperfect automation. Method The lumberjack analogy and black swan concepts have been implemented into three model-based tools that predict operator performance in different systems. These tools include a flight management system, a remotely controlled robotic arm, and an environmental process control system. Results Each modeling effort included a corresponding validation. In one validation, the software tool was used to compare three flight management system designs, which were ranked in the same order as predicted by subject matter experts. The second validation compared model-predicted operator complacency with empirical performance in the same conditions. The third validation compared model-predicted and empirically determined time t…

Overview

Integrity signals

Registry

Crossref · 10.1177/0018720816665201

Cites

58 of 58 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 58 references

Research works printed but not linked: 13

  1. Allender L., 2000, Proceedings of the Military, Government and Aerospace Simulation Symposium, 2000 Advanced Simulation Technologies Conference, 139
  2. Boehm-Davis D. A., 2002, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science, 27
  3. Boorman D. J., 2004, Paper presented at the International Conference on Human-Computer Interaction in Aeronautics
  4. Degani A., 2013, The Oxford handbook of cognitive engineering, 433
  5. Foyle D., 2008, Human performance models in aviation
  6. Gore B. F., 2010, Human modelling in assisted transportation, 43
  7. Lüdtke A., 2010, Paper presented at the Human Computer Interaction Aero Conference 2010
  8. Lüdtke A., 2012, Paper presented at the Embedded Real Time Software and Systems Conference
  9. Lüdtke A., 2009, Proceedings of 7th IFIP WG 13.5 Working Conference, HESSD 2009, 54
  10. Morrow D. G., 2006, Annual review of human factors and ergonomics, 1, 254
  11. Mumaw R., 2006, Paper presented at HCI-Aero 2006, International Conference on Human Computer Interaction
  12. Pew R., 1997, Modeling cognitive and organizational performance
  13. Wickens C. D., Sebok A., Keller J., Peters S., Small R., Hutchins S., Algarín L., Gore B. F., Hooey B. L., Foyle D. C. (2013). Modeling and evaluating pilot performance in NextGen: Review of and recommendations regarding pilot modeling efforts, architectures, and validation studies (NASA/TM 2013–216504). Washington, DC: NASA.

Cited by

See all 80

Metadata

Authors
Sebok, A., & Wickens, C. D.
Affiliations
  • Alion Science and Technology (United States) (US)
  • Consultant, Fort Collins, Colorado
Corresponding author
Sebok, Angelia
Venue
Human Factors: The Journal of the Human Factors and Ergonomics Society
Published
2016-09-27
Volume
59
Issue
2
Pages
189-203
ISSN
  • 0018-7208 (ISSN-L)
  • 1547-8181
OpenAlex
W2515673966
Cited by
75
References
59
Citations by year
2026: 2 · 2025: 6 · 2024: 7 · 2023: 12 · 2022: 12 · 2021: 9 · 2020: 12 · 2019: 4 · 2018: 3 · 2017: 8
FWCI
7.88
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion)
  • PubMed (publishedVersion)
Funders
National Aeronautics and Space Administration
Topics
  • Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Risk and Safety Analysis
  • Social Sciences › Human Factors and Ergonomics › Ergonomics and Human Factors
Keywords
human-automation interaction, black swan events, operator performance prediction, flight management system, automation design
MeSH terms
Automation, Humans, Man-Machine Systems, Models, Theoretical, Task Performance and Analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Implementing lumberjacks and black swans into model-based tools to support human-automation interaction. https://app.cochat.ai/papers/10.1177/0018720816665201
The paper
Sebok, A., & Wickens, C. D. (2017). Implementing lumberjacks and black swans into model-based tools to support human-automation interaction. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/0018720816665201

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.