Implementing lumberjacks and black swans into model-based tools to support human-automation interaction
The DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index.
Abstract
Objective The objectives were to (a) implement theoretical perspectives regarding human-automation interaction (HAI) into model-based tools to assist designers in developing systems that support effective performance and (b) conduct validations to assess the ability of the models to predict operator performance. Background Two key concepts in HAI, the lumberjack analogy and black swan events, have been studied extensively. The lumberjack analogy describes the effects of imperfect automation on operator performance. In routine operations, an increased degree of automation supports performance, but in failure conditions, increased automation results in more significantly impaired performance. Black swans are the rare and unexpected failures of imperfect automation. Method The lumberjack analogy and black swan concepts have been implemented into three model-based tools that predict operator performance in different systems. These tools include a flight management system, a remotely controlled robotic arm, and an environmental process control system. Results Each modeling effort included a corresponding validation. In one validation, the software tool was used to compare three flight management system designs, which were ranked in the same order as predicted by subject matter experts. The second validation compared model-predicted operator complacency with empirical performance in the same conditions. The third validation compared model-predicted and empirically determined time t…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The risk of negative consequences associated with AI-enabled automation errors or failure increases with increasing levels of automation and in the latter functional stages of information processing (Sebok and Wickens, 2017).”
From Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy (2021) · cites this paper as Sebok and Wickens, 2017
In the citing paper
“some failures cannot be foreseen in advance and may not be included in the robot's planner (i.e., Black Swans; Sebok and Wickens, 2017).”
From Understanding and Resolving Failures in Human-Robot Interaction: Literature Review and Model Development (2018) · cites this paper as Sebok and Wickens, 2017
In the citing paper
“an increase in automation during failure condition reduces operator performance (the “lumberjack analogy”; Sebok and Wickens, 2017).”
From Understanding and Resolving Failures in Human-Robot Interaction: Literature Review and Model Development (2018) · cites this paper as Sebok and Wickens, 2017
Citations
Cites
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 1×
“Based on the original classic work of Sheridan and Verplank (1979), Parasuraman et al. (2000) considered that each stage within the taxonomy could be characterized by different levels of implementation.”
BackgroundSelf-citationThe black swan: the impact of the highly improbable
(2007) · Choice Reviews Online · doi:10.5860/choice.45-1430 · Cited by 3,454
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936 · cited 1×
“Examples of this dichotomy may include, in medicine, the distinction between automated diagnostic aids and treatment recommendations (Garg et al., 2005; Morrow, Wickens, & North, 2006).”
BackgroundTrust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817 · cited 2×
“• Capitalize on the meaning of the “loss of SA curve” and carefully craft intuitive displays of dynamic processes that can improve SA without imposing significant mental effort on the operator, in the spirit of ecological displays (Burns et al., 2008; Hoff & Bashir, 2015; Mercado et al., 2016).”
BackgroundComplacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710 · cited 1×
“Although there are many ways any given automation system can fail, based on the work of Mosier, Skitka, Heers, and Burdick (1998) and Parasuraman and Manzey (2010), an important dichotomy built into our S-PRINT model of automation failure detection was whether automation decision aid failed because…”
MethodThe Out-of-the-Loop Performance Problem and Level of Control in Automation
Endsley, M. R., & Kiris, E. O. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779064555 · Cited by 1,406 · cited 1×
“Such a finding is also consistent with the general understanding that being out of the loop degrades awareness of what automation is doing (Endsley & Kiris, 1995; Kaber & Endsley, 2004), with a progressively greater loss as automation does more work and the human does less work.”
ResultHuman and Computer Control of Undersea Teleoperators
Sheridan, T. B., & Verplank, W. L. (1978) · doi:10.21236/ada057655 · Cited by 1,227 · cited 1×
“Based on the original classic work of Sheridan and Verplank (1979), Parasuraman et al. (2000) considered that each stage within the taxonomy could be characterized by different levels of implementation.”
BackgroundRensink, R. A. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.53.100901.135125 · Cited by 850
Kaber, D. B., & Endsley, M. R. (2004) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922021000054335 · Cited by 789 · cited 1×
“Such a finding is also consistent with the general understanding that being out of the loop degrades awareness of what automation is doing (Endsley & Kiris, 1995; Kaber & Endsley, 2004), with a progressively greater loss as automation does more work and the human does less work.”
ResultSchaefer, K. E., Chen, J. Y. C., Szalma, J. L., & Hancock, P. A. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816634228 · Cited by 768
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2008) · Journal of Cognitive Engineering and Decision Making · doi:10.1518/155534308x284417 · Cited by 695
Self-citationHuman Performance Consequences of Stages and Levels of Automation: An Integrated Meta-Analysis
Onnasch, L., Wickens, C. D., Li, H., & Manzey, D. (2014) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720813501549 · Cited by 524 · cited 1×
“The results of the meta-analysis (Onnasch et al., 2014) are shown in Figure 2.”
ResultSelf-citationHow Many Variables Can Humans Process?
Halford, G. S., Baker, R., McCredden, J. E., & Bain, J. D. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.00782.x · Cited by 450
Intelligent agent transparency in human–agent teaming for multi-UxV management
Mercado, J. E., Rupp, M. A., Chen, J. Y. C., Barnes, M. J., Barber, D., & Procci, K. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815621206 · Cited by 403 · cited 1×
“• Capitalize on the meaning of the “loss of SA curve” and carefully craft intuitive displays of dynamic processes that can improve SA without imposing significant mental effort on the operator, in the spirit of ecological displays (Burns et al., 2008; Hoff & Bashir, 2015; Mercado et al., 2016).”
BackgroundHergeth, S., Lorenz, L., Vilimek, R., & Krems, J. F. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815625744 · Cited by 355
Automation Bias: Decision Making and Performance in High-Tech Cockpits
Mosier, K. L., Skitka, L. J., Heers, S., & Burdick, M. (1998) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0801_3 · Cited by 353
Monitoring an Automated System for a Single Failure: Vigilance and Task Complexity Effects
MOLLOY, R., & PARASURAMAN, R. (1996) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089606380211 · Cited by 321 · cited 1×
“The irony of automation is that the more reliable the automation is, the rarer failure events are, becoming essentially “black swans” (Taleb, 2007) that are missed altogether (Molloy & Parasuraman, 1996; Wickens, Hooey, Gore, Sebok, & Koenecke, 2009).”
BackgroundSarter, N. B., & Woods, D. D. (1994) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0401_1 · Cited by 280 · cited 2×
“…flight path; (d) can have different outcomes for pilot actions, depending on the current mode; (e) has many modes of operation; and (f) has multiple ways to trigger mode transitions (Fennell, Sherry, Roberts, & Feary, 2006; Sarter & Woods, 1992, 1994, 2000; Sherry, Feary, Polson, & Fennell, 2003).”
BackgroundBahner, J. E., Hüper, A.-D., & Manzey, D. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.06.001 · Cited by 279
Effects of Imperfect Automation on Decision Making in a Simulated Command and Control Task
Rovira, E., McGarry, K., & Parasuraman, R. (2007) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872007779598082 · Cited by 279
Wickens, C., & McCarley, J. (2007) · CRC Press eBooks · doi:10.1201/9781420063363 · Cited by 269
Self-citation(1998) · Cited by 267
Self-citationPilot Interaction With Cockpit Automation: Operational Experiences With the Flight Management System
Sarter, N. B., & Woods, D. D. (1992) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0204_5 · Cited by 255 · cited 1×
“…flight path; (d) can have different outcomes for pilot actions, depending on the current mode; (e) has many modes of operation; and (f) has multiple ways to trigger mode transitions (Fennell, Sherry, Roberts, & Feary, 2006; Sarter & Woods, 1992, 1994, 2000; Sherry, Feary, Polson, & Fennell, 2003).”
BackgroundSarter, N. B., Mumaw, R. J., & Wickens, C. D. (2007) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872007x196685 · Cited by 224
Self-citationThe Oxford Handbook of Cognitive Engineering
(2013) · doi:10.1093/oxfordhb/9780199757183.001.0001 · Cited by 213
Attentional Tunneling and Task Management in Synthetic Vision Displays
Wickens, C. D., & Alexander, A. L. (2009) · The International Journal of Aviation Psychology · doi:10.1080/10508410902766549 · Cited by 200 · cited 1×
“When mode transitions occur that are not commanded by the pilot, they are sometimes unexpected (Nikolic, Orr, & Sarter, 2004; Sarter, Mumaw & Wickens, 2007; Wickens & Alexander, 2009; Wickens, Hooey, et al., 2009).”
BackgroundSelf-citationEvaluation of Ecological Interface Design for Nuclear Process Control: Situation Awareness Effects
Burns, C. M., Skraaning, G., Jamieson, G. A., Lau, N. K. C., Kwok, J., Welch, R., & Andresen, G. (2008) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x312305 · Cited by 182 · cited 1×
“• Capitalize on the meaning of the “loss of SA curve” and carefully craft intuitive displays of dynamic processes that can improve SA without imposing significant mental effort on the operator, in the spirit of ecological displays (Burns et al., 2008; Hoff & Bashir, 2015; Mercado et al., 2016).”
BackgroundThe Retention of Manual Flying Skills in the Automated Cockpit
Casner, S. M., Geven, R. W., Recker, M. P., & Schooler, J. W. (2014) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814535628 · Cited by 154
Integrated Models of Cognitive Systems
Gray, W. D. (2007) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195189193.001.0001 · Cited by 141
The Impact of Sleep Disruption on Complex Cognitive Tasks: A Meta-Analysis
Wickens, C. D., Hutchins, S. D., Laux, L., & Sebok, A. (2015) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815571935 · Cited by 133
Self-citationMoray, N., & Inagaki, T. (2000) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220052399159 · Cited by 129 · cited 1×
“As research indicates (Moray & Inagaki, 2000; Rovira, McGarry, & Parasuraman, 2007; Wickens, Hooey, et al., 2009), the more reliable a system, the less likely an operator is to expect a failure.”
Wickens, C. D., Hutchins, S., Carolan, T., & Cumming, J. (2013) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720812451994 · Cited by 129
Self-citationNoticing Events in the Visual Workplace: The SEEV and NSEEV Models
Wickens, C. D. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9780511973017.046 · Cited by 129 · cited 3×
“The changes module uses the NSEEV model of visual noticing (Steelman et al., 2011; Wickens, 2015; Wickens & McCarley, 2008) to predict whether or not pilots will notice mode transitions based on (a) salience, expectancy, and location of changes; (b) phase of flight and the associated expected pilot workload (higher wo…”
MethodSelf-citationFalse Alerts in Air Traffic Control Conflict Alerting System: Is There a “Cry Wolf” Effect?
Wickens, C. D., Rice, S., Keller, D., Hutchins, S., Hughes, J., & Clayton, K. (2009) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720809344720 · Cited by 113
Self-citationFunk, K., Lyall, B., Wilson, J., Vint, R., Niemczyk, M., Suroteguh, C., & Owen, G. (1999) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0902_2 · Cited by 100
Taming Hal: designing interfaces beyond 2001
(2004) · Choice Reviews Online · doi:10.5860/choice.41-6575 · Cited by 89 · cited 2×
“, 2012) that helps pilots plan and execute flight paths to maximize efficiency while maintaining safe performance (Degani, 2004; Pritchett, 2009).”
BackgroundMethodTeam Play with a Powerful and Independent Agent: A Full-Mission Simulation Study
Sarter, N. B., & Woods, D. D. (2000) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872000779698178 · Cited by 88 · cited 2×
“…flight path; (d) can have different outcomes for pilot actions, depending on the current mode; (e) has many modes of operation; and (f) has multiple ways to trigger mode transitions (Fennell, Sherry, Roberts, & Feary, 2006; Sarter & Woods, 1992, 1994, 2000; Sherry, Feary, Polson, & Fennell, 2003).”
BackgroundModeling the Control of Attention in Visual Workspaces
Steelman, K. S., McCarley, J. S., & Wickens, C. D. (2011) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811404026 · Cited by 86 · cited 2×
“The changes module uses the NSEEV model of visual noticing (Steelman et al., 2011; Wickens, 2015; Wickens & McCarley, 2008) to predict whether or not pilots will notice mode transitions based on (a) salience, expectancy, and location of changes; (b) phase of flight and the associated expected pilot workload (higher wo…”
MethodSelf-citationPrévôt, T., Homola, J. R., Martin, L. H., Mercer, J. S., & Cabrall, C. D. D. (2012) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2012.634756 · Cited by 75
Identifying Black Swans in NextGen: Predicting Human Performance in Off-Nominal Conditions
Wickens, C. D., Hooey, B. L., Gore, B. F., Sebok, A., & Koenicke, C. S. (2009) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720809349709 · Cited by 75
Self-citationSauer, J., Chavaillaz, A., & Wastell, D. (2016) · Ergonomics · doi:10.1080/00140139.2015.1094577 · Cited by 73
Human Modelling in Assisted Transportation: Models, Tools and Risk Methods
Cacciabue, P. C., Riccioli, C., Lüdtke, A., & Hjälmdahl, M. (2011) · Springer eBooks · doi:10.1007/978-88-470-1821-1 · Cited by 65
Why Pilots Miss the Green Box: How Display Context Undermines Attention Capture
Nikolic, M. I., Orr, J. M., & Sarter, N. B. (2004) · International Journal of Aviation Psychology · doi:10.1207/s15327108ijap1401_3 · Cited by 65
Stages and Levels of Automation in Support of Space Teleoperations
Li, H., Wickens, C. D., Sarter, N., & Sebok, A. (2014) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814522830 · Cited by 47 · cited 2×
“Man–Machine Integration design Analysis System–Function Allocation Support tool (MIdAS-FASt) Our second automation modeling effort is of the robotic arm, such as one used to conduct inspections and repairs on the International Space Station (Li et al., 2014; Wickens, Sebok, et al., 2015).”
MethodSelf-citationAviation Automation: General Perspectives and Specific Guidance for the Design of Modes and Alerts
Pritchett, A. R. (2009) · Reviews of Human Factors and Ergonomics · doi:10.1518/155723409x448026 · Cited by 45 · cited 2×
“, 2012) that helps pilots plan and execute flight paths to maximize efficiency while maintaining safe performance (Degani, 2004; Pritchett, 2009).”
BackgroundMethodFerris, T. K., Sarter, N. B., & Wickens, C. D. (2010) · Elsevier eBooks · doi:10.1016/b978-0-12-374518-7.00015-8 · Cited by 44
Self-citationWickens, C. D., Sebok, A., Li, H., Sarter, N., & Gacy, A. M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814566454 · Cited by 43
Self-citationHuman Versus Automation in Responding to Failures: An Expected-Value Analysis
Sheridan, T. B., & Parasuraman, R. (2000) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872000779698123 · Cited by 43 · cited 1×
“• A higher DOA is appropriate if failure analysis indicates that the consequences of failures are not sufficiently serious to outweigh the benefits of higher DOA, given the frequency of correct operation, and there are only very modest costs of such failures (Sheridan & Parasuraman, 2000).”
BackgroundModeling Human Performance in Complex Systems
Laughery, K. R., Lebiere, C., & Archer, S. (2006) · Handbook of Human Factors and Ergonomics · doi:10.1002/0470048204.ch36 · Cited by 37
Trapsilawati, F., Qu, X., Wickens, C. D., & Chen, C. (2015) · Ergonomics · doi:10.1080/00140139.2014.997301 · Cited by 34
Self-citationManagement by Consent in Human-Machine Systems: When and Why It Breaks Down
Olson, W. A., & Sarter, N. B. (2001) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872001775900904 · Cited by 34 · cited 1×
“The most intuitive contrast of levels, within Stage 3 automation, is between an automated agent that recommends one or more courses of action (lower level) and an agent that will execute the action within a certain period unless the human operator vetoes it (Olson & Sarter, 2001).”
BackgroundDifficult Access: The Impact of Recall Steps on Flight Management System Errors
Fennell, K., Sherry, L., Ralph J. Roberts, Jr., & Feary, M. (2006) · International Journal of Aviation Psychology · doi:10.1207/s15327108ijap1602_4 · Cited by 18
Advances in aviation psychology
Vidulich, M. A., Tsang, P. S., & Flach, J. M. (2014) · Ashgate eBooks · Cited by 14
Sebok, A., Wickens, C., Sarter, N., Quesada, S., Socash, C., & Anthony, B. (2012) · Human Factors and Ergonomics in Manufacturing & Service Industries · doi:10.1002/hfm.20389 · Cited by 12 · cited 4×
“The current paper focuses on the two most relevant modules (noticing changes and complexity; see Sebok et al., 2012, for a more detailed discussion of other modules).”
BackgroundMethodInfluentialSelf-citationModeling Operator Performance and Cognition in Robotic Missions
Gacy, A. M., Wickens, C. D., Sebok, A. L., Gore, B. F., & Hooey, B. L. (2011) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181311551179 · Cited by 8
Self-citationRapid Theory Prototyping: An Example of an Aviation Task
John, B. E., Blackmon, M. H., Polson, P. G., Fennell, K., & Teo, L. (2009) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120905301207 · Cited by 8
Visual attention allocation between robotic arm and environmental process control
Wickens, C. D., Vieane, A. Z., Clegg, B. A., Sebok, A. L., & Janes, J. (2015) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931215591135 · Cited by 5
Self-citationSherry, L., Feary, M., Polson, P. G., & Fennell, K. (2013) · NASA Technical Reports Server (NASA) · Cited by 4
Research works printed but not linked: 13
- Allender L., 2000, Proceedings of the Military, Government and Aerospace Simulation Symposium, 2000 Advanced Simulation Technologies Conference, 139
- Boehm-Davis D. A., 2002, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science, 27
- Boorman D. J., 2004, Paper presented at the International Conference on Human-Computer Interaction in Aeronautics
- Degani A., 2013, The Oxford handbook of cognitive engineering, 433
- Foyle D., 2008, Human performance models in aviation
- Gore B. F., 2010, Human modelling in assisted transportation, 43
- Lüdtke A., 2010, Paper presented at the Human Computer Interaction Aero Conference 2010
- Lüdtke A., 2012, Paper presented at the Embedded Real Time Software and Systems Conference
- Lüdtke A., 2009, Proceedings of 7th IFIP WG 13.5 Working Conference, HESSD 2009, 54
- Morrow D. G., 2006, Annual review of human factors and ergonomics, 1, 254
- Mumaw R., 2006, Paper presented at HCI-Aero 2006, International Conference on Human Computer Interaction
- Pew R., 1997, Modeling cognitive and organizational performance
- Wickens C. D., Sebok A., Keller J., Peters S., Small R., Hutchins S., Algarín L., Gore B. F., Hooey B. L., Foyle D. C. (2013). Modeling and evaluating pilot performance in NextGen: Review of and recommendations regarding pilot modeling efforts, architectures, and validation studies (NASA/TM 2013–216504). Washington, DC: NASA.
Cited by
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611
“The risk of negative consequences associated with AI-enabled automation errors or failure increases with increasing levels of automation and in the latter functional stages of information processing (Sebok & Wickens, 2017).”
BackgroundHonig, S., & Oron-Gilad, T. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00861 · Cited by 338
“In turn, cognitive resources devoted to the failure have an impact on the task: an increase in automation during failure condition reduces operator performance (the “lumberjack analogy”; Sebok and Wickens, 2017).”
BackgroundThe “Out-of-the-Loop” concept in automated driving: proposed definition, measures and implications
Merat, N., Seppelt, B., Louw, T., Engström, J., Lee, J. D., Johansson, E., Green, C. A., Katazaki, S., Monk, C., Itoh, M., et al. (2019) · Cognition, Technology & Work · doi:10.1007/s10111-018-0525-8 · Cited by 282
Mueller, S. T., Hoffman, R. R., Clancey, W., Emrey, A., & Klein, G. (2019) · arXiv · doi:10.48550/arxiv.1902.01876 · Cited by 215
“…Miller, 1988; Muir, 1994; Muramatsu and Pratt, 2001; Pirolli and Card, 1999, 2005, Prietula et al., 2000, 2000; Roth, Butterworth, and Loftus, 1985; Sebok and Wickens, 2017; Strauch, 2017; Tullio et al., 2007; Vermeulen, Luyten, van den Hoven, and Coninx, 2013; Wallace and Freuder, 2001; Wille,…”
Ironies of Automation: Still Unresolved After All These Years
Strauch, B. (2018) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2017.2732506 · Cited by 139
Metadata
- Authors
- Sebok, A., & Wickens, C. D.
- Affiliations
- Alion Science and Technology (United States) (US)
- Consultant, Fort Collins, Colorado
- Corresponding author
- Sebok, Angelia
- Venue
- Human Factors: The Journal of the Human Factors and Ergonomics Society
- Publisher
- SAGE Publications
- Published
- 2016-09-27
- Volume
- 59
- Issue
- 2
- Pages
- 189-203
- ISSN
- 0018-7208 (ISSN-L)
- 1547-8181
- OpenAlex
- W2515673966
- Semantic Scholar
- be58d7b73cd79b3114c721dac2786d6975903b6b
- Cited by
- 75
- References
- 59
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 7 · 2023: 12 · 2022: 12 · 2021: 9 · 2020: 12 · 2019: 4 · 2018: 3 · 2017: 8
- FWCI
- 7.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Aeronautics and Space Administration
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Risk and Safety Analysis
- Social Sciences › Human Factors and Ergonomics › Ergonomics and Human Factors
- Keywords
- human-automation interaction, black swan events, operator performance prediction, flight management system, automation design
- MeSH terms
- Automation, Humans, Man-Machine Systems, Models, Theoretical, Task Performance and Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.