The DOI matches its Crossref record; 33 of the 34 references it cites were found in a registry or an index.
Human Performance Consequences of Automated Decision Aids: The Impact of Degree of Automation and System Experience
Abstract
Two experiments are reported that investigate to what extent performance consequences of automated aids are dependent on the distribution of functions between human and automation and on the experience an operator has with an aid. In the first experiment, performance consequences of three automated aids for the support of a supervisory control task were compared. Aids differed in degree of automation (DOA). Compared with a manual control condition, primary and secondary task performance improved and subjective workload decreased with automation support, with effects dependent on DOA. Performance costs include return-to-manual performance issues that emerged for the most highly automated aid and effects of complacency and automation bias, respectively, which emerged independent of DOA. The second experiment specifically addresses how automation bias develops over time and how this development is affected by prior experience with the system. Results show that automation failures entail stronger effects than positive experience (reliably working aid). Furthermore, results suggest that commission errors in interaction with automated aids can depend on three sorts of automation bias effects: (a) withdrawal of attention in terms of incomplete cross-checking of information, (b) active discounting of contradictory system information, and (c) inattentive processing of contradictory information analog to a “looking-but-not-seeing” effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The positive loop is triggered by the experience of automation success, and the negative loop by the experience of automation failures.”
From Toward Quantifying Trust Dynamics: How People Adjust Their Trust After Moment-to-Moment Interaction With Automation (2023) · cites this paper as Manzey et al., 2012
In the citing paper
“Second, automation failures engender a much stronger influence on trust adjustment than automation successes: trust is difficult to build but can be lost quickly”
From Toward Quantifying Trust Dynamics: How People Adjust Their Trust After Moment-to-Moment Interaction With Automation (2023) · cites this paper as Manzey et al., 2012
In the citing paper
“human operators adjust their trust in automation based on positive and negative feedback loops”
From Toward Quantifying Trust Dynamics: How People Adjust Their Trust After Moment-to-Moment Interaction With Automation (2023) · cites this paper as Manzey et al., 2012
In the citing paper
“This is in line with previous research, where users in a simulated process control task reduced the verification of additional parameters over time, but further controlled for necessary parameters (Manzey et al., 2012).”
From Check the box! How to deal with automation bias in AI-based personnel selection (2023) · cites this paper as Manzey et al., 2012
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 5×
“To guide the research on automation-induced performance consequences, different framework models have been proposed that allow for a standardized characterization of automated systems with respect to how functions are distributed between humans and machine (e.g., Endsley & Kaber, 1999; Endsley & Kiris, 1995; Parasuram…”
BackgroundMethodResultInfluentialComplacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710 · cited 2×
“…bias—that is, an inappropriate weighting of different information—but the effect of a bias of information processing characterized by an automation-induced withdrawal or reallocation of attention, which resembles the complacency effect in automation monitoring (cf. Parasuraman & Manzey, 2010).”
BackgroundSelf-citationMack, A., & Rock, I. (1998) · The MIT Press eBooks · doi:10.7551/mitpress/3707.001.0001 · Cited by 1,636
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
The Out-of-the-Loop Performance Problem and Level of Control in Automation
Endsley, M. R., & Kiris, E. O. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779064555 · Cited by 1,406
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276
ENDSLEY, M. R., & KABER, D. B. (1999) · Ergonomics · doi:10.1080/001401399185595 · Cited by 1,088
Hancock, P. A., & Meshkati, N. (1988) · Cited by 954
Trust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932
Performance Consequences of Automation-Induced 'Complacency'
Parasuraman, R., Molloy, R., & Singh, I. L. (1993) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap0301_1 · Cited by 875 · cited 4×
“Possible performance consequences of complacency are suggested to include a loss of situation awareness, difficulties in returning to manual performance in case of automation failures, and an elevated risk that operators fail to detect and manage automation failures in due time (Endsley & Kiris, 1995; Parasuraman et a…”
BackgroundInfluentialKABER, D. B., & Endsley, M. R. (2004) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922021000054335 · Cited by 854
Does automation bias decision-making?
SKITKA, L. J., MOSIER, K. L., & BURDICK, M. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0252 · Cited by 694 · cited 1×
“As has been described by Skitka, Mosier, and Burdick (1999), these errors “can be the result of not seeking out confirmatory or disconfirmatory information, or discounting other sources of information in the presence of computer-generated cues” (p. 993).”
BackgroundMerritt, S. M., & Ilgen, D. R. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288574 · Cited by 527 · cited 2×
“The second set of questions was guided by the general idea that operators calibrate their trust in an automated system on the basis of what they know about the system and what experiences they have with using it (Lee & See, 2004; Merritt & Illgen, 2008; Seong & Bisantz, 2008).”
BackgroundAutomation and Human Performance
Bowers, C. A., Oser, R. L., Eduardo Salas, A., & Cannon‐Bowers, J. A. (2018) · Routledge eBooks · doi:10.1201/9781315137957 · Cited by 307
Aviation, Space and Environmental Medicine
(1982) · Journal of Sound and Vibration · doi:10.1016/0022-460x(82)90311-x · Cited by 298
Effects of Imperfect Automation on Decision Making in a Simulated Command and Control Task
Rovira, E. M., McGarry, K. A., & Parasuraman, R. (2007) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872007779598082 · Cited by 289
Bahner, J. E., Hüper, A.-D., & Manzey, D. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.06.001 · Cited by 279
Self-citationAutomation failures on tasks easily performed by operators undermine trust in automated aids
Madhavan, P., Wiegmann, D. A., & Lacson, F. C. (2006) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872006777724408 · Cited by 268
de Vries, P., Midden, C., & Bouwhuis, D. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00039-9 · Cited by 264
Stages and Levels of Automation: An Integrated Meta-analysis
Wickens, C., Li, H., Santamaria, A., Sebok, A., & Sarter, N. (2010) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193121005400425 · Cited by 260
Sarter, N. B., Mumaw, R. J., & Wickens, C. D. (2007) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872007x196685 · Cited by 224
Sarter, N. B., & Schroeder, B. (2001) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872001775870403 · Cited by 195
Function allocation: algorithm, alchemy or apostasy?
Sheridan, T. B. (2000) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0285 · Cited by 175
Expertise Differences in Attentional Strategies Related to Pilot Decision Making
Schriver, A. T., Morrow, D. G., Wickens, C. D., & Talleur, D. A. (2008) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x374974 · Cited by 163
Hockey, G. R. J., Wastell, D. G., & Sauer, J. (1998) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872098779480479 · Cited by 148
Moray, N. P., & Inagaki, T. (2000) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220052399159 · Cited by 129
The impact of cognitive feedback on judgment performance and trust with decision aids
Seong, Y., & Bisantz, A. M. (2008) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2008.01.007 · Cited by 129
Expertise Differences in Attentional Strategies Related to Pilot Decision Making
Schriver, A. T., Morrow, D. G., Wickens, C. D., & Talleur, D. A. (2017) · Routledge eBooks · doi:10.4324/9781315095080-25 · Cited by 107
Automated fault-management in a simulated spaceflight micro-world.
Lorenz, B. W. J., Nocera, F. D., Röttger, S., & Parasuraman, R. (2002) · PubMed · Cited by 77
Bahner, J. E., Elepfandt, M. F., & Manzey, D. (2008) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120805201906 · Cited by 35
Self-citationA Case Study for Using a Cognitive Model of Learned Carelessness in Cognitive Engineering
Lüdtke, A., & Möbus, C. (2005) · Carl von Ossiezky University of Oldenburg · Cited by 8
Research works printed but not linked: 3
- Bahner J. E., 2008, International Journal of Human-Computer Interaction, 66, 688
- Duley J. A., 1997, Proceedings of the 9th International Symposium on Aviation Psychology, 322
- Luedtke A., 2005, Proceedings of the 11th International Conference of Human-Computer Interaction
Cited by
Sorted by citations
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
From Here to Autonomy: Lessons Learned From Human–Automation Research
Endsley, M. R. (2017) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816681350 · Cited by 898
Almost human: Anthropomorphism increases trust resilience in cognitive agents.
de Visser, E. J., Monfort, S. S., McKendrick, R., Smith, M. A. B., McKnight, P. E., Krueger, F., & Parasuraman, R. (2016) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000092 · Cited by 614
What influences algorithmic decision-making? A systematic literature review on algorithm aversion
Mahmud, H., Islam, A. K. M. N., Ahmed, S. I., & Smolander, K. (2022) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.121390 · Cited by 601
Metadata
- Authors
- Manzey, D., Reichenbach, J., & Onnasch, L.
- Affiliations
- Technische Universität Berlin (DE)
- Venue
- Journal of Cognitive Engineering and Decision Making
- Publisher
- SAGE Publications
- Published
- 2012-01-13
- Volume
- 6
- Issue
- 1
- Pages
- 57-87
- ISSN
- 1555-3434 (ISSN-L)
- OpenAlex
- W2127333783
- Cited by
- 277
- References
- 34
- Citations by year
- 2026: 20 · 2025: 31 · 2024: 33 · 2023: 28 · 2022: 26 · 2021: 26 · 2020: 22 · 2019: 12 · 2018: 14 · 2017: 24 · 2016: 17 · 2015: 8 · 2014: 11 · 2013: 5
- FWCI
- 11.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Cognitive Engineering and Decision Making (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Risk and Safety Analysis
- Keywords
- automated decision aids, human-automation interaction, levels of automation, supervisory control, workload, automation bias, complacency, operator experience, commission errors, cross-checking, automation failure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
