Automation Bias in Intelligent Time Critical Decision Support Systems
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“several studies suggest that overloading users with information about the system could potentially harm people's situation awareness and lead to worse performance or decision-making outcome [6, 27, 29].”
From Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making (2020) · cites this paper as [6]
In the citing paper
“According to theories of trust [6, 12, 15], trusting behaviors such as adopting suggestions are not only driven by a more positive perception of the trustee but also other factors such as one's disposition to trust and situation awareness.”
From Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making (2020) · cites this paper as [6]
In the citing paper
“Cummings (2004) showed that perceived reliability and time pressure can intensify dependence on automated recommendations in critical decision environments.”
From From Human Oversight to Cognitive Sovereignty: A Process-Based Governance Standard for AI-Assisted Legal Reasoning (2026) · cites this paper as Cummings (2004)
In the citing paper
“Because of automation bias, the phenomenon in which humans become more likely to believe answers that originate from a machine [51], such misleading explanations can have outsized weight.”
From The fallacy of inscrutability (2018) · cites this paper as [51]
In the citing paper
“Clinicians aware of AI biases can avoid overreliance on AI-generated results and make decisions based on more accurate information [91].”
From Fairness of artificial intelligence in healthcare: review and recommendations (2024) · cites this paper as [91]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195
(2013) · Mean Field Simulation for Monte Carlo Integration · doi:10.1201/b14924-7 · Cited by 1,554
ENDSLEY, M. R., & KABER, D. B. (1999) · Ergonomics · doi:10.1080/001401399185595 · Cited by 1,088
Considering the opposite: A corrective strategy for social judgment.
Lord, C. G., Lepper, M. R., & Preston, E. (1984) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.47.6.1231 · Cited by 740
Does automation bias decision-making?
SKITKA, L. J., MOSIER, K. L., & BURDICK, M. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0252 · Cited by 694 · cited 1×
“However, when the automation failed to detect and notify operators of an event, or incorrectly recommended action despite the availability of reliable confirmatory evidence, human error rates increased 19 .”
BackgroundSarter, N. B., & Schroeder, B. (2001) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872001775870403 · Cited by 194
Brittleness in the design of cooperative problem-solving systems: the effects on user performance
Smith, P. J., McCoy, C. E., & Layton, C. (1997) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.568744 · Cited by 163
Design of a Cooperative Problem-Solving System for En-Route Flight Planning: An Empirical Evaluation
Layton, C., Smith, P. J., & McCoy, C. E. (1994) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089403600106 · Cited by 158
Research works printed but not linked: 11
- Chapanis A., 1951, Human Engineering for an effective airnavigation and traffic control system
- Sheridan T.B., 1978, MIT
- Zsambok C.E., 1992, LiteratureReviewofAnalyticalandNaturalisticDecisionMaking",Naval Command
- 10.1037/0022-3514.47.6.1231 · doi:10.1037/0022-3514.47.6.1231 · Paper page
- Carroll J.M., 1987, CognitiveAspectsofHuman-Computer Interaction
- Mosier K.L., 1996, Theory andApplications
- 12 Fiske,S.T.andTaylor,S.E.,Socialcognition,edited,McGraw-Hill,NewYork,1991.
- 17 Johnson,K.,Ren,L.,Kuchar,J.,andOman,C.,InteractionofAutomationandTimePressureinaRouteReplanningTask, International Conference on Human-Computer Interaction in Aeronautics, Cambridge, MA, 2002. 132-137.
- Cummings M.L., 2003, Systems and Information Engineering
- 1973, NTSB
- McGuirl J.M., 2003, Human Factors and Ergonomics Society 47th Annual Meeting
Cited by
Items 201–271 of 271
Autonomy-Respectful E-Coaching Systems: Fending Off Complacency
Kamphorst, B. A. (2020) · Utrecht University Repository (Utrecht University) · doi:10.33540/344 · Cited by 14
Models for Classifying AI Systems: The Switch, the Ladder, and the MatrixPreprint
Mökander, J., Sheth, M., Watson, D., & Floridi, L. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4141677 · Cited by 1
Developing human-autonomy teaming characteristics and guidance in aerospace operations
Tokadlı, G. (2021) · doi:10.31274/td-20240329-223 · Cited by 1
Safeguarding human identity: ethics and AGI in warfare
Christie, L. (2025) · AI and Ethics · doi:10.1007/s43681-025-00687-8 · Cited by 1
“Cummings’ research on automation bias demonstrates how overreliance on AI-generated recommendations can lead to flawed decision-making, a concern that extends to AGI-driven military operations [ 17 ].”
Dorsey, J., & Moffett, L. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5239131 · Cited by 1
AI and Operations: A Foundational Framework of Emerging Research and PracticePreprint
Dai, T., & Swaminathan, J. M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5418934 · Cited by 1
Santos, L., Martin, M. D. L. F., Perez, J. J., Rodriguez-Solano, C., & Sicilia, M. (2015) · International Conference on Military Communications and Information Systems (ICMCIS) · doi:10.1109/icmcis.2015.7158710
“Using automatic decision support system as a supervisory tool in which decisions must be made under time-pressure with little room for errors [3], particularly in a scope where computers are better, is a need in a combat situation.”
MethodManaging Information for Real-Time Decision Support at Community Level
Rahman, H. (2013) · International Journal of Information Communication Technologies and Human Development · doi:10.4018/jicthd.2013010104
Verifying Correctness of Information in Flight-Deck User Interface using Hybrid System Observability
Yang, B.-J., Menon, P. K., & Hwang, I. (2015) · AIAA Infotech@Aerospace Conference · doi:10.2514/6.2015-1114
Responsibility and War Machines
Galliott, J. C. (2015) · Advances in human and social aspects of technology book series · doi:10.4018/978-1-4666-8592-5.ch008
Manan, M. R., & Manan, H. (2021) · TURKISH MEDICAL STUDENT JOURNAL · doi:10.4274/tmsj.galenos.2021.08.01.03
Rozzi, S., Amaldi, P., & Kirwan, B. (2009) · Electronic workshops in computing · doi:10.14236/ewic/ndm2009.63
“Automation failure to deliver the intended benefit has been studied from a cognitive engineering perspective mainly in socio-technical domains like Aviation (Cummings, 2004), ATC Nuclear Power Plants (Norros, 2004) and Health Care (Vikkelsø, 2005).”
BackgroundIntegrating statistical correlation with discrete multi-criteria decision-making
Sanders, D., Tewkesbury, G. E., Bausch, N., & Haddad, M. (2021) · International Journal of Information and Decision Sciences · doi:10.1504/ijids.2021.10036177
Nguyen, S. T., Tulabandhula, T., & Watson‐Manheim, M. B. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4662955
Brinkmanship in algorithmic warfare
Johnson, J. S. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198892182.003.0005
Thinking forward with counterfactuals
Johnson, J. S. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198892182.003.0006
Johnson, J. S. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198892182.005.0001
Johnson, J. S. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198892182.003.0007
Sample of AI-enabled autonomous weapons used in human–machine teaming
Johnson, J. S. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198892182.005.0002
Johnson, J. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198892182.002.0006
Tactical generals and strategic corporals
Johnson, J. S. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198892182.003.0004
Johnson, J. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198892182.002.0003
Introduction: AI-enabled “centaur warfighting”
Johnson, J. S. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198892182.003.0001
Johnson, J. S. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198892182.003.0002
Kovalenko, G. V., & Yadrov, I. A. (2023) · Crede Experto Transport Society Education Language · doi:10.51955/2312-1327_2023_3_45
Kozachek, D. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4767192
FDA regulation of anesthesia and critical care medical devices
Parvinian, B. (2024) · Elsevier eBooks · doi:10.1016/b978-0-12-818381-6.00035-8
Exporing the Relevance of UX in a Machine-Dominated Iot Landscape: Is It Becoming Obsolete?
Kitamura, A. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-62110-9_30
Legally-Salient Variables for AWS
Kwik, J. (2024) · T.M.C. Asser Press eBooks · doi:10.1007/978-94-6265-631-4_8
Kwik, J. (2024) · T.M.C. Asser Press eBooks · doi:10.1007/978-94-6265-631-4_1
Der Mensch im Mittelpunkt: Einblick in die Gestaltung Menschenzentrierter Künstlicher Intelligenz
Weitz, K. (2024) · Springer eBooks · doi:10.1007/978-3-658-43816-6_14
Friedrich, S., & Schulte, A. (2025) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms65439.2025.11154178
“This fosters side effects such as automation bias, complacency, or loss of situational awareness (SA) [8], [9].”
Perkins, R., Berkovich, B., & Robinette, P. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-2382-5_57
An Assistance Control System for Safe and Flexible Operation toward Operator Upskilling
Ishida, R., Inoue, M., Ishihara, S., & Obara, H. (2025) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc58881.2025.11343050
“However, due to automation bias, known as a cognitive bias in which operators place excessive trust in the assistance systems [2], operators fail to notice the malfunction.”
AI as a Tool for Information Warfare
Davydov, S., & Александровна, К. А. (2026) · Contributions to international relations · doi:10.1007/978-3-032-13528-5_4
The impact of automation on manager roles
Schunder, L., & Sós, E. (2025) · Gazdaság és Társadalom · doi:10.21637/gt.2025.2.02
“( Cummings, 2004) When talking about autonomous execution, the processes referred to are those whose “level of automation” (LOA) reaches five or higher on the scale defined by M.L. Cummings.”
Research challenges and future perspectives for e-assessment technologies in higher education
Striewe, M., Strickroth, S., & Ullrich, M. (2026) · i-com · doi:10.1515/icom-2026-0008 · Cited by 2
“119,120 This automation bias – humans’ tendency to favor suggestions from automated decision-making systems 121 – can lead to errors going unnoticed and undermine critical evaluation.”
Resilience Governance in Nuclear Safety: Insights from China’s AI-Driven Innovative Practices
Peng, R., & Guo, D. M. (2026) · Nuclear Technology · doi:10.1080/00295450.2025.2610157
Dimara, E. (2017) · theses.fr (ABES) · doi:10.70675/fa0c0a43z19acz4a60za48ez3ad8abc79047 · Cited by 2
“Moreover, computational tools can incorporate normative algorithms into the decision making process which would be otherwise too di cult, if not impossible, for human beings to compute [124].”
BackgroundMethodInfluentialBertrand, A. (2024) · theses.fr (ABES) · doi:10.70675/216d3647z78bcz4c68z9ba9z2d0a029cf1b4 · Cited by 8
La preuve en droit des systèmes d'intelligence artificielle
Pons, R. (2024) · theses.fr (ABES) · doi:10.70675/1e108f6ezfa39z422az8706zed4d031bb110
Cai, J., Knijnenburg, B. P., Björklund, J., & Leckner, S. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791240
“Along similar lines, several studies [20, 65] have shown that revealing information about the decision-making system may activate users’ situation awareness, which results in poorer outcomes.”
Metacommunication: Talking About the Dialogue with AI
Geroimenko, V. (2026) · Human-computer interaction series · doi:10.1007/978-3-032-21689-2_7
A Strategic AI Governance Framework for Cybersecurity: Ensuring Security, Fairness and Accoutability
Ayyaz, S., & Malik, S. M. (2025) · Asian Conference on Artificial Intelligence Technology (ACAIT) · doi:10.1109/acait67930.2025.11522623
“These challenges arise from the intrinsic interpretability limitations of deep learning systems [25], [26] and the trade-offs between automation efficiency and human intervention [27], [28].”
McClain, A. L., & Wade, T. (2026) · New Directions for Adult and Continuing Education · doi:10.1002/ace.70023 · Cited by 1
“This risk is well documented across decision-support research, where users may miss cues that are contradictory, normalize false alarms, or fail to notice omission errors when time, pressure, or cognitive load is high (Cummings 2004 ; Lyell and Coiera 2017 ; Mosier et al. 1997 ).”
Das, D. K., & Hassan, M. M. (2026) · Sustainability · doi:10.3390/su18126033 · Cited by 1
Menegat, A. C. J. S., & Boas, M. A. S. V. (2026) · Revistas de Ciências Jurídicas e Sociais da UNIPAR · doi:10.25110/rcjs.v29i1.2026-12744
Niazi, M., Hassani, H., & Lee, M. (2026) · Automation · doi:10.3390/automation7030096 · Cited by 1
“Routing decisions (clearance vs. secondary screening) can become de facto commands if systems are not designed to resist automation bias and to generate reviewable records at the moment of intervention [25,111–113].”
InfluentialPaukkonen, N. (2026) · Computer Applications and Quantitative Methods in Archaeology Proceedings · doi:10.64888/caaproceedings.v52i1.1426
Roos, G. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7036-1.ch004
AI-Augmented Leadership and Digital Decision-Making Models
Roos, G. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-2541-3.ch002
Veyrié, A., Kebir, S., Truong, G., Marsman, L., & Hurter, C. (2026) · Cognition Technology & Work · doi:10.1007/s10111-026-00884-3
Human–AI teams for decision-making in banking and finance: A systematic scoping review
Aksu, F., Morandini, S., & Pietrantoni, L. (2026) · Human Systems Management · doi:10.1177/01672533261461402
Ocak, D. (2026) · AI and Ethics · doi:10.1007/s43681-026-01273-2
“Systematic review evidence confirms that automation bias is robust and repro - ducible in healthcare settings, mediated by workload, task complexity and institutional trust [11, 12 ].”
AI-enhanced trait modulation in high-stakes industries: a conceptual perspective
Kroyer, L., & Lütge, C. (2026) · AI and Ethics · doi:10.1007/s43681-026-01197-x
“Similarly, Cummings [ 51 ] explores the implications of automation complacency in aviation, emphasizing how uncritical trust in automation can lead to errors in high-pressure situations.”
Boas, M. A. S. V., & Menegat, A. C. J. S. (2026) · Revista Brasileira de Direito · doi:10.18256/2238-0604.2025.v21i1.5274
SSS Framework: A Think-First, AI-Second Model for AI-Assisted Writing.
Giray, L. (2026) · Annals of Biomedical Engineering · doi:10.1007/s10439-026-04358-5
Security Analysis of LLM-Generated Web API Backends
Khan, A. A., Rauti, S., & Mäkilä, T. (2026) · IEEE Access · doi:10.1109/access.2026.3727682
“Cummings [51] formalizes the related phenomenon as automation bias , the tendency to accept a computer-generated solution once it clears a surface-level check.”
Brusset, X., Kinra, A., & Drake, M. J. (2026) · International Journal of Production Economics · doi:10.1016/j.ijpe.2026.110206
Alves, J. N., & Tseng, H. (2026) · AI and Ethics · doi:10.1007/s43681-026-01343-5
“…are amplified by how humans respond to automated systems: research in cognitive science and human factors documents automation complacency, the degradation of vigilance and critical engagement that occurs when operators work alongside sys - tems that project confidence and authority [ 17, 60].”
Haverkamp, W., Hohendanner, F., Tscholl, V., Alexander, N., Strodthoff, N., Dagres, N., & Hindricks, G. (2026) · Ethik in der Medizin · doi:10.1007/s00481-026-00933-5
Trusting AI too much? Understanding judgment attenuation in Human–AI decision support systems
Choi, Y. (2026) · Human Systems Management · doi:10.1177/01672533261490154 · Cited by 1
Devare, M. H., Vishwakarma, P. K. R., Devare, A. M., & Kalpana, C. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-0090-8.ch009
Atman, E. D., Uludağ, S., Uzun, Ç., Agaran, G., Eskalen, Z., & Karaca, K. B. (2026) · Diagnostics · doi:10.3390/diagnostics16193241
“AB is a well-documented cognitive error where clinicians over-rely on automated systems, leading to a failure in independent critical thinking [13,29–31].”
Strategic Autonomy and Human Agency in the Age of Military Artificial Intelligence
de Socio, M. R., volta, G., & Merlo, A. (2025) · IEEE International Workshop on Technologies for Defense and Security (TechDefense) · doi:10.1109/techdefense67306.2025.11721001
“Evidence from aviation and other time-critical settings shows that realistic, high-stress simulations can cultivate the critical scrutiny necessary to avoid over-reliance on machine outputs [42], [43], [50].”
Rangelov, D., & Knotter, J. (2026) · Forensic Sciences · doi:10.3390/forensicsci6040092
Metadata
- Authors
- Cummings, M.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Cummings, Mary
- ORCID
- Cummings, Mary
- Venue
- AIAA 1st Intelligent Systems Technical Conference
- Published
- 2004-06-19
- OpenAlex
- W4240224338
- Cited by
- 269
- References
- 13
- Citations by year
- 2026: 46 · 2025: 26 · 2024: 51 · 2023: 23 · 2022: 16 · 2021: 26 · 2020: 19 · 2019: 12 · 2018: 6 · 2017: 11 · 2016: 7 · 2015: 5 · 2014: 3 · 2013: 4 · 2012: 2
- FWCI
- 0.57
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- AIAA Intelligent Systems Technical Conference (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- automation bias, intelligent decision support system, time-critical decision making, human-automation interaction, trust in automation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.