Automation Bias in Intelligent Time Critical Decision Support Systems
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“several studies suggest that overloading users with information about the system could potentially harm people's situation awareness and lead to worse performance or decision-making outcome [6, 27, 29].”
From Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making (2020) · cites this paper as [6]
In the citing paper
“According to theories of trust [6, 12, 15], trusting behaviors such as adopting suggestions are not only driven by a more positive perception of the trustee but also other factors such as one's disposition to trust and situation awareness.”
From Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making (2020) · cites this paper as [6]
In the citing paper
“Cummings (2004) showed that perceived reliability and time pressure can intensify dependence on automated recommendations in critical decision environments.”
From From Human Oversight to Cognitive Sovereignty: A Process-Based Governance Standard for AI-Assisted Legal Reasoning (2026) · cites this paper as Cummings (2004)
In the citing paper
“Because of automation bias, the phenomenon in which humans become more likely to believe answers that originate from a machine [51], such misleading explanations can have outsized weight.”
From The fallacy of inscrutability (2018) · cites this paper as [51]
In the citing paper
“Clinicians aware of AI biases can avoid overreliance on AI-generated results and make decisions based on more accurate information [91].”
From Fairness of artificial intelligence in healthcare: review and recommendations (2024) · cites this paper as [91]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195
(2013) · Mean Field Simulation for Monte Carlo Integration · doi:10.1201/b14924-7 · Cited by 1,554
ENDSLEY, M. R., & KABER, D. B. (1999) · Ergonomics · doi:10.1080/001401399185595 · Cited by 1,088
Considering the opposite: A corrective strategy for social judgment.
Lord, C. G., Lepper, M. R., & Preston, E. (1984) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.47.6.1231 · Cited by 740
Does automation bias decision-making?
SKITKA, L. J., MOSIER, K. L., & BURDICK, M. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0252 · Cited by 694 · cited 1×
“However, when the automation failed to detect and notify operators of an event, or incorrectly recommended action despite the availability of reliable confirmatory evidence, human error rates increased 19 .”
BackgroundSarter, N. B., & Schroeder, B. (2001) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872001775870403 · Cited by 194
Brittleness in the design of cooperative problem-solving systems: the effects on user performance
Smith, P. J., McCoy, C. E., & Layton, C. (1997) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.568744 · Cited by 163
Design of a Cooperative Problem-Solving System for En-Route Flight Planning: An Empirical Evaluation
Layton, C., Smith, P. J., & McCoy, C. E. (1994) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089403600106 · Cited by 158
Research works printed but not linked: 11
- Chapanis A., 1951, Human Engineering for an effective airnavigation and traffic control system
- Sheridan T.B., 1978, MIT
- Zsambok C.E., 1992, LiteratureReviewofAnalyticalandNaturalisticDecisionMaking",Naval Command
- 10.1037/0022-3514.47.6.1231 · doi:10.1037/0022-3514.47.6.1231 · Paper page
- Carroll J.M., 1987, CognitiveAspectsofHuman-Computer Interaction
- Mosier K.L., 1996, Theory andApplications
- 12 Fiske,S.T.andTaylor,S.E.,Socialcognition,edited,McGraw-Hill,NewYork,1991.
- 17 Johnson,K.,Ren,L.,Kuchar,J.,andOman,C.,InteractionofAutomationandTimePressureinaRouteReplanningTask, International Conference on Human-Computer Interaction in Aeronautics, Cambridge, MA, 2002. 132-137.
- Cummings M.L., 2003, Systems and Information Engineering
- 1973, NTSB
- McGuirl J.M., 2003, Human Factors and Ergonomics Society 47th Annual Meeting
Cited by
Items 101–200 of 271
Trust, Automation Bias and Aversion: Algorithmic Decision-Making in the Context of Credit Scoring
Gsenger, R., & Strle, T. (2021) · Interdisciplinary Description of Complex Systems · doi:10.7906/indecs.19.4.7 · Cited by 24
“Complacency as well as automation bias (for details see the next section 2.3.) were first researched in the aviation sector [61].”
BackgroundInfluentialRobbins, S. (2025) · AI & Society · doi:10.1007/s00146-024-02169-7 · Cited by 13
“Noel Sharkey correctly identified this as a glorified thermostat rather than a guilty feeling autonomous weapon (2012).”
Counter-Terrorism, Ethics and Technology: Emerging Challenges at the Frontiers of Counter-Terrorism
Henschke, A., Reed, A., Robbins, S., & Miller, S. (2021) · Advanced sciences and technologies for security applications · doi:10.1007/978-3-030-90221-6 · Cited by 42
Micro-entries: Encouraging Deeper Evaluation of Mental Models Over Time for Interactive Data Systems
Block, J. E., & Ragan, E. D. (2020) · IEEE Evaluation and Beyond - Methodological Approaches for Visualization (BELIV) · doi:10.1109/beliv51497.2020.00012 · Cited by 13
“In many contexts, end users avoid taking advantage of the algorithmic support that they do not understand [20, 22, 35, 48]; in other cases, users may over-rely on automation without a critical mindfulness of the system’s limitations and flaws [19, 67, 70].”
Hejji, D. J., Talib, M. W. A., Nassif, A. B., Nasir, Q., & Bouridane, A. (2021) · IEEE International Conference on Internet of Things and Intelligence Systems (IoTaIS) · doi:10.1109/iotais53735.2021.9628555 · Cited by 8
An (E)Affective Bind: Situated Affectivity and the Prospect of Affect Recognition
Branford, J. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3281069 · Cited by 8
“…is the fact that the algorithmic character of such determinations lends them an unwarranted sense of credibility and objectivity due to the well-recognised phenomenon that people tend to trust (or overstate the power of) computer outputs they don’t fully understand (i.e., automation bias [37]).”
BackgroundSwitching Scheme: A Novel Approach for Handling Incremental Concept Drift in Real-World Data Sets
Baier, L., Kellner, V., Kühl, N., & Satzger, G. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.120 · Cited by 12
Tightening the OODA Loop: Police Militarization, Race, and Algorithmic Surveillance
Vagle, J. L. (2016) · Michigan Journal of Race & Law · doi:10.36643/mjrl.22.1.tightening · Cited by 15
A conceptual framework for establishing trust in real world intelligent systems
Guckert, M., Gumpfer, N., Hannig, J., Keller, T., & Urquhart, N. (2021) · Cognitive Systems Research · doi:10.1016/j.cogsys.2021.04.001 · Cited by 10
“They often tend to either overestimate their own capabilities and knowledge (Pallier et al., 2002) or easily accept solutions produced by a machine without sufficient critical reflec-tion (automation bias) (Cummings, 2004).”
Recommender Systems: Legal and Ethical Issues
Genovesi, S., Kaesling, K., & Robbins, S. (2023) · The International library of ethics, law and technology · doi:10.1007/978-3-031-34804-4 · Cited by 15
Kidd, D. G., Reimer, B., Dobres, J., & Mehler, B. L. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.07.002 · Cited by 9
“Automating decision-making is beneficial when the probability of system failure is low but is not advisable when a failure can negatively impact safety since the failure may go undetected (Cummings, 2004; Parasuraman & Wickens, 2008).”
BackgroundA Human-machine Collaborative Framework for Evaluating Malevolence in Dialogues
Zhang, Y., Ren, P., & de Rijke, M. (2021) · doi:10.18653/v1/2021.acl-long.436 · Cited by 17
“At the same time, there is a possibility that human annotators mistakenly follow the outputs of a model with errors (Cummings, 2004).”
Geburczyk, F. (2021) · Computer Law & Security Review · doi:10.1016/j.clsr.2021.105538 · Cited by 7
THE USE OF ARTIFICIAL INTELLIGENCE IN JUDICIAL DECISIONMAKING: THE EXAMPLE OF CHINA
Tahura, U. S., & Selvadurai, N. (2023) · International Journal of Law Ethics and Technology · doi:10.55574/pyeb5374 · Cited by 15
ABCs: Differentiating Algorithmic Bias, Automation Bias, and Automation Complacency
Potasznik, A. (2023) · IEEE International Symposium on Ethics in Engineering, Science, and Technology (ETHICS) · doi:10.1109/ethics57328.2023.10155094 · Cited by 11
“Subsequent studies have reworded and extended the definition: Automation bias “occurs when a human decision maker disregards or does not search for contradictory information in light of a computer-generated solution which is accepted as correct” [21].”
BackgroundBebien, V., Bellenguez‐Morineau, O., Coppin, G., Ma-Wyatt, A., & Stephens, R. G. (2024) · AI and Ethics · doi:10.1007/s43681-024-00459-w · Cited by 14
“Unfortunately, in multiple instances, researchers have shown that automation may cause loss of situation awareness and skill degradation, among other things [22, 31, 32, 54].”
Towards Modeling the Behavior of Autonomous Systems and Humans for Trusted Operations
Taylor, G., Mittu, R., Sibley, C. M., & Coyne, J. T. (2016) · Springer eBooks · doi:10.1007/978-1-4899-7668-0_2 · Cited by 7
“Correctly determining reliability of a system will be critical in this future vision since automation bias, or overreliance on a system, can lead to complacency which in turn can cause errors of omission and commission (Cummings 2004).”
BackgroundDevelopment of a Functionality Matrix for a Cognitive Assistant on Long Distance Space Missions
Tokadlı, G., & Dorneich, M. C. (2017) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601545 · Cited by 7
“Since most of the decision processes are time critical events depending on the conditions, the decision-making function should be allocated between human and the automation per the level of automation (Cummings, 2004).”
BackgroundMeasuring Automation Bias and Complacency in an X-Ray Screening Task
Davis, J. R., Atchley, A., Barr, H. M., Simon, H., & Tenhundfeld, N. L. (2020) · Systems and Information Engineering Design Symposium · doi:10.1109/sieds49339.2020.9106670 · Cited by 13
“Temporal pressures have been shown to increase the likelihood of bias occurring because operators are forced to quickly make a decision and continue the task [13].”
BackgroundMind Wandering Influences EEG Signal in Complex Multimodal Environments
Gouraud, J., Delorme, A., & Berberian, B. (2021) · Frontiers in Neuroergonomics · doi:10.3389/fnrgo.2021.625343 · Cited by 8
“Even though automation generally brought safer and more productive systems, the loss of agency could generate task disengagement and be one of the main reasons why operators are unable to regain manual control in critical situations (Bainbridge, 1983; Endsley and Kiris, 1995; Cummings, 2004; Louw et al., 2015b; Berber…”
BackgroundHuman–Automation Collaboration in Occluded Trajectory Smoothing
Rathje, J. M., Spence, L. B., & Cummings, M. L. (2013) · IEEE Transactions on Human-Machine Systems · doi:10.1109/tsmca.2012.2230439 · Cited by 8
Self-citationFair Governance with Humans and MachinesPreprint
Hermstrüwer, Y., & Langenbach, P. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4118650 · Cited by 7
Desolda, G., Esposito, A., Greco, F., Tucci, C., Buono, P., & Piccinno, A. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103648 · Cited by 7
“In addition to an increase in commission and omission errors (Cummings, 2004), full-automation CCTs increase the risk of deskilling (Sambasivan and Veeraraghavan, 2022).”
Causal Inference in Agentic AI: Bridging Explainability and Dynamic Decision Making
Chakrabarty, P. K. (2025) · International Journal of Science and Research (IJSR) · doi:10.21275/sr25424081718 · Cited by 8
Pilot feedback for an automated planning aid system in the cockpit
Watts, R., Tsiotras, P., & Johnson, E. N. (2009) · IEEE/AIAA Digital Avionics Systems Conference (DASC) · doi:10.1109/dasc.2009.5347472 · Cited by 6
“These poor decisions may cause incidents to become accidents.”
BackgroundLiao, M. (2023) · Journal of Broadcasting & Electronic Media · doi:10.1080/08838151.2023.2206662 · Cited by 7
“The concept of automation bias was first studied in the aviation context (Cummings, 2004).”
BackgroundInfluentialDrivers’ Mental Workload In Agricultural Semi-Autonomous Vehicles
Bashiri, B., & Mann, D. (2013) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213571402 · Cited by 10
“Loss of situational awareness (Endsley and Kaber, 1999, Cummings, 2004, Stanton and Young, 2005, Walker et al., 2008), vigilance decrements (Parasuraman, 1986, Finomore et al., 2009), complacency (Kaber and Endsley, 2004), and skill degradation (Billings, 1996) are some human errors in man-machine…”
BackgroundThe heuristics gap in AI ethics: Impact on green AI policies and beyond
Tamburrini, G. (2024) · Journal of Responsible Technology · doi:10.1016/j.jrt.2024.100104 · Cited by 6
Thomas, I., Oh, S. Y., & Szafir, D. A. (2024) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3640543.3645207 · Cited by 8
Staufer, D., Pallas, F., & Berendt, B. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658936 · Cited by 14
Health AI needs meaningful human involvement: lessons from war
Hillis, J. M., & Payne, K. (2024) · Nature Medicine · doi:10.1038/s41591-024-03311-0 · Cited by 9
Resilience Through Appropriation: Pilots’ View on Complex Decision Support
Zhang, Z. T., Storath, C., Liu, Y., & Butz, A. M. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584056 · Cited by 13
“Within the aviation context, past research on DSTs emphasizes the issue of brittleness [12, 45, 54], i.”
BackgroundA Framework on Division of Work Tasks between Humans and Robots in the Home
Saplacan, D., Herstad, J., Tørresen, J., & Pajalić, Z. (2020) · Multimodal Technologies and Interaction · doi:10.3390/mti4030044 · Cited by 8
“Second, it would also be interesting to explore Cummings’ [40] 10 levels of automation, and more recent work on this topic, concerning new forms of human-robot automation.”
BackgroundHuman Performance in Automated and Autonomous Systems: Current Theory and Methods
(2019) · CRC Press eBooks · doi:10.1201/9780429458330 · Cited by 9
Wang, Y., Wang, Y., Xiao, Y., Escamilla, L., Augustine, B. R., Crace, K., Zhou, G., & Zhang, Y. (2026) · ACM Transactions on Computing for Healthcare · doi:10.1145/3820038 · Cited by 32
“Particularly, we noticed that in the second stage (“challenge distorted thoughts”), the CRBot could not reliably determine whether users had fully engaged with their beliefs before moving on, resulting in premature or inappropriate transitions.”
Salem, M. A., & Khalil, Z. A. (2026) · Information · doi:10.3390/info17090815 · Cited by 5
“AI illiteracy may therefore be associated with lower strategic decision quality, particularly when decisions require professional judgement, comparison of alternatives, and careful evaluation of evidence [24–27].”
Silva, C., Campelo, D., Silva, T., & Silva, V. F. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-63321-3_1 · Cited by 8
A Principled Approach to Human Creativity x AI in Education
Beghetto, R. A., & Zamana, F. (2025) · Springer eBooks · doi:10.1007/978-3-031-84535-2_3 · Cited by 5
Human-Autonomy Teaming for Critical Command and Control Functions
Irandoust, H., & Benaskeur, A. R. (2020) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms49158.2020.9209513 · Cited by 5
“…because of effects such as loss of situation awareness [29], complacency (tendency to become overconfident with automated systems) [19], automation bias (tendency to disregard contradictory information in light of a computer-generated solution) [3][28], and ultimately, skill degradation [18].”
BackgroundRecommending Ourselves to Death: Values in the Age of Algorithms
Robbins, S. (2023) · The International library of ethics, law and technology · doi:10.1007/978-3-031-34804-4_8 · Cited by 4
Development and Evaluation of an Automated Path Planning Aid
Watts, R., Christmann, H. C., Johnson, E. N., Feigh, K. M., & Tsiotras, P. (2012) · Journal of Aircraft · doi:10.2514/1.c031513 · Cited by 4
“Alternatively, rather than simply discounting conflicting information, the pilot may attempt to rationalize and mentally force all available information to fit the automationgenerated solution (assimilation bias) [3].”
BackgroundMeasuring algorithms in online marketplaces
Chen, L. (2017) · Digital Repository Service (Northeastern University) · doi:10.17760/d20251583 · Cited by 7
Editorial: O impacto das novas tecnologias sobre a justiça penal – um horizonte denso de incógnitas
Cesari, C. (2019) · Revista Brasileira de Direito Processual Penal · doi:10.22197/rbdpp.v5i3.292 · Cited by 4
U.S. Military Investments in Autonomy and AI: A Strategic Assessment
Konaev, M., Chahal, H., Fedasiuk, R., Huang, T., & Rahkovsky, I. M. (2020) · doi:10.51593/20190044 · Cited by 9
Organization Routines in Next Generation Manufacturing
Brauner, P., Vervier, L., Brillowski, F., Dammers, H., Steuer-Dankert, L., Schneider, S., Baier, R., Ziefle, M., Gries, T., Leicht-Scholten, C., et al. (2022) · Contributions to management science · doi:10.1007/978-3-031-07734-0_5 · Cited by 3
Osa, N., Lasa, G., Mazmela, M., Apraiz, A., & Escallada, O. (2026) · International Journal of Social Robotics · doi:10.1007/s12369-026-01365-3 · Cited by 4
“…and acquire complex cognitive abilities, new human factors, including automation bias, diminished sense of agency, and over-reliance on robotic systems, require attention [ 122, 154–156 , Addressing these challenges demands interdisciplin - ary collaboration among AI, robotics, human factors,”
What is Wrong With Automation Bias?
Jovchevski, P., Buijsman, S., & Neerincx, M. A. (2026) · Philosophy & Technology · doi:10.1007/s13347-026-01090-9 · Cited by 10
“During the 2003 Iraq War, automation bias was implicated in incidents involving the U.S. Army’s Patriot missile system, which mistakenly engaged friendly aircraft—a British Tornado and an American F/A-18—resulting in the deaths of three aircrew members (Cummings, 2004, p. 6).”
InfluentialRe-thinking human–machine interaction and the governance of AI in the military domain
Bode, I., & Chandler, K. (2026) · Nature Machine Intelligence · doi:10.1038/s42256-026-01231-x · Cited by 6
“This research shows, for example, how the way data are presented can influence cognitive biases, such as automation bias, in anyone who interprets the data 18 .”
Algorithmic Sentencing: Drawing Lessons from Human Factors Research
Zerilli, J. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197539538.003.0009 · Cited by 6
Artificial intelligence, inattention and liability rules
Obidzinski, M., & Oytana, Y. (2024) · International Review of Law and Economics · doi:10.1016/j.irle.2024.106211 · Cited by 7
Digital Governance and Neoliberalism: The Evolution of Machine Learning in Australian Public Policy
Jobberns, H., & Guihot, M. (2024) · Law Technology and Humans · doi:10.5204/lthj.3408 · Cited by 4
Automatic creation of informative TV videos to be delivered through iTV: a system architecture
Silva, T., Mota, M., Hernández, C., & Abreu, J. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.11.077 · Cited by 3
Technology as Terrorism: Police Control Technologies and Drone Warfare
Wolfendale, J. (2020) · Advanced sciences and technologies for security applications · doi:10.1007/978-3-030-90221-6_1 · Cited by 4
Trusted Partners: Human-Machine Teaming and the Future of Military AI
Konaev, M., Huang, T. C., & Chahal, H. (2021) · doi:10.51593/20200024 · Cited by 8
Shukla, S. (2026) · AI, Law, Politics · doi:10.5709/alp-02.01.2026-04 · Cited by 6
Requirements modeling of resilience-aware human-on-the-loop PNT of multiple UASs
Bao, Y., Shen, D., Chen, G., Pham, K. D., & Blasch, E. (2024) · Sensors and Systems for Space Applications · doi:10.1117/12.3023840 · Cited by 2
“18 For instance, humans may be inclined not to trust the autonomous decisions of UASs due to a lack of human-understandable rationale.”
BackgroundAutomated production of audiovisual informative content
Silva, C., Mota, M., & Silva, T. (2018) · Iberian Conference on Information Systems and Technologies (CISTI) · doi:10.23919/cisti.2018.8399162 · Cited by 2
“Considering automation as an automated processes that can be performed by any machine and applied in several fields and sectors by different means, according to Cummings [6] and Ford [7], automation comes with the following benefits:”
MethodGÖZÜBÜYÜK, B. (2022) · Ankara Hacı Bayram Veli Üniversitesi Hukuk Fakültesi Dergisi · doi:10.34246/ahbvuhfd.1066623 · Cited by 2
Paradoxien der Digitalisierung von Organisationen
Houben, D. (2022) · Sozialwissenschaften und Berufspraxis · doi:10.1007/978-3-658-36514-1_20 · Cited by 6
Model Transparency: Why Do We Care?
Papantonis, I., & Belle, V. (2023) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0011726300003393 · Cited by 2
“Failing to do so, can potentially lead to an over-reliance on the model’s decisions Cummings (2004) or model aversion, where users entirely dismiss a model after a few mistakes are made Dietvorst et al. (2015).”
BackgroundHawkins, T., & Cassenti, D. N. (2023) · Springer eBooks · doi:10.1007/978-981-99-3966-4_2 · Cited by 2
Did You Mean...? Confidence-based Trade-offs in Semantic Parsing
Stengel-Eskin, E., & Durme, B. V. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.159 · Cited by 11
Human-Artificial Intelligence Teaming for the U.S. Navy: Developing a Holistic Research Roadmap
Wong, J. H., Chiou, E. K., Gutzwiller, R. S., Cook, M. B., & Fallon, C. K. (2024) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/10711813241260352 · Cited by 6
“Additionally, they overlook the potential for negative outcomes from teaming automation and AI with humans in safety-critical systems (e.g., Cummings, 2004; Hawley, 2007; NTSB, 2020).”
Addressing Human Factors Related to Artificial Intelligence Integrated Visual Cueing
Kelley, B., Raikwar, A., Wickens, C. D., McMahan, R. P., Ortega, F. R., & Clegg, B. A. (2024) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct64951.2024.00051 · Cited by 2
“Automation bias occurs when the user of an automated system, such as an AI cueing system, trusts the system’s decisions even when erroneous [3, 21, 20].”
Engineering Moral Failure? The Challenges of Algorithmic Ethics for Lethal Autonomous Weapon Systems
Schwarz, E. (2025) · Bristol University Press eBooks · doi:10.56687/9781529237191-016 · Cited by 2
Risk Profiling by Law Enforcement Agencies in the Big Data Era: Is There a Need for Transparency?
van Schendel, S. (2019) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-16744-8_18 · Cited by 3
“[34] With this risk in mind, explaining the decision also ensures that human actors do not take the outcome for granted but investigate how it came about.”
Development of a Recognition Primed Decision Agent for supervisory control of autonomy
Dorton, S. L., Terry, B., Jaeger, B., & Shearer, P. B. (2016) · IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support · doi:10.1109/cogsima.2016.7497806 · Cited by 3
“• Current autonomy interfaces are subject to automation bias and issues with trust in automation, which is exacerbated by complex missions with differing Levels of Automation (LOAs), accuracy, time pressure of scenarios, and the uncertain and dynamic environments [1,2,3].”
BackgroundA Glance into the Future of Human Computer Interactions
Farooq, U., Iqbal, M. A., & Nazir, S. (2011) · International Journal of Computer Science Engineering and Applications · doi:10.5121/ijcsea.2011.1303 · Cited by 2
Designing visualization and interaction for industrial control rooms of the future
Domova, V. (2020) · Linköping studies in science and technology. Dissertations · doi:10.3384/diss.diva-165625 · Cited by 4
Anić, N., & Anić, P. (2021) · National security and the future · doi:10.37458/nstf.21.3.4 · Cited by 4
Manger, C., Vogl, A., Rosbach, E., Ziegler, C., & Riener, A. (2023) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3581961.3609897 · Cited by 2
“Furthermore, Cummings [4] divides human errors, which are based on the automation bias, into errors that occur through active commission or omission.”
InfluentialEXPLAINABLE AI AND ITS IMPORTANCE IN DECISION MAKING
Arora, H., Lamba, M., Kumar, L., & Kumar, S. (2023) · Journal of Nonlinear Analysis and Optimization Theory & Applications (JNAO) · doi:10.36893/jnao.2023.v14i1.0019-0027 · Cited by 1
Autonomous Agents in the Wild: Human Interaction Challenges
Major, L. M., & Harriott, C. E. (2019) · Springer proceedings in advanced robotics · doi:10.1007/978-3-030-28619-4_9 · Cited by 2
Integrating statistical correlation with discrete multi-criteria decision-making
Sanders, D., Tewkesbury, G., Bausch, N., & Haddad, M. (2021) · International Journal of Information and Decision Sciences · doi:10.1504/ijids.2021.113599 · Cited by 3
The Effects of Discontinuing Machine Learning Decision SupportPreprint
Bauer, K., Nofer, M., Abdel-Karim, B. M., & Hinz, O. F. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4299664 · Cited by 2
“…that provide users with comprehensive Electronic copy available at: https://ssrn.com/abstract=4299664 information on how to do their tasks (e.g., Cummings 2004; McCall 2008, Rinta-Kahila et al. 2018), reports (e.g., Dowling et al. 2008, Verghese 2008, Hoff 2011), and even take over…”
BackgroundBalázs, L. (2026) · Social Sciences · doi:10.3390/socsci15070433 · Cited by 2
Delegation of Administrative Powers to AI Systems
Ebers, M., & Trasberg, H. (2023) · Data science, machine intelligence, and law · doi:10.1007/978-3-031-19667-6_5 · Cited by 3
Spatola, N. (2025) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2025.100169 · Cited by 7
Manger, C., Vogl, A., & Riener, A. (2025) · Applied Sciences · doi:10.3390/app152011030 · Cited by 2
Kelley, B., McMahan, R. P., Wickens, C. D., Clegg, B. A., & Ortega, F. R. (2025) · ACM Symposium on Virtual Reality Software and Technology (VRST) · doi:10.1145/3756884.3765992 · Cited by 3
“…there may be erroneous cueing instances that may well affect the overall user performance, either by requiring more effort to discern the error and make the correct selection, or by introducing automation bias [9, 31, 37, 42, 43]; although this would also be dependent on the saliency of the cue.”
Meaningful Human Control Over AI Military Decision Support Systems: Exploring Key Challenges
Kozlovski, A. (2026) · Military and humanitarian health ethics · doi:10.1007/978-3-032-11331-3_8 · Cited by 2
Luu, T. M. N., Gangodawilage, D. S. K., Srivastava, A. P., & Subramanian, J. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7442-0.ch005 · Cited by 1
Anthropomorphisme : des animaux aux machines
Nahon, M., Khamassi, M., Freire, I. T., Paternotte, C., & Chatila, R. (2025) · Socio-anthropologie · doi:10.4000/15qdj · Cited by 1
“Ceci met donc en avant des problématiques éthiques importantes, d’autant que l’on peut y ajouter notre tendance naturelle à accorder plus de valeur à une décision venant d’une machine que d’un humain – le biais d’automatisation ( automation bias ) (Cummings, 2017b ; Skitka et al., 2000).”
A Multi-Year Survey of Use and Perceptions of Generative AI in Higher Education
Crescenzi, A., Choi, B., Huang, P.-P., Gautier, E., Little, R., & Pandya, S. (2026) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3786304.3787867 · Cited by 3
“Persistent issues include hallucinations [29, 60], bias propagation from training data [60], automation bias [18], and privacy and data-leakage risks [10, 11].”
Can You Feel My Pain Tonight? – Automated Pain Assessment and Epistemic Injustice
Loh, W. (2026) · Philosophy & Technology · doi:10.1007/s13347-026-01074-9 · Cited by 2
“…this external pain assessment becomes so reliant on the APAS that they develop an automation bias (also called “over-trust” or “over-reli-ance”), i.e. a propensity to acquire an unwarranted trust in the reliability and robustness of technical systems (Cummings, 2004; Klingbeil et al. 2024).”
The Authenticity Gap and the Challenge of Distinguishing AI in Personal and Professional Dialogue
Suleman, D. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8337-8.ch016 · Cited by 2
Rodriguez, R., Hemachandran, K., Ghatole, G., Rege, M., & Balusamy, B. (2026) · Discover Computing · doi:10.1007/s10791-026-10070-8
“This failure underscores a critical regulatory gap: existing frameworks evaluate AI systems as tools rather than as cognitive partners that fundamentally reshape human decision architecture [4, 5].”
Joldić, A., Bijedić, N., & Gašpar, D. (2026) · International Conference on Integrated Intelligence and Cognitive Engineering (ICIICE) · doi:10.1109/iciice69672.2026.11565460 · Cited by 1
“First, prior work on human-AI decision making has shown that explanations and confidence signals can improve or distort reliance depending on how they are presented [5] – [8], [15]-[16].”
Ersozlu, Z., Ledger, S., Babic, M., & Parkes, R. (2026) · Contemporary Educational Technology · doi:10.30935/cedtech/18970 · Cited by 3
Joldić, A., Bijedić, N., Gašpar, D., & Mabić, M. (2026) · International Conference on Intelligent Systems and Digital Applications (ISDA) · doi:10.1109/isda70544.2026.11605984 · Cited by 1
“Classic work on automation bias [13], [14] further warns that uncritical reliance on system recommendations can undermine decision quality, motivating designs that encourage active deliberation.”
Torrent, J. (2026) · European Sport Management Quarterly · doi:10.1080/16184742.2026.2709446 · Cited by 1
Artificial Intelligence and Space Robotics: Questions of Responsibility
(2016) · Routledge eBooks · doi:10.4324/9781315572857-22 · Cited by 2
Dwyer, A. C. (2023) · Routledge eBooks · doi:10.4324/9781003284093-3 · Cited by 1
Panse, A. (2019) · International Transfer Pricing Journal · doi:10.59403/15c6tmj · Cited by 1
Anthropomorphizing AI in centaur teaming
Johnson, J. S. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780198892182.003.0003 · Cited by 1
Monteagudo, J. C. (2024) · Deusto Journal of Human Rights · doi:10.18543/djhr.3083
An Uninterpretable Right: Legal and Practical Limits of the Right to an Explanation
Engelfriet, A. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227396 · Cited by 2
“This burden is amplified by automation bias – the cognitive tendency to regard computer-generated outputs as more reliable or objective than human judgments [30].”
Towards a Clinical Support System for the Early Diagnosis of Sepsis
Helldin, T., Pernestig, A.-K., & Tilevik, D. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-58466-9_3 · Cited by 4
“As stated by Cummings [13], higher levels of automation is often the best solution when automating tasks that require no flexibility in decision-making and with a low probability of system failure.”
BackgroundKognitive Irrtümer in der Arbeitswelt
Wenski, G. (2022) · Springer eBooks · doi:10.1007/978-3-662-64776-9_8 · Cited by 1
Landry, S. (2016) · Digital Commons - Michigan Tech (Michigan Technological University) · doi:10.37099/mtu.dc.etdr/94 · Cited by 2
Metadata
- Authors
- Cummings, M.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Cummings, Mary
- ORCID
- Cummings, Mary
- Venue
- AIAA 1st Intelligent Systems Technical Conference
- Published
- 2004-06-19
- OpenAlex
- W4240224338
- Cited by
- 269
- References
- 13
- Citations by year
- 2026: 46 · 2025: 26 · 2024: 51 · 2023: 23 · 2022: 16 · 2021: 26 · 2020: 19 · 2019: 12 · 2018: 6 · 2017: 11 · 2016: 7 · 2015: 5 · 2014: 3 · 2013: 4 · 2012: 2
- FWCI
- 0.57
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- AIAA Intelligent Systems Technical Conference (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- automation bias, intelligent decision support system, time-critical decision making, human-automation interaction, trust in automation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.