Automation Bias in Intelligent Time Critical Decision Support Systems
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“several studies suggest that overloading users with information about the system could potentially harm people's situation awareness and lead to worse performance or decision-making outcome [6, 27, 29].”
From Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making (2020) · cites this paper as [6]
In the citing paper
“According to theories of trust [6, 12, 15], trusting behaviors such as adopting suggestions are not only driven by a more positive perception of the trustee but also other factors such as one's disposition to trust and situation awareness.”
From Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making (2020) · cites this paper as [6]
In the citing paper
“Cummings (2004) showed that perceived reliability and time pressure can intensify dependence on automated recommendations in critical decision environments.”
From From Human Oversight to Cognitive Sovereignty: A Process-Based Governance Standard for AI-Assisted Legal Reasoning (2026) · cites this paper as Cummings (2004)
In the citing paper
“Because of automation bias, the phenomenon in which humans become more likely to believe answers that originate from a machine [51], such misleading explanations can have outsized weight.”
From The fallacy of inscrutability (2018) · cites this paper as [51]
In the citing paper
“Clinicians aware of AI biases can avoid overreliance on AI-generated results and make decisions based on more accurate information [91].”
From Fairness of artificial intelligence in healthcare: review and recommendations (2024) · cites this paper as [91]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195
(2013) · Mean Field Simulation for Monte Carlo Integration · doi:10.1201/b14924-7 · Cited by 1,554
ENDSLEY, M. R., & KABER, D. B. (1999) · Ergonomics · doi:10.1080/001401399185595 · Cited by 1,088
Considering the opposite: A corrective strategy for social judgment.
Lord, C. G., Lepper, M. R., & Preston, E. (1984) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.47.6.1231 · Cited by 740
Does automation bias decision-making?
SKITKA, L. J., MOSIER, K. L., & BURDICK, M. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0252 · Cited by 694 · cited 1×
“However, when the automation failed to detect and notify operators of an event, or incorrectly recommended action despite the availability of reliable confirmatory evidence, human error rates increased 19 .”
BackgroundSarter, N. B., & Schroeder, B. (2001) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872001775870403 · Cited by 194
Brittleness in the design of cooperative problem-solving systems: the effects on user performance
Smith, P. J., McCoy, C. E., & Layton, C. (1997) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.568744 · Cited by 163
Design of a Cooperative Problem-Solving System for En-Route Flight Planning: An Empirical Evaluation
Layton, C., Smith, P. J., & McCoy, C. E. (1994) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089403600106 · Cited by 158
Research works printed but not linked: 11
- Chapanis A., 1951, Human Engineering for an effective airnavigation and traffic control system
- Sheridan T.B., 1978, MIT
- Zsambok C.E., 1992, LiteratureReviewofAnalyticalandNaturalisticDecisionMaking",Naval Command
- 10.1037/0022-3514.47.6.1231 · doi:10.1037/0022-3514.47.6.1231 · Paper page
- Carroll J.M., 1987, CognitiveAspectsofHuman-Computer Interaction
- Mosier K.L., 1996, Theory andApplications
- 12 Fiske,S.T.andTaylor,S.E.,Socialcognition,edited,McGraw-Hill,NewYork,1991.
- 17 Johnson,K.,Ren,L.,Kuchar,J.,andOman,C.,InteractionofAutomationandTimePressureinaRouteReplanningTask, International Conference on Human-Computer Interaction in Aeronautics, Cambridge, MA, 2002. 132-137.
- Cummings M.L., 2003, Systems and Information Engineering
- 1973, NTSB
- McGuirl J.M., 2003, Human Factors and Ergonomics Society 47th Annual Meeting
Cited by
Automation bias: a systematic review of frequency, effect mediators, and mitigators
Goddard, K., Roudsari, A., & Wyatt, J. C. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000089 · Cited by 1,162
“As the concept is relatively new and undefined, a number of synonyms have been used in the literature to describe the concept of AB, including automation-induced complacency,(9) overreliance on automation, and confirmation bias.(10) In a recent literature review, Parasuraman et al(11) discuss AB and automation-induced…”
BackgroundZhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
“of "automation bias" with which people overly rely on delegation to algorithms [6].”
BackgroundFairness of artificial intelligence in healthcare: review and recommendations
Ueda, D., Kakinuma, T., Fujita, S., Kamagata, K., Fushimi, Y., Ito, R., Matsui, Y., Nozaki, T., Nakaura, T., Fujima, N., et al. (2024) · Japanese Journal of Radiology · doi:10.1007/s11604-023-01474-3 · Cited by 607
“Clinicians aware of AI biases can avoid overreli‑ ance on AI‑generated results and make decisions based on more accurate information [91].”
BackgroundThe ethics of algorithms: key problems and solutions
Tsamados, A., Aggarwal, N., Cowls, J., Morley, J., Roberts, H., Taddeo, M., & Floridi, L. (2022) · AI & SOCIETY · doi:10.1007/s00146-021-01154-8 · Cited by 384
Jacobs, M., Pradier, M. F., McCoy, T. H., Perlis, R. H., Doshi-Velez, F., & Gajos, K. Z. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01224-x · Cited by 247
A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scores
De-Arteaga, M., Fogliato, R., & Chouldechova, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376638 · Cited by 221
“The role of the level of automation on over-reliance in decision support systems has been further discussed in [10].”
BackgroundEthics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations
Mökander, J., Morley, J., Taddeo, M., & Floridi, L. (2021) · Science and Engineering Ethics · doi:10.1007/s11948-021-00319-4 · Cited by 207
“For example, in some cases, ADMS act in full autonomy, whereas in others, ADMS provide recommendations to a human operator who has the final say (Cummings 2004).”
BackgroundThe ‘golden view’: data-driven governance in the scoring society
Dencik, L., Redden, J., Hintz, A., & Warne, H. (2019) · Internet Policy Review · doi:10.14763/2019.2.1413 · Cited by 191
Exploring automation bias in human–AI collaboration: a review and implications for explainable AI
Romeo, G., & Conti, D. (2026) · AI & SOCIETY · doi:10.1007/s00146-025-02422-7 · Cited by 209
Algorithmic Decision-Making and the Control Problem
Zerilli, J., Knott, A., Maclaurin, J., & Gavaghan, C. (2019) · Minds and Machines · doi:10.1007/s11023-019-09513-7 · Cited by 145
“There is no reason to suspect that machine learning and other state-of-the-art decision support systems are less likely to induce complacency effects than other forms of automated effort (e.g. Cummings 2004; Edwards and Veale 2017, p. 51).”
BackgroundKroll, J. A. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0084 · Cited by 132
“Because of automation bias, the phenomenon in which humans become more likely to believe answers that originate from a machine [51], such misleading explanations can have outsized weight.”
BackgroundThe Ethics of Algorithms: Key Problems and Solutions
Tsamados, A., Aggarwal, N., Cowls, J., Morley, J., Roberts, H., Taddeo, M., & Floridi, L. (2021) · Philosophical Studies Series · doi:10.1007/978-3-030-81907-1_8 · Cited by 121
I can do better than your AI: expertise and explanations
Schaffer, J., O'Donovan, J., Michaelis, J., Raglin, A., & Höllerer, T. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302308 · Cited by 119
“Effects related to automation bias [13] were reproduced here.”
BackgroundInfluentialRams, hounds and white boxes: investigating human–AI collaboration protocols in medical diagnosis
Cabitza, F., Campagner, A., Ronzio, L., Cameli, M., Mandoli, G. E., Pastore, M. C., Sconfienza, L. M., Folgado, D., Barandas, M., & Gamboa, H. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102506 · Cited by 117
Springer, A., & Whittaker, S. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302322 · Cited by 115
“Users are prone to blindly believing outputs from algorithmic systems, a phenomena referred to as algorithmic omniscience [23,38,76] and automation bias [17,58].”
BackgroundThe Ethics of Algorithms: Key Problems and SolutionsPreprint
Tsamados, A., Aggarwal, N., Cowls, J., Morley, J., Roberts, H., Taddeo, M., & Floridi, L. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3662302 · Cited by 101
AI hype as a cyber security risk: the moral responsibility of implementing generative AI in business
Humphreys, D., Koay, A., Desmond, D., & Mealy, E. (2024) · AI and Ethics · doi:10.1007/s43681-024-00443-4 · Cited by 98
Regulating human control over autonomous systems
Firlej, M., & Taeihagh, A. (2020) · Regulation & Governance · doi:10.1111/rego.12344 · Cited by 113
“76 See N Sharkey (n 75); Cummings (2004).”
Human control of AI systems: from supervision to teaming
Tsamados, A., Floridi, L., & Taddeo, M. (2025) · AI and Ethics · doi:10.1007/s43681-024-00489-4 · Cited by 92
“This can lead to over-trust dynamics, whereby the human agents ignore their experienced assessments—so-called automation bias [37]—or even “shirking part of their responsibility for decisions”, when this would contradict the behaviour of the AI system.”
Datafied child welfare services: unpacking politics, economics and power
Redden, J., Dencik, L., & Warne, H. (2020) · Policy Studies · doi:10.1080/01442872.2020.1724928 · Cited by 89
“This is further amplified by potential “automation bias” (Cummings 2004), a well-known phenomenon in which people attribute higher value to technological outputs, sometimes trusting these more than their own judgements.”
BackgroundProgressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information?
Springer, A., & Whittaker, S. (2020) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3374218 · Cited by 84
“Users can be prone to blindly believe outputs from algorithmic systems, a phenomenon referred to as algorithmic omniscience [26, 39, 78] and automation bias [19, 59].”
BackgroundSanchez-Martinez, S., Camara, O., Piella, G., Cikes, M., González-Ballester, M. Á., Miron, M., Vellido, A., Gómez, E., Fraser, A. G., & Bijnens, B. (2022) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2021.765693 · Cited by 85
“Automation bias, defined as the human tendency to accept a computer-generated solution without searching for contradictory information (43), may also affect clinical interpretation and decision-making.”
BackgroundChan, A., Ezell, C., Kaufmann, M., Wei, K., Hammond, L., Bradley, H., Bluemke, E., Rajkumar, N., Krueger, D., Kolt, N., et al. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658948 · Cited by 84
Horowitz, M. C., & Kahn, L. (2024) · International Studies Quarterly · doi:10.1093/isq/sqae020 · Cited by 68
Wang, P., & Ding, H. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103732 · Cited by 68
The impact of AI errors in a human-in-the-loop process
Agudo, U., Liberal, K. G., Arrese, M., & Matute, H. (2024) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-023-00529-3 · Cited by 66
“…compliance when the system’s assessment is erroneous is often referred to in the engineering and artificial intelligence fields as automation bias (Cummings, 2004; Lyell & Coiera, 2017; Mosier & Manzey, 2019; Parasuraman & Mustapha, 1996), and this effect has been documented in domains as…”
BackgroundHuman Supervisory Control of Robotic Teams: Integrating Cognitive Modeling with Engineering Design
Peters, J. R., Srivastava, V., Taylor, G. S., Surana, A., Eckstein, M. P., & Bullo, F. (2015) · IEEE Control Systems · doi:10.1109/mcs.2015.2471056 · Cited by 71
“This phenomena, sometimes referred to as automation bias, has been studied extensively in attempt to understand its effects and the conditions under which it occurs [133], [152], [153].”
BackgroundAutomated Decision-Making and Big Data: Concerns for People With Mental Illness
Monteith, S., & Glenn, T. (2016) · Current Psychiatry Reports · doi:10.1007/s11920-016-0746-6 · Cited by 62
“Yet, humans are better than machines in many areas of decision-making such as pattern recognition, reasoning inductively, deciding with incomplete information, improvising, making judgments, language processing, and cultural understanding [147, 148].”
BackgroundBias in Automatic Speech Recognition: The Case of African American Language
Martin, J. L., & Wright, K. E. (2023) · Applied Linguistics · doi:10.1093/applin/amac066 · Cited by 65
Cognitive Biases in Fact-Checking and Their Countermeasures: A Review
Soprano, M., Roitero, K., Barbera, D. L., Ceolin, D., Spina, D., Demartini, G., & Mizzaro, S. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103672 · Cited by 86
Mitigating the Attraction Effect with Visualizations
Dimara, E., Bailly, G., Bezerianos, A., & Franconeri, S. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2865233 · Cited by 61
“They can also incorporate normative algorithms into the decision making process that would be difficult or impossible for human decision makers to compute [20].”
BackgroundDelegating strategic decision-making to machines: Dr. Strangelove Redux?
Johnson, J. S. (2020) · Journal of Strategic Studies · doi:10.1080/01402390.2020.1759038 · Cited by 82
Autopilot, Mind Wandering, and the Out of the Loop Performance Problem
Gouraud, J., Delorme, A., & Berberian, B. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00541 · Cited by 57
Operator scheduling strategies in supervisory control of multiple UAVs
Cummings, M. L., & Mitchell, P. J. (2007) · Aerospace Science and Technology · doi:10.1016/j.ast.2006.10.007 · Cited by 69
“has been demonstrated before in other time-critical command and control applications [ 16 ].”
BackgroundSelf-citationDrummond, D., & Coulet, A. (2022) · Journal of Medical Internet Research · doi:10.2196/39698 · Cited by 64
“Indeed, between 2 contradictory pieces of information, one given by a human and the other by a computer system, humans tend to believe the information given by the computer system [27].”
Autonomous Weapons Systems, Artificial Intelligence, and the Problem of Meaningful Human Control
Schwarz, E. (2021) · Philosophical Journal of Conflict and Violence · doi:10.22618/tp.pjcv.20215.1.139004 · Cited by 80
Computing the Effects of Operator Attention Allocation in Human Control of Multiple Robots
Crandall, J. W., Cummings, M. L., Penna, M. D., & de Jong, P. M. A. (2010) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2010.2084082 · Cited by 57
“However, even suggesting but not enforcing undesirable OAASs can potentially decrease performance due to automation bias [31] and mistrust [32].”
BackgroundSelf-citationGuidelines for Assessing and Minimizing Risks of Emotion Recognition Applications
Hernandez, J., Lovejoy, J., McDuff, D., Suh, J., O'Brien, T., Sethumadhavan, A., Greene, G., Picard, R., & Czerwinski, M. (2021) · 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII) · doi:10.1109/acii52823.2021.9597452 · Cited by 51
“While these observations may seem obvious to the general affective computing researcher, we have observed that the terminology and the models used to represent emotion recognition technology can be confusing and that new practitioners might overestimate the predictive power of AI [15].”
BackgroundCriminal Futures: Predictive Policing and Everyday Police Work
Egbert, S., & Leese, M. (2020) · Routledge eBooks · doi:10.4324/9780429328732 · Cited by 199
Trustworthy Artificial Intelligence in Dentistry: Learnings from the EU AI Act
Ducret, M., Wahal, E., Gruson, D., Amrani, S., Richert, R., Mouncif-Moungache, M., & Schwendicke, F. (2024) · Journal of Dental Research · doi:10.1177/00220345241271160 · Cited by 64
“Trustworthiness of AISs is particularly relevant given the known biases of AISs as well as the high risk of automation bias of human AIS users (Cummings, 2004; Zerilli et al. 2022).”
BackgroundFrom Tools to Agents: Meta-Analytic Insights into Human Acceptance of AI
Li, B., Lai, E. Y., & Wang, X. (. (2025) · Journal of Marketing · doi:10.1177/00222429251355266 · Cited by 78
Artificial intelligence and labour market matching
Broecke, S. (2023) · OECD social employment and migration working papers · doi:10.1787/2b440821-en · Cited by 96
Towards Unbiased and Accurate Deferral to Multiple Experts
Keswani, V., Lease, M., & Kenthapadi, K. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462516 · Cited by 45
“Prior studies on settings where human-in-the-loop frameworks have been implemented provide evidence of such complexities [16, 2, 26, 55].”
BackgroundAlgorithms and Influence Artificial Intelligence and Crisis Decision-Making
Horowitz, M. C., & Lin-Greenberg, E. (2022) · International Studies Quarterly · doi:10.1093/isq/sqac069 · Cited by 46
Cummings, M. L., Bertuccelli, L. F., Macbeth, J., & Surana, A. (2014) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2014.2304962 · Cited by 44
“The main differences between the vehicle-based and taskbased interfaces, discussed next, are in the method of target assignment and path planning for the vehicles.”
MethodSelf-citationThe role of AI in detecting and mitigating human errors in safety-critical industries: A review
Gursel, E., Madadi, M., Coble, J. B., Agarwal, V., Yadav, V., Boring, R. L., & Khojandi, A. (2024) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2024.110682 · Cited by 54
Maas, M. M. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278766 · Cited by 37
“At the same time, research has shown that automated safety systems can instill a blanket trust (‘automation bias’) in operators or users—a trust that may, perversely, encourage greater risk-taking by those users as a result of risk homeostasis [62, p. 12], [66].”
BackgroundFischer, J. E., Greenhalgh, C., Jiang, W., Ramchurn, S. D., Wu, F., & Rodden, T. (2021) · Concurrency and Computation: Practice and Experience · doi:10.1002/cpe.4082 · Cited by 35
“This finding echoes results on ‘automation bias’ in the supervisory control literature [33].”
BackgroundOperator Object Function Guidance for a Real-Time Unmanned Vehicle Scheduling Algorithm
Clare, A. S., Cummings, M. L., How, J. P., Whitten, A. K., & Toupet, O. (2012) · Journal of Aerospace Computing Information and Communication · doi:10.2514/1.i010019 · Cited by 35
Self-citationSupporting intelligent and trustworthy maritime path planning decisions
Cummings, M. L., Buchin, M. E., Carrigan, G. P., & Donmez, B. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2010.05.002 · Cited by 43
“…a human decision bias towards believing an automation-generated solution and not seeking disconfirming evidence, is a known negative consequence of too much trust in a system (Skitka, Mosier, & Burdick, 1999), which has been shown to be a problem in command and control systems (Cummings, 2004).”
BackgroundSelf-citationHuman-automated path planning optimization and decision support
Cummings, M. L., Márquez, J. J., & Roy, N. (2011) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2011.10.001 · Cited by 38
“…with the introduction of automated decision support tools (Parasuraman, Sheridan, & Wickens, 2000), which are particularly relevant when considering that automation can fail and operators may not react appropriately to these circumstances (for review, see Cummings, 2004; Parasuraman & Riley, 1997).”
Self-citationAn Approach to Multi‐Criteria Decision Problems Under Severe Uncertainty
Comes, T., Hiete, M., & Schultmann, F. (2013) · Journal of Multi-Criteria Decision Analysis · doi:10.1002/mcda.1487 · Cited by 37
“In these situations, trade-offs between the level of automation or standardisation and the integration of human expertise and deliberation need to be made (Cummings, 2004).”
BackgroundSpatola, N. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100099 · Cited by 73
State responsibility in relation to military applications of artificial intelligence
Boutin, B. (2022) · Leiden Journal of International Law · doi:10.1017/s0922156522000607 · Cited by 32
Crimes of Dispassion: Autonomous Weapons and the Moral Challenge of Systematic Killing
Renic, N. C., & Schwarz, E. (2023) · Ethics & International Affairs · doi:10.1017/s0892679423000291 · Cited by 32
Lethal Autonomous Weapons: Meaningful Human Control or Meaningful Human Certification? [Opinion]
Cummings, M. L. (2019) · IEEE Technology and Society Magazine · doi:10.1109/mts.2019.2948438 · Cited by 46
Self-citationWITHDRAWN: Overview of machine learning and its adaptability in mechanical engineering
Geetha, N. K., & Bridjesh, P. (2020) · Materials Today Proceedings · doi:10.1016/j.matpr.2020.09.611 · Cited by 30
RetractedWhy Are People’s Decisions Sometimes Worse with Computer Support?
Alberdi, E., Strigini, L., Povyakalo, A. A., & Ayton, P. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-04468-7_3 · Cited by 29
“Factors that have been investigated in empirical studies as possible influences in people’s vulnerability to automation bias include: individual differences among operators [5, 13, 16, 17]; people’s accountability for their own decisions [17]; the levels of automation at which the computer support is provided [12, 18]…”
BackgroundFostering effective hybrid human-LLM reasoning and decision making
Passerini, A., Gema, A. P., Minervini, P., Sayin, B., & Tentori, K. (2025) · Frontiers Artif. Intell. · doi:10.3389/frai.2024.1464690 · Cited by 32
“Such a behavior can easily lead to an automation bias (Cummings, 2012), where users tend to over-rely on information and suggestions from automated systems compared to those from their peers.”
Eye tracking insights into physician behaviour with safe and unsafe explainable AI recommendations
Nagendran, M., Festor, P., Komorowski, M., Gordon, A. C., & Faisal, A. A. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01200-x · Cited by 35
“However, there are also potential negative in fl uences on human decision-making such as automation bias (de fi ned as the tendency for a human decision maker to disregard or not search for contradictory information in light of an AI-generated solution that is accepted as correct) 12 .”
BackgroundHuman Factors Perspective on Next Generation Unmanned Aerial Systems
Goodrich, M. A., & Cummings, M. L. (2014) · Springer eBooks · doi:10.1007/978-90-481-9707-1_23 · Cited by 32
Self-citationInfluencing Trust for Human–Automation Collaborative Scheduling of Multiple Unmanned Vehicles
Clare, A. S., Cummings, M. L., & Repenning, N. P. (2015) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815587803 · Cited by 35
“…automation can lead to the phenomenon of automation bias (Mosier et al., 1998), whereby operators accept an AS-generated solution while disregarding or neglecting to search for contra-dictory information (Chen & Terrence, 2009; Cummings, 2004; Lee & Moray, 1994; Muir & Moray, 1996; See, 2002).”
BackgroundSelf-citationThe Impact of Increasing Autonomy on Training Requirements in a UAV Supervisory Control Task
Cummings, M. L., Huang, L., Zhu, H., Finkelstein, D., & Wei, R. (2019) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343419868917 · Cited by 31
Self-citationActivity Theory as a Framework to Analyze Technology-Mediated Elderly Care
Woll, A., & Bratteteig, T. (2017) · Mind Culture and Activity · doi:10.1080/10749039.2017.1375528 · Cited by 28
“Automated services are becoming important parts of services in many work domains and may replace some parts of human services in the future (Bainbridge, 1983; Cummings, 2004).”
BackgroundJohnson, J. S. (2021) · Journal of Strategic Studies · doi:10.1080/01402390.2020.1867541 · Cited by 32
Rojas-Carabali, W. A., Cifuentes‐González, C., Gutiérrez-Sinisterra, L., Heng, L. Y., Tsui, E. Y. K., Gangaputra, S., Sadda, S. R., Nguyen, Q. D., Kempen, J. H., Pavesio, C. E., et al. (2024) · Asia-Pacific Journal of Ophthalmology · doi:10.1016/j.apjo.2024.100082 · Cited by 25
Human–machine collaboration for enhanced decision-making in governance
Rooy, D. V. (2024) · Data & Policy · doi:10.1017/dap.2024.72 · Cited by 29
“As automation increases, the types of biases shift from those influenced by direct human decision-making toward those related to overreliance on or underengagement with automated systems (Cummings, 2004; Mosier and Skitka, 1999).”
Participatory design for computerization of clinical practice guidelines
Lyng, K. M., & Pedersen, B. S. (2011) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.05.005 · Cited by 26
Customization bias in decision support systems
Solomon, J. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557211 · Cited by 19
“For this reason, Cummings [7] argues that automation bias is a form of confirmation bias.”
BackgroundFair governance with humans and machines.
Hermstrüwer, Y., & Langenbach, P. (2023) · Psychology, Public Policy, and Law · doi:10.1037/law0000381 · Cited by 19
Examining human reliance on artificial intelligence in decision making
Pearson, J., Dror, I. E., Jayes, E., Whordley, G.-R., Mason, G., & Nightingale, S. J. (2026) · Scientific Reports · doi:10.1038/s41598-026-34983-y · Cited by 33
Partnering with AI for instrument development: Possibilities and pitfalls
Beghetto, R. A., Ross, W., Karwowski, M., & Glăveanu, V. P. (2024) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2024.101121 · Cited by 19
Artificial Intelligence and the Ethics of Self-Learning Robots
Vallor, S., & Bekey, G. A. (2017) · Oxford University Press eBooks · doi:10.1093/oso/9780190652951.003.0022 · Cited by 27
AI and the Automation of Wisdom
Vallor, S. (2017) · Philosophical studies series · doi:10.1007/978-3-319-61043-6_8 · Cited by 23
A network analysis of decision strategies of human experts in steel manufacturing
Merten, D. C., Hütt, M. ‐., & Uygun, Y. (2022) · Computers & Industrial Engineering · doi:10.1016/j.cie.2022.108120 · Cited by 25
Computational Measures of Deceptive Language: Prospects and Issues
Tomas, F., Dodier, O., & Demarchi, S. (2022) · Frontiers in Communication · doi:10.3389/fcomm.2022.792378 · Cited by 23
“Automation can take different forms, from a fully automated process with no human intervention (coding or decision), to minimal human supervision of the process (Cummings, 2004).”
BackgroundThe Switch, the Ladder, and the Matrix: Models for Classifying AI Systems
Mökander, J., Sheth, M., Watson, D., & Floridi, L. (2023) · Minds and Machines · doi:10.1007/s11023-022-09620-y · Cited by 28
“As a result, organisations already have processes in place to oversee human decision-making and enforce commitments related to environmental sustainability, corporate social responsibility, and data management (e.g., in line with the General Data Protection Regulation ).”
BackgroundDo-it-yourself services and work-like chores: on civic duties and digital public services
Verne, G., & Bratteteig, T. (2016) · Personal and Ubiquitous Computing · doi:10.1007/s00779-016-0936-6 · Cited by 27
“Computers make possible automation of both physical and symbolic tasks basically by automating decisions [26], expanding the area for automation to include larger parts of the arc of work.”
BackgroundUniversity students’ trust in AI: Examining reliance and strategies for critical engagement.
Abuzar, M., Mahmudulhassan, & Muthoifin (2025) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v19i07.52875 · Cited by 20
Machine Learning for Clinical Decision-Making: Challenges and OpportunitiesPreprint
Sanchez‐Martinez, S., Cámara, Ó., Piella, G., Čikeš, M., Ballester, M. Á. G., Miron, M., Vellido, A., Gómez, E., Fraser, A. G., & Bijnens, B. H. (2019) · Preprints.org · doi:10.20944/preprints201911.0278.v1 · Cited by 17
“However, understanding where automated systems can be used, and which level of automation would be appropriate within clinical procedures is crucial to avoid potentially preventable errors attributed to automation bias (Cummings, 2004).”
BackgroundThe AI Commander: Centaur Teaming, Command, and Ethical Dilemmas
Johnson, J. S. (2024) · doi:10.1093/oso/9780198892182.001.0001 · Cited by 28
Real-World Monitoring of Artificial Intelligence in Radiology: Challenges and Best Practices
Dean, G., Montañà, E., Kyriazi, S., Shelmerdine, S. C., Buckens, C. F. M., Agrell, H., Ranschaert, E. R., Marušić, A., Davies, G. J., Wardle, P., et al. (2025) · Korean Journal of Radiology · doi:10.3348/kjr.2025.0962 · Cited by 22
“…as automation bias, potentially ignoring contradictory clinical evidence, complacency, blind distrust, and cherry-picking (selectively engaging only with AI outputs that align with the clinician’s expectations) can significantly influence the integration of AI into clinical decision-making [26].”
Toward Human–Autonomy Teaming in Single-Pilot Operations: Domain Analysis and Requirements
Tokadlı, G., Dorneich, M. C., & Matessa, M. (2021) · Journal of Air Transportation · doi:10.2514/1.d0240 · Cited by 14
Context-Aware Team Task Allocation to Support Mobile Police Surveillance
Streefkerk, J. W., van Esch-Bussemakers, M. P., & Neerincx, M. A. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02812-0_11 · Cited by 18
“On the downside, some authors argue that such high levels of system automation are not advisable in time-critical environments [16].”
BackgroundExplaining decisions without explainability? Artificial intelligence and medicolegal accountability
McCradden, M. D., & Stedman, I. (2024) · Future Healthcare Journal · doi:10.1016/j.fhj.2024.100171 · Cited by 18
Jessup, S. A., Gibson, A. M., Capiola, A., Alarcon, G. M., & Borders, M. R. (2020) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2020.068 · Cited by 17
“, [8]) where humans trust automation more than humans in initial interactions [7].”
BackgroundResultBaltzer, P. (2023) · Radiology · doi:10.1148/radiol.230770 · Cited by 17
The fine line between automation and augmentation in website usability evaluation
Esposito, A., Desolda, G., & Lanzilotti, R. (2024) · Scientific Reports · doi:10.1038/s41598-024-59616-0 · Cited by 23
“This metric measures the number of omission errors by the evaluators due to automation bias 19 .”
BackgroundInfluentialRizk, A., & Lindgren, I. (2025) · Government Information Quarterly · doi:10.1016/j.giq.2025.102061 · Cited by 50
The soldier’s tolerance for autonomous systems
Galliott, J. C. (2018) · Paladyn Journal of Behavioral Robotics · doi:10.1515/pjbr-2018-0008 · Cited by 16
“It is in the face of this complexity that people have the aforementioned tendency to rely either too much or not enough on automated systems like those we increasingly find embedded into unmanned aircraft or their control systems, especially when in the time-critical and dynamic situations which are characteristic of…”
BackgroundDisparate Impact Diminishes Consumer Trust Even for Advantaged Users
Draws, T., Szlávik, Z., Timmermans, B., Tintarev, N., Varshney, K. R., & Hind, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-79460-6_11 · Cited by 18
“, a tendency to prefer automated over human decisions) [10], in other cases, they experience what has been referred to as algorithm aversion: a tendency to prefer human over algorithmic advice [11,29,32].”
BackgroundEmergence of network effects and predictability in the judicial system
Mones, E., Sapieżyński, P., Thordal, S., Olsen, H. P., & Lehmann, S. (2021) · Scientific Reports · doi:10.1038/s41598-021-82430-x · Cited by 21
Predictive Model for Human-Unmanned Vehicle Systems
Crandall, J. W., Cummings, M. L., & Nehme, C. E. (2009) · Journal of Aerospace Computing Information and Communication · doi:10.2514/1.39191 · Cited by 11
“These processes and limitations include, among others, operator workload [19], operator utilization [20–22], operator trust in automation [23,24], and operator situation awareness [25,26].”
BackgroundSelf-citationArtificial Intelligence and Operations: A Foundational Framework of Emerging Research and Practice
Dai, T., & Swaminathan, J. M. (2026) · Production and Operations Management · doi:10.1177/10591478251412943 · Cited by 32
“Mitigating automation bias requires careful human oversight and ensuring that operators are trained to recognize and understand AI’s limitations (Cummings, 2004).”
Auditor Judgment Bias Research: A 50-Year Trend Analysis and Emerging Technology Use
Lombardi, D. R., Sipior, J. C., & Dannemiller, S. (2023) · Journal of Information Systems · doi:10.2308/isys-2020-079 · Cited by 18
Bias in Using AI for Recruiting: Legal Considerations
Sipior, J. C., Ward, B. T., Rusinko, C. A., & Lombardi, D. R. (2023) · Information Systems Management · doi:10.1080/10580530.2023.2294453 · Cited by 19
“This bias occurs when users of computer-based systems disregard or do not search for contradictory information, even if it is correct, but rather relies on system-generated advice or solutions (Cummings, 2004).”
A comparative user study of human predictions in algorithm-supported recidivism risk assessment
Portela, M., Castillo, C., Tolan, S., Karimi-Haghighi, M., & Pueyo, A. A. (2024) · Artificial Intelligence and Law · doi:10.1007/s10506-024-09393-y · Cited by 23
“Cummings proposed ten levels going from ’the computer decides everything and acts autonomously, ignoring the human’ (level 10) to ’the computer offers no assistance: a human must take all decisions and actions’ (level 1).”
InfluentialAutomated Decision-Making in the Public Sector: A Multidisciplinary Literature Review
Rizk, A., & Lindgren, I. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70274-7_15 · Cited by 15
Predictive Policing in 2025: A Scenario
Macnish, K., Wright, D., & Jiya, T. (2020) · Advanced sciences and technologies for security applications · doi:10.1007/978-3-030-50613-1_9 · Cited by 11
“This has led to fears of automation bias in which officers trust the system despite evidence to the contrary [3, 10], and despite the training, introduced in 2020, to rectify this [4].”
BackgroundUser Trust in Assisted Decision-Making Using Miniaturized Near-Infrared Spectroscopy
Jiang, W., Sarsenbayeva, Z., van Berkel, N., Wang, C., Yu, D., Wei, J., Gonçalves, J., & Kostakos, V. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445710 · Cited by 13
“Moreover, existing works show that users may encounter “algorithm aversion” – where users stop trusting machines after seeing mistakes [20], or “automation bias” – where users over-rely on the machine’s decision [17].”
Background
Metadata
- Authors
- Cummings, M.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Cummings, Mary
- ORCID
- Cummings, Mary
- Venue
- AIAA 1st Intelligent Systems Technical Conference
- Published
- 2004-06-19
- OpenAlex
- W4240224338
- Cited by
- 269
- References
- 13
- Citations by year
- 2026: 46 · 2025: 26 · 2024: 51 · 2023: 23 · 2022: 16 · 2021: 26 · 2020: 19 · 2019: 12 · 2018: 6 · 2017: 11 · 2016: 7 · 2015: 5 · 2014: 3 · 2013: 4 · 2012: 2
- FWCI
- 0.57
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- AIAA Intelligent Systems Technical Conference (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- automation bias, intelligent decision support system, time-critical decision making, human-automation interaction, trust in automation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.