Automation Bias in Intelligent Time Critical Decision Support Systems
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“several studies suggest that overloading users with information about the system could potentially harm people's situation awareness and lead to worse performance or decision-making outcome [6, 27, 29].”
From Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making (2020) · cites this paper as [6]
In the citing paper
“According to theories of trust [6, 12, 15], trusting behaviors such as adopting suggestions are not only driven by a more positive perception of the trustee but also other factors such as one's disposition to trust and situation awareness.”
From Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making (2020) · cites this paper as [6]
In the citing paper
“Cummings (2004) showed that perceived reliability and time pressure can intensify dependence on automated recommendations in critical decision environments.”
From From Human Oversight to Cognitive Sovereignty: A Process-Based Governance Standard for AI-Assisted Legal Reasoning (2026) · cites this paper as Cummings (2004)
In the citing paper
“Because of automation bias, the phenomenon in which humans become more likely to believe answers that originate from a machine [51], such misleading explanations can have outsized weight.”
From The fallacy of inscrutability (2018) · cites this paper as [51]
In the citing paper
“Clinicians aware of AI biases can avoid overreliance on AI-generated results and make decisions based on more accurate information [91].”
From Fairness of artificial intelligence in healthcare: review and recommendations (2024) · cites this paper as [91]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195
(2013) · Mean Field Simulation for Monte Carlo Integration · doi:10.1201/b14924-7 · Cited by 1,554
ENDSLEY, M. R., & KABER, D. B. (1999) · Ergonomics · doi:10.1080/001401399185595 · Cited by 1,088
Considering the opposite: A corrective strategy for social judgment.
Lord, C. G., Lepper, M. R., & Preston, E. (1984) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.47.6.1231 · Cited by 740
Does automation bias decision-making?
SKITKA, L. J., MOSIER, K. L., & BURDICK, M. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0252 · Cited by 694 · cited 1×
“However, when the automation failed to detect and notify operators of an event, or incorrectly recommended action despite the availability of reliable confirmatory evidence, human error rates increased 19 .”
BackgroundSarter, N. B., & Schroeder, B. (2001) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872001775870403 · Cited by 194
Brittleness in the design of cooperative problem-solving systems: the effects on user performance
Smith, P. J., McCoy, C. E., & Layton, C. (1997) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.568744 · Cited by 163
Design of a Cooperative Problem-Solving System for En-Route Flight Planning: An Empirical Evaluation
Layton, C., Smith, P. J., & McCoy, C. E. (1994) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089403600106 · Cited by 158
Automation Bias and Errors: Are Crews Better Than Individuals?
Skitka, L. J., Mosier, K. L., Burdick, M., & Rosenblatt, B. (2000) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap1001_5 · Cited by 127
Development and Evaluation of a Cockpit Decision-Aid for Emergency Trajectory Generation
Chen, T. L., & Pritchett, A. R. (2001) · Journal of Aircraft · doi:10.2514/2.2856 · Cited by 47
Dealing with brittleness in the design of expert systems for immunohematology
Guerlain, S. A. E., Smith, P. J., Obradovich, J. H., Rudmann, S. V., Strohm, P. L., Smith, J. W., & Svirbely, J. R. (1996) · Immunohematology · doi:10.21307/immunohematology-2019-758 · Cited by 13
Research works printed but not linked: 11
- Chapanis A., 1951, Human Engineering for an effective airnavigation and traffic control system
- Sheridan T.B., 1978, MIT
- Zsambok C.E., 1992, LiteratureReviewofAnalyticalandNaturalisticDecisionMaking",Naval Command
- 10.1037/0022-3514.47.6.1231 · doi:10.1037/0022-3514.47.6.1231 · Paper page
- Carroll J.M., 1987, CognitiveAspectsofHuman-Computer Interaction
- Mosier K.L., 1996, Theory andApplications
- 12 Fiske,S.T.andTaylor,S.E.,Socialcognition,edited,McGraw-Hill,NewYork,1991.
- 17 Johnson,K.,Ren,L.,Kuchar,J.,andOman,C.,InteractionofAutomationandTimePressureinaRouteReplanningTask, International Conference on Human-Computer Interaction in Aeronautics, Cambridge, MA, 2002. 132-137.
- Cummings M.L., 2003, Systems and Information Engineering
- 1973, NTSB
- McGuirl J.M., 2003, Human Factors and Ergonomics Society 47th Annual Meeting
Cited by
Automation bias: a systematic review of frequency, effect mediators, and mitigators
Goddard, K., Roudsari, A., & Wyatt, J. C. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000089 · Cited by 1,162
“As the concept is relatively new and undefined, a number of synonyms have been used in the literature to describe the concept of AB, including automation-induced complacency,(9) overreliance on automation, and confirmation bias.(10) In a recent literature review, Parasuraman et al(11) discuss AB and automation-induced…”
BackgroundZhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
“of "automation bias" with which people overly rely on delegation to algorithms [6].”
BackgroundFairness of artificial intelligence in healthcare: review and recommendations
Ueda, D., Kakinuma, T., Fujita, S., Kamagata, K., Fushimi, Y., Ito, R., Matsui, Y., Nozaki, T., Nakaura, T., Fujima, N., et al. (2024) · Japanese Journal of Radiology · doi:10.1007/s11604-023-01474-3 · Cited by 607
“Clinicians aware of AI biases can avoid overreli‑ ance on AI‑generated results and make decisions based on more accurate information [91].”
BackgroundThe ethics of algorithms: key problems and solutions
Tsamados, A., Aggarwal, N., Cowls, J., Morley, J., Roberts, H., Taddeo, M., & Floridi, L. (2022) · AI & SOCIETY · doi:10.1007/s00146-021-01154-8 · Cited by 384
Jacobs, M., Pradier, M. F., McCoy, T. H., Perlis, R. H., Doshi-Velez, F., & Gajos, K. Z. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01224-x · Cited by 247
Metadata
- Authors
- Cummings, M.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Cummings, Mary
- ORCID
- Cummings, Mary
- Venue
- AIAA 1st Intelligent Systems Technical Conference
- Published
- 2004-06-19
- OpenAlex
- W4240224338
- Cited by
- 269
- References
- 13
- Citations by year
- 2026: 46 · 2025: 26 · 2024: 51 · 2023: 23 · 2022: 16 · 2021: 26 · 2020: 19 · 2019: 12 · 2018: 6 · 2017: 11 · 2016: 7 · 2015: 5 · 2014: 3 · 2013: 4 · 2012: 2
- FWCI
- 0.57
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- AIAA Intelligent Systems Technical Conference (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- automation bias, intelligent decision support system, time-critical decision making, human-automation interaction, trust in automation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.