The DOI matches its Crossref record; 57 of the 59 references it cites were found in a registry or an index.
Bending the Automation Bias Curve: A Study of Human and AI-Based Decision Making in National Security Contexts
Open accessAbstract
Uses of artificial intelligence (AI) are growing around the world. What will influence AI adoption in the international security realm? Research on automation bias suggests that humans can often be overconfident in AI, whereas research on algorithm aversion shows that, as the stakes of a decision rise, humans become more cautious about trusting algorithms. We theorize about the relationship between background knowledge about AI, trust in AI, and how these interact with other factors to influence the probability of automation bias in the international security context. We test these in a preregistered task identification experiment across a representative sample of 9,000 adults in nine countries with varying levels of AI industries. The results strongly support the theory, especially concerning AI background knowledge. A version of the Dunning–Kruger effect appears to be at play, whereby those with the lowest level of experience with AI are slightly more likely to be algorithm-averse, then automation bias occurs at lower levels of knowledge before leveling off as a respondent’s AI background reaches the highest levels. Additional results show effects from the task’s difficulty, overall AI trust, and whether a human or AI decision aid is described as highly competent or less competent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Higher levels of AI literacy enable appropriate reliance on automation (Horowitz and Kahn 2024).”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Horowitz and Kahn 2024
In the citing paper
“AB has also been measured as how often users completely change their answers to match AI recommendations (e.g., Horowitz and Kahn 2024)”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Horowitz and Kahn 2024
In the citing paper
“Individuals with minimal AI background knowledge are more prone to aversion, while those with moderate knowledge are most likely to over-rely on AI, exhibiting the Dunning-Kruger effect.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Horowitz and Kahn (2024)
In the citing paper
“participants with extensive AI knowledge demonstrated the most balanced reliance.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Horowitz and Kahn (2024)
In the citing paper
“This bias makes individuals with average AI background knowledge overestimate their understanding of it, leading to overreliance on automation.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Horowitz and Kahn (2024)
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Kruger, J., & Dunning, D. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1121 · Cited by 7,731
Introduction: epistemic communities and international policy coordination
Haas, P. M. (1992) · International Organization · doi:10.1017/s0020818300001442 · Cited by 7,584
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Awad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2018) · Nature · doi:10.1038/s41586-018-0637-6 · Cited by 1,859
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710
An Updated and Streamlined Technology Readiness Index: TRI 2.0
Parasuraman, A., & Colby, C. L. (2015) · Journal of Service Research · doi:10.1177/1094670514539730 · Cited by 1,440
Automation bias: a systematic review of frequency, effect mediators, and mitigators
Goddard, K., Roudsari, A., & Wyatt, J. C. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000089 · Cited by 1,162
Initial validation of the general attitudes towards Artificial Intelligence Scale
Schepman, A., & Rodway, P. (2020) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2020.100014 · Cited by 785
Does automation bias decision-making?
SKITKA, L. J., MOSIER, K. L., & BURDICK, M. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0252 · Cited by 694
Alon-Barkat, S., & Busuioc, M. (2023) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muac007 · Cited by 469
Research works printed but not linked: 8
- Abbott, 2000, Human Factors Engineering and Flight Deck Design, 9.1
- Blosch, 2018, Understanding Gartner’s Hype Cycles
- HAI at Stanford University, 2021, Global AI Vibrancy Tool: Who’s Leading the Global AI Race?
- Hersman, 2020, Wormhole Escalation in the New Nuclear Age, Texas National Security Review, 3, 90
- Luhmann, 1979, Trust and Power
- Mosier, 1996, Human Decision Makers and Automated Decision Aids: Made for Each Other?, 201
- OECD AI, 2022, National Ai Policies & Strategies
- Scharre, 2018, Army of None: Autonomous Weapons and the Future of War
Cited by
OECD (2025) · OECD eBooks · doi:10.1787/795de142-en · Cited by 323
Exploring automation bias in human–AI collaboration: a review and implications for explainable AI
Romeo, G., & Conti, D. (2026) · AI & SOCIETY · doi:10.1007/s00146-025-02422-7 · Cited by 209
International AI Safety Report 2026Preprint
Bengio, Y., Clare, S., Prunkl, C., Andriushchenko, M., Bucknall, B., Murray, M., Bommasani, R., Casper, S., Davidson, T., Douglas, R., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.21012 · Cited by 167
OVERCOMING BARRIERS TO ARTIFICIAL INTELLIGENCE ADOPTION
Ivchyk, V. (2024) · Three Seas Economic Journal · doi:10.30525/2661-5150/2024-4-3 · Cited by 68
Jose, B., Cleetus, A., Joseph, B., Joseph, L., Jose, B., & John, A. K. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1647687 · Cited by 63
Metadata
- Authors
- Horowitz, M. C., & Kahn, L.
- Affiliations
- University of Pennsylvania (US)
- Georgetown University (US)
- Venue
- International Studies Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 2024-03-14
- Volume
- 68
- Issue
- 2
- ISSN
- 0020-8833 (ISSN-L)
- 1468-2478
- OpenAlex
- W4393375049
- Cited by
- 68
- References
- 59
- Citations by year
- 2026: 42 · 2025: 20 · 2024: 5
- FWCI
- 31.97
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- International Studies Quarterly (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- Air Force Office of Scientific Research (#FA9550-18-1-0194)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- automation bias, algorithm aversion, trust in AI, national security decision-making, human-AI decision-making, Dunning-Kruger effect, task difficulty, AI competencies, international security
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Bending the Automation Bias Curve: A Study of Human and AI-Based Decision Making in National Security Contexts. https://app.cochat.ai/papers/10.1093/isq/sqae020
- The paper
- Horowitz, M. C., & Kahn, L. (2024). Bending the Automation Bias Curve: A Study of Human and AI-Based Decision Making in National Security Contexts. International Studies Quarterly. https://doi.org/10.1093/isq/sqae020
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.