The DOI matches its Crossref record; 57 of the 59 references it cites were found in a registry or an index.
Bending the Automation Bias Curve: A Study of Human and AI-Based Decision Making in National Security Contexts
Open accessAbstract
Uses of artificial intelligence (AI) are growing around the world. What will influence AI adoption in the international security realm? Research on automation bias suggests that humans can often be overconfident in AI, whereas research on algorithm aversion shows that, as the stakes of a decision rise, humans become more cautious about trusting algorithms. We theorize about the relationship between background knowledge about AI, trust in AI, and how these interact with other factors to influence the probability of automation bias in the international security context. We test these in a preregistered task identification experiment across a representative sample of 9,000 adults in nine countries with varying levels of AI industries. The results strongly support the theory, especially concerning AI background knowledge. A version of the Dunning–Kruger effect appears to be at play, whereby those with the lowest level of experience with AI are slightly more likely to be algorithm-averse, then automation bias occurs at lower levels of knowledge before leveling off as a respondent’s AI background reaches the highest levels. Additional results show effects from the task’s difficulty, overall AI trust, and whether a human or AI decision aid is described as highly competent or less competent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Higher levels of AI literacy enable appropriate reliance on automation (Horowitz and Kahn 2024).”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Horowitz and Kahn 2024
In the citing paper
“AB has also been measured as how often users completely change their answers to match AI recommendations (e.g., Horowitz and Kahn 2024)”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Horowitz and Kahn 2024
In the citing paper
“Individuals with minimal AI background knowledge are more prone to aversion, while those with moderate knowledge are most likely to over-rely on AI, exhibiting the Dunning-Kruger effect.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Horowitz and Kahn (2024)
In the citing paper
“participants with extensive AI knowledge demonstrated the most balanced reliance.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Horowitz and Kahn (2024)
In the citing paper
“This bias makes individuals with average AI background knowledge overestimate their understanding of it, leading to overreliance on automation.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Horowitz and Kahn (2024)
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Kruger, J., & Dunning, D. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1121 · Cited by 7,731
Introduction: epistemic communities and international policy coordination
Haas, P. M. (1992) · International Organization · doi:10.1017/s0020818300001442 · Cited by 7,584
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Awad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2018) · Nature · doi:10.1038/s41586-018-0637-6 · Cited by 1,859
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710
An Updated and Streamlined Technology Readiness Index: TRI 2.0
Parasuraman, A., & Colby, C. L. (2015) · Journal of Service Research · doi:10.1177/1094670514539730 · Cited by 1,440
Automation bias: a systematic review of frequency, effect mediators, and mitigators
Goddard, K., Roudsari, A., & Wyatt, J. C. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000089 · Cited by 1,162
Initial validation of the general attitudes towards Artificial Intelligence Scale
Schepman, A., & Rodway, P. (2020) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2020.100014 · Cited by 785
Does automation bias decision-making?
SKITKA, L. J., MOSIER, K. L., & BURDICK, M. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0252 · Cited by 694
Alon-Barkat, S., & Busuioc, M. (2023) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muac007 · Cited by 469
Artificial Intelligence: American Attitudes and Trends
Zhang, B., & Dafoe, A. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3312874 · Cited by 464
Automation bias and verification complexity: a systematic review
Lyell, D., & Coiera, E. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw105 · Cited by 451
Public Opinion and the Democratic Peace
TOMZ, M. R., & WEEKS, J. L. P. (2013) · American Political Science Review · doi:10.1017/s0003055413000488 · Cited by 416
Automation Bias in Intelligent Time Critical Decision Support Systems
Cummings, M. (2004) · AIAA 1st Intelligent Systems Technical Conference · doi:10.2514/6.2004-6313 · Cited by 269
Re‐Assessing Elite‐Public Gaps in Political Behavior
Kertzer, J. D. (2022) · American Journal of Political Science · doi:10.1111/ajps.12583 · Cited by 263
Chong, L., Zhang, G., Goucher-Lambert, K., Kotovsky, K., & Cagan, J. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107018 · Cited by 262
A Conceptualization of Trust in International Relations
HOFFMAN, A. M. (2002) · European Journal of International Relations · doi:10.1177/1354066102008003003 · Cited by 258
Expert Political Judgment: How Good Is It? How Can We Know?
Tetlock, P. E. (2009) · Princeton University Press eBooks · doi:10.1515/9781400830312 · Cited by 232
Bailey, N. R., & Scerbo, M. W. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500535301 · Cited by 224
Lam, S. Y., Chiang, J., & Parasuraman, A. (2008) · Journal of Interactive Marketing · doi:10.1002/dir.20119 · Cited by 214
Lim, D., & Liu, R. (2019) · Journal of Military Ethics · doi:10.1080/15027570.2019.1637555 · Cited by 189
The Political Costs of Crisis Bargaining: Presidential Rhetoric and the Role of Party
Trager, R. F., & Vavreck, L. (2011) · American Journal of Political Science · doi:10.1111/j.1540-5907.2011.00521.x · Cited by 179
Overconfidence among beginners: Is a little learning a dangerous thing?
Sanchez, C., & Dunning, D. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000102 · Cited by 177
Automation bias: Empirical results assessing influencing factors
Goddard, K., Roudsari, A., & Wyatt, J. C. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.01.001 · Cited by 163
Is Trust Important in Technology Adoption? A Policy Capturing Approach
Bahmanziari, T., Pearson, J. M., & Crosby, L. (2003) · Journal of Computer Information Systems · doi:10.1080/08874417.2003.11647533 · Cited by 162
The Impact of US Drone Strikes on Terrorism in Pakistan
Johnston, P. B., & Sarbahi, A. K. (2016) · International Studies Quarterly · doi:10.1093/isq/sqv004 · Cited by 161
Experiments and Surveys on Political Elites
Kertzer, J. D., & Renshon, J. (2022) · Annual Review of Political Science · doi:10.1146/annurev-polisci-051120-013649 · Cited by 161
When speed kills: Lethal autonomous weapon systems, deterrence and stability
Horowitz, M. C. (2019) · Journal of Strategic Studies · doi:10.1080/01402390.2019.1621174 · Cited by 148
Self-citationAdopting AI: how familiarity breeds both trust and contempt
Horowitz, M. C., Kahn, L., Macdonald, J., & Schneider, J. (2024) · AI & SOCIETY · doi:10.1007/s00146-023-01666-5 · Cited by 135
Self-citationEmerging technologies and strategic stability in peacetime, crisis, and war
Sechser, T. S., Narang, N., & Talmadge, C. (2019) · Journal of Strategic Studies · doi:10.1080/01402390.2019.1626725 · Cited by 133
What influences attitudes about artificial intelligence adoption: Evidence from U.S. local officials
Horowitz, M. C., & Kahn, L. (2021) · PLoS ONE · doi:10.1371/journal.pone.0257732 · Cited by 130
Self-citationInternational law, military effectiveness, and public support for drone strikes
Kreps, S. E., & Wallace, G. P. R. (2016) · Journal of Peace Research · doi:10.1177/0022343316657405 · Cited by 128
Learning, Realism, and Alliances: The Weight of the Shadow of the Past
Reiter, D. (1994) · World Politics · doi:10.2307/2950716 · Cited by 114
Trust and Mistrust in International Relations
Slantchev, B. L. (2006) · Perspectives on Politics · doi:10.1017/s1537592706740361 · Cited by 104
Zvobgo, K. (2019) · International Studies Quarterly · doi:10.1093/isq/sqz056 · Cited by 92
(2000) · CRC Press eBooks · doi:10.1201/9781420036879 · Cited by 85
Algorithms at War: The Promise, Peril, and Limits of Artificial Intelligence
Jensen, B. M., Whyte, C., & Cuomo, S. (2020) · International Studies Review · doi:10.1093/isr/viz025 · Cited by 84
Does Science Fiction Affect Political Fact? Yes and No: A Survey Experiment on “Killer Robots”
Young, K., & Carpenter, C. (2018) · International Studies Quarterly · doi:10.1093/isq/sqy028 · Cited by 83
Povyakalo, A. A., Alberdi, E., Strigini, L., & Ayton, P. (2013) · Medical Decision Making · doi:10.1177/0272989x12465490 · Cited by 79
Drones, Surveillance, and Violence: Theory and Evidence from a US Drone Program
Mir, A., & Moore, D. (2019) · International Studies Quarterly · doi:10.1093/isq/sqz040 · Cited by 78
Reliance, trust and heuristics in judgmental forecasting
Alvarado, J., & Barrero, L. H. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.03.047 · Cited by 77
Artificial Intelligence and International Politics
Etcheson, C., & Hudson, V. M. (1993) · Political Psychology · doi:10.2307/3791400 · Cited by 77
Drones: What Everyone Needs to Know®
Kreps, S. E. (2016) · doi:10.1093/wentk/9780190235345.001.0001 · Cited by 76
Artificial intelligence and the future of warfare: The USA, China, and strategic stability
Johnson, J. S. (2021) · Manchester University Press eBooks · doi:10.7765/9781526145062 · Cited by 74
Do Emerging Military Technologies Matter for International Politics?
Horowitz, M. C. (2020) · Annual Review of Political Science · doi:10.1146/annurev-polisci-050718-032725 · Cited by 73
Self-citationWargame of Drones: Remotely Piloted Aircraft and Crisis Escalation
Lin-Greenberg, E. (2022) · Journal of Conflict Resolution · doi:10.1177/00220027221106960 · Cited by 67
Algorithms and Influence Artificial Intelligence and Crisis Decision-Making
Horowitz, M. C., & Lin-Greenberg, E. (2022) · International Studies Quarterly · doi:10.1093/isq/sqac069 · Cited by 46
Self-citationMartial Law? Military Experience, International Law, and Support for Torture
Wallace, G. P. R. (2013) · International Studies Quarterly · doi:10.1111/isqu.12092 · Cited by 43
The Unavoidable Technology: How Artificial Intelligence Can Strengthen Nuclear Stability
Cox, J., & Williams, H. (2021) · The Washington Quarterly · doi:10.1080/0163660x.2021.1893019 · Cited by 36
Bin, G. (2009) · Journal of Information Science · doi:10.1177/0165551509105196 · Cited by 32
Johnson, J. S. (2021) · Journal of Strategic Studies · doi:10.1080/01402390.2020.1867541 · Cited by 32
The Effect of Erroneous Computer Interpretation of ECGs on Resident Decision Making
Southern, W. N., & Arnsten, J. H. (2009) · Medical Decision Making · doi:10.1177/0272989x09333125 · Cited by 28
The Impact of Increasing Autonomy on Training Requirements in a UAV Supervisory Control Task
Cummings, M. L., Huang, L., Zhu, H., Finkelstein, D., & Wei, R. (2019) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343419868917 · Cited by 27
Artificial Intelligence and Nuclear Command and Control
Fitzpatrick, M. (2019) · Survival · doi:10.1080/00396338.2019.1614782 · Cited by 26
Reichenbach, J., Onnasch, L., & Manzey, D. (2010) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193121005400422 · Cited by 21
The Tragedy of Human Rights: Liberalism and the Loss of Belonging
Seligman, A. B., & Montgomery, D. W. (2019) · Society · doi:10.1007/s12115-019-00356-7 · Cited by 19
COVID-19 and public support for autonomous technologies—Did the pandemic catalyze a world of robots?
Horowitz, M. C., Kahn, L., Macdonald, J. M., & Schneider, J. G. (2022) · PLoS ONE · doi:10.1371/journal.pone.0273941 · Cited by 6
Self-citation
Research works printed but not linked: 8
- Abbott, 2000, Human Factors Engineering and Flight Deck Design, 9.1
- Blosch, 2018, Understanding Gartner’s Hype Cycles
- HAI at Stanford University, 2021, Global AI Vibrancy Tool: Who’s Leading the Global AI Race?
- Hersman, 2020, Wormhole Escalation in the New Nuclear Age, Texas National Security Review, 3, 90
- Luhmann, 1979, Trust and Power
- Mosier, 1996, Human Decision Makers and Automated Decision Aids: Made for Each Other?, 201
- OECD AI, 2022, National Ai Policies & Strategies
- Scharre, 2018, Army of None: Autonomous Weapons and the Future of War
Cited by
OECD (2025) · OECD eBooks · doi:10.1787/795de142-en · Cited by 323
Exploring automation bias in human–AI collaboration: a review and implications for explainable AI
Romeo, G., & Conti, D. (2026) · AI & SOCIETY · doi:10.1007/s00146-025-02422-7 · Cited by 209
International AI Safety Report 2026Preprint
Bengio, Y., Clare, S., Prunkl, C., Andriushchenko, M., Bucknall, B., Murray, M., Bommasani, R., Casper, S., Davidson, T., Douglas, R., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.21012 · Cited by 167
OVERCOMING BARRIERS TO ARTIFICIAL INTELLIGENCE ADOPTION
Ivchyk, V. (2024) · Three Seas Economic Journal · doi:10.30525/2661-5150/2024-4-3 · Cited by 68
Jose, B., Cleetus, A., Joseph, B., Joseph, L., Jose, B., & John, A. K. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1647687 · Cited by 63
Metadata
- Authors
- Horowitz, M. C., & Kahn, L.
- Affiliations
- University of Pennsylvania (US)
- Georgetown University (US)
- Venue
- International Studies Quarterly
- Publisher
- Oxford University Press (OUP)
- Published
- 2024-03-14
- Volume
- 68
- Issue
- 2
- ISSN
- 0020-8833 (ISSN-L)
- 1468-2478
- OpenAlex
- W4393375049
- Cited by
- 68
- References
- 59
- Citations by year
- 2026: 42 · 2025: 20 · 2024: 5
- FWCI
- 31.97
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- International Studies Quarterly (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- Air Force Office of Scientific Research (#FA9550-18-1-0194)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- automation bias, algorithm aversion, trust in AI, national security decision-making, human-AI decision-making, Dunning-Kruger effect, task difficulty, AI competencies, international security
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.