Who Owns AI When It Breaks? The Convergence of AI Governance and Cybersecurity Accountability
Open accessAbstract
Artificial intelligence (AI) system failures are often silent. Applications may remain operational and continue to generate polished outputs even as recommendations degrade, manipulated inputs alter behavior, or automated agents exceed their intended authority. This lack of transparency creates a governance vacuum, obscuring responsibility when AI systems malfunction. The primary concern is not ownership of the AI system itself, but ownership of the consequential decisions the system informs or executes. Drawing on cybersecurity incident research, AI governance literature, and legal case studies, including Robodebt and SyRI, this paper distinguishes system ownership, which concerns maintenance and operation, from decision ownership, which concerns accountability for outcomes. Further, this discussion addresses three structural failures that undermine AI accountability: capability without authority, inclusion without operational integration, and detection without execution. The common assumption that human-in-the-loop oversight provides meaningful control also is challenged, as automation bias frequently renders this safeguard ineffective. As agentic AI systems acquire greater autonomous authority, these accountability gaps become increasingly consequential. This paper proposes an AI Decision Authority Charter for each significant AI use case. The charter assigns decision rights by domain, identifies a single accountable owner for each consequential decision, defines required cross-functional participation and concurrence, and establishes escalation and containment authority before deployment. Within this distributed governance model, the Chief Information Security Officer (CISO) should possess bounded preauthorized stop-work authority when defined security conditions are exceeded. This authority does not make the CISO the owner of enterprise AI or its business outcomes; it provides the authority necessary to contain systems during security events.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Cites
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · see citing works
Bainbridge, L. (1983) · Automatica · doi:10.1016/0005-1098(83)90046-8 · Cited by 2,205 · see citing works
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710 · see citing works
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 1,372 · see citing works
Software Engineering for Machine Learning: A Case Study
Amershi, S., Begel, A., Bird, C., DeLine, R. A., Gall, H. C., Kamar, E. S., Nagappan, N., Nushi, B., & Zimmermann, T. (2019) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip.2019.00042 · Cited by 1,181 · see citing works
Artificial Intelligence Risk Management Framework (AI RMF 1.0)
Tabassi, E. (2023) · doi:10.6028/nist.ai.100-1 · Cited by 1,136 · see citing works
Responsible Artificial Intelligence Governance: A Review and Research Framework
Papagiannidis, E., Mikalef, P., & Conboy, K. (2025) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2024.101885 · Cited by 565 · see citing works
Madaio, M. A., Stark, L., Wortman Vaughan, J., & Wallach, H. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376445 · Cited by 436 · see citing works
AI Governance: A Systematic Literature Review
Batool, A., Zowghi, D., & Bano, M. (2025) · AI and Ethics · doi:10.1007/s43681-024-00653-w · Cited by 314 · see citing works
Defining organizational AI governance
Mäntymäki, M., Minkkinen, M., Birkstedt, T., & Viljanen, M. (2022) · AI and Ethics · doi:10.1007/s43681-022-00143-x · Cited by 301 · see citing works
Artificial intelligence risk management framework :
National Institute of Standards and Technology (US) (2024) · NIST Trustworthy and Responsible AI · doi:10.6028/nist.ai.600-1 · Cited by 274 · see citing works
The NIST Cybersecurity Framework (CSF) 2.0
National Institute of Standards and Technology (2024) · doi:10.6028/nist.cswp.29 · Cited by 266 · see citing works
Toward AI Governance: Identifying Best Practices and Potential Barriers and Outcomes
Papagiannidis, E., Enholm, I. M., Dremel, C., Mikalef, P., & Krogstie, J. (2023) · Information Systems Frontiers · doi:10.1007/s10796-022-10251-y · Cited by 191 · see citing works
Laux, J. (2024) · AI & SOCIETY · doi:10.1007/s00146-023-01777-z · Cited by 127 · see citing works
Digital welfare fraud detection and the Dutch <i>SyRI</i> judgment
van Bekkum, M., & Borgesius, F. Z. (2021) · European Journal of Social Security · doi:10.1177/13882627211031257 · Cited by 108 · see citing works
On the Quest for Effectiveness in Human Oversight: Interdisciplinary Perspectives
Sterz, S., Baum, K., Biewer, S., Hermanns, H., Lauber-Rönsberg, A., Meinel, P., & Langer, M. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3659051 · Cited by 91 · see citing works
Learning from cyber security incidents: A systematic review and future research agenda
Patterson, C. M., Nurse, J. R. C., & Franqueira, V. N. L. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103309 · Cited by 73 · see citing works
Langer, M., Baum, K. L., & Schlicker, N. (2024) · Minds and Machines · doi:10.1007/s11023-024-09701-0 · Cited by 72 · see citing works
Automation bias in public administration – an interdisciplinary perspective from law and psychology
Ruschemeier, H., & Hondrich, L. J. (2024) · Government Information Quarterly · doi:10.1016/j.giq.2024.101953 · Cited by 59 · see citing works
Naseer, A., Naseer, H., Ahmad, A., Maynard, S. B., & Siddiqui, A. M. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103525 · Cited by 45 · see citing works
Hadley, E., Blatecky, A., & Comfort, M. L. (2024) · AI and Ethics · doi:10.1007/s43681-024-00574-8 · Cited by 25 · see citing works
Lancaster, C., Schulenberg, K., Flathmann, C., McNeese, N. J., & Freeman, G. (2023) · ACM Journal on Responsible Computing · doi:10.1145/3632121 · Cited by 21 · see citing works
Orgeron, C. P., Rials, W., Doss, D. A., & Copeland, J. (2025) · Journal of Cases on Information Technology · doi:10.4018/jcit.381293 · Cited by 1 · see citing works
Self-citationFrom Workforce to Warfighting: Why State Cyber Reserve Forces Fail
Copeland, J. (2026) · The Cyber Defense Review · doi:10.55682/cdr/t8xv-pdqx
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- Kroll, J. A., Huey, J., Barocas, S., Felten, E. W., Reidenberg, J. R., Robinson, D. G., & Yu, H. (2017). Accountable algorithms. University of Pennsylvania Law Review, 165(3), 633-705. https://scholarship.law.upenn.edu/penn_law_review/vol165/iss3/3/
- Authors
- Montgomery, J., & Copeland, J.
- Affiliations
- Colorado Technical University
- Colorado Technical University (US)
- ORCID
- Copeland, Joshua
- Venue
- The Pinnacle: A Journal by Scholar-Practitioners
- Publisher
- Colorado Technical University
- Published
- 2026-09-17
- Volume
- 4
- Issue
- 2
- ISSN
- 2994-7502 (ISSN-L)
- OpenAlex
- W7213471485
- Cited by
- 0
- References
- 23
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by-nd
- Locations
- The Pinnacle A Journal by Scholar-Practitioners (publishedVersion, cc-by-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Technology Governance and Strategy
- Keywords
- AI governance, AI accountability, automation bias, human-in-the-loop oversight, agentic AI, chief information security officer, Robodebt, SyRI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-30.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review