The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Mind the gaps: Assuring the safety of autonomous systems from an engineering, ethical, and legal perspective
Open accessAbstract
This paper brings together a multi-disciplinary perspective from systems engineering, ethics, and law to articulate a common language in which to reason about the multi-faceted problem of assuring the safety of autonomous systems. The paper's focus is on the “gaps” that arise across the development process: the semantic gap, where normal conditions for a complete specification of intended functionality are not present; the responsibility gap, where normal conditions for holding human actors morally responsible for harm are not present; and the liability gap, where normal conditions for securing compensation to victims of harm are not present. By categorising these “gaps” we can expose with greater precision key sources of uncertainty and risk with autonomous systems. This can inform the development of more detailed models of safety assurance and contribute to more effective risk control.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The third international consensus definitions for sepsis and septic shock (Sepsis-3).
Singer, M., Deutschman, C. S., Seymour, C. W., Shankar-Hari, M., Annane, D., Bauer, M., Bellomo, R., Bernard, G. R., Chiche, J.-D., Coopersmith, C. M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0287 · Cited by 28,250
Fleischmann, C., Scherag, A., Adhikari, N. K. J., Hartog, C. S., Tsaganos, T., Schlattmann, P., Angus, D. C., & Reinhart, K. (2016) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201504-0781oc · Cited by 3,548
Aleatory or epistemic? Does it matter?
Kiureghian, A. D., & Ditlevsen, O. (2009) · Structural Safety · doi:10.1016/j.strusafe.2008.06.020 · Cited by 2,454
Responsibility and Control: A Theory of Moral Responsibility
Fischer, J. M., & Ravizza, M. (1998) · doi:10.1017/cbo9780511814594 · Cited by 2,249 · cited 2×
“The Control and Epistemic conditions are sometimes called the ‘Aristotelian conditions’: they can be traced back to Aristotle’s treatment of moral responsibility [3][21][12].”
BackgroundAwad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2018) · Nature · doi:10.1038/s41586-018-0637-6 · Cited by 1,859 · cited 2×
“Some of the ethical concerns fielded in respect of highly autonomous vehicles are an indirect result of the difficulties raised by the semantic gap [6].”
BackgroundThe surviving sepsis campaign bundle: 2018 update
Levy, M. M., Evans, L. E., & Rhodes, A. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5085-0 · Cited by 1,445 · cited 1×
“Best practice for treatment is currently rapid administration of antibiotics to treat the infection, intravenous fluids to correct hypotension (low blood pressure), and vasopressor medications if the patient’s blood pressure remains low [40] [26].”
BackgroundConcrete Problems in AI Safety
Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016) · arXiv · doi:10.48550/arxiv.1606.06565 · Cited by 1,314
Komorowski, M., Celi, L. A., Badawi, O., Gordon, A. C., & Faisal, A. A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0213-5 · Cited by 1,290
The responsibility gap: Ascribing responsibility for the actions of learning automata
Matthias, A. (2004) · Ethics and Information Technology · doi:10.1007/s10676-004-3422-1 · Cited by 1,101
SPARROW, R. (2007) · Journal of Applied Philosophy · doi:10.1111/j.1468-5930.2007.00346.x · Cited by 593 · cited 1×
“Because of the severity of risk and the importance of accountability in the military domain, the notion is often discussed with respect to autonomous weapons and meaningful human control [65] [61][51].”
Meaningful Human Control over Autonomous Systems: A Philosophical Account
Santoni de Sio, F., & van den Hoven, J. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2018.00015 · Cited by 566 · cited 1×
“Because of the severity of risk and the importance of accountability in the military domain, the notion is often discussed with respect to autonomous weapons and meaningful human control [65] [61][51].”
BackgroundAn Empirical Evaluation of Deep Learning on Highway Driving
Huval, B., Wang, T., Tandon, S., Kiske, J., Song, W., Pazhayampallil, J., Andriluka, M., Rajpurkar, P., Migimatsu, T., Cheng-Yue, R., et al. (2015) · arXiv · doi:10.48550/arxiv.1504.01716 · Cited by 537
Nyholm, S. (2018) · Science and Engineering Ethics · doi:10.1007/s11948-017-9943-x · Cited by 242
Legal personality of robots, corporations, idols and chimpanzees: a quest for legitimacy
Solaiman, S. M. (2017) · Artificial Intelligence and Law · doi:10.1007/s10506-016-9192-3 · Cited by 221 · cited 1×
“To solve this problem, this article does not advocate that systems should be granted full legal-personhood [10] [64] [69] as this will come with a host of other problems, such as its being able to own property, sue (as well as being sued), and have its own legal rights.”
BackgroundAtiyah's Accidents, Compensation and the Law
Cane, P. (2013) · doi:10.1017/cbo9781139548885 · Cited by 60
Cited by
Bibri, S. E., Krogstie, J., Kaboli, A., & Alahi, A. (2024) · Environmental Science and Ecotechnology · doi:10.1016/j.ese.2023.100330 · Cited by 536
Yigitcanlar, T., & Cugurullo, F. (2020) · Sustainability · doi:10.3390/su12208548 · Cited by 337
Atakishiyev, S., Salameh, M., Yao, H., & Goebel, R. (2021) · arXiv · doi:10.48550/arxiv.2112.11561 · Cited by 336
Atakishiyev, S., Salameh, M., Yao, H., & Goebel, R. (2024) · IEEE Access · doi:10.1109/access.2024.3431437 · Cited by 323
Bibri, S. E., Alexandre, A., Sharifi, A., & Krogstie, J. (2023) · Energy Informatics · doi:10.1186/s42162-023-00259-2 · Cited by 299
Metadata
- Authors
- Burton, S., Habli, I., Lawton, T., McDermid, J., Morgan, P., & Porter, Z.
- Venue
- Artificial Intelligence
- Publisher
- Elsevier BV
- Published
- 2020-02
- Volume
- 279
- Pages
- 103201
- ISSN
- 0004-3702 (ISSN-L)
- OpenAlex
- W2987375645
- Cited by
- 173
- References
- 15
- FWCI
- 14.80
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.