The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Formal verification of ethical choices in autonomous systems
Open accessAbstract
Autonomous systems such as unmanned vehicles are beginning to operate within society. All participants in society are required to follow specific regulations and laws. An autonomous system cannot be an exception. Inevitably an autonomous system will find itself in a situation in which it needs to not only choose to obey a rule or not, but also make a complex ethical decision. However, there exists no obvious way to implement the human understanding of ethical behaviour in computers. Even if we enable autonomous systems to distinguish between more and less ethical alternatives, how can we be sure that they would choose right? We consider autonomous systems with a hybrid architecture in which the highest level of reasoning is executed by a rational (BDI) agent. For such a system, formal verification has been used successfully to prove that specific rules of behaviour are observed when making decisions. We propose a theoretical framework for ethical plan selection that can be formally verified. We implement a rational agent that incorporates a given ethical policy in its plan selection and show that we can formally verify that the agent chooses to execute, to the best of its beliefs, the most ethical available plan.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Principles of Biomedical Ethics
(2012) · Thieves of Virtue · doi:10.7551/mitpress/9079.003.0009 · Cited by 13,453
Artificial Morality: Top-down, Bottom-up, and Hybrid Approaches
Allen, C., Smit, I., & Wallach, W. (2005) · Ethics and Information Technology · doi:10.1007/s10676-006-0004-4 · Cited by 346
Ethical Decision Making during Automated Vehicle Crashes
Goodall, N. J. (2014) · Transportation Research Record: Journal of the Transportation Research Board · doi:10.3141/2424-07 · Cited by 292
Practical verification of decision-making in agent-based autonomous systems
Dennis, L. A., Fisher, M., Lincoln, N. K., Lisitsa, A., & Veres, S. M. (2016) · Automated Software Engineering · doi:10.1007/s10515-014-0168-9 · Cited by 102
Self-citation
Cited by
The Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities
Floridi, L. (2023) · doi:10.1093/oso/9780198883098.001.0001 · Cited by 507
Ethical governance is essential to building trust in robotics and artificial intelligence systems
Winfield, A. F. T., & Jirotka, M. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0085 · Cited by 493
An Overview of Artificial Intelligence Ethics
Huang, C., Zhang, Z., Mao, B., & Yao, X. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3194503 · Cited by 482
How to Design AI for Social Good: Seven Essential Factors
Floridi, L., Cowls, J., King, T. C., & Taddeo, M. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-020-00213-5 · Cited by 430
“For example, they may include the use of formal verification to ensure that autonomous vehicles, and AI systems in other safety–critical contexts, would make the ethically preferable choice (Dennis et al. 2016).”
BackgroundArtificial Intelligence Regulation: A framework for governance
de Almeida, P. G. R., dos Santos, C. D., & Farias, J. S. (2021) · Ethics and Information Technology · doi:10.1007/s10676-021-09593-z · Cited by 395
Metadata
- Authors
- Dennis, L., Fisher, M., Slavkovik, M., & Webster, M.
- Venue
- Robotics and Autonomous Systems
- Publisher
- Elsevier BV
- Published
- 2016-03
- Volume
- 77
- Pages
- 1-14
- ISSN
- 0921-8890 (ISSN-L)
- OpenAlex
- W2220500481
- Cited by
- 223
- References
- 4
- FWCI
- 9.38
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.