The DOI matches its Crossref record; 19 of the 22 references it cites were found in a registry or an index.
The “big red button” is too late: an alternative model for the ethical evaluation of AI systems
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Taking this approach recognises that, in a digital context, ethical principles are not simply either applied or not, but regularly re-applied or applied differently, or better, or ignored as algorithmic systems are developed, deployed, configured (Ananny and Crawford 2018) tested, revised and re-tuned (Arnold and Scheutz 2018).”
From From What to How: An Initial Review of Publicly Available AI Ethics Tools, Methods and Research to Translate Principles into Practices (2020) · cites this paper as Arnold and Scheutz 2018
Citations
Cites
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · cited 1×
“2016; Devlin 2016), as is being able to correct bias through supervised learning (Hardesty 2016; Hardt et al. 2016).”
BackgroundSuperintelligence: paths, dangers, strategies
(2015) · Choice Reviews Online · doi:10.5860/choice.187536 · Cited by 1,979
Ananny, M., & Crawford, K. (2018) · New Media & Society · doi:10.1177/1461444816676645 · Cited by 1,836 · cited 1×
“Those concerned with algorithmic accountability readily concede that there is no simple transparency available for many types of machine learning (Ananny and Crawford 2016; Boyd 2016).”
BackgroundMoral machines: teaching robots right from wrong
(2009) · Choice Reviews Online · doi:10.5860/choice.46-4493 · Cited by 793
Rationalizing Neural Predictions
Lei, T., Barzilay, R., & Jaakkola, T. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1011 · Cited by 777 · cited 1×
“Ferreting out bias in training data is one area of increasing interest (Lei et al. 2016; Devlin 2016), as is being able to correct bias through supervised learning (Hardesty 2016; Hardt et al.”
BackgroundWallach, W., & Allen, C. (2009) · Oxford University Press · doi:10.1093/acprof:oso/9780195374049.001.0001 · Cited by 711
The Nature, Importance, and Difficulty of Machine Ethics
Moor, J. H. (2006) · IEEE Intelligent Systems · doi:10.1109/mis.2006.80 · Cited by 690
There is a blind spot in AI research
Crawford, K., & Calo, R. (2016) · Nature · doi:10.1038/538311a · Cited by 580
Talking to Bots: Symbiotic Agency and the Case of Tay
Neff, G. (2016) · International journal of communication · Cited by 557
(2007) · Cited by 366
Research works printed but not linked: 2
- Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016). Concrete problems in AI safety. Preprint at arXiv:1606.06565. Retrieved from https://arXiv.org/abs/1606.06565v2 . · arXiv
- Arnold, T., Kasenberg, D., & Scheutz, M. (2017). Value alignment or misalignment: What will keep systems accountable? AAAI Ethics Workshop. Retrieved from https://hrilab.tufts.edu/publications/ aaai17-alignment.pdf .
Cited by
Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-019-00165-5 · Cited by 882
Artificial Intelligence Regulation: A framework for governance
de Almeida, P. G. R., dos Santos, C. D., & Farias, J. S. (2021) · Ethics and Information Technology · doi:10.1007/s10676-021-09593-z · Cited by 395
Wieringa, M. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372833 · Cited by 321
“40, 135] or simulations of behavior [12].”
Ethics as a Service: A Pragmatic Operationalisation of AI Ethics
Morley, J., Elhalal, A., Garcia, F., Kinsey, L., Mökander, J., & Floridi, L. (2021) · Minds and Machines · doi:10.1007/s11023-021-09563-w · Cited by 266
From ethical AI frameworks to tools: a review of approaches
Prem, E. (2023) · AI and Ethics · doi:10.1007/s43681-023-00258-9 · Cited by 242
“In addition, several works are very general or are otherwise difficult to translate into designs for AI systems, most notably [10, [64, 84] present rather simple concepts.”
Background
Metadata
- Authors
- Arnold, T., & Scheutz, M.
- Affiliations
- Tufts University (US)
- Corresponding author
- Arnold, Thomas
- Venue
- Ethics and Information Technology
- Published
- 2018-01-23
- Volume
- 20
- Issue
- 1
- Pages
- 59-69
- ISSN
- 1388-1957 (ISSN-L)
- 1572-8439
- OpenAlex
- W2784773199
- Cited by
- 94
- References
- 22
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 11 · 2023: 11 · 2022: 18 · 2021: 19 · 2020: 15 · 2019: 5 · 2018: 4
- FWCI
- 21.38
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Ethics and Information Technology (publishedVersion)
- Funders
- Office of Naval Research (ONR #N00014-16-1-2278)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- AI ethics, AI safety, emergency shutdown, scenario generation, simulation environment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The “big red button” is too late: an alternative model for the ethical evaluation of AI systems. https://app.cochat.ai/papers/10.1007/s10676-018-9447-7
- The paper
- Arnold, T., & Scheutz, M. (2018). The “big red button” is too late: an alternative model for the ethical evaluation of AI systems. Ethics and Information Technology. https://doi.org/10.1007/s10676-018-9447-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.