CoChat

Responsible AI—Two Frameworks for Ethical Design Practice

Open access
Peters, Dorian, Vold, Karina, Robinson, Diana, Calvo, Rafael A. · 2020 · IEEE Transactions on Technology and Society

The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.

Abstract

In 2019, the IEEE launched the P7000 standards projects intended to address ethical issues in the design of autonomous and intelligent systems. This move came amidst a growing public concern over the unintended consequences of artificial intelligence (AI), compounded by the lack of an anticipatory process for attending to ethical impact within professional practice. However, the difficulty in moving from principles to practice presents a significant challenge to the implementation of ethical guidelines. Herein, we describe two complementary frameworks for integrating ethical analysis into engineering practice to help address this challenge. We then provide the outcomes of an ethical analysis informed by these frameworks, conducted within the specific context of Internet-delivered therapy in digital mental health. We hope both the frameworks and analysis can provide tools and insights, not only for the context of digital healthcare but also for data-enabled and intelligent technology development more broadly.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tts.2020.2974991

Cites

70 of 70 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Connections among six fields centrally involved in the ethical design and development of AI and data-enabled systems (based on Sloan foundation's hexagonal mapping of 'connections among the cognitive sciences' 1978, reproduced in Gardner 1985, p. 37) key: unbroken lines = strong interdisciplinary ties, broken lines = weak interdisciplinary ties.
Fig. 1 Connections among six fields centrally involved in the ethical design and development of AI and data-enabled systems (based on Sloan foundation's hexagonal mapping of 'connections among the cognitive sciences' 1978, reproduced in Gardner 1985, p. 37) key: unbroken lines = strong interdisciplinary ties, broken lines = weak interdisciplinary ties.CC-BY · From the PDF
Fig. 2 Responsible design process framework. A process for technology development in which wellbeing support and ethical impact analysis are incorporated at each phase. A post-launch evaluation phase is also added.
Fig. 2 Responsible design process framework. A process for technology development in which wellbeing support and ethical impact analysis are incorporated at each phase. A post-launch evaluation phase is also added.CC-BY · From the PDF
Fig. 3 Six spheres of technology experience (adapted from Peters, Calvo, and Ryan [26]).
Fig. 3 Six spheres of technology experience (adapted from Peters, Calvo, and Ryan [26]).CC-BY · From the PDF
Image 4
CC-BY · From the PDF
Image 5
CC-BY · From the PDF
Image 6
CC-BY · From the PDF
Image 7
CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 15

  1. A. Sen, The Idea of Justice. London, U.K.: Penguin, 2010.
  2. S. Brown Consequence Scanning Manual, Version 1. London, U.K.: Doteveryone, 2019.
  3. UD Council. (2004). Double Diamond Diagram. [Online]. Available: https://www.designcouncil.org.uk/news-opinion/what-framework- innovation-design-councils-evolved-double-diamond
  4. Plato, Plato's Phaedrus. Cambridge, U.K.: Cambridge Univ. Press, 1952.
  5. AP Association. (2019). App Evaluation Model. [Online]. Available: https://www.psychiatry.org/psychiatrists/practice/mental-health-apps/ app-evaluation-model
  6. IEEE. (2019). Ethically Aligned Design. [Online]. Available: https://ethicsinaction.ieee.org
  7. ACM. (2018). ACM Code of Ethics and Professional Conduct. [Online]. Available: https://www.acm.org/code-of-ethics
  8. Y. Zeng, E. Lu, and C. Huangfu, "Linking artificial intelligence princi- ples," in Proc. AAAI Workshop Artif. Intell. Safety (AAAI-Safe AI), 2019, pp. 1-15.
  9. A. Zimmermann and B. Zevenbergen, Ai Ethics: Seven Traps, Tinker, Oklahoma City, OK, USA 2019.
  10. J. Whittlestone, R. Nyrup, A. Alexandrova, K. Dihal, and S. Cave, Ethical and Societal Implications of Algorithms, Data, and Artificial Intelligence: A Roadmap for Research. London, U.K.: Nuffield Found., 2019.
  11. A. Tieu. (2015). We Now Have an Ai Therapist, and She's Doing Her Job Better Than Humans Can. [Online]. Available: https://futurism.com/uscs-new-ai-ellie-has-more-success-than-actual- therapists
  12. E. Montague, P.-Y. Chen, J. Xu, B. Chewning, and B. Barrett, "Nonverbal interpersonal interactions in clinical encounters and patient perceptions of empathy," J. Participatory Med., vol. 5, p. e33, Aug. 2013.
  13. U.K. House of Lords Select Committee on Artificial Intelligence. (2018). Ai in the U.K.: Ready, Willing and Able? Report of Session 2017-19. [Online]. Available: https://publications.parliament.uk/pa/ld201719/ldselect/ldai/100/100.pdf
  14. Universite de Montreal. (2017). Montreal Declaration for Responsible Ai. [Online]. Available: https://www.montrealdeclaration- responsibleai.com/the-declaration
  15. 2019). Psyberguide. [Online]. Available: http://www.Psyberguide.org

Cited by

See all 293

Metadata

Authors
Peters, D., Vold, K., Robinson, D., & Calvo, R. A.
Affiliations
  • University of Cambridge (GB)
  • Imperial College London (GB)
Venue
IEEE Transactions on Technology and Society
Published
2020-03
Volume
1
Issue
1
Pages
34-47
ISSN
2637-6415 (ISSN-L)
OpenAlex
W3007204236
Cited by
293
References
69
Citations by year
2026: 37 · 2025: 67 · 2024: 75 · 2023: 55 · 2022: 32 · 2021: 21 · 2020: 6
FWCI
38.79
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Technology and Society (publishedVersion, cc-by)
  • Spiral (Imperial College London) (submittedVersion, cc-by)
  • Apollo (University of Cambridge) (submittedVersion, cc-by)
  • Apollo (cc-by)
Funders
  • Leverhulme Centre for the Future of Intelligence, Leverhulme Trust (RC-2015-067)
  • Digital Charter Fellowship Programme at the Alan Turing Institute, U.K.
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Engineering › General Engineering › Flooding and Environmental Impact
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
responsible AI, ethical design, ethical impact assessment, engineering practice, digital mental health, online therapy, AI ethics framework

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.