CoChat
Sign Up
Cited by 9Ethics and Social Impacts of AIEthics in Business and EducationPhilosophical Ethics and Theory

Automating Moral Reasoning (Invited Paper)

Open access
Slavkovik, Marija·2022·Schloss Dagstuhl – Leibniz-Zentrum für Informatik
DOI 10.4230/oasics.aib.2022.6
Open this paper in CoChat — free accountOpen PDF

Abstract

Artificial Intelligence ethics is concerned with ensuring a nonnegative ethical impact of researching, developing, deploying and using AI systems. One way to accomplish that is to enable those AI systems to make moral decisions in ethically sensitive situations, i.e., automate moral reasoning. Machine ethics is an interdisciplinary research area that is concerned with the problem of automating moral reasoning. This tutorial presents the problem of making moral decisions and gives a general overview of how a computational agent can be constructed to make moral decisions. The tutorial is aimed for students in artificial intelligence who are interested in acquiring a starting understanding of the basic concepts and a gateway to the literature in machine ethics.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.4230/oasics.aib.2022.6

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The Humanoid Agents system is extensible to many more aspects, such as personality, moral values, empathy, helpfulness, cultural background and other personal attributes.

    “While our paper demonstrates how three different aspects of System 1 influence agent behavior, our system is also extensible to many more aspects, such as personality (Wu et al., 2020), moral values (Jiang et al., 2022), empathy (Sharma et al., 2020), helpfulness (Wang and Torres, 2022), cultural background (Liu et al., 2021) and other personal attributes (Wang et al., 2022).”

    From Humanoid Agents: Platform for Simulating Human-like Generative Agents (2023) · cites this paper as Jiang et al., 2022

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 87

  1. Saleema Amershi, Maya Cakmak, W. Knox, and Todd Kulesza. Power to the people: The role of humans in interactive machine learning. AI Magazine , 35:105-120, 12 2014. doi: 10.1609/aima g.v35i4.2513. · DOI
  2. Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. Guidelines for human-ai interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems , CHI '19, pp. 1-13, New York, NY, USA, 2019. Association for Computing Machinery. ISBN 9781450359702. doi: 10.1145/3290605.3300233. URL https://doi.org/10.1145/3290605.3300233 . · DOI · Paper page
  3. Prithviraj Ammanabrolu, Liwei Jiang, Maarten Sap, Hanna Hajishirzi, and Yejin Choi. Aligning to social norms and values in interactive narratives. In NAACL , 2022.
  4. Susan Leigh Anderson. Asimov's 'three laws of robotics' and machine metaethics. Ai & Society , 22(4):477-493, 2008.
  5. Edmond Awad, Sydney Levine, Michael Anderson, Susan Leigh Anderson, Vincent Conitzer, M.J. Crockett, Jim A.C. Everett, Theodoros Evgeniou, Alison Gopnik, Julian C. Jamison, Tae Wan Kim, S. Matthew Liao, Michelle N. Meyer, John Mikhail, Kweku Opoku-Agyemang, Jana Schaich Borg, Juliana Schroeder, Walter Sinnott-Armstrong, Marija Slavkovik, and Josh B. Tenenbaum. Computational ethics. Trends in Cognitive Sciences , 26(5):388-405, 2022. ISSN 1364-6613. doi: https://doi.org/10.1016/j.tics.2022.02.009. URL https://www.scienced irect.com/science/article/pii/S1364661322000456 . · DOI
  6. Yejin Bang, Nayeon Lee, Tiezheng Yu, Leila Khalatbari, Yan Xu, Dan Su, Elham J. Barezi, Andrea Madotto, Hayden Kee, and Pascale Fung. Aisocrates: Towards answering ethical quandary questions, 2022. URL https://arxiv.org/abs/2205.05989 . · arXiv
  7. Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency , FAccT '21, pp. 610-623, New York, NY, USA, 2021. Association for Computing Machinery. ISBN 9781450383097. doi: 10.1145/34 42188.3445922. URL https://doi.org/10.1145/3442188.3445922 . · DOI · Paper page
  8. Ruha Benjamin. Race After Technology: Abolitionist Tools for the New Jim Code . John Wiley & Sons, 2019.
  9. Fiona Berreby, Gauvain Bourgne, and Jean-Gabriel Ganascia. Modelling moral reasoning and ethical responsibility with logic programming. In Logic for programming, artificial intelligence, and reasoning , pp. 532-548. Springer, 2015.
  10. Chandra Bhagavatula, Ronan Le Bras, Chaitanya Malaviya, Keisuke Sakaguchi, Ari Holtzman, Hannah Rashkin, Doug Downey, Wen tau Yih, and Yejin Choi. Abductive commonsense reasoning. In International Conference on Learning Representations , 2020. URL https: //openreview.net/forum?id=Byg1v1HKDB .
  11. Christina Bicchieri. Norms in the Wild, How to Diagnose, Measure and Change Social Norms . Oxford University Press, 2016.
  12. Yochanan E. Bigman and Kurt Gray. People are averse to machines making moral decisions. Cognition , 181:21-34, 2018. ISSN 0010-0277. doi: https://doi.org/10.1016/j.cognition.2018.08.003. URL https://www.sciencedirect.com/science/article/pii/S001002771 8302087 . · DOI · Paper page
  13. Yonatan Bisk, Rowan Zellers, Ronan Le Bras, Jianfeng Gao, and Yejin Choi. Piqa: Reasoning about physical commonsense in natural language. In Thirty-Fourth AAAI Conference on Artificial Intelligence , 2020.
  14. Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. Language (technology) is power: A critical survey of 'bias' in NLP. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , pp. 5454-5476, Online, July 2020. Association for Computational Linguistics. doi: 10.18653/v1/2020.acl-main.485. URL https://aclantho logy.org/2020.acl-main.485 . · DOI · Paper page
  15. Richard Boyd. Finite beings, finite goods: The semantics, metaphysics and ethics of naturalist consequentialism, part i. Philosophy and Phenomenological Research , 66(3):505-553, 2003. doi: 10.1111/j.1933-1592.2003.tb00278.x. · DOI
  16. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. Language models are few-shot learners. In H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin (eds.), Advances in Neural Information Processing Systems , volume 33, pp. 1877-1901. Curran Associates, Inc., 2020. URL https://proceedings. neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Pape r.pdf .
  17. Nicholas J. Bryan, Gautham J. Mysore, and Ge Wang. Isse: An interactive source separation editor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , CHI '14, pp. 257-266, New York, NY, USA, 2014. Association for Computing Machinery. ISBN 9781450324731. doi: 10.1145/2556288.2557253. URL https://doi.org/10.1145/25 56288.2557253 . · DOI
  18. Boxi Cao, Hongyu Lin, Xianpei Han, Fangchao Liu, and Le Sun. Can prompt probe pretrained language models? understanding the invisible risks from a causal view. In ACL , March 2022. URL http://arxiv.org/abs/2203.12258 . · arXiv
  19. Dallas Card and Noah A. Smith. On consequentialism and fairness. Frontiers in Artificial Intelligence , 3:34, 2020. ISSN 2624-8212. doi: 10.3389/frai.2020.00034. URL https: //www.frontiersin.org/article/10.3389/frai.2020.00034 . · DOI
  20. Tuhin Chakrabarty, Yejin Choi, and Vered Shwartz. It's not rocket science : Interpreting figurative language in narratives. TACL , 2022.
  21. Mark Coeckelbergh. AI Ethics . The MIT Press, 2020.
  22. Florian Cova, Brent Strickland, Angela Gaia Felicita Abatista, Aurélien Allard, James Andow, Mario Attie, James R. Beebe, Renatas Berni¯ unas, Jordane Boudesseul, Matteo Colombo, Fiery Andrews Cushman, Rodrigo Díaz, Noah N'Djaye Nikolai van Dongen, Vilius Dranseika, Brian D. Earp, Antonio Gaitán Torres, Ivar Rodríguez Hannikainen, José V. Hernández-Conde, Wenjia Hu, François Jaquet, Kareem Khalifa, Hannah Kim, Markus Kneer, Joshua Knobe, Miklos Kurthy, Anthony Lantian, Shen-yi Liao, Edouard Machery, Tania Moerenhout, Christian Mott, Mark Phelan, Jonathan Scott Phillips, Navin Rambharose, Kevin Reuter, Felipe Romero, Paulo Sousa, Jan Sprenger, Emile Thalabard, Kevin Patrick Tobia, Hugo Viciana, Daniel A. Wilkenfeld, and Xiang Zhou. Estimating the reproducibility of experimental philosophy. Review of Philosophy and Psychology , 12:9-44, 2018.
  23. Kate Crawford. Atlas of AI . Yale University Press, March 2021. URL https://www.degruy ter.com/document/doi/10.12987/9780300252392/html . · DOI
  24. Norman Daniels. Wide reflective equilibrium and theory acceptance in ethics. The Journal of Philosophy , 76(5):256-282, 1979. ISSN 0022362X. URL http://www.jstor.org/stab le/2025881 .
  25. Lucas Dixon, John Li, Jeffrey Sorensen, Nithum Thain, and Lucy Vasserman. Measuring and mitigating unintended bias in text classification. In Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society , AIES '18, pp. 67-73, New York, NY, USA, December 2018. Association for Computing Machinery.
  26. Jesse Dodge, Maarten Sap, Ana Marasovi´ c, William Agnew, Gabriel Ilharco, Dirk Groeneveld, Margaret Mitchell, and Matt Gardner. Documenting large webtext corpora: A case study on the colossal clean crawled corpus. In EMNLP , 2021.
  27. Serena Does, Belle Derks, and Naomi Ellemers. Thou shalt not discriminate: How emphasizing moral ideals rather than obligations increases whites' support for social equality. Journal of Experimental Social Psychology , 47(3):562-571, 2011.
  28. Mai ElSherief, Caleb Ziems, David Muchlinski, Vaishnavi Anupindi, Jordyn Seybolt, Munmun De Choudhury, and Diyi Yang. Latent hatred: A benchmark for understanding implicit hate speech. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , pp. 345-363, Online and Punta Cana, Dominican Republic, November 2021. Association for Computational Linguistics. doi: 10.18653/v1/2021.emnlp-main.29. URL https://aclanthology.org/2021.emnlp-main.29 . · DOI
  29. Denis Emelin, Ronan Le Bras, Jena D. Hwang, Maxwell Forbes, and Yejin Choi. Moral stories: Situated reasoning about norms, intents, actions, and their consequences. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , pp. 698-718, Online and Punta Cana, Dominican Republic, November 2021. Association for Computational Linguistics. doi: 10.18653/v1/2021.emnlp-main.54. URL https://aclanthology.org/2021. emnlp-main.54 . · DOI
  30. Oren Etzioni. Point: Should ai technology be regulated? yes, and here's how. Commun. ACM , 61(12):30-32, November 2018. ISSN 0001-0782. doi: 10.1145/3197382. URL https: //doi.org/10.1145/3197382 . · DOI
  31. Maxwell Forbes, Jena D Hwang, Vered Shwartz, Maarten Sap, and Yejin Choi. Social chemistry 101: Learning to reason about social and moral norms. In EMNLP , 2020. URL https://ww w.aclweb.org/anthology/2020.emnlp-main.48 .
  32. Sam Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi, and Noah A Smith. Realtoxicityprompts: Evaluating neural toxic degeneration in language models. In Findings of EMNLP , 2020. URL https://www.aclweb.org/anthology/2020.findings-emnlp.301 / .
  33. Barbara J. Grosz and Candace L. Sidner. Attention, intentions, and the structure of discourse. Comput. Linguist. , 12(3):175-204, jul 1986. ISSN 0891-2017.
  34. John Haugeland. Artificial Intelligence: The Very Idea . Cambridge: MIT Press, 1985.
  35. Marc Hauser, Fiery Cushman, Liane Young, J. I. N. Kang-Xing, and John Mikhail. A dissociation between moral judgments and justifications. Mind and Language , 22(1):1-21, 2007. doi: 10.111 1/j.1468-0017.2006.00297.x.
  36. Dan Hendrycks, Collin Burns, Steven Basart, Andrew Critch, Jerry Li, Dawn Song, and Jacob Steinhardt. Aligning AI with shared human values. In International Conference on Learning Representations , 2021a. URL https://openreview.net/forum?id=dNy\_RKzJacY .
  37. Dan Hendrycks, Mantas Mazeika, Andy Zou, Sahil Patel, Christine Zhu, Jesus Navarro, Dawn Song, Bo Li, and Jacob Steinhardt. What would jiminy cricket do? towards agents that behave morally. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2) , 2021b. URL https://openreview.net/forum?id=G1muTb5zuO7 .
  38. Lifu Huang, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi. Cosmos qa: Machine reading comprehension with contextual commonsense reasoning. In EMNLP/IJCNLP , 2019.
  39. Jialun Aaron Jiang, Morgan Klaus Scheuerman, Casey Fiesler, and Jed R Brubaker. Understanding international perceptions of the severity of harmful content online. PloS one , 16(8), 2021a.
  40. Liwei Jiang, Jena D Hwang, Chandra Bhagavatula, Ronan Le Bras, Maxwell Forbes, Jon Borchardt, Jenny Liang, Oren Etzioni, Maarten Sap, and Yejin Choi. Delphi: Towards machine ethics and norms. arXiv preprint arXiv:2110.07574 , 2021b. · arXiv
  41. Immanuel Kant. Groundwork for the Metaphysics of Morals . Yale University Press, 1785/2002.
  42. Hyunwoo Kim, Youngjae Yu, Liwei Jiang, Ximing Lu, Daniel Khashabi, Gunhee Kim, Yejin Choi, and Maarten Sap. Prosocialdialog: A prosocial backbone for conversational agents, 2022. URL https://arxiv.org/abs/2205.12688 . · arXiv
  43. Richard Kim, Max Kleiman-Weiner, Andres Abeliuk, Edmond Awad, Sohan Dsouza, Joshua Tenenbaum, and Iyad Rahwan. A computational model of commonsense moral decision making. pp. 197-203, 12 2018. doi: 10.1145/3278721.3278770. · DOI
  44. Christine M. Korsgaard. The Sources of Normativity . Cambridge University Press, 1996.
  45. Kobi Leins, Jey Han Lau, and Timothy Baldwin. Give me convenience and give her death: Who should decide what uses of NLP are appropriate, and on what basis? In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , pp. 2908-2913, Online, July 2020. Association for Computational Linguistics. doi: 10.18653/v1/2020.acl-main.261. URL https://aclanthology.org/2020.acl-main.261 . · DOI
  46. S. Matthew Liao. Ethics of Artificial Intelligence . Oxford University Press, 2020.
  47. Nicholas Lourie, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi. Unicorn on rainbow: A universal commonsense reasoning model on a new multitask benchmark. In AAAI , 2021a.
  48. Nicholas Lourie, Ronan Le Bras, and Yejin Choi. Scruples: A corpus of community ethical judgments on 32, 000 real-life anecdotes. In AAAI , 2021b.
  49. Li Lucy and David Bamman. Gender and representation bias in gpt-3 generated stories. In Proceedings of the Third Workshop on Narrative Understanding , pp. 48-55, 2021.
  50. John Leslie Mackie. Ethics: Inventing Right and Wrong . Penguin Books, 1977.
  51. Nikolay Malkin, Sameera Lanka, Pranav Goel, Sudha Rao, and Nebojsa Jojic. GPT perdetry test: Generating new meanings for new words. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies . Association for Computational Linguistics, 2021. URL https://aclanthology.org /2021.naacl-main.439 .
  52. John Mikhail. Universal moral grammar: theory, evidence and the future. Trends in Cognitive Sciences , 11(4):143-152, 2007. ISSN 1364-6613. doi: https://doi.org/10.1016/j.tics.2006.12.007. URL https://www.sciencedirect.com/science/article/pii/S136466130 7000496 . · DOI
  53. Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. Model cards for model reporting. In Proceedings of the conference on fairness, accountability, and transparency , pp. 220-229, 2019.
  54. James Moor. The nature, importance, and difficulty of machine ethics. IEEE Intelligent Systems , 21:18-21, 08 2006. doi: 10.1109/MIS.2006.80. · DOI
  55. Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, and James F. Allen. A corpus and evaluation framework for deeper understanding of commonsense stories. CoRR , abs/1604.01696, 2016. URL http: //arxiv.org/abs/1604.01696 . · arXiv
  56. Thomas Nagel. The View From Nowhere . Oxford University Press, 1986.
  57. Tuan Dung Nguyen, Georgiana Lyall, Alasdair Tran, Minjeong Shin, Nicholas George Carroll, Colin Klein, and Lexing Xie. Mapping topics in 100,000 real-life moral dilemmas. Proceedings of the International AAAI Conference on Web and Social Media , 16(1):699-710, May 2022. URL https://ojs.aaai.org/index.php/ICWSM/article/view/19327 .
  58. Derek Parfit. On What Matters: Volume One . Oxford Scholarship Online, 2011.
  59. Gonçalo Pereira, Rui Prada, and Pedro A. Santos. Integrating social power into the decision-making of cognitive agents. Artificial Intelligence , 241:1-44, 2016. ISSN 0004-3702. doi: https://doi.or g/10.1016/j.artint.2016.08.003. URL https://www.sciencedirect.com/science/ article/pii/S0004370216300868 . · DOI
  60. Luís Moniz Pereira and Ari Saptawijaya. Modelling morality with prospective logic. In Portuguese Conference on Artificial Intelligence , pp. 99-111. Springer, 2007.
  61. Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. Exploring the limits of transfer learning with a unified text-totext transformer. Journal of Machine Learning Research , 21(140):1-67, 2020. URL http: //jmlr.org/papers/v21/20-074.html .
  62. John Rawls. Outline of a decision procedure for ethics. Philosophical Review , 60(2):177-197, 1951. doi: 10.2307/2181696. · DOI
  63. John Rawls. A Theory of Justice . Belknap Press of Harvard University Press, Cambridge, Massachussets, 1 edition, 1971. ISBN 0-674-88014-5.
  64. Francesca Rossi. Building trust in artificial intelligence. Journal of International Affairs , 72(1): 127-134, 2018. ISSN 0022197X. URL https://www.jstor.org/stable/26588348 .
  65. Rachel Rudinger, Vered Shwartz, Jena D Hwang, Chandra Bhagavatula, Maxwell Forbes, Ronan Le Bras, Noah A Smith, and Yejin Choi. Thinking like a skeptic: Defeasible inference in natural language. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings , pp. 4661-4675, 2020.
  66. Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi. Winogrande: An adversarial winograd schema challenge at scale. In AAAI , 2020.
  67. Maarten Sap, Hannah Rashkin, Derek Chen, Ronan Le Bras, and Yejin Choi. Social iqa: Commonsense reasoning about social interactions. In EMNLP 2019 , 2019.
  68. Maarten Sap, Saadia Gabriel, Lianhui Qin, Dan Jurafsky, Noah A Smith, and Yejin Choi. Social bias frames: Reasoning about social and power implications of language. In ACL , 2020. URL https://www.aclweb.org/anthology/2020.acl-main.486 .
  69. Maarten Sap, Swabha Swayamdipta, Laura Vianna, Xuhui Zhou, Yejin Choi, and Noah A. Smith. Annotators with attitudes: How annotator beliefs and identities bias toxic language detection. In NAACL , 2022. URL https://arxiv.org/abs/2111.07997 . · arXiv
  70. Timo Schick and Hinrich Schütze. It's not just size that matters: Small language models are also few-shot learners. arXiv preprint arXiv:2009.07118 , 2020. · arXiv
  71. Eric Schwitzgebel and Mara Garza. Designing ai with rights, consciousness, self-respect, and freedom. In Ethics of Artificial Intelligence , pp. 459-479. 2020.
  72. Emily Sheng, Kai-Wei Chang, Prem Natarajan, and Nanyun Peng. The woman worked as a babysitter: On biases in language generation. In EMNLP , pp. 3407-3412, 2019.
  73. Sharon Street. Coming to terms with contingency : Humean constructivism about practical reason. In Jimmy Lenman and Yonatan Shemmer (eds.), Constructivism in Practical Philosophy . Oxford University Press, 2012.
  74. Zeerak Talat, Hagen Blix, Josef Valvoda, Maya Indira Ganesh, Ryan Cotterell, and Adina Williams. A word on machine ethics: A response to jiang et al. (2021). ArXiv , abs/2111.04158, 2021. · arXiv
  75. Alon Talmor, Ori Yoran, Ronan Le Bras, Chandra Bhagavatula, Yoav Goldberg, Yejin Choi, and Jonathan Berant. CommonsenseQA 2.0: Exposing the limits of AI through gamification. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 1) , 2021. URL https://openreview.net/forum?id=qF7FlUT5dxa .
  76. Mark Ungar. State violence and lesbian, gay, bisexual and transgender (lgbt) rights. New Political Science , 22(1):61-75, 2000.
  77. Bertie Vidgen, Tristan Thrush, Zeerak Waseem, and Douwe Kiela. Learning from the worst: Dynamically generated datasets to improve online hate detection. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) , pp. 1667-1682, Online, August 2021. Association for Computational Linguistics. doi: 10.18653/v1/2021.acl-long.132. URL https://aclanthology.org/2021.acl-long.132 . · DOI · Paper page
  78. Wendell Wallach and Colin Allen. Moral Machines: Teaching Machines Right from Wrong . Oxford University Press, 2010.
  79. Daniel Weld and Oren Etzioni. The first law of robotics (a call to arms). In Proceedings of the Twelfth AAAI National Conference on Artificial Intelligence , AAAI'94, pp. 1042-1047. AAAI Press, 1994.
  80. Thomas Wischmeyer and Timo Rademacher (eds.). Regulating Artificial Intelligence . Springer, Cham, 2020. URL https://link.springer.com/book/10.1007/978-3-030-3 2361-5 . · DOI
  81. David B. Wong. Natural Moralities:A Defense of Pluralistic Relativism: A Defense of Pluralistic Relativism . Oxford University Press, 2006.
  82. Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi. Hellaswag: Can a machine really finish your sentence? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics , 2019.
  83. Rowan Zellers, Ari Holtzman, Elizabeth Clark, Lianhui Qin, Ali Farhadi, and Yejin Choi. TuringAdvice: A generative and dynamic evaluation of language use. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , pp. 4856-4880, Online, June 2021. Association for Computational Linguistics. doi: 10.18653/v1/2021.naacl-main.386. URL https://aclanthology.org/2 021.naacl-main.386 . · DOI
  84. Eviatar Zerubavel. The marked and the unmarked. In Taken for Granted: The Remarkable Power of the Unremarkable . Princeton University Press, 2018. URL http://assets.press.princ eton.edu/chapters/s11226.pdf .
  85. Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, and Luke Zettlemoyer. Opt: Open pre-trained transformer language models, 2022. URL https://arxiv.org/ab s/2205.01068 .
  86. Jieyu Zhao, Daniel Khashabi, Tushar Khot, Ashish Sabharwal, and Kai-Wei Chang. Ethical-advice taker: Do language models understand natural language interventions? In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 , pp. 4158-4164, Online, August 2021a. Association for Computational Linguistics. doi: 10.18653/v1/2021.findings-acl.364. URL https://aclanthology.org/2021.findings-acl.364 . · DOI
  87. Karen Zhou, Ana Smith, and Lillian Lee. Assessing cognitive linguistic influences in the assignment of blame. In Proceedings of the Ninth International Workshop on Natural Language Processing for Social Media , pp. 61-69, Online, June 2021. Association for Computational Linguistics. doi: 10.18653/v1/2021.socialnlp-1.5. URL https://aclanthology.org/2021.socialnl p-1.5 . · DOI

Cited by

Sorted by citations

Authors
Slavkovik, M.
Affiliations
University of Bergen (NO)
Corresponding author
Slavkovik, Marija
ORCID
Slavkovik, Marija
Venue
Schloss Dagstuhl – Leibniz-Zentrum für Informatik
Publisher
Schloss Dagstuhl – Leibniz-Zentrum für Informatik
Published
2022
DOI
10.4230/oasics.aib.2022.6
OpenAlex
W7223741709
Cited by
5
References
0
Citations by year
2026: 1 · 2025: 2 · 2024: 1 · 2022: 1
FWCI
1.16
Type
journal article
Language
en
Open access
Licence
Locations
  • DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) (submittedVersion, cc-by)
  • OASIcs : OpenAccess Series in Informatics (cc-by)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Social Sciences › Decision Sciences › Information Systems and Management › Ethics in Business and Education
  • Social Sciences › Arts and Humanities › Philosophy › Philosophical Ethics and Theory
Keywords
machine ethics, moral reasoning, AI ethics, computational agents

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review