Get out of the BAG! Silos in AI Ethics Education: Unsupervised Topic Modeling Analysis of Global AI Curricula
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
The domain of Artificial Intelligence (AI) ethics is not new, with discussions going back at least 40 years. Teaching the principles and requirements of ethical AI to students is considered an essential part of this domain, with an increasing number of technical AI courses taught at several higher-education institutions around the globe including content related to ethics. By using Latent Dirichlet Allocation (LDA), a generative probabilistic topic model, this study uncovers topics in teaching ethics in AI courses and their trends related to where the courses are taught, by whom, and at what level of cognitive complexity and specificity according to Bloom’s taxonomy. In this exploratory study based on unsupervised machine learning, we analyzed a total of 166 courses: 116 from North American universities, 11 from Asia, 36 from Europe, and 10 from other regions. Based on this analysis, we were able to synthesize a model of teaching approaches, which we call BAG (Build, Assess, and Govern), that combines specific cognitive levels, course content topics, and disciplines affiliated with the department(s) in charge of the course. We critically assess the implications of this teaching paradigm and provide suggestions about how to move away from these practices. We challenge teaching practitioners and program coordinators to reflect on their usual procedures so that they may expand their methodology beyond the confines of stereotypical thought and traditional biases regarding what disciplines should teach and how. This article appears in the AI & Society track.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A revision of bloom's taxonomy: an overview
Krathwohl, D. R. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4104_2 · Cited by 8,132
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774
Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297 · cited 2×
“…modelling approaches have been helpful in investigating the key ideas within a set of documents, such as articles published in academic journals (e.g., marine sciences journals Syed, Borit, & Spruit, 2018), political texts (Grimmer & Stewart, 2013), or data-driven journalism (Rusch et al., 2013).”
BackgroundThe role of artificial intelligence in achieving the Sustainable Development Goals
Vinuesa, R., Azizpour, H., Leite, I., Balaam, M., Dignum, V., Domisch, S., Felländer, A., Langhans, S. D., Tegmark, M., & Fuso Nerini, F. (2020) · Nature Communications · doi:10.1038/s41467-019-14108-y · Cited by 3,294
Self-citationChecklists for improving rigour in qualitative research: a case of the tail wagging the dog?
Barbour, R. S. (2001) · BMJ · doi:10.1136/bmj.322.7294.1115 · Cited by 2,613 · cited 1×
“Following the practices established in qualitative studies (Barbour, 2001) and in LDA analysis (Baden et al., 2020), we attempted to mitigate this risk by relying on two independent researchers for establishing labels and making inferences.”
MethodCombining satellite imagery and machine learning to predict poverty
Jean, N., Burke, M., Xie, M., Davis, W. M., Lobell, D. B., & Ermon, S. (2016) · Science · doi:10.1126/science.aaf7894 · Cited by 1,664
Vision, challenges, roles and research issues of Artificial Intelligence in Education
Hwang, G.-J., Xie, H., Wah, B. W., & Gašević, D. (2020) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2020.100001 · Cited by 1,435 · cited 1×
“Many of these studies discuss more general aspects of AI ethics education (e.g., Hwang et al., 2020; Lin et al., 2021; Yang et al., 2021), while many others explore effective ways to teach the desired topics and skills (e.g., the use of science fiction Burton, Goldsmith, & Mattei, 2018 or design…”
BackgroundDecolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence
Mohamed, S., Png, M.-T., & Isaac, W. (2020) · Philosophy & Technology · doi:10.1007/s13347-020-00405-8 · Cited by 912 · cited 1×
“…or distributed systems, Abad, Ortiz-Holguin, & Boza, 2021); 2) having a limited geographical coverage and, as explained in Hughes et al. (2020), Mohamed et al. (2020), being biased towards Western cultures (e.g., Moller & Crick, 2018; Fiesler et al., 2020; Garrett et al., 2020; Raji et al.,…”
BackgroundSuperintelligence: Paths, Dangers, Strategies
Mulgan, T. (2015) · The Philosophical Quarterly · doi:10.1093/pq/pqv034 · Cited by 878
Human-centered Artificial Intelligence in education: Seeing the invisible through the visible
Yang, S. J. H., Ogata, H., Matsui, T., & Chen, N.-S. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100008 · Cited by 379 · cited 1×
“Many of these studies discuss more general aspects of AI ethics education (e.g., Hwang et al., 2020; Lin et al., 2021; Yang et al., 2021), while many others explore effective ways to teach the desired topics and skills (e.g., the use of science fiction Burton, Goldsmith, & Mattei, 2018 or design…”
BackgroundText mining for information systems researchers: An annotated topic modeling tutorial
University of Liechtenstein, Debortoli, S., Müller, O., IT University of Copenhagen, Junglas, I., Florida State University, vom Brocke, J., & University of Liechtenstein (2016) · Communications of the Association for Information Systems · doi:10.17705/1cais.03907 · Cited by 199 · cited 1×
“…the previous approaches and expand the understanding of the situation, this study pursues a novel strategy for the field of AI ethics education and leverages an automated data-driven approach based on topic modelling (Debortoli et al., 2016) to uncover hidden topics within AI ethics courses.”
BackgroundWhat Do CS1 Syllabi Reveal About Our Expectations of Introductory Programming Students?
Becker, B. A., & Fitzpatrick, T. (2019) · Proceedings of the 50th ACM Technical Symposium on Computer Science Education · doi:10.1145/3287324.3287485 · Cited by 63 · cited 1×
“…Mohamed et al. (2020), being biased towards Western cultures (e.g., Moller & Crick, 2018; Fiesler et al., 2020; Garrett et al., 2020; Raji et al., 2021; Homkes & Strikwerda, 2009); or 3) including courses taught at only one single level (e.g., introductory level, Becker & Fitzpatrick, 2019).”
BackgroundWhy Teaching Ethics to AI Practitioners Is Important
Goldsmith, J., & Burton, E. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11139 · Cited by 60 · cited 1×
“…ethics into teaching AI to tech professionals and to include in the curricula of future AI practitioners specific training that ranges from raising ethical awareness to developing concrete skills for the implementation of ethical guidelines (Nielsen, 1972; Goldsmith & Burton, 2017; Dignum, 2021).”
Backgroundvan Berkel, N., Papachristos, E., Giachanou, A., Hosio, S., & Skov, M. B. (2020) · Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society · doi:10.1145/3419249.3420106 · Cited by 51 · cited 1×
“In the domain of AI/Computer Science (CS), topic modelling has been used to identify salient topics discussed in national AI policies (van Berkel et al., 2020), topics prevalent in Internet news related to the fourth industrial revolution (Jang, Park, & Kim, 2018), or topics of research on AI in…”
MethodA framework for implementing and teaching the social and ethical impact of computing
Martin, C. D., Huff, C., Gotterbarn, D., & Miller, K. (1996) · Education and Information Technologies · doi:10.1007/bf00168276 · Cited by 15 · cited 1×
“While academics have been studying the topics of teaching AI and AI ethics for more than half a century (e.g., Chand, 1974; Gehman, 1984; Martin et al., 1996; Applin, 2006; Ahmad, 2014), the systematic assessment of the topics, developments, and trends in teaching AI ethics is a relatively recent…”
Background
Cited by
Bahroun, Z., Anane, C., Ahmed, V., & Zacca, A. (2023) · Sustainability · doi:10.3390/su151712983 · Cited by 784
Memarian, B., & Doleck, T. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100152 · Cited by 416
Ethical issues of the use of AI-driven mobile apps for education
Klimova, B., Pikhart, M., & Kacetl, J. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2022.1118116 · Cited by 173
The rise of artificial intelligence for cognitive behavioral therapy: A bibliometric overview
Vanhée, L., Andersson, G., Garcia, D., & Sikström, S. (2025) · Applied Psychology Health and Well-Being · doi:10.1111/aphw.70033 · Cited by 14
Metadata
- Authors
- Javed, R. T., Nasir, O., Borit, M., Vanhee, L., Zea, E., Gupta, S., Vinuesa, R., & Qadir, J.
- Venue
- Journal of Artificial Intelligence Research
- Publisher
- AI Access Foundation
- Published
- 2022-03-26
- Volume
- 73
- Pages
- 933-965
- ISSN
- 1076-9757 (ISSN-L)
- OpenAlex
- W4225289236
- Cited by
- 42
- References
- 15
- FWCI
- 9.95
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.