The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Integrating Ethics within Machine Learning Courses
Abstract
This article establishes and addresses opportunities for ethics integration into Machine-learning (ML) courses. Following a survey of the history of computing ethics and the current need for ethical consideration within ML, we consider the current state of ML ethics education via an exploratory analysis of course syllabi in computing programs. The results reveal that though ethics is part of the overall educational landscape in these programs, it is not frequently a part of core technical ML courses. To help address this gap, we offer a preliminary framework, developed via a systematic literature review, of relevant ethics questions that should be addressed within an ML project. A pilot study with 85 students confirms that this framework helped them identify and articulate key ethical considerations within their ML projects. Building from this work, we also provide three example ML course modules that bring ethical thinking directly into learning core ML content. Collectively, this research demonstrates: (1) the need for ethics to be taught as integrated within ML coursework, (2) a structured set of questions useful for identifying and addressing potential issues within an ML project, and (3) novel course models that provide examples for how to practically teach ML ethics without sacrificing core course content. An additional by-product of this research is the collection and integration of recent publications in the emerging field of ML ethics education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567 · cited 6×
“In other words, it should be clear who will be accountable for the harm that could be done by the use of this technology [62].”
BackgroundInfluentialLearning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159 · cited 2×
“For example, ML systems have shown the capability of inheriting racial [1, 19] and gender [3, 27] biases.”
BackgroundResultMan is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615 · cited 1×
“For example, ML systems have shown the capability of inheriting racial [1, 19] and gender [3, 27] biases.”
BackgroundThe role of data privacy in marketing
Martin, K. D., & Murphy, P. E. (2017) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-016-0495-4 · Cited by 902 · cited 2×
“An individual’s right to choose which of their activities and facts are shared with others is an important consideration for ML and data science teams [56].”
BackgroundDiscrimination in online ad delivery
Sweeney, L. (2013) · Communications of the ACM · doi:10.1145/2447976.2447990 · Cited by 783 · cited 1×
“Therefore, since ML is a new field, many norms and regulations may not yet have been explored or defined [60, 86].”
BackgroundZwitter, A. (2014) · Big Data & Society · doi:10.1177/2053951714559253 · Cited by 465
Zarsky, T. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915605575 · Cited by 422
Conscientious Classification: A Data Scientist's Guide to Discrimination-Aware Classification
d'Alessandro, B., O'Neil, C., & LaGatta, T. (2017) · Big Data · doi:10.1089/big.2016.0048 · Cited by 195
Diversity in Big Data: A Review
Drosou, M., Jagadish, H. V., Pitoura, E., & Stoyanovich, J. (2017) · Big Data · doi:10.1089/big.2016.0054 · Cited by 140
Cited by
“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI
Sambasivan, N., Kapania, S., Highfill, H., Akrong, D., Paritosh, P., & Aroyo, L. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445518 · Cited by 781
Fairness in machine learning: A survey
Caton, S., & Haas, C. (2024) · ACM Computing Surveys · doi:10.1145/3616865 · Cited by 646
Ethical Dilemmas and Privacy Issues in Emerging Technologies: A Review
Dhirani, L. L., Mukhtiar, N., Chowdhry, B. S., & Newe, T. (2023) · Sensors · doi:10.3390/s23031151 · Cited by 320
What Do We Teach When We Teach Tech Ethics?: A Syllabi Analysis
Fiesler, C., Garrett, N., & Beard, N. (2020) · Proceedings of the 51st ACM Technical Symposium on Computer Science Education · doi:10.1145/3328778.3366825 · Cited by 269
Self-citationFairness in Machine Learning: A Survey
Caton, S., & Haas, C. (2020) · arXiv · doi:10.48550/arxiv.2010.04053 · Cited by 646
Exploration on Integrating Accessibility into an AI Course
Tseng, C.-E., Jung, S. H., Elglaly, Y. N., Liu, Y., & Ludi, S. (2022) · Proceedings of the 53rd ACM Technical Symposium on Computer Science Education · doi:10.1145/3478431.3499399 · Cited by 42
Dangol, A., Newman, M., Wolfe, R., Lee, J. H., Kientz, J. A., Yip, J., & Pitt, C. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661515 · Cited by 42
“AI literacy encompasses an understanding of AI concepts, practices and perspectives that enable learners to critically evaluate and utilize AI technologies [19, 57] while fostering considerations for AI ethics [57, 73, 84, 90].”
Searching for the Non-Consequential: Dialectical Activities in HCI and the Limits of Computers
Zhang, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641945 · Cited by 12
Guidelines for Practicing Responsible Innovation in HPC: A Sociotechnical Approach
Raybourn, E. M., & Muollo, K. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-34668-2_8 · Cited by 1
Principles to Practices for Responsible AI: Closing the Gap
Schiff, D., Rakova, B., Ayesh, A., Fanti, A., & Lennon, M. (2020) · arXiv · doi:10.48550/arxiv.2006.04707
Metadata
- Authors
- Saltz, J., Skirpan, M., Fiesler, C., Gorelick, M., Yeh, T., Heckman, R., Dewar, N., & Beard, N.
- Venue
- ACM Transactions on Computing Education
- Published
- 2019-08-02
- Volume
- 19
- Issue
- 4
- Pages
- 1-26
- ISSN
- 1946-6226 (ISSN-L)
- OpenAlex
- W2964583491
- Cited by
- 180
- References
- 10
- FWCI
- 26.03
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.