CoChat

Limits and Possibilities for “Ethical AI” in Open Source: A Study of Deepfakes

Open access
Widder, David Gray, Nafus, Dawn, Dabbish, Laura, Herbsleb, James · 2022 · 2022 ACM Conference on Fairness Accountability and Transparency
Cited by 60

The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.

Abstract

Open source software communities are a significant site of AI development, but “Ethical AI” discourses largely focus on the problems that arise in software produced by private companies. Design, policy and tooling interventions to encourage “Ethical AI” based on studies in private companies risk being ill-suited for an open source context, which operates under radically different organizational structures, cultural norms, and incentives.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3531146.3533779

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 15 references

Research works printed but not linked: 62

  1. 2010. The 82nd Academy Awards (2010) Nominees and Winners. http://www.oscars.org/awards/academyawards/legacy/ceremony/82nd-winners.html/. The Academy of Motion Picture Arts and Sciences (2010). Accessed: 2022-004-25.
  2. 2019. Google Will Not Renew Pentagon Contract That Upset Employees. https://deon.drivendata.org. DrivenData (2019). Accessed: 2021-07-7.
  3. Henry Ajder, Giorgio Patrini, Francesco Cavalli, and Laurence Cullen. 2019. The state of deepfakes: Landscape, threats, and impact. Amsterdam: Deeptrace(2019).
  4. 10.1109/MSP.2015.72 · DOI
  5. Shaosong Ou Alexander Hars. 2002. Working for free? Motivations for participating in open-source projects. International journal of electronic commerce 6, 3 (2002), 25–39.
  6. 10.1145/3306618.3314243 · DOI · Paper page
  7. Mike Ananny and Kate Crawford. 2018. Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability. new media & society 20, 3 (2018), 973–989.
  8. Hannah Arendt. 1987. Collective responsibility. In Amor mundi. Springer, 43–50.
  9. Edmond Awad, Sohan Dsouza, Richard Kim, Jonathan Schulz, Joseph Henrich, Azim Shariff, Jean-François Bonnefon, and Iyad Rahwan. 2018. The moral machine experiment. Nature 563, 7729 (2018), 59–64.
  10. Justin B Biddle. 2020. On predicting recidivism: epistemic risk tradeoffs and values in machine learning. Canadian Journal of Philosophy(2020) 1–21.
  11. Nick Bostrom. 2017. Strategic implications of openness in AI development. Global policy 8, 2 (2017), 135–148.
  12. Marcus Burkhardt. 2019. Mapping the Democratization of AI on GitHub. A First Approach. (2019). · doi:10.1515/9783839447192-013
  13. 10.1145/3376898 · DOI · Paper page
  14. E Gabriella Coleman. 2012. Coding freedom: The ethics and aesthetics of hacking. Princeton University Press.
  15. 10.1145/3290607.3299057 · DOI
  16. Henriette Cramer, Jenn Wortman Vaughan, Ken Holstein, Hanna Wallach, Jean Garcia-Gathright, Hal Daumé III, Miroslav Dudík, and Sravana Reddy. 2019. Challenges of incorporating algorithmic fairness into industry practice. FAT* Tutorial (2019).
  17. 10.17705/1thci.00133 · DOI
  18. Jean Macchiaroli Eggen and John G Culhane. 2002. Gun Torts: Defining a cause of action for victims in suits against gun manufacturers. NCL Rev. 81(2002), 115.
  19. 10.2307/2024543 · DOI · Paper page
  20. R Stuart Geiger. 2017. Summary analysis of the 2017 github open source survey. arXiv preprint arXiv:1706.02777(2017). · DOI
  21. Frances S Grodzinsky, Keith Miller, and Marty J Wolf. 2003. Ethical issues in open source software. Journal of Information, Communication and Ethics in Society (2003).
  22. Guido Hertel, Sven Niedner, and Stefanie Herrmann. 2003. Motivation of software developers in Open Source projects: an Internet-based survey of contributors to the Linux kernel. Research policy 32, 7 (2003), 1159–1177.
  23. Bill Hibbard. 2008. Open source AI. Frontiers in Artificial Intelligence and Applications 171 (2008), 473.
  24. 10.1016/j.dss.2012.02.005 · DOI
  25. Don Ihde. 1990. Technology and the lifeworld: From garden to earth. (1990). · DOI · Paper page
  26. 10.1177/0049124114523396 · DOI · Paper page
  27. Jiji. 2020. The RIAA is coming for the YouTube downloaders. https://www.japantimes.co.jp/news/2020/10/02/national/crime-legal/two-men-arrested-deepfake-pornography-videos/. The Japan Times (2 Oct. 2020). Accessed: 2021-07-1.
  28. 10.1145/3290607.3310433 · DOI · Paper page
  29. Jan Kietzmann, Linda W Lee, Ian P McCarthy, and Tim C Kietzmann. 2020. Deepfakes: Trick or treat?Business Horizons 63, 2 (2020), 135–146.
  30. Bruno Latour Wiebe E Bijker and John Law. 1992. Shaping technology/building society: Studies in sociotechnical change. W. Bijker & J. Law (Eds.)(1992) 225–258.
  31. Yvonna S Lincoln, Susan A Lynham, and Egon G Guba. 2011. Paradigmatic controversies, contradictions, and emerging confluences, revisited. The Sage handbook of qualitative research 4 (2011), 97–128.
  32. Zachary C Lipton. 2018. The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery.Queue 16, 3 (2018), 31–57.
  33. 10.1145/2441776.2441794 · DOI
  34. 10.1353/sor.2019.0022 · DOI · Paper page
  35. Lewis Mumford. 1970. The pentagon of power. Vol. 2. Houghton Mifflin Harcourt P.
  36. Robin Murphy and David D Woods. 2009. Beyond Asimov: the three laws of responsible robotics. IEEE intelligent systems 24, 4 (2009), 14–20.
  37. Helen Nissenbaum. 2017. Computing and accountability. In Computer Ethics. Routledge, 273–280.
  38. Wonseok Oh and Sangyong Jeon. 2007. Membership herding and network stability in the open source community: The Ising perspective. Management science 53, 7 (2007), 1086–1101.
  39. Marc Ohm, Henrik Plate, Arnold Sykosch, and Michael Meier. 2020. Backstabber’s Knife Collection: A Review of Open Source Software Supply Chain Attacks. In International Conference on Detection of Intrusions and Malware, and Vulnerability Assessment. Springer, 23–43.
  40. 10.1080/1369118X.2020.1713842 · DOI · Paper page
  41. Arnold Pacey. 1983. The culture of technology. MIT press.
  42. Bruce Perens. 2005. The emerging economic paradigm of open source. First Monday (2005).
  43. 10.5555/2817915.2817918 · doi:10.5555/2817915.2817918
  44. Cynthia Rudin Caroline Wang and Beau Coker. 2018. The age of secrecy and unfairness in recidivism prediction. arXiv preprint arXiv:1811.00731(2018). · arXiv
  45. 10.1891/0886-6708.8.4.339 · DOI
  46. 10.2307/222715 · doi:10.2307/222715
  47. Richard Stallman. 2016. Why programs must not limit the freedom to run them. https://www.gnu.org/philosophy/free-sw.en.html. The Free Software Foundation (18 Nov. 2016). Accessed: 2021-07-1.
  48. Richard Stallman 2021. What is free software?, The Free Software Definition, Version 1.169. https://www.gnu.org/philosophy/free-sw.en.html. The Free Software Foundation (2 Feb. 2021). Accessed: 2021-07-1.
  49. Luke Stark, Daniel Greene, and Anna Lauren Hoffmann. 2021. Critical Perspectives on Governance Mechanisms for AI/ML Systems. In The Cultural Life of Machine Learning. Springer, 257–280.
  50. 10.1089/cpb.2006.9.552 · DOI
  51. Anselm Strauss and Juliet M Corbin. 1997. Grounded theory in practice. Sage.
  52. M Tiemann and Open Source Initiative. 2009. History of the OSI (Open Source Initiative). Retrieved February 4(2009), 2009.
  53. Marcus Tomalin Bill Byrne Shauna Concannon Danielle Saunders and Stefanie Ullmann. 2021. The practical ethics of bias reduction in machine translation: Why domain adaptation is better than data debiasing. Ethics and Information Technology(2021) 1–15. · DOI
  54. Joachim Van den Bergh and Dirk Deschoolmeester. 2010. Ethical decision making in ICT: discussing the impact of an ethical code of conduct. Communications of the IBIMA(2010) 1–10. · DOI · Paper page
  55. 10.1145/2328909.2328916 · DOI
  56. Robert S Weiss. 1995. Learning from strangers: The art and method of qualitative interview studies. Simon and Schuster.
  57. 10.1145/3488666 · DOI · Paper page
  58. 10.1080/23268743.2019.1642794 · DOI · Paper page
  59. 10.1145/563517.563464 · doi:10.1145/563517.563464
  60. Marty J Wolf, Keith W Miller, and Frances S Grodzinsky. 2019. On the Responsibility for Uses of Downstream Software. Computer Ethics-Philosophical Enquiry (CEPE) Proceedings 2019, 1(2019), 3.
  61. Robert K Yin. 2017. Case study research and applications: Design and methods. Sage publications.
  62. 10.1145/3338906.3338918 · DOI

Cited by

See all 60

Metadata

Authors
Widder, D. G., Nafus, D., Dabbish, L., & Herbsleb, J.
Venue
2022 ACM Conference on Fairness Accountability and Transparency
Publisher
ACM
Published
2022-06-20
Pages
2035-2046
OpenAlex
W4283172171
Cited by
60
References
15
FWCI
12.33
Type
conference paper
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Limits and Possibilities for “Ethical AI” in Open Source: A Study of Deepfakes. https://app.cochat.ai/papers/10.1145/3531146.3533779
The paper
Widder, D. G., Nafus, D., Dabbish, L., & Herbsleb, J. (2022). Limits and Possibilities for “Ethical AI” in Open Source: A Study of Deepfakes. 2022 ACM Conference on Fairness Accountability and Transparency. https://doi.org/10.1145/3531146.3533779

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.