AI for the Common Good?! Pitfalls, challenges, and ethics pen-testing
Open accessThe DOI matches its Crossref record; 51 of the 52 references it cites were found in a registry or an index; 10 of the 56 sources its claims cite were checked for support.
Abstract
Recently, many AI researchers and practitioners have embarked on research visions that involve doing AI for “Good”. One frequent theme in current ethical guidelines is the requirement that AI be good for all, or contribute to the common good. The paper proposes ethics pen-testing as a method for making impediments visible and attenuating them.
Overview
CoChat Summary
## TL;DR
The paper argues that “AI for the Common Good” is impeded by four recurring issues: how problems are framed, who defines them, how knowledge is treated, and how side effects and dynamics are handled. It proposes “ethics pen-testing” as an adversarial design method to surface these weaknesses and improve AI systems.
## Key findings
- The author’s exploratory survey covered 99 contributions across four venues: 24 from Data Science for Social Good 2017, 4 from SoGood 2017, 15 from the 2017 AAAI Spring Symposium on AI for Social Good, and 56 from the 2nd AI for Good Global Summit.
- In the surveyed material, the vast majority of contributions used one social goal and one computational goal; there was generally no attempt at alternative framings of the social problem, and the difference between problem versions (Q1') was not the topic of any paper.
- For stakeholder involvement, the large majority of contributions took the problem definition from a non-academic project partner; only one contribution described an explicit multistakeholder process, and another mentioned such a process followed by partners.
- On dynamics, only one contribution in the sample included an explicit consideration of possible future dynamics; the author says the other Q1–Q4 considerations are not an integral part of current operational research practices in AI/DS for Social Good.
- The paper reports that in the first three venues, 8 out of 43 contributions covered SDG #3 (Good Health and Well-being); 5 could be linked to SDG #11 (Sustainable Cities and Communities), and 2 to transportation. In the AI for Good Global Summit, 11 contributions covered SDG #3, and one track had 13 contributions on Smart Cities and another had 6 on AI and Satellite Imagery.
## Methods
- Conceptual/normative argument: the paper draws on AI ethics codes, political philosophy, and computer-science ideas to derive four lead questions about Common Good-oriented AI.
- Exploratory document survey: it reads and assesses all hyperlinked contributions from four recent AI/DS-for-good venues, coding whether they explicitly addressed the four questions.
- The survey examined content and whether contributions contained explicit information relating to Q1–Q4; the author notes the coding was exploratory and simple.
## Limitations
- The paper says the conference survey was exploratory, the coding exercise was simple, and future work will use a codebook and more coders.
- The author notes that the findings may be an artifact of publication conventions that favor unambiguity and a linear research story, and that many surveyed documents were very short; this may have hidden alternatives and process details.
- As an evident limitation from the text: the survey covers only selected conference materials from four venues, so it is not a comprehensive study of AI for the Common Good.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
8 Valid · 9 Not valid · 31 Not checked · 90 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“and it will commit countermeasures against such biased decisions to one formalization of 'fairness', which may mean that other notions of fairness are violated [40, 41].”
What the sources say
- Supportedcites [40] [40] A. Chouldechova, Fair prediction with disparate impact: A study of bias in recidivism prediction instruments, Big Data, 2017, 5(2), 153-16310.1089/big.2016.004728632438 source
Section 2.1 (p. 2) states that when recidivism prevalence differs between groups, a test-fair score cannot also have equal false-positive and false-negative rates. The Discussion (p. 4) adds that balancing error rates will generally produce assessments that are not free from predictive bias. These passages support the claimed trade-off between formalizations of fairness. (LLM, conf=0.92)
- Not matchedcites [41] [41] J. Kleinberg, S. Mullainathan, M. Raghavan, Inherent trade-offs in the fair determination of risk scores, In: Proceedings of the 8th Conference on Innovations in Theoretical Computer Science (ITCS), 201710.1145/3219617.3219634
Its entry has no title and year that we can search by.
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“This can lead to police deciding to patrol where there have been many drugrelated arrests in the past, rather than where there has been much drug usage”
What the sources say
- Could not verifycites [40] [40] A. Chouldechova, Fair prediction with disparate impact: A study of bias in recidivism prediction instruments, Big Data, 2017, 5(2), 153-16310.1089/big.2016.004728632438 sourceExperimental — accuracy not yet measured
The Introduction (p. 1) and Assessing impact (p. 3) discuss recidivism risk assessments used in decisions about defendants, including bail, parole, and sentencing. Searches for drug-related arrests, drug usage, predictive policing, and patrol decisions found no passage addressing the claimed choice of patrol locations. (LLM, conf=0.76)
- Not matchedcites [41] [41] J. Kleinberg, S. Mullainathan, M. Raghavan, Inherent trade-offs in the fair determination of risk scores, In: Proceedings of the 8th Conference on Innovations in Theoretical Computer Science (ITCS), 201710.1145/3219617.3219634
Its entry has no title and year that we can search by.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“as shown by an exploratory study of 99 contributions to recent conferences in the field.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the call to develop and deploy AI for the Common Good has, to the best of my knowledge, not yet led to research programs or publications under that name.”
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The large majority of contributions took their problem definition from the non-academic project partner, which was usually also the data provider (for example, a city council, a health agency, or a transportation agency).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
28 more claims
Create a free account to see all 138 claims and to verify the 16 references still open.
- It may state two separate claims as one. 41
- Probably not a substantial claim. 93
- The quote only partly states this claim. 1
Citations
Cites
boyd, D., & Crawford, K. (2012) · Information, Communication & Society · doi:10.1080/1369118x.2012.678878 · Cited by 5,479 · cited 1×
“225], see [2] for the use of provocations to encourage reflection on big data.”
BackgroundThe Open Society and Its Enemies
Popper, K. (2012) · Routledge eBooks · doi:10.4324/9780203439913 · Cited by 3,505
Exposure to ideologically diverse news and opinion on Facebook
Bakshy, E., Messing, S., & Adamic, L. A. (2015) · Science · doi:10.1126/science.aaa1160 · Cited by 3,245 · cited 1×
“Social media have recently been described as intensifying the echo-chamber effects that media often have anyway, e.g. [46, 47, 48].”
BackgroundBarocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Private traits and attributes are predictable from digital records of human behavior
Kosinski, M., Stillwell, D., & Graepel, T. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1218772110 · Cited by 2,829 · cited 1×
“This is a lesson learned from the history of the Cambridge Analytica case, in which ideas from an academic project in which social media were mined to predict personality [60] were later supposedly used for psychometrically micro-targeted election advertising [61].”
MethodFair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
The age of responsibilization: on market-embedded morality
Shamir, R. (2008) · Economy and Society · doi:10.1080/03085140701760833 · Cited by 1,025
Inherent trade-offs in the fair determination of risk scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2017) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.itcs.2017.43 · Cited by 943
Inherent Trade-Offs in the Fair Determination of Risk Scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016) · arXiv · doi:10.48550/arxiv.1609.05807 · Cited by 941
To save everything, click here: the folly of technological solutionism
(2013) · Choice Reviews Online · doi:10.5860/choice.51-0324 · Cited by 879
Knowledge discovery and data mining: towards a unifying framework
Fayyad, U. M., Piatetsky-Shapiro, G., & Smyth, P. (1996) · Cited by 846
Wallach, W., & Allen, C. (2009) · Oxford University Press · doi:10.1093/acprof:oso/9780195374049.001.0001 · Cited by 711 · cited 1×
“s to whether these goals and behaviors stem from the humans designing, manufacturing, or using the robot, or from the robot itself. Thus, the quesAIfortheCommonGood?! 8 tion of whether machine ethics [25, 26, 27] as a third type of ethics, the ethics of a robot (or in fact any AI system), exists and if so, what its pr…”
BackgroundNetwork analysis reveals open forums and echo chambers in social media discussions of climate change
Williams, H. T. P., McMurray, J. R., Kurz, T., & Hugo Lambert, F. (2015) · Global Environmental Change · doi:10.1016/j.gloenvcha.2015.03.006 · Cited by 631
Lum, K., & Isaac, W. (2016) · Significance · doi:10.1111/j.1740-9713.2016.00960.x · Cited by 611 · cited 2×
“law, law enforcement and healthcare are not, or not in their entirety, AI-based. AI is used to address parts of the problems, as when predictive policing softwarerecommends where to patrol for drugs [39]. The AI models underlying such software need well-defined and accessible data and well-defined objective functions wh…”
BackgroundEcho Chambers: Emotional Contagion and Group Polarization on Facebook
Del Vicario, M., Vivaldo, G., Bessi, A., Zollo, F., Scala, A., Caldarelli, G., & Quattrociocchi, W. (2016) · Scientific Reports · doi:10.1038/srep37825 · Cited by 576 · cited 1×
“ial in relaying, reinforcing and maintaining frames [45], creating “echo chambers”. Social media have recently been described as intensifying the echochamber effects that media often have anyway, e.g. [46, 47, 48]. This is where AI enters: recommender systems (the backbone of modern social media platforms’ approach to…”
BackgroundFive Procedure and Substance in Deliberative Democracy
Cohen, J. (1996) · Democracy and Difference · doi:10.1515/9780691234168-006 · Cited by 544
Diversity in recommender systems – A survey
Kunaver, M., & Požrl, T. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.02.009 · Cited by 504
Woodson, T. (2018) · Journal of Responsible Innovation · doi:10.1080/23299460.2018.1495027 · Cited by 501
Data Science: A Comprehensive Overview
Cao, L. (2018) · ACM Computing Surveys · doi:10.1145/3076253 · Cited by 407 · cited 1×
“mains and other contextual aspects, such as organizational and social aspects) in order to transform data to insights and decisions by following a datato-knowledge-to-wisdom thinking and methodology” [19]. Conway [20], in a frequently cited online source, described data science by means of a Venn diagram: with regard…”
MethodNEWS FRAMING THEORY AND RESEARCH
(2009) · Media Effects · doi:10.4324/9780203877111-8 · Cited by 291 · cited 1×
“of a problem (and its associated “solutions”) has a powerful effect on how people – and thus the public as those who may benefit, or be harmed by an AI system – perceive the world and act in it, e.g., [42]. Frames can themselves be objects of knowledge, that is, statements can be made about them and discussed. For examp…”
BackgroundProcedure and Substance in Deliberative Democracy
Cohen, J. (1997) · Deliberative Democracy · doi:10.7551/mitpress/2324.003.0017 · Cited by 255 · cited 1×
“, that citizens recognize each other as equal and use only reasons that can be accepted by all others [11]) and legal constructs that enable and require a country’s political bodies to protect the political order against thosewhowant to abolish them, such as constitutional clauses that cannot be abolished even by a ma…”
BackgroundBird, S. M., McAuley, A., Perry, S., & Hunter, C. (2016) · Addiction · doi:10.1111/add.13265 · Cited by 248 · cited 2×
“bedded in socio-technical systems differently and differ in their abilities to perceive and voice their values and norms. As an example, consider imprisoned drug users as one of the relevant groups in [31]. Further problems arise when affected communities and individuals are outside the boundaries of the society deemed…”
BackgroundMethodData Science: A Comprehensive Overview
Cao, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03606 · Cited by 210 · cited 1×
“mains and other contextual aspects, such as organizational and social aspects) in order to transform data to insights and decisions by following a datato-knowledge-to-wisdom thinking and methodology” [19]. Conway [20], in a frequently cited online source, described data science by means of a Venn diagram: with regard…”
MethodMilitant Democracy: The Institutional Bases of Democratic Self-Preservation
Capoccia, G. (2013) · Annual Review of Law and Social Science · doi:10.1146/annurev-lawsocsci-102612-134020 · Cited by 202
Integrating robot ethics and machine morality: the study and design of moral competence in robots
Malle, B. F. (2016) · Ethics and Information Technology · doi:10.1007/s10676-015-9367-8 · Cited by 200
Group Privacy: New Challenges of Data Technologies
(2017) · Springer eBooks · doi:10.1007/978-3-319-46608-8 · Cited by 193
What Should We Want From a Robot Ethic?
Asaro, P. M. (2006) · The International Review of Information Ethics · doi:10.29173/irie134 · Cited by 164
Routledge International Handbook of Ignorance Studies
Groß, M., & McGoey, L. (2022) · Routledge eBooks · doi:10.4324/9781003100607 · Cited by 145
Inherent Trade-Offs in Algorithmic Fairness
Kleinberg, J. (2018) · Abstracts of the 2018 ACM International Conference on Measurement and Modeling of Computer Systems · doi:10.1145/3219617.3219634 · Cited by 125
Rethinking constructive technology assessment as democratic, reflective, discourse
Genus, A. (2006) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2005.06.009 · Cited by 102 · cited 2×
“For example, methods for constructive technology assessment (CTA) [87] involve multi-perspective criticism and (friendly) “at-tacks”.”
MethodInterventions over Predictions: Reframing the Ethical Debate for Actuarial Risk Assessment
Barabas, C., Dinakar, K., Ito, J., Virza, M., & Zittrain, J. (2017) · arXiv · doi:10.48550/arxiv.1712.08238 · Cited by 87
Safety in Numbers? Group Privacy and Big Data Analytics in the Developing World
Taylor, L. (2016) · Springer eBooks · doi:10.1007/978-3-319-46608-8_2 · Cited by 85
(2018) · Cited by 78
The ethics of big data as a public good: which public? Whose good?
Taylor, L. (2016) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2016.0126 · Cited by 70
Choice Architecture for Human-Computer Interaction
Jameson, A., Berendt, B., Gabrielli, S., Cena, F., Gena, C., Vernero, F., & Reinecke, K. (2014) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000028 · Cited by 64
Self-citationRequirements Engineering: Best Practice
Fricker, S. A., Grau, R., & Zwingli, A. (2015) · Requirements Engineering for Digital Health · doi:10.1007/978-3-319-09798-5_2 · Cited by 61 · cited 1×
“ther the Common Good is to hear the voices of multiple and diverse people who will be affected by the system. The integration of multiple stakeholders in requirements engineering (for an overview, see [28]) are therefore increasingly required by ethics codes as well as laws. Codes such as the ACM Code of Conduct [3]17,…”
BackgroundSocial issues in requirements engineering
Goguen, J. A. (2002) · [1993] Proceedings of the IEEE International Symposium on Requirements Engineering · doi:10.1109/isre.1993.324858 · Cited by 61
Choice Architecture for Human-Computer Interaction
Jameson, A. (2013) · now publishers, Inc. eBooks · doi:10.1561/9781601987976 · Cited by 43
Formalization in program development
Naur, P. (1982) · BIT · doi:10.1007/bf01934408 · Cited by 43 · cited 1×
“Ex post, the ambivalence that existed in the beginning tends to be cognitively minimized and the result is taken to be the truth (even if it did result from decisions that might just as well have been made otherwise), cf. [34].”
BackgroundExploring provocation as a research method in the social sciences
Pangrazio, L. (2017) · International Journal of Social Research Methodology · doi:10.1080/13645579.2016.1161346 · Cited by 42 · cited 1×
“…be used as provocations : inter-ruptions of the flow of everyday practices designed to “initiate critical reflection [...] on issues that are often otherwise overlooked, obscured or accepted as naturalised practice” [1, p. 225], see [2] for the use of provocations to encourage reflection on big data.”
BackgroundBerendt, B., & Preibusch, S. (2017) · Big Data · doi:10.1089/big.2016.0055 · Cited by 32 · cited 1×
“In general, since the deployment of bigdata analyses will itself create data that then become input to further data analyses, this can easily create viciouscycle phenomena that have been observed by sociologists for long, dynamics that can perpetuate or even aggravate bias and discrimination [64].”
BackgroundSelf-citationSocial Networks Mining for Analysis and Modeling Drugs Usage
Yakushev, A., & Mityagin, S. (2014) · Procedia Computer Science · doi:10.1016/j.procs.2014.05.230 · Cited by 20 · cited 1×
“data protection issues that could well outweigh any positive benefits. As an example, consider social network mining, which is currently a popular method also for studying drug usage, see for example [59]. In the event of a data leak27, such social network mining methods could be used to derive inferences about individ…”
MethodVeruggio, G. (2010) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2010.936959 · Cited by 19
Self-reflection on privacy research in social networking sites
De Wolf, R., Vanderhoven, E., Berendt, B., Pierson, J., & Schellens, T. (2017) · Behaviour & Information Technology · doi:10.1080/0144929x.2016.1242653 · Cited by 13 · cited 3×
“More interaction with this field could benefit future AI and data studies [13].”
BackgroundSelf-citationSchiffner, S., Berendt, B., Siil, T., Degeling, M., Riemann, R., Schaub, F., Wuyts, K., Attoresi, M., Gürses, S., Klabunde, A., et al. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-02547-2_2 · Cited by 11 · cited 1×
“as a general design principle learned from the discussions around the GDPR, which, to protect the rights and freedoms of individuals affected by (data processing) technology, requires technology and organizational designers to design based on the state of the art (see [85] for a discussion of the challenge of translat…”
BackgroundSelf-citation"Tool Clinics" - Embracing Multiple Perspectives in Privacy Research and Privacy-Sensitive Design
Morton, A., Berendt, B., Gürses, S. F., & Pierson, J. (2013) · UCL Discovery (University College London) · Cited by 9
Self-citationPatel, N. A., & Elkin, G. D. (2015) · The AMA Journal of Ethic · doi:10.1001/journalofethics.2015.17.10.nlit1-1510 · Cited by 8 · cited 1×
“[90] 27 “Multiple judgments are possible, and ambiguity and uncertainty”
BackgroundDetermining the Common Good: A (Re-)Constructive Critique of the Proceduralist Paradigm
Blum, C. (2016) · Phenomenology and Mind · doi:10.13128/phe_mi-19616 · Cited by 3 · cited 1×
“) Finally, the questions of what the boundaries of the relevant society (or: political community and itsmembers) are, and of whether to take a welfare consequentialist or other standpoint, andwhether and how to account for collective above individual interests [8], tend to receive less attention than others in “for Go…”
BackgroundFood for Thought: Analyzing Public Opinion on the Supplemental Nutrition Assistance ProgramPreprint
Chappelka, M., Oh, J., Scott, D., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.02443 · Cited by 3 · cited 1×
“A further contribution mentions that the project partner intends to use the developed tool for a number of specified purposes [81].”
BackgroundSocietal Challenges Need Social Agents.
Dignum, V., & Dignum, F. P. M. (2017) · National Conference on Artificial Intelligence · Cited by 3
Control hipotalámico de las interacciones neuroendocrinas
Lizarbe, B., & Cerdán, S. (2013) · DIGITAL.CSIC (Spanish National Research Council (CSIC)) · doi:10.13039/501100003329 · Cited by 1
Research works printed but not linked: 18
- [3] ACM (1992). ACM Code of Ethics and Professional Conduct. https://www.acm. org/about-acm/acm-code-of-ethics-andprofessional-conduct -
- [5] IEEE (2016). Ethically Aligned Design. A Vision for Prioritizing Human Wellbeing with Artificial Intelligence and Autonomous Systems. Version 1 for public discussion. http://standards.ieee. org/develop/indconn/ec/ead\_v1.pdf -
- [16] B. Mols, AI For the Common Good. ACM News, Jun. 20, 2017 https://cacm.acm.org/news/ 218696-ai-for-the-common-good/fulltext -
- [17] A. Tanweer, B. Fiore-Gartland, Cross-sector collaboration in Data Science for Social Good: Opportunities, challenges, and open questions raised by working with academic researchers. In: Data Science for Social Good Conference 2017, Sep. 28-29, 2017, Chicago, IL http://dssg.uchicago.edu/wp-content/ uploads/2017/09/tanweer.pdf -
- [22] S. J. Russell, P. Norvig, Artificial Intelligence: A Modern Approach (Prentice Hall , Englewood Cliffs, NJ, 1995) -
- [49] T. T. Nguyen, P.-M. Hui, F. M. Harper, L. Terveen, J. A. Konstan, J. A., Exploring the filter bubble: The effect of using recommender systems on content diversity, In: Proceedings of International World Wide Web Conference Committee (WWW’14), ACM, New York, 201410.1145/2566486.2568012 · DOI · Paper page
- [57] G. Rockwell, B. Berendt, Information wants to be free, or does it? The ethics of datafication, Electronic Book Review, 2017, http://electronicbookreview.com/thread/technocapitalism/datafiction
- [67] R. Gavaldà, I. Koprinska, S. Kramer (Eds.), Proceedings of the Second Workshop on Data Science for Social Good co-located with European Conference on Machine Learning and Principles and Practice of Knowledge Dicovery in Databases (ECML-PKDD 2017), Skopje, Macedonia, Sep. 18, 2017, CEUR Workshop Proceedings Vol-1960, http://ceur-ws.org/Vol-1960/
- [68] E. Horvitz, B. Grosz, A. Greenwald, D. Parkes, C. Gomes, S. Smith, et al. (Eds.), Artificial Intelligence for the Social Good, Papers from the 2017 AAAI Spring Symposium, Technical Report SS-17-01, AAAI, Palo Alto, CA, 2017, https://www.aaai.org/Library/Symposia/Spring/ss17-01.php
- [69] J. Garriga, J. Piera, F. Bartumeus, A Bayesian framework for reputation in citizen science, In: Proceedings of the Second Workshop on Data Science for Social Good, CEUR Workshop Proceedings, 2017, 1960, 1-18, http://ceur-ws.org/Vol-1960/paper6.pdf
- [71] J. Auerbach, H. Barton, T. Blunt, V. Chaganti, B. Ghai, A. Meng, et al., Using data science as a community advocacy tool to promote equity in urban renewal programs: An analysis of Atlanta’s Anti-Displacement Tax Fund, In: Data Science for Social Good Conference 2017, Sep. 28-29, 2017, Chicago, IL, http://dssg.uchicago.edu/wp-content/uploads/2017/09/auerbach.pdf
- [73] M. Prasad, Back to the future: A framework for modelling altruistic intelligence explosions, In: AAAI 2017 Spring Symposium on Artificial Intelligence for the Social Good, https://aaai.org/ocs/index.php/SSS/SSS17/paper/view/15326
- [74] Y.-H. Wang, Y.-Y. Chen, S.-C. Chen, C.-K. Liu, T. C. Hsieh, Data for Social Good: A case study of building an effective public-private partnership on domestic violence prevention, In: Data Science for Social Good Conference 2017, Sep. 28- 29, 2017, Chicago, IL, http://dssg.uchicago.edu/wp-content/uploads/2017/09/hsieh.pdf
- [75] A. Delaunay, J. Guérin, Wandering detection within an embedded system for Alzheimer suffering patients, In: AAAI 2017 Spring Symposium on Artificial Intelligence for the Social Good, https://aaai.org/ocs/index.php/SSS/SSS17/paper/view/15317
- [76] O. Bendel, LADYBIRD: The animal-friendly robot vacuum cleaner, In: AAAI 2017 Spring Symposium on Artificial Intelligence for the Social Good, https://aaai.org/ocs/index.php/SSS/SSS17/paper/view/15277
- [77] P. Baumgartner, Challenges in assessing predictive bias, In: Data Science for Social Good Conference 2017, Sep. 28- 29, 2017, Chicago, IL, http://dssg.uchicago.edu/wp-content/uploads/2017/09/baumgartner.pdf
- [82] C.-K. Liu, T. C. Hsieh, Lessons learned from using data science to empower change agents across data silos, In: Data Science for Social Good Conference 2017, Sep. 28-29, 2017, Chicago, IL, https://dssg.uchicago.edu/wp-content/uploads/2017/09/liu.pdf
- [84] H. Holmestad, Predicting risk of long-term unemployment, In: Data Science for Social Good Conference 2017, Sep. 28-29, 2017, Chicago, IL, https://dssg.uchicago.edu/wp-content/uploads/2017/09/holmestad.pdf
Cited by
Del Río Castro, G., González Fernández, M. C., & Uruburu Colsa, Á. (2021) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.122204 · Cited by 569
The future of AI and education: Some cautionary notes
Selwyn, N. (2022) · European Journal of Education · doi:10.1111/ejed.12532 · Cited by 401
Tackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336
“[5, 6]), ML for the developing world [7], and the computational sustainability”
BackgroundStahl, B. C. (2021) · SpringerBriefs in Research and Innovation Governance · doi:10.1007/978-3-030-69978-9 · Cited by 317
Ryan, M., & Stahl, B. C. (2021) · Journal of Information, Communication and Ethics in Society · doi:10.1108/jices-12-2019-0138 · Cited by 310
“As a starting point we used the ethical principles that are used by the EU ’ s HLEG (2019) as high-level coding points.”
BackgroundMethodInfluential
Metadata
- Authors
- Berendt, B.
- Affiliations
- KU Leuven (BE)
- Corresponding author
- Berendt, Bettina
- ORCID
- Berendt, Bettina
- Venue
- Paladyn, Journal of Behavioral Robotics
- Publisher
- Walter de Gruyter GmbH
- Published
- 2019-01-01
- Volume
- 10
- Issue
- 1
- Pages
- 44-65
- ISSN
- 2080-9778 (ISSN-L)
- 2081-4836
- OpenAlex
- W2898730196
- Cited by
- 8
- References
- 52
- Citations by year
- 2026: 1 · 2025: 1 · 2023: 3 · 2021: 1 · 2020: 2
- FWCI
- 1.31
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Paladyn Journal of Behavioral Robotics (publishedVersion, cc-by)
- Lirias (acceptedVersion, other-oa)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Innovation, Technology, and Society
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- AI ethics, AI for social good, problem formulation, role of knowledge, AI design, moral norms
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.