The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index; 3 of the 21 sources its claims cite were checked for support.
The Moral Machine experiment
Open accessAbstract
With the rapid development of artificial intelligence have come concerns about how machines will make moral decisions, and the major challenge of quantifying societal expectations about the ethical principles that should guide machine behaviour. To address this challenge, we deployed the Moral Machine, an online experimental platform designed to explore the moral dilemmas faced by autonomous vehicles. This platform gathered 40 million decisions in ten languages from millions of people in 233 countries and territories. Here we describe the results of this experiment. First, we summarize global moral preferences. Second, we document individual variations in preferences, based on respondents' demographics. Third, we report cross-cultural ethical variation, and uncover three major clusters of countries. Fourth, we show that these differences correlate with modern institutions and deep cultural traits. We discuss how these preferences can contribute to developing global, socially acceptable principles for machine ethics. All data used in this article are publicly available.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
The Moral Machine used a multilingual online game to gather millions of judgments about unavoidable autonomous-vehicle crash dilemmas, revealing strong global preferences for sparing humans, more lives, and younger lives. It also found demographic variation that did not reverse preferences, three broad cultural clusters, and country-level correlations with cultural and economic indicators.
Key findings
- The platform collected 39.61 million decisions from 233 countries and territories; the abstract describes roughly 40 million decisions from over 2.3 million people in ten languages.
- Worldwide, the strongest preferences were for sparing humans over animals, sparing more characters, and sparing younger characters; weaker preferences included sparing women and sparing pedestrians.
- Among 492,921 respondents who completed the optional demographic survey, individual characteristics such as age, gender, income, education, politics, and religion did not change the direction of any preference, with effects all below 0.1.
- Country-level clustering identified three groups—Western, Eastern, and Southern—and preferences correlated with individualism/collectivism, GDP per capita, rule of law, economic inequality, and gender gaps in health and survival.
Methods
- The Moral Machine was an online “serious game” launched in June 2016 and later translated into nine additional languages; users chose between two outcomes in unavoidable accident scenarios.
- In Judge mode, sessions contained 13 dilemmas generated around nine factors: species, number of lives, age, gender, physical fitness, social status, pedestrian legality, passenger versus pedestrian status, and whether the car swerves.
- Analyses used conjoint analysis to estimate average marginal component effects, hierarchical clustering of 130 countries with at least 100 respondents, and country-level correlations with socio-economic and cultural indicators.
Limitations
- The paper states that the sample was self-selected and not guaranteed to be representative, so policymakers should not treat the results as the final word on societal preferences.
- The paper states that scenarios assumed certainty about character classification and life-and-death outcomes, did not manipulate respondent-character relationships, and captured preferences before autonomous vehicles are deployed.
- Evident from the text: the findings are based on hypothetical choices from an internet-connected, tech-interested population, and the cross-sectional design cannot establish causal mechanisms behind country-level correlations.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
38 Own result · 16 Own interpretation · 7 Own method · 7 No basis given · 6 No full text of the sources · 5 Sources not found · 3 Not checked yet · 2 Partly supported · 1 Supported · accuracy not yet measured
Every source the paper cites for this claim was checked and supports it.
In the paper
“Our previous work did not find a strong impact of this variable on moral preferences 12”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > DISCUSSION
What the sources say
- Supportedcites [12] Bonnefon, J.-F., Shariff, A. & Rahwan, I. The social dilemma of autonomous vehicles. Science 352, 1573–1576 (2016). source
The Figure 3 caption (p. 11) says the moral preference was robust when respondents imagined riding with a coworker, family member, or their own child. Study 3 (p. 4) found that imagining a family member significantly lowered the morality rating, but it remained above the scale midpoint; thus the relationship affected ratings without overturning the preference. (LLM, conf=0.87)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These codes seldom recognize, though, that humans experience inner conflict, interpersonal disagreements, and cultural dissimilarities in the moral domain 31 , 32 , 33 .”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > DISCUSSION
What the sources say
- Not checked — no full text of the sourcecites [31] Gastil, J., Braman, D., Kahan, D. & Slovic, P. The cultural orientation of mass political opinion. PS Polit. Sci. Polit. 44, 711–714 (2011). source
- Partly supportedcites [32] Nishi, A., Christakis, N. A. & Rand, D. G. Cooperation, decision time, and culture: online experiments with American and Indian participants. PLoS ONE 12, e0171252 (2017). sourceExperimental — accuracy not yet measured
The Introduction describes conflicted choices between cooperation and defection, and the Discussion reports cross-cultural differences in cooperation between American and Indian participants. The paper does not address interpersonal disagreements or whether the codes in the citing sentence recognize these experiences; its findings concern cooperation in economic games rather than the moral domain generally. (LLM, conf=0.85)
- Not matchedcites [33]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“are broadly consistent with both geographical and cultural proximity according to the Inglehart-Welzel Cultural Map 2010-2014 21 .”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > CULTURAL CLUSTERS
What the sources say
- Not checked — no full text of the sourcecites [21] Inglehart, R. & Welzel, C. Modernization, Cultural Change, and Democracy: The Human Development Sequence (Cambridge Univ. Press, Cambridge, 2005).
plaincorrelationaln = 100- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Spain appears in the Western cluster, adjacent to Portugal and other European countries, rather than in the Spanish-speaking Latin American sub-cluster.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > CULTURAL CLUSTERS
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“clusters largely differ in the weight they give to some preferences.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > CULTURAL CLUSTERS
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The same is true about the preference for sparing higher status characters.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > CULTURAL CLUSTERS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we find that individual variations have no sizable impact on any of the nine attributes (all below 0.1; see Figure S6 in SI).”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > INDIVIDUAL VARIATIONS
plainn = 492,921- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“find that demographics do not change the direction of any preference”
- Also stated in: § INDIVIDUAL VARIATIONS · plain
“none of the six characteristics splits its subpopulations into opposing directions of effect”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
plainn = 492,921- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § INDIVIDUAL VARIATIONS · plain
In the paper
“Figure 4c shows a substantial correlation ( ) between this MM distance and the cultural distance from the US based on the World Values .49ρ = 0 Survey 22 .”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > COUNTRY-LEVEL PREDICTORS
What the sources say
- Not checked — no full text of the sourcecites [22] Muthukrishna, M. Beyond WEIRD psychology: measuring and mapping scales of cultural and psychological distance. Preprint at https://ssrn.com/abstract=3259613 (2018). source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
- It may state two separate claims as one. 28
- The quote only partly states this claim. 1
- Probably not a substantial claim. 16
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“participants from countries which are poorer and suffer from weaker institutions are more tolerant of pedestrians who cross illegally, presumably because of their experience of lower rule compliance and weaker punishment of rule deviation 26 .”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > COUNTRY-LEVEL PREDICTORS
What the sources say
- Partly supportedcites [26] Gächter, S. & Schulz, J. F. Intrinsic honesty and the prevalence of rule violations across societies. Nature 531, 496–499 (2016). sourceExperimental — accuracy not yet measured
The paper reports in its main text (labelled Abstract in our copy; page unavailable) that participants from countries with more prevalent rule violations showed less intrinsic honesty, and it suggests that unpunished cheating may make dishonesty seem justifiable. It does not report that participants from poorer countries were more tolerant of pedestrians crossing illegally, or establish weaker punishment as the reason for such tolerance; its experiment measured honesty using a die-rolling task. (LLM, conf=0.83)
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians)”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the preference to spare younger characters rather than older characters is much less pronounced for countries in the Eastern cluster, and much higher for countries in the Southern cluster.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > CULTURAL CLUSTERS
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The third cluster (a broadly Southern cluster) consists of the Latin American countries of Central and South America, in addition to some countries that are characterized in part by French influence”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > CULTURAL CLUSTERS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only the (weak) preference for sparing pedestrians over passengers and the (moderate) preference for sparing the lawful over the unlawful appear to be shared to the same extent in all clusters.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > CULTURAL CLUSTERS
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“both male and female respondents indicated Δ preference for Sparing Females, but the latter group showed stronger preference”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > INDIVIDUAL VARIATIONS
plaincorrelationaln = 492,921- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“male respondents are 0.06 percentage point less inclined to spare females and 0.09 percentage point more inclined to spare humans compared to female respondents”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > INDIVIDUAL VARIATIONS
plaincorrelationaln = 492,921- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The second cluster (which we call the Eastern cluster) contains many far eastern countries such as Japan and Taiwan, belonging to the Confucianist cultural group, and Islamic countries such as Indonesia, Pakistan and Saudi Arabia.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > CULTURAL CLUSTERS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“these differences correlate with modern institutions, but also with deep cultural traits”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the four most spared characters are the baby, the little girl, the little boy, and the pregnant woman”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > GLOBAL PREFERENCES
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“or for that matter, women over men, overweight persons over athletes, or executives over homeless persons--all of which we see weaker but clear effects for.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > GLOBAL PREFERENCES
boostedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories”
- Also stated in: § Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection. · plain
“allowed us to collect 39.61 million decisions in 233 countries, dependencies, or territories”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one. The quote only partly states this claim.
- Also stated in: § Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection. · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the strongest preferences are observed for sparing humans over animals, sparing more lives, and sparing young lives.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > GLOBAL PREFERENCES
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we observe some striking peculiarities, like the strong preference for sparing women and the strong preference for sparing fit characters in the Southern cluster.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > CULTURAL CLUSTERS
boostedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“one increase in standard deviation of religiosity of respondent is associated with 0.09 more inclination to spare humans, 0.08 less inclination to spare the lawful, 0.06 more inclination to spare pedestrians, and 0.06 less inclination to spare the fit.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > INDIVIDUAL VARIATIONS
plaincorrelationaln = 492,921- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Association between the preference for sparing the lawful and each of rule of law and log of GDP per capita (inset).”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > METHODS
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The country from which users access the website, geo-localized through IP address, is a valid proxy for the country-level moral preferences of that country.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Association between individualism and each of the preference for sparing more characters, and the preference for sparing the young (inset).”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > METHODS
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The country from which users access the website, geo-localized through IP address, is a valid proxy for the country-level moral preferences of that country.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The Moral Machine was deployed to initiate such a conversation, and millions of people weighed in from around the world .”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > DISCUSSION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The frequency at which these dilemma will emerge is extremely hard to estimate”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“German Ethical Rule #9 does not take a clear stance on whether and when AVs should be programmed to sacrifice the few to spare the many, but leaves this possibility open”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > GLOBAL PREFERENCES
What the sources say
- Not checked — no full text of the sourcecites [19] Luetge, C. The German Ethics Code for automated and connected driving. Philos. Technol. 30, 547–558 (2017). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“German Ethical Rule #7 unambiguously states that in dilemma situations, the protection of human life should enjoy top priority over the protection of other animal life.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > GLOBAL PREFERENCES
What the sources say
- Not checked — no full text of the sourcecites [19] Luetge, C. The German Ethics Code for automated and connected driving. Philos. Technol. 30, 547–558 (2017). source
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Accordingly, these three preferences may be considered essential building blocks for machine ethics, or at least essential topics to be considered by policymakers.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > GLOBAL PREFERENCES
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The internal structure within this cluster also exhibits notable face validity, with a sub-cluster containing Protestant / Scandinavian countries, and a sub-cluster containing Commonwealth / English-speaking countries.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > CULTURAL CLUSTERS
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
In the paper
“consensus in this matter is going to be important.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
What the sources say
- Not matchedcites [9] Dadich, S. Barack Obama, neural nets, self-driving cars, and the future of the world. Wired https://www.wired.com/2016/10/president-obama-mit-joi-ito-interview/ (2016).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“German Ethical Rule #9 also states that any distinction based on personal features, such as age, should be prohibited.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > GLOBAL PREFERENCES
What the sources say
- Not checked — no full text of the sourcecites [19] Luetge, C. The German Ethics Code for automated and connected driving. Philos. Technol. 30, 547–558 (2017). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
What the sources say
- Not matchedcites [1] Greene, J. Moral Tribes: Emotion, Reason and the Gap Between Us and Them (Atlantic Books, London, 2013).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites [2] Tomasello, M. A Natural History of Human Thinking (Harvard Univ. Press, Cambridge, 2014). source
- Not checked — no full text of the sourcecites [3] Cushman, F. & Young, L. The psychology of dilemmas and the philosophy of morality. Ethical Theory Moral Pract. 12, 9–24 (2009). source
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > Abstract With the rapid development of Artificial Intelligence technology come widespread concerns about how machines will behave in morally charged situations.Addressing these concerns raises the major challenge of quantifying societal expectations about the ethical principles that should guide machine behavior.To address this challenge, we deployed the Moral Machine, an Internet-based experimental platform that is designed to explore the multi-dimensional moral dilemmas faced by autonomous vehicles.This platform enabled us to gather 40 million decisions in ten languages from over 2.3 million people in 233 countries and territories, and thus to assess the paths and obstacles to machine ethics.First, we summarize global moral preferences, some of them strong (e.g., sparing more lives or younger individuals), and some of them weak (e.g., sparing women, sparing pedestrians).Second, we document individual variations of these preferences, based on respondents' demographics (e.g., age, gender, income), and find that demographics do not change the direction of any preference.Third, we report cross-cultural ethical variation, and uncover three major clusters of countries exhibiting substantial differences along key moral preferences about autonomous vehicles.Fourth, we show that these differences correlate with modern institutions, but also with deep cultural traits.We discuss how these three layers of preferences can contribute to developing global, harmonious, and socially acceptable principles for machine ethics.All data used in this article can be accessed and downloaded at https://goo.gl/JXRrBP .We are entering an age in which machines are not only tasked to promote well-being and minimize harm, but also to distribute the well-being they create, and the harm they cannot eliminate.Distributing well-being and harm inevitably creates tradeoffs, whose resolution falls in the moral domain 1 , 2 , 3 .Think of an autonomous vehicle (AV) that is about to crash, and cannot find a trajectory that would save everyone.Should it swerve onto one jaywalking teenager to spare its three elderly passengers?Should it swerve away from a group of children and kill a single adult passenger instead?Even in the more common instances in which harm is not inevitable, but just possible, AVs will need to decide how to divvy up the risk of harm between the different stakeholders on the road.Car manufacturers and policymakers are currently struggling with these moral dilemmas, in large part because they cannot be solved by any simple normative ethical principles like Asimov's laws of robotics 4 . Asimov's laws were not designed to solve the problem of universal machine ethics, and they were not even designed to let machines distribute harm between humans.They were a narrative device whose goal was to generate good stories, by showcasing how challenging it is to create moral machines with a dozen lines of code.And yet, we do not have the luxury to give up on creating moral machines 5 , 6 , 7 , 8 .AVs will cruise our roads soon, necessitating agreement on the principles that should apply when, inevitably, life-threatening dilemmas emerge.The frequency at which these dilemma will emerge is extremely hard to estimate, just as it is extremely hard to estimate the rate at which human drivers find themselves in comparable situations.Human drivers who die in crashes cannot report whether they were faced with a dilemma; and human drivers who survive a crash may not have realized that they were in a dilemma situation.Note though that ethical guidelines for AV choices in dilemma situations do not depend on the frequency of these situations.Whether these cases are rare, very rare, or extremely rare, we need to agree beforehand on how they should be solved. The keyword here is "we".As emphasized by former U.S. president Barack Obama 9 , consensus in this matter is going to be important.Decisions about the ethical principles that will guide AVs cannot be left to solely to either the engineers or the ethicists.For consumers to switch from traditional human-driven cars to AVs, and for the wider public to accept the proliferation of AI-driven vehicles on their roads, both groups will need to understand the origins of the ethical principles programmed into these vehicles 10 .In other words, even if ethicists were to agree on how AVs should solve moral dilemmas, their work would be useless if citizens were to disagree with their solution, and thus opt out of the future that AVs promise in lieu of the status quo.Any attempt to devise AI ethics must be at least cognizant of public morality. Accordingly, we need to gauge social expectations about the way AVs should solve moral dilemmas.This enterprise, however, is not without challenges 11 .The first challenge comes from the high-dimensionality of the problem.In a typical survey, one may test whether people prefer to spare many lives rather than few 9,12 , 13 ; or whether people prefer to spare the young rather than the elderly 14 , 15 ; or whether people prefer to spare pedestrians who cross legally, rather than pedestrians who jaywalk; or yet some other preference, or a simple combination of two or three of these preferences.But combining a dozen of such preferences leads to millions of possible scenarios, requiring a sample size that defies any conventional method of data collection.
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In sum, the individual variations we observe are theoretically important, but not essential information for policymakers.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > INDIVIDUAL VARIATIONS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Attempts at establishing broad ethical codes for intelligent machines, like the Asilomar AI Principle s 30 , often recommend that machine ethics should be aligned with human values.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > DISCUSSION
What the sources say
- Not matchedcites [30] Haidt, J. The Righteous Mind: Why Good People Are Divided by Politics and Religion (Knopf Doubleday, New York, 2012).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“But the fact that broad regions of the world displayed relative agreement suggests that our journey to consensual machine ethics is not doomed from the start.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > DISCUSSION
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“we did not introduce uncertainty about the fates of the characters, and we did not introduce any uncertainty about the classification of these characters.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > DISCUSSION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“our project builds on a long tradition of investigating cultural variations in ethical judgments 29 .”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > DISCUSSION
What the sources say
- Not matchedcites [29] Future of Life Institute. Asilomar AI Principles https://futureoflife.org/ai-principles/ (2017).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“what the Moral Machine captured is the state of moral preferences before AVs are deployed on the road, and before they start facing moral dilemmas.”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > DISCUSSION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“its downside is that our sample is self-selected, and not guaranteed to exactly match the socio-demographics of each country.”
- Also stated in: § DISCUSSION · plain
“But the fact that our samples are not guaranteed to be representative”
§ The Moral Machine Experiment: 40 Million Decisions and the Path to Universal Machine Ethics > DISCUSSION
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Also stated in: § DISCUSSION · plain
The paper relies on this without support.
The 130 countries with at least 100 respondents are representative of their countries' moral preferences.
“We selected the 130 countries with at least 100 respondents (N range = [101 -448,125])”
The paper relies on this without support.
No research ever attempted to measure moral preferences using a 9-dimensional experimental design, in more than 200 countries.
“No research ever attempted to measure moral preferences using a 9-dimensional experimental design, in more than 200 countries.”
The authors state this as an assumption.
In the Moral Machine scenarios, characters were recognized as adults, children, etc. with 100% certainty, and life-and-death outcomes were predicted with 100% certainty.
“In our scenarios, characters were recognized as adults, children, etc. with 100% certainty, and life-and-death outcomes were predicted with 100% certainty.”
“These assumptions are technologically unrealistic, but they were necessary to keep the project tractable.”
The paper relies on this without support.
The country from which users access the website, geo-localized through IP address, is a valid proxy for the country-level moral preferences of that country.
“The country from which users access the website is geo-localized through the IP address of their computer or mobile device.This information is used to compute a vector of moral preferences for each country.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These results by contrast clash with many rules such as the IEEE code of ethics and some of the German ethical rules that clearly prohibit any distinction based on personal features such as age. However, results of the moral machine show that people strongly preferred sparing the young (such as children).”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [153]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“At this level of abstraction meaningful guidance may be impossible.”
From Principles alone cannot guarantee ethical AI (2019) · cites this paper as [44]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The platform gathered the opinion of millions of people from 233 countries with 40 million decisions in ten languages.”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [153]
The cited source says what the claim attributes to it.
In the citing paper
“However, results show broad differences in relative preferences among different countries [153]. However, results show countries within close proximity to one another showed closer moral preferences, with three dominant clusters in the West, East, and South [154].”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [153]
The cited source says what the claim attributes to it.
In the citing paper
“Generally, results of the moral machine show that people prefer sparing humans over animals, sparing more lives, and sparing young lives [153].”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [153]
The cited source says what the claim attributes to it.
In the citing paper
“Previous work has shown that cultural and geographical differences play a key role in perceptions towards algorithmic systems [10,49,97].”
From Disentangling Fairness Perceptions in Algorithmic Decision-Making: the Effects of Explanations, Human Oversight, and Contestability (2023) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“While some people are willing to sacrifice the elderly to save the young 169 , there are cultural differences on this preference 170 .”
From Using social and behavioural science to support COVID-19 pandemic response (2020) · cites this paper as [170]
The cited source says what the claim attributes to it.
In the citing paper
“Empirical work such as the Moral Machine Experiment has demonstrated that ethical preferences vary widely across cultures [8].”
From Ethics-Aware Safe Reinforcement Learning for Rare-Event Risk Control in Interactive Urban Driving (2026) · cites this paper as [8]
In the citing paper
“Ethics should ensure the design of AI technologies for human flourishing around the world [192,193], but this is a very complex matter given that, as the work of Awad et al. [194,195] clearly demonstrates, universally valid and accepted ethical principles do not exist.”
From The sustainability of artificial intelligence: an urbanistic viewpoint from the lens of smart and sustainable cities (2020) · cites this paper as [194]
In the citing paper
“Humans have a wide range of culturally diverse beliefs about right and wrong, and aligning AI systems to human values and preferences is challenging even within narrow domains such as automated driving (151).”
From The impact of generative artificial intelligence on socioeconomic inequalities and policy making (2024) · cites this paper as [151]
Citations
Cites
The Worldwide Governance Indicators: Methodology and Analytical Issues
Kaufmann, D., Kraay, A., & Mastruzzi, M. (2011) · Hague Journal on the Rule of Law · doi:10.1017/s1876404511200046 · Cited by 5,621
The righteous mind: why good people are divided by politics and religion
(2012) · Choice Reviews Online · doi:10.5860/choice.49-7185 · Cited by 4,347
(2005) · Cited by 3,670
In Search of Homo Economicus: Behavioral Experiments in 15 Small-Scale Societies
Henrich, J., Boyd, R. T., Bowles, S., Camerer, C., Fehr, E., Gintis, H. M., & McElreath, R. L. (2001) · American Economic Review · doi:10.1257/aer.91.2.73 · Cited by 2,619
Self-citation(2016) · Cited by 2,334
Hainmueller, J., Hopkins, D. J., & Yamamoto, T. (2014) · Political Analysis · doi:10.1093/pan/mpt024 · Cited by 1,990
A Natural History of Human Thinking
Tomasello, M. (2014) · doi:10.4159/9780674726369 · Cited by 1,923
The worldwide governance indicators : methodology and analytical issues
Kaufmann, D., Kraay, A., & Mastruzzi, M. (2010) · doi:10.1596/1813-9450-5430 · Cited by 1,552
The social dilemma of autonomous vehicles
Bonnefon, J.-F., Shariff, A., & Rahwan, I. (2016) · Science · doi:10.1126/science.aaf2654 · Cited by 1,527
Self-citationMoral tribes: emotion, reason, and the gap between us and them
(2014) · Choice Reviews Online · doi:10.5860/choice.51-4949 · Cited by 978
Cited by
Sorted by citations
Items 901–1,000 of 1,864
Kissel, A., Rechowicz, K. J., & Shull, J. B. (2023) · Societies · doi:10.3390/soc13030069 · Cited by 4
“The ecological validity of such studies is particularly pressing, as the results are already referenced in the development of self-driving cars and other AI machines [18,30].”
Zhou, Z., & Zhu, L. (2023) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2023.06.011 · Cited by 5
Steen, A., & Benzmüller, C. (2024) · Künstliche Intell. · doi:10.1007/s13218-023-00824-7 · Cited by 4
“Our collaboration is motivated by the moral machines experiment of MIT [2].”
Bearing the weight: A qualitative study on expert views on integrating ethics in autonomous vehicles
Milford, S. R., Elger, B. S., & Shaw, D. (2024) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2024.101096 · Cited by 5
Green transformational leadership and organizational culture on environmental performance
Purwanto, F., Riyadi, S., & Ardiana, I. D. K. R. (2024) · Corporate Governance and Organizational Behavior Review · doi:10.22495/cgobrv8i2sip2 · Cited by 4
Moral Complexity in Traffic: Advancing the ADC Model for Automated Driving Systems
Cecchini, D., & Dubljević, V. (2025) · Science and Engineering Ethics · doi:10.1007/s11948-025-00528-1 · Cited by 6
Weichert, J., & Eldardiry, H. (2025) · 2025 ASEE Annual Conference & Exposition Proceedings · doi:10.18260/1-2--56314 · Cited by 6
“Then, students are asked to put themselves in the shoes of self-driving car developers in deciding how to prioritize some lives over others by choosing between two options for a given car-pedestrian collision scenario from the MIT Moral Machine [22].”
Climate Change, Intergenerational Fairness, and the Promises and Pitfalls of Artificial Intelligence
Hauser, O. (2025) · Environmental and Resource Economics · doi:10.1007/s10640-025-00986-y · Cited by 4
“Such a research programme is exemplified in Awad et al. (2018): Through crowdsourcing 40 million moral thought-experiment decisions from millions of people across 200 countries and territories, the authors map the global moral preferences of the lives that an autonomous car should save.”
A methodology for ethical decision-making in automated vehicles
Gros, C., Werkhoven, P. J., Kester, L. J. H. M., et al. (2025) · AI & Society · doi:10.1007/s00146-025-02370-2 · Cited by 4
Actionable Ethics through Neural Learning
Rossini, D., Croce, D., Mancini, S., et al. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6005 · Cited by 4
“…constitute a monolithic and coherent ensemble of concepts and norms: expectations over acceptable or unacceptable behaviors greatly diversify across nations, communities and industry sectors, often generating tensions between ethical principles and opposing hierarchies of values (Awad et al. 2018).”
BackgroundTowards an Extended Requirements Problem Formulation for Superintelligence Safety
Kaindl, H., & Ferdigg, J. (2020) · doi:10.1109/aire51212.2020.00012 · Cited by 4
“In the long run, this may lead to a more elaborate approach along the lines of the moral machine experiment [21].”
BackgroundHayles, N. K. (2021) · Routledge eBooks · doi:10.4324/9781003123996-4 · Cited by 4
Association of natural sleep with moral utilitarianism: No evidence from 6 preregistered studies
Trémolière, B., & Gosling, C. J. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-01945-6 · Cited by 5
Advance Car-Crash Planning: Shared Decision Making between Humans and Autonomous Vehicles
Shaw, D., & Schneble, C. O. (2021) · Science and Engineering Ethics · doi:10.1007/s11948-021-00358-x · Cited by 4
“Either way, some set of principles for the governance of smart cars is widely regarded as necessary, though these principles may vary according to jurisdiction; research has shown that different decisions are made, depending on the decision-makers’ cultural background (Awad et al., 2018).”
BackgroundEmotion-aware Human–Robot Interaction and Social Robots
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398.3502407 · Cited by 4
Doneda, D. C. M., & Wimmer, M. (2022) · Direito Público · doi:10.11117/rdp.v18i100.6119 · Cited by 8
“Conforme relatam Awad et al. (2018), tomando-se como exemplo o conhecido cenário do carro autônomo que, na iminência de um acidente fatal, se vê diante de diferentes possibilidades de decisão – que resultariam na morte do ocupante do carro, de uma criança ou de uma pessoa idosa –, é possível…”
BackgroundEthics for Cognitive Assemblages: Who’s in Charge Here?
Hayles, N. K. (2022) · Springer eBooks · doi:10.1007/978-3-030-42681-1_11-1 · Cited by 4
Comparing Goal Setting Approaches to Boosting Pro-Environmental Behaviors
Staples, D. S., Webster, J., & Lv, S. (2020) · Journal of Sustainability Research · doi:10.20900/jsr20200034 · Cited by 4
Software Engineering and Formal Methods
Boer, F., & Cerone, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58768-0 · Cited by 4
Ethics of Autonomous Collective Decision-Making: The Caesar Framework
Frasheri, M., Struhár, V., Papadopoulos, A. V., & Čaušević, A. (2022) · Science and Engineering Ethics · doi:10.1007/s11948-022-00414-0 · Cited by 6
“The moral rules that guide such negotiation, e.g., which patient should have priority, represent an open problem in the community, similar to the dilemmas of the moral machine (Awad et al., 2018), and are outside the scope of this paper.”
BackgroundAre Robots to be Created in Our Own Image? Testing the Ethical Equivalence of Robots and Humans
Vanderelst, D. F., Jorgenson, C., Özkes, A., & Willems, J. (2022) · International Journal of Social Robotics · doi:10.1007/s12369-022-00940-8 · Cited by 4
“Probably the most high-profile example of this is the Moral Machine Project [38], which has attracted a lot of attention.”
BackgroundUnavoidable Collisions. The Automation of Moral Judgment
Fossa, F. (2023) · Studies in applied philosophy, epistemology and rational ethics · doi:10.1007/978-3-031-22982-4_4 · Cited by 5
Li, Z., Jiang, Q., Wu, Z., Liu, A., Wu, H., Huang, M., Huang, K., & Ku, Y. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3279311 · Cited by 4
“Thus, neither the AI nor the human driver in our experiment will face the so-called social or moral dilemma (e.g. trolley problem) [121], [122], [123], [124].”
Background¿Automatizando la mejora moral humana? La inteligencia artificial para la ética
Rueda, J. (2023) · Daímon · doi:10.6018/daimon.508771 · Cited by 4
Don’t You Agree with My Ethics? Let’s Negotiate!
Memon, M. A., Scoccia, G. L., Inverardi, P., & Autili, M. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230105 · Cited by 5
The Experimental Turn in Moral and Political Philosophy
Gaitán, A., Aguiar, F., & Viciana, H. (2023) · Routledge eBooks · doi:10.4324/9781003301424-1 · Cited by 4
Ethical Aspects of Faking Emotions in Chatbots and Social Robots*
Indurkhya, B. (2023) · IEEE RO-MAN · doi:10.1109/ro-man57019.2023.10309346 · Cited by 5
“As research on moral machines has shown [50], different cultures have widely different values and attitudes when it comes to dealing with ethically ambiguous situations.”
BackgroundRose, G. (2023) · Routledge eBooks · doi:10.5117/9789463727037 · Cited by 6
Schäffner, V. (2024) · AI and Ethics · doi:10.1007/s43681-024-00591-7 · Cited by 4
“The most prominent example is the moral machine experiment designed by Awad et al. [5]; further studies are presented by e.g. Altay et al. [ 2 ], Lucifora et al. [65] and Faulhaber et al. [28].”
User acceptance and ethics of ITS
Dimitrakopoulos, G. J., Uden, L., & Varlamis, I. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-818281-9.00007-3 · Cited by 4
Steps Toward Real-World Ethics for Self-Driving Cars
Holstein, T., Dodig-Crnković, G., & Pelliccione, P. (2020) · Advances in human and social aspects of technology book series · doi:10.4018/978-1-7998-4894-3.ch006 · Cited by 6
Staněk, R., Krčál, O., & Čellárová, K. (2022) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2022.101851 · Cited by 4
Brauner, P., Schaar, A. K., & Ziefle, M. (2022) · Springer eBooks · doi:10.1007/978-3-030-99235-4_14 · Cited by 4
Learning tractable probabilistic models for moral responsibility and blame
Hammond, L., & Belle, V. (2021) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00726-4 · Cited by 4
Persad, G. (2021) · The Hastings Center Report · doi:10.1002/hast.1286 · Cited by 3
Marczak, M., Marchewka, A., Wypych, M., Misiak, M., Droździel, D., Sorokowski, P., & Sorokowska, A. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/750299 · Cited by 4
Bagó, B., Kovács, M., Protzko, J., Kekecs, Z., Nagy, T., Hoekstra, R., Li, M., Musser, E. D., Arvanitis, A., Iones, M. T., et al. (2019) · doi:10.31234/osf.io/9uaqm · Cited by 4
The Terminology of Artificial SentiencePreprint
Pauketat, J. V. T. (2021) · doi:10.31234/osf.io/sujwf · Cited by 6
Sütfeld, L. R., Ehinger, B., König, P., et al. (2019) · doi:10.31234/osf.io/h2z7p · Cited by 4
Kallioinen, N., Pershina, M., Zeiser, J., et al. (2019) · doi:10.31219/osf.io/k4fgh · Cited by 4
Structure is Management of Uncertainty in GroupsPreprint
Hoey, J. (2020) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/rzywc · Cited by 4
Social Preferences Towards Machines and HumansPreprint
von Schenk, A., Klockmann, V., & Köbis, N. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4145868 · Cited by 4
Rismanchian, S., & Doroudi, S. (2023) · doi:10.35542/osf.io/kps79 · Cited by 4
Braga, J., Regateiro, F. S., Stiubiener, I., & Braga, J. C. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/wexjr · Cited by 5
NLPositionality: Characterizing Design Biases of Datasets and Models
Santy, S., Liang, J. T., Bras, R. L., Reinecke, K., & Sap, M. (2023) · arXiv · doi:10.48550/arxiv.2306.01943 · Cited by 31
“Social acceptability is likely to vary by background, as morality (Atari et al., 2022), values (Haerpfer and Kizilova, 2012), and moral decision-making (Awad et al., 2018, 2020) vary by culture.”
BackgroundChen, X., Zhou, P., Tao, L., Wang, X., & Qu, Y. (2024) · IEEE Conference on Engineering Informatics (ICEI) · doi:10.1109/icei64305.2024.10912274 · Cited by 3
“Researchers from MIT and other institutions created a global online experimental platform to collect data about the moral dilemmas faced by AVs ,and how to establish moral guidelines for machines[12].”
Hemesath, S., & Tepe, M. (2025) · Behavioural Public Policy · doi:10.1017/bpp.2025.2 · Cited by 3
“On a normative level, evidence (Bonnefon et al. , 2016; Awad et al. , 2018) suggests citizens’ evaluation is highly emotional, as they prefer others to buy a self-driving car that sac-rifices the passengers in favor of other traffic participants but would like to ride in a self-driving car that…”
Media representation of ethical and social issues inherent in autonomous vehicle technology
Ferrell, M. L., Raikar, I. P., Pflanzer, M., et al. (2025) · AI & Society · doi:10.1007/s00146-025-02367-x · Cited by 3
“In the "Moral Machine" experiment (Awad et al. 2018), dilemmas were generated from a pool of 26 million scenarios to determine how self-driving automobiles should behave.”
Neural Processes Linking Interoception to Moral Preferences Aligned with Group Consensus
Kim, J., & Kim, H. (2025) · Journal of Neuroscience · doi:10.1523/jneurosci.1114-24.2025 · Cited by 2
Digital pathways beyond Western-centric participants
Awad, E. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02751-x · Cited by 4
“We augmented this sample with nationally representative samples via third-party panels from four countries that were chosen to represent three country clusters that we identified in another work on moral dilemmas (Awad et al., 2018).”
InfluentialSelf-citationAI preference prediction and policy making
Lim, J., & Savulescu, J. (2025) · AI & Society · doi:10.1007/s00146-025-02474-9 · Cited by 7
“They obtained data from 10000 respond-ents to the moral machine experiment (Awad et al. 2018), including the responses of the respondents to 13 cases.”
Exploring AI’s role in influencing individual decision-making within human–machine teams
Xu, W. H., Xu, X., Qin, Y., & Zhao, C. (2025) · Computers & Industrial Engineering · doi:10.1016/j.cie.2025.111658 · Cited by 4
Learning ethics through the Metaverse: challenges and responsible educational design solutions
Haugsbakken, H., Hagelia, M., & Bergsjø, L. O. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1698260 · Cited by 4
Geometrical Optimal Navigation and Path Planning—Bridging Theory, Algorithms, and Applications
Jafarpourdavatgar, H., Saeedinia, S. A., & Mohaghegh, M. (2025) · Sensors · doi:10.3390/s25226874 · Cited by 3
Ethical, Legal, and Social Implications of AI
Urbach, N., Feulner, D., & Mayer, V. (2026) · Future of business and finance · doi:10.1007/978-3-032-13308-3_13 · Cited by 4
Trusting machines with morality — Delegating moral decisions to AI
Hüholt, N., & Szech, N. (2026) · European Economic Review · doi:10.1016/j.euroecorev.2025.105255 · Cited by 5
Li, R., Liu, Y., Sun, J., & Tian, Y. (2026) · Accident Analysis & Prevention · doi:10.1016/j.aap.2026.108402 · Cited by 3
Operational responsibility in AI governance: a user-centric liability framework
Chen, Z. (2026) · AI and Ethics · doi:10.1007/s43681-026-01163-7 · Cited by 5
Synthetic Deliberation: Can Emulated Imagination Enhance Machine Ethics?
Pinka, R. (2020) · Minds and Machines · doi:10.1007/s11023-020-09531-w · Cited by 3
Ethik in Zeiten von Digitalisierung und künstlicher Intelligenz
Hasenbein, M. (2020) · Springer eBooks · doi:10.1007/978-3-662-61661-1_9 · Cited by 3
ÇELİK, R. (2021) · AJIT-e Academic Journal of Information Technology · doi:10.5824/ajite.2021.02.003.x · Cited by 3
Éticas falibles para máquinas (in)falibles
Vallverdú, J., & Lázare, S. (2021) · Arbor · doi:10.3989/arbor.2021.800003 · Cited by 3
Care Ethics in the Era of Artificial Intelligence
Villegas-Galaviz, C., & Fernández, J. L. F. (2022) · Springer eBooks · doi:10.1007/978-3-030-97106-9_10 · Cited by 3
Zhang, Q., Wallbridge, C. D., Morgan, P. L., & Jones, D. M. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.09.410 · Cited by 3
“For example, in what’s called the “ moral machine experiments ”, A wad et al. [9] used randomly-generated text-based scenar ios with cartoon picture illustrations to collect people’s preferences of AV decisions in moral dilemmas (e.g., killing three elderly pedestrians who are crossing the road…”
BackgroundChen, W., Weicong, C., Liang, H., Suyu, H., & Yiwen, W. (2023) · Acta Psychologica Sinica · doi:10.3724/sp.j.1041.2024.00194 · Cited by 3
Kumar, J., Jieyao, Z., & Soeiro, J. D. (2024) · Advances in educational marketing, administration, and leadership book series · doi:10.4018/979-8-3693-6955-5.ch003 · Cited by 3
Kim, K. J., & Wang, S. (2024) · Universal Access in the Information Society · doi:10.1007/s10209-024-01145-8 · Cited by 3
“For instance, Awad et al. [ 45 ] found that compared with individuals from collectivistic cultures (e.g., Japan, Taiwan, or South Korea), those from indi - vidualistic cultures (e.g., the United States, Canada, or the United Kingdom) exhibited a stronger preference for saving youth over the…”
Challenges and Solutions to COLREGs on MASS Ethical Issues in Vessel Manoeuvring Practices
He, L. L. (2024) · TransNav the International Journal on Marine Navigation and Safety of Sea Transportation · doi:10.12716/1001.18.03.11 · Cited by 3
“…in terms of the perception that self-driving car algorithms will ultimately have to make decisions that negatively impact passengers or other road users and that mo ral judgments about this decision will have implications for both self-driving car algorithms and policy implementation [11] [18].”
BackgroundBilateral Turing Test: Assessing machine consciousness simulations
Wang, G., Li, X., & Xie, S. (2024) · Cognitive Systems Research · doi:10.1016/j.cogsys.2024.101299 · Cited by 4
The Need for Greed in Artificial Decisionmakers
Kremer-Herman, N., & Gupta, A. (2024) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas61960.2024.10732235 · Cited by 3
“One could imagine Trolley Problems [8] where the car cannot avoid disaster outright, but it can choose to save its passengers or to save bystanders.”
BackgroundBlueprints for Machine Ethics: A Digital Terrarium for Socio-Ethical Artificial Agent Decisionmaking
Kremer-Herman, N., Gupta, A., & Severson, E. R. (2024) · IEEE Access · doi:10.1109/access.2024.3519139 · Cited by 4
The Moral Status of Artificial Intelligence: in Search of a Sociological Perspective
Aganova, A., & Katerny, I. V. (2025) · Sociological Journal · doi:10.19181/socjour.2025.31.1.5 · Cited by 3
Tan, X., He, Y., Zhou, Y., Li, X., Ding, Q., Tang, Y., Luo, Y. L. L., & Gu, R. (2025) · Advanced Science · doi:10.1002/advs.202506262 · Cited by 4
Li, T.-M., Xu, N., Feng, S., et al. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3577660 · Cited by 3
“Thus the ego AVs need to consider their influence on interacting objects, balance their benefits with others, and even divide potential harms [4], [5].”
Artificial Morality: Differences in Responses to Moral Choices by Human and Artificial Agents
Armbruster, D., Mandl, S., Zeiler, A., & Strobel, A. (2025) · International Journal of Social Robotics · doi:10.1007/s12369-025-01276-9 · Cited by 5
“While the majority of third-party studies investigated moral decisions by humans, research has started on responses to moral choices by artifi - cial agents (e.g., Awad et al. 2018 ; Bigman and Gray 2018; Malle et al. 2019 ; Malle et al. 2015 ).”
Berendt, B. (2020) · The International Review of Information Ethics · doi:10.29173/irie381 · Cited by 3
Hillebrand, K. (2021) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-86790-4_18 · Cited by 4
“The language to measure the variables fear, consent, and trust in government is based on Awad et al.'s German question items in the “Moral Machine Experiment” [1].”
BackgroundAI Orthopraxy: Towards a Framework for That Promotes Fairness
Rivas, P. (2020) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas50296.2020.9462167 · Cited by 4
The Ultimate Goal of Ethics Education Should Be More Ethical Behaviors
Clancy, R. F., & Gammon, A. R. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--37901 · Cited by 4
“For example, the Moral Machines project sheds light on how people think about the ethics of autonomous vehicles, as well as the effects of culture and nationality on these judgments [56].”
BackgroundExpectations towards the Morality of Robots: An Overview of Empirical Studies
Wasielewska, A. (2021) · ETHICS IN PROGRESS · doi:10.14746/eip.2021.1.10 · Cited by 3
“The authors state that “The Moral Machine” attracted worldwide attention, and allowed them to collect 39.61 million decisions in 233 countries, dependencies, or territories (Awad et al. 2018, 60).”
BackgroundInfluentialExplanatory Pluralism in Explainable AI
Yao, Y. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-84060-0_18 · Cited by 5
God does not play dice but self-driving cars should
Gantsho, L. (2021) · AI and Ethics · doi:10.1007/s43681-021-00088-7 · Cited by 3
“Intuitively and in line with descriptive analysis of The Moral Machine Experiment [21], Global moral preferences have a bias towards who should be sparred in tragic life and death scenarios.”
ResultReviewing the Case of Online Interpersonal Trust
Tagliaferri, M. (2022) · Foundations of Science · doi:10.1007/s10699-022-09836-2 · Cited by 4
Pink, S., Raats, K., Lindgren, T., et al. (2022) · Springer eBooks · doi:10.1007/978-981-16-7084-8_9 · Cited by 3
Procyk, E., & Meunier, M. (2022) · Current Research in Neurobiology · doi:10.1016/j.crneur.2022.100051 · Cited by 4
Autonomous Vehicles, Business Ethics, and Risk Distribution in Hybrid Traffic
Berkey, B. (2022) · doi:10.1093/oso/9780197639191.003.0013 · Cited by 4
Discrimination in Algorithmic Trolley Problems
Leben, D. (2022) · doi:10.1093/oso/9780197639191.003.0008 · Cited by 3
Vloga umetne inteligence v izobraževanju in za izobraževanje
Pesek, I., & Krašna, M. (2022) · doi:10.18690/um.ff.11.2022.13 · Cited by 3
Artificial Intelligence, Ethics and Privacy
White, R., & Bradley, D. (2022) · Springer eBooks · doi:10.1007/978-3-031-07555-1_9 · Cited by 5
Идея нравственности в экспериментальной моральной философии
Железнов, А. С. (2022) · Philosophy Journal of the Higher School of Economics · doi:10.17323/2587-8719-2022-3-181-207 · Cited by 3
Joo, Y. K., Jeong, M.-W., & Kim, B. (2022) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2023.01.012 · Cited by 3
Lundgren, B. (2023) · Futures · doi:10.1016/j.futures.2023.103120 · Cited by 3
Roberts, J. S., & Montoya, L. N. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-28073-3_35 · Cited by 3
“[6] However, it still has top-down implications such as obeying traffic laws imposed by municipalities.”
BackgroundOthman, K. (2023) · International Conference on Smart Systems and Inventive Technology (ICSSIT) · doi:10.1109/icssit55814.2023.10061032 · Cited by 3
“Although previous studies highlighted that SDCs allow for achieving multiple benefits, papers that investigate the public attitude towards SDCs show that people are skeptical about the performance of SDCs and that they cannot trust a machine to decide what to do with their lives [10-14].”
BackgroundOthman, K. (2023) · AI and Ethics · doi:10.1007/s43681-023-00310-8 · Cited by 4
Prisznyák, A. (2023) · Economy & finance · doi:10.33908/ef.2023.2.4 · Cited by 3
“The answer to the question may seem evident in many cases, however, one is faced with a complex cultural dilemma that is diverse in different regions and social groups (Awad et al., 2018).”
BackgroundArtificial Intelligence and Automation
Koenig, S., Chan, S.-H., Li, J., & Zheng, Y. (2023) · Springer handbooks · doi:10.1007/978-3-030-96729-1_9 · Cited by 3
Othman, K. (2023) · The Open Transportation Journal · doi:10.2174/18744478-v17-e230419-2022-6 · Cited by 3
How to program autonomous vehicle (AV) crash algorithms: an Islamic ethical perspective
Elmahjub, E., & Qadir, J. (2023) · Journal of Information Communication and Ethics in Society · doi:10.1108/jices-02-2023-0015 · Cited by 3
Metadata
- Authors
- Awad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I.
- Affiliations
- MIT Media Lab (US)
- Harvard University (US)
- University of British Columbia (CA)
- Centre National de la Recherche Scientifique (FR)
- Corresponding author
- Shariff, Azim
- Bonnefon, Jean-François
- Rahwan, Iyad
- ORCID
- Venue
- Nature
- Published
- 2018-10-24
- Volume
- 563
- Issue
- 7729
- Pages
- 59-64
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2896252141
- Cited by
- 1,859
- References
- 31
- Citations by year
- 2026: 214 · 2025: 263 · 2024: 222 · 2023: 270 · 2022: 273 · 2021: 263 · 2020: 223 · 2019: 120 · 2018: 10
- FWCI
- 91.60
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- Open Research Exeter (University of Exeter) (acceptedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Figshare (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Agence Nationale de la Recherche (ANR-17-EURE-0010, ANR-10-LABX-0029)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Psychology of Moral and Emotional Judgment
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Ethics in Business and Education
- Keywords
- autonomous vehicles, machine ethics, ethical dilemmas, ethical preferences, cross-cultural variation, individual differences, demographic variation, modern institutions, cultural characteristics
- MeSH terms
- Accidents, Traffic, Pedestrians, Artificial Intelligence, Data Collection, Decision Making, Female, Humans, Male, Morals, Public Opinion, Robotics, Translating, Motor Vehicles, Internet, Internationality, Harm Reduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
