Trustworthy artificial intelligence
Open accessAbstract
Artificial intelligence (AI) brings forth many opportunities to contribute to the wellbeing of individuals and the advancement of economies and societies, but also a variety of novel ethical, legal, social, and technological challenges. Trustworthy AI (TAI) bases on the idea that trust builds the foundation of societies, economies, and sustainable development, and that individuals, organizations, and societies will therefore only ever be able to realize the full potential of AI, if trust can be established in its development, deployment, and use. With this article we aim to introduce the concept of TAI and its five foundational principles (1) beneficence, (2) non-maleficence, (3) autonomy, (4) justice, and (5) explicability. We further draw on these five principles to develop a data-driven research framework for TAI and demonstrate its utility by delineating fruitful avenues for future research, particularly with regard to the distributed ledger technology-based realization of TAI.
AI snapshot
Written from the paper’s full text.
TL;DR
This conceptual article introduces trustworthy AI (TAI) and its five foundational principles—beneficence, non-maleficence, autonomy, justice, and explicability—and argues that trust is necessary for realizing AI’s full potential. It develops the data-driven research framework DaRe4TAI and demonstrates its utility by outlining DLT-based avenues for future TAI research.
Key findings
- TAI is defined as AI perceived as trustworthy by users when it is developed, deployed, and used in ways that ensure legal compliance, robustness, and especially adherence to general ethical principles; the paper adopts five TAI principles: beneficence, non-maleficence, autonomy, justice, and explicability.
- The DaRe4TAI framework treats data as the central resource of AI-based systems and identifies tensions between current AI practice and TAI principles across the AI co-creation stages of input, modeling, and output—including training data availability, malicious training data, invasion of privacy, training data bias, model availability, model uncertainty, model bias, model opacity, and output-stage discrimination.
- The paper demonstrates DaRe4TAI by mapping DLT-based avenues—DLT-based data markets, DLT-based federated learning, and DLT-based transparency, accountability, and explainability—to several TAI tensions; it notes that DLT-based federated learning induces a performance overhead of 5% to 15% (citing Preuveneers et al. 2018) and may be prohibitively expensive for more complex AI models.
- As background, the paper states there are currently more than 60 high-level guidelines for ethical AI (citing Jobin et al. 2019) and that AI is estimated to deliver an additional global economic output of around USD 13 trillion by 2030 (citing Bughin et al. 2018).
Methods
- Conceptual/theoretical article; no empirical sample, experiment, or statistical analysis is reported.
- Reviews extant trust conceptualizations in information systems, adopts the five TAI principles from Floridi et al. (2018), and develops DaRe4TAI from an abstract AI co-creation process comprising input, modeling, and output stages.
- Demonstrates the framework’s utility by deriving future research avenues and exemplary research questions for the DLT-based realization of TAI, particularly DLT-based data markets, federated learning, and transparency/accountability/explainability.
Limitations
- The paper states that several TAI principles may conflict with each other—for example, beneficence and justice in predictive policing—and that such conflicts are difficult or even impossible to fully resolve without trade-offs; it leaves discussion of these trade-offs to ethics and legal experts.
- The paper states that extant TAI principles, frameworks, and guidelines are highly general and provide little to no guidance for transferring them into practice or informing future research on technical and non-technical means to realize TAI.
- The paper states that the outlined tensions represent only a subset, that DLT can address several but not all tensions, and that DLT-based explainable AI is at the idea stage at most, with it remaining unknown how DLT can support explainable AI.
- Evident from the text: DaRe4TAI is not empirically validated; its utility is demonstrated by delineating research questions rather than by testing the framework.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 80 cited sources checked · 0 supported · 0 flagged
- Findingreasoning
The potential for privacy infringements concerning input data represents a tension between input data and the non-maleficence principle.
“Consequently, the potential for privacy infringements concerning input data represents yet another tension between input data and the non-maleficence principle (tension: invasion of privacy).”
Quote in the paperNot a substantial claim- Rests on an assumption: AI possesses the inherent ability to infringe people's privacy.
- Findingreasoning
The outlined principles and corresponding frameworks and guidelines exhibit two major limitations.
“Despite their value for a realization of TAI, the outlined principles and the corresponding frameworks and guidelines also exhibit two major limitations.”
Quote in the paperSubstantial claim - Findingreasoning
The limited availability of large, high-quality data in certain areas creates a tension between input data and the beneficence principle.
“We identify this situation as creating a tension between input data and the beneficence principle (tension: training data availability).”
Quote in the paperSubstantial claim- Rests on an assumption: The creation of high-quality training data is costly and time-consuming, especially when expert knowledge is required.
- Rests on an assumption: Large, high-quality data sets are either under the control of a few large enterprises or limited to a few specific application areas.
- Findingreasoning
Such training data bias creates tension between input data and the justice principle.
“Such training data bias creates tension between input data and the TAI principle of justice, which demands fairness and the avoidance of discrimination (tension: training data bias).”
Quote in the paperSubstantial claim - Findingreasoning
This creates a tension between model data and the beneficence principle.
“We argue that, analog to the limited availability of training input data, this creates a tension between model data and the beneficence principle because the potential for contributing to human well-being is not being fully realized for these AI models (tension: model availability).”
Quote in the paperSubstantial claim
- Findingreasoning
Users' inability to adequately quantify uncertainties of AI models creates a tension between model data and the autonomy principle.
“Users' inability to adequately quantify uncertainties of AI models, therefore, creates a tension between model data and the autonomy principle (tension: model uncertainty).”
Quote in the paperSubstantial claim - Findingreasoning
This bias in AI models creates a tension between model data and the justice principle.
“Similar to the previously described bias in input data, we therefore see this bias in AI models as creating a tension between model data and the justice principle (tension: model bias).”
Quote in the paperSubstantial claim - Findingreasoning
This creates a tension between model data and the non-maleficence principle.
“We, thus, also see a tension between model data and the non-maleficence principle (tension: invasion of privacy).”
Quote in the paperSubstantial claim - Findingreasoning
Model opacity creates a tension between model data and the explicability principle.
“As such, we view model opacity as creating a tension between model data and the explicability principle (tension: model opacity).”
Quote in the paperSubstantial claim - Findingreasoning
This creates a tension between output data and the justice principle.
“We therefore also discern a tension between data at the output stage and the justice principle (tension: discrimination).”
Quote in the paperSubstantial claim - Premisecitation
Individuals' trust in technology commonly concerns the technology's functionality, helpfulness, and reliability.
“In contrast, individuals' trust in technology commonly concerns the technology's functionality (i.e., providing features needed to complete a task), its helpfulness (i.e., help functions will provide necessary advice), and its reliability (i.e., technology will consistently operate properly) (McKnight et al. 2011;Thatcher et al. 2010).”
Quote in the paperNot a substantial claim0 of 2 sources checked - Premisecitation
Most IS research nowadays employs a dualistic perspective on trust: trust in a specific person or organization (a moral and volitional agent) and trust in a specific technology or IT artefact (lacking volition and moral agency).
“Most IS research nowadays employs a dualistic perspective on trust (see Table 1).First, trust in a specific person or organization (a moral and volitional agent) (Lankton et al. 2015;McKnight et al. 2011), such as trust in an e-vendor (Gefen et al. 2003) or virtual team members (Robert et al. 2009).”
- Also stated in: § Extant trust conceptualizations · plain
“Second, trust in a specific technology or IT artefact (lacking volition and moral agency) (Lankton et al. 2015;McKnight et al. 2011), such as trusting an online shopping platform (Vance et al. 2008) or a cloud service (Lansing and Sunyaev 2016).”
Quote in the paperSubstantial claim0 of 2 sources checked - Also stated in: § Extant trust conceptualizations · plain
- Interpretationreasoning
These recent adaptations of trust in specific technology contexts inform our conceptualization of trust in AI-based systems, since such systems are human-like and autonomous.
“These recent adaptations of trust in specific technology contexts inform our conceptualization of trust in AI-based systems, since such systems are human-like and autonomous.”
Quote in the paperNot a substantial claim - Premisecitation
AI-based product recommendations may be disturbed by popularity biases, where popular products are presented more, not necessarily due to good quality.
“Nevertheless, the justice principle is also highly relevant for electronic markets as, for example, AI-based product recommendations may be disturbed by popularity biases, where popular products would be presented more to the public, while such a recommendation may not be a result of good quality (Mehrabi et al. 2019).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Mehrabi et al. 2019
Not checked in the free run.
- Interpretationreasoning
Conflicts between certain TAI principles are inherent to those principles and therefore difficult or impossible to fully resolve without trade-offs.
“Depending on the specific application cases, the conflicts between certain TAI principles are inherent to those principles and therefore difficult or even impossible to fully resolve without making trade-offs.”
Quote in the paperNot a substantial claim - Premisecitation
The growing availability of training data is a fundamental reason for recent advancements of AI.
“Next to advances in machine learning and deep learning methods, the growing availability of training data represents a fundamental reason for the recent advancements of AI (Pandl et al. 2020).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Pandl et al. 2020 source
Not checked in the free run.
- Premisecitation
In general, autonomous systems are generative and learn, evolve and permanently change their functional capacities as a result of the input of operational and contextual information.
“In general, autonomous systems are generative and learn, evolve and permanently change their functional capacities as a result of the input of operational and contextual information (Hancock 2017).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Hancock 2017 source
Not checked in the free run.
- Premisecitation
Several TAI principles may at times conflict with each other.
“First, as noted in the EU TAI Guidelines, several TAI principles may at times conflict with each other.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites EU TAI Guidelines
Not checked in the free run.
- Premisecitation
Data in itself can be a source of manifold ethical problems.
“At the same time, the nascent stream of data ethics tells us that data in itself can be a source of manifold ethical problems (Floridi and Taddeo 2016).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Floridi and Taddeo 2016 source
Not checked in the free run.
- Premisecitation
Feeding low-quality or malicious input data into an AI model's training process bears the risk that the AI-based systems might behave unintendedly or maliciously.
“Feeding low-quality or even malicious input data into an AI model's training process, on the other hand, bears the risk that the AI-based systems themselves might behave unintendedly or even maliciously.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites P. Lee 2016
Not checked in the free run.
- Premisecitation
Specific trust in persons and technology can be positioned in a nomological net of trust, comprising general trusting beliefs and institution-based trust as antecedents and trusting intentions as consequence of specific trust in persons or technology.
“Specific trust in persons and technology can be further positioned in a nomological net of trust, comprising general trusting beliefs and institution-based trust as antecedents and trusting intentions as consequence of specific trust in persons or technology (McKnight et al. 2011;McKnight et al. 2002; see Fig. 1).”
Quote in the paperNot a substantial claim0 of 2 sources checked - Premisecitation
Under certain circumstances, parameters of AI models can be analyzed to generate insights about the underlying training data.
“Extant research has further shown, that under certain circumstances, parameters of AI models can be analyzed to generate insights about the underlying training data (Shokri et al. 2017).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Shokri et al. 2017
Not checked in the free run.
- Premisecitation
The trust literature suggests a causal ordering among trust constructs, such that an individual's general trusting beliefs in people or technology directly influences institution-based trust and indirectly shapes trust in a specific person or technology.
“The trust literature suggests a causal ordering among trust constructs, such that an individual's general trusting beliefs in people or technology directly influences institutionbased trust and indirectly shapes trust in a specific person or technology (McKnight et al. 2011;McKnight and Chervany 2001).”
Quote in the paperNot a substantial claim0 of 2 sources checked - Premisecitation
Trust in a specific person or technology has an impact on an individual's trusting intentions, referring to an individual's intention to engage in trust-related behavior, such as sharing personal information, making a purchase, using a system or acting on information provided by a website.
“Moreover, trust in a specific person or technology has an impact on an individuals' trusting intentions, referring to an individual's intention to engage in trust-related behavior, such as sharing personal information, making a purchase, using a system or acting on information provided by a website (McKnight et al. 2002).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites McKnight et al. 2002 source
Not checked in the free run.
- Premisecitation
AI models increasingly represent an important factor in achieving competitive advantages as intellectual property.
“As a form of intellectual property, AI models increasingly represent an important factor in achieving competitive advantages (Haenlein and Kaplan 2019;Makridakis 2017).”
Quote in the paperSubstantial claim0 of 2 sources checked - Premisecitation
Related research on trust in automated and autonomous systems has developed three trusting beliefs: performance, process, and purpose.
“Contrarily, related research on trust in automated and autonomous systems takes another perspective and has developed three trusting beliefs, namely, performance, process, and purpose (J.D. Lee and See 2004; see Table 1).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites J.D. Lee and See 2004 source
Not checked in the free run.
- Premisecitation
Related research has shown that trust in a technology which is perceived as human-like by its user or is highly automated and autonomous, differs from classical interpersonal trust and also classical trust in technology.
“Related research has shown that trust in a technology which is perceived as human-like by its user or is highly automated and autonomous, differs from classical interpersonal trust and also classical trust in technology (Lansing and Sunyaev 2016).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Lansing and Sunyaev 2016 source
Not checked in the free run.
- Premisecitation
Autonomy aligns with openness, a sub dimension of the process belief of automation technologies.
“In addition, autonomy aligns with openness, a sub dimension of the process belief of automation technologies (J.D. Lee and See 2004), that refers to”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites J.D. Lee and See 2004 source
Not checked in the free run.
- Interpretationreasoning
The limited availability of large, high-quality data in certain areas could lead society to perceive the entire class of AI-based systems as not beneficent enough.
“In line with the view of institutions-based trust in technology being an antecedent to trust in a specific technology (McKnight et al. 2011), we argue, that the limited availability of large, high-quality data in certain areas, which constraints our ability to promote human well-being through AI in those areas, could lead society to perceive the entire class of AIbased systems as not beneficent (”
Quote in the paperSubstantial claim0 of 1 sources checked- cites McKnight et al. 2011 source
Not checked in the free run.
- Premisenone given
Despite efforts, we still lack the ability to fully understand the inner functioning of most AI models, especially deep learning.
“Despite extensive efforts that are being directed toward tackling this issue and creating so-called explainable AI, we still lack the ability to fully understand the inner functioning of most AI models, especially those constructed using deep learning.”
Quote in the paperSubstantial claim - Interpretationreasoning
This overhead could render DLT-based federated learning prohibitively expensive for more complex AI models.
“Although this might at first not seem like a large overhead, it could ultimately render DLT-based federated learning prohibitively expensive for more complex AI models.”
Quote in the paperSubstantial claim - Interpretationreasoning
DLT-based federated learning seems particularly auspicious for addressing invasion of privacy tensions at input and model stages.
“Since no training data is directly shared among participants of the network, DLT-based federated learning seems to be particularly auspicious for addressing the invasion of privacy tensions at the input and model stages.”
Quote in the paperSubstantial claim - Premisecitation
Extant research has proposed using DLT to establish explainability of AI, addressing the model opacity tension.
“Finally, extant research has proposed the use of DLT to establish explainability of AI (i.e., addressing the model opacity tension).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Dinh and Thai 2018 source
Not checked in the free run.
- Premisecitation
DLT can serve to organize the federated training of AI models.
“Next to DLT-based data markets, DLT can also serve to organize the federated (i.e., decentralized) training of AI models (Dinh and Thai 2018).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Dinh and Thai 2018 source
Not checked in the free run.
- Premisereasoning
Output data generated by AI-based systems can represent an infringement of people's privacy.
“First, similar to input data and model data before, output data that is being generated by AI-based systems can represent an infringement of people's privacy.”
Quote in the paperSubstantial claim - Premisecitation
DLT allows for the operation of a highly available, append-only, peer-to-peer database in situations where uncertainty prevails and undesirable outcomes are possible.
“First, DLT allows for the operation of a highly available, append-only, peer-to-peer database (i.e., a distributed ledger) in situations where uncertainty prevails and undesirable outcomes are possible (Zhang and Jacobsen 2018).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Zhang and Jacobsen 2018
Not checked in the free run.
- Premisecitation
There is a nascent stream of literature combining DLT with AI to address diverse issues of current AI-based systems.
“Second, there is a nascent stream of literature combining DLT with AI to address diverse issues of current AI-based systems (Pandl et al. 2020).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Pandl et al. 2020 source
Not checked in the free run.
- Premisereasoning
Being able to adequately quantify uncertainties in AI models is fundamental in deciding how much autonomy to give an AI-based system.
“However, being able to adequately quantify the uncertainties in AI models is a fundamental aspect in deciding how much autonomy should be given to an AI-based system.”
Quote in the paperNot a substantial claim - Premisecitation
Sensitive output data could be used to discriminate against people.
“Second, sensitive output data could not only be used to invade people's privacy but also to discriminate against them.”
Quote in the paperSubstantial claim - Interpretationreasoning
The unique combination of DLT's characteristics presents it as a promising technical means to address several tensions between data at input and model stages and TAI principles.
“The unique combination of DLT's inherent characteristics (e.g., tamper resistance, transparency, and confidentiality) presents it as a promising technical means to address several, albeit not all, of the aforementioned tensions between data at the input and model stages and the outlined TAI principles.”
Quote in the paperSubstantial claim - Premisecitation
Current AI-based systems routinely contain socially constructed biases.
“Current AI-based systems routinely contain socially constructed biases (Obermeyer et al. 2019).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Obermeyer et al. 2019 source
Not checked in the free run.
- Premisenone given
Inferences made by AI models are associated with some uncertainty.
“Inferences made by AI models are associated with some uncertainty.”
Quote in the paperNot a substantial claim- Rests on an assumption: Inferences made by AI models are associated with some uncertainty.
- Premisecitation
Federated learning is potentially vulnerable to inference attacks, where an adversary can extract information about private training data by inferring the AI model multiple times.
“Furthermore, despite increased confidentiality, research has also shown that federated learning is potentially vulnerable to inference attacks, whereby an adversary can aim to extract information about private training data by inferring the AI model multiple times (Melis et al. 2019;Wang et al. 2019).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Melis et al. 2019
Not checked in the free run.
- cites Wang et al. 2019
Not checked in the free run.
- Premisenone given
Another source of bias is the overemphasis of certain aspects by developers during model design.
“Next to the bias in training input data, another source of bias is the overemphasis of certain aspects (e.g., skin color or place of residence) by developers of AI models during the design of an AI model.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Malicious use or inherently malicious purpose of AI-based systems could undermine users' trust in other users, developers, and the AI system itself.
“Again, despite the fact that such AI-based systems could as well be used to do good, it is their malicious use (here discrimination) or possibly even the inherently malicious purpose with which a system was designed and developed, that could eventually undermine users' trust not only in other users or developers of the AI but also in the AI-based system itself.”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 53
- May combine two claims. 42
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenWithin the eight frameworks and guidelines considered, explicability can be found under different terms and to varying degrees.
“Within the eight frameworks and guidelines considered in this work, explicability can be found under different terms and to varying degrees.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
FindingcitationJustice is a key aspect of all eight frameworks and guidelines discussed in this article, though also referred to as fairness by some.
“Like non-maleficence, justice is as key aspect of all eight frameworks and guidelines discussed in this article, albeit it is also referred to as fairness by some.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingcitationAll frameworks and guidelines exhibit similar but slightly distinctive views on justice, summarizable as (1) utilization of AI to amend past inequities, (2) creation and distribution of benefits, and (3) thwarting new harms and inequities.
“As such, all frameworks and guidelines exhibit similar but slightly distinctive views on justice, which can be summarized as (1) the utilization of AI to amend past inequities like discrimination, (2) the creation of shareable and subsequent distribution of benefits through AI, and (3) thwarting the creation of new harms and inequities by AI (Floridi et al. 2018).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Floridi et al. 2018
Not checked in the free run.
May combine two claims.
FindingreasoningSuch acts undermine users' trust in AI-based systems, creating a tension between output data and the non-maleficence principle.
“In the long run, such acts undermine users' trust in those AI-based systems, which is why we identify a tension between output data and the non-maleficence principle (tension: invasion of privacy).”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningThe concept of using DLT to create explainable AI is at the idea stage at most, and it remains unknown how DLT can support the attainment of explainable AI.
“However, looking at the recent literature, we see that the concept of using DLT to create explainable AI is at the idea stage at most and that it remains unknown how DLT can support the attainment of explainable AI.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationTrust persists to play a pivotal role in any buyer-seller relationship.
“Although cost-and time-saving opportunities have triggered a widespread implementation of AI-based systems and services in electronic markets, trust persists to play a pivotal role in any buyer-seller relationship (Bauer et al. 2019;Marella et al. 2020).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Bauer et al. 2019
Not checked in the free run.
- cites Marella et al. 2020 source
Not checked in the free run.
May combine two claims.
PremisecitationSpecific trust in people and trust in technology differ in terms of the nature of the object of dependence and on important trusting beliefs.
“Specific trust in people and trust in technology not only differ in terms of the nature of the object of dependence but also on important trusting beliefs.”
Quote in the paperSubstantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningTAI is of increasing relevance to electronic markets and its research community.
“Consequently, TAI is of increasing relevance to electronic markets and its research community.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
PremisecitationAI is not the 'magic bullet' some would like to believe it is and that AI, just like any other technology, will not only bring forth many benefits but will also be accompanied with a variety of novel ethical, legal, and social challenges.
“However, it is becoming increasingly evident that AI is not the 'magic bullet' some would like to believe it is and that AI, just like any other technology, will not only bring forth many benefits but will also be accompanied with a variety of novel ethical, legal, and social challenges (Floridi 2019;Floridi et al. 2018).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Floridi 2019 source
Not checked in the free run.
- cites Floridi et al. 2018
Not checked in the free run.
Classified as probably not a substantial claim. May combine two claims.
PremisereasoningTAI is a highly interdisciplinary and dynamic field of research, with knowledge on technical and non-technical means to realize TAI being scattered across research disciplines, thus making it challenging to grasp the status quo on its realization.
“Overall, TAI is a highly interdisciplinary and dynamic field of research, with knowledge on technical and non-technical means to realize TAI being scattered across research disciplines, thus making it challenging to grasp the status quo on its realization.”
- Also stated in: § Toward a definition of trustworthy artificial intelligence · plain
“Yet, TAI is a highly interdisciplinary and dynamic field of research, comprising multifarious research discussions and streams that are scattered across disciplines, including psychology, sociology, economics, management, computer science, and IS.”
Quote in the paperSubstantial claim- Also stated in: § Toward a definition of trustworthy artificial intelligence · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationVarious perspectives on trust exist in literature, comprising different dimensions and (partially opposing) interpretations.
“Nevertheless, various perspectives on trust exist in literature, comprising different dimensions and (partially opposing) interpretations (McKnight et al. 2002).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites McKnight et al. 2002 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe Ethics Guidelines for Trustworthy AI published by the independent High-Level Expert Group on Artificial Intelligence of the European Commission in early 2019 have quickly gained traction in research and practice and have laid the foundation for the adoption of the term trustworthy AI in other guidelines and frameworks like the OECD principles on AI or the White House AI principles.
“These guidelines have quickly gained traction in research and practice and have laid the foundation for the adoption of the term trustworthy AI in other guidelines and frameworks like the OECD principles on AI (OECD 2019) or the White House AI principles (Vought 2020).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites OECD 2019
Not checked in the free run.
- cites Vought 2020
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
PremisereasoningThe conceptualization of trust in AI and what makes AI trustworthy remains inconclusive and highly discussed in research and practice.
“Considering that 'trust' in general is a complex phenomenon that has sparked many scholarly debates in recent decades, it is not surprising that the conceptualization of trust in AI and what makes AI trustworthy-as of today-remains inconclusive and highly discussed in research and practice.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
PremisecitationTrustworthy AI (TAI) is based on the idea that trust builds the foundation of societies, economies, and sustainable development, and that individuals, organizations, and societies will only ever be able to realize the full potential of AI if trust can be established in its development, deployment, and use.
“Trustworthy AI (TAI) bases on the idea that trust builds the foundation of societies, economies, and sustainable development, and that individuals, organizations, and societies will therefore only ever be able to realize the full potential of AI, if trust can be established in its development, deployment, and use.”
- Also stated in: § Introduction · plain
“the concept of trustworthy AI (TAI) promotes the idea that individuals, organizations, and societies will only ever be able to achieve the full potential of AI if trust can be established in its development, deployment, and use (Independent High-Level Expert Group on Artificial Intelligence 2019).”
- Also stated in: § Toward a definition of trustworthy artificial intelligence · plain
“In its essence, TAI is based on the idea that trust builds the foundation of societies, economies, and sustainable development, and that therefore the global society will only ever be able to realize the full potential of AI if trust can be established in it (Independent High-Level Expert Group on Artificial Intelligence 2019).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Independent High-Level Expert Group on Artificial Intelligence 2019
Not checked in the free run.
- Also stated in: § Introduction · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationExtant research has commonly agreed that individuals express expectations about a person's competence, benevolence, and integrity.
“Extant research has commonly agreed that individuals express expectations about a person's competence (i.e., its ability to do what the individual needs), benevolence (i.e., its care and motivation to act in the individual's interests), and integrity (i.e., its honesty and promise-keeping) (McKnight et al. 2002).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites McKnight et al. 2002 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThere is no commonly accepted definition of trust but rather a need for contextualized trust conceptualizations.
“As a result of the plurality of perspectives on this concept, there is no commonly accepted definition of trust (Lansing and Sunyaev 2016;Söllner et al. 2016) but rather a need for contextualized trust conceptualizations (Jarvenpaa et al. 2004).”
Quote in the paperNot a substantial claim0 of 3 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationTrust plays a particularly important role in almost any IS-enabled situation in which either uncertainty prevails or undesirable outcomes are possible.
“Trust plays a particularly important role in almost any ISenabled situation in which either uncertainty prevails or undesirable outcomes are possible (McKnight et al. 2011).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites McKnight et al. 2011 source
Not checked in the free run.
May combine two claims.
PremisecitationInterpersonal trusting beliefs reflect judgments that the other party has suitable attributes and motives for performing as expected in a risky situation, whereas technology-related trust necessarily reflects beliefs about a technology's characteristics rather than its motives.
“Interpersonal trusting beliefs reflect judgments that the other party has suitable attributes and motives for performing as expected in a risky situation (Mayer et al. 1995), whereas technology-related trust necessarily reflects beliefs about a technology's characteristics rather than its motives (McKnight et al. 2011).”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningBoth types of trust are highly relevant in the context of AI.
“Both types of trust are highly relevant in the context of AI.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationAI-based systems' autonomous and intelligence-based capabilities allow them to have a great degree of self-governance, which enables them to respond to situations that were not pre-programmed or explicitly anticipated during their development, and to make independent decisions and action selection with little or no control by their users.
“AI-based systems' autonomous and intelligence-based capabilities allow them to have a great degree of self-governance, which enables them to respond to situations that were not pre-programmed or explicitly anticipated during their development, and to make independent decisions and action selection with little or no control by their users (Parasuraman et al. 2000).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Parasuraman et al. 2000 source
Not checked in the free run.
May combine two claims.
PremisecitationTraining data that are already available are routinely biased toward certain groups of people, leading to implicit discrimination of underrepresented groups.
“Next to the limited availability of high-quality training data, training data that are already available are routinely biased toward certain groups of people, which in the past has led to the implicit discrimination of those groups of people that are underrepresented in the training data (Bellamy et al. 2019).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Bellamy et al. 2019
Not checked in the free run.
Classified as probably not a substantial claim. May combine two claims.
Premisenone givenInput data plays a dual role: it serves as the main resource for training AI models, and it is transferred into output data via a trained AI model once deployed.
“Input data plays an important dual role in AI-based systems.On the one hand, it serves as the main resource for the training of AI models.foot_0On the other hand, input data is transferred into output data via a trained AI model, once an AI has been deployed.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationTwo research streams emerged that either adapted the concept of interpersonal trust to conceptualize trust in human-like IT artifacts, or revised the concept of trust in technology to account for automation technology and autonomous systems.
“To understand trust relationships in such scenarios, two research streams emerged that either adapted the concept of interpersonal trust to conceptualize trust in human-like IT artifacts (Lankton et al. 2015), or revised the concept of trust in technology to account for automation technology and autonomous systems (J.D. Lee and See 2004).”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe non-maleficence principle is highly important for electronic markets due to the exchange and analysis of highly sensitive consumer and intellectual property data.
“the non-maleficence principle is highly important for electronic markets due to the exchange and analysis of highly sensitive consumer and intellectual property data.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationNon-maleficence especially concerns the protection of people's privacy and security, as well as their safety.
“Non-maleficence especially concerns the protection of people's privacy (expressed by the Asilomar AI Principles, Montreal Declaration, UK AI Code, AI4People, EU TAI Guidelines, Chinese AI Principles) and security (expressed by the AI4People, EU TAI Guidelines, OECD Principles on AI, White House AI Principles), as well as their safety (expressed by the Asilomar AI Principles, UK AI Code, AI4People,”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationSome TAI frameworks mainly focus on the promotion of human autonomy, agency, and oversight, while others also consider the restriction of AI-based systems' autonomy, where necessary.
“While some mainly focus on the promotion of human autonomy, agency, and oversight (e.g., EU TAI Guidelines), others also consider the restriction of AI-based systems' autonomy, where necessary (e.g., the Montreal Declaration) (Floridi and Cowls 2019).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Floridi and Cowls 2019
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
PremisereasoningThese trust in automation beliefs take a more technical focus, yet they still relate to prevalent beliefs of trust in human-like IT artifacts; purpose corresponds to helpfulness and benevolence and reflects the perception that an automated system has a positive orientation toward the user.
“These trust in automation beliefs therefore take a more technical focus, yet they still relate to prevalent beliefs of trust in human-like IT artifacts.Purpose, for example, corresponds to helpfulness and benevolence and reflects the perception that an automated system has a positive orientation toward the user.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenUnintended or malicious behavior of an AI-based system will most likely exert a negative impact on users' trust in the AI.
“We discern this as a tension between input data and the non-maleficence TAI principle (tension: malicious training data), since unintended or malicious behavior of an AI-based system will most likely exert a negative impact on users' trust in the AI.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationcitationAI-based systems' actions necessarily become more indeterminate across time and are thus more challenging to predict, making trust interactions between humans and AI-based systems more complex and difficult to understand than trust interactions between humans and non-AI technologies.
“AI-based systems' actions necessarily become more indeterminate across time and are thus more challenging to predict (Hancock 2017), making trust interactions between humans and AI-based systems more complex and difficult to understand than trust interactions between humans and non-AI technologies.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Hancock 2017 source
Not checked in the free run.
May combine two claims.
PremisecitationA widely used AI in US hospitals is negatively biased toward Black patients because it uses health costs as a proxy for health needs and less money is spent on Black patients.
“Obermeyer et al. (2019), for example, found that a widely used AI in US hospitals is negatively biased toward Black patients, since it uses health costs spent on patients as a proxy for health needs and since on average less money is spent on Black patients in the US.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Obermeyer et al. 2019 source
Not checked in the free run.
May combine two claims.
PremisereasoningAI models themselves constitute an important form of data, and there are tensions between the model and the five TAI principles.
“In line with our guiding notion that data is the single, most important resource for contemporary AI-based systems, we argue that AI models themselves constitute an important form of data and identify several tensions between the model and the five TAI principles.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationAI can be employed for predictive policing and benefit society by allowing better allocation of police staff and reducing crime rates.
“Extant research shows that AI can be employed for purposes of predictive policing (i.e., using mathematical models to forecast what crimes will happen when and where) and therefore benefit society by allowing for a better allocation of police staff and reducing crime rates (Courtland 2018).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Courtland 2018 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenNon-maleficence represents a distinct principle that represents a key aspect of all considered frameworks and guidelines.
“Although similar to beneficence, which emphasizes the creation of AI that actively acts towards the wellbeing of humanity, non-maleficence represents a distinct principle that represents a key aspect of all considered frameworks and guidelines.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningAn individual will tend to trust the AI if its algorithms can be understood and seem capable of achieving the individual's goals in the current situation.
“Thus, an individual will tend to trust the AI if its algorithms can be understood and seem capable of achieving the individual's goals in the current situation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Premisenone givenExplicability relates to the trusting beliefs competence, functionality, and performance in that explainable and interpretable AI proves it has the capability, functionality, or features to do what needs to be done.
“Explicability relates also to the trusting beliefs competence, functionality, and performance in the sense that explainable and interpretable AI proves that it has the capability, functionality, or features to do what needs to be done.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
PremisereasoningThe autonomy principle is not directly related to extant trusting beliefs but reflects a means to mitigate integrity and reliability risks by balancing between human- and machine-led decision-making.
“The autonomy principle is not directly related to extant trusting beliefs but reflects a means to mitigate integrity and reliability risks by balancing between human-and machineled decision-making.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationIn the IS domain, explicability of AI is of major importance because it allows organizations to meet compliance requirements and is a key driver for acceptance of AI by managers, workforce, and consumers.
“In the IS domain, explicability of AI is of major importance since it will not only allow organizations to meet compliance requirements when employing AI (e.g., by means of enabling independent third-party audits) but will also be a key driver for acceptance of AI by managers, the general workforce, and consumers (Hagras 2018;Rai 2020).”
Quote in the paperNot a substantial claim0 of 2 sources checkedMay combine two claims.
PremisereasoningAlthough beneficence is found in all of the frameworks and guidelines discussed here, it is taken into account to varying degrees.
“Although beneficence is found in all of the frameworks and guidelines discussed here, it is taken into account to varying degrees.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningThese tensions form the backbone of DaRe4TAI and should be understood as illustrations of challenges to overcome to achieve TAI, not as contributing to mistrust.
“These tensions, which form the backbone of DaRe4TAI, should thereby not to be understood from a negative point of view, as in contributing to mistrust in AI, but instead as illustrations of challenges that need to be overcome in certain scenarios to achieve TAI from a user (i.e., consumers, organizations, society) perspective.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenNon-maleficence relates to the trusting beliefs integrity, reliability, and process because it requires AI-based systems to act honestly and consistently, and to sincerely adhere to ethical and other pre-defined principles.
“Nonmaleficence relates to the trusting beliefs integrity, reliability, and process because it requires AI-based systems to act honestly and consistently, and to sincerely adhere to ethical and other pre-defined principles.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningSuch insights could be used to identify individuals, representing a privacy infringement that could undermine trust.
“In extreme cases, such insights could be used to identify individuals who contributed their data, which in turn represents a privacy infringement that could undermine those very individuals' trust in AI-based systems.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationAutonomy aligns with openness, a sub-dimension of the process belief of automation technologies, and openness increases trust into another party.
“addition, autonomy aligns with openness, a sub dimension of the process belief of automation technologies (J.D. Lee and See 2004), that refers to the willingness to give and receive ideas, which will increase trust into another party (Mishra 1992;Schindler and Thomas 1993).”
Quote in the paperNot a substantial claim0 of 3 sources checkedProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Premisenone givenJustice aligns with the trusting beliefs integrity, reliability, and process, ensuring ethical principles are fulfilled by an AI-based system.
“Similar to non-maleficence, justice aligns with the trusting beliefs integrity, reliability, and process, ensuring that ethical principles are fulfilled by an AI-based system.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningAttempts to protect competitive advantages can contribute to promising AI models not being shared and AI being perceived as not beneficent enough.
“Attempts to protect competitive advantages can thereby contribute to the fact that particularly promising AI models are not shared and that AI as a specific class of technology are perceived as not beneficent (enough) by the society (i.e., the whole of AI-based systems not acting in societies best interest).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningGiven that extant TAI frameworks and guidelines provide slightly different understandings of autonomy, it lacks a precise definition.
“Given that extant TAI frameworks and guidelines provide slightly different understandings of this principle, it lacks a precise definition.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenAI-based systems are based on an abstract AI co-creation process comprising three stages: input, modeling, and output.
“They are thus based on an abstract AI co-creation process, comprising three important stages: input, modeling, and output.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenSeveral frameworks and guidelines that promote (ethical) principles for TAI have been developed and published by researchers, industry, and policymakers in the recent past.
“Several frameworks and guidelines that promote (ethical) principles for TAI have been developed and published by researchers, industry, and policymakers in the recent past.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe question of how to effectively design token economies remains a focal theme of contemporary DLT research.
“However, despite first technical solutions being developed by researchers from the IS, computer science, and related disciplines (Ozercan et al. 2018;Özyilmaz et al. 2018;Xiong and Xiong 2019;Zhao et al. 2019), the question of how to effectively design token economies (e.g., to democratize data access or to encourage the generation of more diverse data sets) remains a focal theme of contemporary D”
Quote in the paperNot a substantial claim0 of 3 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenThe last avenue concerns achieving accountability and explainability of AI through DLT.
“The last avenue of DLT-related research on the realization of TAI that we discuss in this article concerns achieving accountability and explainability of AI through DLT.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningDLT-based data markets, DLT-based federated learning, and DLT-based transparency, accountability, and explainability are fruitful avenues for further research to address these tensions and realize TAI.
“Especially DLT-based data markets, DLT-based federated learning, and DLT-based transparency, accountability, and explainability are fruitful avenues for further research to better address these tensions and eventually realize TAI.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningDLT-based data markets provide economic incentives that could stimulate democratization of access to high-quality AI training data and encourage generation of more diverse data sets.
“For example, DLT-based data markets provide the ability to create economic incentives, which could not only stimulate the democratization of access to extant, high-quality AI training data (i.e., addressing the training data availability tension) but as well encourage greater participation by the general public to drive the generation of new, more diverse data sets (i.e., addressing the training”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe privacy invasion on the output stage occurs because the AI's purpose is malicious, unlike input/model stages where purpose might be benevolent.
“However, in contrast to the invasion of privacy tension on the input stage and the model stage, where the AI-based system's purpose might have been benevolent but the collection, processing, and analysis of the users' data without their consent stipulated a privacy infringement, the privacy invasion on the output stage occurs simply due to the fact that the AI's purpose is malicious and an”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationThe modeling of assets as tokens is a topic of ongoing research, and we lack knowledge on how AI-related assets can be modeled and represented adequately as tokens.
“Furthermore, the modeling of assets as tokens is a topic of ongoing research (Kim and Chung 2018;Laskowski et al. 2019) and, thus far, we lack knowledge on what and how AI-related assets (e.g., training data, model data, algorithms) can be modeled and represented adequately as tokens.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Kim and Chung 2018 source
Not checked in the free run.
- cites Laskowski et al. 2019
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
Interpretationnone givenTAI is a promising research topic for IS research.
“In this article, we introduced the concept of TAI as a promising research topic for IS research, delineated its background, positioned it in related trust conceptualizations, and contextualized the five TAI principles beneficence, non-maleficence, autonomy, justice, and explicability to the IS context.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationnone givenWe still lack substantive knowledge on how to successfully design a token economy for DLT-based federated learning.
“However, also similar to DLT-based data markets, we still lack substantive knowledge on how to successfully design such a token economy for DLT-based federated learning.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Premisenone givenThe development and deployment of AI are highly dynamic, with training data and algorithms rapidly changing and constantly evolving.
“However, the development and deployment of AI are highly dynamic, with training data and algorithms (and thus model uncertainty) rapidly changing and constantly evolving.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenIt is not clear whether promises of increased privacy from DLT-based federated learning may strengthen data providers' trust and willingness to contribute data.
“It is, for example, not clear whether the promises of increased privacy due to the application of (DLT-based) federated learning may actually strengthen data providers' trust in an AI-based system's ability to adequately protect their data and ultimately their willingness to contribute their data for purposes of training AI models.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
PremisereasoningDLT can provide a ledger for incentivizing participation in federated learning networks.
“Moreover, and similar to the previously described token economy for AI training data, DLT can provide a ledger for incentivizing participation in federated learning networks.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationIn federated learning, no input training data is directly shared; partial AI models are trained by nodes, with provenance and integrity preserved using a distributed ledger.
“In such a federated learning scenario, no input training data is directly shared.Instead, partial AI models are being trained by nodes participating in the federated learning network, while training data provenance and the integrity of the partial AI models are preserved using a distributed ledger (Pandl et al. 2020).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Pandl et al. 2020 source
Not checked in the free run.
May combine two claims.
PremisecitationApproaches to quantify such uncertainties are often still in their infancy and not broadly available for all use cases.
“Although there exist first approaches in research and practice to quantify such uncertainties, these approaches are often still in their infancy and are not broadly available for all use cases (Begoli et al. 2019).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Begoli et al. 2019
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenThere remain several issues that warrant further research before DLT-based federated learning can be deployed in real-world use cases.
“However, there remain several issues that warrant further research before we will be able to deploy DLTbased federated learning in real-world use cases.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe opacity of most current AI models is a popular topic of contemporary AI research.
“Lastly, the opacity of most current AI models is one of the most popular topics of contemporary AI research (Rudin 2019).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Rudin 2019 source
Not checked in the free run.
Classified as probably not a substantial claim. May combine two claims.
InterpretationcitationEffective auditing of AI warrants creating an independent, tamper-resistant audit trail and continuous updating and assessment using continuous auditing procedures.
“Effective auditing of AI, therefore, does not only warrant creating an independent, tamper-resistant audit trail, but also the continuous updating and assessment of this audit trail using continuous auditing procedures (Lins et al. 2019).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lins et al. 2019 source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationcitationThe potential negative consequences of a token economy that could conflict with TAI warrant further research.
“The potential negative consequences of a token economy that could conflict with the realization of TAI, therefore, warrant further research.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThis opacity impedes interpretability of output data and obstructs establishing accountability.
“Not only does this impede the interpretability of output data but also obstruct establishing accountability.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationResearch has begun exploring DLT for auditing purposes in organizational contexts, and first results indicate feasibility of DLT for auditing AI.
“Owing to DLTs characteristics (e.g., decentralization, high tamper resistance), research has recently begun exploring the application of DLT for auditing purposes in organizational contexts (Hofman et al. 2019), while first research results also indicate the feasibility of DLT for the auditing of AI (Dillenberger et al. 2019).”
Quote in the paperSubstantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningSeveral non-technical questions require further research.
“Despite technical questions, several non-technical questions require further research.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationDLT enables coordination of economic activity through secure, transparent, decentralized electronic markets and is best known as blockchain.
“It enables the coordination of economic activity through the creation of secure, transparent, and decentralized electronic markets (Berg et al. 2019;Kollmann et al. 2019;Subramanian 2017), and is probably best known under the name of blockchain, which is a specific type of DLT (Kannengiesser et al. 2020;Sunyaev 2020).”
Quote in the paperNot a substantial claim0 of 3 sources checkedProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe design of effective token economies for democratizing access to AI models requires further research.
“Yet, analog to the question of how to design token economies capable of effectively democratizing access to input training data, the design of effective token economies for democratizing access to AI models requires further research.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
Interpretationnone givenThere is a vast space of TAI research opportunities for the IS and other research communities that is not limited to explainability.
“In doing so, we highlight a vast space of TAI research opportunities for the IS and other research communities that is not limited to the recent AI hype topic of explainability.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationAI-based systems have been shown to infer individuals' political views or sexual orientation from Facebook likes or predict mental state from posts.
“Toward this end, AI-based systems have, for example, been shown to be able to infer individuals' political views or sexual orientation based on the Facebook pages that they liked (Gibney 2018) or predicted the mental state of Facebook users based on an analysis of their posts (Goggin 2019).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Gibney 2018
Not checked in the free run.
- cites Goggin 2019
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenDLT-based data markets could serve as a means to address several tensions at the input and model stages.
“They are of particular interest for the electronic markets community and could serve as a means to address several tensions at the input and model stages.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Premisenone givenA central facet of establishing AI accountability concerns our ability to independently audit AI, especially data provenance and model uncertainty.
“A central facet of establishing AI accountability concerns our ability to independently audit AI (i.e., AI's auditability), especially in terms of data provenance (i.e., addressing the malicious training data tension) and the degree of uncertainty with which AI models make their predictions (i.e., addressing the model uncertainty tension).”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningDaRe4TAI provides guidance to study technical and non-technical means in support of TAI.
“Further, we drew on a data-driven perspective toward AI to develop the research framework DaRe4TAI that provides guidance to those enticed to study technical and non-technical means in support of TAI, and demonstrated its feasibility on the example of fruitful avenues for future research on the DLT-based realization of TAI.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe potential of a token economy for TAI extends to trading and licensing of other AI-related assets such as models or algorithms.
“Lastly, the potential of a token economy for TAI extends beyond the creation of data markets for input training data to the trading and licensing of other AI-related assets such as models or algorithms (i.e., addressing the model availability tension) (Sarpatwar et al. 2019).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sarpatwar et al. 2019 source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
PremisecitationDLT ought to serve as a tamper-resistant trail for tracking the flow of data within AI-based systems, which may then be further analyzed to create explainable AI models.
“DLT is thereby ought to serve as a tamper resistant trail for tracking the flow of data within AI-based systems, which may then be further analyzed to create explainable AI models (Dinh and Thai 2018).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Dinh and Thai 2018 source
Not checked in the free run.
May combine two claims.
PremisecitationMost research prototypes employ DLT-based federated learning to train relatively simple AI models, and extant research indicates a performance overhead of 5% to 15%.
“Most research prototypes, for example, employ DLT-based federated learning to train relatively simple AI models (Pandl et al. 2020;Preuveneers et al. 2018), while extant research indicates that DLT-based federated learning induces a performance overhead of 5% to 15% (Preuveneers et al. 2018).”
Quote in the paperSubstantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningTAI provides several promising avenues of future research for the field of electronic markets, including and beyond its DLT-based realization.
“Especially for the field of electronic markets, TAI provides several promising avenues of future research, including and beyond its DLT-based realization.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationnone givenThe feasibility of DaRe4TAI was demonstrated on the example of fruitful avenues for future research on the DLT-based realization of TAI.
“Further, we drew on a data-driven perspective toward AI to develop the research framework DaRe4TAI that provides guidance to those enticed to study technical and non-technical means in support of TAI, and demonstrated its feasibility on the example of fruitful avenues for future research on the DLT-based realization of TAI.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable).
Interpretationnone givenDaRe4TAI provides a good starting ground for exploring further tensions and revealing additional avenues for future research on technical and non-technical means in support of TAI.
“Nevertheless, we are convinced that DaRe4TAI provides a good starting ground for exploring further tensions and, thus, revealing additional avenues for future research on technical and non-technical means in support of TAI.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThe tensions between data at the different stages of the AI co-creation process and the five TAI principles outlined represent only a subset of tensions.
“The tensions between data at the different stages of the AI co-creation process and the five TAI principles that we outlined here represent only a subset of tensions.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
Today's AI-based systems are complex systems that mostly function as black boxes and therefore suffer from opacity and a lack of accountability.
“A central reason for this lies in the fact that today's AI-based systems are complex systems that mostly function as black boxes and therefore suffer from opacity and a lack of accountability.”
The paper relies on this without support.
Most AI-based systems developed, deployed, and in use today rely on machine learning or deep learning methods.
“While there exist various approaches to create AI-based systems, most systems that are developed, deployed, and in use today rely on machine learning, or for that matter, deep learning methods.”
The paper relies on this without support.
The creation of high-quality training data is costly and time-consuming, especially when expert knowledge is required.
“However, the creation of high-quality training data is costly and time-consuming, especially when expert knowledge is required (e.g., labeling of thousands of medical images).”
The paper relies on this without support.
Large, high-quality data sets are either under the control of a few large enterprises or limited to a few specific application areas.
“As a result, large, high-quality data sets are either under the control of a few large enterprises or, in the case of freely available high-quality data sets, are limited to a few specific application areas (e.g., a certain disease).”
The paper relies on this without support.
AI possesses the inherent ability to infringe people's privacy.
“AI possesses the inherent ability to infringe people's privacy.”
The paper relies on this without support.
The development and training of an AI model is an expensive and time-consuming task.
“Similar to input data, the development and training of an AI model is an expensive and time-consuming task.”
The paper relies on this without support.
Inferences made by AI models are associated with some uncertainty.
“Inferences made by AI models are associated with some uncertainty.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A main aspect of the study of trustworthy AI starts by analyzing the risk and threat of AI and derives the requirements of trustworthiness.
“A main aspect of this study starts by analyzing the risk, and threat of AI and derives the requirements of trustworthiness [77].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [77]
The Introduction (page unavailable) discusses AI risks and dangers, and the Definition and principles section (page unavailable) sets out conditions for trustworthy AI. The Framework overview describes identifying tensions between AI practices and trustworthiness principles, but does not say the study starts with a risk-and-threat analysis from which it derives trustworthiness requirements. (LLM, conf=0.82)
Experimental — accuracy not yet measured[77] simplifies the system lifecycle as the flow of data and technically analyzes threats existing at each flow stage.
“[77] simplifies the system lifecycle as the flow of data and technically analyzes threats existing at each flow stage.”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [77]
The Framework overview (page unavailable) describes AI as a flow from input data through modeling to output data, and says the paper identifies tensions at each stage. The Input, Model, and Output stage sections give examples of risks, including malicious training data and privacy infringement. But the paper frames these as exemplary tensions with trustworthy-AI principles, not as a technical threat analysis at each stage. (LLM, conf=0.84)
Experimental — accuracy not yet measuredAI governance has become a key issue widely concerned and discussed by various stakeholders.
“As AI technology continues to advance and to be widely adopted, the governance of its development and implementation has become a key issue that is widely concerned and discussed by various stakeholders [14].”
From AI Governance in Higher Education: Case Studies of Guidance at Big Ten Universities (2024) · cites this paper as [14]
The development of sustainability screens or indexes could reduce the burden of understanding data analytics by facilitating the generation of synthetic data visualisations.
“To this effect, the development of sustainability screens or indexes could reduce the burden of understanding data analytics by facilitating the generation of synthetic data visualisations.142”
From Artificial Intelligence and Sustainable Decisions (2023) · cites this paper as [142]
Biases in training data could lead to unequal or unfair treatment outcomes.
“It involves actively working to mitigate risks, such as biases in training data, that could lead to unequal or unfair treatment outcomes [50].”
From Proposing a Principle-Based Approach for Teaching AI Ethics in Medical Education (2024) · cites this paper as [50]
Treatment recommendations from AI in medicine could lead to disadvantages for different groups or individuals due to risk of bias from unrepresentative training data, directly conflicting with the principle of justice.
“Owing to the risk of bias due to unrepresentative training data, for example, treatment recommendations from the use of AI in medicine could lead to disadvantages for different groups or individuals, directly conflicting with the principle of justice [50].”
From Proposing a Principle-Based Approach for Teaching AI Ethics in Medical Education (2024) · cites this paper as [50]
Cites
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736 · see citing works
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · see citing works
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423 · cited 1× · see citing works
“…can be divided into research focusing on the creation of transparent and inter-pretable models (e.g., via decision trees, rule-based learning, or Bayesian models) and research focusing on establishing post-hoc explainability (e.g., via heat maps, or backpropagation) (Barredo Arrieta et al. 2020).”
BackgroundTrust and TAM in Online Shopping: An Integrated Model1
Gefen, D., Karahanna, E., & Straub, D. W. (2003) · MIS Quarterly · doi:10.2307/30036519 · Cited by 8,635 · see citing works
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 4× · see citing works
“Obermeyer et al. (2019), for example, found that a widely used AI in US hospitals is negatively biased toward Black patients, since it uses health costs spent on patients as a proxy for health needs and since on average less money is spent on Black patients in the US.”
BackgroundMethodInfluentialTrust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 7× · see citing works
“Lee and See 2004).”
BackgroundInfluentialPeeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294 · see citing works
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · cited 1× · see citing works
“There are, for example, currently more than 60 high-level guidelines for the development and deployment of ethical AI (Jobin et al. 2019).”
BackgroundA Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812 · see citing works
Developing and validating trust measures for e-commerce: an integrative typology
McKnight, D. H., Choudhury, V., & Kacmar, C. (2002) · Information Systems Research · doi:10.1287/isre.13.3.334.81 · Cited by 5,550 · see citing works
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774 · cited 11× · see citing works
“…for beneficial AI (Future of Life Institute 2017), responsible AI (Chinese National Governance Committee for the New Generation Artificial Intelligence 2019; Université de Montréal 2017; Wiens et al. 2019) , or ethical AI (Floridi et al. 2018; UK House of Lords 2017) during the last few years.”
BackgroundMethodInfluentialMembership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754 · see citing works
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 2× · see citing works
“AI-based systems’ autonomous and intelligence-based capabilities allow them to have a great degree of self-governance, which enables them to respond to situations that were not pre-programmed or explicitly anticipated during their development, and to make independent decisions and action selection with little or no co…”
BackgroundHaenlein, M., & Kaplan, A. (2019) · California Management Review · doi:10.1177/0008125619864925 · Cited by 2,655 · see citing works
Developing and Maintaining Trust in Work Relationships
Lewicki, R. J., & Bunker, B. B. (1996) · Sage eBooks · doi:10.4135/9781452243610.n7 · Cited by 2,611 · see citing works
What trust means in e-commerce customer relationships: an interdisciplinary conceptual typology
McKnight, D. H., & Chervany, N. L. (2001) · International Journal of Electronic Commerce · doi:10.1080/10864415.2001.11044235 · Cited by 2,282 · see citing works
The Ethics of AI Ethics: An Evaluation of Guidelines
Hagendorff, T. (2020) · Minds and Machines · doi:10.1007/s11023-020-09517-8 · Cited by 1,911 · cited 3× · see citing works
“…and AI ethics, which focus on discussing foundational ethical themes (e.g., general ethics frameworks) (Floridi 2019; Floridi and Cowls 2019; Floridi et al. 2018; Hagendorff 2020) and how to embed values that promote wellbeing into AI at the design and development stages (de Swarte et al. 2019).”
BackgroundThe forthcoming artificial intelligence (AI) revolution: Its impact on society and firms
Makridakis, S. (2017) · Futures · doi:10.1016/j.futures.2017.03.006 · Cited by 1,866 · cited 1× · see citing works
“As a form of intellectual property, AI models increasingly represent an important factor in achieving competitive advantages (Haenlein and Kaplan 2019; Makridakis 2017).”
BackgroundExploiting Unintended Feature Leakage in Collaborative Learning
Melis, L., Song, C., De Cristofaro, E., & Shmatikov, V. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00029 · Cited by 1,734 · see citing works
A Unified Framework of Five Principles for AI in Society
Floridi, L., & Cowls, J. (2019) · Harvard Data Science Review · doi:10.1162/99608f92.8cd550d1 · Cited by 1,631 · cited 9× · see citing works
“Toward this end, “ [one] must be able to understand the good or harm [AI] is actually doing to society, and in which ways ” (Floridi and Cowls 2019) for it to be beneficent and non-maleficent.”
BackgroundInfluentialHuman–Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2008) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000005 · Cited by 1,541 · see citing works
Explainable AI: From black box to glass box
Rai, A. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00710-5 · Cited by 1,317 · see citing works
Do no harm: a roadmap for responsible machine learning for health care
Wiens, J., Saria, S., Sendak, M., Ghassemi, M., Liu, V. X., Doshi-Velez, F., Jung, K., Heller, K., Kale, D., Saeed, M., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0548-6 · Cited by 1,266 · see citing works
AI-based chatbots in customer service and their effects on user compliance
Adam, M., Wessel, M., & Benlian, A. (2021) · Electronic Markets · doi:10.1007/s12525-020-00414-7 · Cited by 1,195 · cited 1× · see citing works
“Electronic markets, for example, are increasingly augmented with AI-based systems such as customer service chatbots (Adam et al. 2020).”
BackgroundTrust in a specific technology: An investigation of its components and measures
Mcknight, D. H., Carter, M., Thatcher, J. B., & Clay, P. F. (2011) · ACM Transactions on Management Information Systems · doi:10.1145/1985347.1985353 · Cited by 1,185 · see citing works
Human-Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601980939 · Cited by 1,104 · see citing works
AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias
Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilović, A., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2942287 · Cited by 884 · see citing works
Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning
Wang, Z., Song, M., Zhang, Z., Song, Y., Wang, Q., & Qi, H. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737416 · Cited by 881 · see citing works
Trust In and Adoption of Online Recommendation Agents
Benbasat, I., & Wang, W. (2005) · Journal of the Association for Information Systems · doi:10.17705/1jais.00065 · Cited by 847 · see citing works
Toward Contextualized Theories of Trust: The Role of Trust in Global Virtual Teams
Jarvenpaa, S. L., Shaw, T. R., & Staples, D. S. (2004) · Information Systems Research · doi:10.1287/isre.1040.0028 · Cited by 773 · see citing works
Schaefer, K. E., Chen, J. Y. C., Szalma, J. L., & Hancock, P. A. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816634228 · Cited by 768 · see citing works
Autonomous Vehicle Safety: An Interdisciplinary Challenge
Koopman, P., & Wagner, M. (2017) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2016.2583491 · Cited by 688 · see citing works
A Survey and Analysis of Multi-Robot Coordination
Yan, Z., Jouandeau, N., & Ali-Chérif, A. (2013) · International Journal of Advanced Robotic Systems · doi:10.5772/57313 · Cited by 651 · see citing works
Floridi, L., & Taddeo, M. (2016) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2016.0360 · Cited by 637 · see citing works
Examining Trust in Information Technology Artifacts: The Effects of System Quality and Culture
Vance, A., Elie-Dit-Cosaque, C., & Straub, D. W. (2008) · Journal of Management Information Systems · doi:10.2753/mis0742-1222240403 · Cited by 599 · see citing works
The need for uncertainty quantification in machine-assisted medical decision making
Begoli, E., Bhattacharya, T., & Kusnezov, D. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-018-0004-1 · Cited by 597 · see citing works
Technology, Humanness, and Trust: Rethinking Trust in Technology
Marshall University, Lankton, N., McKnight, D. H., Michigan State University, Tripp, J., & Baylor University (2015) · Journal of the Association for Information Systems · doi:10.17705/1jais.00411 · Cited by 553 · cited 4× · see citing works
“…relationships in such scenarios, two research streams emerged that either adapted the concept of interpersonal trust to conceptualize trust in human-like IT artifacts (Lankton et al. 2015), or revised the concept of trust in technology to account for automation technology and autonomous systems (J.”
BackgroundInfluentialArtificial General Intelligence: Concept, State of the Art, and Future Prospects
Goertzel, B. (2014) · Journal of Artificial General Intelligence · doi:10.2478/jagi-2014-0001 · Cited by 525 · see citing works
Individual Swift Trust and Knowledge-Based Trust in Face-to-Face and Virtual Team Members
Robert, L. P., Denis, A. R., & Hung, Y.-T. C. (2009) · Journal of Management Information Systems · doi:10.2753/mis0742-1222260210 · Cited by 514 · see citing works
Establishing the rules for building trustworthy AI
Floridi, L. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0055-y · Cited by 394 · see citing works
The Ethics of AI Ethics: An Evaluation of Guidelines
Hagendorff, T. (2020) · PhilPapers (PhilPapers Foundation) · Cited by 394 · see citing works
Paul, D. L., & McDaniel, R. R. (2004) · MIS Quarterly · doi:10.2307/25148633 · Cited by 385 · see citing works
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000375277 · Cited by 360 · see citing works
Toward Human-Understandable, Explainable AI
Hagras, H. (2018) · Computer · doi:10.1109/mc.2018.3620965 · Cited by 350 · see citing works
Chained Anomaly Detection Models for Federated Learning: An Intrusion Detection Case Study
Preuveneers, D., Rimmer, V., Tsingenopoulos, I., Spooren, J., Joosen, W., & Ilie-Zudor, E. (2018) · Applied Sciences · doi:10.3390/app8122663 · Cited by 323 · see citing works
AI and Blockchain: A Disruptive Integration
Dinh, T. N., & Thai, M. T. (2018) · Computer · doi:10.1109/mc.2018.3620971 · Cited by 317 · see citing works
Decentralized blockchain-based electronic marketplaces
Subramanian, H. (2017) · Communications of the ACM · doi:10.1145/3158333 · Cited by 264 · see citing works
Slalom: Fast, Verifiable and Private Execution of Neural Networks in Trusted HardwarePreprint
Tramèr, F., & Boneh, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.03287 · Cited by 263 · see citing works
Why different trust relationships matter for information systems users
Söllner, M., Hoffmann, A., & Leimeister, J. M. (2016) · European Journal of Information Systems · doi:10.1057/ejis.2015.17 · Cited by 223 · see citing works
Sarwate, A. D., & Chaudhuri, K. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2259911 · Cited by 211 · see citing works
Bias detectives: the researchers striving to make algorithms fair
Courtland, R. (2018) · Nature · doi:10.1038/d41586-018-05469-3 · Cited by 205 · see citing works
Application Management in Fog Computing Environments
Mahmud, R., Ramamohanarao, K., & Buyya, R. (2020) · ACM Computing Surveys · doi:10.1145/3403955 · Cited by 203 · see citing works
Thatcher, J. B., McKnight, D. H., Baker, E. W., Arsal, R. E., & Roberts, N. H. (2011) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2009.2028320 · Cited by 196 · see citing works
Trade-offs between Distributed Ledger Technology Characteristics
Kannengießer, N., Lins, S., Dehling, T., & Sunyaev, A. (2020) · ACM Computing Surveys · doi:10.1145/3379463 · Cited by 186 · see citing works
Self-citationAl‐Natour, S., Benbasat, I., & Cenfetelli, R. T. (2011) · Journal of the Association for Information Systems · doi:10.17705/1jais.00267 · Cited by 166 · see citing works
Imposing limits on autonomous systems
Hancock, P. A. (2017) · Ergonomics · doi:10.1080/00140139.2016.1190035 · Cited by 162 · see citing works
The Secretive Company That Might End Privacy as We Know It *
Hill, K. (2022) · Auerbach Publications eBooks · doi:10.1201/9781003278290-26 · Cited by 158 · see citing works
Realizing the potential of blockchain technologies in genomics
Ozercan, H. I., Ileri, A. M., Ayday, E., & Alkan, C. (2018) · Genome Research · doi:10.1101/gr.207464.116 · Cited by 143 · see citing works
Machine learning based privacy-preserving fair data trading in big data market
Zhao, Y., Yu, Y. H., Li, Y., Han, G., & Du, X. (2018) · Information Sciences · doi:10.1016/j.ins.2018.11.028 · Cited by 143 · see citing works
The Structure of Interpersonal Trust in the Workplace
Schindler, P. L., & Thomas, C. C. (1993) · Psychological Reports · doi:10.2466/pr0.1993.73.2.563 · Cited by 136 · see citing works
Towards Dependable, Scalable, and Pervasive Distributed Ledgers with Blockchains
Zhang, K., & Jacobsen, H. (2018) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2018.00134 · Cited by 133 · see citing works
IDMoB: IoT Data Marketplace on Blockchain
Özyılmaz, K. R., Dogan, M., & Yurdakul, A. (2018) · doi:10.1109/cvcbt.2018.00007 · Cited by 130 · see citing works
Pandl, K. D., Thiebes, S., Schmidt-Kraepelin, M., & Sunyaev, A. (2020) · IEEE Access · doi:10.1109/access.2020.2981447 · Cited by 115 · see citing works
Self-citationRay, S., Ow, T. T., & Kim, S. S. (2011) · Decision Sciences · doi:10.1111/j.1540-5915.2011.00316.x · Cited by 111 · see citing works
Smart Contract Based Data Trading Mode Using Blockchain and Machine Learning
Xiong, W., & Xiong, L. (2019) · IEEE Access · doi:10.1109/access.2019.2928325 · Cited by 106 · see citing works
Adjustable autonomy: a systematic literature review
Mostafa, S. A., Ahmad, M. S., & Mustapha, A. (2017) · Artificial Intelligence Review · doi:10.1007/s10462-017-9560-8 · Cited by 98 · see citing works
Editor’s Comments: Next-Generation Digital Platforms: Toward Human–AI Hybrids
Rai, A., Constantinides, P., & Sarker, S. (2019) · Journal of the Association for Information Systems · Cited by 96 · see citing works
Understanding the creation of trust in cryptocurrencies: the case of Bitcoin
Marella, V., Upreti, B., Merikivi, J., & Tuunainen, V. K. (2020) · Electronic Markets · doi:10.1007/s12525-019-00392-5 · Cited by 96 · see citing works
Blockchain analytics and artificial intelligence
Dillenberger, D. N., Novotny, P., Zhang, Q., Jayachandran, P., Gupta, H., Hans, S., Verma, D., Chakraborty, S., Thomas, J. J., Walli, M. M., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2900638 · Cited by 82 · see citing works
(2020) · Springer eBooks · doi:10.1007/978-3-030-34957-8 · Cited by 76 · see citing works
Sustainable Growth and Token Economy Design: The Case of Steemit
Kim, M. S., & Chung, J. Y. (2018) · Sustainability · doi:10.3390/su11010167 · Cited by 74 · see citing works
Artificial intelligence, ethics and human values: the cases of military drones and companion robots
de Swarte, T., Boufous, O., & Escalle, P. (2019) · Artificial Life and Robotics · doi:10.1007/s10015-019-00525-1 · Cited by 72 · see citing works
Blockchain Technology as Economic Infrastructure: Revisiting the Electronic Markets Hypothesis
Berg, C., Davidson, S., & Potts, J. (2019) · Frontiers in Blockchain · doi:10.3389/fbloc.2019.00022 · Cited by 67 · see citing works
Negotiating autonomy and responsibility in military robots
Noorman, M. E., & Johnson, D. G. (2014) · Ethics and Information Technology · doi:10.1007/s10676-013-9335-0 · Cited by 66 · see citing works
Trust in Cloud Computing: Conceptual Typology and Trust-Building Antecedents
Lansing, J., & Sunyaev, A. (2016) · ACM SIGMIS Database: the DATABASE for Advances in Information Systems · doi:10.1145/2963175.2963179 · Cited by 64 · see citing works
Self-citationTowards Enabling Trusted Artificial Intelligence via Blockchain
Sarpatwar, K., Vaculin, R., Min, H., Su, G., Heath, T., Ganapavarapu, G., & Dillenberger, D. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-17277-0_8 · Cited by 50 · see citing works
A Classification and Investigation of Trustees in B-to-C e-Commerce: General vs. Specific Trust
Thatcher, J. B., Carter, M., Li, X., & Rong, G. (2013) · Communications of the Association for Information Systems · doi:10.17705/1cais.03204 · Cited by 49 · see citing works
The scant science behind Cambridge Analytica’s controversial marketing techniques
Gibney, E. (2018) · Nature · doi:10.1038/d41586-018-03880-4 · Cited by 48 · see citing works
Kollmann, T., Hensellek, S., de Cruppe, K., & Sirges, A. (2019) · Electronic Markets · doi:10.1007/s12525-019-00369-4 · Cited by 47 · see citing works
Evolution and perspectives of electronic markets
Alt, R. (2020) · Electronic Markets · doi:10.1007/s12525-020-00413-8 · Cited by 46 · see citing works
Internet Computing: Principles of Distributed Systems and Emerging Internet-Based Technologies
Sunyaev, A. (2020) · Cited by 41 · see citing works
Self-citationHofman, D., Lemieux, V. L., Joo, A., & Batista, D. A. (2019) · Records Management Journal · doi:10.1108/rmj-12-2018-0045 · Cited by 40 · see citing works
Is there a market for trusted car data?
Bauer, I., Zavolokina, L., & Schwabe, G. (2019) · Electronic Markets · doi:10.1007/s12525-019-00368-5 · Cited by 40 · see citing works
The “Theoretical Lens” Concept: We All Know What it Means, but do We All Know the Same Thing?
Niederman, F., & March, S. T. (2019) · Communications of the Association for Information Systems · doi:10.17705/1cais.04401 · Cited by 36 · see citing works
From electronic markets to data driven insights
Selz, D. (2020) · Electronic Markets · doi:10.1007/s12525-019-00393-4 · Cited by 35 · see citing works
What are the OECD Principles on AI?
OECD (2019) · OECD Observer · doi:10.1787/6ff2a1c4-en · Cited by 35 · see citing works
Lins, S., Schneider, S., Szefer, J., Ibraheem, S., & Ali, A. (2019) · Communications of the Association for Information Systems · doi:10.17705/1cais.04425 · Cited by 26 · see citing works
Self-citationAnalyzing Human Trust of Autonomous Systems in Hazardous Environments
Stormont, D. P. (2008) · Cited by 24 · see citing works
Distributed Ledger Technology in genomics: a call for Europe
Thiebes, S., Schlesner, M., Brors, B., & Sunyaev, A. (2019) · European Journal of Human Genetics · doi:10.1038/s41431-019-0512-4 · Cited by 24 · see citing works
Self-citationDakkak, A., Li, C., de Gonzalo, S. G., et al. (2019) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud.2019.00067 · Cited by 17 · see citing works
Organizational responses to crisis: The role of mutual trust and top management teams.
Mishra, A. K. (1992) · Deep Blue (University of Michigan) · Cited by 15 · see citing works
Editor'S comments: next-generation digital platforms
RaiArun, ConstantinidesPanos, & SarkerSaonee (2019) · MIS Quarterly · doi:10.5555/3370135.3370136 · Cited by 12 · see citing works
Token Economics in Real-Life: Cryptocurrency and Incentives Design for Insolar’s Blockchain NetworkPreprint
Laskowski, M., Kim, H., Zargham, M., Barlin, M., & Kabanov, D. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3465085 · Cited by 9 · see citing works
Token Economics in Real-Life: Cryptocurrency and Incentives Design for Insolar Blockchain NetworkPreprint
Kim, H., Laskowski, M., Zargham, M., Turesson, H., Barlin, M., & Kabanov, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.02064 · Cited by 2 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- John, M., Marvin, L. M., Nathaniel, R., & Claude, E. S. (2006). A proposal for the Dartmouth summer research project on artificial intelligence, august 31, 1955. AI Magazine, 27(4), 12–14. https://doi.org/10.1609/aimag.v27i4.1904. · DOI
- Smith, V., Chiang, C, K., Sanjabi, M., & Talwalkar, A. S. (2017). Federated multi-task learning. Paper presented at the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA,
Cited by
Sorted by citations
Interpretable machine learning: Fundamental principles and 10 grand challenges
Rudin, C., Chen, C., Chen, Z., Huang, H., Semenova, L., & Zhong, C. (2022) · Statistics Surveys · doi:10.1214/21-ss133 · Cited by 958 · see citing works
Trust in AI and Its Role in the Acceptance of AI Technologies
Choung, H., David, P., & Ross, A. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2050543 · Cited by 963 · see citing works
“Such concerns, compounded by the erosion of trust in institutions and governments (Edelman, 2021), underscore the importance of building trustworthy AI system to instill confidence among users (Gillath et al., 2021; Thiebes et al., 2020) and to further our understanding of the social and psychological mechanisms of tr…”
BackgroundTrustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612 · see citing works
Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI
Jacovi, A., Marasović, A., Miller, T., & Goldberg, Y. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445923 · Cited by 545 · see citing works
Responsible Artificial Intelligence Governance: A Review and Research Framework
Papagiannidis, E., Mikalef, P., & Conboy, K. (2025) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2024.101885 · Cited by 565 · see citing works
Thinking responsibly about responsible AI and ‘the dark side’ of AI
Mikalef, P., Conboy, K., Lundström, J. E., & Popovič, A. (2022) · European Journal of Information Systems · doi:10.1080/0960085x.2022.2026621 · Cited by 435 · see citing works
A Review of Trustworthy and Explainable Artificial Intelligence (XAI)
Chamola, V., Hassija, V., Sulthana, A. R., Ghosh, D., Dhingra, D., & Sikdar, B. (2023) · IEEE Access · doi:10.1109/access.2023.3294569 · Cited by 352 · see citing works
Weber, P., Carl, K. V., & Hinz, O. (2024) · Management Review Quarterly · doi:10.1007/s11301-023-00320-0 · Cited by 292 · see citing works
“Recent calls for, e.g., trustworthy (Thiebes et al. 2021) or sustainable AI (Bawack et al. 2022) underline the need for an exaggerated concept of AI.”
Hermann, E. (2022) · New Media & Society · doi:10.1177/14614448211022702 · Cited by 214 · see citing works
Artificial Intelligence and Sustainable Decisions
Zhao, J., & Gómez Fariñas, B. (2023) · European Business Organization Law Review · doi:10.1007/s40804-022-00262-2 · Cited by 197 · see citing works
Artificial intelligence in public services: When and why citizens accept its usage
Gesk, T. S., & Leyer, M. (2022) · Government Information Quarterly · doi:10.1016/j.giq.2022.101704 · Cited by 195 · see citing works
Wang, C., Teo, T. S. H., & Janssen, M. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2021.102401 · Cited by 161 · see citing works
Toward Trustworthy Artificial Intelligence (TAI) in the Context of Explainability and Robustness
chander, B., John, C., Warrier, L., & Gopalakrishnan, K. (2025) · ACM Computing Surveys · doi:10.1145/3675392 · Cited by 108 · see citing works
Proposing a Principle-Based Approach for Teaching AI Ethics in Medical Education
Weidener, L., & Fischer, M. (2024) · JMIR Medical Education · doi:10.2196/55368 · Cited by 90 · see citing works
AI Governance in Higher Education: Case Studies of Guidance at Big Ten Universities
Wu, C., Zhang, H., & Carroll, J. M. (2024) · Future Internet · doi:10.3390/fi16100354 · Cited by 99 · see citing works
“As AI technology continues to advance and to be widely adopted, the governance of its development and implementation has become a key issue that is widely concerned and discussed by various stakeholders (Erd´elyi and Gold-smith 2018; Thiebes, Lins, and Sunyaev 2021; Bucknall and Dori-Hacohen 2022).”
Ofosu-Ampong, K. (2024) · Telematics and Informatics Reports · doi:10.1016/j.teler.2024.100127 · Cited by 81 · see citing works
Ortega-Bolaños, R., Bernal-Salcedo, J., Germán Ortiz, M., Galeano Sarmiento, J., Ruz, G. A., & Tabares-Soto, R. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10740-3 · Cited by 76 · see citing works
Baroni, I., Re Calegari, G., Scandolari, D., & Celino, I. (2022) · Human Computation · doi:10.15346/hc.v9i1.134 · Cited by 65 · see citing works
The use of AI in mental health services to support decision-making: scoping review
Auf, H., Svedberg, P., Nygren, J., Nair, M., & Lundgren, L. E. (2025) · Journal of Medical Internet Research · doi:10.2196/63548 · Cited by 56 · see citing works
Establishing and evaluating trustworthy AI: overview and research challenges
Kowald, D., Scher, S., Pammer-Schindler, V., Müllner, P., Waxnegger, K., Demelius, L., Fessl, A., Toller, M., Mendoza Estrada, I. G., Šimić, I., et al. (2024) · Frontiers in Big Data · doi:10.3389/fdata.2024.1467222 · Cited by 59 · see citing works
Psychological Traits and Appropriate Reliance: Factors Shaping Trust in AI
Küper, A., & Krämer, N. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2024.2348216 · Cited by 49 · see citing works
CausPref: Causal Preference Learning for Out-of-Distribution Recommendation
He, Y., Wang, Z., Cui, P., Zou, H., Zhang, Y., Cui, Q., & Jiang, Y. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3511969 · Cited by 50 · see citing works
Exploring the impact of security technologies on mental health: a comprehensive review
Malik, A. S., Acharya, S., & Humane, S. (2024) · Cureus · doi:10.7759/cureus.53664 · Cited by 32 · see citing works
Should Users Trust Advanced AI Assistants? Justified Trust As a Function of Competence and Alignment
Manzini, A., Keeling, G., Marchal, N., McKee, K. R., Rieser, V., & Gabriel, I. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658964 · Cited by 28 · see citing works
“Indeed, most contemporary models of trust in technology adopt a ‘dualistic perspective on trust’ [133] which includes both trust in the technology itself (including its functionality and capabilities) and trust in the individuals and organisations developing the technology (encompassing their…”
BackgroundKüper, A., Lodde, G. C., Livingstone, E., Schadendorf, D., & Krämer, N. (2025) · Journal of Medical Internet Research · doi:10.2196/58660 · Cited by 31 · see citing works
“Research ranges from system acceptance and adoption [39,40] to specific investigations of trust in systems [41-44] to the calibration of trust and the appropriateness of reliance [8,9,45-49].”
Interpretable Goal Recognition in the Presence of Occluded Factors for Autonomous Vehicles
Hanna, J. P., Rahman, A., Fosong, E., Eiras, F., Dobre, M., Redford, J., Ramamoorthy, S., & Albrecht, S. V. (2021) · 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9635903 · Cited by 21 · see citing works
High-risk artificial intelligence
Sunyaev, A., Benlian, A., Pfeiffer, J., Jussupow, E., Thiebes, S., Maedche, A., & Gawlitza, J. (2025) · Business & Information Systems Engineering · doi:10.1007/s12599-025-00942-6 · Cited by 16 · see citing works
Self-citationGuglielmucci, F., & Di Basilio, D. (2025) · JMIR Human Factors · doi:10.2196/70698 · Cited by 10 · see citing works
Are numerical or verbal explanations of AI the key to appropriate user reliance and error detection?
Papenkordt, J., Ngonga Ngomo, A.-C., & Thommes, K. (2026) · Behaviour & Information Technology · doi:10.1080/0144929x.2025.2568928 · Cited by 2 · see citing works
“This leads to a mismatch between our technological capabilities and our social and personal readiness for this technology, especially given its rapid development (Thiebes, Lins, and Sunyaev 2021).”
A Systematic Review of Ethical Integration of Generative AI in Higher Education
Yarboi, P. Y., Adu-Manu, K. S., Amponsah, S., Oheneba-Sakyi, Y., & Barimah, A. (2026) · Education Sciences · doi:10.3390/educsci16071016 · Cited by 1 · see citing works
- Authors
- Thiebes, S., Lins, S., & Sunyaev, A.
- Affiliations
- Karlsruhe Institute of Technology (DE)
- Corresponding author
- Sunyaev, Ali
- Venue
- Electronic Markets
- Published
- 2020-10-01
- Volume
- 31
- Issue
- 2
- Pages
- 447-464
- ISSN
- 1019-6781 (ISSN-L)
- 1422-8890
- OpenAlex
- W3090117266
- Semantic Scholar
- 9da092d7c7674e96830f8d6713a9a4f8101f984c
- Cited by
- 595
- References
- 94
- Citations by year
- 2026: 92 · 2025: 149 · 2024: 109 · 2023: 118 · 2022: 83 · 2021: 42 · 2020: 1 · 2017: 1
- FWCI
- 83.03
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Electronic Markets (publishedVersion, cc-by)
- Repository KITopen (Karlsruhe Institute of Technology) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Econstor (Econstor) (submittedVersion, cc-by)
- KITopen (cc-by)
- Funders
- Karlsruher Institut für Technologie (KIT)
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Law › Digitalization, Law, and Regulation
- Keywords
- trustworthy AI, AI ethics, beneficence, non-maleficence, autonomy, justice, explainability, distributed ledger technology, blockchain, research framework
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-08.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-08.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review