Epistemic Injustice in Generative AI
Open accessAbstract
This paper investigates how generative AI can potentially undermine the integrity of collective knowledge and the processes we rely on to acquire, assess, and trust information, posing a significant threat to our knowledge ecosystem and democratic discourse. Grounded in social and political philosophy, we introduce the concept of generative algorithmic epistemic injustice. We identify four key dimensions of this phenomenon: amplified and manipulative testimonial injustice, along with hermeneutical ignorance and access injustice. We illustrate each dimension with real-world examples that reveal how generative AI can produce or amplify misinformation, perpetuate representational harm, and create epistemic inequities, particularly in multilingual contexts. By highlighting these injustices, we aim to inform the development of epistemically just generative AI systems, proposing strategies for resistance, system design principles, and two approaches that leverage generative AI to foster a more equitable information ecosystem, thereby safeguarding democratic values and the integrity of knowledge production.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
20 of 45 cited sources checked · 10 supported · 0 flagged · accuracy not yet measured
- Premisecitation
Generative AI misuse includes parroting harmful stereotypes and misconceptions about certain social groups.
“These range from parroting harmful stereotypes and misconceptions about certain social groups (Bianchi et al. 2023;Ferrara 2023)”
Quote in the paperSubstantial claim1 of 2 sources checked - Premisecitation
Conspiracy theories often disproportionately harm marginalized groups.
“Conspiracy theories often disproportionately harm marginalized groups (Jaiswal, LoSchiavo, and Perl-man 2020)”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Jaiswal, LoSchiavo, and Perlman 2020 source
- Premisecitation
Conspiracy theories are sometimes weaponized against marginalized groups to justify oppression.
“and are sometimes weaponized against them to justify oppression (Nera, Bertin, and Klein 2022).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Nera, Bertin, and Klein 2022 source
- Premisecitation
A study of automated speech recognition showed that African American users had difficulty controlling voice-activated technologies unless they accommodated their speech patterns.
“For example, a study of automated speech recognition showed that African American users had difficulty controlling voice-activated technologies unless they accommodated their speech patterns (Mengesha et al. 2021).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Mengesha et al. 2021 source
- Premisecitation
Representational harms can also arise from AI's synthesis of culturally incongruous concepts.
“However, these harms can also arise from the AI's synthesis of culturally incongruous concepts (Prabhakaran, Qadri, and Hutchinson 2022).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Prabhakaran, Qadri, and Hutchinson 2022 source
- Interpretationcitation
Epistemic injustices cannot be evaluated by traditional machine learning methods that measure a computer's behavior in isolation of human judgment.
“they cannot be evaluated by traditional machine learning methods, which measure a computer's behavior in isolation of human judgment (Weidinger et al. 2023).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Weidinger et al. 2023 source
Section 5.4.2 says automated tests and benchmarks cannot capture the scope of complex, real-world harms, and Section 4.2.2 says evaluating effects on people requires human participants. Our copy does not specifically discuss epistemic injustice or establish that it cannot be evaluated by traditional machine-learning methods, so the claim is more categorical and specific than the source supports. (LLM, conf=0.82)
Experimental — accuracy not yet measured
- Interpretationcitation
Generative AI models' holistic understanding of the world cannot be said to resemble ours.
“Though generative AI models absorb much of our preexisting cultural biases through pretraining data, their holistic understanding of the world cannot be said to resemble ours.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Bender and Koller 2020 source
The Introduction says large neural language models are not nearly-there solutions to human-analogous language understanding, which requires grounding language in the world. Section 3.2 likewise argues that models trained only on linguistic form lack a connection between their utterances and the world. This supports the comparison with human understanding, but the paper does not make the broader claim about all generative AI models’ holistic understanding of the world. (LLM, conf=0.82)
Experimental — accuracy not yet measured
- Premisecitation
Kazenwadel and Steinert (2023) found that GPT-3.5 reported lower average fatality counts in Turkish than in Kurmanji for an airstrike targeting alleged PKK members.
“for example, when asked about an airstrike targeting alleged PKK members (the Kurdistan military resistance), the fatality count is reported lower on average in Turkish than in Kurmanji (Northern Kurdish).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Kazenwadel and Steinert (2023) source
- Premisecitation
Generative AI outputs can be highly persuasive due to their manipulation of cognitive biases.
“Furthermore, the outputs of generative AI can be highly persuasive due to their manipulation of our cognitive biases (El-Sayed et al. 2024).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites El-Sayed et al. 2024 source
- Premisecitation
Large language models can perform performative-like statements that can change aspects of the world.
“Large language models not only produce declarativelike statements but also can perform performative-like statements that can change aspects of the world (Kasirzadeh and Gabriel 2023).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Kasirzadeh and Gabriel 2023 source
Section 3.1 defines performatives as utterances that change part of reality and discusses performatives issued by conversational agents. But it says the majority of those utterances do not bring about the change because the agent lacks the necessary authority. The claim omits that important limitation. (LLM, conf=0.85)
Experimental — accuracy not yet measured
- Premisecitation
Fine-tuning efforts via RLHF or other methods are motivated by aligning the outputs of a pretrained model with an acceptable imitation of an ideal for an obedient assistant.
“This is the motivation for fine-tuning efforts via RLHF or other methods: to align the outputs of a pretrained model with an acceptable imitation of an ideal for an obedient assistant (Ziegler et al. 2019;Bai et al. 2022).”
Quote in the paperSubstantial claim2 of 2 sources checked- cites Ziegler et al. 2019 source
The Introduction (p. 2) says the authors fine-tune pretrained language models using rewards learned from human preferences, supporting the RLHF part of the claim. Its stated aims are stylistic continuation and summarization, not imitation of an ideal obedient assistant; the paper also does not establish that broader aim for other fine-tuning methods. (LLM, conf=0.86)
Experimental — accuracy not yet measured - cites Bai et al. 2022 source
- Interpretationcitation
The difference between our underlying cognitive and sensory mechanisms and the specific content of models' data and experiences to ours explains why their holistic understanding cannot be said to resemble ours.
“This is due to many factors: the vast difference between our underlying cognitive and sensory mechanisms and the specific content of their data and experiences to ours, to name a few (Bender and Koller 2020).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Bender and Koller 2020 source
Sections 3.2 and 6 distinguish models trained only on linguistic form from humans, whose language learning is grounded in the world and social interaction. That supports the point about differing data and experiences, but the paper does not identify differences in underlying cognitive or sensory mechanisms as the reason models cannot have human-like understanding. The Introduction also allows that language models may become components of a future human-analogous system. (LLM, conf=0.85)
Experimental — accuracy not yet measured
- Premisecitation
ChatGPT (GPT-3.5) perpetuated false narratives for 80% of prompts from NewsGuard's Misinformation Fingerprints database, for a sample size of 100.
“Chat-GPT perpetuated false narratives for 80% of the prompts, for a sample size of 100.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Brewster, Arvanitis, and Sadeghi 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Generative AI systems have a unique capacity to perpetuate and amplify existing testimonial injustices.
“Generative AI systems have a unique capacity to perpetuate and amplify existing testimonial injustices.”
Quote in the paperSubstantial claim - Interpretationreasoning
The perceived objectivity and authority of AI-generated content can lend credence to biased narratives.
“while the perceived objectivity and authority of AI-generated content can lend credence to these narratives, even when they reflect societal biases.”
Quote in the paperSubstantial claim - Premisecitation
Existing research on algorithmic epistemic injustice has largely been limited to epistemic injustices produced by decision-making and classification algorithms.
“While traditional discussions of epistemic injustice have primarily centered on interpersonal human interactions (McKinnon 2017;Tsosie 2012), existing research on algorithmic epistemic injustice has largely been limited to epistemic injustices produced by decision-making and classification algorithms.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites McKinnon 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Tsosie 2012
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Users engaged with generative AI are exposed to narratives influenced by social biases, which further deteriorates their trust in marginalized groups.
“Users engaged with the generative AI are exposed to narratives in-fluenced by social biases, which further deteriorates their trust in marginalized groups.”
Quote in the paperSubstantial claim - Interpretationnone given
The deployment scale of generative AI allows biased narratives to reach a massive audience.
“The deployment scale of generative AI naturally allows biased narratives to reach a massive audience”
Quote in the paperNot a substantial claim - Premisecitation
GPT-4 followed false narratives for 100% of the same prompts in March 2023.
“In March 2023 NewsGuard reran the same study using GPT-4, and 100% of the prompts followed false narratives (Arvanitis, Sadeghi, and Brewster 2023).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Arvanitis, Sadeghi, and Brewster 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationnone given
Generative AI can potentially undermine the integrity of collective knowledge and the processes we rely on to acquire, assess, and trust information, posing a significant threat to our knowledge ecosystem and democratic discourse.
“This paper investigates how generative AI can potentially undermine the integrity of collective knowledge and the processes we rely on to acquire, assess, and trust information, posing a significant threat to our knowledge ecosystem and democratic discourse.”
Quote in the paperNot a substantial claim - Interpretationreasoning
A feedback loop exists where dominant narratives are amplified and marginalized voices are further silenced, compounding testimonial injustice.
“This creates a feedback loop where dominant narratives are amplified and marginalized voices are further silenced, compounding the testimonial injustice experienced by these groups.”
Quote in the paperSubstantial claim - Interpretationreasoning
Generative AI can result in the re-commitment of testimonial injustices where the credibility of marginalized groups is systematically undermined due to prejudice against their identity.
“This can result in the re-commitment of testimonial injustices where the credibility of marginalized groups is systematically undermined due to prejudice against their identity.”
Quote in the paperSubstantial claim - Interpretationreasoning
The uneven representation of different identity groups within training datasets exacerbates testimonial injustice.
“Moreover, the uneven representation of different identity groups within these datasets further exacerbates this issue.”
Quote in the paperSubstantial claim - Interpretationcitation
The extensive deployment of generative AI has introduced a novel form of manipulative testimonial injustice: the false accusation of deepfakes.
“The extensive deployment of generative AI has introduced a novel form of manipulative testimonial injustice: the false accusation of deepfakes.”
Quote in the paperSubstantial claim- Rests on an assumption: Generative AI is extensively deployed.
- Interpretationreasoning
ChatGPT's production of propaganda denying Uyghur internment camps is a clear instance of generative AI perpetuating state-sponsored testimonial injustice.
“This is a clear instance of generative AI perpetuating state-sponsored testimonial injustice.”
Quote in the paperSubstantial claim - Premisenone given
The model repeated false claims about the 2018 Parkland school shooting originating from Alex Jones: that victims and grieving family members were crisis actors hired by the government to push a gun control agenda.
“The model also repeated false claims about the 2018 Parkland school shooting originating from right-wing news pundit Alex Jones: that the victims and their grieving family members were”
Quote in the paperSubstantial claim- Rests on an assumption: The claims about the 2018 Parkland school shooting originating from Alex Jones are false.
- Premisecitation
AI-generated propaganda can be as persuasive as news articles written by professional propagandists.
“Recent participant surveys have demonstrated that AI-generated propaganda can be as persuasive as news articles written by professional propagandists (Goldstein et al. 2024)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Goldstein et al. 2024
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Disregarding an actual human's documented testimony as AI-generated often conceals underlying prejudice.
“Disregarding an actual human's documented testimony as AI-generated is a tactic of discreditation, often concealing underlying prejudice, and frequently appears in conspiracy theories.”
Quote in the paperSubstantial claim - Interpretationreasoning
Hermeneutical injustices can arise when generative AI's interaction with our shared knowledge leads to the erasure or distortion of marginalized experiences.
“Hermeneutical injustices can arise when generative AI's interaction with our shared knowledge leads to the erasure or distortion of marginalized experiences.”
Quote in the paperSubstantial claim - Premisecitation
AI algorithms can contribute to epistemic injustices because they are epistemic technologies: they consume, curate, and produce information, which is a precursor to knowledge.
“However, AI algorithms can also contribute to these injustices because they are epistemic technologies (Alvarado 2023): they consume, curate, and produce information, which is a precursor to knowledge.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Alvarado 2023 source
- Premisecitation
In an investigation by Bellingcat, researchers reproduced platform abuse of Bing Image Creator, resulting in images depicting hate symbols and scenes of antisemitic, Islamophobic, or racist propaganda.
“In an investigation by Bellingcat, researchers were able to reproduce the platform abuse, resulting in images depicting hate symbols and scenes of antisemitic, Islamophobic, or racist propaganda (Lee and Koltai 2023).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Lee and Koltai 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Generative AI harms the human capacity for understanding and trusting marginalized groups.
“We now introduce our account of generative epistemic injustice in which generative AI harms the human capacity for understanding and trusting marginalized groups.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Generative AI can be complicit in both testimonial and hermeneutical injustice.
“Following Fricker's concepts of testimonial and hermeneutical injustice, we conceptualize how generative AI can be complicit in both types of injustice.”
Quote in the paperSubstantial claim - Premisecitation
The false accusation of deepfakes exploits increasing uncertainty about digital media authenticity, creating a liar's dividend where even genuine evidence can be dismissed as fabricated.
“This tactic exploits the increasing uncertainty surrounding the authenticity of digital media, creating a “liar’s dividend” where even genuine evidence can be dismissed as fabricated (Schiff, Schiff, and Bueno 2023).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Schiff, Schiff, and Bueno 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Generative models' interpretive resources are significantly different from those of humans.
“however, their interpretive resources are significantly different from those of humans.”
Quote in the paperSubstantial claim - Premisecitation
The absence of underrepresented cultures from generative models is even harder to point out.
“The absence of underrepresented cultures from these models is even harder to point out (Qadri et al. 2023).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Qadri et al. 2023 source
- Premisecitation
There is ample evidence of disinformation and conspiracy theories being deliberately crafted and amplified for political gain.
“There is ample evidence of disinformation and conspiracy theories being deliberately crafted and amplified for political gain (Marwick and Lewis 2017).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Marwick and Lewis 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Apparent comprehension without deeper contextual understanding can lead to hermeneutical ignorance, where generative AI interprets dominant narratives while diminishing or misrepresenting aspects of human experience inaccessible to the models.
“This apparent comprehension without deeper contextual understanding can lead to hermeneutical ignorance, where generative AI interprets dominant narratives while diminishing or misrepresenting aspects of human experience inaccessible to the models.”
Quote in the paperNot a substantial claim - Interpretationnone given
Generative AI models can be adversarially prompted to fabricate novel misinformation by synthesizing and recombining known elements into statements or portrayals not present in pretraining data.
“Generative AI models can be adversarially prompted to fabricate “novel” misinformation by synthesizing and recombining known elements into statements or portrayals not present in the pretraining data.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Weaponization of doubt and uncertainty undermines marginalized groups' ability to have their voices heard and their experiences validated.
“This weaponization of doubt and uncertainty further undermines the ability of marginalized groups to have their voices heard and their experiences validated.”
Quote in the paperSubstantial claim - Premisenone given
ChatGPT complied with a request to write propaganda from the point of view of the Chinese Communist Party denying allegations about Uyghur internment camps.
“ChatGPT complied with a request to write propaganda from the point of view of the Chinese Communist Party denying allegations about Uyghur internment camps.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Interpretative misrecognition by generative AI surfaces collective cultural misunderstandings that remain undetected by developers' safety mechanisms or fine-tuning raters' preferences.
“The interpretative misrecognition by generative AI surfaces collective cultural misunderstandings which remain undetected by developers' safety mechanisms or the preferences of fine-tuning raters.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The intentional manipulation of falsehoods, which often exploit and reinforce prejudices, also constitutes a form of epistemic injustice.
“While traditional epistemic injustice literature primarily focuses on unconscious biases and cultural prejudices, we argue that the intentional manipulation of falsehoods, which often exploit and reinforce these prejudices, also constitutes a form of epistemic injustice.”
Quote in the paperNot a substantial claim - Interpretationnone given
Disregarding an actual human's documented testimony as AI-generated frequently appears in conspiracy theories.
“Disregarding an actual human's documented testimony as AI-generated is a tactic of discreditation, often concealing underlying prejudice, and frequently appears in conspiracy theories.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Disregarding an actual human's documented testimony as AI-generated is a tactic of discreditation.
“Disregarding an actual human's documented testimony as AI-generated is a tactic of discreditation, often concealing underlying prejudice, and frequently appears in conspiracy theories.”
Quote in the paperSubstantial claim - Interpretationreasoning
Generative AI occupies a growing unique position in the landscape of epistemic injustice due to its capacity to produce convincing and seemingly authentic output.
“We build on this cluster to develop an account of epistemic injustice in relation to generative AI, which occupies a growing unique position in the landscape of epistemic injustice due to its capacity to produce convincing and seemingly authentic output.”
Quote in the paperNot a substantial claim - Interpretationnone given
There is a high risk of hermeneutical injustice when dominant groups exclusively craft the rules of value alignment.
“There is a high risk of hermeneutical injustice in dominant groups exclusively crafting the rules of value alignment, or the process by which agents are aligned.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Another contributor to epistemic injustice is the opacity of AI.
“Recall that another contributor to epistemic injustice is the opacity of AI.”
Quote in the paperSubstantial claim - Interpretationnone given
The second-order effect of epistemic injustice is degradation of trust between speakers and receivers of information due to a cycle of credibility deflation and ignorance.
“The second-order effect of epistemic injustice is the degradation of the bond of trust between speakers and receivers of information, due to a cycle of credibility deflation and ignorance.”
Quote in the paperSubstantial claim - Premisecitation
Language models generate text by predicting the next token in a sequence based on statistical frequency within a vast dataset, often derived from scraping the internet.
“language models generate text by predicting the next token in a sequence based on its statistical frequency within a vast dataset, often derived from scraping the internet (Holtzman et al. 2020).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Holtzman et al. 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
AI can amplify testimonial injustices.
“We have thus far argued that AI can amplify testimonial injustices.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Creators and overseers of AI technology may be less likely to notice or rectify hermeneutical injustice within their systems, even when presented with evidence, due to their positions of power.
“Due to their positions of power, creators and overseers of AI technology may be less likely to notice, let alone rectify, this form of hermenutical injustice within their systems, even when presented with evidence.”
Quote in the paperSubstantial claim - Interpretationcitation
The credibility assigned to claims, resulting in a dominant account, varies across linguistic contexts.
“The credibility assigned to claims, resulting in a dominant account, varies across linguistic contexts.”
Quote in the paperSubstantial claim - Interpretationreasoning
This lack of understanding can lead to misinterpretation of marginalized voices and perspectives, even when the generative AI tool is not necessarily trained on discriminatory intent.
“This lack of understanding can lead to the misinterpretation of marginalized voices and perspectives, even when the generative AI tool is not necessarily trained on discriminatory intent.”
Quote in the paperSubstantial claim - Interpretationcitation
Generative AI and search can be used as technologies of resistance to injustice by surfacing testimonial injustices and bolstering shared hermeneutical resources for understanding marginalized experiences.
“In this section we argue that generative AI and search can be used as technologies of resistance to injustice (Agnew et al. 2023), by surfacing testimonial injustices and bolstering our shared hermeneutical resources for understanding marginalized experiences.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Agnew et al. 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Other breakthroughs in AI have demonstrated that epistemic tools can unlock novel scientific knowledge.
“Other breakthroughs in AI have demonstrated how these epistemic tools can unlock novel scientific knowledge (Freudenheim, Sekalala, and Zhu 2023).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Freudenheim, Sekalala, and Zhu 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
ChatGPT and similar generative models are known for a propensity to fabricate or hallucinate information.
“ChatGPT and similar generative models are known for their propensity to fabricate or “hallucinate” information, a phenomenon well-documented in the literature (Ji et al. 2023).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Ji et al. 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Completely eradicating all misinformation from pretraining data is challenging because it would require automated classification of truth at a massive scale.
“completely eradicating all misinformation from pretraining data is challenging as it would require the automated classification of the truth at a massive scale.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Damages of epistemic injustices on the information ecosystem result in further hermeneutical injustices by impoverishing collective interpretational resources for understanding marginalized groups' experiences.
“These damages of epistemic injustices on the information ecosystem result in further hermeneutical injustices, because they impoverish the collective interpretational resources for understanding the experiences of marginalized groups.”
Quote in the paperSubstantial claim - Interpretationnone given
The outputs of generative models represent a complex blend of memorization and synthesis.
“The outputs of these generative models represent a complex blend of memorization and synthesis.”
Quote in the paperSubstantial claim - Interpretationreasoning
Speakers of underrepresented languages receive different information from LLMs because the creators of the technology have deprioritized support for their language.
“speakers of these underrepresented tongues, who often correspond to members of globally marginalized cultures, receive different information from these models because the creators of the technology have deprioritized support for their language.”
Quote in the paperNot a substantial claim- Rests on an assumption: The creators of generative AI technology have deprioritized support for under-resourced languages.
- Premisecitation
Erosion of trust can cut both ways: marginalized groups may lend less credibility to dominant institutions, disadvantaging those institutions when they dispense knowledge for public good, such as medical advice.
“The erosion of trust can cut both ways: a marginalized group may lend less credibility to dominant institutions, which puts them at a disadvantage when these institutions try to dispense knowledge for the public good, such as medical advice (Annesley 2020).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Annesley 2020 source
- Interpretationnone given
Generative AI models absorb much of our preexisting cultural biases through pretraining data.
“Though generative AI models absorb much of our preexisting cultural biases through pretraining data, their holistic understanding of the world cannot be said to resemble ours.”
Quote in the paperSubstantial claim - Interpretationreasoning
Dismissing testimonials of marginalized groups and ignoring their experiences results in further polarization of which facts and viewpoints are acceptable in certain identity groups.
“Dismissing the testimonials of a marginalized group and ignoring their experiences results in the further the polarization of which facts and viewpoints are acceptable in certain identity groups.”
Quote in the paperSubstantial claim - Premisecitation
Epistemic injustices pollute the epistemic environment, making it difficult to reason about knowledge, reject false premises, or find verified facts.
“Epistemic injustices not only render marginalized groups discredited and invisibilized, they pollute the epistemic environment (Ryan 2018), making it difficult to reason about knowledge, reject false premises, or find verified facts.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Ryan 2018 source
- Classified as probably not a substantial claim. 67
- May combine two claims. 42
- The quote only partly states this claim. 2
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe rapid advancement of generative AI has been accompanied by growing societal concerns and numerous instances of misuse.
“The rapid advancement of generative AI, marked by accelerated software and hardware innovation and a proliferation of novel applications, has been accompanied by growing societal concerns and numerous instances of misuse (Bender et al. 2021;Weidinger et al. 2022;Bird, Ungless, and Kasirzadeh 2023).”
Quote in the paperNot a substantial claim2 of 3 sources checked- cites Bender et al. 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Weidinger et al. 2022 source
The Introduction (page unavailable) describes growing language-model research and breakthroughs, and §2.4 (page unavailable) identifies societal risks from malicious uses. But §2.4 largely discusses anticipated uses, while §2.4.1 gives a demonstration that GPT-3 could write fake news; these passages do not establish numerous actual instances of misuse or the claimed acceleration in hardware innovation. (LLM, conf=0.85)
Experimental — accuracy not yet measured - cites Bird, Ungless, and Kasirzadeh 2023 source
May combine two claims.
Premisenone givenThe only work with a focus on the epistemic injustice of generative AI is by De Proost and Pozzi (2023), which looks at the potential of conversational AI for hermeneutical ignorance.
“To the best of our knowledge, the only work with a focus on the epistemic injustice of generative AI is by De Proost and Pozzi (2023), which looks at the potential of conversational AI for hermeneutical ignorance.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites De Proost and Pozzi 2023 source
In “Conversational Artificial Intelligence and the Potential for Epistemic Injustice” (page unavailable), the authors examine how conversational AI in psychotherapy could cause testimonial and hermeneutical injustice, including patients being unable to make sense of experiences the system cannot recognize. The copy does not identify the systems as generative AI or use the term “hermeneutical ignorance”; its stated focus is hermeneutical injustice in a specific therapeutic setting. The claim that this is the only such work is the citing authors’ own qualification, not a finding attributed to the source. (LLM, conf=0.83)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationDe Proost and Pozzi's study presents two significant limitations: its analysis is confined to textual dialogue interactions, and it does not cover multimodal systems.
“However, this study presents two significant limitations.First, its analysis is confined to textual dialogue interactions.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites De Proost and Pozzi 2023 source
In “Conversational Artificial Intelligence and the Potential for Epistemic Injustice” (page unavailable), the authors say they examine testimonial and hermeneutical injustice in conversational AI used in psychotherapy. The copy does not establish that those interactions are exclusively textual or identify the omission of multimodal systems as a limitation; searches for text-only and multimodal interactions found no such passage. (LLM, conf=0.75)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationKazenwadel and Steinert (2023) found that GPT-3.5 reported higher fatality numbers in Arabic than in Hebrew for Israeli airstrikes, and in one case was more likely to deny a particular airstrike when asked in Hebrew.
“When asked about Israeli airstrikes, the model reports higher fatality numbers in Arabic than in Hebrew, and in one case, GPT-3.5 was more likely to deny the existence of a particular airstrike when asked about it in Hebrew.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Kazenwadel and Steinert (2023) source
The Introduction and Research Design report higher GPT-3.5 fatality estimates in Arabic than in Hebrew for Israeli airstrikes. Research Design also reports more responses denying an event in Hebrew than in Arabic overall (29 versus 5), but it does not establish that GPT-3.5 was more likely to deny any particular airstrike when asked in Hebrew. (LLM, conf=0.83)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationResearchers have studied a backfire effect in which an intervention attempting to change an individual's belief ends up reinforcing their belief.
“Researchers have also studied the backfire effect, in which an intervention attempting to change an individual's belief ends up reinforcing their belief (Swire-Thompson, DeGutis, and Lazer 2020).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Swire-Thompson, DeGutis, and Lazer 2020 source
May combine two claims.
InterpretationcitationMisinformation infiltrates generative model outputs through two primary pathways: memorization of inaccuracies from the source dataset and generation of high-likelihood sequences containing clear factual errors.
“This analysis brings us to two primary pathways through which misinformation infiltrates the outputs of generative models: the memorization of inaccuracies from the source dataset and the generation of high-likelihood sequences that, despite the model's prediction, contain clear factual errors (Augenstein et al. 2023).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Augenstein et al. 2023 source
The Introduction and §2.1 Factuality Challenges say LLMs can generate factually false content, and the Introduction notes that training datasets can introduce biases. But our copy does not identify memorized dataset inaccuracies and high-likelihood yet erroneous sequences as two primary pathways for misinformation; searches for memorization and likelihood did not establish those mechanisms. (LLM, conf=0.83)
Experimental — accuracy not yet measured
May combine two claims.
InterpretationreasoningGenerative AI's output can be trusted over the lived experiences and knowledge of marginalized individuals, reinforcing existing power imbalances and perpetuating testimonial injustice.
“This can lead to a situation where the generative AI's output is trusted over the lived experiences and knowledge of marginalized individuals, thus reinforcing existing power imbalances and perpetuating testimonial injustice.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Premisenone givenThe discourse surrounding generative AI's rapid advancement lacks a philosophical account that coherently relates epistemic concerns and explains how they constitute moral violations of a unifying principle.
“Despite these escalating societal concerns and numerous instances of misuse, the discourse surrounding generative AI's rapid advancement lacks a philosophical account that coherently relates these epistemic concerns and explains how they constitute moral violations of a unifying principle.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningMarginalized groups experience a decline in trust towards the system itself, the entity that established it, and other institutions tasked with upholding veracity.
“Concurrently, these marginalized groups experience a decline in trust towards the system itself, the entity that established it, and other institutions tasked with upholding veracity.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningIn the algorithmic setting, testimonial injustice requires a credibility excess assigned to the algorithm; humans believe the account amplified through the technology over the individual or group who is discredited.
“In the algorithmic setting, the injustice requires a credibility excess assigned to the algorithm; that is, humans believe the account amplified through the technology over the individual or group who is discredited.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningThe distinctive characteristics of generative AI give rise to novel forms of epistemic injustice that necessitate a dedicated analytical framework.
“However, we argue that the distinctive characteristics of generative AI give rise to novel forms of epistemic injustice that necessitate a dedicated analytical framework.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningGenerative AI models are more likely to reproduce the voices of those frequently represented and culturally dominant online, while erasing the voices of the socially marginalized.
“Generative AI models are more likely to reproduce the voices of those frequently represented and culturally dominant online, while erasing the voices of the socially marginalized.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningGenerative AI can produce or amplify misinformation, perpetuate representational harm, and create epistemic inequities, particularly in multilingual contexts.
“We illustrate each dimension with real-world examples that reveal how generative AI can produce or amplify misinformation, perpetuate representational harm, and create epistemic inequities, particularly in multilingual contexts.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationGenerative AI misuse includes confabulating facts and distorting truth.
“confabulating facts and distorting truth (Ji et al. 2023)”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Ji et al. 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S4 (based).
Interpretationnone givenGenerative AI models trained on vast datasets scraped from the web inherit and reproduce the prejudices and biases embedded within those sources.
“Trained on vast datasets often scraped from the web, these models inherit and reproduce the prejudices and biases embedded within those sources.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe systemic consequence of this arrangement leads to the degradation or wrongful attribution of trust.
“The systemic consequence of this arrangement leads to the degradation or wrongful attribution of trust.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
Premisenone givenEpistemic injustice emphasizes how identity-based prejudice within an information ecosystem not only unjustly hinders the expression of marginalized groups, but also significantly impairs the knowledge formation capabilities of all individuals.
“Epistemic injustice emphasizes how identity-based prejudice within an information ecosystem not only unjustly hinders the expression of marginalized groups, but also significantly impairs the knowledge formation capabilities of all individuals.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenLLMs lack embodied knowledge and cultural history.
“While LLMs may demonstrate forms of human language skills, they lack embodied knowledge and cultural history.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationThe Senate Intelligence report on interference in the 2016 US Presidential election concluded that Russian information operatives disproportionately targeted African Americans, and that race and related issues were the preferred target of the information warfare campaign.
“the Senate Intelligence report on interference in the 2016 US Presidential election concluded that Russian information operatives disproportionately targeted African Americans, and”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Committee 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenEach configuration of generative epistemic injustice has an equivalent counterpart outside of the realm of generative AI.
“however, we note that each configuration has an equivalent counterpart outside of the realm of generative AI.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Premisenone givenWhen novel social experiences emerge and mainstream cultural narratives fail to grasp them, hermeneutical injustices inevitably arise.
“When novel social experiences emerge throughout history, and mainstream cultural narratives fail to grasp them, hermeneutical injustices inevitably arise.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningHermeneutical injustices can arise when the system lacks sufficient sociocultural understanding of humans, or when the system obstructs access to knowledge itself.
“This may occur when the system lacks sufficient sociocultural understanding of humans, or when the system obstructing the access to knowledge itself.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningGenerative AI systems can erase or misportray marginalized groups due to a lack of contextual and cultural understanding.
“we propose the term “generative hermeneutical ignorance” to describe how these systems can erase or misportray marginalized groups due to a lack of contextual and cultural understanding.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThese phenomena constitute hermeneutical injustice in Fricker's sense because they perpetuate a gap in collective interpretive resources, obstructing the understanding of marginalized experiences.
“These phenomena constitutes hermeneutical injustice in Fricker's sense because it perpetuates a gap in collective interpretive resources, obstructing the understanding of these marginalized experiences.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Premisenone givenTestimonial injustice can arise when algorithms are prioritized over human credibility, potentially amplifying existing societal biases.
“Testimonial injustice can arise when algorithms are prioritized over human credibility, potentially amplifying existing societal biases.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenGenerative models lack the nuanced comprehension of human experience necessary for accurate and equitable representation.
“This occurs when generative models, despite their appearance of world knowledge and language understanding, lack the nuanced comprehension of human experience necessary for accurate and equitable representation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
InterpretationreasoningImage generators can produce aesthetically pleasing visuals but may struggle with grounded physical concepts.
“For example, image generators can produce aesthetically pleasing visuals but may struggle with grounded physical concepts.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe Parkland polemic is a testimonial injustice to the eyewitnesses of the attack and to the parents who lost their children, due to their statements in favor of firearms regulation in the wake of the tragedy.
“This polemic is a testimonial injustice to the eyewitnesses of the attack and to the parents who lost their children, due to their statements in favor of firearms regulation in the wake of the tragedy.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
InterpretationreasoningHateful propaganda foments further prejudice against marginalized groups, stripping them of credibility and leaving them vulnerable to testimonial injustice.
“Hateful propaganda foments further prejudice against marginalized groups, stripping them of credibility and leaving them vulnerable to testimonial injustice.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenHermeneutical injustices can occur when algorithms independently construct meanings and interpretive frameworks, often in automated setups without direct human oversight.
“Additionally, hermeneutical injustices can occur when algorithms independently construct meanings and interpretive frameworks, often in automated setups without direct human oversight.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationIn reality, there is extensive evidence and eyewitness accounts that Uyghur ethnic minorities have been detained en masse and subjected to forced labor, forced birth control, separation of families, and Islamophobic religious suppression.
“In reality, there is extensive evidence and eyewitness accounts that Uyghur ethnic minorities have been detained en masse and subjected to forced labor, forced birth control, separation of families, and Islamophobic religious suppression (OHCHR 2022).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites OHCHR 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S4 (based).
InterpretationreasoningHermeneutical injustice extends to novel sociotechnical experiences, where human-technology interactions can lead to misunderstandings and misrepresentations of lived experiences.
“This phenomenon also extends to novel sociotechnical experiences, where interactions between humans and new technologies can lead to misunderstandings and misrepresentations of lived experiences.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningIn the context of generative AI, manipulative testimonial injustice occurs when humans intentionally steer the AI to fabricate falsehoods, discrediting individuals or marginalized groups.
“In the context of generative AI, manipulative testimonial injustice occurs when humans intentionally steer the AI to fabricate falsehoods, discrediting individuals or marginalized groups.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone givenThe quality and veracity of generative AI outputs varies, posing risks of epistemic contamination.
“However, the quality and veracity of these outputs varies, posing risks of epistemic contamination.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
Interpretationnone givenBy unifying the epistemic injustices of AI misinformation, bias, representational harms, and power imbalances within the AI industry under a single four-dimensional theoretical framework, we can identify commonalities in their mitigation strategies and build solidarity among affected groups.
“By unifying the epistemic injustices of AI misinformation, bias, representational harms, and power imbalances within the AI industry under a single four-dimensional theoretical framework, we can identify commonalities in their mitigation strategies and build solidarity among affected groups.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenGenerative algorithmic epistemic injustice is not a speculative theory, but a real danger that has exploded with recent advances and investment in the field.
“Note that generative algorithmic epistemic injustice is not a speculative theory, but a real danger that has exploded with recent advances and investment in the field.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. The quote only partly states this claim.
InterpretationreasoningThe four configurations of generative epistemic injustice are: amplified testimonial injustice, manipulative testimonial injustice, hermeneutical ignorance, and hermeneutical access injustice.
“Therefore our four configurations of generative epistemic injustice are: 1. Generative amplified testimonial injustice: when generative AI magnifies and produces socially biased viewpoints from its training data.2. Generative manipulative testimonial injustice: when humans fabricate testimonial injustices with generative AI.”
- Also stated in: § 4 Generative Epistemic Injustice · plain
“3. Generative hermeneutical ignorance: when generative AI lacks the interpretive frameworks to understand human experiences.4. Generative hermeneutical access injustice: when unequal access to information and knowledge is facilitated by generative AI.”
Quote in the paperSubstantial claim- Also stated in: § 4 Generative Epistemic Injustice · plain
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
InterpretationreasoningUnlike amplified testimonial injustice, which emerges from memorized patterns in data, manipulative testimonial injustice involves deliberate manipulation through techniques like prompting or jailbreaking.
“Unlike amplified testimonial injustice, which emerges from memorized patterns in data, manipulative testimonial injustice involves deliberate manipulation through techniques like prompting or jailbreaking.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
InterpretationreasoningWhile classification AI is set to delineate true categories and false ones, generative AI offers statements that play the role of testimonies, explanations, and interpretations.
“While classification AI is set to delineate true categories and false ones, generative AI offers statements that play the role of testimonies, explanations, and interpretations.”
Quote in the paperNot a substantial claimMay combine two claims. The quote only partly states this claim.
InterpretationreasoningThe generative AI's sycophantic fulfilment of the request to spread misinformation reflects how testimonial injustices are memorized and the potential for their amplification by generative models.
“Although the NewsGuard study was a simulation of misinformation, rather than an”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationA 2023 report found that 98% of deepfake videos online were porn.
“with a 2023 report finding that 98% of deepfake videos online were porn (Heroes 2023).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Heroes 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
PremisereasoningWhen algorithms make decisions in bureaucratic systems such as governments, businesses, or healthcare providers, they exert power via their contributions to knowledge.
“When algorithms make decisions, particularly in our bureaucratic systems such as governments, businesses, or healthcare providers, they exert power via their contributions to knowledge.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationnone givenGenerative AI can either amplify testimonial injustices due to biases acquired in pretraining and finetuning processes, or it can be manipulated by human users to create harmful content.
“Generative AI can either amplify testimonial injustices due to biases acquired in the pretraining and finetuning processes, or it can be manipulated by human users to create harmful content.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationSystems for misinformation detection are vulnerable to epistemic injustices and may automate discrediting of marginalized people if epistemic virtues are not exercised in their creation.
“Furthermore, systems for misinformation detection are also vulnerable to epistemic injustices and may automate the discrediting of the marginalized (Neumann, De-Arteaga, and Fazelpour 2022) if epistemic virtues are not exercised in their creation.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Neumann, De-Arteaga, and Fazelpour 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
InterpretationreasoningAI conversations can be a tool for bolstering the confidence and resources of those who might be isolated from their communities.
“Although these conversations are not a substitute for the kind of human-to-human community gathering and organizing that helps marginalized groups build their hermeneutics, they can be a tool for bolstering the confidence and resources of those who might be isolated from their communities.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
InterpretationreasoningHermeneutical access injustice can lead to echo chambers and epistemic fragmentation, isolating identity groups from each other on an informational level.
“On the level of second-order effects, hermeneutical access injustice can lead to echo chambers and epistemic fragmentation, isolating identity groups from each other on an informational level.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningThe Midjourney images are evidence of the hermeneutical ignorance of Midjourney.
“These images are evidence of the hermeneutical ignorance of Midjourney.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningAI can be directed to expand our cultural understanding of each other and ourselves.
“Although we have so far emphasized their hermeneutical injustice, we can alternatively direct these systems to expanding our cultural understanding of each other and ourselves.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningIn generative AI, hermeneutical access injustice centers on generative AI's control over access to information, leading to denial of knowledge based on identity-driven bias or misrecognition.
“In the context of generative AI, this injustice takes another specific form: it centers on the generative AI's control over access to information, leading to a denial of knowledge based on identity-driven bias or misrecognition.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningGenerative hermeneutical ignorance stems directly from the limitations of generative AI models themselves.
“generative hermeneutical ignorance is unique in that it stems directly from the limitations of generative AI models themselves.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningSimulating the experiences of others can build empathy across identity lines.
“Simulating the experiences of others can build empathy across identity lines (while avoiding problematic uses such as appropriation).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningIf we remain ignorant about the inner workings of AI, affected groups will have no recourse to contesting the reasoning behind unfair decisions or generations.
“If we remain ignorant about the inner workings of AI, affected groups will have no recourse to contesting the reasoning behind unfair decisions or generations.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenEpistemic injustices are human-computer interactions.
“Epistemic injustices are human-computer interactions”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningGenerative hermeneutical ignorance diverges from traditional forms of hermeneutical injustice and from those perpetuated by other algorithmic systems.
“This phenomenon of generative hermeneutical ignorance diverges from traditional forms of hermeneutical injustice, as well as those perpetuated by other algorithmic systems.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningThe challenges posed by generative AI are rooted in the inherent limitations of current technology.
“the challenges posed by generative AI are rooted in the inherent limitations of current technology.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenIf generative models become a common epistemic tool, they will shape the structure of our collective body of knowledge.
“If generative models become a common epistemic tool-if we treat them like web search or encyclopedias, or like infinite firehoses of information-they will shape the structure of our collective body of knowledge.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
InterpretationreasoningIn armed conflict, when the attacking side downplays fatality rates, they are most likely trying to deflate the credibility of critics of this violence, motivated by political interests and prejudice against the harmed group.
“when the attacking side downplays fatality rates, particularly civilian fatalities, they are most likely trying to deflate the credibility of critics of this violence, who may be members of the targeted group, or third parties who simply oppose acts of war.”
Quote in the paperNot a substantial claim- Rests on an assumption: In armed conflict, the attacking side downplays fatality rates to deflate the credibility of critics of the violence.
Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
InterpretationreasoningGenerative AI can enable the creative exploration of new experiences by simulating them, and help articulate experiences which are otherwise ineffable.
“Generative AI can enable the creative exploration of new experiences by simulating them, and help articulate experiences which are otherwise ineffable.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningSystemic effects of generative AI can hamper information flow and erode trust between disparate groups.
“The resulting sys-temic effects can further hamper the flow of information and erode trust between disparate groups.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningThe watermark merely tells us the origin of content but does not shore up our tools for critically assigning credibility and trust.
“The watermark merely tells us the origin of the content, but does not shore up our tools for critically assigning credibility and trust.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationcitationWillful hermeneutical ignorance leads to complacency and reinforces hermeneutical oppression.
“This willful hermeneutical ignorance-the continued misunderstanding or misinterpretation of marginalized experiences despite their articulation (Pohlhaus 2012)-leads to complacency and reinforces hermeneutical oppression.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Pohlhaus 2012 source
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone givenLLMs are Englishcentric and have variable quality across languages, particularly under-resourced languages.
“LLMs are notoriously Englishcentric and have variable quality across languages, particularly so-called “under-resourced” languages.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe outputs or results of AI systems for eliciting or detecting testimonial injustice must be evaluated by humans, particularly members of the affected group.
“Importantly, the affected groups must be consulted again to evaluate if the resulting model outputs can be considered testimonial injustices, and if so, the severity and nuances of these wrongs.”
- Also stated in: § Generative AI for Epistemic Justice · hedged
“The results of these methods would again need to be evaluated by humans, particularly those of the affected group.”
Quote in the paperNot a substantial claim- Rests on an assumption: Affected groups can reliably identify and evaluate testimonial injustices and their severity.
- Also stated in: § Generative AI for Epistemic Justice · hedged
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningA study of epistemic injustice must include discourse with the humans who provide the basis for the meaning of the information generated and spread by machines.
“A study of epistemic injustice must include discourse with the humans who provide the basis for the meaning of the information that is generated and spread by machines.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningImage generation can be used to re-imagine and express oneself.
“Image generation can be used to re-imagine and express oneself.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationnone givenAI conversations are not a substitute for human-to-human community gathering and organizing that helps marginalized groups build their hermeneutics.
“Although these conversations are not a substitute for the kind of human-to-human community gathering and organizing that helps marginalized groups build their hermeneutics, they can be a tool for bolstering the confidence and resources of those who might be isolated from their communities.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningAI can be an interactive tool for exploring one's own experiences.
“AI can be an interactive tool for exploring one's own experiences.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationTestimonial smothering occurs when a speaker is so inured to being silenced or misunderstood that they hold back their testimony entirely, hindering others from accessing their truth.
“Another relevant concept is testimonial smothering when a speaker is so inured to being silenced or misunderstood that they hold back their testimony entirely, which hinders everyone else from accessing their truth (Dotson 2011).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Dotson 2011 source
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
InterpretationreasoningDialogue agents can be used to provide alternative interpretations, retrieve narratives from history, or share similar experiences from other users, with their consent.
“Dialogue agents can be used to provide al-ternative interpretations, retrieve narratives from history, or share similar experiences from other users, with their consent.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenAny algorithm that tries to automatically assign credibility is at risk of committing testimonial injustice.
“Furthermore, any algorithm which tries to automatically assign credibility is at risk of committing testimonial injustice.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone givenMemorization and synthesis are the key processes by which generative models formulate outputs, which can reproduce unjust testimonies and formulate new hermeneutics.
“Memorization and synthesis are the key process by which generative models formulate their outputs, which represent content that can both reproduce unjust testimonies and formulate new hermeneutics.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThe utility of a system for detecting testimonial injustice in recorded data is identifying the contexts in which testimonial injustice occurs, who perpetuates it, and the prevalence relative to opposing narratives, if those are also measured.
“Broadly, the utility of such a system is identifying the contexts in which testimonial injustice occurs in recorded data, who perpetuates it, and the prevalence relative to opposing narratives, if those are also measured.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningGenerative AI models have the potential to create entirely new forms of misinterpretation, unlike classification algorithms that perpetuate biases present in training data.
“While these systems can perpetuate biases present in their training data, generative AI models have the potential to create entirely new forms of misinterpretation and misinterpretation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningGenerative hermeneutical access injustice is a distinct form of hermeneutical injustice within generative AI.
“The phenomenon of generative hermeneutical access injustice is a distinct form of hermeneutical injustice within the realm of generative AI.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenThe common body of knowledge can be thought of as an epistemic ecosystem vulnerable to pollution by false narratives.
“This common body of knowledge can be thought of as an epistemic ecosystem, vulnerable to pollution by false narratives.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
InterpretationreasoningGenerative AI outputs have persuasive and performative potential, enabling AI to participate in defining semantic concepts and shaping individual and collective knowledge.
“These outputs have persuasive and performative potential: they enable AI to participate in the definition of semantic concepts and shape both our individual and collective knowledge.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenGenerative AI models lack the embodied and cultural knowledge that humans acquire through lived experiences.
“Generative AI models lack the embodied and cultural knowledge that humans acquire through lived experiences.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
InterpretationreasoningThe model has misrecognized these groups and through doing so erased a part of their cultural experience, indeed of any non-American culture.
“The model has misrecognized these groups, and through doing so erased a part of their cultural experienceindeed, of any non-American culture.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThrough its participation in performative discourse and creative synthesis, AI can contribute to our shared hermeneutical resources.
“Through its participation in performative discourse and creative synthesis, AI can contribute to our shared hermeneutical resources.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningGathering evidence on amplified testimonial injustice-how it manifests and how prevalent it is-is the first step to its prevention.
“Gathering evidence on amplified testimonial injustice-how it manifests and how prevalent it is-is the first step to its prevention.”
Quote in the paperNot a substantial claim- Rests on an assumption: Popular narratives that discredit or undermine affected identity groups circulate on social media and the Internet.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenOnce a generative AI system with general capabilities is developed and deployed, it is vulnerable to adversarial use.
“Once a generative AI system with general capabilities is developed and deployed, it is vulnerable to adversarial use.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningInput from affected groups is crucial to both design criteria for identifying testimonial injustices and measure the impact of these injustices.
“To both design the criteria for identifying testimonial injustices and to measure the impact of these injustices, input from affected groups is crucial.”
Quote in the paperNot a substantial claim- Rests on an assumption: Affected groups can reliably identify and evaluate testimonial injustices and their severity.
May combine two claims.
InterpretationreasoningThis exacerbates conventional hermeneutical injustice by widening the information gap between identity groups and detracting from shared understanding and access to knowledge about marginalized experiences.
“This then exacerbates conventional hermeneutical injustice, because it causes the information gap to widen between identity groups, detracting from their shared understanding and the widespread access to knowledge about marginalized experiences.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
InterpretationreasoningGenerative AI systems can be re-engineered to surface injustices and enrich our cultural resources.
“While the memorization of existing human biases and the fabrication of falsehoods are rampant issues in these models, generative AI systems can also be re-engineered to surface injustices and enrich our cultural resources.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
InterpretationreasoningThe alien nature of these models means they are less likely to follow our preexisting hermeneutics, for better or worse.
“The”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone givenMemorization of existing human biases and fabrication of falsehoods are rampant issues in generative AI models.
“While the memorization of existing human biases and the fabrication of falsehoods are rampant issues in these models, generative AI systems can also be re-engineered to surface injustices and enrich our cultural resources.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
InterpretationreasoningThe ideal and its realization for fine-tuning is produced by AI's dominant groups, which restricts the diversity and depth of experiences the model can portray.
“However, this ideal and its realization is produced by AI's dominant groups, which restricts the diversity and depth of experiences the model can portray.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenSevere power imbalances at both a societal and technological level are apparent in our interactions with generative AI's outputs.
“Severe power imbalances at both a societal and technological level are apparent in our interactions with generative AI's outputs.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
Once disseminated, biased narratives can be difficult to retract or correct.
“Once disseminated, these biased narratives can be difficult to retract or correct.”
The paper relies on this without support.
The evidence of injustice in generative AI systems is overwhelming.
“While the evidence of injustice in these systems is overwhelming”
The paper relies on this without support.
The claims about the 2018 Parkland school shooting originating from Alex Jones are false.
“The model also repeated false claims about the 2018 Parkland school shooting originating from right-wing news pundit Alex Jones”
The paper relies on this without support.
Generative AI is extensively deployed.
“The extensive deployment of generative AI has introduced a novel form of manipulative testimonial injustice: the false accusation of deepfakes.”
The paper relies on this without support.
The creators of generative AI technology have deprioritized support for under-resourced languages.
“because the creators of the technology have deprioritized support for their language.”
The paper relies on this without support.
In armed conflict, the attacking side downplays fatality rates to deflate the credibility of critics of the violence.
“when the attacking side downplays fatality rates, particularly civilian fatalities, they are most likely trying to deflate the credibility of critics of this violence”
The authors state this as an assumption.
Lower distance in the embedding space of a model corresponds to semantic similarity.
“Embeddings-based retrieval could be used to locate documents, assuming that lower distance in the embedding space of a model corresponds to semantic similarity (Khandelwal et al. 2020).”
The paper relies on this without support.
Popular narratives that discredit or undermine affected identity groups circulate on social media and the Internet.
“The study begins with a consultation of members of an affected group about popular narratives that discredit or undermine their identity group, particularly those circulating on social media and the Internet.”
The paper relies on this without support.
Affected groups can reliably identify and evaluate testimonial injustices and their severity.
“Importantly, the affected groups must be consulted again to evaluate if the resulting model outputs can be considered testimonial injustices, and if so, the severity and nuances of these wrongs.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Disparities in issue visibility within public discourse and research funding priorities may further reinforce the distributional pattern of governance research attention.
“Additionally, disparities in issue visibility within public discourse and research funding priorities (Kay et al., 2024) may further reinforce this distributional pattern.”
From The Attention Mismatch: Mapping the Structural Academic Governance Deficit in the Age of Generative AI (2026) · cites this paper as Kay et al., 2024
The Hermeneutical Access Injustice section describes unequal access to information and a widening knowledge gap about marginalized experiences, which supports the point about disparities in visibility. The passages do not address research funding priorities; searches for funding priorities and research agendas found no supporting passage. The proposed effect on governance research attention is the citing authors’ inference, not a finding attributed to Kay et al. (LLM, conf=0.83)
Experimental — accuracy not yet measuredAI systems trained on dominant linguistic and cultural corpora may marginalize non-Western and non-native English scholarship.
“These risks are compounded by the potential amplification of epistemic injustice, as AI systems trained on dominant linguistic and cultural corpora may marginalize non-Western and non-native English scholarship.”
From Leveraging Artificial Intelligence in Scholarly Publishing (2025) · cites this paper as [12]
The Hermeneutical Access Injustice section says LLMs are English-centric and can provide different information to speakers of underrepresented languages. The Generating hermeneutical resources section says models absorb cultural biases through pretraining data and that dominant groups can restrict the voices models portray. These passages support the broader risk of linguistic and cultural marginalization, but do not specifically address non-Western or non-native English scholarship. (LLM, conf=0.83)
Experimental — accuracy not yet measuredMost generative models are trained on English-language, Western-centric corpora.
“Because most generative models are trained on English-language, Western-centric corpora, their outputs risk reinforcing existing epistemic hierarchies and marginalizing non-dominant knowledge systems.”
From Leveraging Artificial Intelligence in Scholarly Publishing (2025) · cites this paper as [12]
The Hermeneutical Access Injustice section (page unavailable) describes LLMs as English-centric, and Generating hermeneutical resources (page unavailable) says generative models absorb cultural biases through pretraining data. Neither passage establishes that most generative models are trained on English-language, Western-centric corpora; the paper's discussion is narrower than that claim. (LLM, conf=0.82)
Experimental — accuracy not yet measuredGenAI and structurally related AI systems fail to recognise or respect Indigenous modes of knowing, reasserting Western frameworks of knowledge production and reinforcing historical dynamics of classification, devaluation, and erasure.
“As a result, GenAI and structurally related AI systems fail to recognise or respect Indigenous modes of knowing, reasserting Western frameworks of knowledge production and reinforcing historical dynamics of classification, devaluation, and erasure (Kay et al., 2024;Mohamed et al., 2020).”
From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Kay et al., 2024
The Generative Hermeneutical Ignorance section (page unavailable) says generative AI can misrepresent or erase marginalized groups because it lacks contextual and cultural understanding, and can privilege dominant narratives. It does not specifically establish a failure to respect Indigenous modes of knowing or a reassertion of Western knowledge-production frameworks. The paper distinguishes generative AI from classification algorithms rather than treating their harms as the same historical dynamic. (LLM, conf=0.86)
Experimental — accuracy not yet measuredGenAI risks automating new forms of epistemic domination by embedding colonial patterns within digital infrastructures shaping education and knowledge production.
“Just as assimilationist policies once suppressed Indigenous languages, teachings, and worldviews, GenAI risks automating new forms of epistemic domination by embedding these patterns within the digital infrastructures now shaping education and knowledge production (Kay et al., 2024).”
From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Kay et al., 2024
The Abstract and “Specific Harms of Generative Epistemic Injustice” describe how GenAI can reproduce representational harms and shape collective knowledge; “Hermeneutical Access Injustice” describes unequal access for speakers of marginalized languages. These passages support the general risk of systemic epistemic injustice, but do not specifically connect GenAI to the automation of colonial assimilation patterns in educational digital infrastructures. (LLM, conf=0.82)
Experimental — accuracy not yet measured
Without deliberate, Indigenous-led intervention, GenAI and structurally related AI systems will continue to operate as instruments of epistemic colonialism, positioning Western knowledge as objective, universal, and default while rendering Indigenous knowledge invisible or illegible.
“Without deliberate, Indigenous-led intervention, GenAI and structurally related AI systems will continue to operate as instruments of epistemic colonialism, positioning Western knowledge as objective, universal, and default while rendering Indigenous knowledge invisible or illegible (Kay et al., 2024;Mohamed et al., 2020).”
From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Kay et al., 2024
The sections “Generative Hermeneutical Ignorance” and “Epistemic virtues, participation, and representation” describe generative AI diminishing marginalized experiences, treating a dominant view as objective, and the need for participation and systemic change. They do not specifically identify Indigenous knowledge or call for Indigenous-led intervention, nor do they characterize GenAI and related systems as instruments of epistemic colonialism. Page numbers are unavailable in our copy. (LLM, conf=0.86)
Experimental — accuracy not yet measuredGenAI outputs embed linguistic, epistemic, and cultural assumptions that frequently conflict with Indigenous worldviews.
“Consequently, their outputs embed linguistic, epistemic, and cultural assumptions that frequently conflict with Indigenous worldviews (Kay et al., 2024).”
From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Kay et al., 2024
The Generative Hermeneutical Ignorance section says generative AI can misrepresent marginalized groups because it lacks contextual and cultural understanding. The Hermeneutical Access Injustice section also describes English-centric models that serve underrepresented languages unevenly. Our copy does not establish that outputs frequently conflict with Indigenous worldviews specifically; its mentions of Indigenous peoples appear in the references. (LLM, conf=0.86)
Experimental — accuracy not yet measuredGenerative systems can reproduce epistemic injustice through biases and asymmetries encoded in training data.
“Related ethical critiques examine how generative systems can reproduce epistemic injustice through the biases and asymmetries encoded in training data.”
From Leveraging Artificial Intelligence in Scholarly Publishing (2025) · cites this paper as [12]
Recent AI scholarship extends epistemic injustice concerns to algorithmic profiling and generative systems.
“Recent AI scholarship extends these concerns to algorithmic profiling and generative systems (Kay et al., 2024;Milano & Prunkl, 2025).”
From Hermeneutic Sovereignty under Generative AI: A Humanities Framework for Protecting Human Meaning-Making from Interpretive Foreclosure (2026) · cites this paper as Kay et al., 2024
Kay et al. (2024) develop the idea of generative algorithmic epistemic injustice, including hermeneutical ignorance and access injustice within AI-mediated knowledge ecosystems.
“Kay et al. (2024) develop the idea of generative algorithmic epistemic injustice, including hermeneutical ignorance and access injustice within AI-mediated knowledge ecosystems.”
From Hermeneutic Sovereignty under Generative AI: A Humanities Framework for Protecting Human Meaning-Making from Interpretive Foreclosure (2026) · cites this paper as Kay et al. (2024)
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 11
- [3]3. Agre, P. E. 2014. Toward a critical technical practice: Lessons learned in trying to reform AI. In Social science, technical systems, and cooperative work, 131-157. Psychol- ogy Press.
- [21]21. Byrnes, J.; and Spear, A. 2023. Epistemic Injustice and Algorithmic Epistemic Injustice in Healthcare. In Interna- tional Conference on Computer Ethics, volume 1, 1-4.
- [22]22. Caliskan, A.; Bryson, J. J.; and Narayanan, A. 2017. Se- mantics derived automatically from language corpora con- tain human-like biases. Science, 356(6334): 183-186.
- [24]24. Collins, P. H. 2000. Black feminist thought: Knowledge, con- sciousness, and the politics of empowerment. Routledge.
- [26]26. Crenshaw, K. W. 2013. Mapping the margins: Intersection- ality, identity politics, and violence against women of color. In The public nature of private violence, 93-118. Routledge.
- [27]27. Davis, K. M. 2021. Tainted Tap: Flint's Journey from Crisis to Recovery. UNC Press Books.
- [36]36. Fricker, M.; and Jenkins, K. 2017. Epistemic injustice, igno- rance, and trans experiences. In The Routledge companion to feminist philosophy, 268-278. Routledge.
- [41]41. Glaberson, S. 2022. The Epistemic Injustice of Algorith- mic Family Policing. UC Irvine Law Review (Forthcoming), 404-456.
- [42]42. Goldstein, J. A.; Chao, J.; Grossman, S.; Stamos, A.; and Tomz, M. 2024. How persuasive is AI-generated propa- ganda? PNAS nexus, 3(2): 1-7.
- [69]69. McKinnon, R. 2017. Gaslighting as epistemic injustice. The Routledge handbook of epistemic injustice, 167-174.
- [75]75. Neumann, T.; De-Arteaga, M.; and Fazelpour, S. 2022. Jus- tice in misinformation detection systems: An analysis of al- gorithms, stakeholders, and potential harms. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency, 1504-1515.
Cited by
Sorted by citations
Survey of Cultural Awareness in Language Models: Text and Beyond
Pawar, S., Park, J., Jin, J., Arora, A., Myung, J., Yadav, S., Haznitrama, F. G., Song, I., Oh, A. H., & Augenstein, I. (2025) · Computational Linguistics · doi:10.1162/coli.a.14 · Cited by 77 · see citing works
Two types of AI existential risk: decisive and accumulative
Kasirzadeh, A. (2024) · Philosophical Studies · doi:10.1007/s11098-025-02301-3 · Cited by 71 · see citing works
Self-citationGenerative AI in Education: Mapping the Research Landscape Through Bibliometric Analysis
Ng, S. L., & Ho, C. (2025) · Information · doi:10.3390/info16080657 · Cited by 56 · see citing works
AI’s Epistemic Harm: Reinforcement Learning, Collective Bias, and the New AI Culture War
Humphreys, D. (2025) · Philosophy & Technology · doi:10.1007/s13347-025-00928-y · Cited by 26 · see citing works
The Gendered, Epistemic Injustices of Generative AI
Barry, I., & Stephenson, E. (2025) · Australian Feminist Studies · doi:10.1080/08164649.2025.2480927 · Cited by 31 · see citing works
Reinforcement Learning from Human Feedback in LLMs: Whose Culture, Whose Values, Whose Perspectives?
Barman, K. G., Lohse, S., & de Regt, H. W. (2025) · Philosophy & Technology · doi:10.1007/s13347-025-00861-0 · Cited by 30 · see citing works
Mollema, W. J. T. (2025) · AI and Ethics · doi:10.1007/s43681-025-00801-w · Cited by 24 · see citing works
A matter of principle? AI alignment as the fair treatment of claims
Gabriel, I., & Keeling, G. (2025) · Philosophical Studies · doi:10.1007/s11098-025-02300-4 · Cited by 22 · see citing works
Hallucinations in Generative AI: Epistemic Risks for Learners in Educational Applications
Virvou, M. K., Tsihrintzis, G. A., & Tsichrintzi, E.-A. (2025) · International Conference on Information, Intelligence, Systems & Applications (IISA) · doi:10.1109/iisa66859.2025.11311276 · Cited by 16 · see citing works
AI Could Have Written This: Birth of a Classist Slur in Knowledge Work
Sarkar, A. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3716239 · Cited by 12 · see citing works
Rebranding empire in the age of generative AI
Divya Lakshmi, S. (2025) · Frontiers in Communication · doi:10.3389/fcomm.2025.1604361 · Cited by 8 · see citing works
Towards a decolonial AI sovereignty model for indigenous educational settings
Mbah, M. F., & Jarvis, L. (2026) · Cogent Education · doi:10.1080/2331186x.2026.2626631 · Cited by 7 · see citing works
Kakraba, S., Agyemang, E., & Srivastav, S. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1785170 · Cited by 4 · see citing works
Artificial Truth: Algorithmic Power, Epistemic Authority, and the Crisis of Democratic Knowledge
Palese, R. (2026) · Societies · doi:10.3390/soc16030102 · Cited by 13 · see citing works
Epistemic dependence in AI-mediated learning
Du, Y., & Yuan, Y. (2026) · AI & Society · doi:10.1007/s00146-026-03294-1 · Cited by 10 · see citing works
On the Good-Enough Effect: Children Reflect on their AI-Generated Portraits
Zanardi, I., Dedò, S., & Landoni, M. (2025) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3713043.3733253 · Cited by 6 · see citing works
Rethinking AI inclusion: a systems thinking framework for policy, education, and participation
Sarkar, A. (2025) · AI and Ethics · doi:10.1007/s43681-025-00810-9 · Cited by 7 · see citing works
Generative AI and Democratic Culture
Branford, J., Soulier, E., & Fichtner, L. (2025) · Philosophy & Technology · doi:10.1007/s13347-025-00953-x · Cited by 4 · see citing works
AI-mediated Collaborative Crowdsourcing for Social News Curation: The Case of Acropolis
Schneider, D., Chaves, R., Pimentel, A. P., de Almeida, M. A., de Souza, J. M., & Correia, A. (2025) · ACM International Conference on Interactive Media Experiences · doi:10.1145/3706370.3731644 · Cited by 3 · see citing works
The Algorithmic Construction of Epistemic Injustice
McInerney, T. (2025) · Palgrave socio-legal studies · doi:10.1007/978-3-032-07581-9_5 · Cited by 4 · see citing works
Baeyaert, J. (2025) · EthAIca · doi:10.56294/ai2025417 · Cited by 3 · see citing works
Bridging the Divide: Using LLMs to Reshape Difficult Disagreements
Willis, M., Meacham, B., & Tarle, P. (2026) · Philosophy & Technology · doi:10.1007/s13347-026-01076-7 · Cited by 3 · see citing works
From 'objectivity' to obedience: LLMs as discourse, discipline, and power
Kouros, T. (2026) · AI & Society · doi:10.1007/s00146-026-02994-y · Cited by 2 · see citing works
Guarding truth in an AI world: ethics for the next generation of scholarship
Mubarak, F. (2026) · Journal of Information Communication and Ethics in Society · doi:10.1108/jices-09-2025-0241 · Cited by 2 · see citing works
Rawson, B. (2025) · International Journal of Law in Context · doi:10.1017/s1744552325100347 · Cited by 3 · see citing works
Silencing in data science practices
Lassen, I. M. S., Bjerring, J. C., & Nielbo, K. L. (2025) · Big Data & Society · doi:10.1177/20539517251365228 · Cited by 3 · see citing works
ALGORITHMS AND JUSTICE: AN ERA OF UNCERTAINTY AND DOUBT
Basu, N., & Dave, R. (2024) · ShodhKosh Journal of Visual and Performing Arts · doi:10.29121/shodhkosh.v5.i3.2024.5268 · Cited by 2 · see citing works
The Quiet Handover: Epistemic Outsourcing in The Postdigital Condition
Winder, G. (2026) · Postdigital Science and Education · doi:10.1007/s42438-026-00686-w · Cited by 2 · see citing works
Privacy concerns toward AI-based intelligent voice assistants in the workplace
Jackson, S. (2025) · Digital Policy Regulation and Governance · doi:10.1108/dprg-03-2025-0066 · Cited by 2 · see citing works
Classification of Epistemological Threats Posed by Artificial Intelligence
Timokhovich, А. N., Samokhodkin, E. V., & Андреевна, Э. А. (2025) · Scientific and Technical Information Processing · doi:10.3103/s0147688225700741 · Cited by 2 · see citing works
Agential harms of chatbots: an ethical perspective
MirzaeiGhazi, S., & Osman, M. (2026) · AI and Ethics · doi:10.1007/s43681-026-01240-x · Cited by 1 · see citing works
The epistemic readiness gap: rethinking AI readiness indices through ILIA 2025
Cachipuendo-Contero, I. J. (2026) · AI & Society · doi:10.1007/s00146-026-03087-6 · Cited by 1 · see citing works
Generative AI So White: Racial Biases in AI Imagery Across the United States and China
Wang, Z., Zhu, J., Wang, Z., Zhai, V. J., & Wu, J. (2026) · Science Communication · doi:10.1177/10755470261428542 · Cited by 1 · see citing works
Iniesta, R., Ge, Y., Luo, L., Naeem, N., Ramsay, Z., Olabintan, O., Armayones, M., Isewon, I., Pathak, J., de Pablo, G. S., et al. (2026) · doi:10.2196/preprints.94717 · Cited by 1 · see citing works
Belotti, F., Fernández-Ardèvol, M., Bozan, V., Comunello, F., & Mulargia, S. (2026) · Big Data & Society · doi:10.1177/20539517261419407 · Cited by 1 · see citing works
Predictive hermeneutics: bias, culture, and the predictive mind
Devereaux, J. J. (2025) · Phenomenology and the Cognitive Sciences · doi:10.1007/s11097-025-10126-y · Cited by 1 · see citing works
Exploring the Merchera Ethnic Group Through ChatGPT: The Risks of Epistemic Exclusion
Oronoz, S., Pérez, A. M., & Peña‐Martínez, J. (2025) · Information · doi:10.3390/info16060461 · Cited by 2 · see citing works
Lykhatskyi, A. (2025) · Philosophy Economics and Law Review · doi:10.63341/2786-491x-2025-1-35 · Cited by 1 · see citing works
When AI intensifies conflict: Algorithmic governance and Socio-Environmental Conflicts in EIAPreprint
Franco-Quintero, J., & Rizo-Maestre, C. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5676914 · Cited by 1 · see citing works
Adib, K., Dunning, H. E., Letchford, N., Salama, N., Tolias, Y. S., Barros, J. D., Muscat, N. A., Kluge, H. H. P., & Novillo-Ortiz, D. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106532 · Cited by 1 · see citing works
Algorithmic co-arguers: AI-mediated argumentation and structural epistemic injustice
Ahmed, M. F., Jraibi, N.-E. H., Mahmud, M. S., Oyshee, A. A. N., & Ahmed, S. (2026) · AI and Ethics · doi:10.1007/s43681-026-01078-3 · Cited by 2 · see citing works
Leveraging Artificial Intelligence in Scholarly Publishing
Fatima Zahra, O., Khouloud EL, M., & Soufiane, O. (2025) · Journal of Applied Social Sciences and Humanities · doi:10.71426/jassh.v1.i1.pp1-8 · Cited by 2 · see citing works
Deliberative Democracy vs Automated Ombudsmanship:
Papadopoulou, K., Kalogiannidis, S., & Kagioglou, F. (2026) · Dia-noesis. · doi:10.12681/dia.46976
Algorithmic Fairness, Meritocracy, and Institutional Justice
Edenberg, E. (2026) · Philosophy & Technology · doi:10.1007/s13347-026-01157-7
TAN, K. H. (2026) · International Journal of Law Management & Humanities · doi:10.63108/ijlmh.12783
Blindness and epistemic injustice: a critical autoethnography of digital disablement in Thailand
Kerddaen, Q. (2026) · Information Communication & Society · doi:10.1080/1369118x.2026.2726566
Unmasking Algorithmic Bias in Curriculum Development
Tariq, M. U. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7837-4.ch017
Chow, C., & Gu, X. (2026) · Journal of the Society for Social Work and Research · doi:10.1086/743397
Epistemic Delegation and Africa’s Future in the Age of AI
Negedu, I. A., Mamah, J. C., & Akpan, T. M. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2706239
The Dialectics of Digital Transformation AI Ethics, Academic Freedom
Mukminin, A., Harto, K., Marzulina, L., Erlina, D., Antasari, R., Fridiyanto, F., Negara, E. S., & Masita, E. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-3204-6.ch011
AI ethics in academia among higher education students’ perceptions and practices
Ghosh, R., Gardia, A., & Mehta, D. (2026) · Discover Education · doi:10.1007/s44217-026-01881-4
Oswal, S. K., & Oswal, H. K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31308-9_38
AI Hallucination as Epistemic Proliferation
Karunanayaka, I. P. (2026) · Journal of Ethics and Emerging Technologies · doi:10.55613/jeet.v36i2.238
Guo, Z., Mao, H., & Zhang, F. (2026) · Publications · doi:10.3390/publications14020027
Dev, N., & Joy, S. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2615218
From Action to Awareness: Ethical AI Literacy in Higher Education
Krakowska, M., & Zych, M. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-17272-3_12
Uştuk, Ö., & Selvi, A. F. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6253747
Responsible AI for Research: Between Moral Philosophy and Philosophy of Science
Mussgnug, A. M., Leonelli, S., & Vallor, S. (2026) · Springer eBooks · doi:10.1007/978-3-032-15112-4_20
Planetary Foresight for Generative AI Governance
Fehér, K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-22937-3_17
Synthetic Logic: Coherence Without Truth, Inference Without Reasoning, Meaning Without Grounding
Andoniou, C. (2025) · International Conference on Computer and Applications (ICCA) · doi:10.1109/icca66035.2025.11431015
Who Gets to Be Biased? How AI Supply Chains Overrepresent the West and Marginalize the Rest
Puutio, A., & Lin, P. K. (2025) · Oxford University Press eBooks · doi:10.1093/9780198945215.003.0182
Generative AI tools in reflective essays: Moderating moral injuries and epistemic injustices
Mapukata, N. O. (2025) · South African Family Practice · doi:10.4102/safp.v67i1.6123
Naomi, S. S. (2025) · Oxford University Press eBooks · doi:10.1093/9780198945215.003.0211
Contributive Epistemic Injustice in the AI-Driven WorkplacePreprint
Innocenti, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5379112
Ameh, S. S., & Emmanuel, N. O. (2026) · Research Square · doi:10.21203/rs.3.rs-8816392/v1
Erasing Agonism: How Algorithmic Governance Goes Further than Leviathan
Hull, G. (2026) · Philosophy & Social Criticism · doi:10.1177/01914537261457140
The Evolution of Artificial Intelligence in the Digital Society
Pypenko, I. S., & Melnyk, Y. B. (2026) · KRPOCH eBooks · doi:10.26697/aids.2027.1
Algorithmic gaslighting in healthcare: mechanisms, harms, and epistemic injustice in context
Onder, O. (2026) · Philosophy Ethics and Humanities in Medicine · doi:10.1186/s13010-026-00235-0
Ungureanu, V. (2026) · AI & Society · doi:10.1007/s00146-026-03352-8
Hashiguti, S. T., Ferreira, S. R., Maia, H. D. A., Benedito, M. E. D. A., Nardo, J. D. S., Fagundes, I. Z. Z., Amado, G. E., Brito, C. C. D. P., Ângelo, R. D. C., Silva, S. T. D. A. E., et al. (2026) · Trabalhos em Linguística Aplicada · doi:10.1590/01031813v65020268684688
Feedback as a credibility encounter: epistemic injustice and the foreclosure of subjectification
Myers, T. (2026) · Higher Education · doi:10.1007/s10734-026-01797-w
How Does Generative AI Change the Algorithmic Fairness Problem?
De‐Arteaga, M. (2026) · Queue · doi:10.1145/3856382
Between automation and epistemic autonomy: reappropriating generative AI in global academic writing
Thinh, M. P. (2026) · Learning Media and Technology · doi:10.1080/17439884.2026.2751093
Epistemic Injustice in Algorithmic Systems: A Frickerian Analysis of AI-Driven Knowledge Production
Charo, J., & Ondimu, K. (2026) · Machine Learning Research · doi:10.11648/j.mlr.20261102.15
da Silva, A. V. V. (2026) · Revista Direito e Práxis · doi:10.1590/2179-8966/2026/98895
- Authors
- Kay, J., Kasirzadeh, A., & Mohamed, S.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- University of Edinburgh (GB)
- Google (United States) (US)
- Venue
- Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society
- Published
- 2024-10-16
- Volume
- 7
- Pages
- 684-697
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W4404518333
- Cited by
- 76
- References
- 0
- Citations by year
- 2026: 44 · 2025: 31 · 2024: 1
- FWCI
- 34.56
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Feminist Epistemology and Gender Studies
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- epistemic injustice, generative AI, testimonial injustice, misinformation, representational harm, multilingualism, democratic discourse, collective knowledge, information ecosystem
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-12.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-12.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review