CoChat

LLMs, Truth, and Democracy: An Overview of Risks

Coeckelbergh, Mark · 2025 · Science and Engineering Ethics
Cited by 36

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.

Abstract

While there are many public concerns about the impact of AI on truth and knowledge, especially when it comes to the widespread use of LLMs, there is not much systematic philosophical analysis of these problems and their political implications. This paper aims to assist this effort by providing an overview of some truth-related risks in which LLMs may play a role, including risks concerning hallucination and misinformation, epistemic agency and epistemic bubbles, bullshit and relativism, and epistemic anachronism and epistemic incest, and by offering arguments for why these problems are not only epistemic issues but also raise problems for democracy since they undermine its epistemic basis– especially if we assume democracy theories that go beyond minimalist views. I end with a short reflection on what can be done about these political-epistemic risks, pointing to education as one of the sites for change.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s11948-025-00529-0

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 6 references

Research works printed but not linked: 17

  1. Arendt, H. (1951). The origins of totalitarianism. Penguin.
  2. Arendt, H. (1968[2006]). Truth and politics. In Arendt, H. (Ed.), Between past and future: Eight exercises in political though. (p. 223–259). Penguin.
  3. Estlund, D. (2008). Democratic authority: A philosophical framework. Princeton University Press. · DOI · Paper page
  4. Freiman, O. (2023). Analysis of beliefs acquired from a conversational AI: Instruments-based beliefs, testimony-based beliefs, and technology-based beliefs. Episteme. Advance online publication. https://doi.org/10.1017/epi.2023.12 · DOI
  5. Habermas, J., & Rehg, W. (1996). Between facts and norms: Contributions to a discourse theory of law and democracy (Transl. W. Regh). MIT Press. · DOI · Paper page
  6. Innerarity, D. (2024). The epistemic impossibility of an artificial intelligence take–over of democracy. AI & Society, 39, 1667–1671. https://doi.org/10.1007/s00146-023-01632-1 · DOI
  7. Jungherr, A. (2023). Artificial intelligence and democracy: A conceptual framework. Social Media + Society, Advance online publication. https://doi.org/10.1177/20563051231186353 · DOI · Paper page
  8. Klenk, M. (2022). (Online) manipulation: Sometimes hidden, always careless. Review of Social Economy, 80(1), 85–105. · DOI
  9. Kreps, S., & Kiner, D. (2023). How AI threatens democracy. Journal of Democracy, 34(3), 122–131. · DOI
  10. Landemore, H. (2013). Democratic reason: Politics, collective intelligence, and the rule of the many. Princeton University Press. · DOI
  11. Marcus, G., & Davis, E. (2023). Large language models like ChatGPT say The darnedest things. Blog@ACM Communications of the ACM, January 10, 2023. https://cacm.acm.org/blogcacm/large-language-models-like-chatgpt-say-the-darnedest-things/
  12. Mouffe, C. (2005). On the political. Routledge.
  13. Nemitz, P. (2018). Constitutional democracy and technology in the age of artificial intelligence. Philosophical Transactions of the Royal Society A, 15 October 2018. https://doi.org/10.1098/rsta.2018.0089 · DOI · Paper page
  14. Nussbaum, M. C. (2013). Political emotions: Why love matters for Justice. Harvard University Press. · doi:10.2307/j.ctt6wpqm7
  15. Schumpeter, J. A. (1942[2003]). Capitalism, socialism, and democracy. Routledge.
  16. Tufekci, Z. (2014). Engineering the public: Big data, surveillance and computational politics. First Monday, 19(7). https://doi.org/10.5210/fm.v19i7.4901 · DOI · Paper page
  17. Wihbey, J. P. (2024). AI and epistemic risk for democracy: a coming crisis of public knowledge?, Working paper presented at the Conference democracy’s mega challenges: How climate change, migration, and big data threaten the future of liberal democratic governance, Trinity College, Hartford, CT, April 19–20, 2024. · DOI

Cited by

See all 36

Metadata

Authors
Coeckelbergh, M.
Venue
Science and Engineering Ethics
Published
2025-01-23
Volume
31
Issue
1
ISSN
1471-5546
Cited by
36
References
6
Language
en
Licence
Funders
University of Vienna

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: LLMs, Truth, and Democracy: An Overview of Risks. https://app.cochat.ai/papers/10.1007/s11948-025-00529-0
The paper
Coeckelbergh, M. (2025). LLMs, Truth, and Democracy: An Overview of Risks. Science and Engineering Ethics. https://doi.org/10.1007/s11948-025-00529-0

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.