The Impact and Opportunities of Generative AI in Fact-Checking
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Large Language Models (LLMs) are increasingly used in journalism settings (Cuartielles et al. 2023;Cools and Diakopoulos 2026;Wolfe and Mitra 2024).”
From A Taxonomy of LLM-Supported Tasks for Critical AI Literacy in Journalism (2026) · cites this paper as Wolfe and Mitra 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
Comparison of convenience sampling and purposive sampling
Etikan, I. (2016) · American Journal of Theoretical and Applied Statistics · doi:10.11648/j.ajtas.20160501.11 · Cited by 11,412
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 1×
“Bender et al. [2] contend that training models on poorly specified textual data poses numerous ethical risks for downstream use.”
BackgroundClarke, V., & Braun, V. (2017) · The Journal of Positive Psychology · doi:10.1080/17439760.2016.1262613 · Cited by 6,543
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
The Productivity J-Curve: How Intangibles Complement General Purpose Technologies
Brynjolfsson, E., Rock, D., & Syverson, C. (2021) · American Economic Journal: Macroeconomics · doi:10.1257/mac.20180386 · Cited by 1,003
Participatory design and "democratizing innovation"
Björgvinsson, E., Ehn, P., & Hillgren, P.-A. (2010) · Proceedings of the 11th Biennial Participatory Design Conference · doi:10.1145/1900441.1900448 · Cited by 709
A systematic evaluation of large language models of code
Xu, F. F., Alon, U., Neubig, G., & Hellendoorn, V. J. (2022) · Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming · doi:10.1145/3520312.3534862 · Cited by 540
A Survey on Automated Fact-Checking
Guo, Z., Schlichtkrull, M., & Vlachos, A. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00454 · Cited by 500
Make-A-Video: Text-to-Video Generation without Text-Video Data
Singer, U., Polyak, A., Hayes, T., Yin, X., An, J., Zhang, S., Hu, Q., Yang, H., Ashual, O., Gafni, O., et al. (2022) · arXiv · doi:10.48550/arxiv.2209.14792 · Cited by 395
A Survey of Value Sensitive Design Methods
Friedman, B., Hendry, D. G., & Borning, A. (2017) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000015 · Cited by 389 · cited 1×
“Valuetensionsrefertocaseswherein the values of a stakeholder in a technology or process come into conflict with the values of another stakeholder or of the technology itself [32].”
BackgroundJiang, A. Q., Sablayrolles, A., Mensch, A., Bamford, C., Chaplot, D. S., Casas, D. D. L., Bressand, F., Lengyel, G., Lample, G., Saulnier, L., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.06825 · Cited by 340
The Values Encoded in Machine Learning Research
Birhane, A., Kalluri, P., Card, D., Agnew, W., Dotan, R., & Bao, M. (2021) · arXiv · doi:10.48550/arxiv.2106.15590 · Cited by 317
The Values Encoded in Machine Learning Research
Birhane, A., Kalluri, P., Card, D., Agnew, W., Dotan, R., & Bao, M. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533083 · Cited by 317
The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice
Delgado, F., Yang, S., Madaio, M., & Yang, Q. (2023) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3617694.3623261 · Cited by 256
Adam, H., Yang, M. Y., Cato, K., Baldini, I., Senteio, C., Celi, L. A., Zeng, J., Singh, M., & Ghassemi, M. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534203 · Cited by 33
Scientists' Perspectives on the Potential for Generative AI in their Fields
Morris, M. R. (2023) · arXiv · doi:10.48550/arxiv.2304.01420 · Cited by 28
Research works printed but not linked: 39
- Abeba Birhane, William Isaac, Vinodkumar Prabhakaran, Mark Diaz, Madeleine Clare Elish, Iason Gabriel, and Shakir Mohamed. 2022. Power to the people? opportunities and challenges for participatory AI. Equity and Access in Algorithms, Mechanisms, and Optimization (2022), 1–8.
- Virginia Braun and Victoria Clarke. 2022. Everything changes… well some things do: Reflections on, and resources for, reflexive thematic analysis. QMiP Bulletin (2022). https://api.semanticscholar.org/CorpusID:255921405
- Stephanie Brookes and Lisa Waller. 2023. Communities of practice in the production and resourcing of fact-checking. Journalism 24, 9 (2023), 1938–1958. · DOI
- 10.1145/97243.97263 · DOI · Paper page
- Tuhin Chakrabarty, Vishakh Padmakumar, Faeze Brahman, and Smaranda Muresan. 2023. Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writers. ArXiv abs/2309.12570 (2023). https://api.semanticscholar.org/CorpusID:262217523 · arXiv
- Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, 2021. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 (2021). · arXiv
- Anubrata Das, Houjiang Liu, Venelin Kovatchev, and Matthew Lease. 2023. The state of human-centered NLP technology for fact-checking. Information processing & management 60, 2 (2023), 103219.
- Laurence Dierickx, Carl-Gustav Lindén, and Andreas Lothe Opdahl. 2023. Automated fact-checking to support professional practices: systematic literature review and meta-analysis. International Journal of Communication 17 (2023), 21.
- Mats Ekström, Amanda Ramsälv, and Oscar Westlund. 2021. The epistemologies of breaking news. Journalism Studies 22, 2 (2021), 174–192. · DOI · Paper page
- Mats Ekström, Amanda Ramsälv, and Oscar Westlund. 2022. Data-driven news work culture: Reconciling tensions in epistemic values and practices of news journalism. Journalism 23, 4 (2022), 755–772. · DOI
- Tyna Eloundou, Sam Manning, Pamela Mishkin, and Daniel Rock. 2023. Gpts are gpts: An early look at the labor market impact potential of large language models. arXiv preprint arXiv:2303.10130 (2023). · arXiv
- Robert G Fichman and Chris F Kemerer. 1999. The illusory diffusion of innovation: An examination of assimilation gaps. Information systems research 10, 3 (1999), 255–275.
- Lucas Graves. 2017. Anatomy of a fact check: Objective practice and the contested epistemology of fact checking. Communication, culture & critique 10, 3 (2017), 518–537.
- Lucas Graves. 2018. Factsheet: Understanding the promise and limits of automated fact-checking. Reuters Inst. Study of Journalism, Univ. Oxford, Oxford (2018).
- Lucas Graves and Michelle A Amazeen. 2019. Fact-checking as idea and practice in journalism. In Oxford research encyclopedia of communication. · DOI
- Shrey Jain, Connor Spelliscy, Samuel Vance-Law, and Scott Moore. 2023. AI and Democracy’s Digital Identity Crisis. arXiv preprint arXiv:2311.16115 (2023). · arXiv
- Prerna Juneja and Tanushree Mitra. 2022. Human and technological infrastructures of fact-checking. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1–36.
- 10.1145/3593013.3594070 · DOI
- 10.1145/3531146.3533077 · DOI · Paper page
- Meredith Ringel Morris, Carrie J Cai, Jess Holbrook, Chinmay Kulkarni, and Michael Terry. 2023. The design space of generative models. arXiv preprint arXiv:2304.10547 (2023). · arXiv
- Mahin Naderifar, Hamideh Goli, and Fereshteh Ghaljaie. 2017. Snowball sampling: A purposeful method of sampling in qualitative research. Strides in development of medical education 14, 3 (2017).
- 10.1145/3593013.3594013 · DOI
- OpenAI. 2022. Introducing ChatGPT. OpenAI Blog, (Nov 2022),.
- 10.1080/17512781003642972 · doi:10.1080/17512781003642972
- Kalyan Prasad Agrawal. 2023. Towards adoption of generative AI in organizational settings. Journal of Computer Information Systems (2023), 1–16.
- Australian Associated Press. 2024. Australian Associated Press. https://www.aap.com.au/. [Accessed 22-01-2024].
- 10.1145/3593013.3594134 · DOI · Paper page
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
- 10.1145/3593013.3594084 · DOI
- Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022. Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125 1, 2 (2022), 3. · arXiv
- Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. 2021. Zero-shot text-to-image generation. In International Conference on Machine Learning. PMLR, 8821–8831.
- Paavo Ritala, Mika Ruokonen, and Laavanya Ramaul. 2023. Transforming boundaries: how does ChatGPT change knowledge work?Journal of Business Strategyahead-of-print (2023).
- Clay Spinuzzi. 2005. The Methodology of Participatory Design. Technical Communication 52 (05 2005), 163–174.
- Charlotte Tang, Yunan Chen, Bryan C Semaan, and Jahmeilah A Roberson. 2015. Restructuring human infrastructure: The impact of EHR deployment in a volunteer-dependent clinic. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. 649–661.
- Hugo Touvron Louis Martin Kevin Stone Peter Albert Amjad Almahairi Yasmine Babaei Nikolay Bashlykov Soumya Batra Prajjwal Bhargava Shruti Bhosale 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288 (2023) . · arXiv
- 10.1145/1316624.1316668 · DOI · Paper page
- 10.1109/ICCV51070.2023.00701 · DOI · Paper page
- 10.1108/ITP-04-2021-0254 · DOI · Paper page
- 10.1145/3582430 · DOI · Paper page
Cited by
To Rely or Not to Rely? Evaluating Interventions for Appropriate Reliance on Large Language Models
Bo, J. Y., Wan, S., & Anderson, A. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714097 · Cited by 36
“For example, Uncertainty Highlighting draws visual attention to uncertain tokens in the LLM’s outputs that the user may want to scrutinize [22, 77], which have been found to reduce over-reliance in information search [73], improve trust in answering questions [22], and increase interpretability in…”
A Taxonomy of LLM-Supported Tasks for Critical AI Literacy in Journalism
Dierickx, L., Bjerknes, F., Opdahl, A. L., & Lindén, C.-G. (2026) · Postdigital Science and Education · doi:10.1007/s42438-026-00690-0 · Cited by 2
Metadata
- Authors
- Wolfe, R., & Mitra, T.
- Affiliations
- University of Washington, United States of America
- University of Washington, USA
- Venue
- The 2024 ACM Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2024-06-03
- Pages
- 1531-1543
- Cited by
- 40
- References
- 19
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.