CoChat

The Impact and Opportunities of Generative AI in Fact-Checking

Wolfe, Robert, Mitra, Tanushree · 2024 · The 2024 ACM Conference on Fairness, Accountability, and Transparency
Cited by 40

The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3630106.3658987

Cites

19 of 19 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 39

  1. Abeba Birhane, William Isaac, Vinodkumar Prabhakaran, Mark Diaz, Madeleine Clare Elish, Iason Gabriel, and Shakir Mohamed. 2022. Power to the people? opportunities and challenges for participatory AI. Equity and Access in Algorithms, Mechanisms, and Optimization (2022), 1–8.
  2. Virginia Braun and Victoria Clarke. 2022. Everything changes… well some things do: Reflections on, and resources for, reflexive thematic analysis. QMiP Bulletin (2022). https://api.semanticscholar.org/CorpusID:255921405
  3. Stephanie Brookes and Lisa Waller. 2023. Communities of practice in the production and resourcing of fact-checking. Journalism 24, 9 (2023), 1938–1958. · DOI
  4. 10.1145/97243.97263 · DOI · Paper page
  5. Tuhin Chakrabarty, Vishakh Padmakumar, Faeze Brahman, and Smaranda Muresan. 2023. Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writers. ArXiv abs/2309.12570 (2023). https://api.semanticscholar.org/CorpusID:262217523 · arXiv
  6. Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, 2021. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 (2021). · arXiv
  7. Anubrata Das, Houjiang Liu, Venelin Kovatchev, and Matthew Lease. 2023. The state of human-centered NLP technology for fact-checking. Information processing & management 60, 2 (2023), 103219.
  8. Laurence Dierickx, Carl-Gustav Lindén, and Andreas Lothe Opdahl. 2023. Automated fact-checking to support professional practices: systematic literature review and meta-analysis. International Journal of Communication 17 (2023), 21.
  9. Mats Ekström, Amanda Ramsälv, and Oscar Westlund. 2021. The epistemologies of breaking news. Journalism Studies 22, 2 (2021), 174–192. · DOI · Paper page
  10. Mats Ekström, Amanda Ramsälv, and Oscar Westlund. 2022. Data-driven news work culture: Reconciling tensions in epistemic values and practices of news journalism. Journalism 23, 4 (2022), 755–772. · DOI
  11. Tyna Eloundou, Sam Manning, Pamela Mishkin, and Daniel Rock. 2023. Gpts are gpts: An early look at the labor market impact potential of large language models. arXiv preprint arXiv:2303.10130 (2023). · arXiv
  12. Robert G Fichman and Chris F Kemerer. 1999. The illusory diffusion of innovation: An examination of assimilation gaps. Information systems research 10, 3 (1999), 255–275.
  13. Lucas Graves. 2017. Anatomy of a fact check: Objective practice and the contested epistemology of fact checking. Communication, culture & critique 10, 3 (2017), 518–537.
  14. Lucas Graves. 2018. Factsheet: Understanding the promise and limits of automated fact-checking. Reuters Inst. Study of Journalism, Univ. Oxford, Oxford (2018).
  15. Lucas Graves and Michelle A Amazeen. 2019. Fact-checking as idea and practice in journalism. In Oxford research encyclopedia of communication. · DOI
  16. Shrey Jain, Connor Spelliscy, Samuel Vance-Law, and Scott Moore. 2023. AI and Democracy’s Digital Identity Crisis. arXiv preprint arXiv:2311.16115 (2023). · arXiv
  17. Prerna Juneja and Tanushree Mitra. 2022. Human and technological infrastructures of fact-checking. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1–36.
  18. 10.1145/3593013.3594070 · DOI
  19. 10.1145/3531146.3533077 · DOI · Paper page
  20. Meredith Ringel Morris, Carrie J Cai, Jess Holbrook, Chinmay Kulkarni, and Michael Terry. 2023. The design space of generative models. arXiv preprint arXiv:2304.10547 (2023). · arXiv
  21. Mahin Naderifar, Hamideh Goli, and Fereshteh Ghaljaie. 2017. Snowball sampling: A purposeful method of sampling in qualitative research. Strides in development of medical education 14, 3 (2017).
  22. 10.1145/3593013.3594013 · DOI
  23. OpenAI. 2022. Introducing ChatGPT. OpenAI Blog, (Nov 2022),.
  24. 10.1080/17512781003642972 · doi:10.1080/17512781003642972
  25. Kalyan Prasad Agrawal. 2023. Towards adoption of generative AI in organizational settings. Journal of Computer Information Systems (2023), 1–16.
  26. Australian Associated Press. 2024. Australian Associated Press. https://www.aap.com.au/. [Accessed 22-01-2024].
  27. 10.1145/3593013.3594134 · DOI · Paper page
  28. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
  29. 10.1145/3593013.3594084 · DOI
  30. Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022. Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125 1, 2 (2022), 3. · arXiv
  31. Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. 2021. Zero-shot text-to-image generation. In International Conference on Machine Learning. PMLR, 8821–8831.
  32. Paavo Ritala, Mika Ruokonen, and Laavanya Ramaul. 2023. Transforming boundaries: how does ChatGPT change knowledge work?Journal of Business Strategyahead-of-print (2023).
  33. Clay Spinuzzi. 2005. The Methodology of Participatory Design. Technical Communication 52 (05 2005), 163–174.
  34. Charlotte Tang, Yunan Chen, Bryan C Semaan, and Jahmeilah A Roberson. 2015. Restructuring human infrastructure: The impact of EHR deployment in a volunteer-dependent clinic. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. 649–661.
  35. Hugo Touvron Louis Martin Kevin Stone Peter Albert Amjad Almahairi Yasmine Babaei Nikolay Bashlykov Soumya Batra Prajjwal Bhargava Shruti Bhosale 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288 (2023) . · arXiv
  36. 10.1145/1316624.1316668 · DOI · Paper page
  37. 10.1109/ICCV51070.2023.00701 · DOI · Paper page
  38. 10.1108/ITP-04-2021-0254 · DOI · Paper page
  39. 10.1145/3582430 · DOI · Paper page

Cited by

See all 40

Metadata

Authors
Wolfe, R., & Mitra, T.
Affiliations
  • University of Washington, United States of America
  • University of Washington, USA
Venue
The 2024 ACM Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Published
2024-06-03
Pages
1531-1543
Cited by
40
References
19

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.