Deepfakes, Misinformation, and Disinformation in the Era of Frontier AI, Generative AI, and Large AI Models
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Concerns persist regarding the reliability of GenAI outputs, as large AI models can produce content that appears highly convincing yet may be false or misleading.
“Simultaneously, concerns persist regarding the reliability of GenAI outputs, as large AI models can produce content that appears highly convincing yet may be false or misleading.”
From Engineering student perceptions of generative AI use in learning trust judgment and information seeking (2026) · cites this paper as [24]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2020) · arXiv · doi:10.48550/arxiv.2004.11138 · Cited by 863
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863 · see citing works
Expanding Explainability: Towards Social Transparency in AI systems
Ehsan, U., Liao, Q. V., Muller, M., Riedl, M. O., & Weisz, J. D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445188 · Cited by 538 · cited 1× · see citing works
“• Transparency: AI systems should be developed with trans-parency in mind, allowing for traceability and explainabil-ity in the AI’s decision-making processes [43].”
BackgroundDetecting Deepfakes with Self-Blended Images
Shiohara, K., & Yamasaki, T. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01816 · Cited by 503 · see citing works
Use of ChatGPT in academia: Academic integrity hangs in the balance
Bin-Nashwan, S. A., Sadallah, M., & Bouteraa, M. (2023) · Technology in Society · doi:10.1016/j.techsoc.2023.102370 · Cited by 394 · cited 1× · see citing works
“Evidently, the risks these models pose are beyond their capabilities as they provide opportunities for academic misconduct [21] or deepfake phishing [22] and many uncovered threats.”
BackgroundZhou, J., Zhang, Y., Luo, Q., Parker, A. G., & De Choudhury, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581318 · Cited by 288 · see citing works
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
Xiao, G., Lin, J., Seznec, M., Wu, H., Demouth, J., & Han, S. (2022) · arXiv · doi:10.48550/arxiv.2211.10438 · Cited by 247 · see citing works
Deepfakes: Deceptions, mitigations, and opportunities
Mustak, M., Salminen, J., Mäntymäki, M., Rahman, A., & Dwivedi, Y. K. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2022.113368 · Cited by 209 · cited 1× · see citing works
“The potential for these technologies to be used for blackmail, electoral interference, and social unrest is a pressing concern [23].”
BackgroundAnticipating and Addressing the Ethical Implications of Deepfakes in the Context of Elections
Diakopoulos, N., & Johnson, D. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3474183 · Cited by 194 · see citing works
Pawelec, M. (2022) · Digital Society · doi:10.1007/s44206-022-00010-6 · Cited by 131 · cited 1× · see citing works
“The cumulative effects of unchecked deepfakes and misin-formation are the erosion of public trust [28].”
BackgroundIntroducing the pervert’s dilemma: a contribution to the critique of Deepfake Pornography
Öhman, C. (2020) · Ethics and Information Technology · doi:10.1007/s10676-019-09522-1 · Cited by 130 · see citing works
Shin, W., & Lwin, M. O. (2022) · Asian Journal of Communication · doi:10.1080/01292986.2022.2026992 · Cited by 38 · see citing works
Flagged first, then by citations
Research works printed but not linked: 33
- M. Anderljung, J. Barnhart, J. Leung, A. Korinek, C. O'Keefe, J. Whittle- stone, S. Avin, M. Brundage, J. Bullock, D. Cass-Beggs et al., "Frontier ai regulation: Managing emerging risks to public safety," arXiv preprint arXiv:2307.03718, 2023. · arXiv
- Y. Cao, S. Li, Y. Liu, Z. Yan, Y. Dai, P. S. Yu, and L. Sun, "A comprehensive survey of AI-generated content (AIGC): A history of generative AI from GAN to ChatGPT," arXiv preprint arXiv:2303.04226, 2023. · arXiv
- V. Danry, J. Leong, P. Pataranutaporn, P. Tandon, Y. Liu, R. Shilkrot, P. Punpongsanon, T. Weissman, P. Maes, and M. Sra, "AI-generated characters: putting deepfakes to good use," in CHI Conference on Human Factors in Computing Systems Extended Abstracts, 2022, pp. 1-5.
- N. Amezaga and J. Hajek, "Availability of voice deepfake technology and its impact for good and evil," in Proceedings of the 23rd Annual Conference on Information Technology Education, 2022, pp. 23-28.
- J. Fletcher, "Deepfakes, artificial intelligence, and some kind of dystopia: The new faces of online post-fact performance," Theatre Journal, vol. 70, no. 4, pp. 455-471, 2018.
- R. W. Zmud, "Opportunities for strategic information manipulation through new information technology," Organizations and Communication Technology, pp. 95-116, 1990.
- D. Silverman, K. Kaltenthaler, and M. Dagher, "Seeing is disbelieving: the depths and limits of factual misinformation in war," International Studies Quarterly, vol. 65, no. 3, pp. 798-810, 2021.
- M. T. Ahvanooey, Q. Li, X. Zhu, M. Alazab, and J. Zhang, "ANiTW: A novel intelligent text watermarking technique for forensic identification of spurious information on social media," Computers & Security, vol. 90, p. 101702, 2020.
- I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets," Advances in Neural Information Processing Systems, vol. 27, 2014.
- B. He, Y. Hu, Y. Lee, S. Oh, G. Verma, and S. Kumar, "A survey on the role of crowds in combating online misinformation: Annotators, evaluators, and creators," arXiv, 2023, accessed November 21, 2023.
- S. Siwakoti, J. N. Shapiro, and N. Evans, "Less reliable media drive inter- est in anti-vaccine information," Harvard Kennedy School Misinformation Review, 2023.
- T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al., "Language models are few-shot learners," Advances in Neural Information Processing Systems, vol. 33, pp. 1877-1901, 2020.
- S. Biderman, H. Schoelkopf, Q. G. Anthony, H. Bradley, K. O'Brien, E. Hallahan, M. A. Khan, S. Purohit, U. S. Prashanth, E. Raff et al., "Pythia: A suite for analyzing large language models across training and scaling," in International Conference on Machine Learning. PMLR, 2023, pp. 2397-2430.
- D. Xu, S. Fan, and M. Kankanhalli, "Combating misinformation in the era of generative AI models," in Proceedings of the 31st ACM International Conference on Multimedia, 2023, pp. 9291-9298.
- Y. Mirsky, A. Demontis, J. Kotak, R. Shankar, D. Gelei, L. Yang, X. Zhang, M. Pintor, W. Lee, Y. Elovici et al., "The threat of offensive ai to organizations," Computers & Security, vol. 124, p. 103006, 2023.
- U. A. Ciftci, G. Yuksek, and I. Demir, "My face my choice: Privacy enhancing deepfakes for social media anonymization," in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023, pp. 1369-1379.
- K. Wahl-Jorgensen and M. Carlson, "Conjecturing fearful futures: jour- nalistic discourses on deepfakes," Journalism Practice, vol. 15, no. 6, pp. 803-820, 2021.
- C. Campbell, K. Plangger, S. Sands, and J. Kietzmann, "Preparing for an era of deepfakes and ai-generated ads: A framework for understanding responses to manipulated advertising," Journal of Advertising, vol. 51, no. 1, pp. 22-38, 2022.
- A. Mitra, S. P. Mohanty, P. Corcoran, and E. Kougianos, "A machine learning based approach for deepfake detection in social media through key video frame extraction," SN Computer Science, vol. 2, pp. 1-18, 2021.
- H. Zhao, W. Zhou, D. Chen, T. Wei, W. Zhang, and N. Yu, "Multi- attentional deepfake detection," in Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, 2021, pp. 2185-2194.
- M. Masood, M. Nawaz, K. M. Malik, A. Javed, A. Irtaza, and H. Malik, "Deepfakes generation and detection: State-of-the-art, open challenges, countermeasures, and way forward," Applied Intelligence, vol. 53, no. 4, pp. 3974-4026, 2023.
- D. Krishna, "Deepfakes, online platforms, and a novel proposal for transparency, collaboration, and education," Rich. JL & Tech., vol. 27, p. 1, 2020.
- J. T. Hancock and J. N. Bailenson, "The social impact of deepfakes," pp. 149-152, 2021.
- P. Gupta, K. Chugh, A. Dhall, and R. Subramanian, "The eyes know it: Fakeet-an eye-tracking database to understand deepfake perception," in Proceedings of the 2020 International Conference on Multimodal Interaction, 2020, pp. 519-527.
- K. Kikerpill, A. Siibak, and S. Valli, "Dealing with deepfakes: Reddit, on- line content moderation, and situational crime prevention," in Theorizing Criminality and Policing in the Digital Media Age. Emerald Publishing Limited, 2021, vol. 20, pp. 25-45.
- B. Giovanola and S. Tiribelli, "Beyond bias and discrimination: redefining the AI ethics principle of fairness in healthcare machine-learning algo- rithms," AI & Society, vol. 38, no. 2, pp. 549-563, 2023.
- A. Henriksen, S. Enni, and A. Bechmann, "Situated accountability: Ethical principles, certification standards, and explanation methods in applied AI," in Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society, 2021, pp. 574-585.
- H.-C. Yang, A. R. Rahmanti, C.-W. Huang, and Y.-C. J. Li, "How can research on artificial empathy be enhanced by applying deepfakes?" Journal of Medical Internet Research, vol. 24, no. 3, p. e29506, 2022.
- D. Kelly and J. Burkell, "It's not (all) about the information: The role of cognition in creating and sustaining false beliefs," Cambridge Studies on Governing Knowledge Commons, 2024.
- P. T. Jaeger and N. G. Taylor, "Arsenals of lifelong information literacy: Educating users to navigate political and current events information in world of ever-evolving misinformation," The Library Quarterly, vol. 91, no. 1, pp. 19-31, 2021.
- Y. Liu, H. Du, D. Niyato, J. Kang, Z. Xiong, C. Miao, and A. Jamalipour, "Blockchain-empowered lifecycle management for AI-generated content (AIGC) products in edge networks," arXiv preprint arXiv:2303.02836, 2023. · arXiv
- K. Langmia, Black Communication in the Age of Disinformation: Deep- Fakes and Synthetic Media. Springer Nature, 2023.
- N. Kshetri, "The economics of deepfakes," Computer, vol. 56, no. 8, pp. 89-94, 2023.
Cited by
Sorted by citations
Ethical challenges and solutions of generative AI: an interdisciplinary perspective
Al-kfairy, M., Mustafa, D., Kshetri, N., Insiew, M., & Alfandi, O. (2024) · Informatics · doi:10.3390/informatics11030058 · Cited by 328 · see citing works
Nikolic, S., Sandison, C., Haque, R., Daniel, S., Grundy, S., Belkina, M., Lyden, S., Hassan, G. M., & Neal, P. (2024) · Australasian Journal of Engineering Education · doi:10.1080/22054952.2024.2372154 · Cited by 98 · see citing works
Mohammed, Y., Qandil, H., & Lund, B. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02086-2
- Authors
- Shoaib, M. R., Wang, Z., Ahvanooey, M. T., & Zhao, J.
- Affiliations
- Nanyang Technological University,School of Computer Science and Engineering,Singapore
- Venue
- 2023 International Conference on Computer and Applications (ICCA)
- Publisher
- IEEE
- Published
- 2023-11-28
- Pages
- 1-7
- Cited by
- 124
- References
- 13
- Funders
- Ministry of Education
- Nanyang Technological University
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review