The DOI matches its DataCite record; 4 of the 4 references it cites were found in a registry or an index.
Combating Misinformation in the Age of LLMs: Opportunities and Challenges
Abstract
Misinformation such as fake news and rumors is a serious threat on information ecosystems and public trust. The emergence of Large Language Models (LLMs) has great potential to reshape the landscape of combating misinformation. Generally, LLMs can be a double-edged sword in the fight. On the one hand, LLMs bring promising opportunities for combating misinformation due to their profound world knowledge and strong reasoning abilities. Thus, one emergent question is: how to utilize LLMs to combat misinformation? On the other hand, the critical challenge is that LLMs can be easily leveraged to generate deceptive misinformation at scale. Then, another important question is: how to combat LLM-generated misinformation? In this paper, we first systematically review the history of combating misinformation before the advent of LLMs. Then we illustrate the current efforts and present an outlook for these two fundamental questions respectively. The goal of this survey paper is to facilitate the progress of utilizing LLMs for fighting misinformation and call for interdisciplinary efforts from different stakeholders for combating LLM-generated misinformation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This issue further poses a risk of misinformation dissemination (Chen and Shu, 2023), directly impacting the reliability and trustworthiness of LLMs.”
From Learning Fine-Grained Grounded Citations for Attributed Large Language Models (2024) · cites this paper as Chen and Shu, 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sallam, M. (2023) · doi:10.1101/2023.02.19.23286155 · Cited by 3,123 · cited 1×
“Recent works have pointed out the rise of adoption of LLMs in healthcare applications [167, 221, 266, 299, 357, 423, 426], however, they can also inadvertently be a tool for the generation and propagation of health mis-information [96].”
BackgroundRegulating ChatGPT and other Large Generative AI Models
Hacker, P., Engel, A., & Mauer, M. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594067 · Cited by 466
Model evaluation for extreme risks
Shevlane, T., Farquhar, S., Garfinkel, B., Phuong, M., Whittlestone, J., Leung, J., Kokotajlo, D., Marchal, N., Anderljung, M., Kolt, N., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.15324 · Cited by 66 · cited 1×
“…aims to prevent malicious users exploiting LLMs to generate harmful content including various types of misin-formation, which has been emphasized in a variety of survey papers [15, 44, 52, 63, 64, 73, 91, 101, 102, 113, 117, 151, 171, 196, 224, 237, 281, 305, 347, 435, 446, 522, 529, 548, 577].”
BackgroundHQP: A Human-Annotated Dataset for Detecting Online Propaganda
Maarouf, A., Bär, D., Geissler, D., & Feuerriegel, S. (2023) · arXiv · doi:10.48550/arxiv.2304.14931 · Cited by 7 · cited 1×
“Previously, there are a large number of works on detecting human-written misinformation including fake news [23, 24, 164, 208, 280, 283, 459, 518, 553, 634], rumor [133, 273, 319, 379], clickbait [74], cherry-picking [25], and propaganda [94, 322, 327].”
Background
Research works printed but not linked: 108
- S Abilov, A., Y. Hua, H. Matatov, O. Amir, and M. Naaman. 2021. "VoterFraud2020: A Multi-Modal Dataset of Election Fraud Claims on Twitter." In International Conference on Web and Social Media.
- Aich, A., S. Bhattacharya, and N. Parde. 2022. "Demystifying Neu- ral Fake News Via Linguistic Feature-Based Interpretation." In Proceedings of the COLING.
- Alam, F., S. Cresci, T. Chakraborty, F. Silvestri, D. Dimitrov, G. D. S. Martino, S. Shaar, H. Firooz, and P. Nakov. 2022. "A Survey on Multimodal Disinformation Detection." In Proceedings of the COLING.
- Antypas, D., J. Camacho-Collados, A. Preece, and D. Rogers. 2021. "COVID-19 and Misinformation: A Large-Scale Lexical Analysis on Twitter." In Proceedings of ACL.
- Beltagy, I., K. Lo, and A. Cohan. 2019. "SciBERT: A Pretrained Language Model for Scientific Text." In Proceedings of EMNLP.
- Bu, Y., Q. Sheng, J. Cao, P. Qi, D. Wang, and J. Li. 2023. "Combating Online Misinformation Videos: Characterization, Detection, and Future Directions." In Proceedings of the 31st ACM International Conference on Multimedia, 8770-80.
- Buchholz, M. G. 2023. "Assessing the Effectiveness of GPT-3 in Detecting False Political Statements: A Case Study on the Liar Dataset." arXiv preprint arXiv: 2306.08190. · arXiv
- Carroll, M., A. Chan, H. Ashton, and D. Krueger. 2023. "Character- izing Manipulation From AI Systems." In Proceedings of the 3rd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization, 1-13.
- Chen, C. and K. Shu. 2024. "Can LLM-Generated Misinformation Be Detected?" In The Twelfth International Conference on Learning Representations.
- Chen, C., H. Wang, M. Shapiro, Y. Xiao, F. Wang, and K. Shu. 2022. "Combating Health Misinformation in Social Media: Characteri- zation, Detection, Intervention, and Open Issues." arXiv preprint arXiv:2211.05289. · arXiv
- Chen, Y., J. Sui, L. Hu, and W. Gong. 2019. "Attention-Residual Network With CNN for Rumor Detection." In Proceedings of the CIKM.
- Chen, Z., F. Jiang, J. Chen, T. Wang, F. Yu, G. Chen, H. Zhang, et al. 2023. "Phoenix: Democratizing Chatgpt Across Languages." arXiv preprint arXiv: 2304.10453. · arXiv
- Chern, I.-C., S. Chern, S. Chen, W. Yuan, K. Feng, C. Zhou, J. He, G. Neubig, and P. Liu. 2023. "FacTool: Factuality Detection in Gen- erative AI -a Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios." arXiv preprint arXiv: 2307.13528. · arXiv
- Cheung, T. H., and K. M. Lam. 2023. "FactLLaMA: Optimizing Instruction-Following Language Models With External Knowl- edge for Automated Fact-Checking." In 2023 Asia Pacific Signal and Information Processing Association Annual Summit and Con- ference (APSIPA ASC), 846-53. IEEE.
- De, A., D. Bandyopadhyay, B. Gain, and A. Ekbal. 2021. "A Transformer-Based Approach to Multilingual Fake News Detec- tion in Low-Resource Languages." ACM Transactions on Asian and Low-Resource Language Information Processing 21: 1-20.
- Dementieva, D., and A. Panchenko. 2021. "Cross-Lingual Evidence Improves Monolingual Fake News Detection." In Proceedings of the ACL.
- Devlin, J., M.-W. Chang, K. Lee, and K. Toutanova. 2019. "BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding." In Proceedings of the NAACL.
- Du, L., Y. Wang, X. Xing, Y. Ya, X. Li, X. Jiang, and X. Fang. 2023. "Quantifying and Attributing the Hallucination of Large Lan- guage Models Via Association Analysis." arXiv preprint arXiv: 2309.05217. · arXiv
- Farinneya, P., M. M. Abdollah Pour, S. Hamidian, and M. Diab. 2021. "Active Learning for Rumor Identification on Social Media." In Proceedings of the EMNLP Findings.
- Gou, Z., Z. Shao, Y. Gong, Y. Shen, Y. Yang, M. Huang, N. Duan, and W. Chen. 2023. "ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving." arXiv preprint arXiv: 2309. 17452.
- Hammouchi, H., and M. Ghogho. 2022. "Evidence-Aware Multilin- gual Fake News Detection." IEEE Access 10: 116808-18.
- Hartwig, K., F. Doell, and C. Reuter. 2024. "The Landscape of User- Centered Misinformation Interventions -A Systematic Literature Review." ACM Computing Surveys 56(11): 1-36.
- He, B., M. Ahamad, and S. Kumar. 2023. "Reinforcement Learning- Based Counter-Misinformation Response Generation: A Case Study of COVID-19 Vaccine Misinformation." In Proceedings of the ACM Web Conference 2023.
- He, Z., C. Li, F. Zhou, and Y. Yang. 2021. "Rumor Detection on Social Media with Event Augmentations." In Proceedings of the SIGIR.
- Helbling, A., M. Phute, M. Hull, and D. H. Chau. 2023. "LLM Self Defense: By Self Examination, LLMs Know They are Being Tricked." arXiv preprint arXiv: 2308.07308. · arXiv
- Hu, B., Q. Sheng, J. Cao, Y. Shi, Y. Li, D. Wang, and P. Qi. 2024. "Bad Actor, Good Advisor: Exploring the Role of Large Language Mod- els in Fake News Detection." Proceedings of the AAAI Conference on Artificial Intelligence 38(20): 22105-13.
- Hu, B., Q. Sheng, J. Cao, Y. Zhu, D. Wang, Z. Wang, and Z. Jin. 2023. "Learn Over Past, Evolve for Future: Forecasting Temporal Trends for Fake News Detection." In Proceedings of the ACL.
- Hu, L., Z. Liu, Z. Zhao, L. Hou, L. Nie, and J. Li. 2023. "A Sur- vey of Knowledge Enhanced Pre-Trained Language Models." IEEE Transactions on Knowledge and Data Engineering 36: 1413-30.
- Hu, L., T. Yang, L. Zhang, W. Zhong, D. Tang, C. Shi, N. Duan, and M. Zhou. 2021. "Compare to the Knowledge: Graph Neural Fake 23719621, 2024, 3, Downloaded from https://onlinelibrary.wiley.com/doi/10.1002/aaai.12188, Wiley Online Library on [24/01/2026]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License News Detection With External Knowledge." In Proceedings of the ACL. · DOI · Paper page
- Huang, B., C. Chen, and K. Shu. 2024. "Can Large Language Models Identify Authorship?" arXiv preprint arXiv:2403.08213. · arXiv
- Huang, J. and K. Chang. 2022. "Towards Reasoning in Large Lan- guage Models: A Survey." In Annual Meeting of the Association for Computational Linguistics.
- Huang, K.-H., K. McKeown, P. Nakov, Y. Choi, and H. Ji. 2022. "Faking Fake News for Real Fake News Detection: Propaganda- Loaded Training Data Generation." arXiv preprint arXiv: Arxiv- 2203.05386.
- Huang, L. and Q. Zhu. "An Introduction of System-Scientific Approaches to Cognitive Security." arXiv preprint arXiv: 2301.05920. · arXiv
- Huang, Y., L. Sun, et al. 2024. "TrustLLM: Trustworthiness in Large Language Models." In Forty-first International Conference on Machine Learning.
- Huang, Z., Z. Lv, X. Han, B. Li, M. Lu, and D. Li. 2022. "Social Bot- Aware Graph Neural Network for Early Rumor Detection." In Proceedings of the COLING.
- Jiang, B., Z. Tan, A. Nirmal, and H. Liu. 2024. "Disinformation Detec- tion: An Evolving Challenge in the Age of LLMs." In Proceedings of the 2024 SIAM International Conference on Data Mining (SDM), 427-35. Society for Industrial and Applied Mathematics.
- Jin, Y., X. Wang, R. Yang, Y. Sun, W. Wang, H. Liao, and X. Xie. 2022. "Towards Fine-Grained Reasoning for Fake News Detection." In Proceedings of the AAAI.
- Karinshak, E., S. X. Liu, J. S. Park, and J. T. Hancock. 2023. "Working with ai to Persuade: Examining a Large Language Model's Ability to Generate Pro-Vaccination Messages." Proceedings of the ACM on Human-Computer Interaction 7: 1-29.
- Kirchenbauer, J., J. Geiping, Y. Wen, J. Katz, I. Miers, and T. Goldstein. 2023. "A Watermark for Large Language Models." In International Conference on Machine Learning, 17061-84. PMLR.
- Kojima, T., S. S. Gu, M. Reid, Y. Matsuo, and Y. Iwasawa. "Large Language Models are Zero-Shot Reasoners." In Proceedings of the NeurIPS.
- Lao, A., C. Shi, and Y. Yang. 2021. "Rumor Detection with Field of Linear and Non-Linear Propagation." In Proceedings of the WWW.
- Leite, J. A., O. Razuvayevskaya, K. Bontcheva, and C. Scarton. 2023. "Detecting Misinformation with LLM-Predicted Credibility Signals and Weak Supervision." arXiv preprint arXiv: 2309.07601. · arXiv
- Li, G., H. A. Al Kader Hammoud, H. Itani, D. Khizbullin, and B. Ghanem. 2023. "CAMEL: Communicative Agents for "Mind" Exploration of Large Scale Language Model Society." Advances in Neural Information Processing Systems 36: 51991-2008.
- Li, H., Y. Su, D. Cai, Y. Wang, and L. Liu. 2022. "A Survey on Retrieval- Augmented Text Generation." arXiv preprint arXiv: 2202.01110. · arXiv
- Li, J., X. Cheng, W. X. Zhao, J.-Y. Nie, and J.-R. Wen. 2023. "HaluE- val: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models." arXiv preprint arXiv: 2305.11747. · arXiv
- Li, Q., Q. Zhang, L. Si, and Y. Liu. 2019. "Rumor Detection on Social Media: Datasets, Methods and Opportunities." In Proceedings of the Second Workshop on Natural Language Processing for Internet Freedom: Censorship, Disinformation, and Propaganda.
- Lin, H., J. Ma, L. Chen, Z. Yang, M. Cheng, and C. Guang. 2022. "Detect Rumors in Microblog Posts for Low-Resource Domains Via Adversarial Contrastive Learning." In Proceedings of the ACL Findings.
- Lin, S., J. Hilton, and O. Evans. 2022. "TruthfulQA: Measuring How Models Mimic Human Falsehoods." In Proceedings of the ACL.
- Lyu, Y., X. Yang, J. Liu, S. Xie, P. Yu, and X. Zhang. 2023. "Inter- pretable and Effective Reinforcement Learning for Attacking Against Graph-Based Rumor Detection." In Proceedings of the IJCNN.
- Ma, J., W. Gao, P. Mitra, S. Kwon, B. J. Jansen, K. Wong, and M. Cha. 2016. "Detecting Rumors from Microblogs with Recurrent Neural Networks." In Proceedings of the IJCAI.
- Mahbub, S., E. Pardede, and A. Kayes. 2022. "COVID-19 Rumor Detection Using Psycho-Linguistic Features." IEEE Access 10: 117530-43.
- Mahyoob, M., J. Al-Garaady, and M. Alrahaili. 2020. "Linguistic- Based Detection of Fake News in Social Media." International Journal of English Linguistics Forthcoming.
- Májovsk ỳ, M., M. Čern ỳ, M. Kasal, M. Komarc, and D. Netuka. 2023. "Artificial Intelligence Can Generate Fraudulent but Authentic- Looking Scientific Medical Articles: Pandora's Box Has Been Opened." Journal of Medical Internet Research 25: e46924.
- Martino, G. D. S., S. Cresci, A. Barrón-Cedeño, S. Yu, R. D. Pietro, and P. Nakov. "A Survey on Computational Propaganda Detection." In Proceedings of the IJCAI.
- Matatov, H., M. Naaman, and O. Amir. 2022. "Stop the [image] Steal: The Role and Dynamics of Visual Content in the 2020 U.S. Election Misinformation Campaign." Proceedings of the ACM on Human- Computer Interaction 6(CSCW2): 1-24.
- Mayank, M., S. Sharma, and R. Sharma. 2021. "Deap-Faked: Knowl- edge Graph Based Approach for Fake News Detection." In Inter- national Conference on Advances in Social Networks Analysis and Mining.
- Mehrabi, N., P. Goyal, C. Dupuy, Q. Hu, S. Ghosh, R. Zemel, K.-W. Chang, A. Galstyan, and R. Gupta. 2023. "Flirt: Feedback Loop in- Context Red Teaming." arXiv preprint arXiv: 2308.04265. · arXiv
- Mendes, E., Y. Chen, W. Xu, and A. Ritter. 2023. "Human-in-the-Loop Evaluation for Early Misinformation Detection: A Case Study of COVID-19 Treatments." In Proceedings of the ACL.
- Mosallanezhad, A., M. Karami, K. Shu, M. V. Mancenido, and H. Liu. 2022. "Domain Adaptive Fake News Detection Via Reinforcement Learning." In Proceedings of the ACM Web Conference 2022.
- Muñoz-Ortiz, A., C. Gómez-Rodrí-guez, and D. Vilares. 2023. "Con- trasting Linguistic Patterns in Human and LLM-Generated Text." arXiv preprint arXiv: 2308.09067. · arXiv
- Naumzik, C., and S. Feuerriegel. 2022. "Detecting False Rumors from Retweet Dynamics on Social Media." In Proceedings of the ACM Web Conference 2022.
- Nguyen, D. M., T. H. Do, R. Calderbank, and N. Deligiannis. "Fake News Detection Using Deep Markov Random Fields." In Proceedings of the NAACL.
- Nielsen, D. S. and R. McConville. 2022. "MuMiN: A Large-Scale Mul- tilingual Multimodal Fact-Checked Misinformation Social Net- work Dataset." In Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.
- Pagnoni, A., M. Graciarena, and Y. Tsvetkov. 2022. "Threat Scenarios and Best Practices to Detect Neural Fake News." In Proceedings of the COLING.
- Patel, A., D. Rao, and C. Callison-Burch. "Learning Interpretable Style Embeddings Via Prompting LLMs." arXiv preprint arXiv: 2305.12696. · arXiv
- Pavlyshenko, B. M. 2023. "Analysis of Disinformation and Fake News Detection using Fine-Tuned Large Language Model." arXiv preprint arXiv: 2309.04704. · arXiv
- Pelrine, K., M. Reksoprodjo, C. Gupta, J. Christoph, and R. Rabbany. 2023. "Towards Reliable Misinformation Mitigation: Generaliza- tion, Uncertainty, and GPT-4." arXiv preprint arXiv: 2305.14928. · arXiv
- Peters, H. and S. Matz. 2023. "Large Language Models Can Infer Psychological Dispositions of Social Media Users." arXiv preprint arXiv: 2309.08631. · arXiv
- Popat, K., S. Mukherjee, A. Yates, and G. Weikum. 2018. "DeClarE: Debunking Fake News and False Claims Using Evidence-Aware Deep Learning." In Proceedings of the EMNLP.
- Qi, X., Y. Zeng, T. Xie, P.-Y. Chen, R. Jia, P. Mittal, and P. Henderson. 2023. "Fine-Tuning Aligned Language Models Com- promises Safety, Even When Users Do Not Intend to!." arXiv preprint arXiv: 2310.03693. · arXiv
- Qiu, H., S. Zhang, A. Li, H. He, and Z. Lan. 2023. "Latent Jailbreak: A Benchmark for Evaluating Text Safety and Output Robustness of Large Language Models." arXiv preprint arXiv: 2307.08487. · arXiv
- Rangapur, A., H. Wang, and K. Shu. 2023. "Investigating Online Financial Misinformation and Its Consequences: A Computa- tional Perspective." arXiv preprint arXiv: 2309.12363. · arXiv
- Saakyan, A. and S. Muresan. "ICLEF: In-Context Learning With Expert Feedback for Explainable Style Transfer." arXiv preprint arXiv: 2309.08583. · arXiv
- Sheng, Q., J. Cao, X. Zhang, R. Li, D. Wang, and Y. Zhu. 2022. "Zoom Out and Observe: News Environment Perception for Fake News Detection." In Proceedings of the ACL.
- Shu, K., L. Cui, S. Wang, D. Lee, and H. Liu. 2019. "Defend: Explainable Fake News Detection." In Proceedings of the KDD.
- Shu, K., A. Sliva, S. Wang, J. Tang, and H. Liu. 2017. "Fake News Detection on Social Media: A Data Mining Perspective." ACM SIGKDD Explorations Newsletter 19: 22-36.
- Shu, K., S. Wang, and H. Liu. 2019. "Beyond News Contents: The Role of Social Context for Fake News Detection." In Proceedings of the WSDM.
- Silva, A., L. Luo, S. Karunasekera, and C. Leckie. "Embracing Domain Differences in Fake News: Cross-Domain Fake News Detection Using Multi-Modal Data." In Proceedings of the AAAI.
- Song, C., C. Yang, H. Chen, C. Tu, Z. Liu, and M. Sun. 2021. "CED: Credible Early Detection of Social Media Rumors." IEEE Transactions on Knowledge and Data Engineering 33: 3035- 47.
- Su, X., J. Yang, J. Wu, and Z. Qiu. 2023. "Hy-DeFake: Hyper- graph Neural Networks for Detecting Fake News in Online Social Networks." arXiv preprint arXiv: 2309.02692. · arXiv
- Sun, K., Y. E. Xu, H. Zha, Y. Liu, and X. L. Dong. 2023. "Head-to-Tail: How Knowledgeable are Large Language Models (LLM)? a.k.a. will LLMs Replace Knowledge Graphs?" arXiv preprint arXiv: 2308.10168. · arXiv
- Sun, M., X. Zhang, J. Ma, and Y. Liu. 2021. "Inconsistency Matters: A Knowledge-Guided Dual-Inconsistency Network for Multi-Modal Rumor Detection." In Proceedings of the EMNLP Findings.
- Swire-Thompson, B., J. DeGutis, and D. Lazer. 2020. "Searching for the Backfire Effect: Measurement and Design Considerations." Journal of Applied Research in Memory and Cognition 9: 286- 99.
- Tan, R., B. Plummer, and K. Saenko. 2020. "Detecting Cross- Modal Inconsistency to Defend Against Neural Fake News." In Proceedings of the EMNLP.
- Tausczik, Y. R., and J. W. Pennebaker. 2010. "The Psychologi- cal Meaning of Words: LIWC and Computerized Text Analysis Methods." Journal of Language and Social Psychology 29: 24-54.
- Touvron, H., L. Martin, K. Stone, P. Albert, A. Almahairi, Y. Babaei, N. Bashlykov, et al. 2023. "Llama 2: Open Foundation and Fine- Tuned Chat Models." arXiv preprint arXiv: 2307.09288. · arXiv
- Uchendu, A., T., Le, and D. Lee. 2023. "Attribution and Obfusca- tion of Neural Text Authorship: A Data Mining Perspective." ACM SIGKDD Explorations Newsletter 25: 1-18.
- Uchendu, A., J. Lee, H. Shen, T. Le, T.-H. K. Huang, and D. Lee. 2023. "Does Human Collaboration Enhance the Accuracy of Iden- tifying LLM-Generated Deepfake Texts?" Proceedings of the AAAI Conference on Human Computation and Crowdsourcing 11(1): 163-74.
- Vidgen, B., A. Agrawal, A. M. Ahmed, V. Akinwande, N. Al- Nuaimi, N. Alfaraj, E. Alhajjar, et al. 2024. "Introducing v0.5 of the AI Safety Benchmark from MLCommons." arXiv preprint arXiv:2404.12241. · arXiv
- Wang, H., Y. Dou, C. Chen, L. Sun, P. S. Yu, and K. Shu. 2023. "Attacking Fake News Detectors Via Manipulating News Social Engagement." In The Web Conference.
- Wang, Y., W. Yang, F. Ma, J. Xu, B. Zhong, Q. Deng, and J. Gao. 2020. "Weak Supervision for Fake News Detection Via Reinforcement Learning." In Proceedings of the AAAI.
- Weber-Wulff, D., A. Anohina-Naumeca, S. Bjelobaba, T. Foltýnek, J. Guerrero-Dib, O. Popoola, P. Šigut, and L. Waddington. 2023. "Testing of Detection Tools for AI-Generated Text." arXiv preprint arXiv: 2306.15666. · arXiv
- Wu, G., W. Wu, X. Liu, K. Xu, T. Wan, and W. Wang. 2023. "Cheap- Fake Detection with LLM Using Prompt Engineering." In IEEE International Conference on Multimedia and Expo Workshops (ICMEW).
- Wu, J., and B. Hooi. 2023. "DECOR: Degree-Corrected Social Graph Refinement for Fake News Detection." In Proceedings of the KDD.
- Wu, J., S. Li, A. Deng, M. Xiong, and B. Hooi. 2023. "Prompt-and- Align: Prompt-Based Social Alignment for Few-Shot Fake News Detection." arXiv preprint arXiv: 2309.16424. · arXiv
- Xia, R., K. Xuan, and J. Yu. 2020. "A State-Independent and Time- Evolving Network for Early Rumor Detection in Social Media." In Proceedings of the EMNLP.
- Xiong, M., Z. Hu, X. Lu, Y. Li, J. Fu, J. He, and B. Hooi. "Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs." arXiv preprint arXiv: 2306. 13063.
- Yang, R., J. Ma, H. Lin, and W. Gao. 2022. "A Weakly Supervised Propagation Model for Rumor Verification and Stance Detec- tion With Multiple Instance Learning." In Proceedings of the SIGIR.
- Yang, Z., L. Li, K. Lin, J. Wang, C.-C. Lin, Z. Liu, and L. Wang. 2023. "The Dawn of lMMs: Preliminary Explorations with GPT- 4V(ision)." arXiv preprint arXiv: 2309.17421. · arXiv
- Yao, J., X. Yi, X. Wang, J. Wang, and X. Xie. 2023. "From Instructions to Intrinsic Human Values -A Survey of Alignment Goals for Big Models." arXiv preprint arXiv: 2308.12014. · arXiv
- Yin, S., C. Fu, S. Zhao, K. Li, X. Sun, T. Xu, and E. Chen. 2023. "A Sur- vey on Multimodal Large Language Models." arXiv preprint arXiv: 2306.13549. · arXiv
- Yu, W., C. Zhu, Z. Li, Z. Hu, Q. Wang, H. Ji, and M. Jiang. 2020. "A Survey of Knowledge-Enhanced Text Generation." arXiv preprint arXiv: 2010.04389. · arXiv
- Yue, Z., H. Zeng, Y. Zhang, L. Shang, and D. Wang. 2023. "MetaAdapt: Domain Adaptive Few-Shot Misinformation Detection Via Meta Learning." In Proceedings of the ACL.
- Zellers, R., A. Holtzman, H. Rashkin, Y. Bisk, A. Farhadi, F. Roesner, and Y. Choi. 2019. "Defending Against Neural Fake News." In Proceedings of the NeurIPS.
- Zhang, H., Q. Fang, S. Qian, and C. Xu. 2019. "Multi-Modal Knowledge-Aware Event Memory Network for Social Media Rumor Detection." In Proceedings of the ACM MM.
- Zhang, Y., Y. Li, L. Cui, D. Cai, L. Liu, T. Fu, X. Huang, et al. 2023. "Siren's Song in the AI Ocean: A Survey on Hallucina- tion in Large Language Models." arXiv preprint arXiv: 2309. 01219.
- Zhao, R., H. Chen, W. Wang, F. Jiao, X. L. Do, C. Qin, B. Ding, et al. 2023. "Retrieving Multimodal Information for Augmented Generation: A Survey." arXiv preprint arXiv: 2303.10868. · arXiv
- Zuo, Y., W. Zhu, and G. G. Cai. "Continually Detection, Rapidly React: Unseen Rumors Detection Based on Continual Prompt- Tuning." In Proceedings of the COLING.
Cited by
Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., et al. (2025) · ACM Transactions on Information Systems · doi:10.1145/3703155 · Cited by 4,688
A survey on large language model (LLM) security and privacy: The Good, The Bad, and The Ugly
Yao, Y., Duan, J., Xu, K., Cai, Y., Sun, Z., & Zhang, Y. (2024) · High-Confidence Computing · doi:10.1016/j.hcc.2024.100211 · Cited by 1,083
Jailbreak and Guard Aligned Language Models With Only Few In-Context Demonstrations
Wei, Z., Wang, Y., Li, A., Mo, Y., & Wang, Y. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3660147 · Cited by 51
Learning Fine-Grained Grounded Citations for Attributed Large Language Models
Huang, L., Feng, X., Ma, W., Gu, Y., Zhong, W., Feng, X., Yu, W., Peng, W., Tang, D., Tu, D., et al. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.838 · Cited by 12
Exploring the Robustness of In-Context Learning with Noisy Labels
Cheng, C., Yu, X., Wen, H., Sun, J., Yue, G., Zhang, Y., & Wei, Z. (2025) · ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49660.2025.10889281 · Cited by 11
Metadata
- Authors
- Chen, C., & Shu, K.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- arXiv
- 2311.05656
- References
- 4
- Type
- Preprint
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Combating Misinformation in the Age of LLMs: Opportunities and Challenges. https://app.cochat.ai/papers/10.48550/arxiv.2311.05656
- The paper
- Chen, C., & Shu, K. (2023). Combating Misinformation in the Age of LLMs: Opportunities and Challenges. arXiv. https://doi.org/10.48550/arxiv.2311.05656
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


