CoChat
Sign Up
PreprintCited by 2Misinformation and Its ImpactsSpam and Phishing DetectionTopic Modeling

The DOI matches its DataCite record; its reference list is not available.

Evaluating Generalizability of Fine-Tuned Models for Fake News Detection

Open access
Suprem, Abhijit, Pu, Calton·2022·arXiv
DOI 10.48550/arxiv.2205.07154arXiv 2205.07154
Open this paper in CoChat — free accountOpen PDF

Abstract

The Covid-19 pandemic has caused a dramatic and parallel rise in dangerous misinformation, denoted an `infodemic' by the CDC and WHO. Misinformation tied to the Covid-19 infodemic changes continuously; this can lead to performance degradation of fine-tuned models due to concept drift. Degredation can be mitigated if models generalize well-enough to capture some cyclical aspects of drifted data. In this paper, we explore generalizability of pre-trained and fine-tuned fake news detectors across 9 fake news datasets. We show that existing models often overfit on their training dataset and have poor performance on unseen data. However, on some subsets of unseen data that overlap with training data, models have higher accuracy. Based on this observation, we also present KMeans-Proxy, a fast and effective method based on K-Means clustering for quickly identifying these overlapping subsets of unseen data. KMeans-Proxy improves generalizability on unseen fake news datasets by 0.1-0.2 f1-points across datasets. We present both our generalizability experiments as well as KMeans-Proxy to further research in tackling the fake news problem.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2205.07154

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

Cited by 2

Research works printed but not linked: 44

  1. [1][1] Isha Agarwal. 2020. Covid 19 Fake News Dataset. (6 2020). https://doi.org/10. 6084/m9.figshare.12489293.v1 -
  2. [2][2] Yejin Bang, Etsuko Ishii, Samuel Cahyawijaya, Ziwei Ji, and Pascale Fung. 2021. Model generalization on covid-19 fake news detection. In International Workshop on Combating Hostile Posts in Regional Languages during Emergency Situation . Springer, 128-140. -
  3. [3][3] Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. 2021. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258 (2021). - · arXiv
  4. [4][4] Johannes Brinkrolf and Barbara Hammer. 2018. Interpretable machine learning with reject option. at-Automatisierungstechnik 66, 4 (2018), 283-290. -
  5. [5][5] Marcel Cardillo and Dan L. Warren. 2016. Analysing patterns of spatial and niche overlap among species at multiple resolutions. Global Ecology and Biogeography 25, 8 (2016), 951-963. https://doi.org/10.1111/geb.12455 - · DOI
  6. [6][6] Ben Chen, Bin Chen, Dehong Gao, Qijin Chen, Chengfu Huo, Xiaonan Meng, Weijun Ren, and Yang Zhou. 2021. Transformer-based language model finetuning methods for COVID-19 fake news detection. In International Workshop 7. on Combating Hostile Posts in Regional Languages during Emergency Situation . Springer, 83-92. -
  7. [7][7] Mayee F Chen, Daniel Y Fu, Dyah Adila, Michael Zhang, Frederic Sala, Kayvon Fatahalian, and Christopher Ré. 2022. Shoring Up the Foundations: Fusing Model Embeddings and Weak Supervision. arXiv preprint arXiv:2203.13270 (2022). - · arXiv
  8. [8][8] Mingxi Cheng, Songli Wang, Xiaofeng Yan, Tianqi Yang, Wenshuo Wang, Zehao Huang, Xiongye Xiao, Shahin Nazarian, and Paul Bogdan. 2021. A COVID-19 Rumor Dataset. Frontiers in Psychology 12 (2021), 1566. -
  9. [9][9] Limeng Cui and Dongwon Lee. 2020. Coaid: Covid-19 healthcare misinformation dataset. arXiv preprint arXiv:2006.00885 (2020). - · arXiv
  10. [12][12] Adam M Enders, Joseph E Uscinski, Casey Klofstad, and Justin Stoler. 2020. The different forms of COVID-19 misinformation and their consequences. The Harvard Kennedy School Misinformation Review (2020). -
  11. [13][13] Adam M Enders, Joseph E Uscinski, Casey Klofstad, and Justin Stoler. 2020. The different forms of COVID-19 misinformation and their consequences. The Harvard Kennedy School Misinformation Review (2020). -
  12. [14][14] João Gama, Indr˙ e Žliobait˙ e, Albert Bifet, Mykola Pechenizkiy, and Abdelhamid Bouchachia. 2014. A survey on concept drift adaptation. ACM computing surveys (CSUR) 46, 4 (2014), 1-37. -
  13. [15][15] Yonatan Geifman and Ran El-Yaniv. 2019. Selectivenet: A deep neural network with an integrated reject option. In International Conference on Machine Learning . PMLR, 2151-2159. -
  14. [16][16] Kilian Hendrickx, Lorenzo Perini, Dries Van der Plas, Wannes Meert, and Jesse Davis. 2021. Machine Learning with a Reject Option: A survey. arXiv preprint arXiv:2107.11277 (2021). - · arXiv
  15. [18][18] Eric Hulburd. 2020. Exploring BERT Parameter Efficiency on the Stanford Question Answering Dataset v2.0. (2020). https://doi.org/10.48550/ARXIV.2002.10670 - · DOI
  16. [19][19] Xiaoqi Jiao, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, and Qun Liu. 2021. LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation. https://doi.org/10.48550/ARXIV.2103.06418 - · DOI
  17. [20][20] Rohit Kumar Kaliyar, Anurag Goswami, and Pratik Narang. 2021. MCNNet: generalizing Fake News Detection with a Multichannel Convolutional Neural Network using a Novel COVID-19 Dataset. In 8th ACM IKDD CODS and 26th COMAD . 437-437. -
  18. [21][21] Ziyi Kou, Lanyu Shang, Yang Zhang, Christina Youn, and Dong Wang. 2021. Fakesens: A social sensing approach to covid-19 misinformation detection on social media. In 2021 17th International Conference on Distributed Computing in Sensor Systems (DCOSS) . IEEE, 140-147. -
  19. [22][22] Wouter M Kouw and Marco Loog. 2018. An introduction to domain adaptation and transfer learning. arXiv preprint arXiv:1812.11806 (2018). - · arXiv
  20. [23][23] Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2019. Albert: A lite bert for self-supervised learning of language representations. arXiv preprint arXiv:1909.11942 (2019). - · arXiv
  21. [24][24] David Lazer, Ryan Kennedy, Gary King, and Alessandro Vespignani. 2014. Google Flu Trends still appears sick: An evaluation of the 2013-2014 flu season. Available at SSRN 2408560 (2014). -
  22. [25][25] Jaejun Lee, Raphael Tang, and Jimmy Lin. 2019. What Would Elsa Do? Freezing Layers During Transformer Fine-Tuning. (2019). https://doi.org/10.48550/ARXIV. 1911.03090 - · DOI
  23. [26][26] Yichuan Li, Kyumin Lee, Nima Kordzadeh, Brenton Faber, Cameron Fiddes, Elaine Chen, and Kai Shu. 2021. Multi-Source Domain Adaptation with Weak Supervision for Early Fake News Detection. In 2021 IEEE International Conference on Big Data (Big Data) . IEEE, 668-676. -
  24. [27][27] Shahan Ali Memon and Kathleen M Carley. 2020. Characterizing covid-19 misinformation communities using a novel twitter dataset. arXiv preprint arXiv:2008.00791 (2020). - · arXiv
  25. [28][28] Amil Merchant, Elahe Rahimtoroghi, Ellie Pavlick, and Ian Tenney. 2020. What Happens To BERT Embeddings During Fine-tuning? https://doi.org/10.48550/ ARXIV.2004.14448 - · arXiv
  26. [29][29] Taesun Moon, Parul Awasthy, Jian Ni, and Radu Florian. 2019. Towards Lingua Franca Named Entity Recognition with BERT. (2019). https://doi.org/10.48550/ ARXIV.1912.01389 - · arXiv
  27. [30][30] Yair Movshovitz-Attias, Alexander Toshev, Thomas K Leung, Sergey Ioffe, and Saurabh Singh. 2017. No fuss distance metric learning using proxies. In Proceedings of the IEEE International Conference on Computer Vision . 360-368. -
  28. [31][31] Martin Müller, Marcel Salathé, and Per E Kummervold. 2020. Covid-twitter-bert: A natural language processing model to analyse covid-19 content on twitter. arXiv preprint arXiv:2005.07503 (2020). - · arXiv
  29. [33][33] Laurel Orr, Karan Goel, and Christopher Ré. 2021. Data management opportunities for foundation models. In 12th Annual Conference on Innovative Data Systems Research . -
  30. [35][35] Calton Pu, Abhijit Suprem, Rodrigo Alves Lima, Aibek Musaev, De Wang, Danesh Irani, Steve Webb, and Joao Eduardo Ferreira. 2020. Beyond artificial reality: Finding and monitoring live events from social sensors. ACM Transactions on Internet Technology (TOIT) 20, 1 (2020), 1-21. -
  31. [36][36] Emma K Quinn, Sajjad S Fazel, and Cheryl E Peters. 2021. The Instagram infodemic: cobranding of conspiracy theories, coronavirus disease 2019 and authorityquestioning beliefs. Cyberpsychology, Behavior, and Social Networking 24, 8 (2021), 573-577. -
  32. [37][37] Alexander Ratner, Stephen H Bach, Henry Ehrenberg, Jason Fries, Sen Wu, and Christopher Ré. 2017. Snorkel: Rapid training data creation with weak supervision. In Proceedings of the VLDB Endowment. International Conference on Very Large Data Bases , Vol. 11. NIH Public Access, 269. -
  33. [38][38] Salva Rühling Cachay, Benedikt Boecking, and Artur Dubrawski. 2021. End-toEnd Weak Supervision. Advances in Neural Information Processing Systems 34 (2021). -
  34. [39][39] Juan Carlos Medina Serrano, Orestis Papakyriakopoulos, and Simon Hegelich. 2020. NLP-based feature extraction for the detection of COVID-19 misinformation videos on YouTube. In Proceedings of the 1st Workshop on NLP for COVID-19 at ACL 2020 . -
  35. [40][40] Geelon So, Gaurav Mahajan, and Sanjoy Dasgupta. 2022. Convergence of online k-means. In International Conference on Artificial Intelligence and Statistics . PMLR, 8534-8569. -
  36. [41][41] Abhijit Suprem, Joy Arulraj, Calton Pu, and Joao Ferreira. 2020. Odin: automated drift detection and recovery in video analytics. arXiv preprint arXiv:2009.05440 (2020). - · arXiv
  37. [42][42] Abhijit Suprem, Aibek Musaev, and Calton Pu. 2019. Concept drift adaptive physical event detection for social media streams. In World Congress on Services . Springer, 92-105. -
  38. [43][43] Ruth Urner and Shai Ben-David. 2013. Probabilistic lipschitzness a niceness assumption for deterministic labels. In Learning Faster from Easy Data-Workshop NIPS , Vol. 2. 1. -
  39. [44][44] Jan Philip Wahle, Nischal Ashok, Terry Ruas, Norman Meuschke, Tirthankar Ghosal, and Bela Gipp. 2022. Testing the generalization of neural language models for COVID-19 misinformation detection. In International Conference on Information . Springer, 381-392. -
  40. [45][45] Rahee Walambe, Ananya Srivastava, Bhargav Yagnik, Mohammed Hasan, Zainuddin Saiyed, Gargi Joshi, and Ketan Kotecha. 2022. Explainable Misinformation Detection Across Multiple Social Media Platforms. arXiv preprint arXiv:2203.11724 (2022). - · arXiv
  41. [46][46] Maxwell Weinzierl, Suellen Hopfer, and Sanda M Harabagiu. 2021. Misinformation adoption or rejection in the era of covid-19. In Proceedings of the International AAAI Conference on Web and Social Media (ICWSM), AAAI Press . -
  42. [47][47] Eu Wern Teh, Terrance DeVries, and Graham W Taylor. 2020. ProxyNCA++: Revisiting and Revitalizing Proxy Neighborhood Component Analysis. arXiv e-prints (2020), arXiv-2004. -
  43. [48][48] Shihao Yang, Mauricio Santillana, and Samuel C Kou. 2015. Accurate estimation of influenza epidemics using Google search data via ARGO. Proceedings of the National Academy of Sciences 112, 47 (2015), 14473-14478. -
  44. [49][49] Indr˙ e Žliobait˙ e. 2010. Learning under concept drift: an overview. arXiv preprint arXiv:1010.4784 (2010). · arXiv

Metadata

Authors
Suprem, A., & Pu, C.
Affiliations
Georgia Institute of Technology (US)
ORCID
Pu, Calton
Venue
arXiv
Publisher
arXiv
Published
2022
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2205.07154
arXiv
2205.07154
OpenAlex
W4281477720
Cited by
2
References
0
Citations by year
2023: 1 · 2022: 1
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
fake news detection, generalizability, concept drift, overfitting, fine-tuned models, pre-trained language models, COVID-19 misinformation, infodemic, unseen data, K-means clustering

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Evaluating Generalizability of Fine-Tuned Models for Fake News Detection. https://app.cochat.ai/papers/10.48550/arxiv.2205.07154
The paper
Suprem, A., & Pu, C. (2022). Evaluating Generalizability of Fine-Tuned Models for Fake News Detection. arXiv. https://doi.org/10.48550/arxiv.2205.07154