The Rise of Guardians: Fact-checking URL Recommendation to Combat Fake News
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
A large body of research work and efforts have been focused on detecting fake news and building online fact-check systems in order to debunk fake news as soon as possible. Despite the existence of these systems, fake news is still wildly shared by online users. It indicates that these systems may not be fully utilized. After detecting fake news, what is the next step to stop people from sharing it? How can we improve the utilization of these fact-check systems? To fill this gap, in this paper, we (i) collect and analyze online users called guardians, who correct misinformation and fake news in online discussions by referring fact-checking URLs; and (ii) propose a novel fact-checking URL recommendation model to encourage the guardians to engage more in fact-checking activities. We found that the guardians usually took less than one day to reply to claims in online conversations and took another day to spread verified information to hundreds of millions of followers. Our proposed recommendation model outperformed four state-of-the-art models by 11%~33%. Our source code and dataset are available at http://web.cs.wpi.edu/~kmlee/data/gau.html.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Social Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767 · cited 1×
“1 Fake News, Rumors and Misinformation Although fake news on social media has been extensively studied, it still attracts the attention of communities due to its negative impact on society such as fake Russian Facebook ads and political events [4].”
BackgroundWhen Corrections Fail: The Persistence of Political Misperceptions
Nyhan, B., & Reifler, J. (2010) · Political Behavior · doi:10.1007/s11109-010-9112-2 · Cited by 3,173
Collaborative Deep Learning for Recommender Systems
Wang, H., Wang, N., & Yeung, D.-Y. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783273 · Cited by 1,657
CSI: A Hybrid Deep Model for Fake News Detection
Ruchansky, N., Seo, S., & Liu, Y. (2017) · Proceedings of the 2017 ACM on Conference on Information and Knowledge Management · doi:10.1145/3132847.3132877 · Cited by 1,039
Online Human-Bot Interactions: Detection, Estimation, and Characterization
Varol, O., Ferrara, E., Davis, C., Menczer, F., & Flammini, A. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14871 · Cited by 981 · cited 1×
“Since fake news can be viewed as misinformation, work about detecting content polluters [26], social bots [47] and malicious campaigns [48] are also related to our work.”
BackgroundProminent Features of Rumor Propagation in Online Social Media
Kwon, S., Cha, M., Jung, K., Chen, W., & Wang, Y. (2013) · 2013 IEEE 13th International Conference on Data Mining · doi:10.1109/icdm.2013.61 · Cited by 859 · cited 2×
“gative impact on society such as fake Russian Facebook ads and political events [4]. The majority of studies focused on classifying rumors to either true or false by exploiting different feature sets [7, 23, 34, 41, 53] or by building deep learning models [33, 44]. In natural disasters and emergency situations, misinf…”
BackgroundEnquiring Minds: Early Detection of Rumors in Social Media from Enquiry Posts
Zhao, Z., Resnick, P., & Mei, Q. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741637 · Cited by 583 · cited 3×
“However, fake news is still wildly disseminated on social media even when it has been debunked [36, 58].”
BackgroundGupta, A., Lamba, H., Kumaraguru, P., & Joshi, A. (2013) · Proceedings of the 22nd International Conference on World Wide Web Companion · doi:10.1145/2487788.2488033 · Cited by 573 · cited 1×
“In natural disasters and emergency situations, misinformation was investigated as well [16, 20, 58].”
BackgroundChen (2010) · doi:10.1145/1753326.1753503 · Cited by 416
Real-time Rumor Debunking on Twitter
Liu, X., Nourbakhsh, A., Li, Q., Fang, R., & Shah, S. (2015) · Proceedings of the 24th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2806416.2806651 · Cited by 391 · cited 2×
“To verify correctness of information, researchers proposed to (i) employ experts, who can fact-check information [59], (ii) use systems that can automatically check credibility of news [18, 32, 45]; and build models to detect fake news [7, 23, 34, 41, 53].”
BackgroundFriggeri, A., Adamic, L., Eckles, D., & Cheng, J. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14559 · Cited by 382 · cited 3×
“[14] employed factchecking URLs in Snopes.”
BackgroundInfluentialYang, C., Harkreader, R., Zhang, J., Shin, S., & Gu, G. (2012) · Proceedings of the 21st international conference on World Wide Web · doi:10.1145/2187836.2187847 · Cited by 299
Leveraging the Crowd to Detect and Reduce the Spread of Fake News and Misinformation
Kim, J., Tabibian, B., Oh, A., Schölkopf, B., & Gomez-Rodriguez, M. (2018) · Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining · doi:10.1145/3159652.3159734 · Cited by 230 · cited 1×
“nvestigated as well [15, 19, 58]. Several works attempted to detect rumors as soon as possible using disputed signals [32, 58], leveraging network embedding [54] and employing collective data sources [20, 40]. However, there is no work about combating fake news once it has been debunked. Another direction is to detect…”
BackgroundCharacterizing Online Rumoring Behavior Using Multi-Dimensional Signatures
Maddock, J., Starbird, K., Al-Hassani, H. J., Sandoval, D. E., Orand, M., & Mason, R. M. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675280 · Cited by 129 · cited 2×
“However, fake news is still wildly disseminated on social media even when it has been debunked [36, 58].”
BackgroundHannak, A., Margolin, D., Keegan, B., & Weber, I. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14555 · Cited by 90
Cited by
Misinformation in Social Media: Definition, Manipulation, and Detection
Wu, L., Morstatter, F., Carley, K. M., & Liu, H. (2019) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3373464.3373475 · Cited by 397
Combating disinformation in a social media age
Shu, K., Bhattacharjee, A., Alatawi, F., Nazer, T. H., Ding, K., Karami, M., & Liu, H. (2020) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1385 · Cited by 198
The Future of False Information Detection on Social Media: New Perspectives and Trends
Guo, B., Ding, Y., Yao, L., Liang, Y., & Yu, Z. (2021) · ACM Computing Surveys · doi:10.1145/3393880 · Cited by 122
SoK: Content Moderation in Social Media, from Guidelines to Enforcement, and Research to Practice
Singhal, M., Ling, C., Paudel, P., Thota, P., Kumarswamy, N., Stringhini, G., & Nilizadeh, S. (2023) · 2023 IEEE 8th European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp57164.2023.00056 · Cited by 57
Dataset of Fake News Detection and Fact Verification: A Survey
Murayama, T. (2021) · arXiv · doi:10.48550/arxiv.2111.03299 · Cited by 40
“Rise-Guardian [221], a large-scale version of Snopee, includes 225,068 fact-checking tweets consisting of 157,482 reply tweets and 67,585 retweets collected by Hoaxy [194], which were used for building a fact-checking URL recommendation model to encourage the Guardians to engage more in fact-checking activities.”
BackgroundMethodInfluential
Metadata
- Authors
- Vo, N., & Lee, K.
- Venue
- The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval
- Publisher
- ACM
- Published
- 2018-06-27
- Pages
- 275-284
- OpenAlex
- W2798953174
- Cited by
- 125
- References
- 16
- FWCI
- 50.00
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.