Web-based statistical fact checking of textual documents
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
User generated content has been growing tremendously in recent years. This content reflects the interests and the diversity of online users. In turn, the diversity among internet users is also reflected in the quality of the content being published online. This increases the need to develop means to gauge the support available for content posted online. In this work, we aim to make use of the web-content to calculate a statistical support score for textual documents. In the proposed algorithm, phrases representing key facts are extracted to construct basic elements of the document. Search is used thereon to validate the support available for these elements online, leading to assigning an overall score for each document. Experimental results have shown a difference between the score distribution of factual news data and false facts data. This indicates that the approach seems to be a promising seed for distinguishing different articles based on the content.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Other literature attempts to use the whole web as the knowledge source [65, 171]. However, this method leads to another research problem - 'how to ensure the trustworthiness of the information we use from the web' [84].”
From Survey of Hallucination in Natural Language Generation (2023) · cites this paper as [171]
Citations
Cites
Item-based collaborative filtering recommendation algorithms
Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2001) · Proceedings of the 10th international conference on World Wide Web · doi:10.1145/371920.372071 · Cited by 9,135 · cited 1×
“Collaborative filtering has been heavily used in rating online content [8, 11].”
MethodFeature-rich part-of-speech tagging with a cyclic dependency network
Toutanova, K., Klein, D., Manning, C. D., & Singer, Y. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073478 · Cited by 2,844
Studying cooperation and conflict between authors with history flow visualizations
Viégas, F. B., Wattenberg, M., & Dave, K. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985765 · Cited by 768
New York Times Annotated Corpus
Sandhaus, E., & Linguistic Data Consortium (2012) · TIB Data Manager · doi:10.57702/qbrk4fuh · Cited by 586
Size matters: word count as a measure of quality on wikipedia
Blumenstock, J. E. (2008) · Proceedings of the 17th international conference on World Wide Web · doi:10.1145/1367497.1367673 · Cited by 270
Assessing information quality of a community-based encyclopedia
Stvilia, B., Twidale, M. B., Smith, L. C., & Gasser, L. (2005) · Cited by 245
Measuring article quality in wikipedia: models and evaluation
Hu, M., Lim, E.-P., Sun, A., Lauw, H. W., & Vuong, B.-Q. (2007) · Proceedings of the sixteenth ACM conference on Conference on information and knowledge management · doi:10.1145/1321440.1321476 · Cited by 242
Computing trust from revision history
Zeng, H., Alhossaini, M. A., Ding, L., Fikes, R. E., & McGuinness, D. L. (2006) · Conference on Privacy, Security and Trust · doi:10.1145/1501434.1501445 · Cited by 134
Incremental Collaborative Filtering for Highly-Scalable Recommendation Algorithms
Papagelis, M., Rousidis, I., Plexousakis, D., & Theoharopoulos, E. (2005) · Lecture notes in computer science · doi:10.1007/11425274_57 · Cited by 105
Research works printed but not linked: 1
- Stvilia , B. , Twidale , M. , Gasser , L. , and Smith , L . 2005.Information quality discussions in Wikipedia , In Proceedings of the 2005 International Conference on Knowledge Management (Charlotte, NC, USA, October 27-28, 2005) ICKM2005. 101--113 . Stvilia, B., Twidale, M., Gasser, L., and Smith, L. 2005.Information quality discussions in Wikipedia, In Proceedings of the 2005 International Conference on Knowledge Management (Charlotte, NC, USA, October 27-28, 2005) ICKM2005. 101--113.
Cited by
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
“Some literature attempt to use the whole web as the knowledge source [38, 102].”
BackgroundFake News Detection on Social Media: A Data Mining Perspective
Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3137597.3137600 · Cited by 3,304
A Stylometric Inquiry into Hyperpartisan and Fake News
Potthast, M., Kiesel, J., Reinartz, K., Bevendorff, J., & Stein, B. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1022 · Cited by 686
A survey on fake news and rumour detection techniques
Bondielli, A., & Marcelloni, F. (2019) · Information Sciences · doi:10.1016/j.ins.2019.05.035 · Cited by 658
“[66] has automated the process of web-based fact checking, by comparing facts extracted from a given document against facts extracted from URLs related to such documents.”
MethodBeyond News Contents: The Role of Social Context for Fake News Detection
Shu, K., Wang, S., & Liu, H. (2019) · Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining · doi:10.1145/3289600.3290994 · Cited by 582
Metadata
- Authors
- Magdy, A., & Wanas, N.
- Affiliations
- Alexandria University (EG)
- Cairo Microsoft Innovation Laboratory, Cairo, Egypt
- ORCID
- Magdy, Amr
- Venue
- Proceedings of the 2nd international workshop on Search and mining user-generated contents
- Publisher
- ACM
- Published
- 2010-10-30
- Pages
- 103-110
- OpenAlex
- W1969944630
- Semantic Scholar
- cca87ecd26106502f6d2510575367516210f4d6f
- Cited by
- 59
- References
- 17
- Citations by year
- 2025: 1 · 2024: 5 · 2023: 5 · 2022: 6 · 2021: 10 · 2020: 6 · 2019: 15 · 2018: 7 · 2017: 3 · 2013: 1
- FWCI
- 0.94
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Workshop on Search and Mining User-Generated Contents (SMUC) (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- fact-checking, user-generated content, web search, keyword extraction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Web-based statistical fact checking of textual documents. https://app.cochat.ai/papers/10.1145/1871985.1872002
- The paper
- Magdy, A., & Wanas, N. (2010). Web-based statistical fact checking of textual documents. Proceedings of the 2nd international workshop on Search and mining user-generated contents. https://doi.org/10.1145/1871985.1872002
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.