#Unconfirmed: Classifying Rumor Stance in Crisis-Related Social Media Messages
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
It is well-established that within crisis-related communications, rumors are likely to emerge. False rumors, i.e. misinformation, can be detrimental to crisis communication and response; it is therefore important not only to be able to identify messages that propagate rumors, but also corrections or denials of rumor content. In this work, we explore the task of automatically classifying rumor stances expressed in crisisrelated content posted on social media. Utilizing a dataset of over 4,300 manually coded tweets, we build a supervised machine learning model for this task, achieving an accuracy over 88% across a diverse set of rumors of different types.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774 · cited 5×
“• LIWC features: We extract other lexical features using the Linguistic Inquiry and Word Count (LIWC) (Tausczik and Pennebaker 2010) dictionaries for negation words, swear words, negative emotion words, positive emotion words, emoticons, personal pronouns, adverbs, etc.”
MethodInfluentialTwitter under crisis: can we trust what we RT?
Mendoza, M., Poblete, B., & Castillo, C. (2010) · Proceedings of the First Workshop on Social Media Analytics · doi:10.1145/1964858.1964869 · Cited by 955 · cited 1×
“• Part of speech features: We apply a part-of-speech (POS) tagger using a Tweet NLP system (Owoputi et al. 2013).”
Method(2014) · iConference 2014 Proceedings · doi:10.9776/14308 · Cited by 423
Self-citation
Cited by
A survey on fake news and rumour detection techniques
Bondielli, A., & Marcelloni, F. (2019) · Information Sciences · doi:10.1016/j.ins.2019.05.035 · Cited by 658
“Comparative studies on various machine learning algorithms for rumours and fake news tasks have outlined random forests as a strong performer [3, 12, 36, 57, 107].”
BackgroundMethodInfluentialDetection and Resolution of Rumours in Social Media: A Survey
Zubiaga, A., Aker, A., Bontcheva, K., Liakata, M., & Procter, R. (2019) · ACM Computing Surveys · doi:10.1145/3161603 · Cited by 862
“More recently, [Zeng et al. 2016] enrich the feature sets investigated by earlier studies by features determined through Linguistic Inquiry and Word Count (LIWC) dictionaries [Tausczik and Pennebaker 2010].”
BackgroundFake news detection: A hybrid CNN-RNN based deep learning approach
Nasir, J. A., Khan, O. S., & Varlamis, I. (2021) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2020.100007 · Cited by 565
Exploiting Context for Rumour Detection in Social Media
Zubiaga, A., Liakata, M., & Procter, R. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67217-5_8 · Cited by 350
“For instance, there is an increasing body of work [24,15,10,11,17,34] looking into stance classification of tweets discussing rumours, categorising tweets as supporting, denying or questioning the rumour.”
BackgroundKeeping Rumors in Proportion: Managing Uncertainty in Rumor Systems
Krafft, P. M., & Spiro, E. S. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300876 · Cited by 9
“Pieces of work on rumors that neglect uncertainty in their analysis either focus on analyzing rumors in retrospect, after they have been confirmed or debunked, or utilize a broader definition of rumor to include verifiable misinformation [17, 42, 50].”
BackgroundSelf-citation
Metadata
- Authors
- Zeng, L., Starbird, K., & Spiro, E.
- Venue
- Proceedings of the International AAAI Conference on Web and Social Media
- Published
- 2021-08-04
- Volume
- 10
- Issue
- 1
- Pages
- 747-750
- ISSN
- 2162-3449 (ISSN-L)
- 2334-0770
- OpenAlex
- W2574689852
- Cited by
- 50
- References
- 3
- FWCI
- 12.45
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: #Unconfirmed: Classifying Rumor Stance in Crisis-Related Social Media Messages. https://app.cochat.ai/papers/10.1609/icwsm.v10i1.14788
- The paper
- Zeng, L., Starbird, K., & Spiro, E. (2021). #Unconfirmed: Classifying Rumor Stance in Crisis-Related Social Media Messages. Proceedings of the International AAAI Conference on Web and Social Media. https://doi.org/10.1609/icwsm.v10i1.14788
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.