Cited by 722Misinformation and Its ImpactsComplex Network Analysis TechniquesPublic Relations and Crisis Communication

Analysing How People Orient to and Spread Rumours in Social Media by Looking at Conversational Threads

Open access
Zubiaga, Arkaitz, Liakata, Maria, Procter, Rob, Wong Sak Hoi, Geraldine, Tolmie, Peter·2016·PLOS ONE

Abstract

As breaking news unfolds people increasingly rely on social media to stay abreast of the latest updates. The use of social media in such situations comes with the caveat that new information being released piecemeal may encourage rumours, many of which remain unverified long after their point of release. Little is known, however, about the dynamics of the life cycle of a social media rumour. In this paper we present a methodology that has enabled us to collect, identify and annotate a dataset of 330 rumour threads (4,842 tweets) associated with 9 newsworthy events. We analyse this dataset to understand how users spread, support, or deny rumours that are later proven true or false, by distinguishing two levels of status in a rumour life cycle i.e., before and after its veracity status is resolved. The identification of rumours associated with each event, as well as the tweet that resolved each rumour as true or false, was performed by journalist members of the research team who tracked the events in real time. Our study shows that rumours that are ultimately proven true tend to be resolved faster than those that turn out to be false. Whilst one can readily see users denying rumours once they have been debunked, users appear to be less capable of distinguishing true from false rumours when their veracity remains in question. In fact, we show that the prevalent tendency for users is to support every unverified rumour. We also analyse the role of different types of users, finding that highly reputable users such as news organisations endeavour to post well-grounded statements, which appear to be certain and accompanied by evidence. Nevertheless, these often prove to be unverified pieces of information that give rise to false rumours. Our study reinforces the need for developing robust machine learning techniques that can provide assistance in real time for assessing the veracity of rumours. The findings of our study provide useful insights for achieving this aim.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0150989

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Zubiaga et al. (2016c) concluded that users tend to support unverified rumours early on, then shift toward supporting true rumours and debunking false ones over time.

    “This study concludes that, while the overall tendency is for users to support unverified rumours in the early stages, there is a shift toward supporting true rumours and debunking false rumours as time goes on.”

    From Detection and Resolution of Rumours in Social Media (2019) · cites this paper as Zubiaga et al. 2016c

    The Results (Rumour Support and Denial; page not supplied) say users tend to support unverified rumours and that denial increases after false rumours are debunked. But both the Results and Discussion and Conclusions say support drops after resolution even for true rumours, rather than shifting toward greater support for them. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • Rumours can be classified by various factors, including eventual veracity and degree of credibility.

    “Many different factors are available for classifying rumours by type, including its eventual veracity value (true, false, or unresolved) (Zubiaga et al. 2016c) or its degree of credibility (e.g., high or low) (Jaeger et al. 1980).”

    From Detection and Resolution of Rumours in Social Media (2019) · cites this paper as Zubiaga et al. 2016c

  • Bottom-up sampling strategies emerged more recently to collect a wider range of rumours by sifting through data to identify rumours rather than using known ones.

    “Bottom-up sampling strategies have emerged more recently in studies that aimed at collecting a wider range of rumours, i.e., sifting through data to identify rumours, rather than rumours that are already known.”

    From Detection and Resolution of Rumours in Social Media (2019) · cites this paper as Zubiaga et al. 2016c

  • Veracity annotation has sometimes been operationalised by enlisting journalists with verification expertise.

    “This annotation process has been sometimes operationalised by enlisting the help of journalists with expertise in verification (Zubiaga et al. 2016c).”

    From Detection and Resolution of Rumours in Social Media (2019) · cites this paper as Zubiaga et al. 2016c

  • In one example, journalists analysed rumourous claims during breaking news to determine if a rumour was later confirmed true or debunked false; some rumours were marked unverified because no reliable resolution was found.

    “journalists analysed rumourous claims spreading on social media during breaking news to determine, where possible, if a rumour had later been confirmed as true or debunked and proven false; this is, however, not always possible and some rumours were marked as unverified as no reliable resolution could be found.”

    From Detection and Resolution of Rumours in Social Media (2019) · cites this paper as Zubiaga et al. 2016c

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 24

  1. [6]Derczynski L, Bontcheva K. Pheme: Veracity in digital social networks Proceedings of ISA. 2014;.
  2. [7]DiFonzo N, Bordia P. Rumor, gossip and urban legends. Diogenes. 2007; 54(1): 19– 35. 10.1177/0392192107073433 · DOI · Paper page
  3. [8]Zubiaga A, Liakata M, Procter R, Bontcheva K, Tolmie P. Towards Detecting Rumours in Social Media. In: Proceedings of the AAAI Workshop on AI for Cities; 2015.
  4. [9]Donovan P. How idle is idle talk? One hundred years of rumor research. Diogenes. 2007; 54(1): 59– 82. 10.1177/0392192107073434 · DOI
  5. [11]Qazvinian V, Rosengren E, Radev DR, Mei Q. Rumor has it: Identifying misinformation in microblogs In: Proceedings of EMNLP; 2011 p. 1589– 1599.
  6. [12]Allport GW, Postman L. An analysis of rumor. Public Opinion Quarterly. 1946; 10(4): 501– 517.
  7. [13]Allport GW, Postman L. The psychology of rumor. 1947;. 21012248
  8. [14]Prasad J. The psychology of rumour: A study relating to the great Indian earthquake of 1934. British Journal of Psychology General Section. 1935; 26(1): 1– 15. 10.1111/j.2044-8295.1935.tb00770.x · DOI
  9. [15]Sinha D. Behaviour in a catastrophic situation: A psychological study of reports and rumours. British Journal of Psychology General Section. 1952; 43(3): 200– 209. 10.1111/j.2044-8295.1952.tb00343.x · DOI
  10. [16]Jaeger ME, Anthony S, Rosnow RL. Who Hears What from Whom and with What Effect A Study of Rumor. Personality and Social Psychology Bulletin. 1980; 6(3): 473– 478. 10.1177/014616728063024 · DOI · Paper page
  11. [17]Scanlon TJ. Post-disaster rumor chains: A case study. Mass Emergencies. 1977; 2(126): 22– 27.
  12. [18]Knapp RH. A psychology of rumor. Public Opinion Quarterly. 1944; 8(1): 22– 37.
  13. [19]Bordia P. Studying verbal interaction on the Internet: The case of rumor transmission research. Behavior Research Methods, Instruments, & Computers. 1996; 28(2): 149– 151. 10.3758/BF03204753 · DOI
  14. [21]Castillo C, Mendoza M, Poblete B. Predicting information credibility in time-sensitive social media. Internet Research. 2013; 23(5): 560– 588. 10.1108/IntR-05-2012-0095 · DOI · Paper page
  15. [22]Procter R, Vis F, Voss A. Reading the riots on Twitter: methodological innovation for the analysis of big data. International Journal of Social Research Methodology. 2013; 16(3): 197– 214. 10.1080/13645579.2013.774172 · DOI
  16. [23]Starbird K, Maddock J, Orand M, Achterman P, Mason RM. Rumors, False Flags, and Digital Vigilantes: Misinformation on Twitter after the 2013 Boston Marathon Bombing. In: Proceedings of iConference. iSchools; 2014.
  17. [24]Friggeri A, Adamic LA, Eckles D, Cheng J. Rumor cascades. In: Proceedings of the AAAI Conference on Weblogs and Social Media; 2014.
  18. [27]Lukasik M, Cohn T, Bontcheva K. Classifying Tweet Level Judgements of Rumours in Social Media. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. Lisbon, Portugal: Association for Computational Linguistics; 2015. p. 2590–2595.
  19. [32]Tolmie P, Procter R, Rouncefield M, Liakata M, Zubiaga A. Microblog Analysis as a Programme of Work. ArXiv e-prints. 2015 Nov;.
  20. [33]Saurí R, Pustejovsky J. FactBank: A corpus annotated with event factuality. Language resources and evaluation. 2009; 43(3): 227– 268. 10.1007/s10579-009-9089-9 · DOI
  21. [34]Procter R, Housley W, Williams M, Edwards A, Burnap P, Morgan J, et al Enabling social media research through citizen social science. ECSCW 2013 Adjunct Proceedings. 2013; 3.
  22. [38]Cotter C. News talk: Investigating the language of journalism. Cambridge University Press; 2010.
  23. [40]Saunders KW. Mythic Difficulty in Proving a Negative, The. Seton Hall Law Review. 1984; 15: 276.
  24. [41]Sacks H. Lectures on conversation. Oxford: Basil Blackwell; 1992.

Cited by

Sorted by citations

Authors
Zubiaga, A., Liakata, M., Procter, R., Wong Sak Hoi, G., & Tolmie, P.
Affiliations
University of Warwick (GB)
Corresponding author
Zubiaga, Arkaitz
Venue
PLOS ONE
Published
2016-03-04
Volume
11
Issue
3
Pages
e0150989
ISSN
1932-6203 (ISSN-L)
OpenAlex
W2281420995
Cited by
722
References
6
Citations by year
2026: 42 · 2025: 51 · 2024: 52 · 2023: 64 · 2022: 99 · 2021: 109 · 2020: 101 · 2019: 96 · 2018: 56 · 2017: 40 · 2016: 9 · 2013: 1
FWCI
191.58
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Issue Lab (Candid) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
European Commission (611233)
Topics
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
  • Social Sciences › Communication › Public Relations and Crisis Communication
Keywords
rumor propagation, social media, breaking news, user reputation, news organizations, misinformation
MeSH terms
Communication, Denial, Psychological, Social Support, Social Media

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review