Keeping Rumors in Proportion: Managing Uncertainty in Rumor Systems
Open accessThe DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Abstract
The study of rumors has garnered wider attention as regulators and researchers turn towards problems of misinformation on social media. One goal has been to discover and implement mechanisms that promote healthy information ecosystems. Classically defined as regarding ambiguous situations, rumors pose the unique difficulty of intrinsic uncertainty around their veracity. Further complicating matters, rumors can serve the public when they do spread valuable true information. To address these challenges, we develop an approach that reifies "rumor proportions" as central to the theory of systems for managing rumors. We use this lens to advocate for systems that, rather than aiming to stifle rumors entirely or aiming to stop only false rumors, aim to prevent rumors from growing out of proportion relative to normative benchmark representations of intrinsic uncertainty.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Information credibility on twitter
Castillo, C., Mendoza, M., & Poblete, B. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963500 · Cited by 2,593 · cited 1×
“Prominent fact checking organizations include Snopes and Poli-tiFact, but there has also been work in the academic community pushing this approach in new ways, such as predicting credibility through rumor features (e.g., [9, 10, 29]) or through trust networks (e.g., [51]).”
BackgroundBayesian Inference in Econometric Models Using Monte Carlo Integration
Geweke, J. (1989) · Econometrica · doi:10.2307/1913710 · Cited by 1,563 · cited 1×
“For incentives, existing decisiontheoretic models provide a guide for how to modify distributions of beliefs in high-cost or high-gain situations [18].”
BackgroundQuantifying the consensus on anthropogenic global warming in the scientific literature
Cook, J., Nuccitelli, D., Green, S. A., Richardson, M., Winkler, B., Painting, R., Way, R., Jacobs, P., & Skuce, A. (2013) · Environmental Research Letters · doi:10.1088/1748-9326/8/2/024024 · Cited by 1,360 · cited 2×
“We then compare the proportion of affirmations versus denials in this sample against a benchmark of the aggregate expert opinion, currently estimated to be between 90-100% of climate scientists [2, 13].”
BackgroundTwitter under crisis: can we trust what we RT?
Mendoza, M., Poblete, B., & Castillo, C. (2010) · Proceedings of the First Workshop on Social Media Analytics · doi:10.1145/1964858.1964869 · Cited by 955 · cited 3×
“Finally, several pieces of work in the literature on rumor detection and classification have noted that detection and classification are possible based on features of discussion patterns, such as the presence of questioning or the proportion of affirmations versus denials [32, 41, 42], which indicates a relationship i…”
BackgroundDetection and Resolution of Rumours in Social Media: A Survey
Zubiaga, A., Aker, A., Bontcheva, K., Liakata, M., & Procter, R. (2019) · ACM Computing Surveys · doi:10.1145/3161603 · Cited by 862 · cited 3×
“with problematic forms of information—detect and stop the spread of problematic content [53].”
BackgroundExpert credibility in climate change
Anderegg, W. R. L., Prall, J. W., Harold, J., & Schneider, S. H. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1003187107 · Cited by 813 · cited 2×
“We then compare the proportion of affirmations versus denials in this sample against a benchmark of the aggregate expert opinion, currently estimated to be between 90-100% of climate scientists [2, 13].”
BackgroundGeographic variation in opinions on climate change at state and local scales in the USA
Howe, P. D., Mildenberger, M., Marlon, J. R., & Leiserowitz, A. (2015) · Nature Climate Change · doi:10.1038/nclimate2583 · Cited by 724 · cited 1×
“Surveys of public opinion invariably report the proportion of people who hold a particular belief, and there are wellknown notable cases of public opinion diverging from, for example, the aggregate opinions of experts, such as in beliefs about climate change [2, 13, 23].”
Background(2011) · Cited by 724
Zubiaga, A., Liakata, M., Procter, R., Wong Sak Hoi, G., & Tolmie, P. (2016) · PLOS ONE · doi:10.1371/journal.pone.0150989 · Cited by 722 · cited 3×
“Other work has suggested that rumor proportions vary over time more than how people express uncertainty about a rumor [54].”
BackgroundOptimal Predictions in Everyday Cognition
Griffiths, T. L., & Tenenbaum, J. B. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01780.x · Cited by 639 · cited 2×
“First, many studies in cognitive science have shown that people display Bayesian updating on average in aggregate [20, 21, 45], and recent work has argued that these results may be best explained by sample-based cognitive mechanisms [47].”
BackgroundEnquiring Minds: Early Detection of Rumors in Social Media from Enquiry Posts
Zhao, Z., Resnick, P., & Mei, Q. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741637 · Cited by 583 · cited 1×
“Recent studies have indicated that detecting rumor-related content using discussion patterns and content characteristics can also be successful [32, 34, 35, 52, 53].”
BackgroundImprovised news;: A sociological study of rumor
Shibutani, T. (1966) · Medical Entomology and Zoology · Cited by 529
Griffiths, T. L., Kemp, C., & Tenenbaum, J. B. (2001) · The Cambridge Handbook of Computational Psychology · doi:10.1017/cbo9780511816772.006 · Cited by 507 · cited 2×
“First, many studies in cognitive science have shown that people display Bayesian updating on average in aggregate [20, 21, 45], and recent work has argued that these results may be best explained by sample-based cognitive mechanisms [47].”
BackgroundVul (2014) · doi:10.1111/cogs.12101 · Cited by 502 · cited 3×
“Furthermore, instead of always believing the proposition that is most likely according to available evidence, people across a range of laboratory experiments demonstrate behavior consistent with randomly choosing between discrete beliefs with probability related to the evidence [25, 39, 47, 48].”
Background(2014) · iConference 2014 Proceedings · doi:10.9776/14308 · Cited by 423 · cited 2×
“Finally, several pieces of work in the literature on rumor detection and classification have noted that detection and classification are possible based on features of discussion patterns, such as the presence of questioning or the proportion of affirmations versus denials [32, 41, 42], which indicates a relationship i…”
BackgroundInside rumor: A personal journey.
Rosnow, R. L. (1991) · American Psychologist · doi:10.1037//0003-066x.46.5.484 · Cited by 390 · cited 1×
“In times of crisis, rumors draw their strength from the anxiety of uncertainty [1, 3, 36–38].”
BackgroundImprovised News: A Sociological Study of Rumor.
Katz, E., & Shibutani, T. (1969) · American Sociological Review · doi:10.2307/2092353 · Cited by 381 · cited 2×
“Relatedly, one important theory of rumors is that rumors function to help us make sense of the world together [40].”
BackgroundSocial Influence Network Theory: A Sociological Examination of Small Group Dynamics
Friedkin, N. E., & Johnsen, E. C. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511976735 · Cited by 372
Rumor Detection over Varying Time Windows
Kwon, S., Cha, M., & Jung, K. (2017) · PLOS ONE · doi:10.1371/journal.pone.0168344 · Cited by 352 · cited 1×
“Prominent fact checking organizations include Snopes and Poli-tiFact, but there has also been work in the academic community pushing this approach in new ways, such as predicting credibility through rumor features (e.g., [9, 10, 29]) or through trust networks (e.g., [51]).”
BackgroundPredicting information credibility in time-sensitive social media
Castillo, C., Mendoza, M., & Poblete, B. (2013) · Internet Research · doi:10.1108/intr-05-2012-0095 · Cited by 339
Measuring the Crowd Within: Probabilistic Representations Within Individuals
Vul, E., & Pashler, H. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02136.x · Cited by 333 · cited 1×
“Furthermore, instead of always believing the proposition that is most likely according to available evidence, people across a range of laboratory experiments demonstrate behavior consistent with randomly choosing between discrete beliefs with probability related to the evidence [25, 39, 47, 48].”
BackgroundPsychological Strategies for Winning a Geopolitical Forecasting Tournament
Mellers, B., Ungar, L., Baron, J., Ramos, J., Gurcay, B., Fincher, K., Scott, S. E., Moore, D., Atanasov, P., Swift, S. A., et al. (2014) · Psychological Science · doi:10.1177/0956797614524255 · Cited by 312 · cited 1×
“, [31]), or perhaps a prediction market [33], make a quantitative judgment about what is a rational probability P(R | E) that the rumor is true given public evidence; and to assess the gap between that probability and the proportion of people who express belief in the rumor either through a survey or through observati…”
BackgroundReading the riots on Twitter: methodological innovation for the analysis of big data
Procter, R., Vis, F., & Voss, A. (2013) · International Journal of Social Research Methodology · doi:10.1080/13645579.2013.774172 · Cited by 271 · cited 2×
“Recent studies have indicated that detecting rumor-related content using discussion patterns and content characteristics can also be successful [32, 34, 35, 52, 53].”
BackgroundProblem Solving in Social Interactions on the Internet: Rumor As Social Cognition
Bordia, P., & Difonzo, N. (2004) · Social Psychology Quarterly · doi:10.1177/019027250406700105 · Cited by 256 · cited 1×
“Rumors include a broader class of “unverified information” [7], which can be true or false, and therefore can become disinformation or misinformation once the veracity is settled.”
BackgroundLexicon of Lies: Terms for Problematic Information
Jack, C. (2017) · doi:10.69985/kmpz3134 · Cited by 226 · cited 1×
“Misinformation is defined as an unintentionally false utterance, while disinformation is information that is deliberately false or misleading [24].”
BackgroundIterated learning: Intergenerational knowledge transmission reveals inductive biases
Kalish, M. L., Griffiths, T. L., & Lewandowsky, S. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194066 · Cited by 220 · cited 1×
“Furthermore, instead of always believing the proposition that is most likely according to available evidence, people across a range of laboratory experiments demonstrate behavior consistent with randomly choosing between discrete beliefs with probability related to the evidence [25, 39, 47, 48].”
BackgroundRumor as Communication: A Contextualist Approach
Rosnow, R. L. (1988) · Journal of Communication · doi:10.1111/j.1460-2466.1988.tb02033.x · Cited by 208 · cited 1×
“Consistent with the definition of rumor as a proposition for belief [37], we model R as a being a logical proposition about the world.”
MethodShin, J., Jian, L., Driscoll, K., & Bar, F. (2017) · New Media & Society · doi:10.1177/1461444816634054 · Cited by 203 · cited 1×
“Finally, several pieces of work in the literature on rumor detection and classification have noted that detection and classification are possible based on features of discussion patterns, such as the presence of questioning or the proportion of affirmations versus denials [32, 41, 42], which indicates a relationship i…”
BackgroundDiFonzo, N., Bordia, P., & Rosnow, R. L. (1994) · Organizational Dynamics · doi:10.1016/0090-2616(94)90087-6 · Cited by 200
DiFonzo, N., & Bordia, P. (2000) · Public Relations Review · doi:10.1016/s0363-8111(00)00039-4 · Cited by 187 · cited 2×
“Evidence suggests that an indirect approach of ameliorating anxiety about issues that would stimulate rumors can prevent rumors from forming in the first place [14, 15].”
BackgroundThe Real Power of Artificial Markets
Pennock, D. M., Lawrence, S., Giles, C. L., & Nielsen, F. Å. (2001) · Science · doi:10.1126/science.291.5506.987 · Cited by 185 · cited 1×
“, [31]), or perhaps a prediction market [33], make a quantitative judgment about what is a rational probability P(R | E) that the rumor is true given public evidence; and to assess the gap between that probability and the proportion of people who express belief in the rumor either through a survey or through observati…”
BackgroundPsychology of rumor reconsidered.
Rosnow, R. L. (1980) · Psychological Bulletin · doi:10.1037//0033-2909.87.3.578 · Cited by 185
Social Influence Network Theory: A Sociological Examination of Small Group Dynamics
Friedkin, N. E., & Johnsen, E. C. (2014) · Cited by 176
A Bayesian framework for concept learning
Tenenbaum, J. B. (1999) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 158
The Anatomy of Large Facebook Cascades
Dow, P. A., Adamic, L., & Friggeri, A. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14431 · Cited by 156
A study of rumor control strategies on social networks
Tripathy, R. M., Bagchi, A., & Mehta, S. (2010) · Proceedings of the 19th ACM international conference on Information and knowledge management · doi:10.1145/1871437.1871737 · Cited by 150 · cited 1×
“This approach is advocated by prominent researchers of rumor in psychology and organizational behavior [14, 15], and has also been explored in computer science (e.g., [46]).”
BackgroundWin-Stay, Lose-Sample: A simple sequential algorithm for approximating Bayesian inference
Bonawitz, E., Denison, S., Gopnik, A., & Griffiths, T. L. (2014) · Cognitive Psychology · doi:10.1016/j.cogpsych.2014.06.003 · Cited by 131 · cited 1×
“Belief change can occur in this model, but it happens in discrete bursts from disbelief to belief rather than through tempered, gradual changes in shades [6].”
BackgroundZhang, A. X., Robbins, M., Bice, E., Hawke, S., Karger, D., Mina, A. X., Ranganathan, A., Metz, S. E., Appling, S., Sehat, C. M., et al. (2018) · Companion of the The Web Conference 2018 on The Web Conference 2018 - WWW '18 · doi:10.1145/3184558.3188731 · Cited by 120
Caplow, T. (1947) · Social Forces · doi:10.1093/sf/25.3.298 · Cited by 111 · cited 2×
“Although rumors could be an ineffective mechanism for this function if they are often untrue, both classic and recent studies that have conducted open-ended surveys of rumors in circulation have concluded that most rumors are true or are based in truth [8, 54].”
BackgroundAnthony, S. (1973) · The Journal of Social Psychology · doi:10.1080/00224545.1973.9922572 · Cited by 104 · cited 1×
“In times of crisis, rumors draw their strength from the anxiety of uncertainty [1, 3, 36–38].”
BackgroundOn Rumours: How Falsehoods Spread, Why We Believe Them, What Can Be Done
Sunstein, C. R. (2009) · Medical Entomology and Zoology · Cited by 103
A Closer Look at the Self-Correcting Crowd: Examining Corrections in Online Rumors
Arif, A., Robinson, J. J., Stanek, S. A., Fichet, E. S., Townsend, P., Worku, Z., & Starbird, K. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998294 · Cited by 96 · cited 1×
“Other work has directly documented self-correcting dynamics [4, 54].”
BackgroundHannak, A., Margolin, D., Keegan, B., & Weber, I. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14555 · Cited by 90 · cited 1×
“For instance, works studying the effectiveness of interventions on rumors test whether increases or decreases in rumor proportions are achieved (e.g., [17, 22]).”
BackgroundCould This Be True?: I Think So! Expressed Uncertainty in Online Rumoring
Starbird, K., Spiro, E., Edwards, I., Zhou, K., Maddock, J., & Narasimhan, S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858551 · Cited by 86 · cited 2×
“In this capacity and also as a means of expression, rumors also are theorized to serve to reduce our anxieties [43].”
BackgroundSelf-citationHow Information Snowballs: Exploring the Role of Exposure in Online Rumor Propagation
Arif, A., Shanahan, K., Chou, F.-J., Dosouto, Y., Starbird, K., & Spiro, E. S. (2016) · Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing · doi:10.1145/2818048.2819964 · Cited by 81 · cited 1×
“This distinction is important in practical analysis of rumors on social media [5], and for the most part we have elided it.”
BackgroundSelf-citationDigital Wildfires: Propagation, Verification, Regulation, and Responsible Innovation
Webb, H., Burnap, P., Procter, R., Rana, O., Stahl, B. C., Williams, M., Housley, W., Edwards, A., & Jirotka, M. (2016) · ACM Transactions on Information Systems · doi:10.1145/2893478 · Cited by 64 · cited 1×
“False rumors can have profound, and unwarranted, negative impact [1, 8, 49].”
BackgroundCoast, D., & Fox, J. (2015) · History Compass · doi:10.1111/hic3.12234 · Cited by 59 · cited 1×
“Finally, there has historically be a political dimension to rumor, with rumor being a lever of power not just for the political elite but also for the masses [12].”
BackgroundQuantifying Social Influence in an Online Cultural Market
Krumme, C., Cebrian, M., Pickard, G., & Pentland, S. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033785 · Cited by 58 · cited 1×
“Second, some work has directly tested social sampling models as models of behavior outside of the rumor context [26, 28].”
BackgroundGriffiths, T. L. (2024) · doi:10.21428/e2759450.7b420317 · Cited by 53
#Unconfirmed: Classifying Rumor Stance in Crisis-Related Social Media Messages
Zeng, L., Starbird, K., & Spiro, E. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v10i1.14788 · Cited by 50 · cited 2×
“Pieces of work on rumors that neglect uncertainty in their analysis either focus on analyzing rumors in retrospect, after they have been confirmed or debunked, or utilize a broader definition of rumor to include verifiable misinformation [17, 42, 50].”
BackgroundSelf-citationMarkov chain Monte Carlo with people
Sanborn, A. N., & Griffiths, T. L. (2008) · Warwick Research Archive Portal (University of Warwick) · doi:10.82444/warw.33600526 · Cited by 37
Centralized, Parallel, and Distributed Information Processing during Collective Sensemaking
Krafft, P. M., Zhou, K., Edwards, I. C. A. O. A. L., Starbird, K., & Spiro, E. S. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3026012 · Cited by 34 · cited 1×
“Researchers showed that prominent threads of rumors tend to change in discrete mutations more by merging different rumor threads [27].”
BackgroundSelf-citationA Distributed Learning Dynamics in Social Groups
Celis, L. E., Krafft, P. M., & Vishnoi, N. K. (2017) · ACM Symposium on Principles of Distributed Computing (PODC) · doi:10.1145/3087801.3087820 · Cited by 10 · cited 1×
“A simple “social sampling” behavior provides a motivating example of one suchmechanism [11, 26].”
BackgroundSelf-citationA rational choice framework for collective behavior
Krafft, P. M. (2017) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 3
Self-citation
Research works printed but not linked: 4
- Adrien Friggeri, Lada A Adamic, Dean Eckles, and Justin Cheng. 2014. Rumor cascades. In International Conference on Weblogs and Social Media (ICWSM).
- Tarleton Gillespie. 2018. Platforms are not intermediaries. Georgetown Law Technology Review 2 (2018), 198.
- Michal Lukasik, Kalina Bontcheva, Trevor Cohn, Arkaitz Zubiaga, Maria Liakata, and Rob Procter. 2016. Using Gaussian processes for rumour stance classification in social media. arXiv preprint arXiv:1609.01962 (2016). · arXiv
- 10.1037/0003-066x.46.5.484 · doi:10.1037/0003-066x.46.5.484 · Paper page
Cited by
Zhou, J., Zhang, Y., Luo, Q., Parker, A. G., & De Choudhury, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581318 · Cited by 288
“While most detection eforts focus on content-level features, some work highlights the importance of contextual factors and proposes frameworks to translate and operationalize publisher-news-user tri-relationship [97] and intrinsic uncertainty of misinformation detection [58].”
BackgroundThe Stepwise Deception: Simulating the Evolution from True News to Fake News with LLM Agents
Liu, Y., Song, Z., Zhang, J., Zhang, X., Chen, X., & Yan, R. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.1330 · Cited by 61
“(3) Certainty Shift (CS) evaluates changes in the level of confidence or assertiveness expressed in the news content (Krafft et al., 2019; Kim and Yoon, 2022).”
Bayesian collective learning emerges from heuristic social learning
Krafft, P. M., Shmueli, E., Griffiths, T. L., Tenenbaum, J. B., & Pentland, A. “. (2021) · Cognition · doi:10.1016/j.cognition.2020.104469 · Cited by 41
“Recent research in these fields has begun to investigate how interface design can impact the extent to which individuals conform to Bayesian reasoning in interacting with data visualizations (Kim et al., 2019; Krafft & Spiro, 2019).”
BackgroundSelf-citationAccost, Accede, or Amplify: Attitudes towards COVID-19 Misinformation on WhatsApp in India
Varanasi, R. A., Pal, J., & Vashistha, A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517588 · Cited by 50
“This case highlights the horrific impact of misinformation and rumor-mongering, especially on marginalized populations, in close-knit communities [35, 59, 71, 89].”
Puyod, J. V., & Charoensukmongkol, P. (2021) · Corporate Communications An International Journal · doi:10.1108/ccij-09-2020-0127 · Cited by 48
Metadata
- Authors
- Krafft, P. M., & Spiro, E. S.
- Affiliations
- University of Washington (US)
- Venue
- Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2019-05-02
- Pages
- 1-11
- OpenAlex
- W2942242275
- Cited by
- 9
- References
- 54
- Citations by year
- 2026: 1 · 2024: 1 · 2023: 1 · 2022: 2 · 2021: 2 · 2020: 2
- FWCI
- 4.28
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Gordon and Betty Moore Foundation
- Washington Research Foundation
- Alfred P. Sloan Foundation
- National Science Foundation
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
- Social Sciences › Communication › Public Relations and Crisis Communication
- Keywords
- rumors, misinformation, social media, rumor control, uncertainty, rumor suppression, false rumors, information ecosystem
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.