Tweeting is believing?: understanding microblog credibility perceptions
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Twitter is now used to distribute substantive content such as breaking news, increasing the importance of assessing the credibility of tweets. As users increasingly access tweets through search, they have less information on which to base credibility judgments as compared to consuming content from direct social network connections. We present survey results regarding users' perceptions of tweet credibility. We find a disparity between features users consider relevant to credibility assessment and those currently revealed by search engines. We then conducted two experiments in which we systematically manipulated several features of tweets to assess their impact on credibility ratings. We show that users are poor judges of truthfulness based on content alone, and instead are influenced by heuristics such as user name when making credibility assessments. Based on these findings, we discuss strategies tweet authors can use to enhance their credibility with readers (and strategies astute readers should be aware of!). We propose design improvements for displaying social search results so as to better convey credibility.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Past research on the online diffusion of science has mainly studied the spread of papers without regard to their retraction status (24–29).”
From Dynamics of cross-platform attention to retracted papers (2022) · cites this paper as [24]
Citations
Cites
What is Twitter, a social network or a news media?
Kwak, H., Lee, C., Park, H., & Moon, S. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772751 · Cited by 6,652
Measuring user influence in twitter: The million follower fallacy
Cha, M., Haddadi, H., Benevenuto, F., & Gummadi, K. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14033 · Cited by 3,022 · cited 2×
“For user names, those who plan to tweet exclusively on a specific topic (an advisable strategy for building a large follower base [4]), should adopt a topically-aligned user name as those generated high levels of credibility.”
BackgroundInformation credibility on twitter
Castillo, C., Mendoza, M., & Poblete, B. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963500 · Cited by 2,593
(2018) · Journal of Communication · doi:10.1111/(issn)1460-2466 · Cited by 2,303
Vieweg, S., Hughes, A. L., Starbird, K., & Palen, L. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753486 · Cited by 1,427
Perceptions of Internet Information Credibility
Flanagin, A. J., & Metzger, M. J. (2000) · Journalism & Mass Communication Quarterly · doi:10.1177/107769900007700304 · Cited by 1,069
Twitter under crisis: can we trust what we RT?
Mendoza, M., Poblete, B., & Castillo, C. (2010) · Proceedings of the First Workshop on Social Media Analytics · doi:10.1145/1964858.1964869 · Cited by 955
Characterizing Microblogs with Topic Models
Ramage, D., Dumais, S., & Liebling, D. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14026 · Cited by 702
Ratkiewicz (2011) · doi:10.1145/1963192.1963301 · Cited by 541
Tweets from Justin Bieber's heart: the dynamics of the location field in user profiles
Hecht, B., Hong, L., Suh, B., & Chi, E. H. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978976 · Cited by 465
Research works printed but not linked: 13
- Corcoran , M. Death by Cliff Plunge, With a Push From Twitter . The New York Times , July 10, 2009 . Corcoran, M. Death by Cliff Plunge, With a Push From Twitter. The New York Times, July 10, 2009.
- Esfandiari , G. The Twitter Devolution . Foreign Policy , June 7, 2010 . Esfandiari, G. The Twitter Devolution. Foreign Policy, June 7, 2010.
- 10.5555/640634 · doi:10.5555/640634
- Grover , R. Ad .ly : The Art of Advertising on Twitter . Businessweek , January 6, 2011 . Grover, R. Ad.ly: The Art of Advertising on Twitter. Businessweek, January 6, 2011.
- Kanalley , C. Facebook Shutting Down Rumor Goes Viral: Site Said to be Ending March 15, 2011 . The Huffington Post , January 9, 2011 . Kanalley, C. Facebook Shutting Down Rumor Goes Viral: Site Said to be Ending March 15, 2011. The Huffington Post, January 9, 2011.
- Lamont , I. Plane Lands on the Hudson, and Twitter Documents it All . Computerworld , Jan. 15, 2009 . Lamont, I. Plane Lands on the Hudson, and Twitter Documents it All. Computerworld, Jan. 15, 2009.
- Official Google Blog . An Update to Google Social Search . February 17, 2011 . Official Google Blog. An Update to Google Social Search. February 17, 2011.
- Owens , S. How Celebrity Imposters Hurt Twitter's Credibility . Mediashift. February 20, 2009 . Owens, S. How Celebrity Imposters Hurt Twitter's Credibility. Mediashift. February 20, 2009.
- Schroeder , S. Twitter Takes a Step Toward a Turn-Key Advertising Solution . Mashable , December 15, 2010 . Schroeder, S. Twitter Takes a Step Toward a Turn-Key Advertising Solution. Mashable, December 15, 2010.
- Schwartz , B. Bing Adds Twitter Smart Answers . Search Engine Land , July 1, 2009 . Schwartz, B. Bing Adds Twitter Smart Answers. Search Engine Land, July 1, 2009.
- Siegler , M. G. At 1. 6 Billion Queries Per Day , Twitter Finally Aims To Make Search Personally Relevant. TechCrunch , June 1, 2011 . Siegler, M. G. At 1.6 Billion Queries Per Day, Twitter Finally Aims To Make Search Personally Relevant. TechCrunch, June 1, 2011.
- Sullivan , D. Twitter's Real Time Spam Problem. Search Engine Land , June 6 , 2009 . Sullivan, D. Twitter's Real Time Spam Problem. Search Engine Land, June 6, 2009.
- Twitter Blog . blog.twitter.com. "#numbers ," March 14, 2011 . Twitter Blog. blog.twitter.com. "#numbers," March 14, 2011.
Cited by
Credibility and trust of information in online environments: The use of cognitive heuristics
Metzger, M. J., & Flanagin, A. J. (2013) · Journal of Pragmatics · doi:10.1016/j.pragma.2013.07.012 · Cited by 1,000
Multimodal Fusion with Recurrent Neural Networks for Rumor Detection on Microblogs
Jin, Z., Cao, J., Guo, H., Zhang, Y., & Luo, J. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123454 · Cited by 812
Automatic detection of rumor on Sina Weibo
Yang, F., Liu, Y., Yu, X., & Yang, M. (2012) · Proceedings of the ACM SIGKDD Workshop on Mining Data Semantics · doi:10.1145/2350190.2350203 · Cited by 680
“Some of the features have been studied in previous works [3] [11] [9].”
BackgroundDetect Rumors in Microblog Posts Using Propagation Structure via Kernel Learning
Ma, J., Gao, W., & Wong, K.-F. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1066 · Cited by 637
False rumors detection on Sina Weibo by propagation structures
Wu, K., Yang, S., & Zhu, K. Q. (2015) · 2015 IEEE 31st International Conference on Data Engineering · doi:10.1109/icde.2015.7113322 · Cited by 585
Enquiring Minds: Early Detection of Rumors in Social Media from Enquiry Posts
Zhao, Z., Resnick, P., & Mei, Q. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741637 · Cited by 583
“Although rumors have long been a hot subject in multiple disciplines (e.g., [9, 31, 22]), research on identifying rumors from online social media through computational methods has only begun in recent years.”
BackgroundGupta, A., Lamba, H., Kumaraguru, P., & Joshi, A. (2013) · Proceedings of the 22nd International Conference on World Wide Web Companion · doi:10.1145/2487788.2488033 · Cited by 573
Combating Fake News: A Survey on Identification and Mitigation Techniques
Sharma, K., Qian, F., Jiang, H., Ruchansky, N., Zhang, M., & Liu, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3305260 · Cited by 514
A review of volunteered geographic information quality assessment methods
Senaratne, H., Mobasheri, A., Ali, A. L., Capineri, C., & Haklay, M. (. (2017) · International Journal of Geographical Information Science · doi:10.1080/13658816.2016.1189556 · Cited by 493
Novel Visual and Statistical Image Features for Microblogs News Verification
Jin, Z., Cao, J., Zhang, Y., Zhou, J., & Tian, Q. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2617078 · Cited by 476
TweetCred: Real-Time Credibility Assessment of Content on Twitter
Gupta, A., Kumaraguru, P., Castillo, C., & Meier, P. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-13734-6_16 · Cited by 371
MARTÍNEZ-CÁMARA, E., MARTÍN-VALDIVIA, M. T., UREÑA-LÓPEZ, L. A., & MONTEJO-RÁEZ, A. R. (2014) · Natural Language Engineering · doi:10.1017/s1351324912000332 · Cited by 347
Predicting information credibility in time-sensitive social media
Castillo, C., Mendoza, M., & Poblete, B. (2013) · Internet Research · doi:10.1108/intr-05-2012-0095 · Cited by 339
Disinformation on the Web: Impact, Characteristics, and Detection of Wikipedia Hoaxes
Kumar, S., West, R., & Leskovec, J. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883085 · Cited by 310
A Meta-Analysis of State-of-the-Art Electoral Prediction From Twitter Data
Gayo-Avello, D. (2013) · Social Science Computer Review · doi:10.1177/0894439313493979 · Cited by 315
Edwards, C., Edwards, A., Spence, P. R., & Shelton, A. K. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2013.08.013 · Cited by 315
Finding and assessing social media information sources in the context of journalism
Diakopoulos, N., De Choudhury, M., & Naaman, M. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208409 · Cited by 221
Credibility in social media: opinions, news, and health information—a survey
Viviani, M., & Pasi, G. (2017) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1209 · Cited by 221
Shen, C., Kasra, M., Pan, W., Bassett, G. A., Malloch, Y., & O’Brien, J. F. (2019) · New Media & Society · doi:10.1177/1461444818799526 · Cited by 209
“Previous research in this area has either predominantly focused on fake image detection using machine learning approaches (Gupta et al., 2013), or on the credibility of textual information, such as websites and blogs (Allcott and Gentzkow, 2017; Morris et al., 2012; Wineburg and McGrew, 2016).”
BackgroundGayo-Avello, D. (2012) · arXiv · doi:10.48550/arxiv.1204.6441 · Cited by 179
Yoo, E., Rand, W., Eftekhar, M., & Rabinovich, E. (2016) · Journal of Operations Management · doi:10.1016/j.jom.2016.05.007 · Cited by 173
“…originator's in fl uence is particularly relevant to the context of cascades in social media networks during humanitarian crises since users previously reported having signi fi cant concerns about the credibility of disaster information they received through social media (Ringel Morris et al., 2012).”
BackgroundWang, W., Chen, L., Thirunarayan, K., & Sheth, A. P. (2014) · Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing · doi:10.1145/2531602.2531734 · Cited by 170
Identifying rumors and their sources in social networks
Seo, E., Mohapatra, P., & Abdelzaher, T. (2012) · SPIE Proceedings · doi:10.1117/12.919823 · Cited by 133
Tweet, but verify: epistemic study of information verification on Twitter
Zubiaga, A., & Ji, H. (2014) · Social Network Analysis and Mining · doi:10.1007/s13278-014-0163-y · Cited by 125
“While previous research on credibility perceptions of tweets studied what features catch users’ attention and condition their decisions when assessing the credibility of a tweet (Morris et al. 2012), the accuracy of those perceptions has not been studied yet.”
BackgroundThe Future of False Information Detection on Social Media: New Perspectives and Trends
Guo, B., Ding, Y., Yao, L., Liang, Y., & Yu, Z. (2021) · ACM Computing Surveys · doi:10.1145/3393880 · Cited by 122
Jahanbakhsh, F., Zhang, A. X., Berinsky, A. J., Pennycook, G., Rand, D. G., & Karger, D. R. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449092 · Cited by 112
“For instance, number of quoted sources [74], prior exposure to a claim [51], official-looking logos and domains names [79], and post topic and author username [42] have been found to impact perceptions of news credibility, whereas the news publisher has surprisingly little effect on news accuracy ratings [17].”
BackgroundMitra, T., Hutto, C. J., & Gilbert, E. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702553 · Cited by 102
Keeping Up with the Tweet-dashians: The Impact of 'Official' Accounts on Online Rumoring
Andrews, C., Fichet, E., Ding, Y., Spiro, E. S., & Starbird, K. (2016) · Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing · doi:10.1145/2818048.2819986 · Cited by 98
Hannak, A., Margolin, D., Keegan, B., & Weber, I. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14555 · Cited by 90
The Web of False Information: Rumors, Fake News, Hoaxes, Clickbait, and Various Other Shenanigans
Zannettou, S., Sirivianos, M., Blackburn, J., & Kourtellis, N. (2019) · Journal of Data and Information Quality · doi:10.1145/3309699 · Cited by 86
Dynamics of cross-platform attention to retracted papers
Peng, H., Romero, D. M., & Horvát, E.-Á. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2119086119 · Cited by 57
On the credibility perception of news on Twitter: Readers, topics and features
Shariff, S. M., Zhang, X., & Sanderson, M. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.06.026 · Cited by 49
“Morris et al. (2012) showed that their participants have more con fi dence in the credibility of tweets on trending topics due to the similarity of contents between the tweets and the trending topics.”
BackgroundMethodInfluentialExtreme User and Political Rumor Detection on Twitter
Chang, C., Zhang, Y., Szabo, C., & Sheng, Q. Z. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49586-6_54 · Cited by 47
Trust in online news: comparing social media and official media use by chinese citizens
Wang, Y., & Mark, G. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441843 · Cited by 44
Exploring the Use of Personalized AI for Identifying Misinformation on Social Media
Jahanbakhsh, F., Katsis, Y., Wang, D., Popa, L., & Muller, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581219 · Cited by 42
She gets a sports car from our donation: rumor transmission in a Chinese microblogging community
Liao, Q., & Shi, L. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441842 · Cited by 41
Seeing Is Believing: How People Fail to Identify Fake Images on the Web
Kasra, M., Shen, C., & O'Brien, J. F. (2018) · Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3170427.3188604 · Cited by 36
“), but very few studies have focused specifically on image credibility [5, 4].”
Exploiting the topology property of social network for rumor detection
Yang, Y., Niu, K., & He, Z. (2015) · 2015 12th International Joint Conference on Computer Science and Software Engineering (JCSSE) · doi:10.1109/jcsse.2015.7219767 · Cited by 31
Trustworthiness Perceptions of Social Media Resources Named after a Crisis Event
Chauhan, A., & Hughes, A. L. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392849 · Cited by 12
“This finding aligns with Morris and colleagues [36], who studied users’ perceptions of tweet credibility and found that use of non-standard grammar damaged credibility more than any other factor in their survey.”
ResultEcho chamber formation sharpened by priority users
Ferraz de Arruda, H., Andrade Oliveira, K., & Moreno, Y. (2024) · iScience · doi:10.1016/j.isci.2024.111098 · Cited by 6
“As a consequence, there has been much debate 10–13 about how these verified users exert more influence compared to the other users.”
Building Personalized Trust: Discovering What Makes One Trust and Act on Facebook Posts
Zhou, M. X., Yang, H., Mark, G., Hu, M., Mahumd, J., & Pal, A. (2021) · ACM Transactions on Social Computing · doi:10.1145/3468977 · Cited by 2
Metadata
- Authors
- Morris, M. R., Counts, S., Roseway, A., Hoff, A., & Schwarz, J.
- Affiliations
- Microsoft (United States) (US)
- Carnegie Mellon University (US)
- Venue
- Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
- Publisher
- ACM
- Published
- 2012-02-11
- Pages
- 441-450
- OpenAlex
- W2167024389
- Cited by
- 411
- References
- 31
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 16 · 2023: 19 · 2022: 24 · 2021: 38 · 2020: 29 · 2019: 38 · 2018: 29 · 2017: 42 · 2016: 39 · 2015: 32 · 2014: 42 · 2013: 35 · 2012: 15
- FWCI
- 102.54
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Computer Supported Cooperative Work (CSCW) (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Keywords
- credibility assessment, Twitter, social search, search engine results, truth judgments, social media misinformation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.