Finding and assessing social media information sources in the context of journalism
Abstract
Social media is already a fixture for reporting for many journalists, especially around breaking news events where non-professionals may already be on the scene to share an eyewitness report, photo, or video of the event. At the same time, the huge amount of content posted in conjunction with such events serves as a challenge to finding interesting and trustworthy sources in the din of the stream. In this paper we develop and investigate new methods for filtering and assessing the verity of sources found through social media by journalists. We take a human centered design approach to developing a system, SRSR ("Seriously Rapid Source Review"), informed by journalistic practices and knowledge of information production in events. We then used the system, together with a realistic reporting scenario, to evaluate the filtering and visual cue features that we developed. Our evaluation offers insights into social media information sourcing practices and challenges, and highlights the role technology can play in the solution.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Social media has become a powerful tool for journalists and ordinary citizens.
“Hence, social media has become a powerful tool for journalists (Diakopoulos et al. 2012;Tolmie et al. 2017) but also for ordinary citizens (Hermida 2010).”
From Detection and Resolution of Rumours in Social Media (2019) · cites this paper as Diakopoulos et al. 2012
Social media gives access to eyewitness updates and to many users who may hold exclusive information.
“This enables, among others, access to updates from eyewitnesses and a broad range of users who have access to potentially exclusive information (Diakopoulos et al. 2012;Starbird et al. 2012).”
From Detection and Resolution of Rumours in Social Media (2019) · cites this paper as Diakopoulos et al. 2012
Cited by
Sorted by citations
Processing Social Media Messages in Mass Emergency: A Survey
Imran, M., Castillo, C., Diaz, F., & Vieweg, S. (2015) · ACM Computing Surveys · doi:10.1145/2771588 · Cited by 804 · see citing works
Algorithmic Accountability: Journalistic investigation of computational power structures
Diakopoulos, N. (2015) · Digital Journalism · doi:10.1080/21670811.2014.976411 · Cited by 733 · see citing works
Self-citationA survey on fake news and rumour detection techniques
Bondielli, A., & Marcelloni, F. (2019) · Information Sciences · doi:10.1016/j.ins.2019.05.035 · Cited by 658 · see citing works
Detection and Resolution of Rumours in Social Media
Zubiaga, A., Aker, A., Bontcheva, K., Liakata, M., & Procter, R. (2019) · ACM Computing Surveys · doi:10.1145/3161603 · Cited by 608 · see citing works
“Seriously Rapid Source Review 28 [Diakopoulos et al. 2012] is a system that incorporates a number of advanced aggregations, computations and cues that can be helpful for journalists to find and assess sources in Twitter around breaking news events, such as finding eyewitnesses on the ground.”
BackgroundAngleKindling: Supporting Journalistic Angle Ideation with Large Language Models
Petridis, S., Diakopoulos, N., Crowston, K., Hansen, M., Henderson, K., Jastrzebski, S., Nickerson, J. V., & Chilton, L. B. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580907 · Cited by 98 · see citing works
Self-citationTrue or False: Studying the Work Practices of Professional Fact-Checkers
Micallef, N., Armacost, V., Memon, N., & Patil, S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512974 · Cited by 70 · see citing works
Trust in online news: comparing social media and official media use by chinese citizens
Wang, Y., & Mark, G. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441843 · Cited by 44 · see citing works
- Authors
- Diakopoulos, N., De Choudhury, M., & Naaman, M.
- Affiliations
- Rutgers University, New Brunsick, New Jersey, United States
- Rutgers University & Microsoft Research, New Brunsick, New Jersey, United States
- Rutgers University, New Brunswick, New Jersey, United States
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2012-05-05
- Pages
- 2451-2460
- Cited by
- 144
- References
- 0
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review