Diamonds in the rough: Social media visual analytics for journalistic inquiry
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Journalists increasingly turn to social media sources such as Facebook or Twitter to support their coverage of various news events. For large-scale events such as televised debates and speeches, the amount of content on social media can easily become overwhelming, yet still contain information that may aid and augment reporting via individual content items as well as via aggregate information from the crowd's response. In this work we present a visual analytic tool, Vox Civitas, designed to help journalists and media professionals extract news value from large-scale aggregations of social media content around broadcast events. We discuss the design of the tool, present the text analysis techniques used to enable the presentation, and provide details on the visual and interaction design. We provide an exploratory evaluation based on a user study in which journalists interacted with the system to explore and report on a dataset of over one hundred thousand twitter messages collected during the U.S. State of the Union presidential address in 2010.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Learning extraction patterns for subjective expressions
Riloff, E., & Wiebe, J. (2003) · Proceedings of the 2003 conference on Empirical methods in natural language processing - · doi:10.3115/1119355.1119369 · Cited by 1,059
De Longueville, B., Smith, R. S., & Luraschi, G. (2009) · Proceedings of the 2009 International Workshop on Location Based Social Networks · doi:10.1145/1629890.1629907 · Cited by 307
Cited by
An overview of online fake news: Characterization, detection, and discussion
Zhang, X., & Ghorbani, A. A. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.03.004 · Cited by 997
Algorithmic Accountability: Journalistic investigation of computational power structures
Diakopoulos, N. (2015) · Digital Journalism · doi:10.1080/21670811.2014.976411 · Cited by 733
Self-citationBeyond Trending Topics: Real-World Event Identification on Twitter
Becker, H., Naaman, M., & Gravano, L. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14146 · Cited by 680
Self-citationTwitinfo: aggregating and visualizing microblogs for event exploration
Marcus, A., Bernstein, M. S., Badar, O., Karger, D. R., Madden, S., & Miller, R. C. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978975 · Cited by 548
Meel, P., & Vishwakarma, D. K. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112986 · Cited by 505
SensePlace2: GeoTwitter analytics support for situational awareness
MacEachren, A. M., Jaiswal, A., Robinson, A. C., Pezanowski, S., Savelyev, A., Mitra, P., Zhang, X., & Blanford, J. (2011) · 2011 IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2011.6102456 · Cited by 349
Towards a sociology of computational and algorithmic journalism
Anderson, C. (2013) · New Media & Society · doi:10.1177/1461444812465137 · Cited by 341
Hip and trendy: Characterizing emerging trends on Twitter
Naaman, M., Becker, H., & Gravano, L. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21489 · Cited by 322
Self-citationTowards quality discourse in online news comments
Diakopoulos, N., & Naaman, M. (2011) · Proceedings of the ACM 2011 conference on Computer supported cooperative work · doi:10.1145/1958824.1958844 · Cited by 318
Self-citationOpen source and journalism: toward new frameworks for imagining news innovation
Lewis, S. C., & Usher, N. (2013) · Media, Culture & Society · doi:10.1177/0163443713485494 · Cited by 265
Finding and assessing social media information sources in the context of journalism
Diakopoulos, N., De Choudhury, M., & Naaman, M. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208409 · Cited by 221
Self-citationAngleKindling: Supporting Journalistic Angle Ideation with Large Language Models
Petridis, S., Diakopoulos, N., Crowston, K., Hansen, M., Henderson, K., Jastrzebski, S., Nickerson, J. V., & Chilton, L. B. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580907 · Cited by 98
“Within the second category, numerous tools have been built that support a diverse set of journalistic tasks, including categorizing and understanding large document collections [9], identifying claims to be fact-checked [25] [1], and examining events and content on social media [61] [40] [19] [18] [37] [57].”
BackgroundSelf-citationSupporting the Use of User Generated Content in Journalistic Practice
Tolmie, P., Procter, R., Randall, D. W., Rouncefield, M., Burger, C., Wong Sak Hoi, G., Zubiaga, A., & Liakata, M. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025892 · Cited by 72
True or False: Studying the Work Practices of Professional Fact-Checkers
Micallef, N., Armacost, V., Memon, N., & Patil, S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512974 · Cited by 70
“Such computational tools use several techniques to support journalistic and fact-checking work practices, including but not limited to: automated news discovery [86, 99, 110]; image and video verifcation [42, 88]; specialized search [103]; visualization [137]; social media data extraction [41, 43] and verifcation [122…”
Method
Metadata
- Authors
- Diakopoulos, N., Naaman, M., & Kivran-Swaine, F.
- Venue
- 2010 IEEE Symposium on Visual Analytics Science and Technology
- Publisher
- IEEE
- Published
- 2010-10
- Pages
- 115-122
- OpenAlex
- W1995613787
- Cited by
- 212
- References
- 4
- FWCI
- 12.37
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.