The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Content Analysis in an Era of Big Data: A Hybrid Approach to Computational and Manual Methods
Abstract
Massive datasets of communication are challenging traditional, human-driven approaches to content analysis. Computational methods present enticing solutions to these problems but in many cases are insufficient on their own. We argue that an approach blending computational and manual methods throughout the content analysis process may yield more fruitful results, and draw on a case study of news sourcing on Twitter to illustrate this hybrid approach in action. Careful combinations of computational and manual techniques can preserve the strengths of traditional content analysis, with its systematic rigor and contextual sensitivity, while also maximizing the large-scale capacity of Big Data and the algorithmic accuracy of computational methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,312
boyd, D., & Crawford, K. (2012) · Information, Communication & Society · doi:10.1080/1369118x.2012.678878 · Cited by 5,479
(2011) · Cited by 5,203
I tweet honestly, I tweet passionately: Twitter users, context collapse, and the imagined audience
Marwick, A. E., & boyd, D. (2011) · New Media & Society · doi:10.1177/1461444810365313 · Cited by 4,612
Content Analysis for the Social Sciences and Humanities.
Parker, E. B., & Holsti, O. R. (1970) · American Sociological Review · doi:10.2307/2093233 · Cited by 4,564
Hall, S., Critcher, C., Jefferson, T., Clarke, J., & Roberts, B. (1978) · doi:10.1007/978-1-349-15881-2 · Cited by 3,981
Lazer, D., Pentland, A., Adamic, L., Aral, S., Barabási, A.-L., Brewer, D., Christakis, N., Contractor, N., Fowler, J., Gutmann, M., et al. (2009) · Science · doi:10.1126/science.1167742 · Cited by 3,365
Policing the Crisis: Mugging, the State, and Law and Order
Reiner, R., Hall, S., Critcher, C., Jefferson, T., Clark, J., & Roberts, B. (1978) · The British Journal of Sociology · doi:10.2307/589668 · Cited by 3,108
Content Analysis in Communication Research.
de Sola Pool, I., & Berelson, B. (1952) · American Sociological Review · doi:10.2307/2088029 · Cited by 3,099
Making News: A Study in the Construction of Reality.
Gitlin, T., & Tuchman, G. (1980) · Contemporary Sociology · doi:10.2307/2065604 · Cited by 2,668
Making News: A Study in the Construction of Reality.
Robinson, J. P., & Tuchman, G. (1981) · Social Forces · doi:10.2307/2578016 · Cited by 2,354
Content Analysis for the Social Sciences and Humanities
Parker, S. R. (1970) · Sociology · doi:10.1177/003803857000400231 · Cited by 2,155
Journal of Computer-Mediated Communication
(2018) · Journal of Computer-Mediated Communication · doi:10.1111/(issn)1083-6101 · Cited by 1,883
Content Analysis in Communication Research
Burns, T., & Berelson, B. (1953) · The British Journal of Sociology · doi:10.2307/587175 · Cited by 1,421
Methods of Text and Discourse Analysis
Titscher, S., Meyer, M., Wodak, R., & Vetter, E. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9780857024480 · Cited by 1,373
Hall, S., Critcher, C., Jefferson, T., Clarke, J., & Roberts, B. (2013) · doi:10.1007/978-1-137-00721-6 · Cited by 1,184
TWITTERING THE NEWS: The emergence of ambient journalism
Hermida, A. (2010) · Journalism Practice · doi:10.1080/17512781003640703 · Cited by 1,002
Self-citationContent analysis for the social sciences and humanities
Holsti, O. R. (1969) · Cited by 933
Affective News and Networked Publics: The Rhythms of News Storytelling on #Egypt
Papacharissi, Z., & de Fatima Oliveira, M. (2012) · Journal of Communication · doi:10.1111/j.1460-2466.2012.01630.x · Cited by 803
NORMALIZING TWITTER: Journalism practice in an emerging communication space
Lasorsa, D. L., Lewis, S. C., & Holton, A. E. (2012) · Journalism Studies · doi:10.1080/1461670x.2011.571825 · Cited by 743
Self-citationReporters and Officials: The Organization and Politics of Newsmaking.
Blanchard, R. O., Cantor, M. G., & Sigal, L. V. (1976) · Contemporary Sociology · doi:10.2307/2062646 · Cited by 695
Trending: The Promises and the Challenges of Big Social Data
Manovich, L. (2012) · Debates in the Digital Humanities · doi:10.5749/minnesota/9780816677948.003.0047 · Cited by 682
THE TENSION BETWEEN PROFESSIONAL CONTROL AND OPEN PARTICIPATION: Journalism and its boundaries
Lewis, S. C. (2012) · Information, Communication & Society · doi:10.1080/1369118x.2012.674150 · Cited by 675
Self-citationThe Revolutions Were Tweeted: Information Flows During the 2011 Tunisian and Egyptian Revolutions
Lotan, G., Graeff, E., Ananny, M., Gaffney, D., Pearce, I., & boyd, D. (2011) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 593
McMillan, S. J. (2000) · Journalism & Mass Communication Quarterly · doi:10.1177/107769900007700107 · Cited by 586
International Handbook of Internet Research
(2010) · Springer eBooks · doi:10.1007/978-1-4020-9789-8 · Cited by 557
News and News Sources: A Critical Introduction
Manning, P. (2001) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218082 · Cited by 544
THE REUTERS INSTITUTE FOR THE STUDY OF JOURNALISM
Levy, D. A. L. (2011) · Journalism Studies · doi:10.1080/1461670x.2010.530965 · Cited by 453
The Routledge Companion to News and Journalism
(2009) · Routledge eBooks · doi:10.4324/9780203869468 · Cited by 437
Analyzing Media Messages: Using Quantitative Content Analysis in Research
Riffe, D., Lacy, S., Watson, B. R., & Fico, F. (2019) · Routledge eBooks · doi:10.4324/9780429464287 · Cited by 414
Tweet, tweet, tweet: A content analysis of nonprofit organizations’ Twitter updates
Waters, R. D., & Jamal, J. Y. (2011) · Public Relations Review · doi:10.1016/j.pubrev.2011.03.002 · Cited by 414
SOCIAL MEDIA AS BEAT: Tweets as a news source during the 2010 British and Dutch elections
Broersma, M., & Graham, T. (2012) · Journalism Practice · doi:10.1080/17512786.2012.663626 · Cited by 368
Hermida, A., Lewis, S. C., & Zamith, R. (2014) · Journal of Computer-Mediated Communication · doi:10.1111/jcc4.12074 · Cited by 344
Self-citationRESEARCHING NEWS DISCUSSION ON TWITTER: New methodologies
Bruns, A., & Burgess, J. (2012) · Journalism Studies · doi:10.1080/1461670x.2012.664428 · Cited by 322
Web Content Analysis: Expanding the Paradigm
Herring, S. C. (2009) · International Handbook of Internet Research · doi:10.1007/978-1-4020-9789-8_14 · Cited by 317
Content Analysis of the World Wide Web: Opportunities and Challenges
Weare, C., & Lin, W.-Y. (2000) · Social Science Computer Review · doi:10.1177/089443930001800304 · Cited by 306
SOCIAL SCIENCE RESEARCH METHODS IN INTERNET TIME
Karpf, D. (2012) · Information, Communication & Society · doi:10.1080/1369118x.2012.665468 · Cited by 285
The End of the Virtual : Digital Methods
Rogers, R. (2009) · Amsterdam University Press eBooks · doi:10.5117/9789056295936 · Cited by 282
Poell, T., & Borra, E. (2012) · Journalism · doi:10.1177/1464884911431533 · Cited by 215
HOW LONG IS A TWEET? MAPPING DYNAMIC CONVERSATION NETWORKS ON TWITTER USING GAWK AND GEPHI
Bruns, A. (2012) · Information, Communication & Society · doi:10.1080/1369118x.2011.635214 · Cited by 212
Using Twitter for Promotion and Branding: A Content Analysis of Local Television Twitter Sites
Greer, C. F., & Ferguson, D. A. (2011) · Journal of Broadcasting & Electronic Media · doi:10.1080/08838151.2011.570824 · Cited by 187
FREEZING THE FLOW OF ONLINE NEWS
Karlsson, M., & Strömbäck, J. (2009) · Journalism Studies · doi:10.1080/14616700903119784 · Cited by 145
Sjøvaag, H., & Stavelin, E. (2012) · Convergence The International Journal of Research into New Media Technologies · doi:10.1177/1354856511429641 · Cited by 123
Theory, Method, and Practice in Computer Content Analysis
(2001) · Greenwood Publishing Group Inc. eBooks · doi:10.5040/9798216186847 · Cited by 120
Burgess, J., & Bruns, A. (2012) · Journalism Practice · doi:10.1080/17512786.2012.663610 · Cited by 111
Journalists and Twitter: How Australian News Organisations Adapt to a New Medium
Bruns, A. (2012) · Media International Australia · doi:10.1177/1329878x1214400114 · Cited by 108
Conway, M. (2006) · Journalism & Mass Communication Quarterly · doi:10.1177/107769900608300112 · Cited by 102
The danger of big data: Social media as computational social science
Oboler, A., Welsh, K., & Cruz, L. P. (2012) · First Monday · doi:10.5210/fm.v17i7.3993 · Cited by 89
Cozma, R., & Chen, K. (2012) · Journalism Practice · doi:10.1080/17512786.2012.683340 · Cited by 74
Mapping the Australian Networked Public Sphere
Bruns, A., Burgess, J., Highfield, T., Kirchhoff, L., & Nicolai, T. (2010) · Social Science Computer Review · doi:10.1177/0894439310382507 · Cited by 74
Charting the liquidity of online news
Karlsson, M. (2012) · International Communication Gazette · doi:10.1177/1748048512439823 · Cited by 47
FOREIGN REPORTING IN THE SPHERE OF NETWORK JOURNALISM
Heinrich, A. (2012) · Journalism Practice · doi:10.1080/17512786.2012.667280 · Cited by 38
PUBLIC SERVICE NEWS ON THE WEB
Sjøvaag, H., Moe, H., & Stavelin, E. (2011) · Journalism Studies · doi:10.1080/1461670x.2011.578940 · Cited by 36
Studying the values of hard-to-reach populations
Koepfler, J. A., & Fleischmann, K. R. (2012) · iConference · doi:10.1145/2132176.2132183 · Cited by 31
Computer Content Analysis and Manual Coding Techniques: A Comparative Analysis
Linderman, A. (2001) · doi:10.5040/9798216186847.ch-006 · Cited by 30
Cited by
Issues and Best Practices in Content Analysis
Lacy, S., Watson, B. R., Riffe, D., & Lovejoy, J. (2015) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699015607338 · Cited by 450
Digital inequalities in the age of artificial intelligence and big data
Lutz, C. (2019) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.140 · Cited by 411
Hermida, A., Lewis, S. C., & Zamith, R. (2014) · Journal of Computer-Mediated Communication · doi:10.1111/jcc4.12074 · Cited by 344
Self-citationCaliandro, A. (2018) · Journal of Contemporary Ethnography · doi:10.1177/0891241617702960 · Cited by 295
#JOURNALISM: Reconfiguring journalism research about Twitter, one tweet at a time
Hermida, A. (2013) · Digital Journalism · doi:10.1080/21670811.2013.808456 · Cited by 287
Self-citation
Metadata
- Authors
- Lewis, S. C., Zamith, R., & Hermida, A.
- Venue
- Journal of Broadcasting & Electronic Media
- Publisher
- Informa UK Limited
- Published
- 2013-01
- Volume
- 57
- Issue
- 1
- Pages
- 34-52
- ISSN
- 0883-8151 (ISSN-L)
- 1550-6878
- OpenAlex
- W1988147352
- Cited by
- 418
- References
- 55
- FWCI
- 147.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.