Automated identification of media bias in news articles: an interdisciplinary literature review
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Media bias, i.e., slanted news coverage, can strongly impact the public perception of the reported topics. In the social sciences, research over the past decades has developed comprehensive models to describe media bias and effective, yet often manual and thus cumbersome, methods for analysis. In contrast, in computer science fast, automated, and scalable methods are available, but few approaches systematically analyze media bias. The models used to analyze media bias in computer science tend to be simpler compared to models established in the social sciences, and do not necessarily address the most pressing substantial questions, despite technically superior approaches. Computer science research on media bias thus stands to profit from a closer integration of models for the study of media bias developed in the social sciences with automated methods from computer science. This article first establishes a shared conceptual understanding by mapping the state of the art from the social sciences to a framework, which can be targeted by approaches from computer science. Next, we investigate different forms of media bias and review how each form is analyzed in the social sciences. For each form, we then discuss methods from computer science suitable to (semi-)automate the corresponding analysis. Our review suggests that suitable, automated methods from computer science, primarily in the realm of natural language processing, are already available for each of the discussed forms of media bias, opening multiple directions for promising further research in computer science in this area.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Framing: toward clarification of a fractured paradigm
Entman, R. M. (1993) · Journal of Communication · doi:10.1111/j.1460-2466.1993.tb01304.x · Cited by 16,203
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
The Content Analysis Guidebook
Neuendorf, K. A. (2017) · doi:10.4135/9781071802878 · Cited by 9,286 · cited 2×
“Since statistically sound conclusions can only be derived from the results of deductive content analyses [95], researchers conduct inductive content analyses mainly in early phases of their research, e.”
BackgroundContent analysis and thematic analysis: Implications for conducting a qualitative descriptive study
Vaismoradi, M., Turunen, H., & Bondas, T. (2013) · Nursing & Health Sciences · doi:10.1111/nhs.12048 · Cited by 8,327
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
The Nature and Origins of Mass Opinion
Zaller, J. R. (1992) · doi:10.1017/cbo9780511818691 · Cited by 7,785 · cited 1×
“These strong negative effects have led some researchers to believe that media bias challenges the pillars of our democracy [40, 41]: If media outlets influence public opinion, is the observed public opinion really the “true” public opinion? For instance, a 2003 survey showed that there were significant differences in…”
BackgroundKahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544
Opinion mining and sentiment analysis
Pang, B., & Lee, L. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000011 · Cited by 6,372
Qualitative Content Analysis in Practice
Schreier, M. (2012) · doi:10.4135/9781529682571 · Cited by 5,801 · cited 1×
“automated, but are more likely to miss subtle forms of bias [98].”
BackgroundBlei, D. M. (2012) · Communications of the ACM · doi:10.1145/2133806.2133826 · Cited by 5,516 · cited 2×
“The objective of grouping is to identify topics and group articles on the same topic, e.g., usingLDAor other topicmodeling techniques, as described previously.”
MethodAnswering the Call for a Standard Reliability Measure for Coding Data
Hayes, A. F., & Krippendorff, K. (2007) · Communication Methods and Measures · doi:10.1080/19312450709336664 · Cited by 4,225 · cited 2×
“, the widely used Krippendorff’s Alpha [185], provide estimates for the reliability and robustness of the coding.”
MethodExposure to ideologically diverse news and opinion on Facebook
Bakshy, E., Messing, S., & Adamic, L. A. (2015) · Science · doi:10.1126/science.aaa1160 · Cited by 3,245
A survey of named entity recognition and classification
Nadeau, D., & Sekine, S. (2007) · Lingvisticae Investigationes · doi:10.1075/li.30.1.03nad · Cited by 2,507 · cited 1×
“Named entity extraction [180] could be used to partially address these previously manually performed tasks.”
MethodMan is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615
The Fox News Effect: Media Bias and Voting
DellaVigna, S., & Kaplan, E. (2007) · The Quarterly Journal of Economics · doi:10.1162/qjec.122.3.1187 · Cited by 1,602 · cited 2×
“For instance, DellaVigna and Kaplan analyzed the gradual adoption of cable TV of Fox News between 1996 and 2000 to show that Fox News had a “significant impact” on the presidential elections [51].”
BackgroundThe law of group polarization.
Sunstein, C. R. (2002) · Journal of Political Philosophy · doi:10.1111/1467-9760.00148 · Cited by 1,371
Analysis of emotion recognition using facial expressions, speech and multimodal information
Busso, C., Deng, Z., Yildirim, S., Bulut, M., Lee, C. M., Kazemzadeh, A., Lee, S., Neumann, U., & Narayanan, S. (2004) · Proceedings of the 6th international conference on Multimodal interfaces · doi:10.1145/1027933.1027968 · Cited by 840 · cited 1×
“Automatedmethods can identify faces in images [172], recognize emotions [83, 173], categorize objects shown in pictures [174], and even generate captions for a picture [175].”
BackgroundFacilitating Communication across Lines of Political Difference: The Role of Mass Media
Mutz, D. C. (2001) · American Political Science Review · doi:10.1017/s0003055401000223 · Cited by 700
McCarthy, J. D., McPhail, C., & Smith, J. (1996) · American Sociological Review · doi:10.2307/2096360 · Cited by 677
Media bias in presidential elections: a meta-analysis
D'Alessio, D., & Allen, M. (2000) · Journal of Communication · doi:10.1111/j.1460-2466.2000.tb02866.x · Cited by 510
Smith, J., McCarthy, J. D., McPhail, C., & Augustyn, B. (2001) · Social Forces · doi:10.1353/sof.2001.0053 · Cited by 396
Facial emotion recognition using multi-modal information
De Silva, L. C., Miyasato, T., & Nakatsu, R. (2002) · Proceedings of ICICS, 1997 International Conference on Information, Communications and Signal Processing. Theme: Trends in Information Systems Engineering and Wireless Multimedia Communications (Cat. No.97TH8237) · doi:10.1109/icics.1997.647126 · Cited by 319 · cited 1×
“Automatedmethods can identify faces in images [172], recognize emotions [83, 173], categorize objects shown in pictures [174], and even generate captions for a picture [175].”
BackgroundPapacharissi, Z., & de Fatima Oliveira, M. (2008) · The International Journal of Press/Politics · doi:10.1177/1940161207312676 · Cited by 251 · cited 8×
“, news articles dehumanized terrorists by not ascribing any motive to terrorist attacks or usage of metaphors, such as “David and Goliath” [77].”
BackgroundMethodInfluentialIntrinsic Plagiarism Detection
Eissen, S. M. Z., & Stein, B. (2006) · Lecture Notes in Computer Science · doi:10.1007/11735106_66 · Cited by 184
Gentzkow, M., Glaeser, E. L., & Goldin, C. (2006) · Corruption and Reform · doi:10.7208/chicago/9780226299594.003.0007 · Cited by 141
State-of-the-art in detecting academic plagiarism
Meuschke, N., & Gipp, B. (2013) · International Journal for Educational Integrity · doi:10.21913/ijei.v9i1.847 · Cited by 112 · cited 4×
“The vast majority of plagiarism detection techniques analyzes text [126], and thus could also be adapted and subsequently applied to news texts.”
BackgroundInfluentialSelf-citationPark, S., Ko, M., Kim, J., Liu, Y., & Song, J. (2011) · Proceedings of the ACM 2011 conference on Computer supported cooperative work · doi:10.1145/1958824.1958842 · Cited by 88
Cited by
The Emergence of Deepfake Technology: A Review
Westerlund, M. (2019) · Technology Innovation Management Review · doi:10.22215/timreview/1282 · Cited by 1,138
Bias of AI-generated content: an examination of news produced by large language models
Fang, X., Che, S., Mao, M., Zhang, H., Zhao, M., & Zhao, X. (2024) · Scientific Reports · doi:10.1038/s41598-024-55686-2 · Cited by 194
Mass media impact on opinion evolution in biased digital environments: a bounded confidence model
(2023) · doi:10.1038/s41598-023-39725-y · Cited by 26
Metadata
- Authors
- Hamborg, F., Donnay, K., & Gipp, B.
- Venue
- International Journal on Digital Libraries
- Published
- 2018-11-16
- Volume
- 20
- Issue
- 4
- Pages
- 391-415
- ISSN
- 1432-1300 (ISSN-L)
- 1432-5012
- OpenAlex
- W2900571251
- Cited by
- 216
- References
- 31
- FWCI
- 10.04
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.