The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Automated Multilingual Detection of Pro-Kremlin Propaganda in Newspapers and Telegram Posts
Open accessAbstract
The full-scale conflict between the Russian Federation and Ukraine generated an unprecedented amount of news articles and social media data reflecting opposing ideologies and narratives. These polarized campaigns have led to mutual accusations of misinformation and fake news, shaping an atmosphere of confusion and mistrust for readers worldwide. This study analyses how the media affected and mirrored public opinion during the first month of the war using news articles and Telegram news channels in Ukrainian, Russian, Romanian, French and English. We propose and compare two methods of multilingual automated pro-Kremlin propaganda identification, based on Transformers and linguistic features. We analyse the advantages and disadvantages of both methods, their adaptability to new genres and languages, and ethical considerations of their usage for content moderation. With this work, we aim to lay the foundation for further development of moderation tools tailored to the current conflict.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The extraction script from [25] includes various morphological, syntactical, shallow semantic, and punctuation-based features.
“This model includes various morphological features such as the number of different parts of speech and their types (e.g. verbs, modal and passive forms, proper, common, discourse markers, negations, comparatives, and superlatives), as well as syntactical features such as the frequency of different subordinate clauses (e.g. temporal, concession, clauses of reason, purpose, etc).”
From Exploring incel group dynamics: a computational study of hierarchy and group-boundary policing (2025) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
CROWDSOURCING A WORD–EMOTION ASSOCIATION LEXICON
Mohammad, S. M., & Turney, P. D. (2012) · Computational Intelligence · doi:10.1111/j.1467-8640.2012.00460.x · Cited by 2,901
(2019) · doi:10.18653/v1/p19-1356 · Cited by 1,291
(2017) · Wolfram Research Data Repository · doi:10.24097/wolfram.96543.data · Cited by 1,040
Truth of Varying Shades: Analyzing Language in Fake News and Political Fact-Checking
Rashkin, H., Choi, E., Jang, J. Y., Volkova, S., & Choi, Y. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1317 · Cited by 965
Metrics for Multi-Class Classification: an OverviewPreprint
Grandini, M., Bagli, E., & Visani, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.05756 · Cited by 892
The Road to Unfreedom: Russia, Europe, America
Snyder, T. (2018) · Cited by 423
Automated Fact-Checking for Assisting Human Fact-Checkers
Nakov, P., Corney, D. P. A., Hasanain, M., Alam, F., Elsayed, T., Barrón‐Cedeño, A., Papotti, P., Shaar, S., & Martino, G. D. S. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/619 · Cited by 280
Steiger, M., Bharucha, T. J., Venkatagiri, S., Riedl, M. J., & Lease, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445092 · Cited by 222
Big Data and quality data for fake news and misinformation detection
Asr, F. T., & Taboada, M. (2019) · Big Data & Society · doi:10.1177/2053951719843310 · Cited by 190
“Anything that Causes Chaos”: The Organizational Behavior of Russia Today (RT)
Elswah, M., & Howard, P. N. (2020) · Journal of Communication · doi:10.1093/joc/jqaa027 · Cited by 153
How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable Masking
De Cao, N., Schlichtkrull, M. S., Aziz, W., & Titov, I. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.262 · Cited by 75
Linguistic-Based Detection of Fake News in Social Media
Mahyoob, M., Algaraady, J., & Alrahaili, M. (2020) · International Journal of English Linguistics · doi:10.5539/ijel.v11n1p99 · Cited by 65
State of the Art Models for Fake News Detection Tasks
Antoun, W., Baly, F., Achour, R., Hussein, A., & Hajj, H. M. (2020) · IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT) · doi:10.1109/iciot48696.2020.9089487 · Cited by 61
“Ukraine commits genocide on Russians”: the term “genocide” in Russian propaganda
Fortuin, E. (2022) · Russian Linguistics · doi:10.1007/s11185-022-09258-5 · Cited by 45
How Many Bots in Russian Troll Tweets?
Alsmadi, I. M., & O’Brien, M. J. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102303 · Cited by 43
Stepan Bandera: The resurrection of a Ukrainian national hero
Marples, D. R. (2006) · Europe Asia Studies · doi:10.1080/09668130600652118 · Cited by 37
Interpretable Propaganda Detection in News Articles
Amazon Alexa AI, S., Yu, S., Martino, G. D. S., Mohtarami, M., Glass, J. R., & Nakov, P. (2021) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-072-4_179 · Cited by 34
Characterization and Comparison of Russian and Chinese Disinformation Campaigns
Beskow, D. M., & Carley, K. M. (2020) · Lecture notes in social networks · doi:10.1007/978-3-030-42699-6_4 · Cited by 31
Polarize and Conquer: Russian Influence Operations in the United States
Cosentino, G. (2020) · Springer eBooks · doi:10.1007/978-3-030-43005-4_2 · Cited by 15
Linguistic Interpretation of Russian Political Agenda Through Fake, Deepfake, Post-Truth
Chudinov, A. P., Koshkarova, N. N., & Руженцева, Н. Б. (2019) · Journal of Siberian Federal University Humanities & Social Sciences · doi:10.17516/1997-1370-0492 · Cited by 8
Mixed-code text analysis for the detection of online hidden propaganda
Tundis, A., Mukherjee, G., & Mühlhäuser, M. (2020) · International Conference on Availability, Reliability and Security (ARES) · doi:10.1145/3407023.3409211 · Cited by 8
The post-truth age, the fake news industry, the Russian Federation and the Central European area
Rosůlek, P. (2019) · Trendy v podnikání · doi:10.24132/jtb.2019.9.3.46_53 · Cited by 4
Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in EnglishPreprint
Li, X., Xia, Y., Long, X., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.02359 · Cited by 3
Da Corte, M., & Baptista, J. (2025) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.slate.2025.1 · Cited by 2
Sly, J. (2017) · College & Research Libraries · doi:10.5860/crl.78.6.868 · Cited by 1
Flagged first, then by citations
Research works printed but not linked: 12
- Carroll J (2017) Image and imitation the visual rhetoric of pro-russian propaganda. Ideol Polit J 8:36–79
- Dadu T, Pant K, Mamidi R (2020) Towards detection of subjective bias using contextualized word embeddings. CoRR, vol abs/2002.06644 · arXiv
- Gaufman E (2016) Security threats and public perception: digital russia and the Ukraine crisis. New security challenges
- Meister S (2016) The roots and instruments of Russia’s disinformation campaign (Transatlantic Academy, 2015-16 paper series, chap 3)
- Narayanan VP (2017) Russian involvement and junk news during brexit comprop data memo 2017.10
- NATO Strategic Communications Center of Excellence (2016) The manipulative techniques of russian’s information campaign, euro-atlantic values and russia’s strategic communication in euro-atlantic space (Tech. rep.)
- OED Online (2022) Propaganda vol 11. Oxford University Press, Oxford
- Oliinyk VA, Vysotska V, Burov Y, Mykich K, Fernandes VB (2020) Propaganda detection in text data based on nlp and machine learning. In: MoMLeT+DS
- Powers D (2008) Evaluation: From precision, recall and f‑factor to roc, informedness, markedness & correlation. Mach Learn Technol 2. https://doi.org/10.48550/arXiv.2010.16061 · DOI · Paper page
- Smith BL (2022) Propaganda. Encyclopedia Britannica, p 24
- US Department of State (2020) Pillars of russia’s disinformation and propaganda ecosystem (Tech. rep.)
- Wilbur D (2021) Propaganda or not: Examining the claims of extensive russian information operations within the united states. J Inf Warf 20:146–156
Cited by
Sorted by citations
Exploring incel group dynamics: a computational study of hierarchy and group-boundary policing
Solopova, V., Popa-Wyatt, M., & Berškytė, J. (2025) · Journal of Computational Social Science · doi:10.1007/s42001-024-00357-5 · Cited by 6
Self-citation
Metadata
- Authors
- Solopova, V., Popescu, O.-I., Benzmüller, C., & Landgraf, T.
- Affiliations
- Freie Universität Berlin (DE)
- Deutsches Zentrum für Luft- und Raumfahrt e. V. (DLR) (DE)
- Corresponding author
- Solopova, Veronika
- Venue
- Datenbank-Spektrum
- Published
- 2023-03
- Volume
- 23
- Issue
- 1
- Pages
- 5-14
- ISSN
- 1610-1995 (ISSN-L)
- 1618-2162
- OpenAlex
- W4323043532
- Cited by
- 21
- References
- 28
- Citations by year
- 2026: 2 · 2025: 7 · 2024: 7 · 2023: 5
- FWCI
- 9.02
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Datenbank-Spektrum (publishedVersion, cc-by)
- Funders
- Freie Universität Berlin
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- Russian invasion of Ukraine, misinformation detection, multilingual text classification, news articles, transformer models, linguistic features, content moderation, propaganda detection, public opinion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review