The DOI matches its Crossref record; 64 of the 65 references it cites were found in a registry or an index.
Large-Scale Computerized Text Analysis in Political Science: Opportunities and Challenges
Open accessAbstract
Text has always been an important data source in political science. What has changed in recent years is the feasibility of investigating large amounts of text quantitatively. The internet provides political scientists with more data than their mentors could have imagined, and the research community is providing accessible text analysis software packages, along with training and support. As a result, text-as-data research is becoming mainstream in political science. Scholars are tapping new data sources, they are employing more diverse methods, and they are becoming critical consumers of findings based on those methods. In this article, we first describe the four stages of a typical text-as-data project. We then review recent political science applications and explore one important methodological challenge—topic model instability—in greater detail.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
The Coding Manual for Qualitative Researchers
Saldaña, J. (2025) · SAGE Publications Ltd eBooks · doi:10.4135/9781036235611 · Cited by 19,193
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 12,187
Needleman, S. B., & Wunsch, C. D. (1970) · Journal of Molecular Biology · doi:10.1016/0022-2836(70)90057-4 · Cited by 11,288
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909
Identification of common molecular subsequences
Smith, T. F., & Waterman, M. S. (1981) · Journal of Molecular Biology · doi:10.1016/0022-2836(81)90087-5 · Cited by 9,962
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,957
Congress, The Electoral Connection
Ross, M. J., & Mayhew, D. R. (1975) · The Western Political Quarterly · doi:10.2307/447379 · Cited by 4,094
Research works printed but not linked: 12
- Bird S, 2009, Natural Language Processing with Python—Analyzing Text with the Natural Language Toolkit
- Blei D, 2009, Text Mining: Classification, Clustering, and Applications, 71
- Blei DM, 2003, J. Mach. Learn. Res., 3, 993
- Casas A, 2016, Rev. Espan. Investig. Sociol., 155, 73
- Chuang J, Wilkerson JD, Weiss R, Tingley D, Stewart BM, et al. 2014. Computer-assisted content analysis: topic models for exploring multiple subjective interpretations. Presented at Advances in Neural Information Processing Systems Workshop on Human-Propelled Machine Learning, Montreal, Dec. 8–13
- Collingwood L, 2011, J. Inf. Technol. Polit., 4, 1
- Grimmer J, 2016, The unreliability of measures of intercoder reliability, and what to do about it.
- Huang A, 2008, Proc. Sixth New Zealand Computer Science Research Student Conference, 49
- Kohavi R, 1995, Proc. Int. Joint Conf. Artificial Intelligence, 1137
- Laver M, 2003, Am. Polit. Sci. Rev., 2, 311
- Wallach H, Dicker L, Jensen S. 2010. An alternative prior for nonparametric Bayesian clustering. In Proc. Thirteenth International Conference on Artificial Intelligence and Statistics, May 13–15, 2010, Chia Laguna Resort, Sardinia, Italy , ed. YW Teh, M Titterington, 9:892–99. http://www.jmlr.org/proceedings/papers/v9/
- Ward M, 2013, Analysis, 21, 267
Cited by
Sorted by citations
Items 201–300 of 300
Nyhuis, D. (2020) · Springer eBooks · doi:10.1007/978-3-658-30237-5_12 · Cited by 1
USE OF INFORMATION AND COMMUNICATION TECHNOLOGIES FOR POLITICAL SCIENCE RESEARCH
Chornenkyi, O. (2022) · The Journal of V N Karazin Kharkov National University Issues of Political Science · doi:10.26565/2220-8089-2022-42-06 · Cited by 1
Fujiwara, T., & Liu, T. (2020) · arXiv (Cornell University) · Cited by 1
Characterizing Partisan Political Narratives about COVID-19 on TwitterPreprint
Jing, E., & Ahn, Y. (2021) · arXiv (Cornell University) · Cited by 1
Experiments in the armchair: a history of microeconometrics and program evaluation at Princeton
Netto, A. B. (2021) · doi:10.11606/t.12.2021.tde-10012022-122433 · Cited by 1
4th Workshop on Intelligent Cross-Data Analysis and Retrieval
(2023) · doi:10.1145/3592571 · Cited by 1
Are We Missing Something When Measuring Citizens' Perceptions of the Extractive Industry?
Balza, L. H., Díaz, L. M., Gómez‐Parra, N., & M., O. E. M. (2023) · doi:10.18235/0005304 · Cited by 2
promptr: Format and Complete Few-Shot LLM Prompts
Ornstein, J. (2024) · doi:10.32614/cran.package.promptr · Cited by 1
Machine Learning Method in Medical Education: Focusing on Research Case of Press Frame on Asbestos
Kim, J., Heo, S., Kang, S., Kim, G.-I., & Kang, D. (2017) · Korean Medical Education Review · doi:10.17496/kmer.2017.19.3.158 · Cited by 1
How the Taiwanese Do China Studies: Applications of Text Mining
Shao, H.-L., Huang, S.-C., & Tsai, Y.-C. (2018) · Journal of Data Mining & Digital Humanities · doi:10.46298/jdmdh.4178
Kakeya, H., & Ominami, M. (2019) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.31.2_617
How the Taiwanese Do China Studies: Applications of Text Mining
Shao, H.-L., Huang, S.-C., & Tsai, Y. (2018) · DOAJ (DOAJ: Directory of Open Access Journals)
Polarized Political Texts: a Possible Way to Measure Their Manipulative Capacity
Kazakov, A. A. (2019) · Mediaobrazovanie · doi:10.13187/me.2019.2.258
Word2vec and its application to examining the changes in word contexts over time
Saastamoinen, T. (2020) · Työväentutkimus Vuosikirja
Web Scraping and Naïve Bayes Classification for Political Analysis
Varela, N., Lezama, O. B. P., & Charris, M. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-981-15-8443-5_1
Fung, A. (2020) · ResearchWorks at the University of Washington (University of Washington)
Callegaro, M. (2017) · Survey Practice · doi:10.29115/sp-2018-0018
Learning Algorithms of Sentiment Analysis
Acampa, S., Falco, C. C. D., & Trezza, D. (2021) · Advances in knowledge acquisition, transfer, and management book series/Advances in knowledge acquisition, transfer and management book series · doi:10.4018/978-1-7998-8473-6.ch012
Characterizing Partisan Political Narrative Frameworks about COVID-19 on TwitterPreprint
Jing, E., & Ahn, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.06960
NLP Approach to the Study Economic SanctionsPreprint
Elshehawy, A., Marinov, N., Nanni, F., & Tama, J. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3790866
Matovski, A. (2021) · Cambridge University Press eBooks · doi:10.1017/9781009047500.008
Managing High-Volume Digital Sources in Political Research with Emerging TechnologiesPreprint
Grossman, J., Amano, O. B., & Pedahzur, A. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4012684 · Cited by 1
Social Media and Political Leaders: An exploratory analysisPreprint
Ravi, S., & Kapoor, M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4020367
Is Russia Unique? The Strongman Heresthetic in Comparative Perspective
Matovski, A. (2021) · Cambridge University Press eBooks · doi:10.1017/9781009047500.006
Matovski, A. (2021) · Cambridge University Press eBooks · doi:10.1017/9781009047500.007
Crises, Popular Opinion, and the Realignment of Political Competition in Russia
Matovski, A. (2021) · Cambridge University Press eBooks · doi:10.1017/9781009047500.005
The Crisis Roots of Electoral Authoritarianism: A Macro-Level Analysis
Matovski, A. (2021) · Cambridge University Press eBooks · doi:10.1017/9781009047500.003
A “Perfect Dictatorship?” The Puzzle of Electoral Authoritarianism
Matovski, A. (2021) · Cambridge University Press eBooks · doi:10.1017/9781009047500.001 · Cited by 3
Crises, Popular Opinion, and Electoral Authoritarianism
Matovski, A. (2021) · Cambridge University Press eBooks · doi:10.1017/9781009047500.002
The “Strongman” Electoral Authoritarian Appeal: A Comparative Analysis
Matovski, A. (2021) · Cambridge University Press eBooks · doi:10.1017/9781009047500.004
Fang, W., & Jin, J. (2019) · Cultures of Science · doi:10.1177/209660831900200401
Matovski, A. (2021) · Cambridge University Press eBooks · doi:10.1017/9781009047500.009
Learning Algorithms of Sentiment Analysis
Acampa, S., Falco, C. C. D., & Trezza, D. (2022) · IGI Global eBooks · doi:10.4018/978-1-6684-6303-1.ch040
Measurement error and model instability in automated text analysis: the case of topic modelsPreprint
Ralund, S., Carlsen, H. B., Klemmensen, R., & Lassen, D. D. (2022) · doi:10.31235/osf.io/rxtbg
Looking Back on 60 Years of African Studies in Japan:
Sakamoto, T. (2021) · Journal of African Studies · doi:10.11619/africa.2021.100_3
Computationale Methoden in den Sozial- und Humanwissenschaften
Döring, N. M. (2023) · Springer eBooks · doi:10.1007/978-3-662-64762-2_19
Cadavid-Sanchez, S., Kacem, K., Frade, R. A. M., Boehm, J., Chaney, T., Danial Lashkari, A., & Simig, D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.14588
Is Media Sentiment Associated with Future Conflict Events?Preprint
Jamison, A. S., Miklian, J., Hoelscher, K., Henisz, W., & Ganson, B. (2023) · Social Science Research Network · doi:10.2139/ssrn.4573695 · Cited by 3
Bergmann, J., & Ceross, A. (2023) · British Journal of Healthcare Management · doi:10.12968/bjhc.2022.0081
Finding the structure of parliamentary motions in the Swedish Riksdag 1971–2015
Bruinsma, B., & Johansson, M. (2023) · Quality & Quantity · doi:10.1007/s11135-023-01802-9
Lyu, Z., Nagayoshi, K., & Takikawa, H. (2024) · Translational systems sciences · doi:10.1007/978-981-99-9432-8_7
Data and Methodology in the Twitter EP2019 Analysis
Palonen, E., Sibinescu, L. E., Koljonen, J., & Herkman, J. (2024) · Springer eBooks · doi:10.1007/978-3-031-41737-5_1
Donate To Help Us Fight Back: Political Fundraising and Toxic Rhetoric OnlinePreprint
Kim, S. S., Zilinsky, J., & Brew, B. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/z3vcg
Play to your strengths: Incumbency effect and issue emphasis in Brazilian local elections
Pereira, L. (2026) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2026.107619
Measuring Policy Positioning in U.S. Congressional ElectionsPreprint
Case, C. R., & Porter, R. (2024) · doi:10.31219/osf.io/zhrmv
Montgomery, J. P. (2024) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc2356179
Wang, X., & Wen, J. (2024) · Applied Mathematics and Nonlinear Sciences · doi:10.2478/amns-2024-2924
Xu, Y. (2024) · Applied Mathematics and Nonlinear Sciences · doi:10.2478/amns-2024-3255
Introduction to the Special Issue on “Text as Data in the Study of Politics in Developing Countries”
Kikuchi, H., & Kubo, K. (2025) · The Developing Economies · doi:10.1111/deve.12432
Political Debate about Economic Issues: Some Insights from the Polish Parliament, 1991–2019
Fałkowski, J., Lewkowicz, J., & Nawaro, Ł. (2025) · Ekonomista · doi:10.52335/ekon/200084
Analytical Framework and Research Design
Biel, J., Finger, T., Niemann, A., & Reinke, V. (2025) · Springer eBooks · doi:10.1007/978-3-031-77118-7_4
Measuring Legal Importance: From Case Citations to Linguistic ShiftsPreprint
Chau, B. K. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5226874
Kowal, M. S., & Stoddard, S. V. (2025) · Congress & the Presidency · doi:10.1080/07343469.2025.2457060
Wang, D., Yue, S., Wen, Y., Wu, K., Zhong, T., Chen, M., Yu, Z., Yuan, L., & Lü, G. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05134-x · Cited by 2
Automating Identification of Toxic Comments in Student Evaluations of Teaching
Suzelis, K. N., Mott, G., & Curiel, J. (2025) · Journal of Academic Ethics · doi:10.1007/s10805-025-09645-9
Repositioning of war: the ambiguous language of private military and security companies
Bátora, J., & Ovádek, M. (2025) · European Journal of International Relations · doi:10.1177/13540661251353648
Umansky, K., Giannetti, D., & Pinto, L. (2025) · Journal of Contemporary European Studies · doi:10.1080/14782804.2025.2544023
Bulk Ingestion of Congressional Actions and Materials Dataset
Delano, R., Rudkin, A. F., & Kim, I. (2025) · Scientific Data · doi:10.1038/s41597-025-05737-8
Saverimuttu, S., McInnes, K. M., Warren, K. S., Yeap, L., Hunter, S. A., Gartrell, B. D., Pas, A., Chatterton, J., & Jackson, B. (2025) · PLoS ONE · doi:10.1371/journal.pone.0337720
Quantifying Global Foreign Affairs with a Multimodal Dataset of Diplomatic Websites
Muğurtay, N., Şirin, K. G., Najafabad, M. H., Kahya, A. T., Yılmaz, F. G., Zouzou, Y., Bahçeci, B., Demir, A., Tosun, D., Müftüler‐Baç, M., et al. (2025) · Scientific Data · doi:10.1038/s41597-025-06334-5
Fivaz, J., Schwarz, D., Brandenberger, L., Schlosser, S., Gees, T., & Geiger, C. (2025) · Yearbook of Swiss Administrative Sciences · doi:10.5334/ssas.234
Jing, E., & Ahn, Y. (2021) · Figshare · doi:10.6084/m9.figshare.16909797
Cancio, L. F. P. (2025) · European social work education and practice · doi:10.1007/978-3-031-89410-7_16
Kentikelenis, A., & Seabrooke, L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197828656.003.0006
Kentikelenis, A., & Seabrooke, L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197828656.003.0008
List of Archival Documents Cited
Kentikelenis, A., & Seabrooke, L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197828656.003.0010
How to Study Policy Scripts in International Organizations
Kentikelenis, A., & Seabrooke, L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197828656.003.0003
Kentikelenis, A., & Seabrooke, L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197828656.002.0004
Politics Versus Science in International Organizations
Kentikelenis, A., & Seabrooke, L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197828656.003.0001
Politics Versus Science Across Global Organizations
Kentikelenis, A., & Seabrooke, L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197828656.003.0009
Kentikelenis, A., & Seabrooke, L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197828656.003.0004
Kentikelenis, A., & Seabrooke, L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197828656.003.0007
Kentikelenis, A., & Seabrooke, L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197828656.003.0005
Kentikelenis, A., & Seabrooke, L. (2025) · Oxford University Press eBooks · doi:10.1093/9780197828656.003.0002
Fan, Y., Xu, J., & Chen, B. (2026) · Journal of Intelligent Systems · doi:10.1515/jisys-2025-0059
Mestre, R., & Ryan, M. (2026) · Political Analysis · doi:10.1017/pan.2025.10031
Blinova, D., & Bagozzi, B. E. (2026) · The Information Society · doi:10.1080/01972243.2026.2618259
Co-DETECT: Collaborative Discovery of Edge Cases in Text ClassificationPreprint
Xiong, C., Ni, J., Fan, Y., Zouhar, V., Rooein, D., Calvo-Bartolomé, L., Hoyle, A., Jin, Z., Sachan, M., Leippold, M., et al. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5343743
Ren, T. (2026) · Humanities and Social Sciences Communications · doi:10.1057/s41599-026-06682-6
Baumgartner, F. R., Bevan, S., & Sebők, M. (2026) · Communication and Change · doi:10.1007/s44382-026-00021-8 · Cited by 2
Tulga, A. Y. (2026) · Doğu Asya Araştırmaları Dergisi · doi:10.59114/dasad.1797836
ZHANG, P., Wei, Z., Li, Y., Jiang, N., & Hui, P. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6329079
In search of common ground: Exploring value networks at the UNFCCC climate change talks
Almquist, Z. W., Bagozzi, B. E., Blinova, D., & Brown, Z. (2026) · Network Science · doi:10.1017/nws.2026.10027
Shu, Y., & Hu, G. (2026) · Technology in Society · doi:10.1016/j.techsoc.2026.103372
Wu, N., Yang, B., & Zhang, D.-P. (2026) · Journal of planning education and research · doi:10.1177/0739456x261442161
How to Measure Them? Selecting the Method
Lehmann, P. (2026) · Springer eBooks · doi:10.1007/978-3-032-11081-7_5
The European Union’s use of scientific knowledge in SDG policymaking: a topic model approach
Hemmes, R. A., Leendertse, J., Janssen, M. J., & van Rijnsoever, F. J. (2026) · Science and Public Policy · doi:10.1093/scipol/scag032 · Cited by 1
Institutionalizing International Forums: The Increasing Role of G7 and G20 Engagement Groups
Hüttemann, N. (2026) · Global Society · doi:10.1080/13600826.2026.2686231
Türkiye'de Alevilerin Medyada Temsili: Haber Tweetleri Üzerine Hesaplamalı Bir Analiz
Demirel, S. (2026) · Yeni Medya Dergisi · doi:10.55609/yenimedya.1865257 · Cited by 1
Vartholomaios, A., & Perperidou, D. G. (2026) · Smart Cities · doi:10.3390/smartcities9090143
Hassan, A. (2026) · Frontiers in Political Science · doi:10.3389/fpos.2026.1901653
Tian, Y., & Wang, B. (2026) · Climate Policy · doi:10.1080/14693062.2026.2722557
Assembling Topic Models: Material Political Economy and the Genealogy of an Algorithm
Zhang, B. (2026) · Social Studies of Science · doi:10.1177/03063127261469570
Gazquez-Garcia, J., Sánchez-Bocanegra, C. L., & Fernández-Llatas, C. (2026) · Research Square · doi:10.21203/rs.3.rs-10806370/v1
GovText: 142 Billion Tokens Extracted from Government Documents
Mehta, A., Du, A., Gopal, A., Huang, Y., Lee, B. C. G., & Deeds, K. (2026) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3805696.3848487
Kim, M. H., & Kim, K. (2026) · Oxford Research Encyclopedia of Politics · doi:10.1093/9780197851821.003.2315
Metadata
- Authors
- Wilkerson, J., & Casas, A.
- Affiliations
- University of Washington (US)
- ORCID
- Casas, Andreu
- Venue
- Annual Review of Political Science
- Publisher
- Annual Reviews
- Published
- 2017-05-11
- Volume
- 20
- Issue
- 1
- Pages
- 529-544
- ISSN
- 1094-2939 (ISSN-L)
- 1545-1577
- OpenAlex
- W2515855575
- Semantic Scholar
- 0d345c2fb459e6ecc28328917ab37a4707e4a502
- Cited by
- 300
- References
- 65
- Citations by year
- 2026: 29 · 2025: 48 · 2024: 37 · 2023: 38 · 2022: 34 · 2021: 50 · 2020: 25 · 2019: 25 · 2018: 12 · 2017: 2
- FWCI
- 7.83
- Type
- journal article
- Language
- en
- Open access
- green
- research.vu.nl
- Licence
- other-oa
- Locations
- Annual Review of Political Science (publishedVersion)
- VU Research Portal (publishedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Topics
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Social Sciences › Political Science and International Relations › Political Science Research and Education
- Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
- Keywords
- text-as-data, computational text analysis, topic modeling, online information sources, quantitative text analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review