The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Computer-Assisted Text Analysis for Comparative Politics
Abstract
Recent advances in research tools for the systematic analysis of textual data are enabling exciting new research throughout the social sciences. For comparative politics, scholars who are often interested in non-English and possibly multilingual textual datasets, these advances may be difficult to access. This article discusses practical issues that arise in the processing, management, translation, and analysis of textual data with a particular focus on how procedures differ across languages. These procedures are combined in two applied examples of automated text analysis using the recently introduced Structural Topic Model. We also show how the model can be used to analyze data that have been translated into a single language via machine translation tools. All the methods we describe here are implemented in open-source software packages available from the authors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When estimating word frequencies, the order of words, punctuation, grammar, and so on do not matter, so the 'software needs only to correctly translate the significant terms in the original document' (Lucas et al. 2015, 7).”
From Informational Autocrats (2019) · cites this paper as Lucas et al. 2015
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297 · cited 1×
“Unlike the issues involved in multilingual text processing, these methods have been well developed elsewhere (e.g., Grimmer and Stewart 2013).”
MethodSelf-citationHow Censorship in China Allows Government Criticism but Silences Collective Expression
KING, G., PAN, J., & ROBERTS, M. E. (2013) · American Political Science Review · doi:10.1017/s0003055413000014 · Cited by 2,415
Self-citationtopicmodels : An R Package for Fitting Topic Models
Grün, B., & Hornik, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v040.i13 · Cited by 1,072
Birds of the Same Feather Tweet Together: Bayesian Ideal Point Estimation Using Twitter Data
Barberá, P. (2015) · Political Analysis · doi:10.1093/pan/mpu011 · Cited by 982 · cited 2×
“…Roberts (2013) studied the focus of censorship in social media in China; Jamal et al. (n.d.) studied anti-Americanism in Arabic-language Twitter posts, and Barberá (2012) used Twitter posts to scale citizen liberal-conservative ideal points across the United States and several European countries.”
BackgroundA Scaling Model for Estimating Time‐Series Party Positions from Texts
Slapin, J. B., & Proksch, S. (2008) · American Journal of Political Science · doi:10.1111/j.1540-5907.2008.00338.x · Cited by 684
How to analyze political attention with minimal assumptions and costs
Quinn, K. M., Monroe, B. L., Colaresi, M., Crespin, M. H., & Radev, D. R. (2010) · American Journal of Political Science · doi:10.1111/j.1540-5907.2009.00427.x · Cited by 671
Media Commercialization and Authoritarian Rule in China
Stockmann, D. (2012) · doi:10.1017/cbo9781139087742 · Cited by 596
Monroe, B. L., Colaresi, M. P., & Quinn, K. M. (2008) · Political Analysis · doi:10.1093/pan/mpn018 · Cited by 542
The Secret Life of Pronouns: Flexibility in Writing Style and Physical Health
Campbell, R. S., & Pennebaker, J. W. (2003) · Psychological Science · doi:10.1111/1467-9280.01419 · Cited by 430
Rethinking Social Inquiry: Diverse Tools, Shared Standards
(2010) · doi:10.5040/9798216385530 · Cited by 405
U.S. Treaty Making with American Indians: Institutional Change and Relative Power, 1784–1911
Spirling, A. (2012) · American Journal of Political Science · doi:10.1111/j.1540-5907.2011.00558.x · Cited by 98
Research works printed but not linked: 46
- 10.2139/ssrn.2108098 · DOI · Paper page
- 10.18637/jss.v025.i05 · DOI
- 10.1002/(SICI)1097-4571(199101)42:1<7::AID-ASI2>3.0.CO;2-P · DOI · Paper page
- 10.2307/2111609 · DOI
- Fokkens, A. , Van Erp, M. , Postma, M. , Pedersen, T. , Vossen, P. , and Freire, N. 2013. Offspring from reproduction problems: What replication failure teaches us. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1691–1701, Sofia, Bulgaria, August. Association for Computational Linguistics.
- Nielsen, R. 2013. The lonely Jihadist: Weak networks and the radicalization of Muslim clerics. PhD Thesis, Harvard University. Ann Arbor: ProQuest/UMI (Publication No. 3567018).
- Brachman, 2009, Global Jihadism
- Brown, 1990, A statistical approach to machine translation, Computational Linguistics, 16, 79
- Lunde, 2009, CJKV information processing
- 10.2307/20033345 · DOI
- 10.1080/09592310902975455 · DOI · Paper page
- 10.3115/v1/P14-1110 · DOI
- 10.1145/2133806.2133826 · DOI · Paper page
- Blei, 2007, A correlated topic model of science, Annals of Applied Statistics, 1, 17
- 10.1017/psrm.2013.3 · DOI
- Krovetz, R. J. 1995. Word-sense disambiguation for large text databases PhD thesis, University of Massachusetts, Amherst.
- Salton, 1989, Automatic text processing: The transformation, analysis, and retrieval of information by computer
- 10.1002/(SICI)1097-4571(199601)47:1<70::AID-ASI7>3.0.CO;2-# · DOI
- 10.1093/oso/9780199244003.001.0001 · DOI
- Roberts, M. E. , Stewart, B. M. , Tingley, D. , and Airoldi, E. M. 2013. The structural topic model and applied social science. Advances in Neural Information Processing Systems Workshop on Topic Models: Computation, Application, and Evaluation.
- Telhami, 2002, The stakes: America and the Middle East
- George, 2005, Case studies and theory development in the social sciences
- 10.3115/1699571.1699627 · DOI
- Lynch, 2007, Anti-Americanisms in world politics, 196
- Habash, 2009, Proceedings of the Fourth Workshop on Statistical Machine Translation
- Boyd-Graber, 2010, Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, 45
- 10.1023/B:INRT.0000009439.19151.4c · DOI
- 10.1093/pan/mpn006 · DOI
- 10.2307/j.ctvqr1d6h · DOI
- Mosteller, 1963, Inference in an authorship problem: A comparative study of discrimination methods applied to the authorship of the disputed Federalist Papers, Journal of the American Statistical Association, 58, 275
- Paul, 2009, Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers, 221
- 10.1017/S0003055403000698 · DOI · Paper page
- 10.7551/mitpress/3127.001.0001 · DOI
- Brown, 1993, The mathematics of statistical machine translation: Parameter estimation, Computational Linguistics, 19, 263
- Utiyama, M. , and Isahara, H. 2007. A comparison of pivot methods for phrase-based statistical machine translation. In 2007 Proceedings of NAACL/HLT, pp. 484–491.
- Katzenstein, 2007, Anti-Americanisms in world politics, 9
- 10.1002/(SICI)1097-4571(1999)50:3<218::AID-ASI4>3.0.CO;2-1 · DOI
- 10.3115/1557690.1557763 · DOI
- 10.1353/book.3369 · DOI
- 10.1017/CBO9780511815829 · DOI
- Boyd-Graber, 2009, Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, 75
- 10.1093/pan/mpp034 · DOI
- Tseng, 2005, Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, 171
- Zhao, 2006, Proceedings of the COLING/ACL on Main Conference Poster Sessions
- 10.1145/2396761.2398446 · DOI
- 10.1111/ajps.12103 · DOI
Cited by
Sorted by citations
stm : An R Package for Structural Topic Models
Roberts, M. E., Stewart, B. M., & Tingley, D. (2019) · Journal of Statistical Software · doi:10.18637/jss.v091.i02 · Cited by 1,714
Self-citationGuriev, S., & Treisman, D. (2019) · Journal of Economic Perspectives · doi:10.1257/jep.33.4.100 · Cited by 560
Fischer-Preßler, D., Schwemmer, C., & Fischbach, K. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.05.012 · Cited by 133
Capturing Clicks: How the Chinese Government Uses Clickbait to Compete for Visibility
Lu, Y., & Pan, J. (2021) · Political Communication · doi:10.1080/10584609.2020.1765914 · Cited by 130
Concealing Corruption: How Chinese Officials Distort Upward Reporting of Online Grievances
PAN, J., & CHEN, K. (2018) · American Political Science Review · doi:10.1017/s0003055418000205 · Cited by 125
Metadata
- Authors
- Lucas, C., Nielsen, R. A., Roberts, M. E., Stewart, B. M., Storer, A., & Tingley, D.
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2015
- Volume
- 23
- Issue
- 2
- Pages
- 254-277
- ISSN
- 1047-1987
- 1476-4989
- Cited by
- 366
- References
- 14
- Language
- en
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review