Large language models and political science
The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Large Language Models (LLMs) are a type of artificial intelligence that uses information from very large datasets to model the use of language and generate content. While LLMs like GPT-3 have been used widely in many applications, the recent public release of OpenAI's ChatGPT has opened more debate about the potential uses and abuses of LLMs. In this paper, we provide a brief introduction to LLMs and discuss their potential application in political science and political methodology. We use two examples of LLMs from our recent research to illustrate how LLMs open new areas of research. We conclude with a discussion of how researchers can use LLMs in their work, and issues that researchers need to be aware of regarding using LLMs in political science and political methodology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This has led to their increasing adoption in social sciences where qualitative text analysis has traditionally been the dominant paradigm (see Karjus, 2025;Linegar et al., 2023).”
From Using large language models to analyze political texts through natural language understanding (2026) · cites this paper as Linegar et al., 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
LoRA: Low-Rank Adaptation of Large Language Models
Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., & Chen, W. (2021) · arXiv · doi:10.48550/arxiv.2106.09685 · Cited by 13,453
Social Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767 · cited 1×
“It is well-known that social media is a vector of fake news and misinformation that can threaten elections (Allcott and Gentzkow, 2017).”
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2019) · arXiv · doi:10.48550/arxiv.1908.09635 · Cited by 5,812
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
QLoRA: Efficient Finetuning of Quantized LLMs
Dettmers, T., Pagnoni, A., Holtzman, A., & Zettlemoyer, L. (2023) · arXiv · doi:10.48550/arxiv.2305.14314 · Cited by 3,832
Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297 · cited 2×
“For example, textual data has been used in political science to study political party manifestos (Laver and Garry, 2000), political speeches (Grimmer and Stewart, 2013), legislator communications with constituents (Grimmer, 2013), and social movements (Kann et al., 2023).”
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469
Research works printed but not linked: 25
- Abid, 2021, Large language models associate Muslims with violence, Nat. Mach. Intell., 3, 461, 10.1038/s42256-021-00359-2 · DOI
- Alvarez, 2023, Generative AI and the Future of Elections
- Alvarez, 2022, How (not) to reproduce: Practical considerations to improve research transparency in political science, Polit. Sci. Polit., 55, 149, 10.1017/S1049096521001062 · DOI
- Borji, 2022, Generated faces in the wild: Quantitative comparison of Stable Diffusion, Midjourney and DALL-E 2, arXiv preprint arXiv:2210.00586, 10.48550/arXiv.2210.00586 · DOI · Paper page
- Buolamwini, 2018, “Gender shades: intersectional accuracy disparities in commercial gender classification,”, Proceedings of the 1st Conference on Fairness, Accountability and Transparency, volume 81 of Proceedings of Machine Learning Research, 77
- Chouldechova, 2018, “A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions,”, 134
- Denton, 2023, “Neurips 2023,”, Thirty-seventh Conference on Neural Information Processing Systems
- Gao, 2020, The pile: an 800GB dataset of diverse text for language modeling, arXiv preprint arXiv:2101.00027, 10.48550/arXiv.2101.00027 · DOI · Paper page
- Grimmer, 2013, Representational Style in Congress: What Legislators Say and Why It Matters, 10.1017/CBO9781139207782 · DOI · Paper page
- Holland, 2020, The dataset nutrition label, Data Protect. Privacy, 12, 1, 10.5040/9781509932771.ch-001 · DOI · Paper page
- Kann, 2023, Collective identity in collective action: evidence from the 2020 summer BLM protests, Front. Polit. Sci., 5, 1185633, 10.3389/fpos.2023.1185633 · DOI
- King, 1995, Replication, replication, Polit. Sci. Polit., 28, 444, 10.2307/420301 · DOI
- Kocielnik, “Can you label less by using out-of-domain data? Active & transfer learning with few-shot instructions,”, 22
- Kocielnik, BiasTestGPT: using ChatGPT for social bias testing of language models, arXiv preprint arXiv: 2302.07371 · arXiv
- Laver, 2000, Estimating policy positions from political texts, Am. J. Polit. Sci., 44, 619, 10.2307/2669268 · DOI · Paper page
- Li, 2023, “TROCR: transformer-based optical character recognition with pre-trained models,”, Proceedings of the AAAI Conference on Artificial Intelligence, 13094, 10.1609/aaai.v37i11.26538 · DOI · Paper page
- Mendelsohn, 2023, “From dogwhistles to bullhorns: unveiling coded rhetoric with language models,”, 10.18653/v1/2023.acl-long.845 · DOI
- Poole, 1985, A spatial model for legislative roll call analysis, Am. J. Polit. Sci., 29, 357, 10.2307/2111172 · DOI · Paper page
- Radford, 2021, “Learning transferable visual models from natural language supervision,”, 8748
- Schnabel, 2016, “Recommendations as treatments: debiasing learning and evaluation,”, 1670
- Srikanth, 2021, “Dynamic social media monitoring for fast-evolving online discussions,”, Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, 3576
- van der Linden, 2023, Foolproof: Why Misinformation Infects our Minds and How to Build Immunity
- Xu, 2023, WizardLM: empowering large language models to follow complex instructions, arXiv preprint arXiv:2304.12244, 10.48550/arXiv.2304.12244 · arXiv · doi:10.48550/arxiv.2304.12244 · Paper page
- Zhang, One small step for generative AI, one giant leap for AGI: a complete survey on chatgpt in AIGC era, arXiv preprint arXiv:2304.06488, 10.48550/arXiv.2304.06488 · DOI
- Zhang, Text-to-image diffusion model in Generative AI: A survey, arXiv preprint arXiv:2303.07909, 10.48550/arXiv.2303.07909 · arXiv · doi:10.48550/arxiv.2303.07909 · Paper page
Cited by
Using large language models to analyze political texts through natural language understanding
Benoit, K., De Marchi, S., Laver, C., Laver, M., & Ma, J. (2026) · American Journal of Political Science · doi:10.1111/ajps.70050 · Cited by 37
Metadata
- Authors
- Linegar, M., Kocielnik, R., & Alvarez, R. M.
- Venue
- Frontiers in Political Science
- Publisher
- Frontiers Media SA
- Published
- 2023-10-16
- Volume
- 5
- ISSN
- 2673-3145
- Cited by
- 42
- References
- 34
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Large language models and political science. https://app.cochat.ai/papers/10.3389/fpos.2023.1257092
- The paper
- Linegar, M., Kocielnik, R., & Alvarez, R. M. (2023). Large language models and political science. Frontiers in Political Science. https://doi.org/10.3389/fpos.2023.1257092
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.