The Self-Perception and Political Biases of ChatGPT
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
This contribution analyzes the self-perception and political biases of OpenAI’s Large Language Model ChatGPT. Considering the first small-scale reports and studies that have emerged, claiming that ChatGPT is politically biased towards progressive and libertarian points of view, this contribution is aimed at providing further clarity on this subject. Although the concept of political bias and affiliation is hard to define, lacking an agreed-upon measure for its quantification, this contribution attempts to examine this issue by having ChatGPT respond to questions on commonly used measures of political bias. In addition, further measures for personality traits that have previously been linked to political affiliations were examined. More specifically, ChatGPT was asked to answer the questions posed by the political compass test as well as similar questionnaires that are specific to the respective politics of the G7 member states. These eight tests were repeated ten times each and indicate that ChatGPT seems to hold a bias towards progressive views. The political compass test revealed a bias towards progressive and libertarian views, supporting the claims of prior research. The political questionnaires for the G7 member states indicated a bias towards progressive views but no significant bias between authoritarian and libertarian views, contradicting the findings of prior reports. In addition, ChatGPT’s Big Five personality traits were tested using the OCEAN test, and its personality type was queried using the Myers-Briggs Type Indicator (MBTI) test. Finally, the maliciousness of ChatGPT was evaluated using the Dark Factor test. These three tests were also repeated ten times each, revealing that ChatGPT perceives itself as highly open and agreeable, has the Myers-Briggs personality type ENFJ, and is among the test-takers with the least pronounced dark traits.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“On one hand, we must be mindful that several studies have underscored the ways in which the outputs of GenAI tools like ChatGPT can inadvertently reinforce biases in areas such as gender and politics (Gross, 2023; Motoki et al., 2024; Rutinowski et al., 2024).”
From If ChatGPT can do it, where is my creativity? generative AI boosts performance but diminishes experience in creative writing (2025) · cites this paper as Rutinowski et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“Available data point to ChatGPT output expressing more progressive than traditional political views [38][39][40].”
From The Impact of Artificial Intelligence on Human Sexuality: A Five-Year Literature Review 2020–2024 (2024) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
The dark triad of personality: Narcissism, Machiavellianism, and psychopathy
Paulhus, D. L., & Williams, K. M. (2002) · Journal of Research in Personality · doi:10.1016/s0092-6566(02)00505-6 · Cited by 5,265
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Llama 2: Open Foundation and Fine-Tuned Chat Models
Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.09288 · Cited by 2,604
Artificial hallucinations in ChatGPT: implications in scientific writing
Alkaissi, H., & McFarlane, S. I. (2023) · Cureus · doi:10.7759/cureus.35179 · Cited by 1,540
The Myers-Briggs Type Indicator: Manual (1962).
Myers, I. B. (1962) · Consulting Psychologists Press eBooks · doi:10.1037/14404-000 · Cited by 1,102
Consistency of the factorial structures of personality ratings from different sources.
Fiske, D. W. (1949) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0057198 · Cited by 980
Gender differences in personality across the ten aspects of the big five
Weisberg, Y. J., DeYoung, C. G., & Hirsh, J. B. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00178 · Cited by 947
A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT
White, J., Fu, Q., Hays, S., Sandborn, M., Olea, C., Gilbert, H., Elnashar, A., Spencer-Smith, J., & Schmidt, D. C. (2023) · arXiv · doi:10.48550/arxiv.2302.11382 · Cited by 838
A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT
Zhou, C., Li, Q., Li, C., Yu, J., Liu, Y., Wang, G., Zhang, K., Ji, C., Yan, Q., He, L., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.09419 · Cited by 574
The Big Five Personality Traits in the Political Arena
Gerber, A. S., Huber, G. A., Doherty, D., & Dowling, C. M. (2011) · Annual Review of Political Science · doi:10.1146/annurev-polisci-051010-111659 · Cited by 558
A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT
Zhou, C., Li, Q., Li, C., Yu, J., Liu, Y., Wang, G., Zhang, K., Ji, C., Yan, Q., He, L., et al. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02443-6 · Cited by 557
Moshagen, M., Hilbig, B. E., & Zettler, I. (2018) · Psychological Review · doi:10.1037/rev0000111 · Cited by 519
Big Five personality traits and academic performance: A meta‐analysis
Mammadov, S. (2022) · Journal of Personality · doi:10.1111/jopy.12663 · Cited by 383
More human than human: measuring ChatGPT political bias
Motoki, F., Pinho Neto, V., & Rodrigues, V. (2024) · Public Choice · doi:10.1007/s11127-023-01097-2 · Cited by 329
The Political Biases of ChatGPT
Rozado, D. (2023) · Social Sciences · doi:10.3390/socsci12030148 · Cited by 281
The Utility of the Myers-Briggs Type Indicator
Pittenger, D. J. (1993) · Review of Educational Research · doi:10.2307/1170497 · Cited by 245
Machine Learning Approach to Personality Type Prediction Based on the Myers–Briggs Type Indicator®
Amirhosseini, M. H., & Kazemian, H. B. (2020) · Multimodal Technologies and Interaction · doi:10.3390/mti4010009 · Cited by 180
The Self-Perception and Political Biases of ChatGPT
Rutinowski, J., Franke, S., Endendyk, J., Dormuth, I., & Pauly, M. (2023) · arXiv · doi:10.48550/arxiv.2304.07333 · Cited by 178
Self-citationHartmann, J., Schwenzow, J., & Witte, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4316084 · Cited by 173
Human Language Understanding & Reasoning
Manning, C. D. (2022) · Daedalus · doi:10.1162/daed_a_01905 · Cited by 162
Is Chat Gpt biased against conservatives? An empirical study
McGee, R. W. (2023) · doi:10.2139/ssrn.4359405 · Cited by 141
Stein, R., & Swan, A. B. (2019) · Social and Personality Psychology Compass · doi:10.1111/spc3.12434 · Cited by 138
Benchmarking Intersectional Biases in NLP
Lalor, J., Yang, Y., Smith, K., Forsgren, N., & Abbasi, A. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.263 · Cited by 117
Ghosh, S., & Caliskan, A. (2023) · Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3600211.3604672 · Cited by 112
Algorithmic Political Bias in Artificial Intelligence Systems
Peters, U. (2022) · Philosophy & Technology · doi:10.1007/s13347-022-00512-8 · Cited by 111
Stability and Change: The Dark Factor of Personality Shapes Dark Traits
Zettler, I., Moshagen, M., & Hilbig, B. E. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550620953288 · Cited by 75
King, S. P., & Mason, B. A. (2020) · Wiley eBooks · doi:10.1002/9781118970843.ch123 · Cited by 75
Quantifying and alleviating political bias in language models
Liu, R., Jia, C., Wei, J., Xu, G., & Vosoughi, S. (2022) · Artificial Intelligence · doi:10.1016/j.artint.2021.103654 · Cited by 68
Ghosh, S., & Caliskan, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.10510 · Cited by 55
D’Alonzo, S., & Tegmark, M. (2022) · PLoS ONE · doi:10.1371/journal.pone.0271947 · Cited by 35
Radisavljević, D., Rzepka, R., & Araki, K. (2023) · Applied Sciences · doi:10.3390/app13074506 · Cited by 32
How Prevalent Is Gender Bias in ChatGPT? - Exploring German and English ChatGPT Responses
Urchs, S., Thurner, V., Aßenmacher, M., Heumann, C., & Thiemichen, S. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-74630-7_20 · Cited by 31
The evolution of the political compass (and why libertarianism is not right-wing)
Lester, J. C. (1994) · Journal of Social and Evolutionary Systems · doi:10.1016/1061-7361(94)90011-6 · Cited by 28
Who Were the 10 Best and 10 Worst U.S. Presidents?The Opinion of Chat GPT (Artificial Intelligence)Preprint
McGee, R. W. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4367762 · Cited by 27
Investigating Bias in Image Classification using Model ExplanationsPreprint
Tong, S., & Kagal, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.05463 · Cited by 20
How Prevalent is Gender Bias in ChatGPT? -- Exploring German and English ChatGPT ResponsesPreprint
Urchs, S., Thurner, V., Aßenmacher, M., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.03031 · Cited by 13
Petrik, A. (2012) · Journal of social science education/Sowi-Onlinejournal · doi:10.4119/jsse-541 · Cited by 8
Lytwyn, T. (2012) · Digital Commons at Illinois Wesleyan University (Illinois Wesleyan University) · Cited by 3
An Experimental Test of the Validity of Survey-Measured Political IdeologyPreprint
Laméris, M. D., Jong‐A‐Pin, R., & Wiese, R. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3237290 · Cited by 2
Research works printed but not linked: 9
- Y. LeCun, 2023, Do Large Language Models Need Sensory Grounding for Meaning and Understanding?
- A. Radford, 2019, Language models are unsupervised multitask learners
- A. Radford, 2018, Improving language understanding by generative pretraining
- D. Nolan, 1971, Classifying and analyzing politico-economic systems, The Individualist, 1, 5
- P. H. Ray, 2002, The New Political Compass, 2010
- K. Li, 2021, The personalities of political identity: analyzing the relationship between the Myers-Briggs Indicator Traits and identification with political liberalism and conservatism
- M. van den Broek, 2023, ChatGPT’s Left-Leaning Liberal Bias
- D. Rozado, 2023, Danger in the Machine: The Perils of Political and Demographic Biases Embedded in AI Systems
- 10.3102/00346543063004467 · doi:10.3102/00346543063004467 · Paper page
Cited by
A Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 4,254
Large AI Models in Health Informatics: Applications, Challenges, and the Future
Qiu, J., Li, L., Sun, J., Peng, J., Shi, P., Zhang, R., Dong, Y., Lam, K., Lo, F. P.-W., Xiao, B., et al. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3316750 · Cited by 233
Raman, R., Mandal, S., Das, P., Kaur, T., Sanjanasri, J. P., & Nedungadi, P. (2024) · Human Behavior and Emerging Technologies · doi:10.1155/2024/3085910 · Cited by 214
Generative AI and Marketing Education: What the Future Holds
Guha, A., Grewal, D., & Atlas, S. (2024) · Journal of Marketing Education · doi:10.1177/02734753231215436 · Cited by 149
AI for social science and social science of AI: A survey
Xu, R. F., Sun, Y., Ren, M., Guo, S., Pan, R., Lin, H., Sun, L., & Han, X. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103665 · Cited by 226
Metadata
- Authors
- Rutinowski, J., Franke, S., Endendyk, J., Dormuth, I., Roidl, M., & Pauly, M.
- Affiliations
- TU Dortmund University (DE)
- Corresponding author
- Rutinowski, Jérôme
- Venue
- Human Behavior and Emerging Technologies
- Publisher
- Wiley
- Published
- 2024-01-22
- Volume
- 2024
- Pages
- 1-9
- ISSN
- 2578-1863 (ISSN-L)
- OpenAlex
- W4391090624
- Cited by
- 98
- References
- 41
- Citations by year
- 2026: 18 · 2025: 31 · 2024: 37
- FWCI
- 35.62
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Human Behavior and Emerging Technologies (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Projekt DEAL
- Research Center Trustworthy Data Science and Security
- German Ministry of Education and Research
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Communication › Social Media and Politics
- Social Sciences › Political Science and International Relations › Academic Freedom and Politics
- Keywords
- ChatGPT, large language models, political bias, Big Five personality traits, Myers-Briggs Type Indicator
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.