The DOI matches its Crossref record; 48 of the 50 references it cites were found in a registry or an index.
Moral Foundations Twitter Corpus: A Collection of 35k Tweets Annotated for Moral Sentiment
Open accessAbstract
Research has shown that accounting for moral sentiment in natural language can yield insight into a variety of on- and off-line phenomena such as message diffusion, protest dynamics, and social distancing. However, measuring moral sentiment in natural language is challenging, and the difficulty of this task is exacerbated by the limited availability of annotated data. To address this issue, we introduce the Moral Foundations Twitter Corpus, a collection of 35,108 tweets that have been curated from seven distinct domains of discourse and hand annotated by at least three trained annotators for 10 categories of moral sentiment. To facilitate investigations of annotator response dynamics, we also provide psychological and demographic metadata for each annotator. Finally, we report moral sentiment classification baselines for this corpus using a range of popular methodologies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Further comparisons (Tables S7 and S8 in Rathje et al. (75)) on another moral foundations dataset, on which the BERT model was not fine-tuned (MFTC; (81)), showed that BERT, despite being applied cross-context, outperformed GPT-4 on the Authority and Purity foundations, and GPT-4-Turbo also on the Loyalty foundation.”
From Perils and opportunities in using large language models in psychological research (2024) · cites this paper as [81]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Advances in neural information processing systems 7
Cios, K. J., & Shields, M. E. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,093
An Introduction to Statistical Learning
James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013) · Springer Texts in Statistics · doi:10.1007/978-1-4614-7138-7 · Cited by 12,106
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Support Vector Regression Machines
Drucker, H., Burges, C. J. C., Kaufman, L., Smola, A. J., & Vapnik, V. N. (1996) · Cited by 4,666
Liberals and conservatives rely on different sets of moral foundations.
Graham, J., Haidt, J., & Nosek, B. A. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0015141 · Cited by 4,560
The righteous mind: why good people are divided by politics and religion
(2012) · Choice Reviews Online · doi:10.5860/choice.49-7185 · Cited by 4,347
The kappa statistic in reliability studies: use, interpretation, and sample size requirements
Sim, J., & Wright, C. C. (2005) · Physical Therapy · doi:10.1093/ptj/85.3.257 · Cited by 4,093
An Overview of Multi-Task Learning in Deep Neural NetworksPreprint
Ruder, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.05098 · Cited by 3,827
Flagged first, then by citations
2 of the 50 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Boyd R. L., 2015, Ninth International AAAI
- Garten J., 2016, Proceedings of IJCAI 2016 Workshop on Computational Modeling of Attitudes
- Poulshock J. W. (2006). Language and morality: Evolution, altruism, and linguistic moral mechanisms (Unpublished doctoral dissertation). University of Edinburgh, United Kingdom.
- Zhou L., 2015, Studies in Health Technology and Informatics, 216, 629
Cited by
Sorted by citations
Items 101–177 of 177
From Stance to Concern: Adaptation of Propositional Analysis to New Tasks and Domains
Mather, B., Dorr, B. J., Dalton, A., de Beaumont, W., Rambow, O., & Schmer-Galunder, S. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.264 · Cited by 4
Comparative moral principles: justifications, values, and foundations
Ylä-Anttila, T. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-01684-0 · Cited by 12
Ethics Incognito: Detecting Ethically Relevant Courses Across Curricula in Higher Education
Ongis, M., Kidd, D., & Miner, J. (2023) · Journal of Academic Ethics · doi:10.1007/s10805-023-09482-8 · Cited by 4
A transformer-based deep learning model for Persian moral sentiment analysis
Karami, B., Bakouie, F., & Gharibzadeh, S. (2023) · Journal of Information Science · doi:10.1177/01655515231188344 · Cited by 4
MOTIV: Visual Exploration of Moral Framing in Social Media
Wentzel, A., Levine, L., Dhariwal, V., Fatemi, Z., Bhattacharya, A., Eugenio, B. D., Rojecki, A., Zheleva, E., & Marai, G. E. (2024) · Computer Graphics Forum · doi:10.1111/cgf.15072 · Cited by 5
Quantitative and Qualitative Analysis of Moral Foundations in Argumentation
Landowska, A., Budzyńska, K., & Zhang, H. (2024) · Argumentation · doi:10.1007/s10503-024-09636-x · Cited by 6
Analysing Moral Beliefs for Detecting Hate Speech Spreaders on Twitter
Lai, M., Stranisci, M. A., Bosco, C., Damiano, R., & Patti, V. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-13643-6_12 · Cited by 4
Understanding Stay-at-home Attitudes through Framing Analysis of Tweets
Fatemi, Z., Bhattacharya, A., Wentzel, A., Dhariwal, V., Levine, L., Rojecki, A., Marai, G. E., Eugenio, B. D., & Zheleva, E. (2022) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa54385.2022.10032455 · Cited by 4
Do Language Models Understand Morality? Towards a Robust Detection of Moral Content
Bulla, L., Aldo Gangemi, A., & Mongiovı̀, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-58202-8_7 · Cited by 5
Moral Association Graph: A Cognitive Model for Automated Moral Inference
Ramezani, A., & Xu, Y. (2024) · Topics in Cognitive Science · doi:10.1111/tops.12774 · Cited by 4
Capraro, V. (2025) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2025.102024 · Cited by 3
Beyond Sentiment: Examining the Role of Moral Foundations in User Engagement with News on Twitter
D'Ignazi, J., Kalimeri, K., & Beiró, M. G. (2025) · ACM Web Science Conference (WebSci) · doi:10.1145/3717867.3717871 · Cited by 5
Malaysian Onion Army and Othering: Radicalized Trolling Hunters on Twitter During Pandemic
Zamri, N. A. K., Nasir, N. N. A. M., Hassim, M. N., Ramli, S. M., & Amin, F. M. (2022) · Advances in Social Science, Education and Humanities Research/Advances in social science, education and humanities research · doi:10.2991/assehr.k.220101.024 · Cited by 3
Unsupervised Reinforcement Adaptation for Class-Imbalanced Text Classification
Wu, Y., & Huang, X. (2022) · Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/2022.starsem-1.27 · Cited by 4
Nordin, N., Siti‐Nabiha, A. K., & Samsudin, M. A. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-031-08087-6_31 · Cited by 3
Huang, F., Li, S., Ding, H., Han, N., & Zhu, T. (2022) · Current Psychology · doi:10.1007/s12144-022-03735-2 · Cited by 3
Lenk, T. (2023) · Journal of Communication Management · doi:10.1108/jcom-12-2022-0139 · Cited by 4
Constructing Vec-tionaries to Extract Message Features from Texts: A Case Study of Moral Content
Duan, Z., Shao, A., Hu, Y., Lee, H., Liao, X., Suh, Y. J., Kim, J., Yang, K.-C., Chen, K., & Yang, S. (2025) · Political Analysis · doi:10.1017/pan.2025.6 · Cited by 3
Zheng, J., Friedman, S., Schmer-Galunder, S., Magnusson, I., Wheelock, R., Gottlieb, J., Gómez, D., & Miller, C. A. (2022) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2022.woah-1.19 · Cited by 3
Mutlu, E., Oghaz, T. A., Tütüncüler, E., Jasser, J., & Garibay, I. (2020) · arXiv.org · doi:10.48550/arxiv.2004.13142 · Cited by 4
Evolution of the Moral Lexicon
Ramezani, A., Stellar, J. E., Feinberg, M., & Xu, Y. (2024) · Open Mind · doi:10.1162/opmi_a_00164 · Cited by 4
An Ontology Network for Citizen Curation
Asprino, L., Damiano, R., Daquino, M., Giorgis, S. D., Aldo Gangemi, A., Lieto, A., Sartini, B., & Striani, M. (2024) · Journal on Computing and Cultural Heritage · doi:10.1145/3704729 · Cited by 2
Visual Moral Inference and Communication
Zhu, W., Ramezani, A., & Xu, Y. (2025) · Topics in Cognitive Science · doi:10.1111/tops.70031 · Cited by 2
Noise Audits Improve Moral Foundation Classification
Mokhberian, N., Hopp, F. R., Harandizadeh, B., Morstatter, F., & Lerman, K. (2022) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam55673.2022.10068681 · Cited by 2
Toxicity in Evolving Twitter Topics
Geller, M., de Vasconcelos, V. V. L., & Pinheiro, F. L. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-36027-5_4 · Cited by 2
Moral Salience in Film Reviews Associated With Film Success: An Analysis of 1.6 Million Reviews
Huang, J., Yang, Z. J., & Zhu, J. (2024) · J. Media Psychol. Theor. Methods Appl. · doi:10.1027/1864-1105/a000416 · Cited by 2
Measuring Online Emotional Reactions to Events
Guo, S., He, Z., Rao, A., Jang, E., Nan, Y., Morstatter, F., Brantingham, J., & Lerman, K. (2023) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1145/3625007.3627477 · Cited by 2
Wang, M.-J., Yogeeswaran, K., Nash, K. A., & Sivaram, S. (2024) · Journal of Computational Social Science · doi:10.1007/s42001-024-00288-1 · Cited by 2
Agiollo, A., Siebert, L. C., Murukannaiah, P. K., & Omicini, A. (2024) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-024-09663-8 · Cited by 8
Reader, T. W., & Gillespie, A. (2024) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2024.2398181 · Cited by 2
Agent-based moral rhetoric simulation to reduce political polarization
Williams, E., & Carley, K. M. (2025) · Computational and Mathematical Organization Theory · doi:10.1007/s10588-025-09401-9 · Cited by 2
Recognising Moral Foundations in Online Extremist Discourse : A Cross-Domain Classification Study
van Luenen, & Fleur, A. (2020) · Cited by 2
Gubelmann, R., Hongler, P., Margadant, E., & Handschuh, S. (2022) · Natural Legal Language Processing Workshop (NLLP) · doi:10.18653/v1/2022.nllp-1.2 · Cited by 2
The Pulse of Mood Online: Unveiling Emotional Reactions in a Dynamic Social Media Landscape
Guo, S., He, Z., Rao, A., Morstatter, F., Brantingham, P. J., & Lerman, K. (2024) · ACM Transactions on the Web · doi:10.1145/3708513 · Cited by 3
HaMor at the Profiling Hate Speech Spreaders on Twitter
Lai, M., Stranisci, M. A., Bosco, C., Damiano, R., & Patti, V. (2021) · Institutional Research Information System University of Turin (University of Turin) · Cited by 2
Being Seen: How Markets Impact Our Moral SentimentsPreprint
Harris, C. M., Myers, A., & Kaiser, A. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3997378 · Cited by 2
Theory-driven Measurement of Emotion (Expressions) in Social Media TextPreprint
Brady, W. J., McLoughlin, K. L., & Crockett, M. J. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/v9xd7 · Cited by 3
Understanding the human psychology towards relationships using the Reddit dataset
Dubey, P. (2022) · doi:10.32469/10355/95148 · Cited by 2
George, A., Ahrens, M., Pierrehumbert, J. B., & McMahon, M. F. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-71210-4_3 · Cited by 1
Condez, A. C., Tavares, D., & Magalhães, J. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3758166 · Cited by 1
Exploring how students interact with AI for detecting moral sentiments in social media
Upadhyaya, A., Schicchi, D., Taibi, D., & Fisichella, M. (2026) · Array · doi:10.1016/j.array.2026.100941 · Cited by 1
Historical reconstruction of human moralization with word association and text corpora
Ramezani, A., Stellar, J. E., Feinberg, M., & Xu, Y. (2026) · Nature Communications · doi:10.1038/s41467-025-67891-2 · Cited by 1
Moral rhetoric in discrete choice models: a Natural Language Processing approach
Szép, T., van Cranenburgh, S., & Chorus, C. G. (2023) · Quality & Quantity · doi:10.1007/s11135-023-01625-8 · Cited by 2
Díaz-Faes, A. M., Murteira, C., & Ruskov, M. (2024) · Journal of Data Mining & Digital Humanities · doi:10.46298/jdmdh.13120 · Cited by 4
Quantifying the emergence of moral foundational lexicon in child language development
Ramezani, A., Liu, E., Lee, S. W. S., & Xu, Y. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae278 · Cited by 2
NLP as a Lens for Causal Analysis and Perception Mining to Infer Mental Health on Social MediaPreprint
Garg, M., Saxena, C., Naseem, U., Sohn, S., & Dorr, B. J. (2023) · doi:10.36227/techrxiv.21972974 · Cited by 1
Osborne, M. R., Cratsley, M. J., Massey, M., & Rice, V. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/tc5vq · Cited by 1
Text analysis of moral foundations using big data : focusing on entrance exam articles
Kim, H., & Kim, B.-R. (2020) · Journal of Digital Contents Society · doi:10.9728/dcs.2020.21.6.1159
Measuring a Texts Fairness Dimensions Using Machine Learning Based on Social Psychological FactorsPreprint
Izzidien, A., & Stillwell, D. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.00086 · Cited by 1
Macanovic, A., & Przepiorka, W. (2022) · doi:10.31235/osf.io/cerzs
Classificação computacional de fundamentos morais a partir de texto
Lan, A. G. J. (2022) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.100.2022.tde-05052022-094458
Targeting audiences’ moral values shapes misinformation sharingPreprint
Abdurahman, S., Reimer, N. K., Golazizian, P., Baek, E. C., Shen, Y. L., Trager, J. P., Lulla, R., Kaplan, J., Parkinson, C. M., & Dehghani, M. (2023) · doi:10.31234/osf.io/ztq2k
Self-citationMorality analysis: Reducing moral backlash to public policy
Mills, B. (2023) · Canadian Public Administration · doi:10.1111/capa.12522
Zúquete, M., Orghian, D., & Pinheiro, F. L. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35995-8_30
Agent-Based Moral Interaction Simulations in Imbalanced Polarized Settings
Williams, E., & Carley, K. M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43129-6_14
Moral Essential Elements: MEE-A Dataset for Moral Judgement
Wang, Y., Du, X., Liu, P., & Yu, D. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-7224-1_20
A Lens to Pandemic Stay at Home Attitudes
Wentzel, A., Levine, L., Dhariwal, V., Fatemi, Z., Bhattacharya, A., Eugenio, B. D., Rojecki, A., Zheleva, E., & Marai, G. E. (2023) · doi:10.1109/vis4pandemres60343.2023.00008
Rzepka, R., & Araki, K. (2024) · Elsevier eBooks · doi:10.1016/b978-0-44-315991-6.00018-2
Capraro, V. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4769363
Allein, L., Truşcǎ, M. M., & Moens, M. (2024) · Artificial Intelligence · doi:10.1016/j.artint.2024.104234 · Cited by 1
What does AI consider praiseworthy?
Peterson, A. (2025) · AI and Ethics · doi:10.1007/s43681-025-00682-z
Prevedello, G., Verheyen, L., Brugnoli, E., Sardo, D. R. L., & van Trijp, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-85463-7_4
Does FinTech Uplift Vulnerable Consumers?
Nixon, A., & An, J. (2025) · IGI Global eBooks · doi:10.4018/979-8-3693-9944-6.ch009
Computational Methods in Media Psychology
Fisher, J. T. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197689875.013.0017
Zamri, N. A. K., & Nasir, N. N. A. M. (2025) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83608-482-220251003
Greco, C. M., Zangari, L., Picca, D., & Tagarelli, A. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3761618 · Cited by 3
Xu, M., Cropp, F., & Cameron, G. T. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108873
Haines, E. A., Thomas, E. F., Stothard, C., Kernot, D., Lizzio‐Wilson, M., Caminschi, I., Ram, R., & Rizoiu, M.-A. (2026) · New Media & Society · doi:10.1177/14614448251413686
Yadav, A., & Singh, V. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774905.3796488
Co-Constructing Alignment: A Participatory Approach to Situating AI Values
Arzberger, A., Liscio, E., Lupetti, M. L., de Troya, Í. M. D. R., & Yang, J. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812267 · Cited by 2
Macías-Vasileff, V., Garofalo, C., Schuurmans, E., Bogaerts, S., Erbaş, Y., & Caluwé, E. D. (2026) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2026.102732
Saturation of moral language predicts lower content engagement on social media
Candia, C., Atari, M., Kteily, N., & Uzzi, B. (2026) · Nature Human Behaviour · doi:10.1038/s41562-026-02560-y · Cited by 8
Self-citationYuan, Y., & Liu, K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7412293
Diwanji, V. S., Lee, J., Cortese, J., & Kwon, K. (2026) · Journal of Global Marketing · doi:10.1080/08911762.2026.2747190
Metadata
- Authors
- Hoover, J., Portillo-Wightman, G., Yeh, L., Havaldar, S., Davani, A. M., Lin, Y., Kennedy, B., Atari, M., Kamel, Z., Mendlen, M., Moreno, G., Park, C., Chang, T. E., Chin, J., Leong, C., Leung, J. Y., Mirinjian, A., & Dehghani, M.
- Affiliations
- University of Southern California (US)
- Rensselaer Polytechnic Institute (US)
- Corresponding author
- Dehghani, Morteza
- ORCID
- Venue
- Social Psychological and Personality Science
- Publisher
- SAGE Publications
- Published
- 2020-02-19
- Volume
- 11
- Issue
- 8
- Pages
- 1057-1071
- ISSN
- 1948-5506 (ISSN-L)
- 1948-5514
- OpenAlex
- W3008655042
- Semantic Scholar
- a95ee39bda53cf7cbf1677d1bbac9d2be34fcc5a
- Cited by
- 177
- References
- 50
- Citations by year
- 2026: 10 · 2025: 19 · 2024: 36 · 2023: 41 · 2022: 39 · 2021: 24 · 2020: 7
- FWCI
- 10.91
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Social Psychological and Personality Science (publishedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- Funders
- Army Research Laboratory
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Life Sciences › Neuroscience › Cognitive Neuroscience › Psychology of Moral and Emotional Judgment
- Keywords
- moral sentiments, moral foundations, Twitter, annotated corpus, social media discourse, message dissemination, protest dynamics, social distancing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review