Cited by 34Hate Speech and Cyberbullying DetectionPsychology of Moral and Emotional JudgmentSentiment Analysis and Opinion Mining

Analysis of Moral Judgment on Reddit

Botzer, Nicholas, Gu, Shawn, Weninger, Tim·2023·IEEE Transactions on Computational Social Systems

Abstract

Moral outrage has become synonymous with social media in recent years. However, the preponderance of academic analysis on social media websites has focused on hate speech and misinformation. This article focuses on analyzing moral judgments rendered on social media by capturing the moral judgments that are passed in the subreddit /r/AmITheAsshole on Reddit. Using the labels associated with each judgment, we train a classifier that can take a comment and determine whether it judges the user who made the original post to have positive or negative moral valence. Then, we employ human annotators to verify the performance of this classifier and use it to investigate an assortment of website traits surrounding moral judgments in ten other subreddits. Our analysis looks to answer three questions related to moral judgments and how these apply to different aspects of Reddit. We seek to determine whether moral valence impacts post scores, in which subreddit communities contain users with more negative moral valence, and whether gender and age play a role in moral judgments. Findings from our experiments show that users upvote posts more often when posts contain positive moral valence. We also find that certain subreddits, such as /r/confessions, attract users who tend to be judged more negatively. Finally, we found that men and older age were judged negatively more often.

Integrity signals

Registry

Crossref · 10.1109/tcss.2022.3160677

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Botzer, N., Gu, S., & Weninger, T.
Affiliations
University of Notre Dame (US)
Venue
IEEE Transactions on Computational Social Systems
Published
2023-06
Volume
10
Issue
3
Pages
947-957
ISSN
  • 2329-924X (ISSN-L)
  • 2373-7476
OpenAlex
W4226339449
Cited by
34
References
5
Citations by year
2026: 1 · 2025: 8 · 2024: 14 · 2023: 11
FWCI
2.71
Type
journal article
Language
en
Open access
closed
Locations
IEEE Transactions on Computational Social Systems (publishedVersion)
Funders
  • U.S. Army Research Office (W911NF-17-1-0448)
  • U.S. Defense Advanced Research Projects Agency (DARPA W911NF-17-C-0094)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Psychology of Moral and Emotional Judgment
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
Keywords
moral judgment, moral outrage, Reddit, moral valence, subreddits, gender differences, age differences, online communities

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review