CoChat

The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index; 6 of the 71 sources its claims cite were checked for support.

The psychological impacts of content moderation on content moderators: A qualitative study

Open access
Spence, Ruth, Bifulco, Antonia, Bradbury, Paula, Martellozzo, Elena, DeMarco, Jeffrey · 2023 · Cyberpsychology: Journal of Psychosocial Research on Cyberspace

Abstract

Content moderation generally refers to the practice of monitoring user generated content and applying a set of rules defining what is acceptable. As a result, Content Moderators (CMs) are responsible for reviewing and removing harmful online material, which has the potential to cause psychological harm. However, little is known about the perceived impacts of the job. Semi-structured interviews were conducted with 11 commercial CMs who were exposed to child sexual abuse material (CSAM) as part of their job. Interviews were analysed using framework analysis to investigate any psychological impacts. Results demonstrated that CMs manifested with a range of symptoms consistent with experiencing repeated trauma. This included experiencing intrusive thoughts of CSAM, triggered by situations with similar contexts to those encountered at work, avoidance of children and negative cognitive and emotional effects such as cynicism, anxiety and detachment. These symptoms fit into a framework of post traumatic and secondary traumatic stress and suggest CMs wellbeing and exposure to stressful stimuli may be comparable to professionals working in the emergency services or caring professions, such as social workers. These personnel are at heightened risk of various problems including compassion fatigue, vicarious trauma and burnout. Companies which employ moderators should learn from these comparable professions and provide psychoeducation and trauma-informed care to CMs which have been demonstrated to help mitigate these challenges.

Overview

CoChat Summary

## TL;DR

This qualitative study of 11 commercial content moderators exposed to child sexual abuse material (CSAM) found a range of psychological effects consistent with repeated trauma, including intrusive thoughts, avoidance, hypervigilance, and negative cognitive/emotional changes. The authors argue that commercial moderators may need trauma-informed support and that larger quantitative and longitudinal studies are needed.

## Key findings

  • The study interviewed 11 commercial content moderators; the sample included 6 females and 5 males from 8 countries.
  • Moderators reported impacts across multiple domains, especially negative cognitive and emotional effects; the paper’s themes included Impact Awareness, Detachment, Negative Cognitive Changes, Emotional Toll, and Stressful Work Environment.
  • Reported symptoms were consistent with trauma-related responses: intrusive thoughts of CSAM, avoidance of children, hypervigilance regarding children, sleep disturbance, anxiety, anger, fatigue, and cynical views of people/world.
  • The authors conclude these effects resemble post-traumatic stress / secondary traumatic stress and suggest companies should provide psychoeducation and trauma-informed care.

## Methods

  • Design: Qualitative study using semi-structured online interviews with commercial content moderators.
  • Sample/data: 11 full-time moderators who had experience moderating CSAM; recruited through online advertising, existing networks, and snowball sampling. Interviews were conducted April to June 2022 and lasted 47 to 78 minutes.
  • Analysis: Interviews were audio-recorded, transcribed verbatim, anonymised, and analysed using framework analysis.

## Limitations

  • The paper states the study was cross-sectional, so it could not capture changes over time.
  • The paper states time in post was not reported, so it could not determine whether effects differed by career stage.
  • The paper states participants were not asked about detailed employment arrangements such as whether they were direct employees or outsourced labor, so the study did not fully capture the range of work environments; additionally, because the sample was only 11 English-speaking commercial moderators, that small, specific sample is an evident constraint (evident from the text).

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.5817/cp2023-4-8

Cites

51 of 51 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

6 Valid · 1 Not valid · 41 Not checked · 65 Own results and interpretations

48 more claims

Create a free account to see all 113 claims and to verify the 6 references still open.

See all claims — free account
  • It may state two separate claims as one. 48
  • Probably not a substantial claim. 22

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 50 references

Research works printed but not linked: 5

  1. Drootin, A. (2021). "Community guidelines": The legal implications of workplace conditions for internet content moderators. Fordham Law Review, 90(3), 1197-1244. https://ir.lawnet.fordham.edu/flr/vol90/iss3/4
  2. Facebook. (2022b). Meta reports first quarter 2022 results. https://investor.fb.com/investor-news/press-release-details/2022/Meta-Reports-First-Quarter-2022-Results/default.aspx
  3. Lo, C. (2018). When all you have is a Banhammer: The social and communicative work of volunteer moderators [Doctoral thesis, Massachusetts Institute of Technology, Cambridge, MA]. https://cmsw.mit.edu/wp/wp-content/uploads/2018/05/Claudia-Lo-When-All-You-Have-Is-a-Banhammer.pdf
  4. Ritchie, J., & Lewis, J. (2003). Qualitative research practice. Sage Publications.
  5. Steiger, M. (2020). Building a resilient workforce: Programming for commercial content moderation staff [Doctoral dissertation, St. Mary's University]. https://commons.stmarytx.edu/dissertations/46

Cited by

See all 48

Metadata

Authors
Spence, R., Bifulco, A., Bradbury, P., Martellozzo, E., & DeMarco, J.
Affiliations
Middlesex University London (GB)
Venue
Cyberpsychology: Journal of Psychosocial Research on Cyberspace
Published
2023-09-18
Volume
17
Issue
4
ISSN
1802-7962 (ISSN-L)
OpenAlex
W4386834659
Cited by
48
References
50
Citations by year
2026: 20 · 2025: 20 · 2024: 7 · 2023: 1
FWCI
13.99
Type
journal article
Language
en
Open access
Locations
  • Cyberpsychology Journal of Psychosocial Research on Cyberspace (publishedVersion, cc-by-sa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Posttraumatic Stress Disorder Research
  • Social Sciences › Psychology › Social Psychology › Stress and Burnout Research
  • Social Sciences › Sociology and Political Science › Emotional Labor in Professions
Keywords
content moderation, psychological impact, child pornography, secondary traumatic stress, post-traumatic stress, vicarious trauma, compassion fatigue, burnout, trauma-informed care, psychoeducation, online content removal, occupational stress

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The psychological impacts of content moderation on content moderators: A qualitative study. https://app.cochat.ai/papers/10.5817/cp2023-4-8
The paper
Spence, R., Bifulco, A., Bradbury, P., Martellozzo, E., & DeMarco, J. (2023). The psychological impacts of content moderation on content moderators: A qualitative study. Cyberpsychology: Journal of Psychosocial Research on Cyberspace. https://doi.org/10.5817/cp2023-4-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.