The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index; 6 of the 71 sources its claims cite were checked for support.
The psychological impacts of content moderation on content moderators: A qualitative study
Open accessAbstract
Content moderation generally refers to the practice of monitoring user generated content and applying a set of rules defining what is acceptable. As a result, Content Moderators (CMs) are responsible for reviewing and removing harmful online material, which has the potential to cause psychological harm. However, little is known about the perceived impacts of the job. Semi-structured interviews were conducted with 11 commercial CMs who were exposed to child sexual abuse material (CSAM) as part of their job. Interviews were analysed using framework analysis to investigate any psychological impacts. Results demonstrated that CMs manifested with a range of symptoms consistent with experiencing repeated trauma. This included experiencing intrusive thoughts of CSAM, triggered by situations with similar contexts to those encountered at work, avoidance of children and negative cognitive and emotional effects such as cynicism, anxiety and detachment. These symptoms fit into a framework of post traumatic and secondary traumatic stress and suggest CMs wellbeing and exposure to stressful stimuli may be comparable to professionals working in the emergency services or caring professions, such as social workers. These personnel are at heightened risk of various problems including compassion fatigue, vicarious trauma and burnout. Companies which employ moderators should learn from these comparable professions and provide psychoeducation and trauma-informed care to CMs which have been demonstrated to help mitigate these challenges.
Overview
CoChat Summary
## TL;DR
This qualitative study of 11 commercial content moderators exposed to child sexual abuse material (CSAM) found a range of psychological effects consistent with repeated trauma, including intrusive thoughts, avoidance, hypervigilance, and negative cognitive/emotional changes. The authors argue that commercial moderators may need trauma-informed support and that larger quantitative and longitudinal studies are needed.
## Key findings
- The study interviewed 11 commercial content moderators; the sample included 6 females and 5 males from 8 countries.
- Moderators reported impacts across multiple domains, especially negative cognitive and emotional effects; the paper’s themes included Impact Awareness, Detachment, Negative Cognitive Changes, Emotional Toll, and Stressful Work Environment.
- Reported symptoms were consistent with trauma-related responses: intrusive thoughts of CSAM, avoidance of children, hypervigilance regarding children, sleep disturbance, anxiety, anger, fatigue, and cynical views of people/world.
- The authors conclude these effects resemble post-traumatic stress / secondary traumatic stress and suggest companies should provide psychoeducation and trauma-informed care.
## Methods
- Design: Qualitative study using semi-structured online interviews with commercial content moderators.
- Sample/data: 11 full-time moderators who had experience moderating CSAM; recruited through online advertising, existing networks, and snowball sampling. Interviews were conducted April to June 2022 and lasted 47 to 78 minutes.
- Analysis: Interviews were audio-recorded, transcribed verbatim, anonymised, and analysed using framework analysis.
## Limitations
- The paper states the study was cross-sectional, so it could not capture changes over time.
- The paper states time in post was not reported, so it could not determine whether effects differed by career stage.
- The paper states participants were not asked about detailed employment arrangements such as whether they were direct employees or outsourced labor, so the study did not fully capture the range of work environments; additionally, because the sample was only 11 English-speaking commercial moderators, that small, specific sample is an evident constraint (evident from the text).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 1 Not valid · 41 Not checked · 65 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Nevertheless, this study suggests the psychological impacts experienced by commercial CMs are comparable to those experienced by professionals such as first responders and police tasked with analysing child exploitation material (Greinacher et al., 2019; Bourke & Craun, 2014).”
What the sources say
- Supportedcites Greinacher et al., 2019 source
The Results (Descriptive data) report secondary traumatization among first responders, including police officers investigating Internet child abuse. The comparison with commercial content moderators is framed as the citing study’s own conclusion, not a finding attributed to Greinacher et al. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites Bourke & Craun, 2014 source
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 3 assumptions not shown here.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“negative cognitive and emotional effects such as cynicism, anxiety and detachment”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This included experiencing intrusive thoughts of CSAM, triggered by situations with similar contexts to those encountered at work”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Results demonstrated that CMs manifested with a range of symptoms consistent with experiencing repeated trauma.”
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“avoidance of children”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
48 more claims
Create a free account to see all 113 claims and to verify the 6 references still open.
- It may state two separate claims as one. 48
- Probably not a substantial claim. 22
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“One study found that over half of the surveyed content moderators scored high (13 and over) on a general depression scale (CORE-10), indicating clinical depression [13,169].”
From Measuring the Mental Health of Content Reviewers, a Systematic Review (2025) · cites this paper as [169]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“According to news reports, lawsuits, ethnographic investigations, and some survey research, content reviewers experience similar mental health harms as other helping professionals [169].”
From Measuring the Mental Health of Content Reviewers, a Systematic Review (2025) · cites this paper as [169]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The measure includes an assumption that workers can choose cases, which may not hold true for all content reviewers [24,25,168,169].”
From Measuring the Mental Health of Content Reviewers, a Systematic Review (2025) · cites this paper as [169]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This rate is higher than in other professions such as policing, where a quarter of the personnel scored in the clinical range for depression due to dealing with child sexual abuse and exploitation material [38,169].”
From Measuring the Mental Health of Content Reviewers, a Systematic Review (2025) · cites this paper as [169]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some studies have used measures that include secondary and vicarious trauma [169].”
From Measuring the Mental Health of Content Reviewers, a Systematic Review (2025) · cites this paper as [169]
Experimental — accuracy not yet measured
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
Gale, N. K., Heath, G., Cameron, E., Rashid, S., & Redwood, S. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-117 · Cited by 10,865 · cited 1×
“A Framework approach was used to analyse the data (Gale et al., 2013).”
MethodMoral injury and moral repair in war veterans: A preliminary model and intervention strategy
Litz, B. T., Stein, N., Delaney, E., Lebowitz, L., Nash, W. P., Silva, C., & Maguen, S. (2009) · Clinical Psychology Review · doi:10.1016/j.cpr.2009.07.003 · Cited by 2,738 · cited 1×
“Moral injury occurs when someone acts, fails to prevent or bears witness to acts that transgress their moral beliefs (Litz et al., 2009) and therefore for some, the work of CMs could manifest as moral injury.”
BackgroundFigley, C. R. (1995) · Cited by 1,466
Hakanen, J. J., Schaufeli, W. B., & Ahola, K. (2008) · Work & Stress · doi:10.1080/02678370802379432 · Cited by 1,432 · cited 1×
“Furthermore, disorders such as PTSD, STS and burnout are often comorbid with other mental health problems such as depression and anxiety and in some cases their onsets are linked (e.g., Hakanen et al., 2008; Schindel-Allon et al., 2010).”
BackgroundPsychological debriefing for preventing post traumatic stress disorder (PTSD)
Rose, S. C., Bisson, J., Churchill, R., & Wessely, S. (2002) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000560 · Cited by 1,250
Gillespie, T. (2019) · doi:10.12987/9780300235029 · Cited by 806
Relation between Emotion Regulation and Mental Health: A Meta-Analysis Review
Hu, T., Zhang, D., Wang, J., Mistry, R., Ran, G., & Wang, X. (2014) · Psychological Reports · doi:10.2466/03.20.pr0.114k22w4 · Cited by 633 · cited 1×
“However, the adjustment seemed to be associated with the ability to suppress emotions, which may have longer-term consequences for social and mental wellbeing (Chervonsky & Hunt, 2017; Hu et al., 2014).”
BackgroundHunsaker, S., Chen, H., Maughan, D., & Heaston, S. (2015) · Journal of Nursing Scholarship · doi:10.1111/jnu.12122 · Cited by 592 · cited 1×
“Organisational support can also raise feelings of compassion satisfaction where the focus rests on the benefits rather than costs of the job, and positive feelings are experienced when helping someone who has been traumatised (Brady, 2017; Hunsaker et al., 2015).”
BackgroundCompassion fatigue, burnout, and compassion satisfaction among Colorado child protection workers
Conrad, D., & Kellar-Guenther, Y. (2006) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2006.03.009 · Cited by 517 · cited 1×
“This can act as a buffer against compassion fatigue, STS and burnout (Brady, 2017; Conrad & Kellar-Guenther, 2006).”
Background
Research works printed but not linked: 5
- Drootin, A. (2021). "Community guidelines": The legal implications of workplace conditions for internet content moderators. Fordham Law Review, 90(3), 1197-1244. https://ir.lawnet.fordham.edu/flr/vol90/iss3/4
- Facebook. (2022b). Meta reports first quarter 2022 results. https://investor.fb.com/investor-news/press-release-details/2022/Meta-Reports-First-Quarter-2022-Results/default.aspx
- Lo, C. (2018). When all you have is a Banhammer: The social and communicative work of volunteer moderators [Doctoral thesis, Massachusetts Institute of Technology, Cambridge, MA]. https://cmsw.mit.edu/wp/wp-content/uploads/2018/05/Claudia-Lo-When-All-You-Have-Is-a-Banhammer.pdf
- Ritchie, J., & Lewis, J. (2003). Qualitative research practice. Sage Publications.
- Steiger, M. (2020). Building a resilient workforce: Programming for commercial content moderation staff [Doctoral dissertation, St. Mary's University]. https://commons.stmarytx.edu/dissertations/46
Cited by
Content Moderator Mental Health, Secondary Trauma, and Well-being: A Cross-Sectional Study
Spence, R., Bifulco, A., Bradbury, P., Martellozzo, E., & DeMarco, J. (2024) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2023.0298 · Cited by 29
“16,19 Yet, little is currently known about the impacts of the role or what aspects are supportive.”
Self-citationSecuring Federated Platforms: Collective Risks and Responses
Roth, Y., & Lai, S. (2024) · Journal of Online Trust and Safety · doi:10.54501/jots.v2i2.171 · Cited by 31
Artificial Intelligence in Science and Society: The Vision of USERN
Dorigo, T., Brown, G. D., Casonato, C., Cerdà, A., Ciarrochi, J., Lio, M. D., D’Souza, N., Gauger, N. R., Hayes, S. C., Hofmann, S. G., et al. (2025) · IEEE Access · doi:10.1109/access.2025.3529357 · Cited by 27
Critique of the standard model of moral injury
Acampora, C. D., Munch‐Jurišić, D. M., Culbreth, A., Denne, S., & Smith, J. H. (2024) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2024.101107 · Cited by 19
Las otras geopolíticas de la inteligencia artificial
Colomina, C., & Galceran-Vercher, M. (2024) · Revista CIDOB d Afers Internacionals · doi:10.24241/rcai.2024.138.3.27 · Cited by 17
Metadata
- Authors
- Spence, R., Bifulco, A., Bradbury, P., Martellozzo, E., & DeMarco, J.
- Affiliations
- Middlesex University London (GB)
- Venue
- Cyberpsychology: Journal of Psychosocial Research on Cyberspace
- Publisher
- Masaryk University Press
- Published
- 2023-09-18
- Volume
- 17
- Issue
- 4
- ISSN
- 1802-7962 (ISSN-L)
- OpenAlex
- W4386834659
- Cited by
- 48
- References
- 50
- Citations by year
- 2026: 20 · 2025: 20 · 2024: 7 · 2023: 1
- FWCI
- 13.99
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Cyberpsychology Journal of Psychosocial Research on Cyberspace (publishedVersion, cc-by-sa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Posttraumatic Stress Disorder Research
- Social Sciences › Psychology › Social Psychology › Stress and Burnout Research
- Social Sciences › Sociology and Political Science › Emotional Labor in Professions
- Keywords
- content moderation, psychological impact, child pornography, secondary traumatic stress, post-traumatic stress, vicarious trauma, compassion fatigue, burnout, trauma-informed care, psychoeducation, online content removal, occupational stress
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The psychological impacts of content moderation on content moderators: A qualitative study. https://app.cochat.ai/papers/10.5817/cp2023-4-8
- The paper
- Spence, R., Bifulco, A., Bradbury, P., Martellozzo, E., & DeMarco, J. (2023). The psychological impacts of content moderation on content moderators: A qualitative study. Cyberpsychology: Journal of Psychosocial Research on Cyberspace. https://doi.org/10.5817/cp2023-4-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.