CoChat

Longitudinal comparison of psychological outcomes of professional content moderators engaged in resilience training program

Open access
Savio, Marlyn Thomas, Balammal, Aruna, de Villa, John Caesar, Perez, Jolguer, Huang, Xieyining, Guevara, Rachel Lutz · 2025 · Frontiers in Psychiatry

The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index; 9 of the 31 sources its claims cite were checked for support.

Abstract

Introduction: Content moderators safeguard the ever-growing online realm by reviewing and filtering out harms, yet are themselves subject to the risk of psychological concerns. Method: This study explored the psychological outcomes of content moderators (N = 311) who were offered a resilience training program called The TaskUs Method 2.0 from baseline to 18 months. Participants completed psychometric screeners for resilience, burnout, secondary traumatic stress, compassion satisfaction, and perceived stress. For the analyses, three timepoints were identified to follow participants across the study period based on their tenure-T0 (0-3 months tenure), T1 (5-10 months), and T2 (11-16 months tenure). Results: Findings from the entire sample (regardless of whether participants had data for all three timepoints) revealed that secondary traumatic stress and perceived stress did not differ significantly between timepoints. However, burnout, compassion satisfaction and resilience showed small yet significant decline between T0 and T2. With a reduced sample of only those having data for all three timepoints, similar trends remained although the rate of change from T0 to T1 did not differ significantly from that of T1 to T2 for any of the variables. Discussion: Results indicated that participants in the program showed no significant increases in secondary traumatic stress, the main target of the program. Across the different psychometrics, effect sizes were small suggesting that content moderators using the program were not at significant risk for increased psychological distress from content moderation during the study duration. These findings provide a valuable foundation for further refining interventions aimed at content moderators. Future studies may consider experimental and multifactorial designs to delve into therapeutic mechanisms and different types of psychological outcomes.

Overview

CoChat Summary

## TL;DR

This longitudinal study followed 311 full-time content moderators in TaskUs Method 2.0 for up to 18 months and found no significant worsening in secondary traumatic stress or perceived stress. Burnout, compassion satisfaction, and resilience changed modestly, with small effect sizes and overall minimal clinical worsening.

## Key findings

  • In the full sample (N = 311), secondary traumatic stress did not differ significantly between timepoints: T1 vs T0, T2 vs T1, and T2 vs T0 were all non-significant.
  • Perceived stress also showed no significant change between T0 and T1 or between T1 and T2; no T0-to-T2 comparison was possible because no participants had data at all three timepoints for this measure.
  • Burnout increased modestly: T1 was higher than T0 by 1.15 points (p < .001, d = .22), and T2 was higher than T0 by 1.16 points (p = .022, d = .20), while T1 vs T2 was not significant.
  • Compassion satisfaction and resilience declined slightly: compassion satisfaction fell by 1.23 points from T0 to T1, 0.93 from T1 to T2, and 1.55 from T0 to T2; resilience fell by 0.65 from T0 to T1 and 0.87 from T0 to T2, with small effect sizes.

## Methods

  • Secondary analysis of repeated psychometric survey data from full-time content moderators employed by TaskUs; surveys were administered at 6-month intervals from May 2022 to November 2023.
  • Sample size was 311 moderators overall; 131 had data at all three tenure-based timepoints (T0: 0–3 months, T1: 5–10 months, T2: 11–16 months).
  • Outcomes assessed were resilience (CD-RISC 10), burnout, secondary traumatic stress, compassion satisfaction (ProQOL), and perceived stress (PSS); analyses used paired t-tests in the full sample and follow-up comparisons among those with complete data at all three timepoints.

## Limitations

  • The paper states there was no randomization, no experimental control group, and no internal comparator, which prevents definitive causal conclusions about the intervention.
  • The paper states the outcomes were self-reported and drawn from a single organization, introducing reporting and desirability bias.
  • The paper states the sample was grouped by tenure rather than calendar time, and that dropout reasons could not be confirmed; evident additional limitation: this raises possible self-selection/survival bias and limits control over seasonality and exposure differences.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3389/fpsyt.2025.1666543

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Study timeline and sample composition.
Figure 1 Study timeline and sample composition.CC BY · PubMed Central
Figure 2 Mean scores of the full sample for compassion satisfaction, secondary traumatic stress, and burnout across the study timepoints.
Figure 2 Mean scores of the full sample for compassion satisfaction, secondary traumatic stress, and burnout across the study timepoints.CC BY · PubMed Central
Figure 3 Mean scores of the full sample for resilience across the study timepoints.
Figure 3 Mean scores of the full sample for resilience across the study timepoints.CC BY · PubMed Central
Figure 4 Mean scores of the full sample for perceived stress across the study timepoints.
Figure 4 Mean scores of the full sample for perceived stress across the study timepoints.CC BY · PubMed Central
Figure 5 Mean scores of the reduced sample for compassion satisfaction, secondary traumatic stress, and burnout across the study timepoints.
Figure 5 Mean scores of the reduced sample for compassion satisfaction, secondary traumatic stress, and burnout across the study timepoints.CC BY · PubMed Central
Figure 6 Mean scores of the reduced sample for resilience across the study timepoints.
Figure 6 Mean scores of the reduced sample for resilience across the study timepoints.CC BY · PubMed Central

Verification

Claims the paper makes

6 Valid · 2 Not valid · 17 Not checked · 91 Own results and interpretations

58 more claims

Create a free account to see all 116 claims and to verify the 4 references still open.

See all claims — free account
  • Probably not a substantial claim. 31
  • It may state two separate claims as one. 35
  • Borderline: one of the tests for a substantial claim is unclear. 1

Create a free account to see these claims.

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Not confirmedt(130) = 0.93reported p = .351 · recomputed p = .354

    “t(130) = .93, p = .351”

  • Consistentt(310) = 0.895reported p = .371 · recomputed p = .371

    “t (310) = .895, p = .371”

  • Consistentt(130) = 1.24reported p = .216 · recomputed p = .217

    “t(130) = 1.24, p = .216”

  • Consistentt(130) = 1.14reported p = .255 · recomputed p = .256

    “t(130) = 1.14, p = .255”

  • Consistentt(109) = 1.39reported p = .169 · recomputed p = .167

    “t(109) = 1.39, p = .169”

5 of 22 · the rest aren’t loaded

17 more recomputed tests

Create a free account to see every test the Stats check recomputed.

See all tests — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Self-check results appear here once an independent check has confirmed them.

Citations

Cites

Show all 32 references

Research works printed but not linked: 9

  1. Cook, 2018, Awe versus aww: the effectiveness of two kinds of positive emotional stimulation on stress reduction for online content moderators, 19
  2. Stamm, 2010, The concise proQOL manual
  3. Shapiro, 2001, Eye movement desensitization and reprocessing: Basic principles, protocols, and procedures
  4. Levine, 2015, Trauma and memory: Brain and body in a search for the living past: A practical guide for understanding and working with traumatic memory
  5. Bowles, 2019, An integrated rapid memory reconsolidation approach: rapid resolution therapy, Neuropsychotherapist, 7, 43
  6. Rivera, 2016, Reconnecting the mind and body: using bodywork to help improve mental health
  7. Kouba, 2017, Group cognitive processing therapy for veterans experiencing trauma:A systematic review
  8. Linehan, 1993, Cognitive-behavioral treatment of borderline personality disorder
  9. Schiraldi, 2017, The resilience workbook essential skills to recover from stress, trauma, and adversity

Cited by

See all 1

Metadata

Authors
Savio, M. T., Balammal, A., de Villa, J. C., Perez, J., Huang, X., & Guevara, R. L.
Corresponding author
Balammal, Aruna
Venue
Frontiers in Psychiatry
Published
2025-12-04
Volume
16
Pages
1666543-1666543
ISSN
1664-0640 (ISSN-L)
OpenAlex
W4416976801
Cited by
1
References
31
Citations by year
2026: 1
FWCI
1.10
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Psychiatry (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Psychology › Social Psychology › Stress and Burnout Research
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Occupational Health and Burnout
  • Social Sciences › Psychology › Clinical Psychology › Resilience and Mental Health
Keywords
resilience training, burnout, secondary traumatic stress, compassion satisfaction, perceived stress, psychological distress, online content moderation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Longitudinal comparison of psychological outcomes of professional content moderators engaged in resilience training program. https://app.cochat.ai/papers/10.3389/fpsyt.2025.1666543
The paper
Savio, M. T., Balammal, A., de Villa, J. C., Perez, J., Huang, X., & Guevara, R. L. (2025). Longitudinal comparison of psychological outcomes of professional content moderators engaged in resilience training program. Frontiers in Psychiatry. https://doi.org/10.3389/fpsyt.2025.1666543

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.