Content Moderator Mental Health and Associations with Coping Styles: Replication and Extension of Previous Studies
Open accessThe DOI matches its Crossref record; 49 of the 51 references it cites were found in a registry or an index; 6 of the 43 sources its claims cite were checked for support.
Abstract
There is an increasing evidence base that demonstrates the psychological toll of content moderation on the employees that perform this crucial task. Nevertheless, content moderators (CMs) can be based worldwide and have varying working conditions. Therefore, there is a need for studies to be replicated to ensure that the results are robust. The current study used a large sample of commercial CMs employed by an international company to replicate the results from two previous studies that relied on an anonymous online survey. The results pertaining to mental health, wellbeing, and the effectiveness of wellbeing services for this population were mostly replicated. Over a quarter of CMs demonstrated moderate to severe psychological distress, and a quarter were experiencing low wellbeing. Further, the results suggest the potential utility for interventions that increase problem-focussed problem solving, as well as a need for the efficacy of wellbeing services to be evaluated more broadly.
Overview
CoChat Summary
## TL;DR
This study replicated prior findings in 160 commercial content moderators from an international company and found substantial mental health burden: over a quarter had moderate-to-severe psychological distress, and 28.8% had low wellbeing. Exposure frequency and coping style mattered, while wellbeing service use was only clearly linked to lower secondary trauma, not to distress or wellbeing.
## Key findings
- Among 160 moderators, 24.4% scored in the moderate-to-severe range on the CORE-10, and 33.75% scored 13 or greater, suggesting symptoms associated with clinical depression.
- 28.8% scored in the low wellbeing range on the SWEMWBS, and 13.5% scored in the high wellbeing range.
- Daily exposure to distressing content was associated with significantly greater psychological distress and secondary trauma than weekly/monthly or less frequent exposure: psychological distress, F(2, 131) = 6.01, p = 0.003; secondary trauma, F(2, 131) = 8.72, p < 0.001.
- Problem-focussed coping was associated with lower psychological distress, lower secondary trauma, and greater wellbeing; avoidant coping showed the opposite pattern. Emotion-focussed coping was associated with lower distress and trauma and greater wellbeing in the reported MGLM results.
- Using wellbeing services was associated with significantly lower secondary trauma, but not with psychological distress or wellbeing; concerns about confidentiality were associated with higher distress and trauma and lower wellbeing.
## Methods
- Cross-sectional anonymous online survey of 160 content moderators employed by an international company in the entertainment industry; the company employs approximately 200 moderators, so the response rate was 80%.
- Measures included demographic/work questions, the CORE-10, SWEMWBS, Secondary and Vicarious Trauma Scale, and Brief-COPE.
- Main analyses were descriptive statistics and multiple multivariate general linear models (MGLMs), adjusting for sex, location, duration in role, and age where relevant.
## Limitations
- The authors state the study was cross-sectional, so it cannot show how experiences and symptoms change over time; they call for longitudinal research.
- The authors note they are replicating their own work with data they cannot publicly share, so other researchers cannot yet independently reproduce the findings with this dataset.
- Evident from the text: the sample comes from a single international company, so generalizability beyond that company is limited, even though the authors argue the 80% response rate supports representativeness within the company.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
6 Valid · 0 Not valid · 29 Not checked · 90 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“For one, the population to which the survey was distributed cannot be described; this means that the respondents may be unrepresentative in some meaningful way (Andrade, 2020).”
§ Content Moderator Mental Health and Associations with Coping Styles: Replication and Extension of Previous Studies > 1. Introduction
What the sources say
- Supportedcites Andrade, 2020 source
In “Online Surveys,” Andrade says the population that could have accessed and responded to a widely distributed survey cannot be identified or described, and that biased respondents may be overrepresented. This supports the citing sentence’s concern that such respondents may be unrepresentative. (LLM, conf=0.94)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Resilience-building initiatives, such as Acceptance and Commitment Therapy, have shown promise in trauma-exposed professions by enhancing emotional regulation and distress tolerance (Hayes et al., 2006).”
§ Content Moderator Mental Health and Associations with Coping Styles: Replication and Extension of Previous Studies > 4. Discussion
What the sources say
- Partly supportedcites Hayes et al., 2006 sourceExperimental — accuracy not yet measured
The Mediational studies section (pp. 17–18) reports promising ACT outcomes for workers and reduced burnout among substance-abuse counselors. The Experimental psychopathology and ACT component studies section (p. 14) also reports increased pain tolerance, but in other participants. These passages do not establish that ACT improved emotional regulation and distress tolerance in trauma-exposed professions specifically. (LLM, conf=0.87)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Nonetheless, mental health is not merely the absence of mental illness, and the two are related but distinct (Westerhof & Keyes, 2010); therefore, wellbeing services may also help to improve mental health without reducing symptoms.”
§ Content Moderator Mental Health and Associations with Coping Styles: Replication and Extension of Previous Studies > 4. Discussion
What the sources say
- Supportedcites Westerhof & Keyes, 2010 source
The citation is attached to the statement before the semicolon: mental health is not merely the absence of mental illness, and the two are related but distinct. The Introduction’s “Two Continua Model of Mental Illness and Health” section states both points. The subsequent suggestion about wellbeing services is the citing authors’ inference, not a finding attributed to this source. (LLM, conf=0.92)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The MGLM showed that there was a dose–response effect between the frequency of exposure and psychological distress (F(2, 131) = 6.01, p = 0.003) and secondary trauma (F(2, 131) = 8.72, p < 0.001) but not wellbeing (F(2, 131) = 1.19, n.s.) (see Figure 1).”
§ Content Moderator Mental Health and Associations with Coping Styles: Replication and Extension of Previous Studies > 3. Results The majority of the participants were male (63.75%) and located in Asia (62.50%). The moderators were aged between 19 and 48 (mean = 29.68, SD = 5.10) and had most commonly been in the role between 6 months and 2 years (mean = 20.71 months, SD = 19.52). This is compared to the respondents in Spence et al. (2024), where the minority of the participants were male (46.9%), the average age was 34.3 years (SD = 54.52), and the average duration in the role was 51.76 months (SD = 54.52). The analysis demonstrated that the current sample contained significantly more males (χ2 = 13.98, p < 0.01), the participants were significantly younger (F = 30.60, p < 0.001), and the average time in the role was shorter (F = 12.02, p < 0.001). The majority of previous participants were based in Europe (45.1%); therefore, the sample location was also significantly different (χ2 = 180.84, p < 0.001) (see Table 1). The majority of the participants (51.3%) scored in the low-to-mild range of the CORE-10, with a further 24.4% scoring in the healthy range and almost a quarter (24.4%) scoring in the moderate-to-severe range. There were 54 participants (33.75%) who scored 13 or greater on the CORE-10, suggesting that a third of the sample had symptoms associated with clinical levels of depression. Over a quarter of the participants (28.8%) scored in the low wellbeing range and 13.5% scored in the high range. Psychological distress demonstrated a significant negative relationship with wellbeing (r = −0.59, p < 0.001) and a significant positive relationship with secondary trauma (r = 0.77, p < 0.001). Wellbeing was negatively correlated with secondary trauma (r = −0.62, p < 0.001). > 3.1. Exposure to Content and Mental Health
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The MGLM showed that there was a dose–response effect between the frequency of exposure and psychological distress (F(2, 131) = 6.01, p = 0.003) and secondary trauma (F(2, 131) = 8.72, p < 0.001) but not wellbeing (F(2, 131) = 1.19, n.s.) (see Figure 1).”
§ Content Moderator Mental Health and Associations with Coping Styles: Replication and Extension of Previous Studies > 3. Results The majority of the participants were male (63.75%) and located in Asia (62.50%). The moderators were aged between 19 and 48 (mean = 29.68, SD = 5.10) and had most commonly been in the role between 6 months and 2 years (mean = 20.71 months, SD = 19.52). This is compared to the respondents in Spence et al. (2024), where the minority of the participants were male (46.9%), the average age was 34.3 years (SD = 54.52), and the average duration in the role was 51.76 months (SD = 54.52). The analysis demonstrated that the current sample contained significantly more males (χ2 = 13.98, p < 0.01), the participants were significantly younger (F = 30.60, p < 0.001), and the average time in the role was shorter (F = 12.02, p < 0.001). The majority of previous participants were based in Europe (45.1%); therefore, the sample location was also significantly different (χ2 = 180.84, p < 0.001) (see Table 1). The majority of the participants (51.3%) scored in the low-to-mild range of the CORE-10, with a further 24.4% scoring in the healthy range and almost a quarter (24.4%) scoring in the moderate-to-severe range. There were 54 participants (33.75%) who scored 13 or greater on the CORE-10, suggesting that a third of the sample had symptoms associated with clinical levels of depression. Over a quarter of the participants (28.8%) scored in the low wellbeing range and 13.5% scored in the high range. Psychological distress demonstrated a significant negative relationship with wellbeing (r = −0.59, p < 0.001) and a significant positive relationship with secondary trauma (r = 0.77, p < 0.001). Wellbeing was negatively correlated with secondary trauma (r = −0.62, p < 0.001). > 3.1. Exposure to Content and Mental Health
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
66 more claims
Create a free account to see all 125 claims and to verify the 4 references still open.
- Probably not a substantial claim. 38
- It may state two separate claims as one. 30
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“In comparison with previous studies on content moderators wherein psychological distress was at clinically moderate to high levels (e.g., 47, 48), in the current sample, lower scores of secondary traumatic stress and burnout for instance across time were observed.”
From Longitudinal comparison of psychological outcomes of professional content moderators engaged in resilience training program (2025) · cites this paper as [48]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These surveys highlight the potential detrimental mental health impact of content moderation; however, these studies only screened for general mental health problems (10 items) and wellbeing (7 items) and did not use specific or commonly used psychiatric diagnostic self-report or interview measures.”
From I've Seen Enough: Measuring the Toll of Content Moderation on Mental Health (2025) · cites this paper as Spence & DeMarco, 2025
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In a recent cross-sectional online survey of content moderator mental health ( N = 167), 53% of those self-identifying as content moderators reported a clinical level of general distress (Spence et al., 2024); with findings replicated in another study by the same researchers, this time specifically recruiting from a technology company pool of content moderators ( N = 160; Spence & DeMarco, 2025).”
From I've Seen Enough: Measuring the Toll of Content Moderation on Mental Health (2025) · cites this paper as Spence & DeMarco, 2025
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- ConsistentF(2, 131) = 6.01reported p = .003 · recomputed p = .003
“F(2, 131) = 6.01, p = .003”
- ConsistentF(2, 131) = 8.72reported p < .001 · recomputed p < .001
“F(2, 131) = 8.72, p < .001”
- ConsistentF(2, 131) = 1.19reported n.s. · recomputed p = .307
“F(2, 131) = 1.19, n.s.”
- ConsistentF(1, 152) = 3.37reported n.s. · recomputed p = .068
“F(1, 152) = 3.37, n.s.”
- ConsistentF(1, 152) = 1.29reported n.s. · recomputed p = .258
“F(1, 152) = 1.29, n.s.”
16 more recomputed tests
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Citations
Cites
The Job Demands‐Resources model: state of the art
Bakker, A. B., & Demerouti, E. (2007) · Journal of Managerial Psychology · doi:10.1108/02683940710733115 · Cited by 12,996
You want to measure coping but your protocol’ too long: Consider the brief cope
Carver, C. S. (1997) · International Journal of Behavioral Medicine · doi:10.1207/s15327558ijbm0401_6 · Cited by 7,361 · cited 1×
“Coping Orientation to Problems Experienced Inventory (Brief-COPE; Carver, 1997) The Brief-COPE is a 28-item self-report measure of effective and ineffective coping strategies.”
Acceptance and commitment therapy: model, processes and outcomes
Hayes, S. C., Luoma, J. B., Bond, F. W., Masuda, A., & Lillis, J. (2006) · Behaviour Research and Therapy · doi:10.1016/j.brat.2005.06.006 · Cited by 6,587 · cited 1×
“Resilience-building initiatives, such as Acceptance and Commitment Therapy, have shown promise in trauma-exposed professions by enhancing emotional regulation and distress tolerance (Hayes et al., 2006).”
The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): development and UK validation
Tennant, R., Hiller, L., Fishwick, R., Platt, S., Joseph, S., Weich, S., Parkinson, J., Secker, J., & Stewart-Brown, S. (2007) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-5-63 · Cited by 5,031 · cited 2×
“Short Warwick–Edinburgh Mental Wellbeing Scale (SWEMWBS; Tennant et al., 2007) The SWEMWS is a seven-item self-report measure that asks about thoughts and feelings over the previous two weeks.”
Experimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687
Transactional theory and research on emotions and coping
Lazarus, R. S., & Folkman, S. (1987) · European Journal of Personality · doi:10.1002/per.2410010304 · Cited by 3,053
Wright, K. B. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2005.tb00259.x · Cited by 2,550 · cited 1×
“These limitations make it harder to make generalisations from the study findings but can be ameliorated through replication (Wright, 2005).”
Mental Illness and Mental Health: The Two Continua Model Across the Lifespan
Westerhof, G. J., & Keyes, C. L. M. (2010) · Journal of Adult Development · doi:10.1007/s10804-009-9082-y · Cited by 1,345 · cited 1×
“Nonetheless, mental health is not merely the absence of mental illness, and the two are related but distinct (Westerhof & Keyes, 2010); therefore, wellbeing services may also help to improve mental health without reducing symptoms.”
The role of masculinity in men's help-seeking for depression: A systematic review
Seidler, Z. E., Dawes, A. J., Rice, S. M., Oliffe, J. L., & Dhillon, H. M. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.09.002 · Cited by 1,093 · cited 1×
“This study’s participants were younger, had shorter tenure, and were predominantly male—factors that may influence resilience and reporting of distress (Seidler et al., 2019).”
Prevalence of Secondary Traumatic Stress among Social Workers
Bride, B. E. (2007) · Social Work · doi:10.1093/sw/52.1.63 · Cited by 937 · cited 1×
“…as police and social workers that demonstrates that exposure to the suffering of others can result in detrimental mental health outcomes such as secondary traumatic stress, vicarious trauma, depression, and anxiety (e.g., Bride, 2007; Caringi et al., 2017; Foley et al., 2022; Hurrell et al., 2018).”
Gillespie, T. (2019) · doi:10.12987/9780300235029 · Cited by 806
Electronic Survey Methodology: A Case Study in Reaching Hard-to-Involve Internet Users
Andrews, D., Nonnecke, B., & Preece, J. (2003) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1602_04 · Cited by 747 · cited 1×
“For example, it is impossible to track non-response rates (Andrews et al., 2003), and the studies likely suffer from self-selection bias (Thompson et al., 2003).”
Psychology, Science, and Knowledge Construction: Broadening Perspectives from the Replication Crisis
Shrout, P. E., & Rodgers, J. L. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011845 · Cited by 725
The limitations of online surveys
Andrade, C. (2020) · Indian Journal of Psychological Medicine · doi:10.1177/0253717620957496 · Cited by 618 · cited 1×
“For one, the population to which the survey was distributed cannot be described; this means that the respondents may be unrepresentative in some meaningful way (Andrade, 2020).”
Handbook of Multicultural Perspectives on Stress and Coping
(2006) · International and Cultural Psychology · doi:10.1007/b137168 · Cited by 533
Workaholism vs. Work Engagement: the Two Different Predictors of Future Well-being and Performance
Shimazu, A., Schaufeli, W. B., Kamiyama, K., & Kawakami, N. (2015) · International Journal of Behavioral Medicine · doi:10.1007/s12529-014-9410-x · Cited by 422 · cited 1×
“Additionally, workplace mental health policies and management attitudes toward wellbeing differ across regions, potentially affecting engagement with wellbeing services (Hofstede, 2001; Shimazu et al., 2013).”
Barkham, M., Bewick, B., Mullin, T., Gilbody, S., Connell, J., Cahill, J., Mellor-Clark, J., Richards, D., Unsworth, G., & Evans, C. (2013) · Counselling and Psychotherapy Research · doi:10.1080/14733145.2012.729069 · Cited by 413 · cited 2×
“Outcomes in Routine Evaluation (Core-10; Barkham et al., 2013) The CORE-10 assesses psychological distress over the previous week.”
Approach and avoidant coping: Implications for adolescent mental health
Herman-Stabl, M. A., Stemmler, M., & Petersen, A. C. (1995) · Journal of Youth and Adolescence · doi:10.1007/bf01536949 · Cited by 378
Behind the Screen: Content Moderation in the Shadows of Social Media
ROBERTS, S. T. (2019) · Yale University Press · doi:10.2307/j.ctvhrcz0v · Cited by 339
Queirós, C., Passos, F., Bártolo, A., Marques, A. J., da Silva, C. F., & Pereira, A. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00587 · Cited by 330 · cited 1×
“Alongside mental health aspects, workers may also experience burnout (Frieiro Padín et al., 2021; Queirós et al., 2020), as well as increased sickness rates and compassion fatigue (Körlin et al., 2009; Ondrejková & Halamová, 2022).”
Moderator engagement and community development in the age of algorithms
Seering, J., Wang, T., Yoon, J., & Kaufman, G. (2019) · New Media & Society · doi:10.1177/1461444818821316 · Cited by 310
What meta-analyses reveal about the replicability of psychological research.
Stanley, T. D., Carter, E. C., & Doucouliagos, H. (2018) · Psychological Bulletin · doi:10.1037/bul0000169 · Cited by 307
Tackett, J. L., Lilienfeld, S. O., Patrick, C. J., Johnson, S. L., Krueger, R. F., Miller, J. D., Oltmanns, T. F., & Shrout, P. E. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617690042 · Cited by 251
Classification and Its Consequences for Online Harassment: Design Insights from HeartMob
Blackwell, L., Dimond, J., Schoenebeck, S., & Lampe, C. (2017) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3134659 · Cited by 245
The replication crisis in psychology: An overview for theoretical and philosophical psychology.
Wiggins, B. J., & Christopherson, C. D. (2019) · Journal of Theoretical and Philosophical Psychology · doi:10.1037/teo0000137 · Cited by 207
From paper to pixels: Moving personnel surveys to the Web
THOMPSON, L. F., SURFACE, E. A., MARTIN, D. L., & SANDERS, M. G. (2003) · Personnel Psychology · doi:10.1111/j.1744-6570.2003.tb00149.x · Cited by 193 · cited 1×
“For example, it is impossible to track non-response rates (Andrews et al., 2003), and the studies likely suffer from self-selection bias (Thompson et al., 2003).”
Wohn, D. Y. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300390 · Cited by 191
Behind the Screen: Content Moderation in the Shadows of Social Media
Roberts, S. T. (2019) · Yale University Press eBooks · doi:10.12987/9780300245318 · Cited by 176
Ondrejková, N., & Halamová, J. (2022) · Health & Social Care in the Community · doi:10.1111/hsc.13741 · Cited by 93
Secondary traumatic stress and licensed clinical social workers.
Caringi, J. C., Hardiman, E. R., Weldon, P., Fletcher, S., Devlin, M., & Stanick, C. (2017) · Traumatology · doi:10.1037/trm0000061 · Cited by 83 · cited 1×
“…as police and social workers that demonstrates that exposure to the suffering of others can result in detrimental mental health outcomes such as secondary traumatic stress, vicarious trauma, depression, and anxiety (e.g., Bride, 2007; Caringi et al., 2017; Foley et al., 2022; Hurrell et al., 2018).”
Bewick, B. M., Gill, J., Mulhern, B., Barkham, M., & Hill, A. J. (2008) · E-Journal of Applied Psychology · doi:10.7790/ejap.v4i2.120 · Cited by 66 · cited 1×
“Bewick et al. (2008) found Research using the CORE-10 in non-clinical studies is lacking; however, a study by Bewick et al. (2008) found that 17.2% of students scored in the moderate-to-severe range of the CORE-10.”
InfluentialHow does appreciation lead to higher job satisfaction?
Pfister, I. B., Jacobshagen, N., Kälin, W., & Semmer, N. K. (2020) · Journal of Managerial Psychology · doi:10.1108/jmp-12-2018-0555 · Cited by 57 · cited 1×
“This has numerous benefits beyond mental health, including increased job satisfaction and motivation (Pfister et al., 2020; Seitl et al., 2024) and decreased intention to leave (Liu et al., 2024).”
Foley, J., Hassett, A., & Williams, E. P. (2021) · The Police Journal Theory Practice and Principles · doi:10.1177/0032258x21990412 · Cited by 55 · cited 1×
“…as police and social workers that demonstrates that exposure to the suffering of others can result in detrimental mental health outcomes such as secondary traumatic stress, vicarious trauma, depression, and anxiety (e.g., Bride, 2007; Caringi et al., 2017; Foley et al., 2022; Hurrell et al., 2018).”
Prevalence and predictors of secondary trauma in the legal profession: a systematic review
Iversen, S., & Robertson, N. (2021) · Psychiatry Psychology and Law · doi:10.1080/13218719.2020.1855270 · Cited by 53 · cited 1×
“A systematic review by Iversen and Robertson (2021) found there was a high prevalence of secondary trauma in legal professionals who were exposed to clients who have experienced trauma.”
Emotion-Focused Coping Worsens Depressive Feelings and Health Complaints in Cyberbullied Children
Völlink, T., Bolman, C. A. W., Eppingbroek, A., & Dehue, F. (2013) · Journal of Criminology · doi:10.1155/2013/416976 · Cited by 49
Burnout in Health Social Work: an international systematic review (2000–2020)
Frieiro Padín, P., Verde-Diego, C., Arias, T. F., & González-Rodríguez, R. (2021) · European Journal of Social Work · doi:10.1080/13691457.2020.1870215 · Cited by 49
The psychological impacts of content moderation on content moderators: A qualitative study
Spence, R., Bifulco, A., Bradbury, P., Martellozzo, E., & DeMarco, J. (2023) · Cyberpsychology: Journal of Psychosocial Research on Cyberspace · doi:10.5817/cp2023-4-8 · Cited by 48
Self-citationSecondary traumatic stress in police officers investigating childhood sexual abuse
Hurrell, A.-K., Draycott, S., & Andrews, L. (2018) · Policing: An International Journal · doi:10.1108/pijpsm-08-2016-0131 · Cited by 42 · cited 1×
“…as police and social workers that demonstrates that exposure to the suffering of others can result in detrimental mental health outcomes such as secondary traumatic stress, vicarious trauma, depression, and anxiety (e.g., Bride, 2007; Caringi et al., 2017; Foley et al., 2022; Hurrell et al., 2018).”
Fear the Reaper: How content moderation rules are enforced on social media
Common, M. F. (2020) · International Review of Law, Computers & Technology · doi:10.1080/13600869.2020.1733762 · Cited by 38 · cited 1×
“…what can at times be coded nuances to make decisions about the suitability of content (Gillespie, 2018; Roberts, 2019); these decisions often need to be made within approximately 10–30 s (Barrett, 2020; Common, 2020), sometimes thousands of times over any given shift (Barrett, 2020; Newton, 2019).”
Why do volunteer content moderators quit? Burnout, conflict, and harmful behaviors
Schöpke-Gonzalez, A. M., Atreja, S., Shin, H. N., Ahmed, N., & Hemphill, L. (2024) · New Media & Society · doi:10.1177/14614448221138529 · Cited by 37
When all you have is a banhammer : the social and communicative work of Volunteer moderators
Lo, C. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 35
Sickness absence among women and men in the police: A systematic literature review
Körlin, J., Alexanderson, K., & Svedberg, P. (2009) · Scandinavian Journal of Public Health · doi:10.1177/1403494808098508 · Cited by 31
Content Moderator Mental Health, Secondary Trauma, and Well-being: A Cross-Sectional Study
Spence, R., Bifulco, A., Bradbury, P., Martellozzo, E., & DeMarco, J. (2024) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2023.0298 · Cited by 29 · cited 5×
“Whereas Spence et al. (2024) found not understanding the pressure of the role to be associated with higher psychological distress, secondary trauma, and lower wellbeing, there are no significant relationships in the current study.”
InfluentialSelf-citationDirty Data: Content Moderation, Regulatory Outsourcing, and The Cleaners
Parks, L. (2019) · Film Quarterly · doi:10.1525/fq.2019.73.1.11 · Cited by 27
Chang, O. D., Ward, K. P., & Lee, S. J. (2024) · Health & Social Work · doi:10.1093/hsw/hlae018 · Cited by 14 · cited 2×
“This supports prior research showing that active engagement with stressors mitigates negative effects, whereas disengagement or avoidance can exacerbate psychological distress (Chang et al., 2024; Völlink et al., 2013).”
Rosen, D. (2022) · Routledge eBooks · doi:10.4324/9781003171270 · Cited by 13
Content or Context Moderation?: Artisanal, Community-Reliant, and Industrial Approaches
Caplan, R. (2018) · doi:10.69985/owpr3156 · Cited by 4
Daily state of motivation as the effect of appreciation in a diary study
Seitl, M., Manuoglu, E., & Hrbáčková, A. (2024) · Current Issues in Personality Psychology · doi:10.5114/cipp/185714 · Cited by 3 · cited 1×
“This has numerous benefits beyond mental health, including increased job satisfaction and motivation (Pfister et al., 2020; Seitl et al., 2024) and decreased intention to leave (Liu et al., 2024).”
Liu, X., Zhang, Y., & Qian, Z. (2024) · Journal of Education, Humanities and Social Sciences · doi:10.54097/6e77cc72 · Cited by 2 · cited 1×
“This has numerous benefits beyond mental health, including increased job satisfaction and motivation (Pfister et al., 2020; Seitl et al., 2024) and decreased intention to leave (Liu et al., 2024).”
Research works printed but not linked: 4
- Trafimow, D. (in press). Replication and theory development in the social and psychological sciences. Research handbook on the replication crisis, Edward Elgar.
- Hofstede, G. (2001). Culture’s consequences: Comparing values, behaviors, institutions, and organizations across nations, Sage Publications. [2nd ed.].
- Pompili, 2017, The impact of COVID-19 on unemployment: A long-term risk factor for suicide?, Journal of Affective Disorders, 268, 157
- Steiger, M., Bharucha, T. J., Venkatagiri, S., Riedl, M. J., and Lease, M. (, January May). The psychological well-being of content moderators: The emotional labor of commercial moderation and avenues for improving support. CHI Conference on Human Factors in Computing Systems (CHI’21), Yokohama, Japan.
Cited by
Savio, M. T., Balammal, A., de Villa, J. C., Perez, J., Huang, X., & Guevara, R. L. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1666543 · Cited by 1
Liu, Q., Li, S., Qie, Y., & Zhang, W. (2026) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2026.103962 · Cited by 1
Beyond Content Exposure: Systemic Factors Driving Moderators' Mental Health Crisis in Africa
Abdelkadir, N. A., Yang, T., Kapania, S., Malgwi, K. I., Gebrekidan, F. B., Dinika, A.-A. T., Nsoesie, E. O., Miceli, M., & Chancellor, S. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791639
“In Spence and DeMarco [85]’s study, 60.6% of the surveyed moderators who are contracted to an Asian BPO reported the wellness service provided by the BPO made them feel valued/heard.”
InfluentialCommercial content moderation: Trauma exposure on the digital frontline
DeMarco, J. N., Watson, P., & Norman, S. B. (2026) · Journal of Traumatic Stress · doi:10.1002/jts.70087 · Cited by 1
Self-citationdos Santos, M. R., & Xavier, D. M. (2026) · Revista Brasileira de Enfermagem · doi:10.1590/0034-7167-2025-0258pt
Metadata
- Authors
- Spence, R., & DeMarco, J.
- Affiliations
- Middlesex University London (GB)
- Corresponding author
- DeMarco, Jeffrey
- Venue
- Behavioral Sciences
- Publisher
- MDPI AG
- Published
- 2025-04-08
- Volume
- 15
- Issue
- 4
- Pages
- 487
- ISSN
- 2076-328X (ISSN-L)
- PMC
- PMC12024403
- OpenAlex
- W4409242339
- Cited by
- 6
- References
- 51
- Citations by year
- 2026: 5 · 2025: 1
- FWCI
- 6.60
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Behavioral Sciences (publishedVersion, cc-by)
- Preprints.org (acceptedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Middlesex University
- Topics
- Social Sciences › Psychology › Social Psychology › Stress and Burnout Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Workplace Health and Well-being
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Employment and Welfare Studies
- Keywords
- mental health, psychological distress, well-being, coping styles, problem-focused coping, well-being services, replication, online content moderation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.