Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index; 5 of the 38 sources its claims cite were checked for support.

Impacts of school shooter drills on the psychological well-being of American K-12 school communities: a social media study

Open access
ElSherief, Mai, Saha, Koustuv, Gupta, Pranshu, Mishra, Shrija, Seybolt, Jordyn, Xie, Jiajia, O’Toole, Megan, Burd-Sharps, Sarah, De Choudhury, Munmun · 2021 · Humanities and Social Sciences Communications

Abstract

The toll from gun violence in American K-12 schools has escalated over the past 20 years. School administrators face pressure to prepare for possible active shootings, and often do so through drills, which can range from general lockdowns to simulations, involving masked “shooters” and simulated gunfire, and many variations in between. However, the broad and lasting impact of these drills on the well-being of school communities is poorly understood. To that end, this article applies machine learning and interrupted time series analysis to 54 million social media posts, both pre- and post-drills in 114 schools spanning 33 states. Drill dates and locations were identified via a survey, then posts were captured by geo-location, school social media following, and/or school social media group membership. Results indicate that anxiety, stress, and depression increased by 39–42% following the drills, but this was accompanied by increases in civic engagement (10–106%). This research, paired with the lack of strong evidence that drills save lives, suggests that proactive school safety strategies may be both more effective, and less detrimental to mental health, than drills.

Overview

CoChat Summary

TL;DR

School shooter drills were associated with sustained increases in anxiety/stress and depression markers in social media posts from K-12 school communities, alongside increases in community/civic engagement. The authors argue that current unregulated drills may harm mental health and that proactive safety strategies may be preferable.

Key findings

  • Anxiety/stress and depression expressions rose after drills: mean proportion of stress/anxiety posts was 0.281 before vs. 0.399 after (LC = 42.1% increase; t = 19.1, p < 10⁻¹⁵), and depression was 0.125 vs. 0.173 (LC = 38.7%; t = 10.13, p < 10⁻¹⁵), with effects sustained at least 90 days.
  • Community/civic outcomes also increased: the abstract reports civic engagement increases of 10–106%; results show LIWC increases in perception (10.78%), article (16.3%), first-person plural pronouns (47.79%), second-person pronouns (10.21%), friends (33.7%), and work (106.18%).
  • Robustness checks supported attribution to drills: excluding mass-shooting overlaps still yielded LC increases of 43.12% for stress/anxiety and 39.58% for depression (temporal exclusion) and 30% and 29.6% (spatial exclusion); ARIMA counterfactual predicted 26.3% and 50% lower stress/anxiety and depression than actual; actual control time series changed only −0.375–2.5%.
  • Subgroup analyses found high school communities and teachers showed the largest changes: ↑24.3–55.1% for anxiety/stress and depression and ↑5.9–27.2% for LIWC categories (p < 0.001).

Methods

  • Observational natural-experiment design using social media, with interrupted time series (ITS) analysis to estimate immediate change (IC) and longer-term change (LC) around drill dates, plus four robustness checks: temporal/spatial exclusion of mass shootings, ARIMA counterfactual forecasting, synthetic-control permutation tests, and an actual Twitter control.
  • Data: a survey fielded November 2019–February 2020 from 153 volunteers identified drill dates/locations; final analyses covered 114 schools in 33 states and 54 million public Twitter/Reddit posts (27.8M treatment + ~27M control) spanning 90 days before and after each drill, January 2018–March 2020; focus groups included 34 stakeholders (21 parents, 11 teachers, 2 students) in 6 groups.
  • Analysis: SVM classifiers for stress/anxiety and depression, LIWC psycholinguistic categories, SAGE n-gram saliency, Welch t-tests with Benjamini-Krieger-Yekutieli FDR correction, and inductive qualitative coding of focus-group transcripts.

Limitations

  • Stated: classifiers are not clinical diagnostic tools; true causality cannot be inferred; the study covers only a 3-month post-drill window; social media data carry self-selection bias; Twitter excludes users under 13; the survey did not collect drill type or implementation; focus groups cannot provide the same quantitative validity as large-scale data.
  • Evident from the text: drill dates came from a self-reported survey of volunteers in a grassroots gun violence prevention organization, so the sample may not represent all schools or communities; social media data miss non-users and younger students; and the study does not directly measure individual drill exposure or participation.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1057/s41599-021-00993-6

Cites

65 of 65 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

4 Valid · 2 Not valid · 27 Not checked · 84 Own results and interpretations

39 more claims

Create a free account to see all 117 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 51
  • Probably not a substantial claim. 31
  • The quote only partly states this claim. 3

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 60 references

Research works printed but not linked: 7

  1. Beaton RDMurphy SA,(1995) Working with people in crisis: Research implications. In: Compassion fatigue: coping with secondary traumatic stress disorder in those who treat the traumatized. vol. 1. Brunner/Routledge, pp. 1–51
  2. Eisenstein J, Ahmed A, Xing EP (2011) Sparse additive generative models of text. In Proceedings of the 28th International Conference on Machine Learning, ICML, pp. 1041–1048
  3. Farrell A (2005) Ethical research with children. McGraw-Hill Education (UK)
  4. Gubiotti M (2015) Opposing viewpoints: preparing students, teachers, and the community for school shootings: Saving lives with active shooter simulations. Child Legal Right J 35(3):254
  5. Hurford DP, Lindskog R, Cole A, Jackson R, Thomasson S, Wade A (2010) The role of school climate in school violence: a validity study of a web-based school violence survey. J Educ Res Policy Stud 10(1):51–77
  6. Rygg L (2015) School shooting simulations: At what point does preparation become more harmful than helpful. Child Legal Right J 35:215
  7. Terrades V, Khan SK (2018) Will it ever end: Preventing mass shootings in florida & the us. Suffolk Univ Law Rev 51:505

Cited by

See all 44

Metadata

Authors
ElSherief, M., Saha, K., Gupta, P., Mishra, S., Seybolt, J., Xie, J., O’Toole, M., Burd-Sharps, S., & De Choudhury, M.
Affiliations
  • University of California San Diego (US)
  • Microsoft Research Montréal (Canada) (CA)
  • Georgia Institute of Technology (US)
Venue
Humanities and Social Sciences Communications
Published
2021-12-08
Volume
8
Issue
1
ISSN
  • 2055-1045 (ISSN-L)
  • 2662-9992
OpenAlex
W4200177403
Cited by
43
References
60
Citations by year
2026: 5 · 2025: 11 · 2024: 12 · 2023: 10 · 2022: 5
FWCI
3.72
Type
journal article
Language
en
Open access
Licence
Locations
  • Humanities and Social Sciences Communications (publishedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Georgia Institute of Technology
Topics
  • Social Sciences › Health › Gun Ownership and Violence Research
  • Social Sciences › Psychology › Clinical Psychology › Posttraumatic Stress Disorder Research
  • Social Sciences › Safety Research › Education, Safety, and Science Studies
Keywords
school safety, psychological well-being, anxiety, stress, depression, citizen participation, school community, social media posts, K-12 schools, school lockdown

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Impacts of school shooter drills on the psychological well-being of American K-12 school communities: a social media study. https://app.cochat.ai/papers/10.1057/s41599-021-00993-6
The paper
ElSherief, M., Saha, K., Gupta, P., Mishra, S., Seybolt, J., Xie, J., O’Toole, M., Burd-Sharps, S., & De Choudhury, M. (2021). Impacts of school shooter drills on the psychological well-being of American K-12 school communities: a social media study. Humanities and Social Sciences Communications. https://doi.org/10.1057/s41599-021-00993-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.