The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
The Effect of School-Wide Positive Behavior Interventions and Supports on Disciplinary Exclusions: A Conceptual Replication
Abstract
Disciplinary exclusions, particularly out-of-school suspension and expulsions, are a pressing concern for schools, as research demonstrates that they are associated with myriad deleterious outcomes such as increased risk for poor academic achievement, school dropout, and contact with juvenile justice. Research suggests that School-Wide Positive Behavior Interventions and Supports (SWPBIS), a prevention and intervention framework for addressing school-based problem behavior, can have a significant and meaningful impact on reducing the likelihood of student suspensions and expulsions. In this study, we conceptually replicated a series of previous studies conducted in other states and examined the effect of universal SWPBIS on disciplinary exclusions in California. Using propensity score matching, we examine differences in suspension and expulsion rates for 98 schools implementing universal SWPBIS with fidelity and 98 comparison schools not implementing SWPBIS. Results suggest that schools implementing SWPBIS with fidelity have significantly fewer suspensions. No effects were found for expulsions. Implications and recommendations for future research are discussed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
For the low risk of bias studies (Barrett and Harris 2018; Gage et al. 2019), the low risk primarily comes from the use of matching and difference-in-differences.
“From the ‘low’ RoB studies (Barrett and Harris 2018; Gage et al. 2019), this primarily comes from the use of matching and difference‐in‐differences”
From School‐Based Interventions for Reducing Disciplinary School Exclusion. An Updated Systematic Review (2025) · cites this paper as Gage et al. 2019
Citations
Cites
MatchIt : Nonparametric Preprocessing for Parametric Causal Inference
Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2011) · Journal of Statistical Software · doi:10.18637/jss.v042.i08 · Cited by 4,385
Principled missing data methods for researchers
Dong, Y., & Peng, C.-Y. J. (2013) · SpringerPlus · doi:10.1186/2193-1801-2-222 · Cited by 2,208
Flagged first, then by citations
Research works printed but not linked: 35
- American Academy of Pediatrics. (2013). Policy statement: Out-of-school suspension and expulsion. Pediatrics, 131, e1000–e1007. https://doi.org/10.1542/peds.2012-3932 · DOI
- Anderson K. P., Ritter G. W., Zamarro G. (2019). Understanding a vicious cycle: The relationship between student discipline and student academic outcomes. Educational Researcher, 48(5), 251–262. https://doi.org/10.3102/0013189X19848720 · DOI
- Azur M. J., Stuart E. A., Frangakis C., Leaf P. J. (2011). Multiple imputation by chained equations: What is it and how does it work? International Journal of Methods in Psychiatric Research, 20, 40–49. https://doi.org/10.1002/mpr.329 · DOI · Paper page
- 10.1002/9780470743386 · DOI · Paper page
- Bradshaw C. P., Koth C. W., Bevans K. B., Ialongo N., Leaf P. J. (2008). The impact of school-wide Positive Behavioral Interventions and Supports (PBIS) on the organizational health of elementary schools. School Psychology Quarterly, 23, 462–473. https://doi.org/10.1037/a0012883 · DOI
- Bradshaw C. P., Waasdorp T. E., Leaf P. J. (2012). Effects of school-wide positive behavioral interventions and supports on child behavior problems. Pediatrics, 130, e1136–e1145. https://doi.org/10.1001/archpediatrics.2011.755 · DOI
- Chin J. K., Dowdy E., Jimerson S. R., Rime W. J. (2012). Alternatives to suspensions: Rationale and recommendations. Journal of School Violence, 11, 156–173. https://doi.org/doi.org/10.1080/15388220.2012.652912 · DOI
- Cohen J., 1988, Statistical power analysis for the behavioral sciences
- Coyne M. D., Cook B. G., Therrien W. J. (2016). Recommendations for replication research in special education: A framework of systematic, conceptual replications. Remedial and Special Education, 37, 244–253. https://doi.org/10.1177/0741932516648463 · DOI
- Crone D. A., 2010, Responding to problem behavior in schools: The behavior education program
- Fortson K., 2012, Using an experimental evaluation of charter schools to test whether nonexperimental comparison group methods can replicate experimental impact estimates
- Gage N. A., Grasley-Boy N., George H. P., Childs K., Kincaid D. (2019). A quasi-experimental design analysis of the effects of school-wide positive behavior interventions and supports on discipline in Florida. Journal of Positive Behavior Interventions, 21, 50–61. https://doi.org/10.1177/1098300718768208 · DOI
- Gage N. A., Lee A., Grasley-Boy N., George H. P. (2018). The impact of school-wide positive behavior interventions and supports on school suspensions: A statewide quasi-experimental analysis. Journal of Positive Behavior Interventions, 20, 217–226. https://doi.org/10.1177/1098300718768204 · DOI
- Gage N. A., Leite W., Childs K., Kincaid D. (2017). Average treatment effect of school-wide positive behavioral interventions and supports on school-level academic achievement in Florida. Journal of Positive Behavior Interventions, 19, 158–167. https://doi.org/10.1177/1098300717693556 · DOI
- 10.1353/etc.2018.0029 · DOI
- Gage N. A., Whitford D. K., Katsiyannis A. (2018). A review of schoolwide positive behavior interventions and supports as a framework for reducing disciplinary exclusions. The Journal of Special Education, 52, 142–151. https://doi.org/10.1177/0022466918767847 · DOI
- Grasley-Boy N., Gage N. A., Lombardo M. (2019). Effects of SWPBIS on disciplinary exclusions for students with and without disabilities. Exceptional Children, 86, 25–39. https://doi.org/10.1177/0014402919854196 · DOI
- 10.4135/9781071802854 · DOI
- Losen D. J., 2013, Out of school and off track: The overuse of suspensions in American middle and high schools
- McIntosh K., Massar M. M., Algozzine R. F., George H. P., Horner R. H., Lewis T. J., Swain-Bradway J. (2017). Technical adequacy of the SWPBIS Tiered Fidelity Inventory. Journal of Positive Behavior Interventions, 19, 3–13. https://doi.org/10.1177/1098300716637193 · DOI
- Mercer S. H., McIntosh K., Hoselton R. (2017). Comparability of fidelity measures for assessing tier 1 school-wide positive behavioral interventions and supports. Journal of Positive Behavior Interventions, 19, 195–204. https://doi.org/10.1177/1098300717693384 · DOI
- Mitchell B. S., Hatton H., Lewis T. J. (2018). An examination of the evidence-base of school-wide positive behavior interventions and supports through two quality appraisal processes. Journal of Positive Behavior Interventions, 20, 239–250. https://doi.org/1098300718768217 · DOI
- Noltemeyer A. L., Ward R. M., McLoughlin C. (2015). Relationship between school suspension and student outcomes: A meta-analysis. School Psychology Review, 44, 224–240. https://doi.org/10.17105/spr-14-0008.1 · DOI
- Pas E. T., Ryoo J. H., Musci R. J., Bradshaw C. P. (2019). A state-wide quasi-experimental effectiveness study of the scale-up of school-wide positive behavioral interventions and supports. Journal of School Psychology, 73, 41–55. https://doi.org/10.1016/j.jsp.2019.03.001 · DOI
- Raghunathan T. E., 2001, Survey Methodology, 27, 85
- Raudenbush S. W., 2002, Hierarchical linear models: Applications and data analysis methods, 1
- 10.1093/biomet/70.1.41 · DOI · Paper page
- Rumberger R. W., 2016, The high cost of harsh discipline and its disparate impact
- Ryoo J. H., Hong S., Bart W. M., Shin J., Bradshaw C. P. (2018). Investigating the effect of school-wide positive behavioral interventions and supports on student learning and behavioral problems in elementary and middle schools. Psychology in the Schools, 55, 629–643. https://doi.org/10.1002/pits.22134 · DOI
- Shadish W. R., 2002, Experimental and quasi-experimental designs for generalized causal inference
- Stuart E. A., Azur M., Frangakis C., Leaf P. (2009). Multiple imputation with large data sets: A case study of the children’s mental health initiative. American Journal of Epidemiology, 169, 1133–1139. https://doi.org/10.1093/aje/kwp026 · DOI
- Sugai G., 2005, School-wide Evaluation Tool, v. 2.1
- Sullivan A. L., Van Norman E. R., Klingbeil D. A. (2014). Exclusionary discipline of students with disabilities: Student and school characteristics predicting suspension. Remedial and Special Education, 35, 199–210. https://doi.org/10.1177/0741932513519825 · DOI
- van Buuren S., Groothuis-Oudshoorn K. (2011). mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45, 1–67. http://www.jstatsoft.org/v45/i03/ · DOI · Paper page
- Walker H. M., Seeley J. R., Small J., Severson H. H., Graham B. A., Feil E. G. Forness S. R. (2009). A randomized controlled trial of the first step to success early intervention: Demonstration of program efficacy outcomes in a diverse, urban school district. Journal of Emotional and Behavioral Disorders, 17, 197–212. https://doi.org/10.1177/1063426609341645 · DOI
Cited by
Sorted by citations
Lee, A., & Gage, N. A. (2020) · Psychology in the Schools · doi:10.1002/pits.22336 · Cited by 163
Self-citationRodriguez, L. A., & Welsh, R. O. (2022) · AERA Open · doi:10.1177/23328584221083669 · Cited by 47
School‐Based Interventions for Reducing Disciplinary School Exclusion. An Updated Systematic Review
Valdebenito, S., Gaffney, H., Arosemena-Burbano, M. J., Hitchcock, S., Jolliffe, D., & Sutherland, A. (2025) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.1002/cl2.70063 · Cited by 8
Metadata
- Authors
- Gage, N. A., Grasley-Boy, N., Lombardo, M., & Anderson, L.
- Affiliations
- University of Florida (US)
- University of Florida, Gainesville, USA
- Placer County Office of Education, Auburn, CA, USA
- Corresponding author
- Gage, Nicholas A.
- Venue
- Behavioral Disorders
- Publisher
- SAGE Publications
- Published
- 2019-12-26
- Volume
- 46
- Issue
- 1
- Pages
- 42-53
- ISSN
- 0198-7429 (ISSN-L)
- 2163-5307
- OpenAlex
- W2998072911
- Cited by
- 26
- References
- 2
- Citations by year
- 2026: 1 · 2025: 7 · 2024: 6 · 2023: 4 · 2022: 4 · 2021: 3 · 2020: 1
- FWCI
- 5.40
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Behavioral Disorders (publishedVersion)
- Topics
- Social Sciences › Education › Education Discipline and Inequality
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Social Sciences › Law › Legal Issues in Education
- Keywords
- school-wide positive behavior interventions and supports, disciplinary exclusion, school suspension, expulsion, universal prevention programs, implementation fidelity, student discipline, California schools
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review