Economic Impact of the Statewide Implementation of an Evidence-Based Treatment: Multisystemic Therapy in New Mexico
Abstract
Several states have made considerable investments into large-scale implementation of evidence-based treatments (EBTs), yet little is known about key success indicators for these implementation efforts such as cost and sustainability. To that end, the present study examined the economic impact of statewide implementation of multisystemic therapy (MST; Henggeler, Schoenwald, Borduin, Rowland, & Cuningham, 2009), a family- and community-based behavioral EBT for serious juvenile offenders in New Mexico. Participants were 1,869 youth who received MST across 23 teams during the study period. We conducted a cost-benefit analysis using metrics from state data sources that compared the cost of MST to its benefits (i.e., avoided expenses from pre- to posttreatment) in two domains: (a) behavioral health services (i.e., Medicaid claims) and (b) juvenile crime (i.e., taxpayer expenses, tangible and intangible expenses to crime victims). MST costs were based on Medicaid claims, which were reimbursed at an enhanced billing rate that was intended to cover expenses for both clinical and implementation (e.g., training, quality assurance) activities. Results suggest that implementation of MST in New Mexico over the 7-year study period may have produced net benefits, through 2 years posttreatment, of more than $4,643 per youth in avoided behavioral health claims and $15,019 per youth through reductions in juvenile crime. Stated differently, every dollar that New Mexico spent on MST appeared to have returned $3.34 for a total benefit of $64.2 million over the course of the study. We discuss implications of these findings for policymakers, administrators, and researchers who are interested in increasing the sustainability of complex EBTs in community settings.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Community-based behavioral health agencies that deliver MST pay up-front for implementation, often with support from juvenile justice partners, whereas Medicaid and adult criminal justice realize most of the eventual benefits from decreased arrests and out-of-home placements.
“For example, community-based behavioral health agencies that deliver MST pay up-front for implementation, often with support from juvenile justice partners, whereas Medicaid and adult criminal justice realize most of the eventual benefits from decreased arrests and out-of-home placements [36].”
From Translating economic evaluations into financing strategies for implementing evidence-based practices (2021) · cites this paper as [36]
Economic evaluations estimate that MST produces over $3 in economic benefits per $1 spent within 2 years post-treatment.
“Finally, economic evaluations estimate that MST produces over $3 in economic benefits per $1 spent within 2 years post-treatment [36, 37].”
From Translating economic evaluations into financing strategies for implementing evidence-based practices (2021) · cites this paper as [36]
Based on published evidence of >$3 for each dollar spent and the state's predicted 28% reduction in youth recidivism, state-level savings for this initiative were conservatively predicted at over $8 million across 3 years.
“Based on published evidence of >$3 for each dollar spent [36, 37] and the state’s predicted 28% reduction in youth recidivism [39], state-level savings for this initiative were conservatively predicted at over $8 million across 3 years.”
From Translating economic evaluations into financing strategies for implementing evidence-based practices (2021) · cites this paper as [36]
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,588 · see citing works
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
Cost-Effectiveness in Health and Medicine
(1996) · doi:10.1093/oso/9780195108248.001.0001 · Cited by 7,193 · see citing works
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · see citing works
Pfadenhauer, L. M., Gerhardus, A., Mozygemba, K., Lysdahl, K. B., Booth, A., Hofmann, B., Wahlster, P., Polus, S., Burns, J., Brereton, L., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0552-5 · Cited by 1,016 · see citing works
McHugh, R. K., & Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0018121 · Cited by 909 · see citing works
Evidence for Health Decision Making — Beyond Randomized, Controlled Trials
Frieden, T. R. (2017) · New England Journal of Medicine · doi:10.1056/nejmra1614394 · Cited by 770 · see citing works
New Evidence on the Monetary Value of Saving a High Risk Youth
Cohen, M. A., & Piquero, A. R. (2009) · Journal of Quantitative Criminology · doi:10.1007/s10940-008-9057-3 · Cited by 682 · see citing works
The cost of crime to society: New crime-specific estimates for policy and program evaluation
McCollister, K. E., French, M. T., & Fang, H. (2010) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2009.12.002 · Cited by 584 · see citing works
Multisystemic therapy for antisocial behavior in children and adolescents
Henggeler, S. W. (2009) · Cited by 535 · see citing works
Statewide Implementation of Evidence-Based Programs
Fixsen, D. L., Blasé, K. A., Metz, A. J. R., & Dyke, M. K. V. (2013) · Exceptional Children · doi:10.1177/001440291307900206 · Cited by 535 · see citing works
Age and the Explanation of Crime, Revisited
Sweeten, G., Piquero, A. R., & Steinberg, L. D. (2013) · Journal of Youth and Adolescence · doi:10.1007/s10964-013-9926-4 · Cited by 404 · see citing works
Briggs, A. H., & Gray, A. M. (1999) · BMJ · doi:10.1136/bmj.319.7210.635 · Cited by 206 · see citing works
Updating the Economic Impacts of the High/Scope Perry Preschool Program
Nores, M., Belfield, C., Barnett, W. S., & Schweinhart, L. J. (2005) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737027003245 · Cited by 183 · see citing works
Evidence-Based Psychosocial Treatments for Adolescents With Disruptive Behavior
McCart, M. R., & Sheidow, A. J. (2016) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2016.1146990 · Cited by 181 · see citing works
Henggeler, S. W. (2011) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032210-104615 · Cited by 168 · see citing works
Research, Data, and Evidence-Based Treatment Use in State Behavioral Health Systems, 2001–2012
Bruns, E. J., Kerns, S. E. U., Pullmann, M. D., Hensley, S. W., Lutterman, T., & Hoagwood, K. E. (2016) · Psychiatric Services · doi:10.1176/appi.ps.201500014 · Cited by 167 · see citing works
Self-citationDavies, K., & Foley, A. J. (2014) · The Wiley Blackwell Encyclopedia of Health, Illness, Behavior, and Society · doi:10.1002/9781118410868.wbehibs072 · Cited by 161 · see citing works
Reforming Juvenile Justice: A Developmental ApproachPreprint
National Research Council (2013) · CrimRxiv · doi:10.21428/cb6ab371.27f06126 · Cited by 145 · see citing works
Reforming Juvenile Justice: A Developmental Approach
Bonnie, R. J. (2013) · Cited by 125 · see citing works
French, M. T., Salomé, H. J., Sindelar, J. L., & McLellan, A. T. (2002) · Health Services Research · doi:10.1111/1475-6773.031 · Cited by 122 · see citing works
Leve, L. D., & Chamberlain, P. (2007) · Research on Social Work Practice · doi:10.1177/1049731506293971 · Cited by 113 · see citing works
Cost-Outcome Methods for Mental Health
Hargreaves, W. A., Shumway, M., Hu, T.-W., & Cuffel, B. (1997) · Cited by 101 · see citing works
Family-based treatments for serious juvenile offenders: A multilevel meta-analysis.
Dopp, A. R., Borduin, C. M., White, M., & Kuppens, S. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000183 · Cited by 73 · see citing works
Self-citationToward Evidence-Based Transport of Evidence-Based Treatments: MST as an Example
Schoenwald, S. K. (2008) · Journal of Child & Adolescent Substance Abuse · doi:10.1080/15470650802071671 · Cited by 71 · see citing works
Rhoades, B. L., Bumbarger, B. K., & Moore, J. E. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9502-1 · Cited by 62 · see citing works
Costs to Community Mental Health Agencies to Sustain an Evidence-Based Practice
Roundfield, K. D., & Lang, J. M. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600193 · Cited by 60 · see citing works
Bumbarger, B. K., & Campbell, E. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0372-x · Cited by 58 · see citing works
Ogden, T., Bjørnebekk, G., Kjøbli, J., Patras, J., Christiansen, T., Taraldsen, K., & Tollefsen, N. (2012) · Implementation Science · doi:10.1186/1748-5908-7-49 · Cited by 57 · see citing works
Dopp, A. R., Borduin, C. M., Wagner, D. V., & Sawyer, A. M. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0036415 · Cited by 48 · see citing works
Self-citationPromoting Evidence‐Based Practice in Delinquency Prevention at the State Level
Greenwood, P. W., & Welsh, B. C. (2012) · Criminology & Public Policy · doi:10.1111/j.1745-9133.2012.00826.x · Cited by 44 · see citing works
Grietens, H. W. E., & Hellinckx, W. (2003) · Aggression and Violent Behavior · doi:10.1016/s1359-1789(03)00043-0 · Cited by 44 · see citing works
Cost-Outcome Methods for Mental Health.
Najavits, L. M. (1998) · Psychotherapy Research · doi:10.1093/ptr/8.4.475 · Cited by 40 · see citing works
Advancing the Power of Economic Evidence to Inform Investments in Children, Youth, and Families
Board on Children, Y., Education, D. O. B. A. S. S. A., & National Academies of Sciences, E. (2016) · National Academies Press eBooks · doi:10.17226/23481 · Cited by 38 · see citing works
Lies, Damn Lies and Arrest Statistics
Elliott, D. S. (2006) · Cited by 37 · see citing works
Greenwood, P. W., & Welsh, B. C. (2012) · Criminology & Public Policy · doi:10.1111/j.1745-9133.2012.00825.x · Cited by 35 · see citing works
Evidence-Based Interventions for Juvenile Offenders and Juvenile Justice Policies that Support Them
Henggeler, S. W., & Sohoenwald, S. K. (2011) · PsycEXTRA Dataset · doi:10.1037/e639922011-001 · Cited by 34 · see citing works
McCollister, K. E., French, M. T., Sheidow, A. J., Henggeler, S. W., & Halliday‐Boykins, C. A. (2008) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-007-9094-y · Cited by 31 · see citing works
Smith-Boydston, J. M., Holtzman, R. J., & Roberts, M. C. (2014) · Child & Youth Care Forum · doi:10.1007/s10566-014-9255-0 · Cited by 23 · see citing works
Building Evidence for Evidence‐Based Policy Making
Dodge, K. A., & Mandel, A. D. (2012) · Criminology & Public Policy · doi:10.1111/j.1745-9133.2012.00828.x · Cited by 22 · see citing works
Welsh, B. C., & Greenwood, P. W. (2014) · Youth Violence and Juvenile Justice · doi:10.1177/1541204014541708 · Cited by 18 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Eisman, A. B., Kilbourne, A. M., Dopp, A. R., Saldana, L., & Eisenberg, D. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.06.008 · Cited by 210 · see citing works
Self-citationDopp, A. R., Narcisse, M.-R., Mundey, P., Silovsky, J. F., Smith, A. B., Mandell, D., Funderburk, B. W., Powell, B. J., Schmidt, S., Edwards, D., et al. (2020) · Implementation Research and Practice · doi:10.1177/2633489520939980 · Cited by 79 · see citing works
Self-citationBowser, D. M., Henry, B. F., & McCollister, K. E. (2021) · Implementation Science · doi:10.1186/s13012-021-01094-3 · Cited by 61 · see citing works
Translating economic evaluations into financing strategies for implementing evidence-based practices
Dopp, A. R., Kerns, S. E. U., Panattoni, L., Ringel, J. S., Eisenberg, D., Powell, B. J., Low, R., & Raghavan, R. (2021) · Implementation Science · doi:10.1186/s13012-021-01137-9 · Cited by 52 · see citing works
Self-citationDopp, A. R., Perrine, C. M., Iovan, S., & Lantz, P. M. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00940-3 · Cited by 7 · see citing works
Self-citation
- Authors
- Dopp, A. R., Coen, A. S., Smith, A. B., Reno, J., Bernstein, D. H., Kerns, S. E. U., & Altschul, D.
- Affiliations
- University of Arkansas at Fayetteville (US)
- University of New Mexico Health Sciences Center (US)
- University of Denver (US)
- Corresponding author
- Dopp, Alex R.
- ORCID
- Venue
- Behavior Therapy
- Publisher
- Elsevier BV
- Published
- 2018-07
- Volume
- 49
- Issue
- 4
- Pages
- 551-566
- ISSN
- 0005-7894 (ISSN-L)
- OpenAlex
- W2773136167
- Cited by
- 33
- References
- 42
- Citations by year
- 2026: 5 · 2025: 1 · 2024: 5 · 2023: 1 · 2022: 5 · 2021: 6 · 2020: 4 · 2019: 4 · 2018: 2
- FWCI
- 6.98
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Behavior Therapy (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Crime Patterns and Interventions
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Safety Research › Child Welfare and Adoption
- Keywords
- multisystemic therapy, evidence-based treatment, statewide implementation, juvenile offenders, cost-benefit analysis, Medicaid claims, juvenile delinquency, treatment sustainability, New Mexico
- MeSH terms
- Adolescent, Combined Modality Therapy, Cost-Benefit Analysis, Crime, Female, Humans, Juvenile Delinquency, Male, New Mexico, Psychotherapy, Evidence-Based Medicine, Crime Victims
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review