Research, Data, and Evidence-Based Treatment Use in State Behavioral Health Systems, 2001–2012
Open accessAbstract
OBJECTIVE: Empirical study of public behavioral health systems' use of data and their investment in evidence-based treatments (EBTs) is limited. This study describes trends in state-level EBT investment and research supports from 2001 to 2012. METHODS: Data were from National Association for State Mental Health Program Directors Research Institute (NRI) surveys, which were completed by representatives of state mental health authorities (SMHAs). Multilevel models examined change over time related to state adoption of EBTs, numbers of clients served, and penetration rates for six behavioral health EBTs for adults and children: supported housing, supported employment, assertive community treatment, therapeutic foster care, multisystemic therapy, and functional family therapy. State supports related to research, evaluation, and information management were also examined. RESULTS: Increasing percentages of states reported funding an external research center, promoting the adoption of EBTs through provider contracts, and providing financial incentives for EBTs. Decreasing percentages of states reported promoting EBT adoption through stakeholder mobilization, monitoring fidelity, and specific budget requests. There was greater reported use of adult-focused EBTs (65%-80%) compared with youth-focused EBTs (25%-50%). Overall penetration rates of EBTs were low (1%-3%) and EBT adoption by states showed flat or declining trends. SMHAs' investment in data systems and use of research showed little change. CONCLUSIONS: SMHA investment in EBTs, implementation infrastructure, and use of research has declined. More systematic measurement and examination of these metrics may provide a useful approach for setting priorities, evaluating success of health reform efforts, and making future investments.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Only 1-3% of the eligible population receives these interventions.
“yet only 1–3% of the eligible population receives these interventions [32].”
From Translating economic evaluations into financing strategies for implementing evidence-based practices (2021) · cites this paper as [32]
Behavioral health EBPs can address risk for ongoing behavioral problems and reduce criminal recidivism, offering alternatives to youth detention and incarceration.
“Behavioral health EBPs can address risk for ongoing behavioral problems and reduce criminal recidivism, offering alternatives to youth detention and incarceration”
From Translating economic evaluations into financing strategies for implementing evidence-based practices (2021) · cites this paper as [32]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Institute of Medicine (2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,174 · see citing works
Crossing the Quality Chasm: A New Health System for the 21st Century
Baker, A. (2001) · BMJ · doi:10.1136/bmj.323.7322.1192 · Cited by 10,754 · see citing works
Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence
Singer, J. D., & Willett, J. B. (2003) · doi:10.1093/acprof:oso/9780195152968.001.0001 · Cited by 10,647 · see citing works
To Err is Human: Building a Safer Health System
Hendee, W. R. (2001) · Journal of Vascular and Interventional Radiology · doi:10.1016/s1051-0443(01)70072-3 · Cited by 10,122 · see citing works
Crossing the Quality Chasm: A New Health System for the 21st Century
Committee on Quality of Health Care in America (2002) · Journal for Healthcare Quality · doi:10.1111/j.1945-1474.2002.tb00463.x · Cited by 8,508 · see citing works
Mental Health: A Report of the Surgeon General
United States. Public Health Service. Office of the Surgeon General (1999) · PsycEXTRA Dataset · doi:10.1037/e636982009-001 · Cited by 3,105 · see citing works
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.1.7 · Cited by 3,067 · see citing works
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · see citing works
Leavitt, M. (2001) · PubMed · Cited by 1,835 · see citing works
Core Implementation Components
Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009) · Research on Social Work Practice · doi:10.1177/1049731509335549 · Cited by 1,103 · see citing works
Implementing Evidence-Based Practices in Routine Mental Health Service Settings
Drake, R. E., Goldman, H. H., Leff, H. S., Lehman, A. F., Dixon, L. B., Mueser, K. T., & Torrey, W. C. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.2.179 · Cited by 724 · see citing works
Worldwide application of prevention science in adolescent health
Catalano, R. F., Fagan, A. A., Gavin, L. E., Greenberg, M. T., Irwin, C. E., Ross, D. A., & Shek, D. T. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60238-4 · Cited by 674 · see citing works
Achieving the promise: Transforming mental health care in America
The President's New Freedom Commission on Mental Health (2007) · PsycEXTRA Dataset · doi:10.1037/e432262008-003 · Cited by 496 · see citing works
Innovation Adoption: A Review of Theories and Constructs
Wisdom, J. P., Chor, K. H. B., Hoagwood, K. E., & Horwitz, S. M. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0486-4 · Cited by 451 · see citing works
Self-citationDrake, R. E., McHugo, G. J., Clark, R. E., Teague, G. B., Xie, H., Miles, K. M., & Ackerson, T. H. (1998) · American Journal of Orthopsychiatry · doi:10.1037/h0080330 · Cited by 419 · see citing works
Glisson, C., & Schoenwald, S. K. (2005) · Mental Health Services Research · doi:10.1007/s11020-005-7456-1 · Cited by 373 · see citing works
Cook, J. Α., Leff, H. S., Blyler, C. R., Gold, P. B., Goldberg, R. W., Mueser, K. T., Toprac, M. G., McFarlane, W. R., Shafer, M. S., Blankertz, L., et al. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.5.505 · Cited by 273 · see citing works
A Measurement Feedback System (MFS) Is Necessary to Improve Mental Health Outcomes
Hamilton, J. D., & Bickman, L. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e3181825af8 · Cited by 270 · see citing works
Improving Programs and Outcomes
Bertram, R. M., Blasé, K. A., & Fixsen, D. L. (2014) · Research on Social Work Practice · doi:10.1177/1049731514537687 · Cited by 246 · see citing works
Frank, R. (2006) · Johns Hopkins University Press eBooks · doi:10.1353/book.3252 · Cited by 219 · see citing works
A meta-systems approach to evidence-based practice for children and adolescents.
Kazak, A. E., Hoagwood, K., Weisz, J. R., Hood, K. K., Kratochwill, T. R., Vargas, A., & Banez, G. A. (2010) · American Psychologist · doi:10.1037/a0017784 · Cited by 196 · see citing works
Self-citationde Beurs, E., den Hollander-Gijsman, M. E., van Rood, Y. R., van der Wee, N. J. A., Giltay, E. J., van Noorden, M. S., van der Lem, R., van Fenema, E. M., & Zitman, F. G. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.696 · Cited by 195 · see citing works
Better but not well: mental health policy in the United States since 1950
(2007) · Choice Reviews Online · doi:10.5860/choice.44-4478 · Cited by 193 · see citing works
Holzner, B., Giesinger, J. M., Pinggera, J., Zugal, S., Schöpf, F., Oberguggenberger, A., Gamper, E., Zabernigg, A. F., Weber, B., & Rumpold, G. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-126 · Cited by 188 · see citing works
Ethical Considerations for Research Involving Prisoners
Institute of Medicine (2007) · National Academies Press eBooks · doi:10.17226/11692 · Cited by 179 · see citing works
Henggeler, S. W. (2011) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032210-104615 · Cited by 167 · see citing works
Improving Community-Based Mental Health Care for Children: Translating Knowledge into Action
Garland, A. F., Haine‐Schlagel, R., Brookman-Frazee, L. I., Baker-Ericzén, M. J., Trask, E. V., & Fawley-King, K. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0450-8 · Cited by 144 · see citing works
Handbook of Family Therapy: The Science and Practice of Working with Families and Couples
Geist, R. (2005) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.2005.59.2.170 · Cited by 121 · see citing works
Tabol, C., Drebing, C. E., & Rosenheck, R. (2010) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2009.12.002 · Cited by 118 · see citing works
Daleiden, E. L., & Chorpita, B. F. (2005) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2004.11.002 · Cited by 113 · see citing works
Bruns, E. J., & Hoagwood, K. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e31816485f4 · Cited by 74 · see citing works
Self-citationBrown, C. H., Kellam, S. G., Kaupert, S., Muthén, B. O., Wang, W., Muthén, L. K., Chamberlain, P., PoVey, C. L., Cady, R., Valente, T. W., et al. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0387-3 · Cited by 68 · see citing works
Bruns, E. J., Hoagwood, K., Rivard, J. C., Wotring, J., Marsenich, L., & CARTER, B. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e3181684557 · Cited by 65 · see citing works
Self-citationGilmore, A. S., Yingxu, Z., Kang, N., Ryskina, K. L., Legorreta, A. P., Taira, D. A., & Chung, R. S. (2007) · Health Services Research · doi:10.1111/j.1475-6773.2007.00725.x · Cited by 56 · see citing works
The State Health Authority Yardstick (SHAY)
Finnerty, M. T., Rapp, C. A., Bond, G. R., Lynde, D., Ganju, V. K., & Goldman, H. H. (2009) · Community Mental Health Journal · doi:10.1007/s10597-009-9181-z · Cited by 41 · see citing works
Assessing Conformity to Standards for Treatment Foster Care
Farmer, E. M. Z., Burns, B. J., Dubs, M. S., & Thompson, S. (2002) · Journal of Emotional and Behavioral Disorders · doi:10.1177/10634266020100040301 · Cited by 37 · see citing works
Unpacking the Black Box of Implementation: The Next Generation for Policy, Research and Practice
Hoagwood, K., Atkins, M. S., & Ialongo, N. S. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0512-6 · Cited by 37 · see citing works
Self-citationFacing Reality and Jumping the Chasm
Bickman, L. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0460-6 · Cited by 20 · see citing works
Adoption of Clinical and Business Trainings by Child Mental Health Clinics in New York State
Chor, K. H. B., Olin, S.-C. S., Weaver, J., Cleek, A. F., McKay, M. M., Hoagwood, K., & Horwitz, S. M. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201300535 · Cited by 17 · see citing works
Self-citationCohen, D. (2014) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-014-9407-x · Cited by 16 · see citing works
Evidence‐Based Practice in Adult Mental Health
Frueh, B. C., Ford, J. D., Elhai, J. D., & Grubaugh, A. L. (2012) · Wiley eBooks · doi:10.1002/9781118156391.ebcp002001 · Cited by 14 · see citing works
The Research Potential of Administrative Data From State Mental Health Agencies
Fisher, W. H., & Rivard, J. C. (2010) · Psychiatric Services · doi:10.1176/ps.2010.61.6.546 · Cited by 6 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [26]Singer JD Willett JB Applied longitudinal data analysis New York Oxford University Press 2003
Cited by
Sorted by citations
Moberg, C., Niles, A., & Beermann, D. (2019) · Journal of Medical Internet Research · doi:10.2196/12556 · Cited by 157 · see citing works
Animal-assisted therapies for youth with or at risk for mental health problems: A systematic review
Hoagwood, K. E., Acri, M., Morrissey, M., & Peth-Pierce, R. (2017) · Applied Developmental Science · doi:10.1080/10888691.2015.1134267 · Cited by 158 · see citing works
Self-citationMeza, R. D., Triplett, N. S., Woodard, G. S., Martin, P., Khairuzzaman, A. N., Jamora, G., & Dorsey, S. (2021) · Implementation Science · doi:10.1186/s13012-021-01104-4 · Cited by 76 · see citing works
Advancing the pragmatic measurement of sustainment: a narrative review of measures
Moullin, J. C., Sklar, M., Green, A., Dickson, K. S., Stadnick, N. A., Reeder, K., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00068-8 · Cited by 72 · see citing works
Dopp, A. R., Narcisse, M.-R., Mundey, P., Silovsky, J. F., Smith, A. B., Mandell, D., Funderburk, B. W., Powell, B. J., Schmidt, S., Edwards, D., et al. (2020) · Implementation Research and Practice · doi:10.1177/2633489520939980 · Cited by 79 · see citing works
Translating economic evaluations into financing strategies for implementing evidence-based practices
Dopp, A. R., Kerns, S. E. U., Panattoni, L., Ringel, J. S., Eisenberg, D., Powell, B. J., Low, R., & Raghavan, R. (2021) · Implementation Science · doi:10.1186/s13012-021-01137-9 · Cited by 52 · see citing works
Self-citationDopp, A. R., Coen, A. S., Smith, A. B., Reno, J., Bernstein, D. H., Kerns, S. E. U., & Altschul, D. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.12.003 · Cited by 33 · see citing works
Self-citationMotamedi, M., Lau, A. S., Lind, T., Lui, J. H., Rodriguez, A., Smith, A., & Brookman-Frazee, L. (2021) · Implementation Research and Practice · doi:10.1177/2633489520982903 · Cited by 17 · see citing works
Fukui, S., Salyers, M. P., Morse, G., & Rollins, A. L. (2021) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000469 · Cited by 15 · see citing works
Karlin, B. E., Brown, G. K., Jager-Hyman, S., Green, K. L., Wong, M., Lee, D. S., Bertagnolli, A., & Ross, T. B. (2019) · Behavior Therapy · doi:10.1016/j.beth.2018.08.002 · Cited by 12 · see citing works
- Authors
- Bruns, E. J., Kerns, S. E. U., Pullmann, M. D., Hensley, S. W., Lutterman, T., & Hoagwood, K. E.
- Affiliations
- University of Washington (US)
- Venue
- Psychiatric Services
- Published
- 2016-05-01
- Volume
- 67
- Issue
- 5
- Pages
- 496-503
- ISSN
- 0022-1597 (ISSN-L)
- 1075-2730
- 1557-9700
- PMC
- PMC5107263
- OpenAlex
- W2203666706
- Cited by
- 167
- References
- 42
- Citations by year
- 2026: 8 · 2025: 13 · 2024: 13 · 2023: 11 · 2022: 15 · 2021: 26 · 2020: 24 · 2019: 18 · 2018: 15 · 2017: 15 · 2016: 8 · 2015: 1
- FWCI
- 16.12
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Psychiatric Services (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (P30MH090322)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Social Psychology › Mental Health Treatment and Access
- Keywords
- evidence-based treatment, state mental health system, research funding, data systems, supported employment, assertive community treatment, therapeutic foster care, multisystemic therapy, functional family therapy, supported housing, implementation infrastructure, mental health policy
- MeSH terms
- Behavior Therapy, Mental Disorders, Community Mental Health Services, Government Programs, Health Plan Implementation, Humans, Surveys and Questionnaires, Research, United States, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
