The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Toward a policy ecology of implementation of evidence-based practices in public mental health settings
Open accessAbstract
BACKGROUND: Mental health policymaking to support the implementation of evidence-based practices (EBPs) largely has been directed toward clinicians. However, implementation is known to be dependent upon a broader ecology of service delivery. Hence, focusing exclusively on individual clinicians as targets of implementation is unlikely to result in sustainable and widespread implementation of EBPs. DISCUSSION: Policymaking that is informed by the implementation literature requires that policymakers deploy strategies across multiple levels of the ecology of implementation. At the organizational level, policies are needed to resource the added marginal costs of EBPs, and to assist organizational learning by re-engineering continuing education units. At the payor and regulatory levels, policies are needed to creatively utilize contractual mechanisms, develop disease management programs and similar comprehensive care management approaches, carefully utilize provider and organizational profiling, and develop outcomes assessment. At the political level, legislation is required to promote mental health parity, reduce discrimination, and support loan forgiveness programs. Regulations are also needed to enhance consumer and family engagement in an EBP agenda. And at the social level, approaches to combat stigma are needed to ensure that individuals with mental health need access services. SUMMARY: The implementation literature suggests that a single policy decision, such as mandating a specific EBP, is unlikely to result in sustainable implementation. Policymaking that addresses in an integrated way the ecology of implementation at the levels of provider organizations, governmental regulatory agencies, and their surrounding political and societal milieu is required to successfully and sustainably implement EBPs over the long term.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Funding mechanisms significantly affect sustainability, due to costs associated with training, supervision, documentation, and regulatory compliance (Raghavan et al., 2008).”
From Bridging Traditions and Prevention: Insights into Implementing and Sustaining Substance Use Programs for Urban AI/AN Communities (2026) · cites this paper as Raghavan et al., 2008
The cited source says what the claim attributes to it.
In the citing paper
“Enhanced reimbursement models are essential for covering the increased marginal costs associated with implementing EBPs, which include expenses for training, supervision, productivity losses, and compliance with regulations (Raghavan et al., 2008).”
From Bridging Traditions and Prevention: Insights into Implementing and Sustaining Substance Use Programs for Urban AI/AN Communities (2026) · cites this paper as Raghavan et al., 2008
The cited source says what the claim attributes to it.
In the citing paper
“Expansion of the Outer Setting also brings the updated CFIR into closer alignment with other implementation and policy frameworks [18, 78–80].”
From The updated consolidated framework for implementation research based on user feedback (2022) · cites this paper as [79]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“To date there has been insufficient exploration of the barriers that communities face in adapting, implementing, and sustaining substance use prevention programs (Dickerson et al., 2020; Raghavan et al., 2008).”
From Bridging Traditions and Prevention: Insights into Implementing and Sustaining Substance Use Programs for Urban AI/AN Communities (2026) · cites this paper as Raghavan et al., 2008
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“However, limited research has been conducted to understand program implementation and sustainability in AI/AN organizations and communities.”
From Bridging Traditions and Prevention: Insights into Implementing and Sustaining Substance Use Programs for Urban AI/AN Communities (2026) · cites this paper as Raghavan et al., 2008
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The fifth discipline, the art and practice of the learning organization
Senge, P. M. (1991) · Performance + Instruction · doi:10.1002/pfi.4170300510 · Cited by 20,060
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Evidence-Based Medicine: A New Approach to Teaching the Practice of Medicine
Guyatt, G. (1992) · JAMA · doi:10.1001/jama.1992.03490170092032 · Cited by 4,202
(2005) · Cited by 3,748
(1980) · Health Care Management Review · doi:10.1097/00004010-198005030-00017 · Cited by 2,504
(2001) · PubMed · Cited by 1,709
Ferlie, E. B., & Shortell, S. M. (2001) · The Milbank Quarterly · doi:10.1111/1468-0009.00206 · Cited by 1,335 · cited 1×
“Efforts by governmental agencies to improve quality in Britain [17], Brazil [18], and Germany [19], to name a few examples, have also been largely focused at the clinical level.”
Treating Trauma and Traumatic Grief in Children and Adolescents
Cohen, J. A., Mannarino, A. P., & Deblinger, E. (2006) · Cited by 1,199
Changing Provider Behavior: An Overview of Systematic Reviews of Interventions
Grimshaw, J. M., Shirran, L., Thomas, R., Mowatt, G., Fraser, C., Bero, L., Grilli, R., Harvey, E., Oxman, A., & O’Brien, M. A. (2001) · Medical Care · doi:10.1097/00005650-200108002-00002 · Cited by 778
Effectiveness, Transportability, and Dissemination of Interventions: What Matters When?
Schoenwald, S. K., & Hoagwood, K. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.9.1190 · Cited by 763
Implementing Evidence-Based Practices in Routine Mental Health Service Settings
Drake, R. E., Goldman, H. H., Leff, H. S., Lehman, A. F., Dixon, L., Mueser, K. T., & Torrey, W. C. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.2.179 · Cited by 724
Evidence-Based Quality Improvement: The State Of The Science
Shojania, K. G., & Grimshaw, J. M. (2005) · Health Affairs · doi:10.1377/hlthaff.24.1.138 · Cited by 691
Evidence-Based Practice in Child and Adolescent Mental Health Services
Hoagwood, K., Burns, B. J., Kiser, L., Ringeisen, H., & Schoenwald, S. K. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.9.1179 · Cited by 607
Continuing Medical Education and the Physician as a Learner: Guide to the Evidence
Mazmanian, P. E., & Davis, D. A. (2002) · JAMA · doi:10.1001/jama.288.9.1057 · Cited by 480
Guyatt, G. H., Cairns, J., Churchill, D. N., Cook, D., Haynes, B., Hirsh, J., Irvine, J. E., Levine, M. F., Levine, M., Nishikawa, J., et al. (1992) · JAMA · doi:10.1001/jama.268.17.2420 · Cited by 449
The mark of shame: stigma of mental illness and an agenda for change
(2007) · Choice Reviews Online · doi:10.5860/choice.45-0556 · Cited by 392
The Organizational Context of Children's Mental Health Services
Glisson, C. (2002) · Clinical Child and Family Psychology Review · doi:10.1023/a:1020972906177 · Cited by 367
Senie, R. T., Rosen, P. P., Rhodes, P., Lesser, M. L., & Kinne, D. W. (1992) · Rehabilitation Oncology · doi:10.1097/01893697-199210010-00023 · Cited by 300
Recovery from Mental Illness as an Emergent Concept and Practice in Australia and the UK
Ramon, S., Healy, B., & Renouf, N. (2007) · International Journal of Social Psychiatry · doi:10.1177/0020764006075018 · Cited by 277
Crismon, M. L., Trivedi, M., Pigott, T. A., Rush, A. J., Hirschfeld, R. M. A., Kahn, D. A., DeBattista, C., Nelson, J. C., Nierenberg, A. A., Sackeim, H. A., et al. (1999) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v60n0302 · Cited by 250
Integrating Evidence-Based Practices and the Recovery Model
Frese, F. J., Stanley, J., Kress, K., & Vogel-Scibilia, S. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.11.1462 · Cited by 246
Report of the 2005 Presidential Task Force on Evidence-Based Practice: (582372010-001)
(2005) · PsycEXTRA Dataset · doi:10.1037/e582372010-001 · Cited by 229
Glisson, C., & Green, P. (2006) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-005-0016-0 · Cited by 216
Organizational Process: A Missing Link Between Research and Practice
Rosenheck, R. A. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.12.1607 · Cited by 202
Transportability of Multisystemic Therapy: Evidence for Multilevel Influences
Schoenwald, S. K., Sheidow, A. J., Letourneau, E. J., & Liao, J. G. (2003) · Mental Health Services Research · doi:10.1023/a:1026229102151 · Cited by 165
Graham, N., Lindesay, J., Katona, C., Bertolote, J. M., Camus, V., Copeland, J. R. M., de Mendonça Lima, C. A., Gaillard, M., Gély Nargeot, M. C., Gray, J., et al. (2003) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.876 · Cited by 165
Structural Stigma in State Legislation
Corrigan, P. W., Watson, A. C., Heyrman, M. L., Warpinski, A., Gracia, G., Slopen, N., & Hall, L. L. (2005) · Psychiatric Services · doi:10.1176/appi.ps.56.5.557 · Cited by 165
Evidence-Based Practice As Mental Health Policy: Three Controversies And A Caveat
Tanenbaum, S. J. (2005) · Health Affairs · doi:10.1377/hlthaff.24.1.163 · Cited by 158
The State Policy Context of Implementation Issues for Evidence-Based Practices in Mental Health
Isett, K. R., Burnam, M. A., Coleman-Beattie, B., Hyde, P. S., MORRISSEY, J. P., Magnabosco, J. L., Rapp, C. A., Ganju, V. K., & Goldman, H. H. (2007) · Psychiatric Services · doi:10.1176/ps.2007.58.7.914 · Cited by 146
The American Journal of Nursing
&NA; (1912) · AJN American Journal of Nursing · doi:10.1097/00000446-191212050-00023 · Cited by 110
Disease Management: A Systems Approach to Improving Patient Outcomes
Todd, W., & Nash, D. (1998) · Journal for Healthcare Quality · doi:10.1097/01445442-199803000-00011 · Cited by 91
Ganju, V. (2003) · Schizophrenia Bulletin · doi:10.1093/oxfordjournals.schbul.a006982 · Cited by 87
Evidence‐based practice in mental health: practical weaknesses meet political strengths
Tanenbaum, S. J. (2003) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2003.00409.x · Cited by 86
Texas Medication Algorithm Project
Suppes, T. M., Swann, A. C., Dennehy, E. B., Habermacher, E. D., Mason, M., Crismon, M. L., Toprac, M. G., Rush, A. J., Shon, S. P., & Altshuler, K. Z. (2001) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v62n0607 · Cited by 78
Emerging models of depression care: multi‐level (‘6 P’) strategies
Pincus, H. A., Hough, L., Houtsinger, J. K., Rollman, B. L., & Frank, R. G. (2003) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.142 · Cited by 76
Pharmaceutical Marketing Research and the Prescribing Physician
Greene, J. A. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-10-200705150-00008 · Cited by 52
The Road Ahead: Research Partnerships to Transform Services
(2006) · PsycEXTRA Dataset · doi:10.1037/e636822011-001 · Cited by 45
Ganju, V. K. (2006) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-006-0071-1 · Cited by 44
Walker, A. M., Klein, M. S., Hemmens, C. T., Stohr, M. K., & Burton, V. S. (2015) · Community Mental Health Journal · doi:10.1007/s10597-015-9941-x · Cited by 43
Hemmens, C. T., Miller, M., Burton, V. S., & Milner, S. (2002) · Community Mental Health Journal · doi:10.1023/a:1014543104471 · Cited by 38
The Use of Clinical Guidelines to Improve Medical Practice: Main Issues in the United States
Huttin, C. C. (1997) · International Journal for Quality in Health Care · doi:10.1093/intqhc/9.3.207 · Cited by 38
Biegel, D. E., Kola, L. A., Ronis, R. J., Boyle, P. E., Reyes, C. M. D., Wieder, B., & Kubek, P. M. (2003) · Research on Social Work Practice · doi:10.1177/1049731503013004007 · Cited by 34
National Healthcare Quality Report, 2005
(2005) · PsycEXTRA Dataset · doi:10.1037/e593172009-001 · Cited by 32
Consumer and Family Views on Evidence-Based Practices and Adult Mental Health Services
Scheyett, A., McCarthy, E. M., & Rausch, C. (2006) · Community Mental Health Journal · doi:10.1007/s10597-005-9027-2 · Cited by 24
Consumers and families as partners in implementing evidence-based practice
Birkel, R. C., Hall, L. L., Lane, T., McNulty, K. C., & Miller, J. E. (2003) · Psychiatric Clinics of North America · doi:10.1016/s0193-953x(03)00065-0 · Cited by 20
Medicaid Disease Management Programs
Gillespie, J. L., & Rossiter, L. F. (2003) · Disease Management & Health Outcomes · doi:10.2165/00115677-200311060-00001 · Cited by 18
World Health Day 2001: minding the world's mental health
Jenkins, R. (2001) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s001270170059 · Cited by 14
The Development of an Evidence-based Toolkit to Prevent Meningococcal Disease in College Students
Butler, K. M. (2007) · Family & Community Health · doi:10.1097/01.fch.0000264407.36013.e7 · Cited by 11
Use of utilization management methods in State Medicaid programs.
Buck, J. A., & Silverman, H. A. (1996) · PubMed · Cited by 11
Reviewing the learning organisation model in a child and adolescent mental health service
Birleson, P., & Brann, P. (2006) · Australian Health Review · doi:10.1071/ah060181 · Cited by 10
How C-L Services Can Comply With New HCFA Guidelines
Worley, F. A. P. M. L. L. M. (1998) · General Hospital Psychiatry · doi:10.1016/s0163-8343(98)00011-5 · Cited by 9
Fisher, G. L., & Roget, N. A. (2009) · doi:10.4135/9781412964500.n217 · Cited by 9
Quality Improvement Issues in Brazil
Malik, A. M. (1997) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30295-4 · Cited by 8
Billing for psychiatric evaluations: options for coding and reimbursement
Goldberg, R. J. (2004) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2004.02.005 · Cited by 6
State Mental Health Policy: Pharmacy Costs: Finding a Role for Quality
Ning, A., Dubin, W. R., & Parks, J. (2005) · Psychiatric Services · doi:10.1176/appi.ps.56.8.909 · Cited by 6
Quality Improvement in Germany
Paeger, A. (1997) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30293-0 · Cited by 6
Physician data profiling proliferates.
Jh, S. (2001) · PubMed · Cited by 5
McKeon, E., Roit, S. M., & Zimmerman, K. (2001) · AJN American Journal of Nursing · doi:10.1097/00000446-200101000-00028 · Cited by 4
Develop a Learning Organisation
Noble, J. (2007) · Education for Primary Care · doi:10.1080/14739879.2007.11493550 · Cited by 3
Exploring relationships of knowledge to action
Mazmanian, P. E. (2006) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.56 · Cited by 2
Enhanced reimbursement is becoming a reality.
Ogrod, E. S., & Rb, D. (1988) · PubMed · Cited by 1
Research works printed but not linked: 15
- Ganju V: Implementation of Evidence-Based Practices in State Mental Health Systems: Implications for Research and Effectiveness Studies. Schizophrenia Bulletin. 2003, 29: 125-131. · DOI · Paper page
- U.S. Department of Health and Human Services Substance Abuse and Mental Health Services Administration: About Evidence-Based Practices: Shaping Mental Health Services Towards Recovery. 2005, Rockville, MD: USDHHS, Substance Abuse and Mental Health Services Administration
- U.S. Department of Health and Human Services Agency for Health Care Policy and Research: Using Clinical Practice Guidelines to Evaluate Quality of Care. 1995, Rockville, MD: U.S. Department of Health and Human Services
- Oregon Office of Mental Health and Addiction Services: Project Plan to Promote the Adoption of Evidence-Based Practices. 2004
- U.S. Department of Health and Human Services Substance Abuse and Mental Health Services Administration: FY 2005 SAMHSA Grant Awardees – CMHS. 2005, Rockville, MD: USDHHS, Substance Abuse and Mental Health Services Administration
- U.S. Department of Health and Human Services Substance Abuse and Mental Health Services Administration: FY 2006 SAMHSA Grant Awardees. 2006, Rockville, MD: USDHHS, Substance Abuse and Mental Health Services Administration
- Necochea L: Identifying State Purchasing Levers for Promoting the Use of Evidence-Based Practice in Substance Abuse Treatment (RWJF Research Meeting Highlight). 2007, Washington, DC: Robert Wood Johnson Foundation
- Brown R, Chen A: Disease Management Options: Issues for State Medicaid Programs to Consider (Issue Brief). 2004, Washington, DC: Mathematica Policy Research
- Cohen JA, Mannarino AP, Deblinger E: Child and Parent Trauma-Focused Cognitive Behavioral Therapy Treatment Manual. 2006, Philadelphia, PA: Drexel University College of Medicine
- Tilly J, Elam L: Prior Authorization for Medicaid Prescription Drugs in Five States: Lessons for Policy Makers. 2003, Washington, DC: Kaiser Family Foundation
- Iowa Consortium for Mental Health: Legislation Update. 2006
- Youngclarke D, Ramos K: Evidence-Based Practice: What role should research play in our decision making?. California Court Appointed Special Advocate Association. 2006
- New Freedom Commission on Mental Health: Achieving the Promise: Transforming Mental Health Care in America. Final Report. 2003, Rockville, MD
- U.S. Department of Health and Human Services National Institutes of Health: Reducing Mental Illness Stigma and Discrimination PAR-07-156. 2006, Bethesda, MD: U.S. Department of Health and Human Services, National Institutes of Health
- World Health Organization: Child and Adolescent Mental Health Initiatives of the Department of Mental Health and Substance Abuse. 2003
Cited by
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Self-citationPowell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963
The updated consolidated framework for implementation research based on user feedback
Damschroder, L. J., Reardon, C. M., Widerquist, M. A. O., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-022-01245-0 · Cited by 4,452
A compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069
Methods to Improve the Selection and Tailoring of Implementation Strategies
Powell, B. J., Beidas, R. S., Lewis, C. C., Aarons, G. A., McMillen, J. C., Proctor, E. K., & Mandell, D. S. (2017) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-015-9475-6 · Cited by 967
Metadata
- Authors
- Raghavan, R., Bright, C. L., & Shadoin, A. L.
- Affiliations
- Washington University in St. Louis (US)
- Corresponding author
- Raghavan, Ramesh
- Venue
- Implementation Science
- Published
- 2008-05-16
- Volume
- 3
- Issue
- 1
- Pages
- 26-26
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC2396668
- OpenAlex
- W2032503405
- Cited by
- 205
- References
- 61
- Citations by year
- 2026: 4 · 2025: 8 · 2024: 18 · 2023: 24 · 2022: 18 · 2021: 23 · 2020: 13 · 2019: 10 · 2018: 13 · 2017: 15 · 2016: 9 · 2015: 12 · 2014: 9 · 2013: 9 · 2012: 12
- FWCI
- 5.16
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Digital Commons@Becker (Washington University School of Medicine) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Washington University in St. Louis
- National Institutes of Health (5p30mh068579-05)
- National Institute of Mental Health (5 P30 MH068579, P30-MH-068579)
- Center for Mental Health Services
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- evidence-based practice, mental health policy, public mental health services, mental health parity, disease management programs, care management, mental health stigma, organizational learning, sustainable implementation, mental health law
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
