A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The goal of this study was to assess potential differences between administrators/policymakers and those involved in direct practice regarding factors believed to be barriers or facilitating factors to evidence-based practice (EBP) implementation in a large public mental health service system in the United States. METHODS: Participants included mental health system county officials, agency directors, program managers, clinical staff, administrative staff, and consumers. As part of concept mapping procedures, brainstorming groups were conducted with each target group to identify specific factors believed to be barriers or facilitating factors to EBP implementation in a large public mental health system. Statements were sorted by similarity and rated by each participant in regard to their perceived importance and changeability. Multidimensional scaling, cluster analysis, descriptive statistics and t-tests were used to analyze the data. RESULTS: A total of 105 statements were distilled into 14 clusters using concept-mapping procedures. Perceptions of importance of factors affecting EBP implementation varied between the two groups, with those involved in direct practice assigning significantly higher ratings to the importance of Clinical Perceptions and the impact of EBP implementation on clinical practice. Consistent with previous studies, financial concerns (costs, funding) were rated among the most important and least likely to change by both groups. CONCLUSIONS: EBP implementation is a complex process, and different stakeholders may hold different opinions regarding the relative importance of the impact of EBP implementation. Implementation efforts must include input from stakeholders at multiple levels to bring divergent and convergent perspectives to light.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 2×
“There are other models and approaches to be considered, which may be less or more comprehensive than the one presented here [15-17].”
BackgroundProctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Self-citationDiffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 5×
“The findings from this study and our previous work [5,14] provide a lens through which implementation can be viewed.”
BackgroundResultInfluentialSelf-citationDavis, D. A. (1995) · JAMA · doi:10.1001/jama.1995.03530090032018 · Cited by 1,763
An introduction to concept mapping for planning and evaluation
Trochim, W. M. K. (1989) · Evaluation and Program Planning · doi:10.1016/0149-7189(89)90016-5 · Cited by 1,512
Ferlie, E. B., & Shortell, S. M. (2001) · The Milbank Quarterly · doi:10.1111/1468-0009.00206 · Cited by 1,335 · cited 1×
“Public mental health services are embedded in local health and human service systems; therefore, input from multiple levels of stakeholders must be considered for effective major change efforts such as implementation of EBP [3,4].”
BackgroundAarons, G. A. (2004) · Mental Health Services Research · doi:10.1023/b:mhsr.0000024351.12294.65 · Cited by 1,272 · cited 1×
“At the practice level, providers contend with high caseloads, meeting the needs of a variety of clients and their families, and relationships with peers and supervisors [9], while consumers bring their own needs, preferences, and expectations [10].”
BackgroundSelf-citationFrambach, R. T., & Schillewaert, N. (2002) · Journal of Business Research · doi:10.1016/s0148-2963(00)00152-1 · Cited by 1,270
Assessing organizational readiness for change
Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(02)00233-7 · Cited by 863 · cited 1×
“Challenges in administering day-to-day operations of clinics, including leadership abilities, high staff turnover, and need for adequate training and clinical supervision may serve as barriers or facilitators to the implementation of EBPs [8].”
Background
Research works printed but not linked: 29
- Hoagwood K, Olin S: The NIMH blueprint for change report: Research priorities in child and adolescent mental health. J Am Acad Child Adolesc Psychiatry. 2002, 41: 760-767. 10.1097/00004583-200207000-00006. · DOI · Paper page
- Backer TE, David SL, Soucy GE: Reviewing the Behavioral Science Knowledge Base on Technology Transfer (NIDA Research Monograph 155, NIH Publication No. 95-4035). 1995, Rockville, MD: National Institute on Drug Abuse
- Grol R, Wensing M: What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004, 180: S57-S60. · DOI · Paper page
- Glisson C: Structure and technology in human service organizations. Human services as complex organizations. Edited by: Hasenfeld Y. 1992, Thousand Oaks, CA: Sage Publications, 184-202.
- Laing A, Hogg G: Political exhortation, patient expectation and professional execution: Perspectives on the consumerization of health care. Brit J Manage. 2002, 13: 173-188. 10.1111/1467-8551.00230. · DOI
- Hermann RC, Chan JA, Zazzali JL, Lerner D: Aligning measurement-based quality improvement with implementation of evidence-based practices. Adm Policy Ment Health. 2006, 33: 636-645. 10.1007/s10488-006-0055-1. · DOI
- Innvaer S, Vist G, Trommald M, Oxman A: Health policy-makers' perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002, 7: 239-244. 10.1258/135581902320432778. · DOI · Paper page
- Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F: Implementation Research: A synthesis of the literature. 2005, Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231)
- Dopson S, Fitzgerald L: The role of the middle manager in the implementation of evidence-based health care. J Nurs Manag. 2006, 14: 43-51. 10.1111/j.1365-2934.2005.00612.x. · DOI
- Dopson S, Locock L, Gabbay J, Ferlie E, Fitzgerald L: Evidence-based medicine and the implementation gap. Health: An Interdisciplinary Journal for the Social Study of Health, Illness and Medicine. 2003, 7: 311-330. 10.1177/1363459303007003004. · DOI · Paper page
- Morgenstern J: Effective technology transfer in alcoholism treatment. Subst Use Misuse. 2000, 35: 1659-1678. 10.3109/10826080009148236. · DOI · Paper page
- Solomon DH, Hashimoto H, Daltroy L, Liang MH: Techniques to improve physicians' use of diagnostic tests: a new conceptual framework. JAMA. 1998, 280: 2020-10.1001/jama.280.23.2020. · DOI · Paper page
- Rimmer M, Macneil J, Chenhall R, Langfield-Smith K, Watts L: Reinventing Competitiveness: Achieving Best Practice in Australia. 1996, South Melbourne, Australia: Pitman
- Kotter JP: Leading Change: Why Transformation Efforts Fail. (Cover story). Harvard Bus Rev. 1995, 73: 59-67.
- Lozeau D, Langley A, Denis J-L: The corruption of managerial techniques by organizations. Human Relations. 2002, 55: 537-564. 10.1177/0018726702055005427. · DOI · Paper page
- Pettigrew AM, Ferlie E, McKee L: Shaping strategic change: Making change in large organizations: The case of the National Health Service. 1992, London: Sage Publications
- Diamond MA: Innovation and diffusion of technology: A human process. Consult Psychol J. 1996, 48: 221-229. · DOI
- Dale BG, Boaden RJ, Wilcox M, McQuater RE: Sustaining continuous improvement: What are the key issues?. Quality Engineering. 1999, 11: 369-377. 10.1080/08982119908919253. · DOI
- Rapp CA, Etzel-Wise D, Marty D, Coffman M, Carlson L, Asher D, Callaghan J, Holter M: Barriers to evidence-based practice implementation: results of a qualitative study. Community Ment Health J. 2010, 46: 112-118. 10.1007/s10597-009-9238-z. · DOI
- Rapp CA, Etzel-Wise D, Marty D, Coffman M, Carlson L, Asher D, Callaghan J, Whitley R: Evidence based practice implementation strategies: Results of a qualitative study. Community Ment Health J. 2008, 44: 213-224. 10.1007/s10597-007-9109-4. · DOI
- US Census Bureau: State and county quick facts: San Diego County, California. 2010, US Census Bureau
- Concept Systems: The Concept System software®. Ithaca, NY. 2007, 4.147
- Kane M, Trochim W: Concept mapping for planning and evaluation. 2007, Thousand Oaks, CA: Sage Publications, Inc · DOI · Paper page
- Trochim WMK, Stillman FA, Clark PI, Schmitt CL: Development of a model of the tobacco industry's interference with tobacco control programmes. Tob Control. 2003, 12: 140-147. 10.1136/tc.12.2.140. · DOI
- Cohen J: Statistical power analysis for the behavioral sciences. 1988, Hillsdale, NJ: Erlbaum, 2
- Aarons G, Sawitzky A: Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services. Adm Policy Ment Health. 2006, 33: 289-301. 10.1007/s10488-006-0039-1. · DOI · Paper page
- Palinkas LA, Aarons GA, Chorpita BF, Hoagwood K, Landsverk J, Weisz JR: Cultural exchange and implementation of evidence-based practices. Res Social Work Prac. 2009, 19: 602-612. 10.1177/1049731509335529. · DOI
- Aarons GA, Brown SA, Hough RL, Garland AF, Wood PA: Prevalence of adolescent substance use disorders across five sectors of care. J Am Acad Child Adolesc Psychiatry. 2001, 40: 419-426. 10.1097/00004583-200104000-00010. · DOI · Paper page
- Checkland K, Coleman A, Harrison S, Hiroeh U: 'We can't get anything done because...': making sense of'barriers' to Practice-based Commissioning. J Health Serv Res Policy. 2009, 14: 20-10.1258/jhsrp.2008.008043. · DOI
Cited by
Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0528-y · Cited by 12,038
“The snowball/ maximum variation study involved a sequential design where the qualitative study was merged into the quantitative data for the purpose of convergence and conceptual model development (Green and Aarons 2011).”
BackgroundMethodInfluentialMethods to Improve the Selection and Tailoring of Implementation Strategies
Powell, B. J., Beidas, R. S., Lewis, C. C., Aarons, G. A., McMillen, J. C., Proctor, E. K., & Mandell, D. S. (2017) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-015-9475-6 · Cited by 967
Self-citationPublic health program capacity for sustainability: a new framework
Schell, S. F., Luke, D. A., Schooley, M. W., Elliott, M. B., Herbers, S. H., Mueller, N. B., & Bunger, A. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-15 · Cited by 563
Ten recommendations for using implementation frameworks in research and practice
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Albers, B., Nilsen, P., Broder-Fingert, S., Mukasa, B., & Aarons, G. A. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00023-7 · Cited by 488
Self-citationDynamic adaptation process to implement an evidence-based child maltreatment intervention
Aarons, G. A., Green, A. E., Palinkas, L. A., Self-Brown, S., Whitaker, D. J., Lutzker, J. R., Silovsky, J. F., Hecht, D. B., & Chaffin, M. J. (2012) · Implementation Science · doi:10.1186/1748-5908-7-32 · Cited by 449
“For example, in the outer context, communities may need to develop alignments among stakeholders or change funding or contracting in order to successfully implement an EBP [32,33].”
BackgroundSelf-citation
Metadata
- Authors
- Green, A. E., & Aarons, G. A.
- Venue
- Implementation Science
- Published
- 2011-09-07
- Volume
- 6
- Issue
- 1
- Pages
- 104-104
- ISSN
- 1748-5908 (ISSN-L)
- OpenAlex
- W2170592114
- Cited by
- 126
- References
- 20
- FWCI
- 13.29
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. https://app.cochat.ai/papers/10.1186/1748-5908-6-104
- The paper
- Green, A. E., & Aarons, G. A. (2011). A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. Implementation Science. https://doi.org/10.1186/1748-5908-6-104
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.