Implementing a Measurement Feedback System in Community Mental Health Clinics: A Case Study of Multilevel Barriers and Facilitators
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Abstract Measurement feedback systems (MFSs) have been proposed as a means of improving practice. The present study examined the implementation of a MFS, the Contextualized Feedback System (CFS), in two community-based clinic sites. Significant implementation differences across sites provided a basis for examining factors that influenced clinician uptake of CFS. Following the theoretical implementation framework of Aarons et al. (Adm Policy Mental Health Mental Health Serv Res 38(1):4–23, 2011), we coded qualitative data collected from eighteen clinicians (13 from Clinic U and 5 from Clinic R) who participated in semi-structured interviews about their experience with CFS implementation. Results suggest that clinicians at both clinics perceived more barriers than facilitators to CFS implementation. Interestingly, clinicians at the higher implementing clinic reported a higher proportion of barriers to facilitators (3:1 vs. 2:1); however, these clinicians also reported a significantly higher level of organizational and leadership supports for CFS implementation. Implications of these findings are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 9×
“, sociopolitical, funding, interorganizational networks, client advocacy) influence the adoption and implementation of innovations (Aarons et al. 2011).”
InfluentialEvidence-based practice in psychology.
American Psychological Association (2006) · American Psychologist · doi:10.1037/0003-066x.61.4.271 · Cited by 2,478
The Challenge of Innovation Implementation
Klein, K. J., & Sorra, J. S. (1996) · The Academy of Management Review · doi:10.2307/259164 · Cited by 2,113 · cited 1×
“Interview questions were developed based on Aarons et al (2011) as a broad conceptual framework; further, we used the Klein and Sorras’ (1996) measure that focused on facilitators and barriers to technology implementation to develop more domain-specific questions.”
Assessing organizational readiness for change
Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(02)00233-7 · Cited by 863
The cross‐level effects of culture and climate in human service teams
Glisson, C., & James, L. R. (2002) · Journal of Organizational Behavior · doi:10.1002/job.162 · Cited by 758
Glisson, C., & Hemmelgarn, A. (1998) · Child Abuse & Neglect · doi:10.1016/s0145-2134(98)00005-2 · Cited by 744 · cited 3×
“…and quality (e.g., Aarons and Sawitzky 2006; Brunette et al. 2008; Carr et al. 2003; Glisson 2008; Glisson and Durick 1988; Glisson and Green 2006; Glisson and Hemmelgarn 1998; Glisson et al. 2013a; Glisson et al. 2008a; Glisson et al. 2010; Greener et al. 2007; Guzzo et al. 1985; Neuman et al.…”
Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., Green, P., & The Research Network on Youth Mental Health (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0148-5 · Cited by 608 · cited 1×
“…et al. 2008; Carr et al. 2003; Glisson 2008; Glisson and Durick 1988; Glisson and Green 2006; Glisson and Hemmelgarn 1998; Glisson et al. 2013a; Glisson et al. 2008a; Glisson et al. 2010; Greener et al. 2007; Guzzo et al. 1985; Neuman et al. 1989; Olin et al. 2014; Parker et al. 2003;…”
Self-citationLangley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010) · School Mental Health · doi:10.1007/s12310-010-9038-1 · Cited by 477
Self-citationInnovation Adoption: A Review of Theories and Constructs
Wisdom, J. P., Chor, K. H. B., Hoagwood, K. E., & Horwitz, S. M. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0486-4 · Cited by 451 · cited 2×
“The process of adoption and implementation thus appears to be as critical to the overall effectiveness of the program as the specific treatment itself (Aarons et al. 2011; Fixsen et al. 2013; Wisdom et al. 2013).”
Self-citation
Research works printed but not linked: 46
- Aarons, G. A., & Sawitzky, A. C. (2006). Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 33(3), 289–301. · DOI · Paper page
- Arco, L. (1997). Improving program outcome with process-based performance feedback. Journal of Organizational Behavior Management, 17(1), 37–64. · DOI
- Bernard, H. H. R., & Ryan, G. W. (2009). Analyzing qualitative data: Systematic approaches. Thousand Oaks: SAGE publications.
- Bickman, L., Douglas Kelley, S., & Athay, M. (2012). The technology of measurement feedback systems. Couple and Family Psychology: Research and Practice, 1(4), 274–284. · DOI · Paper page
- Brunette, M., Asher, D., Whitley, R., Lutz, W., Wieder, B., Jones, A., et al. (2008). Implementation of integrated dual disorders treatment: a qualitative analysis of facilitators and barriers. Psychiatric Services, 59(9), 989–995. · DOI · Paper page
- Bruns, E. J., Hoagwood, K. E., & Hamilton, J. D. (2008). State implementation of evidence-based practice for youths, part I: Responses to the state of the evidence. Journal of the American Academy of Child and Adolescent Psychiatry, 47(4), 369–373. · DOI
- Carr, J. Z., Schmidt, A. M., Ford, J. K., & DeShon, R. P. (2003). Climate perceptions matter: a meta-analytic path analysis relating molar climate, cognitive and affective states, and individual level work outcomes. Journal of Applied Psychology, 88(4), 605. · DOI · Paper page
- Cebul, R. D. (2008). Using electronic medical records to measure and improve performance. Transactions of the American Clinical Climatological Association, 119, 65–76.
- Chorpita, B. F., Bernstein, A., & Daleiden, E. L. (2008). Driving with roadmaps and dashboards: Using information resources to structure the decision models in service organizations. Administration and Policy in Mental Health and Mental Health Services Research, 35(1–2), 114–123. · DOI
- Duncan, K., & Pozehl, B. (2000). Effects of performance feedback on patient pain outcomes. Clinical Nursing Research, 9(4), 379–397. · doi:10.1177/10547730022158645
- Fixsen, D., Blasé, K., Metz, A., & Van Dyke, M. (2013). Statewide implementation of evidence-based programs. Exceptional Children, 79(2), 213–230. · DOI · Paper page
- Furman, C. E., Adamek, M. S., & Furman, A. G. (1992). The use of an auditory device to transmit feedback to student therapists. Journal of Music Therapy, 29(1), 40–53. · doi:10.1093/jmt/29.1.40
- Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5(4), 233–253. · DOI · Paper page
- Glisson, C. (2008). Interventions with organizations: The ARC model. In K. Sowers & C. Dulmus (Eds.), The comprehensive handbook of social work and social welfare. New Jersey: Wiley.
- Glisson, C., & Durick, M. (1988). Predictors of job satisfaction and organizational commitment in human service organizations. Administrative Science Quarterly, 33(1), 61–81. · DOI · Paper page
- Glisson, C., & Green, P. (2006). The effects of organizational culture and climate on the access to mental health care in child welfare and juvenile justice systems. Administration and Policy in Mental Health and Mental Health Services Research, 33(4), 433–448. · DOI · Paper page
- Glisson, C., Hemmelgarn, A., Green, P., Dukes, D., Atkinson, S., & Williams, N. J. (2012). Randomized trial of the availability, responsiveness, and continuity (ARC) organizational intervention with community-based mental health programs and clinicians serving youth. Journal of the American Academy of Child & Adolescent Psychiatry, 51(8), 780–787. · DOI
- Glisson, C., Hemmelgarn, A., Green, P., & Williams, N. J. (2013). Randomized trial of the availability, responsiveness and continuity (ARC) organizational intervention for improving youth outcomes in community mental health programs. Journal of the American Academy of Child and Adolescent Psychiatry, 52(5), 493–500. · DOI
- Goebel, L. J. (1997). A peer review feedback method of promoting compliance with preventive care guidelines in a resident ambulatory care clinic. Joint Commission Journal on Quality Improvement, 23, 196–202. · DOI
- Greener, J. M., Joe, G. W., Simpson, D. D., Rowan-Szal, G. A., & Lehman, W. E. (2007). Influence of organizational functioning on client engagement in treatment. Journal of Substance Abuse Treatment, 33(2), 139. · DOI
- Guzzo, R. A., Jette, R. D., & Katzell, R. A. (1985). The effects of psychologically based intervention programs on worker productivity: A meta-analysis. Personnel Psychology, 38(2), 275–291. · DOI · Paper page
- Hall, D. T., & Yip, K. (2014). Career cultures and climates in organizations. In B. Schneider & K. Barbera (Eds.), The oxford handbook of organizational climate and culture. New York: Oxford University Press.
- Holmboe, E., Scranton, R., Sumption, K., & Hawkins, R. (1998). Effect of medical record audit and feedback on residents’ compliance with preventive health care guidelines. Academic Medicine, 73(8), 901–903. · DOI
- Howe, A. (1996). Detecting psychological distress: can general practitioners improve their own performance? British Journal of General Practice, 46(408), 407–410.
- Jensen-Doss, A., & Hawley, K. M. (2010). Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child & Adolescent Psychology, 39(6), 885–896. · DOI · Paper page
- Lambert, M., Hansen, N., & Finch, A. (2001a). Patient-focused research: Using treatment outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159–172. · doi:10.1037/0022-006x.69.2.159 · Paper page
- Lambert, M. J., Harmon, C., Slade, K., Whipple, J. L., & Hawkins, E. J. (2005). Providing feedback to psychotherapists on their patients’ progress: Clinical results and practice suggestions. Journal of Clinical Psychology, 61(2), 165–174. · DOI · Paper page
- Lambert, M. J., Whipple, J. L., Smart, D. W., Vermeersch, D. A., Nielsen, S. L., & Hawkin, E. J. (2001b). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced? Psychotherapy Research, 11, 49–68. · DOI · Paper page
- Leshan, L. A., Fitzsimmons, M., Marbella, A., & Gottlieb, M. (1997). Increasing clinical prevention efforts in a family practice residency program through CQI methods. The Joint Commission Journal on Quality Improvement, 23(7), 391–400. · DOI
- Mazonson, P. D., Mathias, S. D., Fifer, S. K., Buesching, D. P., Malek, P., & Patrick, D. L. (1996). The mental health patient profile: Does it change primary care physicians’ practice patterns? The Journal of the American Board of Family Practice, 9(5), 336–345.
- Mortenson, B. P., & Witt, J. C. (1998). The use of weekly performance feedback to increase teacher implementation of a pre-referral academic intervention. School Psychology Review, 27, 613–627. · DOI · Paper page
- Neuman, G. A., Edwards, J. E., & Raju, N. S. (1989). Organizational development interventions: A meta-analysis of their effects on satisfaction and other attitudes. Personnel Psychology, 42(3), 461–489. · DOI · Paper page
- Olin, S. S., Williams, N., Pollock, M., Armusewicz, K., Kutash, K., Glisson, C., & Hoagwood, K. E. (2014). Quality indicators for family support services and their relationship to organizational social context. Administration and Policy in Mental Health and Mental Health Services Research, 41(1), 43–54. · DOI
- Osborne, D., & Gaebler, T. (1992). Reinventing Government: How the entrepreneurial spirit is transforming the public sector. New York: Plume.
- Parker, C. P., Baltes, B. B., Young, S. A., Huff, J. W., Altmann, R. A., Lacost, H. A., et al. (2003). Relationships between psychological climate perceptions and work outcomes: A meta-analytic review. Journal of Organizational Behavior, 24(4), 389–416. · DOI · Paper page
- Peters, T. J., & Waterman, R. H. (1982). In search of excellence. New York: Harper & Row Inc.
- Robinson, M. B., Thompson, E., & Black, N. A. (1996). Evaluation of the effectiveness of guidelines, audit and feedback: Improving the use of intravenous thrombolysis in patients with suspected acute myocardial infarction. International Journey of Quality Health Care, 8, 211–222.
- Rokstad, K., Straand, J., & Fugelli, P. (1995). Can drug treatment be improved by feedback on prescribing profiles combined with therapeutic recommendations? A prospective, controlled trial in general practice. Journal of Clinical Epidemiology, 48, 1061–1068. · DOI
- Rose, D. J., & Church, R. J. (1998). Learning to teach: The acquisition and maintenance of teaching skills. Journal of Behavioral Education, 8(1), 5–35. · DOI
- Sapyta, J., Riemer, M., & Bickman, L. (2005). Feedback to clinicians: Theory, research, and practice. Journal of Clinical Psychology, 61(2), 145–153. · DOI · Paper page
- Sheridan, J. E. (1992). Organizational culture and employee retention. Academy of Management Journal, 35(5), 1036–1056. · DOI · Paper page
- Shim, M. (2010). Factors influencing child welfare employee’s turnover: Focusing on organizational culture and climate. Children and Youth Services Review, 32(6), 847–856. · DOI
- Tabenkin, H., Steinmetz, D., Eilat, Z., Heman, H., Dagan, B., & Epstein, L. (1995). A peer review programme to audit the management of hypertensive patients in family practices in Israel. Family Practice, 12(3), 309–312. · doi:10.1093/fampra/12.3.309
- Tuckman, B. W., & Yates, D. (1980). Evaluating the student feedback strategy for changing teacher style. Journal of Educational Research, 74(2), 74–77. · doi:10.1080/00220671.1980.10885286
- Unsworth, G., Cowie, H., & Green, A. (2012). Therapists’ and clients’ perceptions of routine outcome measurement in the NHS: A qualitative study. Counselling and Psychotherapy Research: Linking research with practice, 12(1), 71–80. · DOI
- Wolpert, M., Curtis-Tyler, K., & Edbrooke-Childs, J. (2014). A qualitative exploration of patient and clinician views on patient reported outcome measures in child mental health and diabetes services. Administration and Policy in Mental Health and Mental Health Services Research,. doi: 10.1007/s10488-014-0586-9 . · DOI · Paper page
Cited by
Qualitative methods in implementation research: An introduction
Hamilton, A. B., & Finley, E. P. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112516 · Cited by 1,315
Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Rabin, B., & Aarons, G. A. (2019) · Implementation Science · doi:10.1186/s13012-018-0842-6 · Cited by 1,223
“For example, Gleacher and colleagues [52] used qualitative interview data from clinicians to augment quantitative utilization and implementation data to examine multilevel factors associated with adoption and implementation of measurement feedback systems in community mental health clinics.”
Implementing Measurement-Based Care in Behavioral Health: A Review
Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., Douglas, S., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3329 · Cited by 605
Self-citationHogue, A., Dauber, S., Bobek, M., Jensen-Doss, A., & Henderson, C. E. (2019) · Implementation Science · doi:10.1186/s13012-019-0874-6 · Cited by 11
Hogue, A., Bobek, M., MacLean, A., Porter, N., Jensen-Doss, A., & Henderson, C. E. (2019) · Trials · doi:10.1186/s13063-019-3783-8 · Cited by 9
Metadata
- Authors
- Gleacher, A. A., Olin, S. S., Nadeem, E., Pollock, M., Ringle, V., Bickman, L., Douglas, S., & Hoagwood, K.
- Venue
- Administration and Policy in Mental Health and Mental Health Services Research
- Published
- 2015-03-04
- Volume
- 43
- Issue
- 3
- Pages
- 426-440
- ISSN
- 0894-587X (ISSN-L)
- 1573-3289
- OpenAlex
- W1997267607
- Cited by
- 91
- References
- 17
- FWCI
- 12.85
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.springer.com/tdm (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Implementing a Measurement Feedback System in Community Mental Health Clinics: A Case Study of Multilevel Barriers and Facilitators. https://app.cochat.ai/papers/10.1007/s10488-015-0642-0
- The paper
- Gleacher, A. A., Olin, S. S., Nadeem, E., Pollock, M., Ringle, V., Bickman, L., Douglas, S., & Hoagwood, K. (2016). Implementing a Measurement Feedback System in Community Mental Health Clinics: A Case Study of Multilevel Barriers and Facilitators. Administration and Policy in Mental Health and Mental Health Services Research. https://doi.org/10.1007/s10488-015-0642-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.