Measuring the fidelity of implementation of a mental health program model.

Abstract

A fidelity index of program implementation for assertive community treatment (ACT) was developed. In Study 1, 20 experts rated the importance of 73 elements proposed as critical ACT ingredients, also indicating ideal model specifications for elements. Agreement among experts on ratings of importance was high (intraclass r = .98). In Study 2, a 17-item subset of the expert-identified critical ingredients was used to construct a fidelity index with three subscales: Staffing, Organization, and Service. Internal consistencies ranged from .50 to .72, with a .81 reliability for the total scale. Fidelity was linearly related to program "generations," suggesting "program drift." In 18 ACT programs, fidelity also was associated with measures of reduction in days in psychiatric hospitals. The correlation was significant for the total scale and for the Organization and Staffing subscales but not for the Service subscale.

Cites (3)

1. Alternative to Mental Hospital Treatment: I. Conceptual Model, Treatment Program, and Clinical Evaluation
   Stein, Leonard I. · 1980 · Archives of General Psychiatry
2. Treatment fidelity in outcome studies
   Moncher, Frank J., Prinz, Ronald J. · 1991 · Clinical Psychology Review
3. The functions of program theory
   Bickman, Leonard · 1987 · New Directions for Program Evaluation

Show all 3 references

Cited by (14)

1. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings
   Dusenbury, L. · 2003 · Health Education Research
2. The 2009 schizophrenia PORT psychosocial treatment recommendations and summary statements
   Dixon, L. B., Dickerson, F., Bellack, A. S., Bennett, M., Dickinson, D., Goldberg, R. W., Lehman, A., Tenhula, W. N., Calmes, C., Pasillas, R. M. et al. · 2010 · Schizophrenia Bulletin
3. Effectiveness, Transportability, and Dissemination of Interventions: What Matters When?
   Schoenwald, Sonja K., Hoagwood, Kimberly · 2001 · Psychiatric Services
4. Assertive Community Treatment for People with Severe Mental Illness: Critical Ingredients and Impact on Patients
   Bond, Gary R., Drake, Robert E., Mueser, Kim T., Latimer, Eric · 2001 · Disease Management and Health Outcomes
5. Assertive community treatment for people with severe mental disorders
   Marshall, Max, Lockwood, Austin · 1998 · Cochrane Database of Systematic Reviews · Retracted

See all 380