Advances in Fidelity Measurement for Mental Health Services Research: Four Measures
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Mental health intervention research requires clear and accurate specification of treatment conditions in intervention studies. Measures are increasingly available for community-based interventions for persons with serious mental illnesses. Measures must go beyond structural features to assess critical processes in interventions. They must also balance effectiveness, or adequate coverage of active treatment elements, with efficiency, or the degree to which measures may be used cost-effectively. The context of their use is changing with the emergence of new frameworks for implementation research and quality improvement. To illustrate a range of approaches, this article describes four recently developed fidelity measures: Cognitive Therapy for Psychosis Adherence Scale, Strengths Model Fidelity Scale, Illness Management and Recovery Program Fidelity Scale, and Tool for Measurement of ACT. The fidelity measures assess interventions in a range of treatment contexts from dyads to teams. Each measure focuses assessment resources on critical elements. Each has demonstrated coverage of its target intervention and satisfactory psychometric properties and is related to outcomes. Measures have been used for training, quality improvement, or certification. They assess domains and have uses beyond their nominal position in implementation and quality frameworks. This review of recent fidelity measures indicates that process components in community-based interventions can be effectively assessed. Omission of elements assessing potentially critical active treatment components poses risk to both research and practice until there is evidence to demonstrate that they are nonessential. Further development of fidelity measurement theory and approaches should proceed in conjunction with development of theory and methods in implementation science.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Donabedian, A. (1988) · JAMA · doi:10.1001/jama.260.12.1743 · Cited by 5,895 · cited 1×
“Within the classic structure-process-outcome quality framework (13), fidelity measures typically include both structure and process elements.”
Stein, L. I. (1980) · Archives of General Psychiatry · doi:10.1001/archpsyc.1980.01780170034003 · Cited by 1,902
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894
Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873
Treatment fidelity in outcome studies
Moncher, F. J., & Prinz, R. J. (1991) · Clinical Psychology Review · doi:10.1016/0272-7358(91)90103-2 · Cited by 797 · cited 1×
“For example, inferences about effects in experimental studies depend on fidelity: therapists’ adherence to the intended treatment, their competence to apply it, and sufficient differentiation across conditions (1,2).”
Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.829 · Cited by 533
Henggeler, S. W., Pickrel, S. G., & Brondino, M. J. (1999) · Mental Health Services Research · doi:10.1023/a:1022373813261 · Cited by 449
Measurement of Fidelity in Psychiatric Rehabilitation
Bond, G. R., Evans, L., Salyers, M. P., Williams, J., & Kim, H.-W. (2000) · Mental Health Services Research · doi:10.1023/a:1010153020697 · Cited by 302
Garety, P. A., Fowler, D. G., Freeman, D., Bebbington, P., Dunn, G., & Kuipers, E. (2008) · British Journal of Psychiatry · doi:10.1192/bjp.bp.107.043570 · Cited by 296
Shortell, S. M. (2004) · Medical Care Research and Review · doi:10.1177/1077558704266768 · Cited by 145 · cited 1×
“This implementation research framework itself draws on a model for assessing change at four levels: individual, group or team, organization, and larger system and environment (20).”
Cited by
Uses and abuses of recovery: implementing recovery-oriented practices in mental health systems
Slade, M., Amering, M., Farkas, M., Hamilton, B., O'Hagan, M., Panther, G., Perkins, R., Shepherd, G., Tse, S., & Whitley, R. (2014) · World Psychiatry · doi:10.1002/wps.20084 · Cited by 949
Key attributes of integrated community-based youth service hubs for mental health: a scoping review
Settipani, C. A., Hawke, L. D., Cleverley, K., Chaim, G., Cheung, A., Mehra, K., Rice, M., Szatmari, P., & Henderson, J. (2019) · International Journal of Mental Health Systems · doi:10.1186/s13033-019-0306-7 · Cited by 172
“Some models discussed the role of support or outreach workers in linking clients to services outside the ICYSH and maintaining connection and follow up [34, 72].”
BackgroundSatre, D. D., Ly, K., Wamsley, M., Curtis, A., & Satterfield, J. (2017) · JMIR Research Protocols · doi:10.2196/resprot.7070 · Cited by 13
Metadata
- Authors
- Teague, G. B., Mueser, K. T., & Rapp, C. A.
- Venue
- Psychiatric Services
- Published
- 2012-08
- Volume
- 63
- Issue
- 8
- Pages
- 765-771
- ISSN
- 0022-1597 (ISSN-L)
- 1075-2730
- 1557-9700
- OpenAlex
- W2122406162
- Cited by
- 48
- References
- 10
- FWCI
- 5.95
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.