The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
A Framework for Measuring Fidelity of Implementation: A Foundation for Shared Language and Accumulation of Knowledge
Abstract
There is a growing recognition of the value of measuring fidelity of implementation (FOI) as a necessary part of evaluating interventions. However, evaluators do not have a shared conceptual understanding of what FOI is and how to measure it. Thus, the creation of FOI measures is typically a secondary focus and based on specific contexts and programs. This article describes a project that holds the development of FOI measures as its primary goal and has developed a suite of data collection tools designed to be used across multiple programs. It describes the foundation of the suite—a conceptual framework for clearly and specifically describing FOI and the need for the framework. It also describes where the framework resides in existing literature and how it can be used to support measurement of interventions in education and other fields.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Journal for Research in Mathematics Education
(2023) · Journal for Research in Mathematics Education · doi:10.5951/jresematheduc · Cited by 2,764
Dusenbury, L. (2003) · Health Education Research · doi:10.1093/her/18.2.237 · Cited by 1,671
Dane, A. V., & Schneider, B. H. (1998) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00043-3 · Cited by 1,557 · cited 11×
“It is our hope that this work can respond to the recommendations of past works that call for increased clarity in FOI measures, specific descriptions of interventions, and the development of a theoretical framework (Dane & Schneider, 1998; Leithwood & Montgomery, 1980; O’Donnell, 2008).”
BackgroundMethodInfluentialChange in schools : facilitating the process
Hall, G. E., & Hord, S. M. (1987) · Cited by 1,109
O’Donnell, C. L. (2008) · Review of Educational Research · doi:10.3102/0034654307313793 · Cited by 1,032
Fidelity Criteria: Development, Measurement, and Validation
MOWBRAY, C. (2003) · The American Journal of Evaluation · doi:10.1016/s1098-2140(03)00057-2 · Cited by 884
Research on Curriculum and Instruction Implementation
Fullan, M., & Pomfret, A. (1977) · Review of Educational Research · doi:10.2307/1170134 · Cited by 732
A Developmental Model for Determining Whether the Treatment Is Actually Implemented
Hall, G. E., & Loucks, S. F. (1977) · American Educational Research Journal · doi:10.2307/1162291 · Cited by 353
Measurement of Fidelity in Psychiatric Rehabilitation
Bond, G. R., Evans, L., Salyers, M. P., Williams, J., & Kim, H.-W. (2000) · Mental Health Services Research · doi:10.1023/a:1010153020697 · Cited by 302
TREATMENT INTEGRITY IN APPLIED BEHAVIOR ANALYSIS WITH CHILDREN
Gresham, F. M., Gansle, K. A., & Noell, G. H. (1993) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1993.26-257 · Cited by 299
The fidelity‐adaptation debate: Implications for the implementation of public sector social programs
Blakely, C. H., Mayer, J. P., Gottschalk, R. G., Schmitt, N., Davidson, W. S., Roitman, D. B., & Emshoff, J. G. (1987) · American Journal of Community Psychology · doi:10.1007/bf00922697 · Cited by 297
Evaluation Methods for Social Intervention
Lipsey, M. W., & Cordray, D. S. (2000) · Annual Review of Psychology · doi:10.1146/annurev.psych.51.1.345 · Cited by 220
Reinventing fidelity: The transfer of social technology among settings
Bauman, L. J., Stein, R. E. K., & Ireys, H. T. (1991) · American Journal of Community Psychology · doi:10.1007/bf00937995 · Cited by 208
Fidelity of Supported Employment Programs and Employment Outcomes
Becker, D. R., Smith, J., Tanzman, B., Drake, R. E., & Tremblay, T. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.6.834 · Cited by 178
Implementation of a teacher-delivered sex education programme: obstacles and facilitating factors
Buston, K. (2002) · Health Education Research · doi:10.1093/her/17.1.59 · Cited by 175
A Survey Measuring Elementary Teachers' Implementation of Standards-Based Mathematics Teaching
Ross, J. A., McDougall, D. E., Hogaboam‐Gray, A., & LeSage, A. (2003) · Journal for Research in Mathematics Education · doi:10.2307/30034787 · Cited by 156
Evaluating Program Implementation
Leithwood, K. A., & Montgomery, D. J. (1980) · Evaluation Review · doi:10.1177/0193841x8000400202 · Cited by 108
Bodilly, S. J. (1998) · Cited by 106
Assessing Fidelity to a Community-Based Treatment for Youth: The Wraparound Fidelity Index
Bruns, E. J., Burchard, J. D., Suter, J. C., Leverentz-Brady, K. M., & Force, M. M. (2004) · Journal of Emotional and Behavioral Disorders · doi:10.1177/10634266040120020201 · Cited by 98
Balfanz, R. W., Iver, D. J. M., & Byrnes, V. (2006) · Journal for Research in Mathematics Education · Cited by 88
Penuel, W. R., & Means, B. (2004) · Journal of Research in Science Teaching · doi:10.1002/tea.20002 · Cited by 87
Ysseldyke, J., Spicuzza, R., Kosciolek, S., Teelucksingh, E., Boys, C., & Lemkuil, A. (2003) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr0802_4 · Cited by 70 · cited 1×
“Others have used similar approaches with indicators of use ranging from the reporting of data to the numbers of problems attempted from a program to the use of student worksheets (Penuel & Means, 2004; Songer & Gotwals, 2005; Ysseldyke et al., 2003).”
MethodA conceptual framework for effective implementation of JIT
Wafa, M. A., & Yasin, M. M. (1998) · International Journal of Operations & Production Management · doi:10.1108/01443579810231697 · Cited by 70
Implementing Conceptual Change Teaching in Primary Science
Neale, D. C., Smith, D. C., & Johnson, V. G. (1990) · The Elementary School Journal · doi:10.1086/461641 · Cited by 66
Implementing Assertive Community Treatment Programs in Rural Settings
McDonel, E. C., Bond, G. R., Salyers, M. P., Fekete, D. M., Chen, S. A., McGrew, J. H., & Miller, L. (1997) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1023/a:1022286921362 · Cited by 48
Implementing a Community-Based Social Marketing Project to Improve Agricultural Worker Health
Flocks, J. D., Clarke, L., Albrecht, S., Bryant, C., Monaghan, P., & Baker, H. K. (2001) · Environmental Health Perspectives · doi:10.1289/ehp.01109s3461 · Cited by 47
Emshoff, J. G., Blakely, C. H., Gottschalk, R. G., Mayer, J., Davidson, W. S., & Erickson, S. K. (1987) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737009004300 · Cited by 46
Evaluating Program Implementation: What Can Be Learned from Follow Through
Fullan, M. J. (1983) · Curriculum Inquiry · doi:10.1080/03626784.1983.11075881 · Cited by 43
The Utility of Degree of Implementation Measures in Program Implementation and Evaluation Research
Wang, M. C., Nojan, M., Strom, C. D., & Walberg, H. J. (1984) · Curriculum Inquiry · doi:10.1080/03626784.1984.11075926 · Cited by 31
Fidelity of Implementation in Three Sequential Curricular Units
Songer, N. B., & Gotwals, A. W. (2005) · Cited by 24
Program implementation and evaluation results
Rezmovic, E. L. (1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90017-9 · Cited by 10
Gersten, R. M., & Carnine, D. W. (1980) · Cited by 2
Cited by
Implementation Mapping: Using Intervention Mapping to Develop Implementation Strategies
Fernandez, M. E., ten Hoor, G. A., van Lieshout, S., Rodriguez, S. A., Beidas, R. S., Parcel, G., Ruiter, R. A. C., Markham, C. M., & Kok, G. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00158 · Cited by 914
An Agenda for Research on the Sustainability of Public Health Programs
Scheirer, M. A., & Dearing, J. W. (2011) · American Journal of Public Health · doi:10.2105/ajph.2011.300193 · Cited by 775
Kalolo, A., Gautier, L., Radermacher, R., Srivastava, S., Meshack, M., & De Allegri, M. (2021) · BMC Public Health · doi:10.1186/s12889-020-10013-y · Cited by 429
Stains, M., & Vickrey, T. (2017) · CBE—Life Sciences Education · doi:10.1187/cbe.16-03-0113 · Cited by 177
Kang, Y., Rahrig, H., Eichel, K., Niles, H. F., Rocha, T., Lepp, N. E., Gold, J., & Britton, W. B. (2018) · Journal of School Psychology · doi:10.1016/j.jsp.2018.03.004 · Cited by 143
Metadata
- Authors
- Century, J., Rudnick, M., & Freeman, C.
- Venue
- American Journal of Evaluation
- Publisher
- SAGE Publications
- Published
- 2010-05-11
- Volume
- 31
- Issue
- 2
- Pages
- 199-218
- ISSN
- 1098-2140 (ISSN-L)
- 1557-0878
- OpenAlex
- W2122396114
- Cited by
- 351
- References
- 32
- FWCI
- 20.06
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.