Measuring Implementation of Evidence-Based Programs Targeting Young Children at Risk for Emotional/Behavioral Disorders: Conceptual Issues and Recommendations
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Young children with and at risk for emotional/behavioral disorders (EBD) present challenges for early childhood teachers. Evidence-based programs designed to address these young children’s behavior problems exist, but there are a number of barriers to implementing these programs in early childhood settings. Advancing the science of treatment integrity measurement can assist researchers and consumers interested in implementing evidence-based programs in early childhood classrooms. To provide guidance for researchers interested in assessing the integrity of implementation efforts, we describe a conceptual model of implementation of evidence-based programs designed to prevent EBD when applied in early childhood settings. Next, we describe steps that can be used to develop treatment integrity measures. Last, we discuss factors to consider when developing treatment integrity measures with specific emphasis on psychometrically strong measures that have maximum utility for implementation research in early childhood classrooms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Donabedian, A. (1988) · JAMA · doi:10.1001/jama.260.12.1743 · Cited by 5,895
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 1×
“The left side of the model focuses on some characteristics of settings in which EBPs are implemented that might influence treatment implementation and outcome (Aarons et al., 2011).”
MethodWelcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254 · cited 1×
“Implementation science has been defined as “the scientific study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practices” (Eccles & Mittman, 2006, p. 1).”
MethodDane, A. V., & Schneider, B. H. (1998) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00043-3 · Cited by 1,557 · cited 1×
“A number of different terms have been proposed: treatment fidelity, treatment adherence, and intervention integrity (Dane & Schneider, 1998; Jones, Clarke, & Power, 2008; McLeod et al., 2009; Sanetti & Kratochwill, 2009).”
BackgroundTesting the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873
Webster‐Stratton, C., Jamila Reid, M., & Stoolmiller, M. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01861.x · Cited by 837 · cited 1×
“For example, some prevention programs may be more universal in nature, with teachers focusing intervention efforts on whole groups or classes of children with the purpose of preventing problem behaviors (e.g., Webster-Stratton et al., 2008).”
BackgroundEffectiveness, Transportability, and Dissemination of Interventions: What Matters When?
Schoenwald, S. K., & Hoagwood, K. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.9.1190 · Cited by 763 · cited 1×
“An important focus of implementation research is to understand how contextual issues influence the delivery of EBPs across a variety of settings (Mendel, Meredith, Schoenbaum, Sherbourne, & Wells, 2008; Schoenwald & Hoagwood, 2001).”
BackgroundBierman, K. L., Nix, R. L., Greenberg, M. T., Blair, C., & Domitrovich, C. E. (2008) · Development and Psychopathology · doi:10.1017/s0954579408000394 · Cited by 720 · cited 10×
“With a similar approach to measuring adherence, Bierman, Nix, Greenberg, Blair, and Domitrovich (2008) used a 4-point Likert-type scale to assess the extensiveness with which teachers in the Head Start REDI project covered the core components of the PK PATHS.”
BackgroundMethodInfluentialChorpita, B. F., & Daleiden, E. L. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0014565 · Cited by 687 · cited 1×
“…of implementation measures, including the characterization of practices used in BAU, items should be designed to measure somewhat broad “therapeutic strategies” (Beutler & Baker, 1998), also called “practice elements” (Chorpita & Daleiden, 2009) or “evidence-based kernels” (Embry & Biglan, 2008).”
MethodSustainability of Teacher Implementation of School-Based Mental Health Programs
Han, S. S., & Weiss, B. (2005) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-005-7646-2 · Cited by 641 · cited 2×
“…problem behavior), and organizational variables at the program level are important (e.g., administrative support, program type/requirements [Head Start vs. community child care], Baker, Kupersmidt, Voegler-Lee, Arnold, & Willoughby, 2010; Domitrovich et al., 2010; Durlak, 2010; Han & Weiss, 2005).”
Background
Cited by
McLeod, B. D., Sutherland, K. S., Martinez, R. G., Conroy, M. A., Snyder, P. A., & Southam-Gerow, M. A. (2017) · Prevention Science · doi:10.1007/s11121-016-0703-y · Cited by 143
Self-citationAdvancing the science of integrity measurement in school mental health research
Sutherland, K. S., & McLeod, B. D. (2022) · School Mental Health · doi:10.1007/s12310-021-09468-0 · Cited by 14
Self-citationBarriers and facilitators to implementation of BEST in CLASS
Granger, K. L., Sutherland, K. S., Conroy, M. A., Hetrick, A. A., & Parnell, E. (2020) · Exceptionality · doi:10.1080/09362835.2020.1727335 · Cited by 5
Self-citation
Metadata
- Authors
- Sutherland, K. S., McLeod, B. D., Conroy, M. A., & Cox, J. R.
- Venue
- Journal of Early Intervention
- Publisher
- SAGE Publications
- Published
- 2013-06
- Volume
- 35
- Issue
- 2
- Pages
- 129-149
- ISSN
- 1053-8151 (ISSN-L)
- 2154-3992
- OpenAlex
- W2008656843
- Cited by
- 50
- References
- 24
- FWCI
- 11.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measuring Implementation of Evidence-Based Programs Targeting Young Children at Risk for Emotional/Behavioral Disorders: Conceptual Issues and Recommendations. https://app.cochat.ai/papers/10.1177/1053815113515025
- The paper
- Sutherland, K. S., McLeod, B. D., Conroy, M. A., & Cox, J. R. (2013). Measuring Implementation of Evidence-Based Programs Targeting Young Children at Risk for Emotional/Behavioral Disorders: Conceptual Issues and Recommendations. Journal of Early Intervention. https://doi.org/10.1177/1053815113515025
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.