The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Opening the Black Box: Using Process Evaluation Measures to Assess Implementation and Theory Building
Abstract
The past decade has seen increasing recognition in prevention science of the need to move away from a black box approach to intervention evaluation and toward an approach that can elaborate on the mechanisms through which changes in the outcomes operate (Chen & Rossi, 1989; Durlak & Wells, 1997; Spoth et al., 1995). An approach that examines issues of program implementation is particularly critical in the design of efficacy studies of school‐based preventive interventions. Numerous preventive intervention strategies are now delivered within the schools, often by regular classroom teachers. The extent to which teachers faithfully deliver a particular curriculum or incorporate instructional strategies emphasized by an intervention is a critical question for the overall project evaluation. This article illustrates the utilization of process measures from a multicomponent school‐based prevention program to examine implementation of a teaching staff development intervention, and the program's underlying theoretical basis. Given the nested study design, the analyses utilize hierarchical linear models (Bryk & Raudenbush, 1992) to examine changes in teaching strategies by condition and investigate the hypothesized relationships between teaching practices and student behaviors based on the program's theoretical framework. Results suggest that teaching practices in two of the six intervention focus areas were positively impacted in the first 18 months of the project. Findings also support th relationships between teachers' instructional practices and students' behaviour.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Handbook of research on teaching
Wittrock, M. C. (1986) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 10,626
Hawkins, J. D., Catalano, R. F., & Miller, J. Y. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.1.64 · Cited by 5,428
Self-citationCooperative Learning: Theory, Research and Practice
Slavin, R. E. (1983) · Cited by 3,757
Hierarchical Linear Models: Applications and Data Analysis Methods.
Goldstein, H., Bryk, A. S., & Raudenbush, S. W. (1993) · Journal of the American Statistical Association · doi:10.2307/2290750 · Cited by 3,321
Manual for the Teacher's Report Form and 1991 Profile
Achenbach, T. M. (1991) · Medical Entomology and Zoology · Cited by 2,024
Application of hierarchical linear models to assessing change.
Bryk, A. S., & Raudenbush, S. W. (1987) · Psychological Bulletin · doi:10.1037//0033-2909.101.1.147 · Cited by 1,514
Classroom Organization and Management
Brophy, J. E. (1983) · The Elementary School Journal · doi:10.1086/461318 · Cited by 1,263
Delinquency and crime : current theories
Hawkins, J. D. (1996) · Cited by 1,174
The social development model: A theory of antisocial behavior.
Catalano, R. F., & Hawkins, J. D. (1996) · Cited by 1,096
Self-citation
Cited by
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
Dusenbury, L. (2003) · Health Education Research · doi:10.1093/her/18.2.237 · Cited by 1,671
O’Donnell, C. L. (2008) · Review of Educational Research · doi:10.3102/0034654307313793 · Cited by 1,032
Saunders, R. P., Evans, M. H., & Joshi, P. (2005) · Health Promotion Practice · doi:10.1177/1524839904273387 · Cited by 1,031
Implementation Mapping: Using Intervention Mapping to Develop Implementation Strategies
Fernandez, M. E., ten Hoor, G. A., van Lieshout, S., Rodriguez, S. A., Beidas, R. S., Parcel, G., Ruiter, R. A. C., Markham, C. M., & Kok, G. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00158 · Cited by 914
Metadata
- Authors
- Harachi, T. W., Abbott, R. D., Catalano, R. F., Haggerty, K. P., & Fleming, C. B.
- Venue
- American Journal of Community Psychology
- Publisher
- Wiley
- Published
- 1999-10
- Volume
- 27
- Issue
- 5
- Pages
- 711-731
- ISSN
- 0091-0562 (ISSN-L)
- 1573-2770
- OpenAlex
- W2148682946
- Cited by
- 269
- References
- 48
- FWCI
- 5.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Opening the Black Box: Using Process Evaluation Measures to Assess Implementation and Theory Building. https://app.cochat.ai/papers/10.1023/a:1022194005511
- The paper
- Harachi, T. W., Abbott, R. D., Catalano, R. F., Haggerty, K. P., & Fleming, C. B. (1999). Opening the Black Box: Using Process Evaluation Measures to Assess Implementation and Theory Building. American Journal of Community Psychology. https://doi.org/10.1023/a%3A1022194005511
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.