The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Methodological Quality Standards for Evaluation Research
Abstract
Evaluation studies vary in methodological quality. It is essential to develop methodological quality standards for evaluation research that can be understood and easily used by scholars, practitioners, policy makers, the mass media, and systematic reviewers. This article proposes that such standards should be based on statistical conclusion validity, internal validity, construct validity, external validity, and descriptive validity. Methodological quality scales are reviewed, and it is argued that efforts should be made to improve them. Pawson and Tilley's challenge to the Campbell evaluation tradition is also assessed. It is concluded that this challenge does not have any implications for methodological quality standards, because the Campbell tradition already emphasizes the need to study moderators and mediators in evaluation research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
(1963) · Medical Entomology and Zoology · Cited by 15,085
(2002) · Cited by 13,211
(1979) · Medical Entomology and Zoology · Cited by 11,252
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,010
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
Serious and Violent Juvenile Offenders: Risk Factors and Successful Interventions
Janson, C.-G., Loeber, R., & Farrington, D. P. (1999) · Contemporary Sociology · doi:10.2307/2655346 · Cited by 1,888
Self-citationA method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Preventing Crime: What Works, What Doesn't, What's Promising: (520902006-001)
Sherman, L. W., Gottfredson, D. C., MacKenzie, D. L., Eck, J., Reuter, P., & Bushway, S. D. (1998) · PsycEXTRA Dataset · doi:10.1037/e520902006-001 · Cited by 1,108
Cited by
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Effectiveness of school-based programs to reduce bullying: a systematic and meta-analytic review
Ttofi, M. M., & Farrington, D. P. (2011) · Journal of Experimental Criminology · doi:10.1007/s11292-010-9109-1 · Cited by 1,624
Self-citationUniversities–industry collaboration: A systematic review
Ankrah, S., & AL-Tabbaa, O. (2015) · Scandinavian Journal of Management · doi:10.1016/j.scaman.2015.02.003 · Cited by 980
The effectiveness of treatment for sexual offenders: a comprehensive meta-analysis
L�sel, F., & Schmucker, M. (2005) · Journal of Experimental Criminology · doi:10.1007/s11292-004-6466-7 · Cited by 806
School-based programs to reduce bullying and victimization: (528362010-001)
Farrington, D. P., & Ttofi, M. M. (2009) · PsycEXTRA Dataset · doi:10.1037/e528362010-001 · Cited by 667
Self-citation
Metadata
- Authors
- Farrington, D. P.
- Venue
- The ANNALS of the American Academy of Political and Social Science
- Publisher
- SAGE Publications
- Published
- 2003-05
- Volume
- 587
- Issue
- 1
- Pages
- 49-68
- ISSN
- 0002-7162 (ISSN-L)
- 1552-3349
- OpenAlex
- W2060823110
- Cited by
- 352
- References
- 37
- FWCI
- 16.89
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Methodological Quality Standards for Evaluation Research. https://app.cochat.ai/papers/10.1177/0002716202250789
- The paper
- Farrington, D. P. (2003). Methodological Quality Standards for Evaluation Research. The ANNALS of the American Academy of Political and Social Science. https://doi.org/10.1177/0002716202250789
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.