Ethical Practice and Evaluation of Interventions in Crime and Justice: The Moral Imperative for Randomized Trials
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
In considering the ethical dilemmas associated with randomized experiments, scholars ordinarily focus on the ways in which randomization of treatments or interventions violates accepted norms of conduct of social science research more generally or evaluation of crime and justice questions more specifically. The weight of ethical judgment is thus put on experimental research to justify meeting ethical standards. In this article, it is argued that just the opposite should be true, and that in fact there is a moral imperative for the conduct of randomized experiments in crime and justice. That imperative develops from our professional obligation to provide valid answers to questions about the effectiveness of treatments, practices, and programs. It is supported by a statistical argument that makes randomized experiments the preferred method for ruling out alternative causes of the outcomes observed. Common objections to experimentation are reviewed and found overall to relate more to the failure to institutionalize experimentation than to any inherent limitations in the experimental method and its application in crime and justice settings. It is argued that the failure of crime and justice practitioners, funders, and evaluators to develop a comprehensive infrastructure for experimental evaluation represents a serious violation of professional standards.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
General deterrent effects of police patrol in crime “hot spots”: A randomized, controlled trial
Sherman, L. W., & Weisburd, D. (1995) · Justice Quarterly · doi:10.1080/07418829500096221 · Cited by 1,029 · cited 1×
“…with domestic violence (e.g., see Dunford, Huizinga, and Elliott 1990; Hirschel et al. 1990; Pate, Hamilton, and Annan 1991; Sherman 1992; Sherman and Berk 1984; Sherman and Cohn 1989) and crime hot spots (e.g., see Sherman and Rogan 1995; Sherman and Weisburd 1995; Weisburd and Green 1995).”
BackgroundSelf-citationPolicing drug hot spots: The Jersey City drug market analysis experiment
Weisburd, D., & Green, L. (1995) · Justice Quarterly · doi:10.1080/07418829500096261 · Cited by 583
Self-citationCures That Harm: Unanticipated Outcomes of Crime Prevention Programs
McCord, J. (2003) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716202250781 · Cited by 338
Does research design affect study outcomes in criminal justice?
Weisburd, D., Lum, C. M., & Petrosino, A. (2001) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/000271620157800104 · Cited by 335
Self-citationRandomised Controlled Trials for Evidence-based Education: Some Problems in Judging 'What Works'
Morrison, K. (2001) · Evaluation & Research in Education · doi:10.1080/09500790108666984 · Cited by 90 · cited 1×
“…to experimentation (e.g., see Bauman, Tsui, and Viadro 1994; Dunford 1990; Feder, Jolin, and Feyerherm, 2000; Heckman and Smith 1995; Mitroff 1983; Morrison 2001; Petersilia 1989; White and Pezzino 1986), I think it useful to focus particular attention on concerns raised by Clarke and Cornish…”
BackgroundResolving Ethical and Legal Problems in Randomized Experiments
Boruch, R. F., Victor, T., & Cecil, J. S. (2000) · Crime & Delinquency · doi:10.1177/0011128700046003005 · Cited by 40
Research works printed but not linked: 40
- Bauman, K., A. Tsui, and C. Viadro. 1994. Use of true experimental designs for family planning program evaluation: Merits, problems and solutions. International Family Planning Perspectives 20 (3): 111-113. · doi:10.2307/2133513
- 10.1111/j.1745-9125.1980.tb01307.x · DOI
- 10.1111/j.1532-5415.1994.tb04977.x · DOI
- Boruch, R. 1975. On common contentions about randomized field experiments. In Experimental testing of public policy: The Proceedings of the 1974 Social Sciences Research Council Conference on Social Experimentation, edited by R. F. Boruch and H. W. Reicken, 107-142. Boulder, CO: Westview Press.
- 10.1177/0011128700046002002 · DOI · Paper page
- Campbell, D. T., and R. Boruch. 1975. Making the case for randomized assignments to treatments by considering the alternatives: Six ways in which quasi-experimental evaluations in compensatory education tend to underestimate effects. In Central issues in social program evaluation, edited by C. Bennett and A. Lumsdaine. New York: Academic Press. · DOI · Paper page
- Dennis, M. L. 1988. Implementing randomized field experiments: An analysis of criminal and civil justice research. Unpublished dissertation, Northwestern University. Ann Arbor, MI: University Microfilms.
- 10.1016/0149-7189(90)90040-4 · doi:10.1016/0149-7189(90)90040-4
- 10.1111/j.1745-9125.1990.tb01323.x · DOI · Paper page
- Eck, J. 2002. Learning from experience in problem oriented policing and crime prevention: The positive function of weak evaluations and the negative functions of strong ones. In Evaluation for crime prevention: Crime prevention studies, Vol. 14, edited by N. Tilley, 93-117. Monsey, NY: Criminal Justice Press.
- Esbensen, F. 1991. Ethical considerations in criminal justice research. American Journal of Police 10 (2): 87-104.
- 10.1016/0047-2352(86)90107-8 · DOI
- Farrington, D. Forthcoming. British randomized experiments on crime and justice. Annals of the American Academy of Political and Social Science.
- Farrington, D. 1983. Randomized experiments in crime and justice. In Crime and justice: An annual review of research, edited by N. Morris and M. Tonry, 257-308. Chicago: University of Chicago Press. · DOI · Paper page
- 10.1177/0011128700046003001 · DOI
- 10.1177/0011128700046003007 · DOI
- 10.1177/016327878200500104 · DOI
- 10.1002/sim.4780010413 · DOI
- 10.1177/0193841X03027003006 · DOI
- 10.1177/0011128700046002008 · doi:10.1177/0011128700046002008
- 10.1257/jep.9.2.85 · DOI · Paper page
- Hill, B. 1962. Principles of medical statistics. New York: Oxford University Press.
- 10.1177/0193841X03027003004 · doi:10.1177/0193841x03027003004
- 10.1177/0011128700046003004 · DOI
- 10.1177/0193841X03027003003 · DOI
- 10.1177/0193841X8901300501 · DOI · Paper page
- Petrosino, A. 1997. “What works?” revisited again: A meta-analysis of randomized field experiments in individual level interventions. Unpublished dissertation. Ann Arbor, MI: University Microfilms.
- Petrosino, A. 1998. A survey of 150 randomized experiments in crime reduction: Some preliminary findings. Forum (Justice Research and Statistics Association) 16 (1): 7-8.
- 10.1177/000271620157800102 · doi:10.1177/000271620157800102 · Paper page
- 10.1177/0011128700046003006 · DOI · Paper page
- 10.1177/0193841X03027003005 · DOI
- Sherman, L. 1992. Policing domestic violence: Experiments and dilemmas. New York: The Free Press.
- 10.2307/2095575 · DOI · Paper page
- 10.2307/3053883 · DOI · Paper page
- 10.1080/07418829500096281 · DOI · Paper page
- Sieber, J. Ed. 1982. The ethics of social research. New York: Springer-Verlag. · doi:10.1007/978-1-4612-5722-6
- Stanley, K., M. Stjernsward, and M. Isley. 1981. The conduct of a cooperative clinical trial. New York: Springer-Verlag. · doi:10.1007/978-3-642-81630-7
- 10.1177/0011128700046002003 · DOI · Paper page
- 10.1023/A:1007574906103 · DOI
- 10.1177/027112148600600308 · doi:10.1177/027112148600600308
Cited by
What Can Police Do to Reduce Crime, Disorder, and Fear?
Weisburd, D., & Eck, J. E. (2004) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716203262548 · Cited by 790
Self-citationWEISBURD, D., WYCKOFF, L. A., READY, J., ECK, J. E., HINKLE, J. C., & GAJEWSKI, F. (2006) · Criminology · doi:10.1111/j.1745-9125.2006.00057.x · Cited by 533
Self-citationWhat Can Police Do to Reduce Crime, Disorder, and Fear?
Eck, J., & Weisburd, D. (2007) · International Handbook of Penology and Criminal Justice · doi:10.1201/9781420053883.ch14 · Cited by 527
Self-citationGaffney, H., Ttofi, M. M., & Farrington, D. P. (2019) · Aggression and Violent Behavior · doi:10.1016/j.avb.2018.07.001 · Cited by 518
Gaffney, H., Farrington, D. P., Espelage, D. L., & Ttofi, M. M. (2019) · Aggression and Violent Behavior · doi:10.1016/j.avb.2018.07.002 · Cited by 363
Metadata
- Authors
- Weisburd, D.
- Venue
- Evaluation Review
- Publisher
- SAGE Publications
- Published
- 2003-06
- Volume
- 27
- Issue
- 3
- Pages
- 336-354
- ISSN
- 0145-4692 (ISSN-L)
- 0193-841X
- 1552-3926
- OpenAlex
- W2018680716
- Cited by
- 135
- References
- 7
- FWCI
- 8.69
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Ethical Practice and Evaluation of Interventions in Crime and Justice: The Moral Imperative for Randomized Trials. https://app.cochat.ai/papers/10.1177/0193841x03027003007
- The paper
- Weisburd, D. (2003). Ethical Practice and Evaluation of Interventions in Crime and Justice: The Moral Imperative for Randomized Trials. Evaluation Review. https://doi.org/10.1177/0193841x03027003007
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.