The Effects of “Pulling Levers” Focused Deterrence Strategies on Crime
Open accessAbstract
This Campbell systematic review assesses the effectiveness of focused deterrence strategies known as “pulling levels” in reducing crime. The review summarises findings from 10 studies, all of which report evidence from programmes in the US. Pulling levers focused deterrence strategies are associated with a medium-sized crime reduction effect. Nine out of 10 studies reported a statistically significant positive effect. There is a strongly significant medium size effect average effect across all studies. Gang or group intervention programs had the largest effect, followed by the drug market intervention programs, with the smallest but still statistically significant effect for the high-risk individuals programs. All included studies use non-randomized experimental designs, which have a risk of over-stating impact. However, the effect size is large enough to have reasonable confidence in the effectiveness of these programs. Abstract: BACKGROUND: A number of American police departments have been experimenting with new problem-oriented policing frameworks to prevent gang and group-involved violence generally known as the “pulling levers” focused deterrence strategies. Focused deterrence strategies honor core deterrence ideas, such as increasing risks faced by offenders, while finding new and creative ways of deploying traditional and non-traditional law enforcement tools to do so, such as directly communicating incentives and disincentives to targeted offenders. Pioneered in Boston to halt serious gang violence, the focused deterrence framework has been applied in many American cities through federally sponsored violence prevention programs. In its simplest form, the approach consists of selecting a particular crime problem, such as gang homicide; convening an interagency working group of law enforcement, social-service, and community-based practitioners; conducting research to identify key offenders, groups, and behavior patterns; framing a response to offenders and groups of offenders that uses a varied menu of sanctions (”pulling levers”) to stop them from continuing their violent behavior; focusing social services and community resources on targeted offenders and groups to match law enforcement prevention efforts; and directly and repeatedly communicating with offenders to make them understand why they are receiving this special attention. These new strategic approaches have been applied to a range of crime problems, such as overt drug markets and individual repeat offenders, and have shown promising results in the reduction of crime. OBJECTIVES: To synthesize the extant evaluation literature and assess the effects of pulling levers focused deterrence strategies on crime. SELECTION CRITERIA: Eligible studies had to meet three criteria: (1) the program had to have the core elements of a pulling levers focused deterrence strategy present; (2) a comparison group was included; (3) at least one crime outcome was reported. The units of analysis had to be people or places. SEARCH STRATEGY: Several strategies were used to perform an exhaustive search for literature fitting the eligibility criteria. First, a keyword search was performed on an array of online abstract databases. Second, we reviewed the bibliographies of past narrative and empirical reviews of literature that examined the effectiveness of pulling levers focused deterrence programs. Third, we performed forward searches for works that have cited seminal focused deterrence studies. Fourth, we searched bibliographies of narrative reviews of police crime prevention efforts and past completed Campbell systematic reviews of police crime prevention efforts. Fifth, we performed hand searches of leading journals in the field. DATA COLLECTION AND ANALYSIS: For our ten eligible studies, we complete a narrative review of effectiveness and a formal meta-analysis of the main effects of these programs on reported crime outcomes. MAIN RESULTS: Based on our narrative review, we find that nine of the ten eligible evaluations reported statistically significant reductions in crime. It is important to note here that all ten evaluations used nonrandomized quasi-experimental designs. No randomized controlled trials were identified by our search strategies. Our meta-analysis suggests that pulling levers focused deterrence strategies are associated with an overall statistically-significant, medium-sized crime reduction effect. CONCLUSIONS: We conclude that pulling levers focused deterrence strategies seem to be effective in reducing crime. However, we urge caution in interpreting these results because of the lack of more rigorous randomized controlled trials in the existing body of scientific evidence on this approach.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
SUTVA posits that the assignment of units to treatment or control groups should not influence the outcomes of other units.
“SUTVA posits that the assignment of units to treatment or control groups should not influence the outcomes of other units (Braga et al., 2012(Braga et al., , 2018)).”
From ‘Led by Intelligence': A Scoping Review on the Experimental Evaluation of Intelligence-Led Policing (2024) · cites this paper as Braga et al., 2012
The cited paper’s sections on outcome measures (3.1.4) and crime effects (4.3) discuss spillover and diffusion into non-treated areas, but they do not define SUTVA or state what it posits. Searches for SUTVA, interference, and treatment assignment found no passage addressing the attributed definition. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Neighborhoods and Violent Crime: A Multilevel Study of Collective Efficacy
Sampson, R. J., Raudenbush, S. W., & Earls, F. (1997) · Science · doi:10.1126/science.277.5328.918 · Cited by 11,999 · see citing works
(1979) · Medical Entomology and Zoology · Cited by 11,252 · see citing works
(2000) · Cited by 9,198 · see citing works
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955 · see citing works
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791 · see citing works
Tyler, T. R. (2004) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716203262627 · Cited by 1,282 · see citing works
Counterfactuals and Causal Inference: Methods and Principles for Social Research
Morgan, S. L., & Winship, C. (2007) · doi:10.1017/cbo9780511804564 · Cited by 1,146 · see citing works
Crime, Punishment, and Deterrence
Trilling, C., & Gibbs, J. P. (1976) · The Journal of Criminal Law and Criminology (1973-) · doi:10.2307/1142953 · Cited by 1,056 · see citing works
What Can Police Do to Reduce Crime, Disorder, and Fear?
Weisburd, D., & Eck, J. E. (2004) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716203262548 · Cited by 790 · see citing works
Self-citationPaternoster, R. (1987) · Justice Quarterly · doi:10.1080/07418828700089271 · Cited by 619 · see citing works
BRAGA, A. A., KENNEDY, D. M., WARING, E. J., & PIEHL, A. M. (2001) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427801038003001 · Cited by 589 · see citing works
Self-citationDo Fair Procedures Matter? The Effect of Procedural Justice on Spouse Assault
Paternoster, R., Bachman, R., Brame, R., & Sherman, L. W. (1997) · Law & Society Review · doi:10.2307/3054098 · Cited by 588 · see citing works
WEISBURD, D., WYCKOFF, L. A., READY, J., ECK, J. E., HINKLE, J. C., & GAJEWSKI, F. (2006) · Criminology · doi:10.1111/j.1745-9125.2006.00057.x · Cited by 533 · see citing works
Self-citationDurlauf, S. N., & Nagin, D. S. (2011) · Criminology & Public Policy · doi:10.1111/j.1745-9133.2010.00680.x · Cited by 404 · see citing works
The Effects of Hot Spots Policing on Crime
Braga, A. A. (2001) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/000271620157800107 · Cited by 390 · see citing works
Self-citationCrime Prevention and the Displacement Phenomenon
Reppetto, T. A. (1976) · Crime & Delinquency · doi:10.1177/001112877602200204 · Cited by 374 · see citing works
DIFFUSION OF CRIME CONTROL BENEFITS: OBSERVATIONS ON THE REVERSE OF DISPLACEMENT
Clarke, R. V., & Weisburd, D. L. (2006) · Cited by 346 · see citing works
Self-citationYouth Violence in Boston: Gun Markets, Serious Youth Offenders, and a Use-Reduction Strategy
Kennedy, D. M., Piehl, A. M., & Braga, A. A. (1996) · Law and Contemporary Problems · doi:10.2307/1192213 · Cited by 338 · see citing works
Self-citationThe Effects of Focused Deterrence Strategies on Crime
Braga, A. A., & Weisburd, D. L. (2011) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427811419368 · Cited by 335 · see citing works
Self-citationDoes research design affect study outcomes in criminal justice?
Weisburd, D., Lum, C. M., & Petrosino, A. (2001) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/000271620157800104 · Cited by 335 · see citing works
Self-citationThose confounded moderators in meta-analysis: good, bad, and ugly
Lipsey, M. W. (2003) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716202250791 · Cited by 283 · see citing works
Hot spots policing and crime prevention: A systematic review of randomized controlled trials
Braga, A. A. (2005) · Journal of Experimental Criminology · doi:10.1007/s11292-005-8133-z · Cited by 249 · see citing works
Self-citationPulling Levers: Chronic Offenders, High-Crime Settings, and a Theory of Prevention
Kennedy, D. M. (2011) · ValpoScholar (Valparaiso University) · Cited by 237 · see citing works
Deterrence and Crime Prevention: Reconsidering the Prospect of Sanction
Kennedy, D. M. (2008) · Cited by 234 · see citing works
Publication bias as a threat to the validity of meta-analytic results
Rothstein, H. R. (2008) · Journal of Experimental Criminology · doi:10.1007/s11292-007-9046-9 · Cited by 216 · see citing works
Attention Felons: Evaluating Project Safe Neighborhoods in Chicago
Papachristos, A. V., Meares, T. L., & Fagan, J. A. (2007) · Journal of Empirical Legal Studies · doi:10.1111/j.1740-1461.2007.00096.x · Cited by 210 · see citing works
Campbell, D. P., & Boruch, R. F. (1975) · Elsevier eBooks · doi:10.1016/b978-0-12-088850-4.50008-2 · Cited by 203 · see citing works
DID CEASEFIRE, COMPSTAT , AND EXILE REDUCE HOMICIDE?*
Rosenfeld, R., Fornango, R. J., & Baumer, E. P. (2005) · Criminology & Public Policy · doi:10.1111/j.1745-9133.2005.00310.x · Cited by 180 · see citing works
Jean, P. K. B. S. (2007) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226775005.001.0001 · Cited by 179 · see citing works
The Campbell Collaboration Crime and Justice Group
Farrington, D. P., & Petrosino, A. J. (2001) · The Annals of the American Academy of Political and Social Science · doi:10.1177/000271620157800103 · Cited by 167 · see citing works
Reducing Gun Violence: Results from an Intervention in East Los Angeles
Tita, G., Riley, K., Ridgeway, G. K., Grammich, C. A., Abrahamse, A., & Greenwood, P. (2003) · RAND Corporation eBooks · doi:10.7249/mr1764 · Cited by 159 · see citing works
Effects of Hot Spots Policing on Crime <sup/>
Braga, A. A. (2007) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2007.1 · Cited by 157 · see citing works
Self-citationManaging Drug Involved Probationers with Swift and Certain Sanctions: Evaluating Hawaii's HOPE
Hawken, A., & R.Kleiman, M. A. (2009) · PsycEXTRA Dataset · doi:10.1037/e513502010-001 · Cited by 155 · see citing works
Street‐Level Drug Law Enforcement: A Meta‐Analytic Review
Mazerolle, L., Soole, D., & Rombouts, S. (2007) · Campbell Systematic Reviews · doi:10.4073/csr.2007.2 · Cited by 152 · see citing works
Evaluation of CeaseFire-Chicago
Skogan, W. G., Hartnett, S. M., & Bump, N. (2012) · Cited by 150 · see citing works
Making Public Places SaferSurveillance and Crime Prevention
Welsh, B. C., & Farrington, D. P. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195326215.001.0001 · Cited by 148 · see citing works
Reducing Homicide through a “Lever‐Pulling” Strategy
McGarrell, E. F., Chermak, S. M., Wilson, J. M., & Corsaro, N. A. (2006) · Justice Quarterly · doi:10.1080/07418820600688818 · Cited by 143 · see citing works
Testing for Structural Breaks in the Evaluation of Programs
Piehl, A. M., Cooper, S. J., Braga, A. A., & Kennedy, D. M. (2003) · The Review of Economics and Statistics · doi:10.1162/003465303322369713 · Cited by 134 · see citing works
Self-citationPulling levers focused deterrence strategies and the prevention of gun homicide
Braga, A. A. (2008) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2008.06.009 · Cited by 116 · see citing works
Self-citationThe Strategic Prevention of Gun Violence Among Gang‐Involved Offenders
Braga, A. A., Pierce, G. L., McDevitt, J., Bond, B. J., & Cronin, S. W. (2008) · Justice Quarterly · doi:10.1080/07418820801954613 · Cited by 107 · see citing works
Self-citationBraga, A. A., & Pierce, G. L. (2005) · Criminology & Public Policy · doi:10.1111/j.1745-9133.2005.00353.x · Cited by 100 · see citing works
Self-citationEvaluation Research on Correctional Treatment in West Germany: A Meta-analysis
Lösel, F., & Köferl, P. (1989) · Research in criminology · doi:10.1007/978-3-642-86017-1_21 · Cited by 100 · see citing works
The Effects of Problem-Oriented Policing on Crime and Disorder <sup/>
Weisburd, D., Telep, C. W., Hinkle, J. C., & Eck, J. E. (2008) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2008.14 · Cited by 100 · see citing works
Self-citationWilson, D. B. (2009) · Journal of Experimental Criminology · doi:10.1007/s11292-009-9085-5 · Cited by 86 · see citing works
Meta-Analytic Methods for Criminology
Wilson, D. B. (2001) · The Annals of the American Academy of Political and Social Science · doi:10.1177/000271620157800105 · Cited by 85 · see citing works
Welsh, B. C., Peel, M. E., Farrington, D. P., Elffers, H., & Braga, A. A. (2011) · Journal of Experimental Criminology · doi:10.1007/s11292-010-9117-1 · Cited by 79 · see citing works
Self-citationThe Importance of Randomized Field Trials
Boruch, R. F., Snyder, B., & DeMoya, D. (2000) · Crime & Delinquency · doi:10.1177/0011128700046002002 · Cited by 71 · see citing works
Attention Felons: Evaluating Project Safe Neighborhoods in ChicagoPreprint
Papachristos, A. V., Meares, T. L., & Fagan, J. A. (2007) · SSRN Electronic Journal · doi:10.2139/ssrn.860685 · Cited by 66 · see citing works
Braga, A. A., McDevitt, J., & Pierce, G. L. (2006) · Police Quarterly · doi:10.1177/1098611104264497 · Cited by 59 · see citing works
Self-citationPolicing Guns and Youth Violence
Fagan, J. (2002) · The Future of Children · doi:10.2307/1602743 · Cited by 58 · see citing works
Corsaro, N. A., & McGarrell, E. F. (2009) · Journal of Experimental Criminology · doi:10.1007/s11292-008-9065-1 · Cited by 50 · see citing works
Developing a Multicenter Randomized Trial in Criminology: The Case of HIDTA
Weisburd, D. L., & Taxman, F. S. (2000) · Journal of Quantitative Criminology · doi:10.1023/a:1007574906103 · Cited by 48 · see citing works
Self-citationPerry, A., Weisburd, D. L., & Hewitt, C. E. (2010) · Journal of Experimental Criminology · doi:10.1007/s11292-010-9099-z · Cited by 45 · see citing works
Self-citationBETTER GUN ENFORCEMENT, LESS CRIME*
Ludwig, J. (2005) · Criminology & Public Policy · doi:10.1111/j.1745-9133.2005.00352.x · Cited by 45 · see citing works
Locating Focused Deterrence Approaches within a Situational Crime Prevention Framework
Tillyer, M. S., & Kennedy, D. M. (2008) · Crime Prevention and Community Safety · doi:10.1057/cpcs.2008.5 · Cited by 41 · see citing works
Methodological quality and the evaluation of anti-crime programs
Farrington, D. (2006) · Journal of Experimental Criminology · doi:10.1007/s11292-006-9012-y · Cited by 38 · see citing works
New Approaches to the Strategic Prevention of Gang and Group-Involved Violence
Braga, A. A., Kennedy, D. M., & Tita, G. (2002) · Sage eBooks · doi:10.4135/9781452232201.n17 · Cited by 35 · see citing works
Self-citationProblem solving and youth violence: an evaluation of the Boston Gun Project
Piehl, A., Kennedy, D. M., & Braga, A. (2000) · American Law and Economics Review · doi:10.1093/aler/2.1.58 · Cited by 34 · see citing works
Self-citationAdvocate Old wine in new bottles: policing and the lessons of pulling levers
Kennedy, D. M. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511489334.008 · Cited by 34 · see citing works
KNOWING WHEN TO FOLD 'EM: AN ESSAY ON EVALUATING THE IMPACT OF CEASEFIRE, COMPSTAT , AND EXILE *
Berk, R. A. (2005) · Criminology & Public Policy · doi:10.1111/j.1745-9133.2005.00314.x · Cited by 33 · see citing works
Perry, A., & Johnson, M. (2008) · Journal of Experimental Criminology · doi:10.1007/s11292-008-9051-7 · Cited by 26 · see citing works
Drugs, race and common ground: Reflections on the High Point Intervention
Kennedy, D. (2009) · PsycEXTRA Dataset · doi:10.1037/e534662009-004 · Cited by 16 · see citing works
Shifting crime and justice resources from prisons to police
Weisburd, D. L. (2011) · Criminology & Public Policy · doi:10.1111/j.1745-9133.2010.00690.x · Cited by 13 · see citing works
Self-citation
Flagged first, then by citations
1 of the 64 references couldn’t be matched to a known paper.
Research works printed but not linked: 31
- 1 ELIGIBLE STUDIES WITH COMPARISON GROUPS INCLUDED IN SYSTEMATIC REVIEW
- OTHER WORKS CITED Apel, Robert and Daniel Nagin. 2011. "General Deterrence: A Review of Recent Evidence." In James Q. Wilson and Joan Petersilia (Eds.), Crime and Public Policy (pp. 411 -436). New York: Oxford University Press.
- Blalock, Hubert. 1979. Social Statistics. Revised Second Edition. New York, NY: McGraw-Hill Publishing Company.
- Blumstein, Alfred, Jacqueline Cohen, and Daniel Nagin (Eds.). 1978. Deterrence and Incapacitation: Estimating the Effects of Criminal Sanctions on Crime Rates. Washington, DC: National Academy of Sciences.
- Boyum, David A., Jonathan P. Caulkins, and Mark A.R. Kleiman. 2011. "Drugs, Crime, and Public Policy." In James Q. Wilson and Joan Petersilia (Eds.), Crime and Public Policy (pp. 368 -410). New York: Oxford University Press.
- Braga, Anthony. 2008a. Problem-Oriented Policing and Crime Prevention. Second edition. Monsey, NY: Criminal Justice Press.
- Braga, Anthony A. and David M. Kennedy. 2012. "Linking Situational Crime Prevention and Focused Deterrence Strategies." In Graham Farrell and Nick Tilley (Eds.), The Reasoning Criminologist: Essays in Honour of Ronald V. Clarke. London: Taylor and Francis.
- Cohen, Jacob. 1988. Statistical Power Analysis for the Behavioral Sciences. 2nd edition. Hillsdale, NJ: Lawrence Erlbaum.
- Cook, Philip J. 1980. "Research in Criminal Deterrence: Laying the Groundwork for the Second Decade." In Norval Morris and Michael Tonry (Eds.), Crime and Justice: An Annual Review of Research, Vol. 2 (pp. 211-268). Chicago: University of Chicago Press.
- Dalton, Erin. 2002. "Targeted Crime Reduction Efforts in Ten Communities: Lessons for the Project Safe Neighborhoods Initiative." U.S. Attorney's Bulletin, 50: 16 -25.
- Goldstein, Herman. 1990. Problem-Oriented Policing. Philadelphia: Temple University Press.
- Guerette, Robert T. 2009. "The Pull, Push, and Expansion of Situation Crime Prevention Evaluation: An Appraisal of Thirty-Seven Years of Research." In Johannes Knutsson and Nick Tilley (Eds.), Evaluating Crime Reduction Initiatives, Crime Prevention Studies, Vol. 24 (pp. 29 -58). Monsey, NY: Criminal Justice Press.
- Kleiman, Mark A.R. and Kerry D. Smith. 1990. "State and Local Drug Enforcement: In Search of a Strategy." In Michael Tonry and James Q. Wilson (Eds.), Drugs and Crime, Crime and Justice: A Review of Research, Vol. 13 (pp. 69 - 108). Chicago: University of Chicago Press. 18911803, 2012, 1, · DOI
- McGarrell, Edmund F. and Steven Chermak. 2003. "Problem Solving to Reduce Gang and Drug-Related Violence in Indianapolis." In Scott H. Decker (Ed.), Policing Gangs and Youth Violence (pp. 77 -101). Belmont, CA: Wadsworth Publishing Company.
- Meares, Tracey, Andrew Papachristos, and Jeffrey Fagan. 2009. Homicide and Gun Violence in Chicago: Evaluation and Summary of the Project Safe Neighborhoods Program. Review of Research.
- Nagin, Daniel. 1998. "Criminal Deterrence Research at the Outset of the Twenty- First Century." In Michael Tonry (Ed.), Crime and Justice: A Review of Research, Vol. 23 (pp. 1 -42). Chicago: University of Chicago Press.
- Perry, Amanda, David Weisburd, and Catherine Hewitt. 2010. "Are Criminologists Reporting Experiments in Ways that Allow us to Assess Them?" Journal of Experimental Criminology, 6: 245 -263.
- Rosenthal, Robert. 1994. "Parametric Measures of Effect Size." In Harris Cooper and Larry Hedges (Eds.), The Handbook of Research Synthesis (pp. 231-244). New York: Russell Sage Foundation.
- Sherman, Lawrence. 2002. "Fair and Effective Policing." In James Q. Wilson and Joan Petersilia(Eds.), Crime: Public Policies for Crime Control (pp. 383-412). Oakland, CA: Institute for Contemporary Studies Press.
- Skogan, Wesley and Kathleen Frydl (Eds.) 2004. Fairness and Effectiveness in Policing: The Evidence. Committee to Review Research on Police Policy and Practices. Washington, DC: The National Academies Press.
- Tita, George E., K. Jack Riley, and Peter Greenwood. 2003. "From Boston to Boyle Heights: The Process and Prospects of a 'Pulling Levers' Strategy in a Los Angeles Barrio." In Scott H. Decker (ed.), Policing Gangs and Youth Violence (pp. 102 -130). Belmont, CA:Wadsworth Publishing Company.
- Tyler, Tom R. 1990. Why People Obey the Law: Procedural Justice, Legitimacy, and Compliance. New Haven, CT: Yale University Press.
- Wellford, Charles F., John V. Pepper, and Carol V. Petrie (Eds.). 2005. Firearms and Violence: A Critical Review. Committee to Improve Research Information and Data on Firearms. Washington, DC: The National Academies Press.
- Zimring, Franklin and Gordon Hawkins. 1973. Deterrence: The Legal Threat in Crime Control. Chicago: University of Chicago Press. 18911803, 2012, 1, · DOI
- Natalie K. Hipple, Michigan State University 18911803, 2012, 1, · DOI
- Elaine B. Sharp, University of Kansas 72. Lawrence Sherman, University of Cambridge 73. Wesley Skogan, Northwestern University 74. Nick Tilley, University College London 75. Marie S. Tillyer, University of Texas, San Antonio 76. George E. Tita, University of California, Irvine 18911803, 2012, 1, Reference Information 1. Document ID: __ __ __ __ · DOI
- Publication date (year): ______________ 6a. Journal Name: ____________________________________________ 6b. Journal Volume: _______________ 6c. Journal Issue: ____________
- Coder's Initials: __ __ __ 18911803, 2012, 1, · DOI
- Other (specify) _____________ 18911803, 2012, 1, · DOI
- For the units of analysis in this study, what time periods were examined for the outcome covered on this coding sheet? 1. Yearly 2. Monthly 3. Weekly 4. Other researcher defined time periods (specify) __________________ 18911803, 2012, 1, · DOI
- Additional notes about study: __________________________________________________________ 18911803, 2012, 1, · DOI
Cited by
Sorted by citations
Criminal Deterrence: A Review of the Literature
Chalfin, A., & McCrary, J. (2017) · Journal of Economic Literature · doi:10.1257/jel.20141147 · Cited by 727 · see citing works
Handling Complex Meta-analytic Data Structures Using Robust Variance Estimates: a Tutorial in R
Tanner-Smith, E. E., Tipton, E., & Polanin, J. R. (2016) · Journal of Developmental and Life-Course Criminology · doi:10.1007/s40865-016-0026-5 · Cited by 390 · see citing works
Hot spots policing and crime reduction: an update of an ongoing systematic review and meta-analysis
Braga, A. A., Turchan, B. S., Papachristos, A. V., & Hureau, D. M. (2019) · Journal of Experimental Criminology · doi:10.1007/s11292-019-09372-3 · Cited by 352 · see citing works
Self-citationBraga, A. A., Weisburd, D., & Turchan, B. (2018) · Criminology & Public Policy · doi:10.1111/1745-9133.12353 · Cited by 261 · see citing works
Self-citationHot spots policing of small geographic areas effects on crime
Braga, A. A., Turchan, B., Papachristos, A. V., & Hureau, D. M. (2019) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.1002/cl2.1046 · Cited by 226 · see citing works
Self-citationDOES WHAT POLICE DO AT HOT SPOTS MATTER? THE PHILADELPHIA POLICING TACTICS EXPERIMENT*
GROFF, E. R., RATCLIFFE, J. H., HABERMAN, C. P., SORG, E. T., JOYCE, N. M., & TAYLOR, R. B. (2015) · Criminology · doi:10.1111/1745-9125.12055 · Cited by 202 · see citing works
What Works in Crime Prevention and Rehabilitation
Weisburd, D. L., Farrington, D. P., Gill, C. E., & With Mimi Ajzenstadt, T. B. (2017) · Criminology & Public Policy · doi:10.1111/1745-9133.12298 · Cited by 193 · see citing works
Self-citationWeisburd, D. L., & Telep, C. W. (2014) · Journal of Contemporary Criminal Justice · doi:10.1177/1043986214525083 · Cited by 185 · see citing works
Self-citationShjarback, J. A., Pyrooz, D. C., Wolfe, S. E., & Decker, S. H. (2017) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2017.04.003 · Cited by 182 · see citing works
CAN HOT SPOTS POLICING REDUCE CRIME IN URBAN AREAS? AN AGENT‐BASED SIMULATION*
WEISBURD, D., BRAGA, A. A., GROFF, E. R., & WOODITCH, A. (2017) · Criminology · doi:10.1111/1745-9125.12131 · Cited by 140 · see citing works
Self-citationRobbins, M. W., Saunders, J. M., & Kilmer, B. (2016) · Journal of the American Statistical Association · doi:10.1080/01621459.2016.1213634 · Cited by 138 · see citing works
Ariel, B., Weinborn, C., & Sherman, L. W. (2016) · Journal of Experimental Criminology · doi:10.1007/s11292-016-9260-4 · Cited by 134 · see citing works
Hot Spots of Crime and Place‐Based Prevention
Weisburd, D. L. (2018) · Criminology & Public Policy · doi:10.1111/1745-9133.12350 · Cited by 113 · see citing works
Self-citationTelep, C. W., & Lum, C. M. (2014) · Police Quarterly · doi:10.1177/1098611114548099 · Cited by 111 · see citing works
Nagin, D. S., & Sampson, R. J. (2018) · Annual Review of Criminology · doi:10.1146/annurev-criminol-011518-024838 · Cited by 106 · see citing works
The Social Determinants of Trauma: A Trauma Disparities Scoping Review and Framework
Mikhail, J. N., Nemeth, L. S., Mueller, M., Pope, C. A., & NeSmith, E. G. (2018) · Journal of Trauma Nursing · doi:10.1097/jtn.0000000000000388 · Cited by 103 · see citing works
Barnum, J. D., Caplan, J. M., Kennedy, L. W., & Piza, E. L. (2017) · Applied Geography · doi:10.1016/j.apgeog.2016.12.011 · Cited by 95 · see citing works
Focused deterrence strategies effects on crime: A systematic review
Braga, A. A., Weisburd, D., & Turchan, B. (2019) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.1002/cl2.1051 · Cited by 92 · see citing works
Self-citationAriel, B., Sutherland, A., Henstock, D., Young, J., Drover, P., Sykes, J., Megicks, S., & Henderson, R. (2018) · Journal of Experimental Criminology · doi:10.1007/s11292-017-9311-5 · Cited by 85 · see citing works
Kochel, T. R., & Weisburd, D. (2017) · Journal of Experimental Criminology · doi:10.1007/s11292-017-9283-5 · Cited by 77 · see citing works
Self-citationAn Integrated Theory of Hot Spots Patrol Strategy
Sherman, L. W., Williams, S., Ariel, B., Strang, L. R., Wain, N., Slothower, M. P., & Norton, A. (2014) · Journal of Contemporary Criminal Justice · doi:10.1177/1043986214525082 · Cited by 77 · see citing works
Hotspots vs. harmspots: Shifting the focus from counts to harm in the criminology of place
Weinborn, C., Ariel, B., Sherman, L. W., & Dwyer, E. O. (2017) · Applied Geography · doi:10.1016/j.apgeog.2017.06.009 · Cited by 73 · see citing works
Saraiva, M., Matijošaitienė, I., Mishra, S., & Amante, A. (2022) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi11070400 · Cited by 60 · see citing works
Examining the Environmental Characteristics of Drug Dealing Locations
Barnum, J. D., Campbell, W. L., Trocchio, S., Caplan, J. M., & Kennedy, L. W. (2016) · Crime & Delinquency · doi:10.1177/0011128716649735 · Cited by 58 · see citing works
Evidence‐based juvenile justice programs and practices: A critical review
Elliott, D. S., Buckley, P. R., Gottfredson, D. C., Hawkins, J. D., & Tolan, P. H. (2020) · Criminology & Public Policy · doi:10.1111/1745-9133.12520 · Cited by 57 · see citing works
Arrested Development: Misguided Directions in Deterrence Theory and Policy
Pickett, J. T., & Roche, S. P. (2016) · Criminology & Public Policy · doi:10.1111/1745-9133.12217 · Cited by 58 · see citing works
Stop and Risk: Policing, Data, and the Digital Age of Discrimination
Browning, M., & Arrigo, B. A. (2020) · American Journal of Criminal Justice · doi:10.1007/s12103-020-09557-x · Cited by 56 · see citing works
Hot spots policing in a high-crime environment: an experimental evaluation in Medellín
Collazos, D., García, E., Mejía, D., Ortega, D., & Tobón, S. (2021) · Journal of Experimental Criminology · doi:10.1007/s11292-019-09390-1 · Cited by 54 · see citing works
Measuring the Spatial and Temporal Patterns of Police Proactivity
Wu, X., & Lum, C. (2017) · Journal of Quantitative Criminology · doi:10.1007/s10940-016-9318-5 · Cited by 52 · see citing works
The Effectiveness of Big Data-Driven Predictive Policing: Systematic Review
Lee, Y., Bradford, B., & Pósch, K. (2024) · Justice Evaluation Journal · doi:10.1080/24751979.2024.2371781 · Cited by 52 · see citing works
Ariel, B., Sherman, L. W., & Newton, M. (2020) · Criminology · doi:10.1111/1745-9125.12231 · Cited by 51 · see citing works
Frequency Vs. Length of Hot Spots Patrols: a Randomised Controlled Trial
Williams, S., & Coupe, T. (2017) · Cambridge Journal of Evidence-Based Policing · doi:10.1007/s41887-017-0003-1 · Cited by 51 · see citing works
Wilson, D. B. (2021) · Journal of quantitative criminology · doi:10.1007/s10940-021-09494-w · Cited by 49 · see citing works
Near-repeat shootings in contemporary Sweden 2011 to 2015
Sturup, J., Rostami, A., Gerell, M., & Sandholm, A. (2017) · Security Journal · doi:10.1057/s41284-017-0089-y · Cited by 49 · see citing works
Towards a framework for preventing community violence among youth
Abt, T. (2016) · Psychology Health & Medicine · doi:10.1080/13548506.2016.1257815 · Cited by 48 · see citing works
Building collective action at crime hot spots: Findings from a randomized field experiment
Weisburd, D., Gill, C., Wooditch, A., Barritt, W., & Murphy, J. (2021) · Journal of Experimental Criminology · doi:10.1007/s11292-019-09401-1 · Cited by 46 · see citing works
Self-citationMacbeth, E., & Ariel, B. (2017) · Justice Quarterly · doi:10.1080/07418825.2017.1360379 · Cited by 46 · see citing works
Hot Spot Policing With Actively Monitored CCTV Cameras: Does it Reduce Assaults in Public Places?
Gerell, M. (2016) · International Criminal Justice Review · doi:10.1177/1057567716639098 · Cited by 44 · see citing works
Kennedy, D. M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108278423.010 · Cited by 43 · see citing works
Assessing the effects of bus stop relocation on street robbery
Liu, L., Lan, M., Eck, J. E., & Kang, E. L. (2020) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2019.101455 · Cited by 43 · see citing works
The Impact of Hot Spots Policing on Collective Efficacy: Findings from a Randomized Field Trial
Rinehart Kochel, T., & Weisburd, D. (2019) · Justice Quarterly · doi:10.1080/07418825.2018.1465579 · Cited by 42 · see citing works
Self-citationTesting the Transitivity of Reported Risk Perceptions: Evidence of Coherent Arbitrariness
Thomas, K. J., Hamilton, B. C., & Loughran, T. A. (2018) · Criminology · doi:10.1111/1745-9125.12154 · Cited by 41 · see citing works
‘We’ll show you gang’: The subterranean structuration of gang life in London
Densley, J. A., & Stevens, A. (2014) · Criminology & Criminal Justice · doi:10.1177/1748895814522079 · Cited by 40 · see citing works
What Works in Crime Prevention?
Fagan, A. A., & Buchanan, M. (2016) · Criminology & Public Policy · doi:10.1111/1745-9133.12228 · Cited by 40 · see citing works
Policing and public health: Not quite the right analogy
Anderson, E. D., & Burris, S. C. (2016) · Policing & Society · doi:10.1080/10439463.2016.1231188 · Cited by 38 · see citing works
Ariel, B., Bland, M., & Sutherland, A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0187392 · Cited by 37 · see citing works
Can Precision Policing Reduce Gun Violence? Evidence from “Gang Takedowns” in New York City
Chalfin, A. J., LaForest, M., & Kaplan, J. (2021) · Journal of Policy Analysis and Management · doi:10.1002/pam.22323 · Cited by 37 · see citing works
Using meta-analysis under conditions of definitional ambiguity: the case of corporate crime
Rorie, M. L., Alper, M. E., Schell-Busey, N. M., & Simpson, S. S. (2017) · Criminal Justice Studies · doi:10.1080/1478601x.2017.1412960 · Cited by 36 · see citing works
#Defund or #Re-Fund? Re-examining Bayley’s blueprint for police reform
Koziarski, J., & Huey, L. (2021) · International Journal of Comparative and Applied Criminal Justice · doi:10.1080/01924036.2021.1907604 · Cited by 35 · see citing works
Intention is not method, belief is not evidence, rank is not proof
Mitchell, R. J., & Lewis, S. (2017) · International Journal of Emergency Services · doi:10.1108/ijes-04-2017-0018 · Cited by 35 · see citing works
An agent-based model for simulating urban crime with improved daily routines
Zhu, H., & Wang, F. (2021) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2021.101680 · Cited by 33 · see citing works
Gill, C. E. (2016) · Springer series on evidence-based crime policy · doi:10.1007/978-1-4939-3477-5_3 · Cited by 33 · see citing works
Telep, C. W., & Weisburd, D. L. (2016) · Springer series on evidence-based crime policy · doi:10.1007/978-1-4939-3477-5_5 · Cited by 32 · see citing works
Self-citationCan routinely collected ambulance data about assaults contribute to reduction in community violence?
Ariel, B., Weinborn, C., & Boyle, A. A. (2013) · Emergency Medicine Journal · doi:10.1136/emermed-2013-203133 · Cited by 32 · see citing works
Frontiers in the economics of crime: lessons for Latin America and the Caribbean
Jaitman, L. (2019) · Latin American Economic Review · doi:10.1186/s40503-019-0081-5 · Cited by 31 · see citing works
Braga, A. A., & Weisburd, D. L. (2014) · Journal of Experimental Criminology · doi:10.1007/s11292-014-9205-8 · Cited by 31 · see citing works
Self-citationChainey, S., Serrano-Berthet, R., & Veneri, F. (2020) · Police Practice & Research · doi:10.1080/15614263.2020.1749619 · Cited by 23 · see citing works
How Phishers Exploit the Coronavirus Pandemic: A Content Analysis of COVID-19 Themed Phishing Emails
Akdemir, N., & YENAL, S. (2021) · SAGE Open · doi:10.1177/21582440211031879 · Cited by 30 · see citing works
Meaningfully and Artfully Reinterpreting Crime for Useful Science
Eck, J. E., & Madensen, T. D. (2015) · Palgrave Macmillan eBooks · doi:10.1057/9781137391322.0006 · Cited by 28 · see citing works
Hamilton, B. C., Rosenfeld, R., & Levin, A. R. (2017) · Journal of Experimental Criminology · doi:10.1007/s11292-017-9309-z · Cited by 28 · see citing works
Public health, youth violence, and perpetrator well-being.
Neville, F., Goodall, C. A., Gavine, A. J., Williams, D., & Donnelly, P. (2015) · Peace and Conflict Journal of Peace Psychology · doi:10.1037/pac0000081 · Cited by 26 · see citing works
Disorder policing to reduce crime: A systematic review
Braga, A. A., Welsh, B. C., & Schnell, C. (2019) · Campbell Systematic Reviews · doi:10.1002/cl2.1050 · Cited by 26 · see citing works
Self-citationThe spatial concentration and stability of crime in a South African township
Breetzke, G. D., & Edelstein, I. S. (2018) · Security Journal · doi:10.1057/s41284-018-0145-2 · Cited by 25 · see citing works
On to the next one? Using social network data to inform police target prioritization
Hashimi, S., & Bouchard, M. (2017) · Policing An International Journal · doi:10.1108/pijpsm-06-2016-0079 · Cited by 24 · see citing works
Seeing and Treating Violence as a Health Issue
Ransford, C., & Slutkin, G. (2017) · Wiley eBooks · doi:10.1002/9781118924501.ch34 · Cited by 24 · see citing works
An integrated public health and criminal justice approach to gangs: What can research tell us?
Gebo, E. (2016) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2016.07.007 · Cited by 22 · see citing works
Do Gang Injunctions Reduce Violent Crime? Four Tests in Merseyside, UK
Carr, R., Slothower, M. P., & Parkinson, J. (2017) · Cambridge Journal of Evidence-Based Policing · doi:10.1007/s41887-017-0015-x · Cited by 22 · see citing works
Mitchell, R. J. (2017) · Cambridge Journal of Evidence-Based Policing · doi:10.1007/s41887-017-0002-2 · Cited by 21 · see citing works
Understanding the role of parenting in developing radical beliefs: Lessons learned from Indonesia
Riany, Y. E., Haslam, D. M., Musyafak, N., Farida, J., Maarif, S., & Sanders, M. R. (2018) · Security Journal · doi:10.1057/s41284-018-00162-6 · Cited by 21 · see citing works
Sanders, C. B., & Langan, D. (2018) · Policing & Society · doi:10.1080/10439463.2018.1427744 · Cited by 20 · see citing works
The Role of Geoprocessing in Mapping Crime Using Hot Streets
Tom-Jack, Q. T., Bernstein, J. M., & Loyola, L. C. (2019) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi8120540 · Cited by 20 · see citing works
Shedding Light on the Dark: The Impact of Legal Enforcement on Darknet Transactions
Chan, J., He, S., Qiao, D., & Whinston, A. B. (2023) · Information Systems Research · doi:10.1287/isre.2023.1222 · Cited by 19 · see citing works
The Extent and Correlates of Public Support for Deterrence Reforms and Hot Spots Policing
Metcalfe, C. F., & Pickett, J. T. (2018) · Law & Society Review · doi:10.1111/lasr.12327 · Cited by 18 · see citing works
Pulling Levers on Gang Violence in London and St. Paul
Densley, J. A., & Jones, D. S. (2016) · Springer eBooks · doi:10.1007/978-3-319-29602-9_16 · Cited by 18 · see citing works
Combatting Gun Violence in Newark, New Jersey
Grossman, L. S., & Clear, T. R. (2020) · Springer eBooks · doi:10.1007/978-3-030-55513-9_13 · Cited by 17 · see citing works
Tracking Violent Crime with Ambulance Data: How Much Crime Goes Uncounted?
Sutherland, A., Strang, L., Štěpánek, M., Giacomantonio, C., Boyle, A. A., & Strang, H. (2021) · Cambridge Journal of Evidence-Based Policing · doi:10.1007/s41887-021-00064-5 · Cited by 17 · see citing works
Optenhövel, S., & Sutter, C. (2021) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2021.100429 · Cited by 17 · see citing works
PROTOCOL: Third Party Policing for Reducing Crime and Disorder: A Systematic Review
MAZEROLLE, L. G., Eggins, E., & Higginson, A. (2016) · Campbell Systematic Reviews · doi:10.1002/cl2.153 · Cited by 16 · see citing works
Phayal, A., Gold, A., Maharani, C., Palomares, M. L. D., Pauly, D. F., Prins, B., & Riyadi, S. F. (2024) · Political Geography · doi:10.1016/j.polgeo.2024.103069 · Cited by 16 · see citing works
Harm-focused offender triage and prioritization: a Philadelphia case study
Ratcliffe, J., & Kikuchi, G. (2019) · Policing: An International Journal · doi:10.1108/pijpsm-08-2018-0118 · Cited by 15 · see citing works
Focused Deterrence and Program Fidelity: Evaluating the Impact of Detroit Ceasefire
Circo, G. M., Krupa, J. M., McGarrell, E. F., & Biasi, A. D. (2020) · Justice Evaluation Journal · doi:10.1080/24751979.2020.1827938 · Cited by 16 · see citing works
Fairness in Algorithmic Policing
Purves, D. (2022) · Journal of the American Philosophical Association · doi:10.1017/apa.2021.39 · Cited by 15 · see citing works
Interstate hostility and maritime crime: Evidence from South East Asia
Phayal, A., Gold, A., & Prins, B. (2022) · Marine Policy · doi:10.1016/j.marpol.2022.105134 · Cited by 15 · see citing works
Implementing Information Science in Policing: Mapping the Evidence Base
BOWERS, K. J., Tompson, L., & Johnson, S. D. (2014) · Policing A Journal of Policy and Practice · doi:10.1093/police/pau052 · Cited by 15 · see citing works
Robinson, A. L. (2016) · Victims & Offenders · doi:10.1080/15564886.2016.1187691 · Cited by 15 · see citing works
Rowe, M., & Søgaard, T. F. (2019) · Policing & Society · doi:10.1080/10439463.2019.1603226 · Cited by 14 · see citing works
Rosenbaum, D. P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108278423.015 · Cited by 14 · see citing works
Crime, Broken Families, and Punishment
Bezin, E., Verdier, T., & Zénou, Y. (2022) · American Economic Journal Microeconomics · doi:10.1257/mic.20200379 · Cited by 14 · see citing works
Testing the Spatial Accuracy of Address-Based Geocoding for Gunshot Locations
Wheeler, A. P., Gerell, M., & Yoo, Y. (2020) · The Professional Geographer · doi:10.1080/00330124.2020.1730195 · Cited by 14 · see citing works
Citizen Security: Conceptual Framework and Empirical Evidence
Abizanda, B., Hoffman, J. S., Marmolejo, L., & Duryea, S. (2012) · doi:10.18235/0006935 · Cited by 14 · see citing works
Middleton, J., & Shepherd, J. P. (2018) · BMJ · doi:10.1136/bmj.k1967 · Cited by 14 · see citing works
Nordisk politiforskning – udfordringer og muligheder
Holmberg, L. (2014) · Nordic Journal of Studies in Policing · doi:10.18261/issn1894-8693-2014-01-04 · Cited by 13 · see citing works
Telep, C. W., & Weisburd, D. L. (2014) · Journal of Experimental Criminology · doi:10.1007/s11292-014-9206-7 · Cited by 13 · see citing works
Self-citation‘Led by Intelligence': A Scoping Review on the Experimental Evaluation of Intelligence-Led Policing
Khalfa, R., & Hardyns, W. (2024) · Evaluation Review · doi:10.1177/0193841x231204588 · Cited by 12 · see citing works
Community safety and well-being: Concept, practice, and alignment (LEPH2018)
Nilson, C. (2018) · Journal of Community Safety and Well-Being · doi:10.35502/jcswb.81 · Cited by 12 · see citing works
Shader, C. G., Gill, C. E., Zheng, X., & Carleton, B. (2024) · Aggression and Violent Behavior · doi:10.1016/j.avb.2024.101957 · Cited by 11 · see citing works
Implementation, Implementation, Implementation: Insights from Offender Management Evaluations
Dawson, P. A., & Stanko, B. (2013) · Policing A Journal of Policy and Practice · doi:10.1093/police/pat015 · Cited by 11 · see citing works
Taylor, B. G., Liu, W., Maitra, P., Koper, C. S., Sheridan-Johnson, J., & Johnson, W. D. (2022) · Journal of Experimental Criminology · doi:10.1007/s11292-022-09541-x · Cited by 10 · see citing works
van Caem, B., van Steden, R., Boutellier, H., & van Stokkom, B. (2013) · Policing A Journal of Policy and Practice · doi:10.1093/police/pat006 · Cited by 10 · see citing works
Space, Place, and Policing: Exploring Geographies of Research and Practice
Lum, C. M., & Fyfe, N. R. (2015) · Policing A Journal of Policy and Practice · doi:10.1093/police/pav026 · Cited by 10 · see citing works
- Authors
- Braga, A. A., & Weisburd, D. L.
- Affiliations
- Rutgers, The State University of New Jersey (US)
- Harvard University (US)
- Corresponding author
- Braga, Anthony A.
- Venue
- Campbell Systematic Reviews: Better Evidence for a Better World
- Publisher
- SAGE Publications
- Published
- 2012-03-04
- Volume
- 8
- Issue
- 1
- ISSN
- 1891-1803 (ISSN-L)
- OpenAlex
- W135423543
- Cited by
- 204
- References
- 64
- Citations by year
- 2026: 3 · 2025: 12 · 2024: 11 · 2023: 15 · 2022: 15 · 2021: 13 · 2020: 14 · 2019: 18 · 2018: 18 · 2017: 27 · 2016: 29 · 2015: 7 · 2014: 15 · 2013: 5 · 2012: 1
- FWCI
- 29.54
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Campbell Systematic Reviews (publishedVersion, cc-by)
- Issue Lab (Candid) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Universitätsbibliothek Tübingen
- Funders
- National Policing Improvement Agency, United Kingdom
- Topics
- Social Sciences › Sociology and Political Science › Crime Patterns and Interventions
- Social Sciences › Political Science and International Relations › Policing Practices and Perceptions
- Social Sciences › Law › Criminal Justice and Penology
- Keywords
- focused deterrence, crime reduction, gang violence, problem-oriented policing, high-risk individuals, repeat offenders, violence prevention, social services
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review