Was the pope to blame? Statistical powerlessness and the predictive policing of micro‐scale randomized control trials
Abstract
Research Summary Hinkle et al. (2013) highlighted a statistical powerlessness problem in hot‐spots policing experiments in midsized cities with moderate property crime rates. The current work demonstrates that this problem is less readily resolved than previously suspected. It reviews results from a predictive policing randomized control trial in a large city with property crime rates higher than Chicago or Los Angeles. It reports, for the first time, a graphical analysis indicating the marked car patrol intervention, practically effective at the 500′ by 500′ (mission) grid level, three grids per shift, likely had a district‐wide impact on reducing reported property crime. In addition, it reviews results of a series of thought experiments exploring statistical power impacts of four modified experimental designs. Only one alternative design, with spatially up‐scaled predictive policing mission areas and concomitantly higher property crime prevalence rates, produced acceptable statistical power levels. Implications follow for current theoretical confusion in community criminology about concentration effects and units of analysis, and how models organize impacts across those different units. Implications follow for practice amid ongoing concerns about whether predictive policing works and, if it did, how to gauge its impacts and social justice costs. Policy Implications The current work brings to the fore important questions beyond “does predictive policing work?” Can we design…
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Widening the scale of treatment areas may make patrol officers' activities less monotonous and reduce the likelihood of boundary violations, but it could also lead to net-widening effects and pose challenges to police legitimacy.
“However, while widening the scale of treatment areas may make patrol officers' activities less monotonous and reduce the likelihood of boundary violations, it could also lead to net-widening effects and pose challenges to police legitimacy (Ratcliffe et al., 2021;Taylor & Ratcliffe, 2020).”
From ‘Led by Intelligence': A Scoping Review on the Experimental Evaluation of Intelligence-Led Policing (2024) · cites this paper as Taylor & Ratcliffe, 2020
Cites
Robust Locally Weighted Regression and Smoothing Scatterplots
Cleveland, W. S. (1979) · Journal of the American Statistical Association · doi:10.1080/01621459.1979.10481038 · Cited by 11,594 · see citing works
Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting
Cleveland, W. S., & Devlin, S. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478639 · Cited by 5,740 · see citing works
Small is beautiful: economics as if people mattered
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1061 · Cited by 2,601 · see citing works
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461 · see citing works
HOT SPOTS OF PREDATORY CRIME: ROUTINE ACTIVITIES AND THE CRIMINOLOGY OF PLACE*
SHERMAN, L. W., GARTIN, P. R., & BUERGER, M. E. (1989) · Criminology · doi:10.1111/j.1745-9125.1989.tb00862.x · Cited by 2,104 · see citing works
The Gang. A Study of 1,313 Gangs in Chicago
Lyon, F. E., & Thrasher, F. M. (1927) · Journal of the American Institute of Criminal Law and Criminology · doi:10.2307/1134377 · Cited by 1,226 · see citing works
Brantingham, P. L., & Brantingham, P. (1995) · European Journal on Criminal Policy and Research · doi:10.1007/bf02242925 · Cited by 1,199 · see citing works
THE LAW OF CRIME CONCENTRATION AND THE CRIMINOLOGY OF PLACE*
WEISBURD, D. (2015) · Criminology · doi:10.1111/1745-9125.12070 · Cited by 1,064 · see citing works
Self-Exciting Point Process Modeling of Crime
Mohler, G., Short, M., Brantingham, P., Schoenberg, F., & Tita, G. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.ap09546 · Cited by 998 · see citing works
Fairness in Criminal Justice Risk Assessments: The State of the Art
Berk, R., Heidari, H., Jabbari, S., Kearns, M., & Roth, A. (2021) · Sociological Methods & Research · doi:10.1177/0049124118782533 · Cited by 988 · see citing works
The Criminology of Place: Street Segments and Our Understanding of the Crime Problem
Weisburd, D., Groff, E. R., & Yang, S.-M. (2012) · doi:10.1093/acprof:oso/9780195369083.001.0001 · Cited by 685 · see citing works
Roncek, D. W., & MAIER, P. A. (1991) · Criminology · doi:10.1111/j.1745-9125.1991.tb01086.x · Cited by 681 · see citing works
Sherman, L. W., & Goldstein, H. (1991) · The Journal of Criminal Law and Criminology (1973-) · doi:10.2307/1143749 · Cited by 539 · see citing works
Routine Activity and Rational Choice
Lambert, R. D. (2017) · Routledge eBooks · doi:10.4324/9781315128788 · Cited by 530 · see citing works
Block Crime and Fear: Defensible Space, Local Social Ties, and Territorial Functioning
Taylor, R. B., Gottfredson, S. D., & Brower, S. N. (1984) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427884021004003 · Cited by 468 · see citing works
Self-citationStreet stops and police legitimacy: Teachable moments in young urban men’s legal socialization
Tyler, T. R., Fagan, J., & Geller, A. (2014) · Journal of Empirical Legal Studies · doi:10.1111/jels.12055 · Cited by 457 · see citing works
Taylor, R. (1997) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427897034001006 · Cited by 449 · see citing works
Self-citationThe Utility of Hotspot Mapping for Predicting Spatial Patterns of Crime
Chainey, S., Tompson, L., & Uhlig, S. (2008) · Security Journal · doi:10.1057/palgrave.sj.8350066 · Cited by 424 · see citing works
Stanley, J. C. (1965) · The School Review · doi:10.1086/442740 · Cited by 417 · see citing works
The Effects of Hot Spots Policing on Crime
Braga, A. A. (2001) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/000271620157800107 · Cited by 390 · see citing works
Randomized Controlled Field Trials of Predictive Policing
Mohler, G. O., Short, M. B., Malinowski, S., Johnson, M., Tita, G. E., Bertozzi, A. L., & Brantingham, P. J. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1077710 · Cited by 381 · see citing works
Infectious Burglaries. A Test of the Near Repeat Hypothesis
Townsley, M. (2003) · The British Journal of Criminology · doi:10.1093/bjc/43.3.615 · Cited by 350 · see citing works
Crime Attractors, Generators and Detractors: Land Use and Urban Crime Opportunities
Kinney, J. B., Brantingham, P. L., Wuschke, K., Kirk, M., & Brantingham, P. J. (2008) · Built Environment · doi:10.2148/benv.34.1.62 · Cited by 316 · see citing works
Hot Spots of Bus Stop Crime: The Importance of Environmental Attributes
Loukaitou-sideris, A. (1999) · Journal of the American Planning Association · doi:10.1080/01944369908976070 · Cited by 299 · see citing works
Near-Repeat Patterns in Philadelphia Shootings
Ratcliffe, J., & Rengert, G. F. (2008) · Security Journal · doi:10.1057/palgrave.sj.8350068 · Cited by 297 · see citing works
Self-citationWeisburd, D. L., Morris, N. A., & Groff, E. R. (2009) · Journal of Quantitative Criminology · doi:10.1007/s10940-009-9075-9 · Cited by 296 · see citing works
Finch, W. H., Bolin, J. E., & Kelley, K. (2019) · Chapman & Hall/CRC eBooks · doi:10.1201/9781351062268 · Cited by 295 · see citing works
The role of neighborhood parks as crime generators
Groff, E. R., & McCord, E. S. (2011) · Security Journal · doi:10.1057/sj.2011.1 · Cited by 255 · see citing works
Hot spots policing of small geographic areas effects on crime
Braga, A. A., Turchan, B., Papachristos, A. V., & Hureau, D. M. (2019) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.1002/cl2.1046 · Cited by 226 · see citing works
Environmental criminology and crime analysis
(2009) · Choice Reviews Online · doi:10.5860/choice.46-5914 · Cited by 226 · see citing works
Braga, A. A., Hureau, D. M., & Papachristos, A. V. (2010) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427810384137 · Cited by 219 · see citing works
The Many Faces of a Scatterplot
Cleveland, W. S., & McGill, R. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477098 · Cited by 213 · see citing works
The Stability of Space-Time Clusters of Burglary
Johnson, S. D. (2004) · The British Journal of Criminology · doi:10.1093/bjc/44.1.55 · Cited by 213 · see citing works
Rosenbaum, D. P., & Hanson, G. S. (1998) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427898035004002 · Cited by 202 · see citing works
Bernasco, W. (2008) · European Journal of Criminology · doi:10.1177/1477370808095124 · Cited by 186 · see citing works
Jean, P. K. B. S. (2007) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226775005.001.0001 · Cited by 179 · see citing works
How concentrated is crime at places? A systematic review from 1970 to 2015
Lee, Y., Eck, J. E., SooHyun, O., & Martinez, N. N. (2017) · Crime Science · doi:10.1186/s40163-017-0069-x · Cited by 178 · see citing works
Crime and Disorder in Drug Hot Spots: Implications for Theory and Practice in Policing
Weisburd, D. L., & MAZEROLLE, L. G. (2000) · Police Quarterly · doi:10.1177/1098611100003003006 · Cited by 176 · see citing works
Operationism and scientific method.
Feigl, H. (1945) · Psychological Review · doi:10.1037/h0056755 · Cited by 174 · see citing works
Predictive Crime Mapping: Arbitrary Grids or Street Networks?
Rosser, G., Davies, T., BOWERS, K. J., Johnson, S. D., & Cheng, T. (2016) · Journal of Quantitative Criminology · doi:10.1007/s10940-016-9321-x · Cited by 146 · see citing works
The Corner: A Year in the Life of an Inner-City Neighborhood
Simon, D., & Burns, E. (1997) · Broadway Books · Cited by 138 · see citing works
Proactive Policing: Effects on Crime and CommunitiesPreprint
(2022) · CrimRxiv · doi:10.21428/cb6ab371.159ebb3d · Cited by 138 · see citing works
Ariel, B., Weinborn, C., & Sherman, L. W. (2016) · Journal of Experimental Criminology · doi:10.1007/s11292-016-9260-4 · Cited by 134 · see citing works
Criminal Circumstance: A Dynamic Multicontextual Criminal Opportunity Theory
Sacco, V. F., Wilcox, P., Land, K. C., & Hunt, S. A. (2004) · The Canadian Journal of Sociology · doi:10.2307/3341955 · Cited by 132 · see citing works
(2009) · Choice Reviews Online · doi:10.5860/choice.46-4159 · Cited by 127 · see citing works
The Impact of Gang Formation on Local Patterns of Crime
Tita, G., & Ridgeway, G. K. (2007) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427806298356 · Cited by 126 · see citing works
CONTROLLING DRUG AND DISORDER PROBLEMS: THE ROLE OF PLACE MANAGERS*
MAZEROLLE, L. G., Kadleck, C., & Roehl, J. (1998) · Criminology · doi:10.1111/j.1745-9125.1998.tb01252.x · Cited by 123 · see citing works
The Spatial Extent of Criminogenic Places: A Changepoint Regression of Violence around Bars
Ratcliffe, J. H. (2012) · Geographical Analysis · doi:10.1111/j.1538-4632.2012.00856.x · Cited by 120 · see citing works
Self-citationCops in the Classroom: A Longitudinal Evaluation of Drug Abuse Resistance Education (Dare)
Rosenbaum, D. P., Flewelling, R. L., Bailey, S. L., Ringwalt, C., & Wilkinson, D. L. (1994) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427894031001001 · Cited by 119 · see citing works
Shapiro, A. (2017) · Nature · doi:10.1038/541458a · Cited by 118 · see citing works
Delinquency in Two Birth Cohorts
Wolfgang, M. E. (1983) · American Behavioral Scientist · doi:10.1177/000276483027001005 · Cited by 118 · see citing works
Lawton, B. A., Taylor, R. B., & Luongo, A. J. (2005) · Justice Quarterly · doi:10.1080/07418820500364619 · Cited by 115 · see citing works
Self-citationPredictive Policing as a New Tool for Law Enforcement? Recent Developments and Challenges
Hardyns, W., & Rummens, A. (2017) · European Journal on Criminal Policy and Research · doi:10.1007/s10610-017-9361-2 · Cited by 102 · see citing works
Gang Set Space, Drug Markets, and Crime around Drug Corners in Camden
Taniguchi, T. A., Ratcliffe, J. H., & Taylor, R. B. (2011) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427810393016 · Cited by 95 · see citing works
Self-citationJennings, J. M., Milam, A. J., Greiner, A., Furr-Holden, D., Curriero, F. C., & Thornton, R. J. (2013) · Journal of Urban Health · doi:10.1007/s11524-013-9821-z · Cited by 93 · see citing works
Asthma, asthma medication and autonomic nervous system dysfunction
Lechín, F. (2001) · Clinical Physiology · doi:10.1046/j.1365-2281.1998.00064_21_6.x · Cited by 89 · see citing works
Cartographies of Danger: Mapping Hazards in America
Monmonier, M. S. (1997) · Cited by 88 · see citing works
Research methods in criminal justice
Taylor, R. B. (1994) · McGraw-Hill eBooks · Cited by 83 · see citing works
Self-citationWillis, J. J., & Mastrofski, S. D. (2016) · Policing & Society · doi:10.1080/10439463.2015.1135921 · Cited by 77 · see citing works
Assessing the Spatial–Temporal Relationship Between Disorder and Violence
Yang, S. (2009) · Journal of Quantitative Criminology · doi:10.1007/s10940-009-9085-7 · Cited by 76 · see citing works
Early Warning System for Temporary Crime Hot Spots
Gorr, W. L., & Lee, Y. (2014) · Journal of Quantitative Criminology · doi:10.1007/s10940-014-9223-8 · Cited by 75 · see citing works
The Philadelphia predictive policing experiment
Ratcliffe, J. H., Taylor, R. B., Askey, A. P., Thomas, K., Grasso, J., Bethel, K. J., Fisher, R., & Koehnlein, J. (2021) · Journal of Experimental Criminology · doi:10.1007/s11292-019-09400-2 · Cited by 74 · see citing works
Self-citationHaberman, C. P. (2017) · Criminology & Public Policy · doi:10.1111/1745-9133.12303 · Cited by 71 · see citing works
Who commits near repeats? A test of the boost explanation
Bowers, K., & Johnson, S. D. (2004) · UCL Discovery (University College London) · Cited by 68 · see citing works
Crime Seen Through a Cone of Resolution
Brantingham, P. J., Dyreson, D. A., & Brantingham, P. L. (1976) · American Behavioral Scientist · doi:10.1177/000276427602000207 · Cited by 65 · see citing works
Taylor, R. B. (2016) · New York University Press eBooks · doi:10.18574/nyu/9780814725498.001.0001 · Cited by 65 · see citing works
Self-citation(2014) · Cited by 63 · see citing works
Panel data and experimental design
Burlig, F., Preonas, L., & Woerman, M. (2020) · Journal of Development Economics · doi:10.1016/j.jdeveco.2020.102458 · Cited by 52 · see citing works
Police and policing: Contemporary issues
Munster, A. (1992) · Journal of Criminal Justice · doi:10.1016/0047-2352(92)90037-a · Cited by 50 · see citing works
Eck, J., Lee, Y., O, S., & Martinez, N. N. (2017) · Crime Science · doi:10.1186/s40163-017-0070-4 · Cited by 47 · see citing works
Conflicts and congruencies between predictive policing and the patrol officer’s craft
Ratcliffe, J. H., Taylor, R. B., & Fisher, R. (2019) · Policing & Society · doi:10.1080/10439463.2019.1577844 · Cited by 45 · see citing works
Self-citationHinkle, J. C., Weisburd, D., Famega, C., & Ready, J. (2013) · Evaluation Review · doi:10.1177/0193841x13519799 · Cited by 39 · see citing works
The effect of spatiotemporal resolution on predictive policing model performance
Rummens, A., & Hardyns, W. (2020) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2020.03.006 · Cited by 37 · see citing works
Modeling Criminal Activity in Urban Landscapes
Brantingham, P. L., Glässer, U., Jackson, P. J., & Vajihollahi, M. (2009) · Springer eBooks · doi:10.1007/978-3-211-09442-6_2 · Cited by 33 · see citing works
Keeping Score: Predictive Analytics in Policing
Fitzpatrick, D., Gorr, W. L., & Neill, D. B. (2018) · Annual Review of Criminology · doi:10.1146/annurev-criminol-011518-024534 · Cited by 32 · see citing works
Shalloo, J. P., Michael, J., & Adler, M. J. (1934) · University of Pennsylvania Law Review · doi:10.2307/3307940 · Cited by 32 · see citing works
Reducing Crime: A Companion for Police Leaders
Ratcliffe, J. H. (2018) · Cited by 23 · see citing works
Self-citationDrawve, G. R., & Wooditch, A. (2019) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2019.101625 · Cited by 17 · see citing works
Schmidt, C. O., Ittermann, T., Schulz, A., Grabe, H. J., & Baumeister, S. E. (2012) · International Journal of Public Health · doi:10.1007/s00038-012-0363-z · Cited by 13 · see citing works
Increasing Equivalence in Small-Sample Place-Based Experiments
Gill, C. E., & Weisburd, D. L. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139424776.011 · Cited by 12 · see citing works
Panel Data and Experimental DesignPreprint
Burlig, F., Preonas, L., & Woerman, M. (2017) · doi:10.31222/osf.io/d5eud · Cited by 5 · see citing works
Flagged first, then by citations
2 of the 83 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Data in Policing: An Integrative Review
Afzal, M., & Panagiotopoulos, P. (2024) · International Journal of Public Administration · doi:10.1080/01900692.2024.2360586 · Cited by 51 · see citing works
The Long-Term and System-Level Impacts of Institutionalizing Hot Spot Policing in a Small City
Koper, C. S., Lum, C. M., Wu, X., & Hegarty, T. (2020) · Policing A Journal of Policy and Practice · doi:10.1093/police/paaa096 · Cited by 24 · see citing works
Smart criminal justice: Phenomena and normative requirements
Simmler, M., Canova, G., & Schedler, K. (2023) · International Review of Administrative Sciences · doi:10.1177/00208523211039740 · Cited by 16 · see citing works
The Indianapolis harmspot policing experiment
Carter, J. G., Mohler, G., Raje, R., Chowdhury, N., & Pandey, S. (2021) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2021.101814 · Cited by 14 · see citing works
‘Led by Intelligence': A Scoping Review on the Experimental Evaluation of Intelligence-Led Policing
Khalfa, R., & Hardyns, W. (2024) · Evaluation Review · doi:10.1177/0193841x231204588 · Cited by 12 · see citing works
Corsaro, N. A., ENGEL, R. S., Herold, T. D., Yildirim, M., & Motz, R. T. (2021) · Journal of Experimental Criminology · doi:10.1007/s11292-021-09485-8 · Cited by 6 · see citing works
Legal, Ethical, and Social Issues of AI and Law Enforcement in Europe
Brakel, R. E. V. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009367783.022 · Cited by 4 · see citing works
Algorithms, human decision-making and predictive policing
Phillips, P. J., & Pohl, G. (2021) · SN Social Sciences · doi:10.1007/s43545-021-00109-6 · Cited by 4 · see citing works
Khalfa, R., & Hardyns, W. (2025) · Applied Spatial Analysis and Policy · doi:10.1007/s12061-025-09683-1 · Cited by 3 · see citing works
The effects of nonresponse and follow-up mailings on a citizen survey of law enforcement services
Ward, R. E. (2022) · Police Practice and Research · doi:10.1080/15614263.2022.2036610 · Cited by 2 · see citing works
Valasik, M. A., & Brantingham, P. J. (2024) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197618158.013.38 · Cited by 1 · see citing works
Boqué, P., Sáez, M., & Serra, L. (2025) · European Journal on Criminal Policy and Research · doi:10.1007/s10610-025-09621-4 · Cited by 1 · see citing works
(2020) · Criminology & Public Policy · doi:10.1111/1745-9133.12454 · Cited by 1 · see citing works
Relasi Kekuasaan antar Pemerintah, Masyarakat & LSM pada Revitalisasi Teluk Jakarta
Gugat, R. M. D., Abubakar, F., & Susanti, R. (2022) · ijd-demos · doi:10.37950/ijd.v4i1.219
Le système pénal intelligent : observations et exigences normatives
Simmler, M., Canova, G., & Schedler, K. (2023) · Revue Internationale des Sciences Administratives · doi:10.3917/risa.892.0109
Smuha, N. A. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009367783.016
- Authors
- Taylor, R. B., & Ratcliffe, J. H.
- Affiliations
- Temple University (US)
- Corresponding author
- Taylor, Ralph B.
- Venue
- Criminology & Public Policy
- Publisher
- Informa UK Limited
- Published
- 2020-07-27
- Volume
- 19
- Issue
- 3
- Pages
- 965-996
- ISSN
- 1538-6473 (ISSN-L)
- 1745-9133
- OpenAlex
- W3044472787
- Cited by
- 16
- References
- 83
- Citations by year
- 2025: 4 · 2024: 2 · 2023: 2 · 2022: 2 · 2021: 4 · 2020: 2
- FWCI
- 3.34
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Criminology & Public Policy (publishedVersion)
- Funders
- National Institute of Justice (2014‐R2‐CX‐0002)
- Topics
- Social Sciences › Sociology and Political Science › Crime Patterns and Interventions
- Social Sciences › Political Science and International Relations › Policing Practices and Perceptions
- Social Sciences › Law › Criminal Justice and Penology
- Keywords
- predictive policing, statistical power, randomized controlled trials, property crime, hot spot policing, unit of analysis, concentration effects, social justice, experimental design, crime prevention effectiveness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review