Cited by 178Criminal Justice and Corrections AnalysisPsychopathy, Forensic Psychiatry, Sexual OffendingCriminal Justice and Penology

Forecasting Murder Within a Population of Probationers and Parolees: A High Stakes Application of Statistical Learning

Open access
Berk, Richard, Sherman, Lawrence, Barnes, Geoffrey, Kurtz, Ellen, Ahlman, Lindsay·2009·Journal of the Royal Statistical Society Series A: Statistics in Society

Abstract

Summary: Forecasts of future dangerousness are often used to inform the sentencing decisions of convicted offenders. For individuals who are sentenced to probation or paroled to community supervision, such forecasts affect the conditions under which they are to be supervised. The statistical criterion for these forecasts is commonly called recidivism, which is defined as a charge or conviction for any new offence, no matter how minor. Only rarely do such forecasts make distinctions on the basis of the seriousness of offences. Yet seriousness may be central to public concerns, and judges are increasingly required by law and sentencing guidelines to make assessments of seriousness. At the very least, information about seriousness is essential for allocating scarce resources for community supervision of convicted offenders. The paper focuses only on murderous conduct by individuals on probation or parole. Using data on a population of over 60000 cases from Philadelphia’s Adult Probation and Parole Department, we forecast whether each offender will be charged with a homicide or attempted homicide within 2 years of beginning community supervision. We use a statistical learning approach that makes no assumptions about how predictors are related to the outcome. We also build in the costs of false negative and false positive charges and use half of the data to build the forecasting model, and the other half of the data to evaluate the quality of the forecasts. Forecasts that are based on this approach offer the possibility of concentrating rehabilitation, treatment and surveillance resources on a small subset of convicted offenders who may be in greatest need, and who pose the greatest risk to society.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/j.1467-985x.2008.00556.x

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Berk et al. evaluated their model only on the set of defendants who had been granted parole.

    “For instance, Berk et al. evaluated their model only on the set of defendants who have been granted parole.”

    From The Selective Labels Problem (2017) · cites this paper as [7]

    The Setting (p. unavailable) describes the supervised population as both probationers and parolees. The Data section (p. unavailable) says the test sample was drawn from APPD intake cases, not solely from people granted parole. (LLM, conf=0.90)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured
  • The assumption of no unmeasured confounders does not typically hold in cases where human decisions are providing data labels.

    “This assumption does not typically hold in cases where human decisions are providing data labels [7, 21].”

    From The Selective Labels Problem (2017) · cites this paper as [7]

    The Setting (section 3; page unavailable) says homicide charges are an imperfect outcome measure and that convictions introduce further error through adjudication. The Discussion (section 6; page unavailable) also notes that subjective forecasts may contain unmeasured racial bias. These passages support concerns about human decisions in the data, but the paper does not say that the no-unmeasured-confounders assumption typically fails when humans provide labels. (LLM, conf=0.77)

    Experimental — accuracy not yet measured
  • Prior research often overlooks the selective labels problem, evaluating models by computing traditional metrics such as AUC or accuracy only on data points for which ground truth labels are available.

    “While prior research has explored applications of machine learning to domains where human judgments are part of the data labeling process (crime [7, 21, 43], medical diagnosis [6, 22]), the selective labels problem is often overlooked, with evaluation of the models typically carried out by computing traditional metrics such as AUC or accuracy only on the data points for which ground truth labels”

    From The Selective Labels Problem (2017) · cites this paper as [7]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 51 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

  1. Burgess, E. W. (1928) Factors determining success or failure on parole. In The Working of the Indeterminant Sentence Law and the Parole System in Illinois (eds A. A. Bruce, A. J. Harno, E. W. Burgess and J. Landesco), pp. 205-249. Springfield: State Board of Parole.
  2. Maltz, M. D. (1984) Recidvism. New York: Academic Press.

Cited by

Sorted by citations

Authors
Berk, R., Sherman, L., Barnes, G., Kurtz, E., & Ahlman, L.
Affiliations
  • University of Pennsylvania (US)
  • University of Cambridge (GB)
  • First Judicial District of Pennsylvania , Philadelphia , USA
Corresponding author
Berk, Richard
Venue
Journal of the Royal Statistical Society Series A: Statistics in Society
Published
2008-07-24
Volume
172
Issue
1
Pages
191-211
ISSN
  • 0964-1998 (ISSN-L)
  • 1467-985X
OpenAlex
W2038763866
Cited by
178
References
51
Citations by year
2026: 2 · 2025: 5 · 2024: 6 · 2023: 10 · 2022: 13 · 2021: 6 · 2020: 12 · 2019: 14 · 2018: 13 · 2017: 12 · 2016: 16 · 2015: 9 · 2014: 7 · 2013: 15 · 2012: 16
FWCI
24.22
Type
journal article
Language
en
Open access
Locations
Journal of the Royal Statistical Society Series A (Statistics in Society) (publishedVersion)
Funders
National Science Foundation (SES-0437169)
Topics
  • Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
  • Social Sciences › Psychology › Clinical Psychology › Psychopathy, Forensic Psychiatry, Sexual Offending
  • Social Sciences › Law › Criminal Justice and Penology
Keywords
probationers, parolees, recidivism, statistical learning, community supervision, sentencing guidelines, resource allocation, Philadelphia

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review