Performance of recidivism risk assessment instruments in U.S. correctional settings.
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
With the population of adults under correctional supervision in the United States at an all-time high, psychologists and other professionals working in U.S. correctional agencies face mounting pressures to identify offenders at greater risk of recidivism and to guide treatment and supervision recommendations. Risk assessment instruments are increasingly being used to assist with these tasks; however, relatively little is known regarding the performance of these tools in U.S. correctional settings. In this review, we synthesize the findings of studies examining the predictive validity of assessments completed using instruments designed to predict general recidivism risk, including committing a new crime and violating conditions of probation or parole, among adult offenders in the United States. We searched for studies conducted in the United States and published between January 1970 and December 2012 in peer-reviewed journals, government reports, master's theses, and doctoral dissertations using PsycINFO, the U.S. National Criminal Justice Reference Service Abstracts, and Google. We identified 53 studies (72 samples) conducted in U.S. correctional settings examining the predictive validity of 19 risk assessment instruments. The instruments varied widely in the number, type, and content of their items. For most instruments, predictive validity had been examined in 1 or 2 studies conducted in the United States that were published during the reference period. Only 2 studies reported on interrater reliability. No instrument emerged as producing the "most" reliable and valid risk assessments. Findings suggest the need for continued evaluation of the performance of instruments used to predict recidivism risk in U.S. correctional agencies. (PsycINFO Database Record
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
How Big is a Big Odds Ratio? Interpreting the Magnitudes of Odds Ratios in Epidemiological Studies
Chen, H., Cohen, P., & Chen, S. (2010) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610911003650383 · Cited by 1,952 · cited 4×
“Then, total scores are cross-referenced with actuarial risk tables (Hilton, Harris, & Rice, 2006).”
InfluentialComparing effect sizes in follow-up studies: ROC Area, Cohen's d, and r.
Rice, M. E., & Harris, G. T. (2005) · Law and Human Behavior · doi:10.1007/s10979-005-6832-7 · Cited by 1,608 · cited 1×
“…1.50–2.99 .10–.19 Good .50–.79 .24–.36 .64–.71 3.00–4.99 .20–.29 Excellent > .80 .37–1.00 .71–1.00 > 5.00 .30–1.00 Notes: Benchmarks were anchored to Cohen’s d (1988) and based upon the calculations of Rice and Harris (2005) for AUC values and Chen, Cohen, and Chen (2010) for the odds ratios.”
InfluentialRehabilitating criminal justice policy and practice
Andrews, D. A., & Bonta, J. (2010) · Psychology, Public Policy, and Law · doi:10.1037/a0018362 · Cited by 1,223 · cited 1×
“Additionally, in contrast with the traditional “one-size-fits-all” criminal justice approach, research shows that the most effective strategies for reducing recidivism are those delivered to offenders at greater risk of recidivism that target individual needs (Andrews & Bonta, 2010).”
ResultRecidivism of Prisoners Released in 1994
Langan, P. A., & Levin, D. J. (2002) · Federal Sentencing Reporter · doi:10.1525/fsr.2002.15.1.58 · Cited by 1,008
Ægisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., Nichols, C. N., Lampropoulos, G. K., Walker, B. S., Cohen, G., et al. (2006) · The Counseling Psychologist · doi:10.1177/0011000005285875 · Cited by 737 · cited 1×
“There is overwhelming evidence that risk assessments completed using structured approaches produce estimates that are more reliable and more accurate than unstructured risk assessments (Ægisdóttir et al., 2006; Grove, Zald, Lebow, Snitz, & Nelson, 2000).”
BackgroundRisk Assessment in Criminal Sentencing
Monahan, J., & Skeem, J. L. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-092945 · Cited by 256 · cited 9×
“However, the more widespread use of risk assessment instruments in the sentencing process is a topic of continued debate (Monahan & Skeem, 2016).”
BackgroundInfluential
Cited by
The Principles and Limits of Algorithm-in-the-Loop Decision Making
Green, B., & Chen, Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359152 · Cited by 392
RISK, RACE, AND RECIDIVISM: PREDICTIVE BIAS AND DISPARATE IMPACT*
SKEEM, J. L., & LOWENKAMP, C. T. (2016) · Criminology · doi:10.1111/1745-9125.12123 · Cited by 317
Disparate Interactions: An Algorithm-in-the-Loop Analysis of Fairness in Risk Assessments
Green, B., & Chen, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287563 · Cited by 275
“67 on the test set, indicating comparable accuracy to COMPAS [37, 45], the Public Safety Assessment [13], and other risk assessments [14, 15].”
ResultRisk Assessment in Criminal Sentencing
Monahan, J., & Skeem, J. L. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-092945 · Cited by 256
“Instruments used at sentencing also differ with respect to their evidence base (Desmarais et al. 2015).”
BackgroundLayers of bias: A unified approach for understanding problems with risk assessment
Eckhouse, L., Lum, K., Conti-Cook, C., & Ciccolini, J. (2019) · Criminal Justice and Behavior · doi:10.1177/0093854818811379 · Cited by 156
Tolan, S., Miron, M., Gómez, E., & Castillo, C. (2019) · Proceedings of the Seventeenth International Conference on Artificial Intelligence and Law · doi:10.1145/3322640.3326705 · Cited by 75
Engel, C., & Grgić-Hlača, N. (2021) · Journal of Legal Analysis · doi:10.1093/jla/laab001 · Cited by 16
Examining the predictive validity of the Public Safety Assessment
Brittain, B. J., Georges, L., & Martin, J. (2021) · Criminal Justice and Behavior · doi:10.1177/00938548211005836 · Cited by 15
Metadata
- Authors
- Desmarais, S. L., Johnson, K. L., & Singh, J. P.
- Venue
- Psychological Services
- Published
- 2016-08
- Volume
- 13
- Issue
- 3
- Pages
- 206-222
- ISSN
- 1541-1559 (ISSN-L)
- 1939-148X
- OpenAlex
- W2462893817
- Cited by
- 118
- References
- 6
- FWCI
- 18.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.