Violent recidivism: Assessing predictive validity.

Abstract

Until very recently, there has been little evidence of the ability of either clinicians or actuarial instruments to predict violent behavior. Moreover, a confusing variety of measures have been proposed for the evaluation of the accuracy of predictions. This report demonstrates that receiver operating characteristics (ROCs) have advantages over other measures inasmuch as they are simultaneously independent of the base rate for violence in the populations studied and of the particular cutoff score chosen to classify cases as likely to be violent. In an illustration of the value of this approach, the base rates of violence were altered with the use of data from 3.5-, 6-, and 10-year follow-ups of 799 previously violent men. Base rates for the 10-year follow-up were also altered by changing the definition of violent recidivism and by examining a high-risk subgroup. The report also shows how ROC methods can be used to compare the performance of different instruments for the prediction of violence. The report illustrates how ROCs facilitate decisions about whether, at a particular base rate, the use of a prediction instrument is warranted. Finally, some of the limitations of ROCs are outlined, and some cautionary remarks are made with regard to their use.

Cites (3)

1. The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis.
   Lipsey, Mark W., Wilson, David B. · 1993 · American Psychologist
2. A common language effect size statistic
   McGraw, Kenneth O., Wong, S. P. · 1992 · Psychological Bulletin
3. Sex offender recidivism: a review
   Furby, Lita, Weinrott, Mark R., Blackshaw, Lyn · 1989 · Psychological Bulletin

Show all 3 references

Cited by (23)

1. Comparing effect sizes in follow-up studies: ROC Area, Cohen's d, and r.
   Rice, Marnie E., Harris, Grant T. · 2005 · Law and Human Behavior
2. A META‐ANALYSIS OF THE PREDICTORS OF ADULT OFFENDER RECIDIVISM: WHAT WORKS!*
   GENDREAU, PAUL, LITTLE, TRACY, GOGGIN, CLAIRE · 1996 · Criminology
3. Improving risk assessments for sex offenders: A comparison of three actuarial scales.
   Hanson, R. Karl, Thornton, David · 2000 · Law and Human Behavior
4. Studying the clinician: judgment research and psychological assessment
   1999 · Choice Reviews Online
5. Screening for generalized anxiety disorder using the Penn State Worry Questionnaire: a receiver operating characteristic analysis
   Behar, Evelyn, Alcaine, Oscar, Zuellig, Andrea R., Borkovec, T.D. · 2003 · Journal of Behavior Therapy and Experimental Psychiatry

See all 638