The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Predictive Validity Performance Indicators in Violence Risk Assessment: A Methodological Primer
Open accessAbstract
The predictive validity of violence risk assessments can be divided into two components: calibration and discrimination. The most common performance indicator used to measure the predictive validity of structured risk assessments, the area under the receiver operating characteristic curve (AUC), measures the latter component but not the former. As it does not capture how well a risk assessment tool's predictions of risk agree with actual observed risk, the AUC provides an incomplete portrayal of predictive validity. This primer provides an overview of calibration and discrimination performance indicators that measure global performance, performance in identifying higher‐risk groups, and performance in identifying lower‐risk groups. It is recommended that future research into the predictive validity of violence risk assessment tools includes a number of performance indicators that measure different facets of predictive validity and that the limitations of reported indicators be routinely explicated. Copyright © 2013 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Hanley, J. A., & McNeil, B. J. (1983) · Radiology · doi:10.1148/radiology.148.3.6878708 · Cited by 7,016
Pencina, M. J., D' Agostino, R. B., D' Agostino, R. B., & Vasan, R. S. (2008) · Statistics in Medicine · doi:10.1002/sim.2929 · Cited by 6,493
Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170
Note on the Sampling Error of the Difference Between Correlated Proportions or Percentages
McNemar, Q. (1947) · Psychometrika · doi:10.1007/bf02295996 · Cited by 4,754
Tests for comparing elements of a correlation matrix
Steiger, J. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.87.2.245 · Cited by 4,621 · cited 1×
“To test for differences in r pb , Fisher ’ s (1924) z -test can be used for independent samples, Steiger ’ s (1980) z -test for overlapping samples, and Pearson and Filon ’ s z -test for non-overlapping but correlated samples (Raghunathan, Rosenthal, & Rubin, 1996).”
MethodThe number needed to treat: a clinically useful measure of treatment effect
Cook, R. J., & Sackett, D. L. (1995) · BMJ · doi:10.1136/bmj.310.6977.452 · Cited by 1,885
Statistics Notes: Diagnostic tests 2: predictive values
Altman, D. G., & Bland, J. M. (1994) · BMJ · doi:10.1136/bmj.309.6947.102 · Cited by 1,711
Comparing effect sizes in follow-up studies: ROC Area, Cohen's d, and r.
Rice, M. E., & Harris, G. T. (2005) · Law and Human Behavior · doi:10.1007/s10979-005-6832-7 · Cited by 1,608
Rehabilitating criminal justice policy and practice
Andrews, D. A., & Bonta, J. (2010) · Psychology, Public Policy, and Law · doi:10.1037/a0018362 · Cited by 1,223 · cited 1×
“…most from the development of risk management plans and the provision of treatment resources can be identi fi ed, while those who pose the lowest risk can be screened out of interventions focused on violence risk reduction (Andrews & Bonta, 2010; Singh, Grann, Lichtenstein, Långström, & Fazel, 2012).”
BackgroundPrognosis and prognostic research: Developing a prognostic model
Royston, P., Moons, K. G. M., Altman, D. G., & Vergouwe, Y. (2009) · BMJ · doi:10.1136/bmj.b604 · Cited by 1,172
Higgins, J. P., Deeks, J. J., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch16 · Cited by 475 · cited 1×
“Further, the DOR is unde fi ned when either the number of FP or FN cases is zero, though this may be addressed by adding a constant of +1 to each cell (Higgins, Deeks, & Altman, 2008).”
BackgroundFrom effect size into number needed to treat
Furukawa, T. A. (1999) · The Lancet · doi:10.1016/s0140-6736(99)01163-0 · Cited by 114
Cited by
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
Predicting domestic violence: A meta-analysis on the predictive validity of risk assessment tools
van der Put, C. E., Gubbels, J., & Assink, M. (2019) · Aggression and Violent Behavior · doi:10.1016/j.avb.2019.03.008 · Cited by 83
Predictive Validity of Pretrial Risk Assessments: A Systematic Review of the Literature
Desmarais, S. L., Zottola, S. A., Duhart Clarke, S. E., & Lowder, E. M. (2021) · Criminal Justice and Behavior · doi:10.1177/0093854820932959 · Cited by 79
Hamilton, M. (2019) · Behavioral Sciences & the Law · doi:10.1002/bsl.2406 · Cited by 67
The predictive validity of risk assessment tools for female offenders: A systematic review
Geraghty, K. A., & Woodhams, J. (2015) · Aggression and Violent Behavior · doi:10.1016/j.avb.2015.01.002 · Cited by 54
Metadata
- Authors
- Singh, J. P.
- Venue
- Behavioral Sciences & the Law
- Publisher
- Wiley
- Published
- 2013-01
- Volume
- 31
- Issue
- 1
- Pages
- 8-22
- ISSN
- 0735-3936 (ISSN-L)
- 1099-0798
- OpenAlex
- W1535531650
- Cited by
- 184
- References
- 13
- FWCI
- 18.70
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.