Cited by 1,608Meta-analysis and systematic reviewsStatistical Methods in EpidemiologyPsychology Research and Bibliometrics

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

Comparing effect sizes in follow-up studies: ROC Area, Cohen's d, and r.

Rice, Marnie E., Harris, Grant T.·2005·Law and Human Behavior

DOI 10.1007/s10979-005-6832-7

Open this paper in CoChat — free account

Abstract

In order to facilitate comparisons across follow-up studies that have used different measures of effect size, we provide a table of effect size equivalencies for the three most common measures: ROC area (AUC), Cohen's d, and r. We outline why AUC is the preferred measure of predictive or diagnostic accuracy in forensic psychology or psychiatry, and we urge researchers and practitioners to use numbers rather than verbal labels to characterize effect sizes.

Integrity signals

Registry

Crossref · 10.1007/s10979-005-6832-7

Cites

0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Meta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635
Interpreting the magnitudes of correlation coefficients.
Hemphill, J. F. (2003) · American Psychologist · doi:10.1037/0003-066x.58.1.78 · Cited by 1,237
A common language effect size statistic
McGraw, K. O., & Wong, S. P. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.2.361 · Cited by 934 · cited 1×
“AUC also has a plain language interpretation because it is conceptually and mathematically similar to the common language effect size or CL ( McGraw & Wong, 1992; see also Delaney & Vargha, 2002).”

Flagged first, then by citations

Show all 0 references

Research works printed but not linked: 13

Berlin, F. S., Galbreath, N. W., Geary, B., & McGlone, G. (2003). The use of actuarials at civil commitment hearings to predict the likelihood of future sexual violence. Sexual Abuse: A Journal of Research and Treatment, 15, 377–382. · DOI
Cohen, J. (1969). Statistical power analysis for the behavioral sciences. New York: Academic Press.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
Cohen, J. (1992). A power primer. Psychological Bulletin, 122, 155–159. · DOI · Paper page
Delaney, H. D., & Vargha, A. (2002). Comparing several robust tests of stochastic equality with ordinally scaled variables and small to moderate sized samples. Psychological Methods, 7, 485–503. · DOI
Harris, G. T., & Rice, M. E. (2003). Actuarial assessment of risk among sex offenders. In R. A. Prentky, E. S. Janus, & M. C. Seto (Eds.), Understanding and managing sexually coercive behavior, Vol. 989 (pp. 198–210). New York: Annals of the New York Academy of Sciences. · DOI
Mossman, D. (1994). Assessing predictions of violence being accurate about accuracy. Journal of Consulting and Clinical Psychology, 62, 783–792. · DOI
Pearson, E. S., & Hartley, H. O. (Eds.). (1954). Biometrika tables for statisticians, Vol. 1 (1st ed.). Cambridge: Cambridge University Press.
Rice, M. E., & Harris, G. T. (1995). Violent recidivism: Assessing predictive validity. Journal of Consulting and Clinical Psychology, 63, 737–748. · DOI
Rosenthal, R. (1990). How are we doing in soft psychology? American Psychologist, 45, 775–777. · DOI
Rosenthal, R., & Rubin, D. B. (1982). A simple, general purpose display of magnitude of experimental effect. Journal of Educational Psychology, 74, 166–169. · DOI
Swets, J. A. (1986). Indices of discrimination or diagnostic accuracy: Their ROCs and implied models. Psychological Bulletin, 99, 100–117. · DOI
Swets, J. A., Dawes, R. M., & Monahan, J. (2000). Psychological science can improve diagnostic decisions. Psychological Science in the Public Interest: A Journal of the American Psychological Society, 1, 1–26. · DOI

Sorted by citations

Items 701–800 of 1,001

Examining the Psychometric Properties of the Sexual Initiation Strategies Scale (SISS): A New Self-Report Measure of Sexual Aggression Perpetration History
Peterson, Z. D. (2022) · Journal of Sex Research · doi:10.1080/00224499.2022.2130856 · Cited by 12
“…p < 001.2 For other measures of convergent validity, given that the analyses involved point-biserial correlations with an expected base rate of 25% or less for sexual coercion/assault, .086, .212, and .327, were treated as low, medium, and high effect sizes, respectively (Rice & Harris, 2005).”
BackgroundInfluential
Novel Gene Signatures Predicting Primary Non-response to Infliximab in Ulcerative Colitis: Development and Validation Combining Random Forest With Artificial Neural Network
Feng, J., Chen, Y.-Y., Feng, Q., Ran, Z., & Shen, J. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.678424 · Cited by 12
“9, it was considered an outstanding discrimination (19).”
Background
An investigation into the psychosocial impact of therapeutic recreation summer camp for youth with serious illness and disability
Yang, J., Shafran, R., Bennett, S., & Jolly, A. (2021) · Clinical Child Psychology and Psychiatry · doi:10.1177/13591045211028539 · Cited by 12
“Post-hoc pairwise comparisons using the Bonferroni correction and Cohen’s d effect sizes (Rice & Harris, 2005) were conducted on data for the PedsQL subscales to further examine whether there was a statistically significant difference between pre-camp scores and post-camp 1 scores, and between…”
Method
Age as a determining variable in the practice or abandonment of physical exercise among young people
Portela-Pino, I., Esteve, T. V., & Martínez‐Patiño, M. J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0253750 · Cited by 17
Deception and lie detection in the courtroom: The effect of defendants wearing medical face masks.
Vrij, A., & Hartwig, M. (2021) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2021.06.002 · Cited by 19
“Small effects are the equivalent of the difference in height between a 15- and 16-year old girl (about an inch) which is barely visible with the naked eye (Cohen, 1992; Rice & Harris, 2005).”
Background
Tailoring to a Mandate: The Development and Validation of the Prisoner Assessment Tool Targeting Estimated Risk and Needs (PATTERN)
Hamilton, Z. K., Duwe, G., Kigerl, A., Gwinn, J. D., Langan, N. P., & Dollar, C. W. (2021) · Justice quarterly · doi:10.1080/07418825.2021.1906930 · Cited by 12
“The AUC is the industry standard for predictive accuracy and established effect-size range magnitudes are, negligible (<0.55), small (0.55–0.63), moderate (0.64–0.71), and strong (>0.71) (Rice & Harris, 2005).”
BackgroundInfluential
Incremental validity of the Psychopathy Checklist-Revised above and beyond the diagnosis of antisocial personality disorder regarding recidivism in sexual offenders
Yoon, D., Eher, R., & Mokros, A. (2021) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2020.101780 · Cited by 12
Predicting youth reoffending after incarceration: added value of protective factors and heart rate variability
de Ruigh, E. L., Kleeven, A. T. H., Jansen, L. M. C., Robbé, M. D. V., Vermeiren, R. R. J. M., Mulder, E. A., de Paauw, B., van de Ven, P. M., & Popma, A. (2020) · Journal of Forensic Psychiatry and Psychology · doi:10.1080/14789949.2020.1860250 · Cited by 20
“In a review conducted by Borum and colleagues (Bartel et al., 2000), the area under the curve (AUC) for the SAVRY total risk scores ranged from .74 to .80 across studies (these can be perceived as large effect sizes) (Rice & Harris, 2005).”
Background
Dispersion matters: Diagnostics and control data computer simulation in Concealed Information Test studies
Lukács, G., & Specker, E. (2020) · PLoS ONE · doi:10.1371/journal.pone.0240259 · Cited by 16
“The diagnostic efficiencies of these two devices (A and B) can then be statistically compared, for example, using DeLong’s test to compare the two AUCs [12, 13].”
Method
Mr-ResNeXt: A Multi-resolution Network Architecture for Detection of Obstructive Sleep Apnea
Chen, Q.-R., Yue, H.-J., Pang, X.-W., Lei, W.-B., Zhao, G.-S., Liao, E.-H., & Wang, Y.-Q. (2020) · NCAA · doi:10.1007/978-981-15-7670-6_35 · Cited by 12
Psychopathy, emotionality, and offending
Mossière, A., Olver, M., & Marche, T. (2020) · Journal of Forensic Psychiatry & Psychology · doi:10.1080/14789949.2020.1772341 · Cited by 12
“ROC generates an area under the curve (AUC) statistic whereby values of .56, .64, and .71 correspond to small, medium, and large effects, respectively (Rice & Harris, 2005).”
Background
Vital sign abnormalities as predictors of clinical deterioration in subacute care patients: A prospective case-time-control study.
Considine, J., Street, M., Hutchinson, A. M., Mohebbi, M., Rawson, H., Dunning, T., Botti, M., Duke, M., Hutchison, A. F., & Bucknall, T. (2020) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2020.103612 · Cited by 12
Validity of Risk Assessment Instruments Among Juveniles Who Sexually Offended: Victim Age Matters
Krause, C., Roth, A., Landolt, M., Bessler, C., & Aebi, M. (2020) · Sexual abuse. A Journal of Research and Treatment · doi:10.1177/1079063220910719 · Cited by 12
“Others (Rice & Harris, 2005) suggest interpreting AUC values analogously to Cohen’s effect size d as small (AUC = .556–.639; d = .20–.50), moderate (AUC = .639–.714; 386 Sexual Abuse 33(4) d = .50–.80), and large (AUC ≥ .714; d ≥ .80).”
BackgroundMethod
Cross Validation of the Prodromal Questionnaire 16-Item Version in an Adolescent Help-Seeking Population
de Jong, Y., Mulder, C., Boon, A., Coenders, E., & van der Gaag, M. (2020) · Schizophrenia Bulletin Open · doi:10.1093/schizbullopen/sgaa033 · Cited by 12
Developing a risk/need assessment tool for women offenders: a gender-informed approach
Wardrop, K., Wanamaker, K. A., & Derkzen, D. (2019) · doi:10.1108/jcrpp-03-2019-0017 · Cited by 12
Proof-of-concept study of a multi-gene risk score in adolescent bipolar disorder
Dimick, M. K., Cazes, J., Fıksenbaum, L., Zai, C. C. H., Tampakeras, M., Freeman, N., Youngstrom, E. A., Kennedy, J. L., & Goldstein, B. I. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.009 · Cited by 14
Generating actionable predictions regarding MOOC learners’ engagement in peer reviews
Er, E., Gómez-Sánchez, E., Bote-Lorenzo, M., Dimitriadis, Y., & Asensio-Pérez, J. (2019) · Behavior and Information Technology · doi:10.1080/0144929x.2019.1669222 · Cited by 12
Determining Batterer Intervention Program Treatment Intensities: An Illustration Using the Ontario Domestic Assault Risk Assessment
Radatz, D. L., & Hilton, N. Z. (2019) · Partner Abuse · doi:10.1891/1946-6560.10.3.269 · Cited by 12
“In ID:p0120 cross-validations of the ODARA’s predictive accuracy for domestic violence recidivism in samples overlapping with the present study sample, area under the curves (AUCs) ranged from .65 to .74, considered medium to large effects (Rice & Harris, 2005).”
Method
Validity and Reliability of the Violence Risk Scale–Youth Sexual Offense Version
Rojas, E. Y., & Olver, M. (2019) · Sexual abuse. A Journal of Research and Treatment · doi:10.1177/1079063219858064 · Cited by 12
“A value of .50 represents chance-level predictive accuracy; values of .56, .64, and .71 represent small, medium, and large effects, respectively (Rice & Harris, 2005).”
Background
A Prospective Study on Self-Reported Psychopathy and Criminal Recidivism Among Incarcerated Male Juvenile Offenders
Pechorro, P., Seto, M., Ray, J. V., Alberto, I., & Simões, M. (2019) · International journal of offender therapy and comparative criminology · doi:10.1177/0306624x19849569 · Cited by 12
Utility of a Clinical Decision Support System in Weight Loss Prediction After Head and Neck Cancer Radiotherapy.
Cheng, Z., Nakatsugawa, M., Zhou, X.-C., Hu, C., Greco, S., Kiess, A., Page, B., Alcorn, S., Haller, J., Utsunomiya, K., et al. (2019) · JCO Clinical Cancer Informatics · doi:10.1200/cci.18.00058 · Cited by 12
Mental Health Screening in Juvenile Justice Settings: Evaluating the Utility of the Massachusetts Youth Screening Instrument, Version 2
Shulman, E. P., Bechtold, J., Kelly, E., & Cauffman, E. (2018) · doi:10.1177/0887403416650250 · Cited by 12
“An AUC of .50, which is the AUC of the diagonal “chance performance” curve (and the equivalent of a Cohen’s d of 0.00; Rice & Harris, 2005), would indicate that a subscale was useless—no better than chance—at classifying youth with or without the criterion diagnosis.”
BackgroundMethodInfluential
Psychological Assessment of Intimate Partner Violence
Yaxley, R., Norris, K., & Haines, J. M. (2018) · Psychiatry, Psychology and Law · doi:10.1080/13218719.2017.1356211 · Cited by 12
“ROC analysis has become the preferred method of analysis in violence prediction studies because it allows scales to be compared and, unlike other statistics, is not adversely affected by the underlying recidivist rate in the target population – i.e. the base rate (Rice & Harris 2005).”
BackgroundMethod
Self-reported violent ideation and its link to interpersonal violence among offenders with mental disorders and general psychiatric patients.
Persson, M., Sturup, J., Belfrage, H., & Kristiansson, M. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2017.12.079 · Cited by 12
Psychometric Examination of Treatment Change Among Mentally Disordered Offenders: A Risk–Needs Analysis
Kingston, D. A., & Olver, M. (2018) · Criminal Justice and Behavior · doi:10.1177/0093854817743539 · Cited by 12
How effective are risk assessments/measures for predicting future aggressive behaviour in adults with intellectual disabilities (ID): A systematic review and meta-analysis.
Lofthouse, R. E., Golding, L., Totsika, V., Hastings, R., & Lindsay, W. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.10.001 · Cited by 12
The prevalence, subtypes and associated factors of hyperuricemia in lupus nephritis patients at chronic kidney disease stages 1–3
Liu, S., Gong, Y., Ren, H., Zhang, W., Chen, X.-N., Zhou, T., Li, X., & Chen, N. (2017) · OncoTarget · doi:10.18632/oncotarget.19051 · Cited by 12
The Predictive Validity of the Structured Assessment of Violence Risk in Youth for Young Spanish Offenders
Ortega-Campos, E., García-García, J., & Zaldívar-Basurto, F. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00577 · Cited by 12
“71 are described as large effects (Rice and Harris, 2005).”
BackgroundInfluential
L’évaluation structurée du risque de récidive des personnes placées sous main de justice : méthodes et enjeux
Guay, J.-P., Benbouriche, M., & Parent, G. (2015) · Pratiques Psychologiques · doi:10.1016/j.prps.2015.05.005 · Cited by 12
Factor structure and construct validity of the psychopathic personality inventory in a forensic sample.
Gonsalves, V. M., McLawsen, J. E., Huss, M. T., & Scalora, M. J. (2013) · International Journal of Law and Psychiatry · doi:10.1016/j.ijlp.2013.01.010 · Cited by 12
“Other scholars discourage judging results according to absolute * p .05 ** p .01 cut-offs, and instead recommend that researchers and audiences alike interpret AUC values by comparing them to similar results in the relevant field of research (Rice & Harris, 2005).”
Result
Speech-Based Automated Cognitive Impairment Detection From Remotely-Collected Cognitive Test Audio
Yu, B., Williamson, J., Mundt, J., & Quatieri, T. (2018) · IEEE Access · doi:10.1109/access.2018.2856478 · Cited by 12
“The effect size of these demographic variables on CI is quantified in Table 3 with Cohen’s d [30] for the age and education variables and the log odds ratio, appropriate for binary variables, for the gender variable.”
Method
The Incremental Validity of Self-Report and Performance-Based Methods for Assessing Hostility to Predict Cardiovascular Disease in Physicians
Meyer, G. J., Katko, N. J., Mihura, J. L., Klag, M. J., & Meoni, L. A. (2018) · Journal of Personality Assessment · doi:10.1080/00223891.2017.1306780 · Cited by 12
“An AUC value of .7465 equates to a Cohen’s d value of 0.94 (Rice & Harris, 2005), which is large.”
MethodInfluential
Mapping Mental Health of Seafarers Post-COVID-19: A Gaussian Graphical Model of Depression, Anxiety, and Maritime Working Conditions
Sivri, F., Uğurlu, Ö., Blanco-Davis, E., Şenbursa, N., & Wang, J. (2025) · Inquiry : a journal of medical care organization, provision and financing · doi:10.1177/00469580251371386 · Cited by 11
Do Cognitive Functions Belong in the Hierarchical Taxonomy of Psychopathology Model? A Meta-Analysis
Ringwald, W. R., Amitai Abramovitch, A., van Rentergem, J. A. A., & Kotov, R. (2025) · Perspectives on Psychological Science · doi:10.1177/17456916251347926 · Cited by 6
“For the current study, we converted all d values to r with a two-step procedure: We first converted d to point-biserial r (Rice & Harris, 2005); then we converted point-biserial r to biserial r (Terrell, 1982).”
Heritability and polygenic load for comorbid anxiety and depression
Tabrizi, F. F., Rosén, J., Grönvall, H., William-Olsson, V. R., Arner, E., Magnusson, P. K. E., Palm, C., Larsson, H., Viktorin, A., Bernhardsson, J., et al. (2025) · Translational Psychiatry · doi:10.1038/s41398-025-03325-3 · Cited by 18
Effects of 4 weeks of foot exercise on subjective outcome and foot plantar pressure in elite adolescent dancers with hallux valgus: a pilot study
Liu, Z.-J., Zhong, Y.-C., Chen, S., Tanaka, H., Li, Y., Katsutani, H., Okunuki, T., Yabiku, H., & Kumai, T. (2024) · BMC Sports Science, Medicine and Rehabilitation · doi:10.1186/s13102-024-01003-3 · Cited by 11
“Effect sizes were interpreted as follows: > 0.80 large, 0.50–0.79 moderate, 0.20–0.49 small, and < 0.20 trivial [35].”
Influential
Acute Effects of Local High-Frequency Percussive Massage on Deep Fascial and Muscular Stiffness and Joint Range of Motion in Young Adult Men.
Liu, Z.-J., Zhong, Y.-C., Maemichi, T., Zhou, Q., Okunuki, T., Li, Y., Kazuki, W., & Kumai, T. (2024) · Journal of sport rehabilitation · doi:10.1123/jsr.2022-0455 · Cited by 11
Alternative metrics for characterizing longer-term clinical outcomes in difficult-to-treat depression: II. Sensitivity to treatment effects
Aaronson, S., Sackeim, H., Jiang, M., Badejo, S., Greco, T., Bunker, M., Conway, C., Demyttenaere, K., Young, A. H., McAllister-Williams, R., et al. (2023) · Australian and New Zealand journal of psychiatry (Print) · doi:10.1177/00048674231209837 · Cited by 11
“AUC values of 0.556, 0.639 and 0.714 correspond to small ( d = 0.2), medium ( d = 0.5) and large ( d = 0.8) ES (Rice and Harris, 2005).”
Influential
High-risk Victims of Intimate Partner Violence: An Examination of Abuse Characteristics, Psychosocial Vulnerabilities and Reported Revictimization
Tomkins, J., Simpson, A. D. J., & Polaschek, D. L. L. (2023) · Journal of Family Violence · doi:10.1007/s10896-023-00661-0 · Cited by 11
“Most variables did not significantly predict either outcome (see Tomkins, 2020 for full correlation matrix); and the magnitude of these relationships were generally small (Cohen, 1998, as cited in Rice & Harris, 2005).”
Death is a law: Death of former colleagues and management forecasts
Kuang, Y., Li, L.-Y., Lu, L., & Qin, B. (2022) · Accounting, Organizations and Society · doi:10.1016/j.aos.2022.101350 · Cited by 11
A novel approach to determine aortic valve area with phase-contrast cardiovascular magnetic resonance
Troger, F., Lechner, I., Reindl, M., Tiller, C., Holzknecht, M., Pamminger, M., Kremser, C., Schwaiger, J. P., Reinstadler, S., Bauer, A., et al. (2022) · Journal of Cardiovascular Magnetic Resonance · doi:10.1186/s12968-021-00838-w · Cited by 11
“Rice M, Harris G. Comparing effect sizes in follow-up studies: ROC Area, Cohen’s d, and r. Law Hum Behav.”
MethodInfluential
Cardiac magnetic resonance imaging improves prognostic stratification of patients with ST-elevation myocardial infarction and preserved ejection fraction
Reindl, M., Stiermaier, T., Lechner, I., Tiller, C., Holzknecht, M., Mayr, A., Schwaiger, J. P., Brenner, C., Klug, G., Bauer, A., et al. (2021) · European Heart Journal Open · doi:10.1093/ehjopen/oeab033 · Cited by 11
Psychometric Evaluation of ITP Life Quality Index (ILQI) in a Global Survey of Patients with Immune Thrombocytopenia
Viana, R., D'Alessio, D., Grant, L., Cooper, N., Arnold, D., Morgan, M., Provan, D., Cuker, A., Hill, Q., Tomiyama, Y., et al. (2021) · Advances in Therapy · doi:10.1007/s12325-021-01934-0 · Cited by 11
Detecting Noncompliant Behavior in Organizations: How Online Survey Responses and Behaviors Reveal Risk
Jenkins, J. L., Valacich, J., Zimbelman, A. F., & Zimbelman, M. F. (2021) · Journal of Management Information Systems · doi:10.1080/07421222.2021.1962600 · Cited by 11
“An AUC of 0.7 or higher was considered an acceptable model with a strong effect size [37, 46].”
MethodInfluential
Perceptions of Workplace Violence and Workplace Stress: A Mixed Methods Study of Trauma among Psychiatric Workers
Hilton, N. Z., Ricciardelli, R., Shewmake, J., Rodrigues, N. C., Seto, M. C., & Ham, E. (2021) · Issues in Mental Health Nursing · doi:10.1080/01612840.2021.1899350 · Cited by 15
“We treated AUCs of at least .556, .639, and .714 as small, medium, and large effect sizes, respectively (Rice & Harris, 2005).”
Method
Long-Term Predictive Validity of the Juvenile Sex Offender Assessment Protocol–II: Research and Practice Implications
Schwartz-Mette, R., Righthand, S., Hecker, J. E., Dore, G., & Huff, R. (2020) · Sexual abuse. A Journal of Research and Treatment · doi:10.1177/1079063219825871 · Cited by 11
Treatment Burst Data Points and Single Case Design Studies: A Bayesian N-of-1 Analysis for Estimating Treatment Effect Size
Barnard-Brak, L., Richman, D., & Watkins, L. (2020) · Perspectives on Behavior Science · doi:10.1007/s40614-020-00258-8 · Cited by 11
Psychometric Properties of the Impairment Rating Scale in Samples of Adults With Attention Deficit Hyperactivity Disorder
Dawson, A. E., Egan, T. E., & Wymbs, B. T. (2017) · Assessment · doi:10.1177/1073191117746502 · Cited by 13
“Although AUC classification is relative to the goal of test, a general classification may be that AUC values of .6 or lower are considered poor, .6 to .7 are sufficient, .7 to .8 are good, .8 to .9 are very good, and .9 and higher are excellent (Rice & Harris, 2005).”
Background
Examination of triarchic psychopathy measure in a sample of Lithuanian juvenile offenders.
Laurinavičius, A., Sellbom, M., Klimukiene, V., Wygant, D., Laurinaitytė, I., Ustinavičiūtė, L., & Baltrūnas, M. (2019) · Psychological Assessment · doi:10.1037/pas0000793 · Cited by 11
An integrated statistical model of Emergency Department length of stay informed by Resilient Health Care principles
Ross, A., Murrells, T., Kirby, T., Jaye, P., & Anderson, J. E. (2019) · doi:10.1016/j.ssci.2019.06.018 · Cited by 11
Comparison of Literacy Screener Risk Selection Between English Proficient Students and English Learners
Cummings, K. D., Smolkowski, K., & Baker, D. (2019) · Learning Disability Quarterly · doi:10.1177/0731948719864408 · Cited by 11
The effects of transcranial direct current stimulation (tDCS) on multitasking performance and oculometrics
Nelson, J. M., Phillips, C. A., McKinley, R. A., McIntire, L. K., Goodyear, C., & Monforton, L. (2019) · Military Psychology · doi:10.1080/08995605.2019.1598217 · Cited by 11
“Cohen’s d value that exceeds 0.8 represents a large effect between the two groups (Rice & Harris, 2005).”
BackgroundInfluential
Risk assessment for foster placement breakdown: The predictive value of the strengths and difficulties questionnaire and foster child and foster family characteristics
van Rooij, F. V., van der Put, C. E., Maaskant, A., Folkeringa, D., & Hermanns, J. (2019) · Children and youth services review · doi:10.1016/j.childyouth.2019.02.038 · Cited by 11
Cross-Validation of the Revised Version of the Violence Risk Appraisal Guide (VRAG-R) in a Sample of Individuals Convicted of Sexual Offenses
Gregório-Hertz, P., Eher, R., Etzler, S., & Rettenberger, M. (2019) · Sexual abuse. A Journal of Research and Treatment · doi:10.1177/1079063219841901 · Cited by 11
“Since AUC values are not sensitive to base rate effects (Hanley & McNeil, 1982; Rice & Harris, 2005) they allow comparisons between different scales and independent studies (Harris & Rice, 2007).”
BackgroundResult
The effect of mental countermeasures on neuroimaging‐based concealed information tests
Hsu, C., Begliomini, C., Dall’Acqua, T., & Ganis, G. (2019) · Human Brain Mapping · doi:10.1002/hbm.24567 · Cited by 15
“…meta-analysis of the CIT using skin conductance and event-related potential measures (P300 amplitude, specifically) reported effect sizes (d) of about 1.55 and 1.89, respectively (Meijer, Selle, Elber, & Ben-Shakhar, 2014), corresponding to AUCs of 0.86 and 0.91, respectively (Rice & Harris, 2005).”
MethodInfluential
Assessment of Risk for Seclusion Among Forensic Inpatients: Validation and Modification of the Risk of Administrative Segregation Tool (RAST)
Hilton, N. Z., Ham, E., & Seto, M. C. (2019) · International journal of offender therapy and comparative criminology · doi:10.1177/0306624x18823621 · Cited by 11
Detecting over-reporting of symptoms: the French version of the self-report symptom inventory
Geurten, M., Meulemans, T., & Seron, X. (2018) · Clinical Neuropsychologist · doi:10.1080/13854046.2018.1524027 · Cited by 11
Cross-Validation of the Discrimination and Calibration Properties of the VRAG-R in a Treated Sexual Offender Sample
Olver, M., & Sewall, L. A. (2018) · doi:10.1177/0093854818762483 · Cited by 11
“…recidivist would have a higher score on a given risk tool than a randomly selected nonrecidivist. with values of .50 representing chance-level prediction, values of .56, .64, and .71 can be interpreted as corresponding to small, medium, and large effect sizes, respectively (Rice & Harris, 2005).”
BackgroundMethod
Assessing Protective Factors for Violence Risk in U.K. General Mental Health Services Using the Structured Assessment of Protective Factors
Haines, A., Brown, A., Javaid, S., Khan, F., Noblett, S., Omodunbi, O., Sadiq, K., Zaman, W., & Whittington, R. (2017) · International journal of offender therapy and comparative criminology · doi:10.1177/0306624x17749449 · Cited by 11
“Rice and Harris (2005) suggest the following interpretations of AUC values: .500 to .556, small; .557 to .639, moderate; and .640 to 1.00, large.”
BackgroundInfluential
Epistemic beliefs of non-STEM majors regarding the nature of science: Where they are and what we can do
Willoughby, S., & Johnson, K. A. (2017) · American Journal of Physics · doi:10.1119/1.4979654 · Cited by 11
The predictive validity of common risk assessment tools in men with intellectual disabilities and problematic sexual behaviors.
Fedoroff, J. P., Richards, D., Ranger, R., & Curry, S. D. (2016) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2016.06.011 · Cited by 11
An Examination of the Predictive Validity of the Structured Assessment of Risk and Need–Treatment Needs Analysis (SARN-TNA) in England and Wales
Tully, R., Browne, K., & Craig, L. A. (2015) · Criminal Justice and Behavior · doi:10.1177/0093854814553096 · Cited by 11
“In this study, Thornton found a Receiver Operating Characteristic (ROC) Area Under the Curve (AUC) of 0.78, which according to Rice and Harris (2005) can be considered a large effect size or good predictive accuracy.”
BackgroundMethodInfluential
Appraising the Risk Matrix 2000 Static Sex Offender Risk Assessment Tool
Tully, R., & Browne, K. (2015) · International journal of offender therapy and comparative criminology · doi:10.1177/0306624x13508928 · Cited by 11
“Table 2 offers comparisons of AUC and d alongside verbal descriptors, adapted from Rice and Harris (2005).”
MethodResult
Psychopathy in Offenders with Intellectual Disabilities: A Comparison of the PCL-R and PCL:SV
Pouls, C., & Jeandarme, I. (2014) · International Journal of Forensic Mental Health · doi:10.1080/14999013.2014.922138 · Cited by 11
“Here, the authors found a median effect size (Cohen’s d) of .63 (p .001) for violent recidivism, which is comparable with an AUC of approximately .67 (Rice & Harris, 2005).”
MethodResult
Two-Tiered Violence Risk Estimates: a validation study of an integrated-actuarial risk assessment instrument.
Mills, J., & Gray, A. L. (2013) · Psychological services · doi:10.1037/a0032608 · Cited by 11
Die revidierte Version des »Screeninginstruments zur Vorhersage des Gewaltrisikos« (SVG-5): Darstellung relativer und absoluter Rückfallraten
Eher, R., Schilling, F., Mönichweger, M., Haubner-Maclean, T., & Rettenberger, M. (2012) · doi:10.1515/mks-2012-950102 · Cited by 11
“Dabei ist die Vorhersageleistung des Instruments unter Verwendung nationaler wie internationaler Standards als sehr gut zu bezeichnen (Dahle 2005; Rice & Harris 2005).”
Background
The Sex Offender Risk Appraisal Guide
Rice, M., & Harris, G. (2016) · doi:10.1007/978-1-4939-2416-5_21 · Cited by 11
Self-citation
National Institute of Mental Health Depression of Alzheimer Disease : assessment and diagnostic validity studies using depression scales developed for older adults
Sepehry, A. (2015) · doi:10.14288/1.0167687 · Cited by 11
“371 and over is considered a large effect.(342) However, when we examine the specificity of the scales, specificity increases as the number of items drop (e.”
Background
Developing and Validating a Risk Assessment Scale to Predict Inmate Placements in Administrative Segregation in the Correctional Service of Canada
Helmus, L. M. (2015) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2015-10835 · Cited by 11
“Consequently, the two effect size statistics will be interpreted interchangeably (with values of .56, .64, and .71 considered small, moderate, and large, following Rice & Harris, 2005).”
Post-traumatic stress disorder in peacekeepers: a systematic literature review and meta-analysis
Carmona, L., Camilo, C., Carvalho, V. S., & Chambel, M. J. (2024) · European Journal of Psychotraumatology · doi:10.1080/20008066.2024.2413735 · Cited by 14
“Effect sizes greater than r > .100 were deemed small, r > .243 as medium, and r > .371 as large, following Rice and Harris’ (2005) guidelines.”
Background
Assessing Risk of Family Violence by Young People: Identifying Recidivism Base Rates and the Validity of the VP-SAFvR for Youth
Sheed, A., Mcewan, T., Papalia, N., Spivak, B., & Simmons, M. (2023) · Criminal Justice and Behavior · doi:10.1177/00938548231170799 · Cited by 10
“…dyad specifically. discRiminATiVe VAlidiTy of THe VP-sAfVR The VP-SAFvR demonstrated moderate discriminative validity for both same-dyad (AUC = .65; Rice & Harris, 2005) and any-dyad (AUC = .65) recidivism for youth aged 10 to 24 years, with a strong positive correlation observed between the…”
BackgroundInfluential
Predictive Bias in Juvenile Risk Assessment: Considering Race/Ethnicity and Sex
Childs, K. K., Peck, J. H., & Brady, C. M. (2022) · Crime & Delinquency · doi:10.1177/00111287221143936 · Cited by 9
“…(1) group-specific AUC values ranged from 0.56 to 0.59, (2) regardless of subgroup, the predictive accuracy of PACT risk level is relatively weak (Rice & Harris, 2005), although it does align with previous research using the PACT (e.g., Baglivio et al., 2013), and (3) confidence intervals for…”
BackgroundResultInfluential
Temporal Order of Sexual Offending Is Risk-Relevant for Individuals With Child Sexual Exploitation Materials Offences
Babchishin, K., Lee, S. C., Eke, A. W., & Seto, M. (2022) · Sexual offending · doi:10.5964/sotrap.7229 · Cited by 10
“Cohen’s ds of .20, .50, and .80 are considered small, moderate, and large effects (Rice & Harris, 2005).”
Background
Viewing Time Measures of Sexual Interest and Sexual Offending Propensity: An Online Survey of Fathers
Pezzoli, P., Babchishin, K., Pullman, L. E., & Seto, M. (2022) · Archives of Sexual Behavior · doi:10.1007/s10508-022-02324-5 · Cited by 10
“In the risk assessment literature (e.g., Rice & Harris, 2005), it has been suggested that AUC values between .50 and .55 correspond to a small effect size (Cohen’s d = .20), values between .56 and 65 correspond to a medium effect size (d = .50), and values greater than .65 to a large effect size (d…”
Background
Measurement and Correlates of Zoophilic Interest in an Online Community Sample
Zidenberg, A. M., & Olver, M. (2022) · Archives of Sexual Behavior · doi:10.1007/s10508-022-02429-x · Cited by 10
“With values of 0.50 representing chance level discrimination, AUCs of 0.56, 0.64, and 0.71 represent small, medium, and large effects, respectively, and directly correspond to d values of 0.20,0.50, and 0.80, respectively (Rice & Harris, 2005).”
BackgroundInfluential
Early assessment of the risk of child welfare involvement for preventive purposes
van der Put, C. E., Assink, M., Schmitz, D., de Jager, A., Stams, G. J. J. M., & van Dam, L. (2022) · Children and Youth Services Review · doi:10.1016/j.childyouth.2022.106654 · Cited by 12
Validation of the YLS/CMI on an Australian Juvenile Offending Population
Dellar, K., Roberts, L. D., Bullen, J., Downe, K., & Kane, R. T. (2022) · International Journal of Offender Therapy and Comparative Criminology · doi:10.1177/0306624x221086556 · Cited by 18
“The weighted average effect size across all studies (AUC = 0.640, SD = 0.042) corresponded to a medium effect size according to Rice and Harris (2005).”
ResultInfluential
The Development of a Suicidal Ideation Predictive Model for Community-Dwelling Elderly Aged >55 Years
Na, K., Geem, Z. W., & Cho, S.-E. (2022) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s336947 · Cited by 14
Association of C-Reactive Protein Velocity with Early Left Ventricular Dysfunction in Patients with First ST-Elevation Myocardial Infarction
Holzknecht, M., Tiller, C., Reindl, M., Lechner, I., Fink, P., Lunger, P., Mayr, A., Henninger, B., Brenner, C., Klug, G., et al. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10235494 · Cited by 10
The Ontario Domestic Assault Risk Assessment: Predicting Violence Among Men With a Police Record of Intimate Partner Violence in the United States
Radatz, D. L., & Hilton, N. Z. (2021) · Criminal Justice and Behavior · doi:10.1177/00938548211035816 · Cited by 10
“AUC values range from 0 to 1, and values upward of .556, .639, and .714 correspond to Cohen’s d of .2 (small effect), .5 (medium effect), and .8 (large effect), respectively (Rice & Harris, 2005).”
Background
Who has a Choice?: Survey-Based Predictors of Volitionality in Facebook Use and Non-use
Skeba, P., Saxena, D., Guha, S., & Baumer, E. (2021) · Proc. ACM Hum. Comput. Interact. · doi:10.1145/3463935 · Cited by 10
“75 which is generally considered a high score in fields such as applied psychology [67].”
Background
The HIV Index: Using a Patient-Reported Outcome on Engagement in HIV Care to Explain Sub-Optimal Retention in Care and Virologic Control.
Christopoulos, K., Neilands, T., Koester, K. A., Sauceda, J., Dilworth, S., Mugavero, M., Crane, H., Fredericksen, R., Cachay, E., Mayer, K., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa1892 · Cited by 10
Aggressive Personality and Aggressive Incidents: A Pilot Investigation of the Personality Assessment Inventory within Forensic Psychiatry
Battaglia, A. M., Gicas, K., Rose, A. L., Mamak, M., & Goldberg, J. O. (2020) · Journal of Forensic Psychiatry & Psychology · doi:10.1080/14789949.2020.1867225 · Cited by 10
“We used Rice and Harris (2005) effect size guidelines for point/rank-biserial correlations and AUC: rpb of .100 (small), .243 (medium), and .371 (large); and AUC of .556 (small), .639 (medium), and .714 (large).”
BackgroundMethod
IRT-Based Differential Item Functioning Analysis of the Youth Level of Service/Case Management Inventory Across Indigenous and Non-Indigenous Youth
Huang, S., Peterson-badali, M., Jang, E., & Skilling, T. (2020) · doi:10.1177/0093854820968877 · Cited by 10
“The yLS/CMI possesses moderate to strong internal consistency for most subscales (Catchpole & gretton, 2003; Schmidt et al., 2005), and moderate to strong concurrent validity with broad and narrowband scores on the Child Behavior Checklist (Schmidt et al., 2005) and Structured Assessment of…”
Background
Can the triarchic model of psychopathy predict youth offender recidivism?
Pechorro, P., Quintas, J., Delisi, M., & Gonçalves, R. (2020) · Psychology, Crime and Law · doi:10.1080/1068316x.2020.1818237 · Cited by 10
“The standard benchmarks stipulate that AUC values≥ .56 represent small effect sizes, AUC values≥ .64 represent medium effect sizes, and AUC values ≥ .71 represent large effect sizes (see Rice & Harris, 2005).”
Background
Assessment of Emotional States Through Physiological Signals and Its Application in Music Therapy for Disabled People
Ramírez, A. V., Hornero, G., Royo, D., Aguilar, A., & Casas, O. (2020) · IEEE Access · doi:10.1109/access.2020.3008269 · Cited by 10
“3146 could be interpreted as a small-moderate effect [38].”
Background
Understanding the Role of Neighborhood Typology and Sociodemographic Characteristics on Time to Recidivism Among Adjudicated Youth
Campbell, C., Barnes, A. R., Papp, J., D’Amato, C., Anderson, V. R., & Moses, N. (2020) · Criminal Justice and Behavior · doi:10.1177/0093854820924834 · Cited by 11
“For reference, AUC values of .56, .64, and .71 represent small, moderate, and large effects, respectively (Rice & Harris, 2005).”
Background
Assessing the Interactions between Strengths and Risk Factors of Recidivism through the Structured Assessment of Violence Risk in Youth (SAVRY)
Ortega-Campos, E., García-García, J., Sánchez, L. D. L. F., & Zaldívar-Basurto, F. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17062112 · Cited by 10
Association between 9-minute walk/run test and obesity among children and adolescents: evidence for criterion-referenced cut-points
Silva, D. A., Lang, J., Petróski, E., Mello, J., Gaya, A., & Tremblay, M. (2020) · PeerJ · doi:10.7717/peerj.8651 · Cited by 10
Vitamin D Status Differs by Sex, Sport-Season, and Skin Pigmentation among Elite Collegiate Basketball Players
Fields, J., Payne, D. C., Gallo, S., Busteed, D. R., & Jones, M. T. (2019) · Sports · doi:10.3390/sports7110239 · Cited by 10
Developing and validating a tool to predict placements in administrative segregation: Predictive accuracy with inmates, including indigenous and female inmates.
Helmus, L., Johnson, S., & Harris, A. (2019) · Psychology, public policy and law · doi:10.1037/law0000201 · Cited by 10
Risk assessment of criminal offenders in Ghana: An investigation of the discriminant validity of the HCR-20V3
Adjorlolo, S., & Chan, H. C. (2019) · International Journal of Law and Psychiatry · doi:10.1016/j.ijlp.2019.101458 · Cited by 24
Deceleration characteristics of elite Australian male field hockey players during an Olympic tournament.
Chesher, S. M., Netto, K., Appleby, B., Jacques, A., & Wild, C. (2019) · Journal of Science and Medicine in Sport · doi:10.1016/j.jsams.2018.11.019 · Cited by 10
Reverse Engineering the Behaviour of Twitter Bots
Bello, B. S., Heckel, R., & Minku, L. L. (2018) · International Conference on Social Networks Analysis, Management and Security · doi:10.1109/snams.2018.8554675 · Cited by 10
“70 or higher is considered strong [18].”
Changing Epistemological Beliefs with Nature of Science Implementations
Johnson, K. A., & Willoughby, S. (2018) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.14.010110 · Cited by 10
Predictive Validity of HCR-20, START, and Static-99R Assessments in Predicting Institutional Aggression Among Sexual Offenders
Cartwright, J., Desmarais, S. L., Hazel, J., Griffith, T., & Azizian, A. (2017) · Law and Human Behavior · doi:10.1037/lhb0000263 · Cited by 10
Development of Vermont Assessment of Sex Offender Risk-2 (VASOR-2) Reoffense Risk Scale
McGrath, R., Lasher, M. P., Cumming, G. F., Langton, C. M., & Hoke, S. E. (2014) · Sexual abuse. A Journal of Research and Treatment · doi:10.1177/1079063213486936 · Cited by 10
“The AUC statistic is a recommended index of predictive accuracy for relatively low base-rate phenomena such as sexual reoffending (Rice & Harris, 2005).”
Background
Predicting Risk of Sexual Recidivism in Juveniles: Predictive Validity of the J‐SOAP‐II
Prentky, R., Pimental, A., Cavanaugh, D. J., & Righthand, S. (2012) · doi:10.1002/9780470714362.ch15 · Cited by 10
Effect Size as a Measure of Difference Between Two Populations
Dey, R., & Mulekar, M. (2018) · Encyclopedia of Social Network Analysis and Mining. 2nd Ed. · doi:10.1007/978-1-4939-7131-2_110195 · Cited by 10
Diagnostic utility of CPSS vs. CAPS-CA for assessing posttraumatic stress symptoms in children and adolescents.
Hukkelberg, S., Ormhaug, S., Holt, T., Wentzel-Larsen, T., & Jensen, T. (2014) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2013.11.001 · Cited by 10

Authors: Rice, M. E., & Harris, G. T.
Affiliations: Waypoint Centre for Mental Health Care (CA)
Venue: Law and Human Behavior
Publisher: American Psychological Association (APA)
Published: 2005-10
Volume: 29
Issue: 5
Pages: 615-620
ISSN: 0147-7307 (ISSN-L)
1573-661X
DOI: 10.1007/s10979-005-6832-7
OpenAlex: W2060774914
Cited by: 1,608
References: 0
Citations by year: 2026: 60 · 2025: 84 · 2024: 90 · 2023: 121 · 2022: 151 · 2021: 150 · 2020: 174 · 2019: 137 · 2018: 112 · 2017: 80 · 2016: 88 · 2015: 65 · 2014: 64 · 2013: 58 · 2012: 51
FWCI: 11.55
Type: journal article
Language: en
Open access: closed
Locations: Law and Human Behavior (publishedVersion)
PubMed (publishedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Keywords: effect size, Cohen's d, diagnostic accuracy, prediction accuracy, forensic psychology, follow-up study
MeSH terms: Forecasting, Humans, ROC Curve, Risk Assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Comparing effect sizes in follow-up studies: ROC Area, Cohen's d, and r.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Metadata

Record

About these checks