Cited by 9,349Psychological Testing and AssessmentPsychometric Methodologies and TestingHistorical and Modern Theater Studies

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Cicchetti, Domenic V.·1994·Psychological Assessment

DOI 10.1037/1040-3590.6.4.284

Open this paper in CoChat — free account

Abstract

In the context of the development of prototypic assessment instruments in the areas of cognition, personality, and adaptive functioning, the issues of standardization, norming procedures, and the important psychometrics of test reliability and validity are evaluated critically. Criteria, guidelines, and simple rules of thumb are provided to assist the clinician faced with the challenge of choosing an appropriate test instrument for a given psychological assessment. Clinicians are often faced with the critical challenge of choosing the most appropriate available test instrument for a given psychological assessment of a child, adolescent, or adult of a particular age, gender, and class of disability. It is the purpose of this report to provide some criteria, guidelines, or simple rules of thumb to aid in this complex scientific decision. As such, it draws upon my experience with issues of test development, standardization, norming procedures, and important psychometrics, namely, test reliability and validity. As I and my colleagues noted in an earlier publication, the major areas of psychological functioning, in the normal development of infants, children, adolescents, adults, and elderly people, include cognitive, academic, personality, and adaptive behaviors (Sparrow, Fletcher, & Cicchetti, 1985). As such, the major examples or applications discussed in this article derive primarily, although not exclusively, from these several areas of human functioning.

Integrity signals

Registry

Crossref · 10.1037/1040-3590.6.4.284

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Psychometric theory (2nd ed.).
Sitgreaves, R. (1979) · Contemporary Psychology · doi:10.1037/018882 · Cited by 14,384
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
Cooper, A. M., & Michels, R. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.1.128 · Cited by 7,419
Manual for the Wechsler Adult Intelligence Scale.
Wechsler, D. (1955) · Psychological Corp. eBooks · Cited by 4,941
Essentials of Psychological Testing
Rosner, B., & Cronbach, L. J. (1960) · The American Journal of Psychology · doi:10.2307/1419921 · Cited by 4,524
Statistical Methods for Rates and Proportions, 2nd ed
GROVE, W. A. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.12.1644-a · Cited by 3,756
The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354

Show all 43 references

Sorted by citations

Items 1,001–1,086 of 1,086

Validity of US norms for the Bayley Scales of Infant Development-III in Malawian children
Cromwell, E. A., Dube, Q., Cole, S. R., Chirambo, C. M., Dow, A., Heyderman, R. S., & Rie, A. V. (2014) · European Journal of Paediatric Neurology · doi:10.1016/j.ejpn.2013.11.011 · Cited by 52
Coding Counsellor Behaviour in Motivational Interviewing Sessions: Inter‐Rater Reliability for the Swedish Motivational Interviewing Treatment Integrity Code (MITI)
Forsberg, L., Källmén, H., Hermansson, U., Berman, A. H., & Helgason, Á. R. (2007) · Cognitive Behaviour Therapy · doi:10.1080/16506070701339887 · Cited by 52
The usefulness of a self-report questionnaire measuring auditory verbal hallucinations
Kim, S. H., Jung, H. Y., Hwang, S. S., Chang, J. S., Kim, Y., Ahn, Y. M., & Kim, Y. S. (2010) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2010.05.005 · Cited by 51
Influence of Counselor Characteristics and Behaviors on the Efficacy of a Brief Motivational Intervention for Heavy Drinking in Young Men-A Randomized Controlled Trial
Gaume, J., Magill, M., Longabaugh, R., Bertholet, N., Gmel, G., & Daeppen, J.-B. (2014) · Alcoholism: Clinical and Experimental Research · doi:10.1111/acer.12469 · Cited by 47
Bringing chronic-pain care to rural veterans: A telehealth pilot program description.
Glynn, L. H., Chen, J. A., Dawson, T. C., Gelman, H., & Zeliadt, S. B. (2021) · Psychological Services · doi:10.1037/ser0000408 · Cited by 40
The development of narcissistic admiration and machiavellianism in early adulthood.
Grosz, M. P., Göllner, R., Rose, N., Spengler, M., Trautwein, U., Rauthmann, J. F., Wetzel, E., & Roberts, B. W. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000174 · Cited by 45
A qualitative study to understand how Ebola virus disease affected nutrition in Sierra Leone – a food value-chain framework for improving future response strategies
Kodish, S. R., Bio, F., Oemcke, R., Conteh, J., Beauliere, J. M., Pyne-Bailey, S., Rohner, F., Ngnie-Teta, I., Jalloh, M. B., & Wirth, J. P. (2019) · PLOS Neglected Tropical Diseases · doi:10.1371/journal.pntd.0007645 · Cited by 44
Translation and validation of Simplified Chinese version of the Pain Catastrophizing Scale in chronic pain patients: Education may matter
Shen, B., Wu, B., Abdullah, T. B., Zhan, G., Lian, Q., Vania Apkarian, A., & Huang, L. (2018) · Molecular Pain · doi:10.1177/1744806918755283 · Cited by 44
“9 as excellent.(46) Concurrent validity was assessed by Pearson’s correlation coefficients (R) with other pain-related measurements.”
Method
Development and validation of the forms of Self-Criticizing/Attacking and Self-Reassuring Scale—Short Form.
Sommers-Spijkerman, M., Trompetter, H., ten Klooster, P., Schreurs, K., Gilbert, P., & Bohlmeijer, E. (2018) · Psychological Assessment · doi:10.1037/pas0000514 · Cited by 43
Does repetitive negative thinking affect attention? Differential effects of worry and rumination on attention to emotional stimuli.
Lewis, E. J., Blanco, I., Raila, H., & Joormann, J. (2019) · Emotion · doi:10.1037/emo0000535 · Cited by 43
Validation of a short form Three Facet Mindfulness Questionnaire (TFMQ-SF) in pregnant women
Truijens, S. E. M., Nyklíček, I., van Son, J., & Pop, V. J. M. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2015.06.037 · Cited by 41
Acceptability, Feasibility, and Efficacy of a Workplace Mindfulness Program for Public Sector Employees: a Pilot Randomized Controlled Trial with Informant Reports
Bartlett, L., Lovell, P., Otahal, P., & Sanderson, K. (2017) · Mindfulness · doi:10.1007/s12671-016-0643-4 · Cited by 42
Linking metacognition and mindreading: Evidence from autism and dual-task investigations.
Nicholson, T., Williams, D. M., Lind, S. E., Grainger, C., & Carruthers, P. (2021) · Journal of Experimental Psychology: General · doi:10.1037/xge0000878 · Cited by 42
Number of Measurements Needed to Obtain a Reliable Estimate of Home Blood Pressure: Results From the Improving the Detection of Hypertension Study
Bello, N. A., Schwartz, J. E., Kronish, I. M., Oparil, S., Anstey, D. E., Wei, Y., Cheung, Y. K. K., Muntner, P., & Shimbo, D. (2018) · Journal of the American Heart Association · doi:10.1161/jaha.118.008658 · Cited by 42
Predictive validity of the Structured Assessment of Violence Risk in Youth (SAVRY) with Indigenous and Caucasian female and male adolescents on probation.
Muir, N. M., Viljoen, J. L., Jonnson, M. R., Cochrane, D. M., & Rogers, B. J. (2020) · Psychological Assessment · doi:10.1037/pas0000816 · Cited by 41
Motivational Interviewing Delivered by Existing Prison Staff: A Randomized Controlled Study of Effectiveness on Substance Use After Release
Forsberg, L. G., Ernst, D., Sundqvist, K., & Farbring, C. Å. (2011) · Substance Use & Misuse · doi:10.3109/10826084.2011.591880 · Cited by 40
A systematic review of randomised controlled trials using Acceptance and commitment therapy as an intervention in the management of non-malignant, chronic pain in adults
Simpson, P. A., Mars, T., & Esteves, J. E. (2017) · International Journal of Osteopathic Medicine · doi:10.1016/j.ijosm.2017.03.001 · Cited by 38
Adaptation and validation of the Dutch version of the nasal obstruction symptom evaluation (NOSE) scale
van Zijl, F. V. W. J., Timman, R., & Datema, F. R. (2017) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-017-4486-y · Cited by 40
Overall and differential attrition in mindfulness-based interventions: A meta-analysis
Lam, S. U., Kirvin-Quamme, A., & Goldberg, S. B. (2022) · Mindfulness · doi:10.1007/s12671-022-01970-z · Cited by 39
“Interrater reliabilities for inclusion at title and/or abstract and full text levels were good to excellent (i.e., ICC ≥ 0.60; Cicchetti, 1994).”
MethodInfluential
Autism Severity as a Predictor of Comorbid Conditions
Jang, J., & Matson, J. L. (2015) · Journal of Developmental and Physical Disabilities · doi:10.1007/s10882-015-9421-9 · Cited by 39
The role of “on demand” therapist guidance vs. no support in the treatment of tinnitus via the internet: a randomized controlled trial
Rheker, J., Andersson, G., & Weise, C. (2015) · Internet Interventions · doi:10.1016/j.invent.2015.03.007 · Cited by 38
Cultural adaptations of psychotherapy: Therapists' applications of conceptual models with Asians and Asian Americans
Hall, G. C. N., Kim-Mozeleski, J. E., Zane, N. W., Sato, H., Huang, E. R., Tuan, M., & Ibaraki, A. Y. (2019) · Asian American Journal of Psychology · doi:10.1037/aap0000122 · Cited by 36
Medical history of discordant twins and environmental etiologies of autism
Willfors, C., Carlsson, T., Anderlid, B.-M., Nordgren, A., Kostrzewa, E., Berggren, S., Ronald, A., Kuja-Halkola, R., Tammimies, K., & Bölte, S. (2017) · Translational Psychiatry · doi:10.1038/tp.2016.269 · Cited by 35
A randomized clinical trial of a group cognitive-behavioral therapy to reduce alcohol use among human immunodeficiency virus-infected outpatients in western Kenya
Papas, R. K., Gakinya, B. N., Mwaniki, M. M., Lee, H., Keter, A. K., Martino, S., Klein, D. A., Liu, T., Loxley, M. P., Sidle, J. E., et al. (2021) · Addiction · doi:10.1111/add.15112 · Cited by 37
“067) so did not require controlling for the grouping effect in the final analysis (59).”
Background
Can cognitive insight predict symptom remission in a first episode psychosis cohort?
O’Connor, J. A., Ellett, L., Ajnakina, O., Schoeler, T., Kollliakou, A., Trotta, A., Wiffen, B. D., Falcone, A. M., Di Forti, M., Murray, R. M., et al. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1210-9 · Cited by 37
Assessing Advanced Communication Skills via Objective Structured Clinical Examination: A Comparison of Faculty Versus Self, Peer, and Standardized Patient Assessors
Talwalkar, J. S., Murtha, T. D., Prozora, S., Fortin, A. H., Morrison, L. J., & Ellman, M. S. (2020) · Teaching and Learning in Medicine · doi:10.1080/10401334.2019.1704763 · Cited by 32
Self‐report measure of parental reflective functioning: A study of reliability and validity across three samples of varying clinical risk
Carlone, C., Milan, S., Decoste, C., Borelli, J. L., McMahon, T. J., & Suchman, N. E. (2023) · Infant Mental Health Journal · doi:10.1002/imhj.22046 · Cited by 35
Long-acting injectable versus daily oral antipsychotic treatment trials in schizophrenia: pragmatic versus explanatory study designs
Bossie, C. A., Alphs, L. D., & Correll, C. U. (2015) · International Clinical Psychopharmacology · doi:10.1097/yic.0000000000000082 · Cited by 33
The effect of therapists’ adherence and competence in delivering the adolescent community reinforcement approach on client outcomes.
Campos-Melady, M., Smith, J. E., Meyers, R. J., Godley, S. H., & Godley, M. D. (2017) · Psychology of Addictive Behaviors · doi:10.1037/adb0000216 · Cited by 28
Initial validation of the Danish version of the Fear of Cancer Recurrence Inventory (FCRI) in colorectal cancer patients
Hovdenak Jakobsen, I., Jeppesen, M. M., Simard, S., Thaysen, H. V., Laurberg, S., & Juul, T. (2018) · Journal of Cancer Survivorship · doi:10.1007/s11764-018-0709-5 · Cited by 32
Association between quality of sleep and screen time during the COVID‐19 outbreak among adolescents in the United Arab Emirates
Bani‐Issa, W., Radwan, H., Saqan, R., Hijazi, H., Fakhry, R., Alameddine, M., Naja, F., Ibrahim, A., Lin, N., Naing, Y. T., et al. (2023) · Journal of Sleep Research · doi:10.1111/jsr.13666 · Cited by 30
“Values of 0.40–0.59 are considered fair reliability, 0.60–0.74 good reliability, and >0.75 excellent reliability (Cicchetti, 1994).”
BackgroundInfluential
Adolescents’ definitions of bullying: The contribution of age, gender, and experience of bullying.
Byrne, H., Dooley, B., Fitzgerald, A., & Dolphin, L. (2016) · European Journal of Psychology of Education · doi:10.1007/s10212-015-0271-8 · Cited by 31
Application of representative learning design for assessment of common practice tasks in tennis
Krause, L., Farrow, D., Buszard, T., Pinder, R., & Reid, M. (2019) · Psychology of Sport and Exercise · doi:10.1016/j.psychsport.2018.11.008 · Cited by 30
Low rates of pointing in 18-month-olds at risk for autism spectrum disorder and extremely preterm infants: A common index of language delay?
Sansavini, A., Guarini, A., Zuccarini, M., Lee, J. Z., Faldella, G., & Iverson, J. M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02131 · Cited by 30
“75 are considered an index of excellent agreement both for ICC and Cohen’s Kappa (Cicchetti, 1994).”
Influential
Development of a Scale to Measure Practitioner Adherence to a Brief Intervention in the Emergency Department
Pantalon, M. V., Martino, S., Dziura, J., Li, F.-Y., Owens, P. H., Fiellin, D. A., O'Connor, P. G., & D'Onofrio, G. (2012) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2012.08.011 · Cited by 30
“75 or above are excellent (Cicchetti, 1994).”
parental psychological factors and quality of life of children with inflammatory bowel disease
Bramuzzo, M., De Carlo, C., Arrigo, S., Pavanello, P. M., Canaletti, C., Giudici, F., Agrusti, A., Martelossi, S., Di Leo, G., & Barbi, E. (2020) · Journal of Pediatric Gastroenterology and Nutrition · doi:10.1097/mpg.0000000000002548 · Cited by 28
When Zero May Not Be Zero: A Cautionary Note on the Use of Inter-Rater Reliability in Evaluating Grant Peer Review
Erosheva, E. A., Martinková, P., & Lee, C. J. (2021) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12681 · Cited by 28
“For psychological assessment, Cicchetti (1994) provides the following recommendation: IRR values below 0.4, between 0.4 and 0.59, between 0.6 and 0.74, and 0.75 or above are indicative of poor, fair, good, and excellent reliability, respectively.”
BackgroundInfluential
Linguistic complexity as the predictor of EFL independent and integrated writing quality
Zhang, Y., & Ouyang, J. (2023) · Assessing Writing · doi:10.1016/j.asw.2023.100727 · Cited by 28
Measuring Cognitive Flexibility with the Flexible Item Selection Task: From fMRI Adaptation to Individual Connectome Mapping
Dajani, D. R., Odriozola, P., Winters, M., Voorhies, W., Marcano, S., Baez, A., Gates, K. M., Dick, A. S., & Uddin, L. Q. (2020) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01536 · Cited by 27
“Established guidelines were used to interpret ICC values: poor (<.40), fair (.40–.59), good (.60–.74), and excellent (.75–1.00; Cicchetti, 1994).”
MethodInfluential
Experimental pain tolerance is decreased and independent of clinical pain intensity in patients with endometriosis
van Aken, M., Oosterman, J., van Rijn, T., Woudsma, K., Ferdek, M., Ruigt, G., Kozicz, T., Braat, D., Peeters, A., & Nap, A. (2018) · Fertility and Sterility · doi:10.1016/j.fertnstert.2018.06.040 · Cited by 26
A novel approach to the assessment of fidelity to a cognitive behavioral therapy for PTSD using clinical worksheets: A proof of concept with cognitive processing therapy
Stirman, S. W., Gutner, C. A., Gamarra, J., Suvak, M. K., Vogt, D., Johnson, C., Wachen, J. S., Dondanville, K. A., Yarvis, J. S., Mintz, J., et al. (2021) · Behavior Therapy · doi:10.1016/j.beth.2020.08.005 · Cited by 24
Implementing Motivational Interviewing for Substance Misuse on Medical Inpatient Units: a Randomized Controlled Trial
Martino, S., Zimbrean, P., Forray, A., Kaufman, J. S., Desan, P. H., Olmstead, T. A., Gilstad-Hayden, K., Gueorguieva, R., & Yonkers, K. A. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-05257-3 · Cited by 24
Acceptability and Feasibility of an Intervention to Enhance Social Group Belonging: Evidence From Three Trials of Groups 4 Health
Cruwys, T., Haslam, C., Haslam, S. A., Rathbone, J. A., & Donaldson, J. L. (2022) · Behavior Therapy · doi:10.1016/j.beth.2022.06.011 · Cited by 23
Language mapping in aphasia
Wilson, S. M., Eriksson, D. K., Yen, M., Demarco, A. T., Schneck, S. M., & Lucanie, J. M. (2019) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2019_jslhr-l-rsnp-19-0031 · Cited by 25
“Dice coefficients are conceptually related to the kappa statistic and can be interpreted as poor ( .40), fair (.40–.60), good (.60–.75), or excellent (≥ .75), following Cicchetti (1994).”
Background
Bioscience-scale automated detection of figure element reuse
Acuna, D. E., Brookes, P. S., & Kording, K. P. (2018) · doi:10.1101/269415 · Cited by 54
Short-Term Meditation Training Fosters Mindfulness and Emotion Regulation: A Pilot Study
Fazia, T., Bubbico, F., Iliakis, I., Salvato, G., Berzuini, G., Bruno, S., & Bernardinelli, L. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.558803 · Cited by 22
“Questionnaire internal consistency was assessed via Cronbach’s α coefficients (Cicchetti, 1994).”
Method
Enhanced memory for negative social information in borderline personality disorder.
Niedtfeld, I., Renkewitz, F., Mädebach, A., Hillmann, K., Kleindienst, N., Schmahl, C., & Schulze, L. (2020) · Journal of Abnormal Psychology · doi:10.1037/abn0000540 · Cited by 22
Allegiance effects in mindfulness-based interventions for psychiatric disorders: A meta-re-analysis
Goldberg, S. B., & Tucker, R. P. (2020) · Psychotherapy Research · doi:10.1080/10503307.2019.1664783 · Cited by 21
“The initial agreement was good (ICC = .85; Cicchetti, 1994).”
Background
Self-Focused Attention and Depressive Symptoms in Adults with Autistic Spectrum Disorder (ASD)
Burns, A., Irvine, M., & Woodcock, K. (2019) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-018-3732-5 · Cited by 20
Measuring psychological mindedness: Validity, reliability, and relationship with psychopathology of an Italian version of the Balanced Index of Psychological Mindedness
Giromini, L., Brusadelli, E., Di Noto, B., Grasso, R., & Lang, M. (2015) · Psychoanalytic Psychotherapy · doi:10.1080/02668734.2015.1006666 · Cited by 22
Improving Medical Residents’ Self-Assessment of Their Diagnostic Accuracy: Does Feedback Help?
Kuhn, J., van den Berg, P., Mamede, S., Zwaan, L., Bindels, P., & van Gog, T. (2022) · Advances in Health Sciences Education · doi:10.1007/s10459-021-10080-9 · Cited by 21
“Each diagnosis was rated by two general practitioners with an ‘excellent’ interrater reliability, ICC = 0.96 (Cicchetti, 1994).”
MethodInfluential
Test–retest reliability of skeletal muscle oxygenation measurement using near-infrared spectroscopy during exercise in patients with sport-related iliac artery flow limitation
van Hooff, M., Meijer, E. J., Scheltinga, M. R. M., Savelberg, H. H. C. M., & Schep, G. (2022) · Clinical Physiology and Functional Imaging · doi:10.1111/cpf.12738 · Cited by 20
“The ICC values were interpreted following the criteria of Landis and Koch: 0.00 poor, 0.00–0.20 slight, 0.21–0.40 fair, 0.41–0.60 moderate, 0.61–0.80 substantial and 0.81–1.00 almost perfect reliability (Cicchetti, 1994).”
MethodInfluential
Usefulness of Modern Activity Trackers for Monitoring Exercise Behavior in Chronic Cardiac Patients: Validation Study
Herkert, C., Kraal, J. J., van Loon, E. M. A., van Hooff, M., & Kemps, H. M. C. (2019) · JMIR mHealth and uHealth · doi:10.2196/15045 · Cited by 19
“An ICC below 0.4 was considered poor, between 0.4 and 0.59 fair, between 0.6 and 0.74 good, and above 0.75 was considered as excellent reliability [34].”
BackgroundInfluential
Can generative AI infer thinking style from language? Evaluating the utility of AI as a psychological text analysis tool
Markowitz, D. M. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02344-0 · Cited by 19
It’s the thought that counts: belief in suicide as an escape moderates the relationship between emotion dysregulation and suicidal ideation cross-sectionally and longitudinally
Al-Dajani, N., Uliaszek, A. A., & Hamdullahpur, K. (2019) · Borderline Personality Disorder and Emotion Dysregulation · doi:10.1186/s40479-019-0112-5 · Cited by 18
Magnetic resonance cholangiopancreatography severity predicts disease outcomes in pediatric primary sclerosing cholangitis: a reliability and validity study
Patil, K., Ricciuto, A., Alsharief, A., Al‐Rayahi, J., Amirabadi, A., Church, P. C., Kamath, B. M., & Greer, M. C. (2020) · Hepatology Communications · doi:10.1002/hep4.1454 · Cited by 18
The Mindfulness-Oriented Recovery Enhancement Fidelity Measure (MORE-FM): Development and Validation of a New Tool to Assess Therapist Adherence and Competence
Hanley, A. W., & Garland, E. L. (2021) · Journal of Evidence-Based Social Work · doi:10.1080/26408066.2020.1833803 · Cited by 16
Identifying bias in models that detect vocal fold paralysis from audio recordings using explainable machine learning and clinician ratings
Low, D. M., Rao, V., Randolph, G., Song, P. C., & Ghosh, S. S. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000516 · Cited by 16
Psychometric analysis of the Swedish panic disorder severity scale and its self-report version
Svensson, M., Nilsson, T., Johansson, H., Viborg, G., Perrin, S., & Sandell, R. (2019) · Nordic Journal of Psychiatry · doi:10.1080/08039488.2018.1554699 · Cited by 16
“Cicchetti’s [37] criteria were used for interpretation of inter-rater agreement estimates: less than 0.”
Method
An Evaluation of the Psychometric Properties of the Sheehan Disability Scale in a Chinese Psychotherapy-Seeking Sample
Zeljic, K., Zhang, Y., Qiu, X., Chen, X., Gong, H., Jin, H., Zhang, C., & Storch, E. A. (2020) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.34.1.58 · Cited by 15
“Convergent validity with the WHODAS 2.0 was interpreted based on the following conventions: > .50 = good, .30–.49 = fair, and .10– .29 = poor, with inverse intervals used to categorize divergent validity: .10–.29 = good, .30–.49 = fair, and > .50 = poor (Cicchetti, 1994).”
MethodInfluential
The impact of motivational interviewing on communication of patients undergoing periodontal therapy.
Kitzmann, J., Ratka‐Krueger, P., Vach, K., & Woelber, J. P. (2019) · Journal of Clinical Periodontology · doi:10.1111/jcpe.13132 · Cited by 15
The conceptualization and measurement of values: A review of the psychometric properties of measures developed to inform values work with adults
Serowik, K. L., Khan, A. J., LoCurto, J., & Orsillo, S. M. (2018) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-018-9679-1 · Cited by 15
Responsibility causes reassurance seeking, too: An experimental investigation
Leonhart, M. W., & Radomsky, A. S. (2019) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2017.10.005 · Cited by 15
Brief Report: Examining the Links Between Language Processes and Working Memory Impairments in Toddlers and Preschoolers with ASD
Edmunds, S. R., Colman, C., Vidal, P., & Faja, S. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05049-x · Cited by 14
A preliminary validation of the Swedish short version of the Avoidance and Fusion Questionnaire for Youth (AFQ-Y8) for children and adolescents with cancer
Cederberg, J. T., Weineland, S., Dahl, J., & Ljungman, G. (2018) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2018.09.004 · Cited by 13
Psychometric Properties of the Academic Encouragement Scale in Chinese University Students
Tang, H., Huo, Z., Liu, C., Liu, Z., & Wong, Y. J. (2021) · Journal of Psychoeducational Assessment · doi:10.1177/0734282920966821 · Cited by 13
“An ICC higher than .60 was considered acceptable (Cicchetti, 1994).”
Background
The evolving collaborative relationship between Practice-Based Research Networks (PBRNs) and Clinical and Translational Science Awardees (CTSAs)
Riley-Behringer, M., Davis, M. M., Werner, J. J., Fagnan, L. J., & Stange, K. C. (2017) · Journal of Clinical and Translational Science · doi:10.1017/cts.2017.305 · Cited by 12
Digging into the construct of fibrofog: Psychometric properties of the Spanish version of the Multidimensional Inventory of Subjective Cognitive Impairment in patients with fibromyalgia
Feliu‐Soler, A., Pérez‐Aranda, A., Andrés‐Rodríguez, L., Butjosa, A., Díaz, N. S., Trujols, J., Núñez, C., Stephan‐Otto, C., Rozadilla‐Sacanell, A., Serrano‐Blanco, A., et al. (2018) · Journal of Applied Biobehavioral Research · doi:10.1111/jabr.12134 · Cited by 12
A Comparison of Interactions Among Children, Parents, and Therapists in Cognitive Behavior Therapy for Anxiety Disorders in Australia and Japan
Ishikawa, S.-I., Romano, M., & Hudson, J. L. (2022) · Behavior Therapy · doi:10.1016/j.beth.2021.05.008 · Cited by 11
Assessing in-session rumination and its effects on CBT for depression
Kennedy, J. C., Dunlop, B. W., Craighead, L. W., Nemeroff, C. B., Mayberg, H. S., & Craighead, W. E. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2022.104209 · Cited by 11
Further Validation of a Dutch Translation of the Sussex Oxford Compassion for the Self Scale in Samples of Crisis Line Volunteers, Military Personnel and Nursing Students
de Krijger, E., Willems, R., ten Klooster, P., Bakker, E., Miedema, H., Drossaert, C., & Bohlmeijer, E. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.895850 · Cited by 11
“Internal consistency was considered adequate when above 0.70 (Cicchetti, 1994).”
BackgroundInfluential
Psychometric properties of the Cognitive Fusion Questionnaire in females with fibromyalgia
Luque-Reca, O., Gillanders, D., Catala, P., & Peñacoba, C. (2023) · Current Psychology · doi:10.1007/s12144-021-02214-4 · Cited by 8
“In those participants who answered the scale again after two months (n = 62), the intraclass correlation coefficient (abbreviated as the ICC) was used to explore test-retest reliability, considering values ≥ .70 as adequate (Cicchetti, 1994).”
Method
Occupational physical activity in brewery and office workers
Thompson, J. F., Severson, R. L., & Rosecrance, J. C. (2018) · Journal of Occupational and Environmental Hygiene · doi:10.1080/15459624.2018.1492136 · Cited by 9
Psychometric Properties of the Persian Structured Clinical Interview for Personality Disorders of DSM-5-Personality Version (SCID-5-PD)
Gharraee, B., Shabani, A., Masoumian, S., Zamirinejad, S., Yaghmaeezadeh, H., Khanjani, S., & Ghahremani, S. (2021) · doi:10.21203/rs.3.rs-670472/v1 · Cited by 9
Capturing a mentalized moment: A pilot study of the psychometric properties of a novel assessment method of mentalizing in daily life
Steinberg, N., Moshe-Cohen, R., Sheena, L., & Kivity, Y. (2024) · Current Psychology · doi:10.1007/s12144-023-04963-w · Cited by 8
“The Pearson’s r correlation between the BRFI scores of the two coders was r = .87 and the Intra Class Correlation (2, 1) was 0.79 which is considered above good (Cicchetti, 1994).”
Influential
Listening to and believing derogatory and threatening voices
Sheaves, B., Johns, L., Loe, B. S., Bold, E., Černis, E., Panel, T. M. H. V. L. E. A., Molodynski, A., & Freeman, D. (2023) · Schizophrenia Bulletin · doi:10.1093/schbul/sbac101 · Cited by 8
Florida Obsessive-Compulsive Inventory: Psychometric properties in a chinese psychotherapy-seeking sample
Zhang, C. C., McGuire, J. F., Qiu, X., Jin, H., Li, Z., Cepeda, S., Goodman, W. K., & Storch, E. A. (2017) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2016.11.006 · Cited by 7
An Interventionist Adherence Scale for a Specialized Brief Negotiation Interview Focused on Treatment Engagement for Opioid use Disorders
Pantalon, M. V., Dziura, J., Li, F.-Y., Owens, P. H., O'Connor, P. G., & D'Onofrio, G. (2017) · Substance Abuse · doi:10.1080/08897077.2017.1294548 · Cited by 7
Effectiveness of smart applications of oral hygiene instructions on periodontal health compared to oral information: A prospective study
Alasmari, D., Alkhalaf, M. S., Alqahtani, S. M., Alqhtani, N. R., Alqahtani, A. S., Gufran, K., & Alotaibi, Y. K. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192214703 · Cited by 7
“Educational applications could deliver a mass of health information to a wider audience because of the popularity and advancement of smartphones in the current era [14,26,30,33].”
Background
A contemporary tool for assessing instrumental activities of daily living: validation of a caregiver-reported scale for non-institutionalized older adults
Barakat, Z., Sacre, H., Khatib, S., Hajj, A., BouMalham, C., Haddad, C., Zeenny, R. M., Akel, M., Abbas, L. A., Barakat, M., et al. (2025) · PLOS One · doi:10.1371/journal.pone.0322554 · Cited by 6
“ICC values can range between 0 and 1, with scores between 0.40 and 0.59 indicating fair agreement, 0.60 to 0.74 indicating good agreement, and 0.75 to 1 indicating excellent agreement [60].”
Influential
Barriers and facilitators to implementation of BEST in CLASS
Granger, K. L., Sutherland, K. S., Conroy, M. A., Hetrick, A. A., & Parnell, E. (2020) · Exceptionality · doi:10.1080/09362835.2020.1727335 · Cited by 5
Validity and reliability of torso- versus waist-worn inertial measurement units in the assessment of vertical jumps
Amin Mohammadian, M., Mozayyany, H., Bagheri Koudakani, S., & Maloney, S. J. (2024) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2024.112338 · Cited by 5
Intra-Reliability of a Wearable Near-Infrared Sensor for Monitoring the Intensity of Exercise
Michalik, K., Smolarek, M., Nowak, M., Pueo, B., & Żmijewski, P. (2024) · Applied Sciences · doi:10.3390/app14135856 · Cited by 3
Development and validation of a Japanese version of the Teachers Acceptance and Action Questionnaire
Koh, Y., Iwasawa, N., Inoue, K., & Ohtsuki, T. (2024) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2024.100726 · Cited by 1
GenAI Meets Psychometrics: Development and Validation of the Human-AI Collaboration Dynamics Scale and the Generative AI-Research Augmentation Scale
Mahy, T., & Li, H. (2026) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2026.2623216 · Cited by 2
“The Cronbach’s a coefficients ranged from 0.71 to 0.92 across five subscales in subsample A2 and subsample B (Table 5), consistently higher than the conventionally acceptable standard (i.e., 0.70) (Cicchetti, 1994).”
Influential
Learning gains from a one-day training in acceptance-based behavior therapy
Gu, G., Roemer, L., Suvak, M., Liverant, G., & Orsillo, S. M. (2021) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2020.1829026
“These ICCs suggest that inter-coder reliability was good to excellent (Cicchetti, 1994; Koo & Li, 2016).”
Background

Authors: Cicchetti, D. V.
Affiliations: Veterans Health Administration (US)
Corresponding author: Cicchetti, Domenic V.
Venue: Psychological Assessment
Publisher: American Psychological Association (APA)
Published: 1994-12
Volume: 6
Issue: 4
Pages: 284-290
ISSN: 1040-3590 (ISSN-L)
1939-134X
DOI: 10.1037/1040-3590.6.4.284
OpenAlex: W2063085086
Cited by: 9,349
References: 43
Citations by year: 2026: 538 · 2025: 654 · 2024: 693 · 2023: 753 · 2022: 842 · 2021: 886 · 2020: 882 · 2019: 825 · 2018: 786 · 2017: 611 · 2016: 355 · 2015: 308 · 2014: 209 · 2013: 152 · 2012: 139
FWCI: 17.61
Type: journal article
Language: en
Open access: closed
Locations: Psychological Assessment (publishedVersion)
Topics: Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
Keywords: test selection, standardized assessment, test standardization, test norming, test reliability, test validity, psychometrics, test development, cognitive assessment, personality assessment, adaptive behavior, children and adolescents, adults, older adults, disability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks