Cited by 9,349Psychological Testing and AssessmentPsychometric Methodologies and TestingHistorical and Modern Theater Studies

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Cicchetti, Domenic V.·1994·Psychological Assessment

DOI 10.1037/1040-3590.6.4.284

Open this paper in CoChat — free account

Abstract

In the context of the development of prototypic assessment instruments in the areas of cognition, personality, and adaptive functioning, the issues of standardization, norming procedures, and the important psychometrics of test reliability and validity are evaluated critically. Criteria, guidelines, and simple rules of thumb are provided to assist the clinician faced with the challenge of choosing an appropriate test instrument for a given psychological assessment. Clinicians are often faced with the critical challenge of choosing the most appropriate available test instrument for a given psychological assessment of a child, adolescent, or adult of a particular age, gender, and class of disability. It is the purpose of this report to provide some criteria, guidelines, or simple rules of thumb to aid in this complex scientific decision. As such, it draws upon my experience with issues of test development, standardization, norming procedures, and important psychometrics, namely, test reliability and validity. As I and my colleagues noted in an earlier publication, the major areas of psychological functioning, in the normal development of infants, children, adolescents, adults, and elderly people, include cognitive, academic, personality, and adaptive behaviors (Sparrow, Fletcher, & Cicchetti, 1985). As such, the major examples or applications discussed in this article derive primarily, although not exclusively, from these several areas of human functioning.

Integrity signals

Registry

Crossref · 10.1037/1040-3590.6.4.284

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Psychometric theory (2nd ed.).
Sitgreaves, R. (1979) · Contemporary Psychology · doi:10.1037/018882 · Cited by 14,384
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
Cooper, A. M., & Michels, R. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.1.128 · Cited by 7,419
Manual for the Wechsler Adult Intelligence Scale.
Wechsler, D. (1955) · Psychological Corp. eBooks · Cited by 4,941
Essentials of Psychological Testing
Rosner, B., & Cronbach, L. J. (1960) · The American Journal of Psychology · doi:10.2307/1419921 · Cited by 4,524
Statistical Methods for Rates and Proportions, 2nd ed
GROVE, W. A. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.12.1644-a · Cited by 3,756
The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354

Show all 43 references

Sorted by citations

Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial
Hallgren, K. A. (2012) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.08.1.p023 · Cited by 3,884
The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English
Livingstone, S. R., & Russo, F. (2018) · PLoS ONE · doi:10.1371/journal.pone.0196391 · Cited by 2,084
Psychometric properties of the Beck Depression Inventory-II: a comprehensive review
Wang, Y.-P., & Gorenstein, C. (2013) · Revista Brasileira de Psiquiatria · doi:10.1590/1516-4446-2012-1048 · Cited by 1,577
The primary care PTSD screen for DSM-5 (PC-PTSD-5): development and evaluation within a veteran primary care sample
Prins, A., Bovin, M. J., Smolenski, D. J., Marx, B. P., Kimerling, R., Jenkins-Guarnieri, M. A., Kaloupek, D. G., Schnurr, P. P., Kaiser, A. P., Leyva, Y. E., et al. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3703-5 · Cited by 1,303
Mindfulness-based interventions for psychiatric disorders: A systematic review and meta-analysis
Goldberg, S. B., Tucker, R. P., Greene, P. A., Davidson, R. J., Wampold, B. E., Kearney, D. J., & Simpson, T. L. (2018) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.10.011 · Cited by 1,145
The impact of behaviour problems on caregiver stress in young people with autism spectrum disorders
Lecavalier, L., Leone, S., & Wiltz, J. (2006) · Journal of Intellectual Disability Research · doi:10.1111/j.1365-2788.2005.00732.x · Cited by 1,163
A Randomized Trial of Methods to Help Clinicians Learn Motivational Interviewing.
Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.6.1050 · Cited by 1,075
The Depression Anxiety Stress Scales—21 (DASS‐21): Further Examination of Dimensions, Scale Reliability, and Correlates
Osman, A., Wong, J. L., Bagge, C. L., Freedenthal, S. L., Gutierrez, P. M., & Lozano, G. (2012) · Journal of Clinical Psychology · doi:10.1002/jclp.21908 · Cited by 1,097
Psychometric Properties of the Five Facet Mindfulness Questionnaire in Depressed Adults and Development of a Short Form
Bohlmeijer, E., ten Klooster, P. M., Fledderus, M., Veehof, M., & Baer, R. (2011) · Assessment · doi:10.1177/1073191111408231 · Cited by 990
What does best practice care for musculoskeletal pain look like? Eleven consistent recommendations from high-quality clinical practice guidelines: systematic review
Lin, I. B., Wiles, L., Waller, R., Goucke, R. C., Nagree, Y., Gibberd, M., Straker, L. M., Maher, C. G., & O’Sullivan, P. (2019) · British Journal of Sports Medicine · doi:10.1136/bjsports-2018-099878 · Cited by 1,091
Psychometric properties of the EQ-5D-5L: a systematic review of the literature
Feng, Y.-S., Kohlmann, T., Janssen, M. F., & Buchholz, I. (2021) · Quality of Life Research · doi:10.1007/s11136-020-02688-y · Cited by 917
“We relied on the guidance from Cicchetti 1994 [22] to define Kappa and ICC: 0.40 = poor, 0.40–0.59 = fair, 0.60–0.74 = good, 0.75–1.00 = excellent.”
Influential
Reliability in Coding Open-Ended Data: Lessons Learned from HIV Behavioral Research
Hruschka, D. J., Schwartz, D., St.John, D. C., Picone-Decaro, E., Jenkins, R. A., & Carey, J. W. (2004) · Field Methods · doi:10.1177/1525822x04266540 · Cited by 829
Acceptance-based interventions for the treatment of chronic pain: a systematic review and meta-analysis.
Veehof, M. M., Oskam, M.-J., Schreurs, K. M. G., & Bohlmeijer, E. T. (2011) · PAIN · doi:10.1016/j.pain.2010.11.002 · Cited by 792
Guidelines for establishing reliability when coding narrative data
Syed, M., & Nelson, S. C. (2015) · Emerging Adulthood · doi:10.1177/2167696815587648 · Cited by 801
Edinburgh Handedness Inventory – Short Form: A revised version based on confirmatory factor analysis
Veale, J. F. (2013) · Laterality Asymmetries of Body Brain and Cognition · doi:10.1080/1357650x.2013.783045 · Cited by 805
Development and validation of the Inventory of Depression and Anxiety Symptoms (IDAS).
Watson, D., O'Hara, M. W., Simms, L. J., Kotov, R., Chmielewski, M., McDade-Montez, E. A., Gamez, W., & Stuart, S. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.3.253 · Cited by 740
Assessing competence in the use of motivational interviewing
Moyers, T. B., Martin, T., Manuel, J. K., Hendrickson, S. M. L., & Miller, W. R. (2005) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2004.11.001 · Cited by 738
Screening for major depression disorders in medical inpatients with the Beck Depression Inventory for Primary Care
Beck, A. T., Guth, D., Steer, R. A., & Ball, R. (1997) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)00025-9 · Cited by 733
Reliability of the Timeline Followback for cocaine, cannabis, and cigarette use
Robinson, S. M., Sobell, L. C., Sobell, M. B., & Leo, G. I. (2014) · Psychology of Addictive Behaviors · doi:10.1037/a0030992 · Cited by 699
A Prospective, Multi-institutional, Pathologist-Based Assessment of 4 Immunohistochemistry Assays for PD-L1 Expression in Non–Small Cell Lung Cancer
Rimm, D. L., Han, G., Taube, J. M., Yi, E. S., Bridge, J. A., Flieder, D. B., Homer, R., West, W. W., Wu, H., Roden, A. C., et al. (2017) · JAMA Oncology · doi:10.1001/jamaoncol.2017.0013 · Cited by 764
Prevalence and risk factors of postpartum posttraumatic stress disorder: A meta-analysis
Grekin, R., & O’Hara, M. W. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.05.003 · Cited by 716
Impacts of the CARE for Teachers program on teachers’ social and emotional competence and classroom interactions.
Jennings, P. A., Brown, J. L., Frank, J. L., Doyle, S., Oh, Y., Davis, R., Rasheed, D., DeWeese, A., DeMauro, A. A., Cham, H., et al. (2017) · Journal of Educational Psychology · doi:10.1037/edu0000187 · Cited by 645
On orthorexia nervosa: A review of the literature and proposed diagnostic criteria
Dunn, T. M., & Bratman, S. (2016) · Eating Behaviors · doi:10.1016/j.eatbeh.2015.12.006 · Cited by 635
Preliminary Findings for Two New Measures of Social and Role Functioning in the Prodromal Phase of Schizophrenia
Cornblatt, B., Auther, A. M., Niendam, T. A., Smith, C. W., Zinberg, J. L., Bearden, C. E., & Cannon, T. D. (2007) · Schizophrenia Bulletin · doi:10.1093/schbul/sbm029 · Cited by 631
The Incremental Validity of Narrative Identity in Predicting Well-Being: A Review of the Field and Recommendations for the Future
Adler, J. M., Lodi-Smith, J., Philippe, F. L., & Houle, I. (2016) · Personality and Social Psychology Review · doi:10.1177/1088868315585068 · Cited by 618
Living into the story: Agency and coherence in a longitudinal study of narrative identity development and mental health over the course of psychotherapy
Adler, J. M. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0025289 · Cited by 588
Initial validation of the Voris cocaine craving scale: A preliminary report
Smelson, D. A., McGee-Caulfield, E., Bergstein, P., & Engelhart, C. (1999) · Journal of Clinical Psychology · doi:10.1002/(sici)1097-4679(199901)55:1 · Cited by 25
Working Alliance Inventory‐Short Revised (WAI‐SR): psychometric properties in outpatients and inpatients
Munder, T., Wilmers, F., Leonhart, R., Linster, H. W., & Barth, J. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.658 · Cited by 538
The Motivational Interviewing Treatment Integrity Code (MITI 4): Rationale, Preliminary Reliability and Validity
Moyers, T. B., Rowell, L. N., Manuel, J. K., Ernst, D., & Houck, J. M. (2016) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2016.01.001 · Cited by 567
Wearable Sleep Technology in Clinical and Research Settings
DE ZAMBOTTI, M., CELLINI, N., GOLDSTONE, A., COLRAIN, I. M., & BAKER, F. C. (2019) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001947 · Cited by 564
An Overview of Coefficient Alpha and a Reliability Matrix for Estimating Adequacy of Internal Consistency Coefficients with Psychological Research Measures
Ponterotto, J. G., & Ruckdeschel, D. E. (2007) · Perceptual and Motor Skills · doi:10.2466/pms.105.3.997-1014 · Cited by 555
A comparison of self-reported and device measured sedentary behaviour in adults: a systematic review and meta-analysis
Prince, S. A., Cardilli, L., Reed, J. L., Saunders, T. J., Kite, C., Douillette, K., Fournier, K., & Buckley, J. (2020) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-020-00938-3 · Cited by 574
The Empirical Status of Mindfulness-Based Interventions: A Systematic Review of 44 Meta-Analyses of Randomized Controlled Trials
Goldberg, S. B., Riordan, K. M., Sun, S., & Davidson, R. J. (2022) · Perspectives on Psychological Science · doi:10.1177/1745691620968771 · Cited by 520
“Interrater reliabilities were in the good to excellent range (i.e., κs and intraclass correlation coefficients > .60; Cicchetti, 1994).”
Background
Prevalence of mental disorders in school children and adolescents in China: diagnostic data from detailed clinical assessments of 17,524 individuals.
Li, F., Cui, Y., Li, Y., Guo, L., Ke, X., Liu, J., Luo, X., Zheng, Y., & Leckman, J. F. (2022) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13445 · Cited by 498
Efficacy of group social skills interventions for youth with autism spectrum disorder: A systematic review and meta-analysis
Gates, J. A., Kang, E., & Lerner, M. D. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.01.006 · Cited by 519
Development and Validation of New Anxiety and Bipolar Symptom Scales for an Expanded Version of the IDAS (the IDAS-II)
Watson, D., O’Hara, M. W., Naragon-Gainey, K., Koffel, E., Chmielewski, M., Kotov, R., Stasik, S. M., & Ruggero, C. J. (2012) · Assessment · doi:10.1177/1073191112449857 · Cited by 470
Normalizing the Use of Single-Item Measures: Validation of the Single-Item Compendium for Organizational Psychology
Matthews, R. A., Pineault, L., & Hong, Y.-H. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-022-09813-3 · Cited by 528
Toward a consensus definition of pathological video-gaming: A systematic review of psychometric assessment tools
King, D. L., Haagsma, M. C., Delfabbro, P., Gradisar, M., & Griffiths, M. D. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.01.002 · Cited by 499
Assessment of young children's social‐emotional development and psychopathology: recent advances and recommendations for practice
Carter, A. S., Briggs‐Gowan, M. J., & Davis, N. O. (2004) · Journal of Child Psychology and Psychiatry · doi:10.1046/j.0021-9630.2003.00316.x · Cited by 460
Psychometric evaluation of the five-factor Modified Drinking Motives Questionnaire — Revised in undergraduates
Grant, V. V., Stewart, S. H., O’Connor, R. M., Blackwell, E., & Conrod, P. (2007) · Addictive Behaviors · doi:10.1016/j.addbeh.2007.07.004 · Cited by 442
Mind matters: A meta-analysis on parental mentalization and sensitivity as predictors of infant–parent attachment.
Zeegers, M. A. J., Colonnesi, C., Stams, G. J. J. M., & Meins, E. (2017) · Psychological Bulletin · doi:10.1037/bul0000114 · Cited by 478
Diagnostic procedures in autism spectrum disorders: a systematic literature review
Falkmer, T., Anderson, K., Falkmer, M., & Horlin, C. (2013) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-013-0375-0 · Cited by 475
#bodypositivity: A Content Analysis of Body Positive Accounts on Instagram
Cohen, R., Irwin, L., Newton-John, T., & Slater, A. (2019) · Body Image · doi:10.1016/j.bodyim.2019.02.007 · Cited by 401
Systematic evaluation of the impact of stimulation intensity on neuroplastic after‐effects induced by transcranial direct current stimulation
Jamil, A., Batsikadze, G., Kuo, H.-I., Labruna, L., Hasan, A., Paulus, W., & Nitsche, M. (2017) · Journal of Physiology · doi:10.1113/jp272738 · Cited by 366
Evidence-Based Assessment of Child and Adolescent Disorders: Issues and Challenges
Mash, E. J., & Hunsley, J. D. (2005) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3403_1 · Cited by 396
A Review of Parent Participation Engagement in Child and Family Mental Health Treatment
Haine-Schlagel, R., & Walsh, N. E. (2015) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-015-0182-x · Cited by 369
Screening and assessment tools for gaming disorder: A comprehensive systematic review
King, D. L., Chamberlain, S. R., Carragher, N., Billieux, J., Stein, D., Mueller, K., Potenza, M. N., Rumpf, H. J., Saunders, J., Starcevic, V., et al. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101831 · Cited by 369
“, that longer scales tend to have higher alphas (Cicchetti, 1994; Groth-Marnat, 2009).”
BackgroundMethodInfluential
The Effects of Improvisational Music Therapy on Joint Attention Behaviors in Autistic Children: A Randomized Controlled Study
Kim, J., Wigram, T., & Gold, C. (2008) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-008-0566-6 · Cited by 371
Revision of a method quality rating scale for single-case experimental designs and n-of-1 trials: The 15-item Risk of Bias in N-of-1 Trials (RoBiNT) Scale
Tate, R. L., Perdices, M., Rosenkoetter, U., Wakim, D., Godbee, K., Togher, L., & McDonald, S. (2013) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2013.824383 · Cited by 358
The validity of individual Rorschach variables: Systematic reviews and meta-analyses of the comprehensive system.
Mihura, J. L., Meyer, G. J., Dumitrascu, N., & Bombel, G. (2012) · Psychological Bulletin · doi:10.1037/a0029406 · Cited by 399
From in-session behaviors to drinking outcomes: A causal chain for motivational interviewing.
Moyers, T. B., Martin, T., Houck, J. M., Christopher, P. J., & Tonigan, J. S. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0017189 · Cited by 359
The role of the human-robot interaction in consumers’ acceptance of humanoid retail service robots
Song, C. S., & Kim, Y. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.03.087 · Cited by 346
Using the Childhood Autism Rating Scale to Diagnose Autism Spectrum Disorders
Chlebowski, C., Green, J. A., Barton, M. L., & FEIN, D. A. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-009-0926-x · Cited by 344
Psychometric properties of the Drug Abuse Screening Test in psychiatric outpatients.
Cocco, K. M., & Carey, K. B. (1998) · Psychological Assessment · doi:10.1037/1040-3590.10.4.408 · Cited by 336
Does Self-Control Training Improve Self-Control? A Meta-Analysis
Friese, M., Frankenbach, J., Job, V., & Loschelder, D. D. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617697076 · Cited by 360
Test-retest reliability of alcohol measures: Is there a difference between Internet-based assessment and traditional methods?
Miller, E. T., Neal, D. J., Roberts, L. J., Baer, J. S., Cressler, S. O., Metrik, J., & Marlatt, G. A. (2002) · Psychology of Addictive Behaviors · doi:10.1037/0893-164x.16.1.56 · Cited by 356
Cognitively engaging chronic physical activity, but not aerobic exercise, affects executive functions in primary school children: a group-randomized controlled trial
Schmidt, M., Jäger, K., Egger, F., Roebers, C. M., & Conzelmann, A. (2015) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.2015-0069 · Cited by 329
Validity and repeatability of inertial measurement units for measuring gait parameters
Washabaugh, E. P., Kalyanaraman, T., Adamczyk, P. G., Claflin, E. S., & Krishnan, C. (2017) · Gait & Posture · doi:10.1016/j.gaitpost.2017.04.013 · Cited by 331
Extending Signaling Theory to Rhetorical Signals: Evidence from Crowdfunding
Steigenberger, N., & Wilhelm, H. (2018) · Organization Science · doi:10.1287/orsc.2017.1195 · Cited by 349
How does motivational interviewing work? Therapist interpersonal skill predicts client involvement within motivational interviewing sessions.
Moyers, T. B., Miller, W. R., & Hendrickson, S. M. L. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.4.590 · Cited by 327
Twenty-five years with the 20-item Toronto Alexithymia Scale
Bagby, R. M., Parker, J. D. A., & Taylor, G. J. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2020.109940 · Cited by 334
ChatGPT outperforms humans in emotional awareness evaluations
Elyoseph, Z., Hadar-Shoval, D., Asraf, K., & Lvovsky, M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1199058 · Cited by 324
“ICC was calculated, and good consistency (ICC = 0.720) and absolute agreement (ICC = 0.659) was found between the psychologists’ ratings (Cicchetti, 1994).”
BackgroundResultInfluential
Reliability and Validity of the Beck Depression Inventory--II With Adolescent Psychiatric Inpatients.
Osman, A., Kopper, B. A., Barrios, F. X., Gutierrez, P. M., & Bagge, C. L. (2004) · Psychological Assessment · doi:10.1037/1040-3590.16.2.120 · Cited by 328
Use of the Beck Depression Inventory for Primary Care to screen for major depression disorders
Steer, R. A., Cavalieri, T. A., Leonard, D. M., & Beck, A. T. (1999) · General Hospital Psychiatry · doi:10.1016/s0163-8343(98)00070-x · Cited by 313
Rating the methodological quality of single-subject designs and n-of-1 trials: Introducing the Single-Case Experimental Design (SCED) Scale
L Tate, R., Mcdonald, S., Perdices, M., Togher, L., Schultz, R., & Savage, S. (2008) · Neuropsychological Rehabilitation · doi:10.1080/09602010802009201 · Cited by 362
The reliability of Form 90: an instrument for assessing alcohol treatment outcome.
Tonigan, J. S., Miller, W. R., & Brown, J. M. (1997) · Journal of Studies on Alcohol · doi:10.15288/jsa.1997.58.358 · Cited by 312
Psychometric Properties of the Generalized Anxiety Disorder Scale-7 Item (GAD-7) in a Large Sample of Chinese Adolescents
Sun, J., Liang, K., Chi, X., & Chen, S. (2021) · Healthcare · doi:10.3390/healthcare9121709 · Cited by 310
“70 that were considered acceptable for research purposes [35].”
Background
The measurement of Internet addiction: A critical review of existing scales and their psychometric properties
Laconi, S., Rodgers, R. F., & Chabrol, H. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.09.026 · Cited by 338
Reliability and Validity of an Assessment Instrument for Anxiety, Depression, and Mood Among Individuals with Mental Retardation
Esbensen, A. J., Rojahn, J., Aman, M. G., & Ruedrich, S. (2003) · Journal of Autism and Developmental Disorders · doi:10.1023/b:jadd.0000005999.27178.55 · Cited by 308
Factor structure and reliability of the Childhood Trauma Questionnaire in a Canadian undergraduate student sample
Paivio, S. C., & Cramer, K. M. (2004) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2004.01.011 · Cited by 306
General functional connectivity: Shared features of resting-state and task fMRI drive reliable and heritable individual differences in functional brain networks
Elliott, M. L., Knodt, A. R., Cooke, M. E., Kim, M. J., Melzer, T. R., Keenan, R. J., Ireland, D. R., Ramrakha, S., Poulton, R., Caspi, A., et al. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.01.068 · Cited by 308
Measuring Language Mindsets and Modeling Their Relations With Goal Orientations and Emotional and Behavioral Responses in Failure Situations
Lou, N. M., & Noels, K. A. (2017) · Modern Language Journal · doi:10.1111/modl.12380 · Cited by 348
Self-Compassion in Depression: Associations With Depressive Symptoms, Rumination, and Avoidance in Depressed Outpatients
Krieger, T., Altenstein, D., Baettig, I., Doerig, N., & Holtforth, M. G. (2013) · Behavior Therapy · doi:10.1016/j.beth.2013.04.004 · Cited by 374
Emotional, motivational and interpersonal responsiveness of children with autism in improvisational music therapy
Kim, J., Wigram, T., & Gold, C. (2009) · Autism · doi:10.1177/1362361309105660 · Cited by 303
Cultural Adaptation of the Difficulties in Emotion Regulation Scale: Reliability and Validity of an Italian Version
Giromini, L., Velotti, P., de Campora, G., Bonalume, L., & Cesare Zavattini, G. (2012) · Journal of Clinical Psychology · doi:10.1002/jclp.21876 · Cited by 301
Internet gaming disorder, motives, game genres and psychopathology
Laconi, S., Pirès, S., & Chabrol, H. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.06.012 · Cited by 301
Assessment of depression in medical patients: A systematic review of the utility of the Beck Depression Inventory-II
Wang, Y., & Gorenstein, C. (2013) · Clinics · doi:10.6061/clinics/2013(09)15 · Cited by 306
Accurately measuring willingness to pay for consumer goods: a meta-analysis of the hypothetical bias
Schmidt, J., & Bijmolt, T. H. A. (2019) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00666-6 · Cited by 340
Statistics From A (Agreement) to Z (z Score): A Guide to Interpreting Common Measures of Association, Agreement, Diagnostic Accuracy, Effect Size, Heterogeneity, and Reliability in Medical Research
Schober, P. R., Mascha, E. J., & Vetter, T. R. (2021) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000005773 · Cited by 325
Brain-age in midlife is associated with accelerated biological aging and cognitive decline in a longitudinal birth cohort
Elliott, M. L., Belsky, D. W., Knodt, A. R., Ireland, D. R., Melzer, T. R., Poulton, R., Ramrakha, S., Caspi, A., Moffitt, T. E., & Hariri, A. R. (2019) · Molecular Psychiatry · doi:10.1038/s41380-019-0626-7 · Cited by 297
“001), indicating excellent reliability [33].”
Psychedelic therapy for smoking cessation: qualitative analysis of participant accounts
Noorani, T., Garcia-Romeu, A., Swift, T. C., Griffiths, R. R., & Johnson, M. W. (2018) · Journal of Psychopharmacology · doi:10.1177/0269881118780612 · Cited by 285
Recommendations for the management of hip and knee osteoarthritis: A systematic review of clinical practice guidelines
Gibbs, A., Gray, B., Wallis, J. A., Taylor, N. F., Kemp, J. L., Hunter, D. J., & Barton, C. J. (2023) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2023.05.015 · Cited by 303
Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems
Hogue, A., Henderson, C. E., Dauber, S., Barajas, P. C., Fried, A., & Liddle, H. A. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.4.544 · Cited by 284
Maternal Dietary Patterns and Birth Outcomes: A Systematic Review and Meta-Analysis
Chia, A.-R., Chen, L.-W., Lai, J. S., Wong, C. H., Neelakantan, N., van Dam, R. M., & Chong, M. F.-F. (2019) · Advances in Nutrition · doi:10.1093/advances/nmy123 · Cited by 271
“The inter-rater agreement for each subscale was reasonably good (intraclass correlation coefficient values between 0.75 and 0.93) (13).”
Influential
Alexithymia as a mediator between childhood trauma and self-injurious behaviors
Paivio, S. C., & McCulloch, C. R. (2004) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2003.11.018 · Cited by 273
How should clinicians rehabilitate patients after ACL reconstruction? A systematic review of clinical practice guidelines (CPGs) with a focus on quality appraisal (AGREE II)
Andrade, R., Pereira, R., van Cingel, R., Staal, J. B., & Espregueira-Mendes, J. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2018-100310 · Cited by 264
Initial evidence for the reliability and validity of a "Lite" version of the Addiction Severity Index.
Cacciola, J., Alterman, A., Mclellan, A., Lin, Y.-T., & Lynch, K. (2007) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2006.09.002 · Cited by 277
Manifesting Destiny: Re/presentations of Indigenous Peoples in K–12 U.S. History Standards
Shear, S. B., Knowles, R. T., Soden, G. J., & Castro, A. J. (2015) · Theory & Research in Social Education · doi:10.1080/00933104.2014.999849 · Cited by 228
REVIEW ARTICLES
Volberg, R. A., Gupta, R., Griffiths, M. D., Ólason, D. Þ., & Delfabbro, P. (2010) · International Journal of Adolescent Medicine and Health · doi:10.1515/ijamh.2010.22.1.3 · Cited by 273
The relationship between adult attachment style and therapeutic alliance in individual psychotherapy: A meta-analytic review.
Diener, M. J., & Monroe, J. M. (2011) · Psychotherapy · doi:10.1037/a0022425 · Cited by 260
Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials
Goldberg, S. B., Lam, S. U., Simonsson, O., Torous, J., & Sun, S. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000002 · Cited by 237
The Posttraumatic Stress Disorder (PTSD) Checklist for DSM–5: A systematic review of existing psychometric evidence.
Forkus, S. R., Raudales, A. M., Rafiuddin, H. S., Weiss, N. H., Messman, B. A., & Contractor, A. A. (2023) · Clinical Psychology: Science and Practice · doi:10.1037/cps0000111 · Cited by 262
Validity of teleneuropsychology for older adults in response to COVID-19: A systematic and critical review
Marra, D. E., Hamlet, K. M., Bauer, R. M., & Bowers, D. (2020) · The Clinical Neuropsychologist · doi:10.1080/13854046.2020.1769192 · Cited by 250
“1177/1357633x19890788 Cicchetti DV (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. doi:10.1037/1040-3590.6.4.284 Ciemins EL, Holloway B, Coon PJ, McClosky-Armstrong T, & Min SJ (2009). Telemedicine an…”
BackgroundMethodInfluential
The Japanese version of the National Cancer Institute’s patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE): psychometric validation and discordance between clinician and patient assessments of adverse events
Kawaguchi, T., Azuma, K., Sano, M., Kim, S., Kawahara, Y., Sano, Y., Shimodaira, T., Ishibashi, K., Miyaji, T., Basch, E., et al. (2018) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-017-0022-5 · Cited by 248
Integrated motivational interviewing and cognitive behavioural therapy for people with psychosis and comorbid substance misuse: randomised controlled trial
Barrowclough, C., Haddock, G., Wykes, T., Beardmore, R., Conrod, P., Craig, T., Davies, L. M., Dunn, G., Eisner, E., Lewis, S. W., et al. (2010) · BMJ · doi:10.1136/bmj.c6325 · Cited by 245
The technical hypothesis of motivational interviewing: A meta-analysis of MI’s key causal model.
Magill, M., Gaume, J., Apodaca, T. R., Walthers, J., Mastroleo, N. R., Borsari, B. E., & Longabaugh, R. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0036833 · Cited by 246
We need to talk about reliability: making better use of test-retest studies for study design and interpretation
Matheson, G. J. (2019) · PeerJ · doi:10.7717/peerj.6918 · Cited by 246
Effects of school design on student outcomes
Tanner, C. K. (2009) · Journal of Educational Administration · doi:10.1108/09578230910955809 · Cited by 247
Prevalence and risk factors of birth-related posttraumatic stress among parents: A comparative systematic review and meta-analysis
Heyne, C.-S., Kaźmierczak, M., Souday, R., Horesh, D., den Berg, M. P. L., Weigl, T., Horsch, A., Oosterman, M., Dikmen‐Yildiz, P., & Garthus‐Niegel, S. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102157 · Cited by 266
The Child Report Form of the CHIP–Child Edition
Riley, A. W., Forrest, C. B., Rebok, G. W., Starfield, B. H., Green, B. F., Robertson, J. A., & Friello, P. J. (2004) · Medical Care · doi:10.1097/01.mlr.0000114910.46921.73 · Cited by 242

Authors: Cicchetti, D. V.
Affiliations: Veterans Health Administration (US)
Corresponding author: Cicchetti, Domenic V.
Venue: Psychological Assessment
Publisher: American Psychological Association (APA)
Published: 1994-12
Volume: 6
Issue: 4
Pages: 284-290
ISSN: 1040-3590 (ISSN-L)
1939-134X
DOI: 10.1037/1040-3590.6.4.284
OpenAlex: W2063085086
Cited by: 9,349
References: 43
Citations by year: 2026: 538 · 2025: 654 · 2024: 693 · 2023: 753 · 2022: 842 · 2021: 886 · 2020: 882 · 2019: 825 · 2018: 786 · 2017: 611 · 2016: 355 · 2015: 308 · 2014: 209 · 2013: 152 · 2012: 139
FWCI: 17.61
Type: journal article
Language: en
Open access: closed
Locations: Psychological Assessment (publishedVersion)
Topics: Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
Keywords: test selection, standardized assessment, test standardization, test norming, test reliability, test validity, psychometrics, test development, cognitive assessment, personality assessment, adaptive behavior, children and adolescents, adults, older adults, disability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks