Cited by 9,349Psychological Testing and AssessmentPsychometric Methodologies and TestingHistorical and Modern Theater Studies

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Cicchetti, Domenic V.·1994·Psychological Assessment

DOI 10.1037/1040-3590.6.4.284

Open this paper in CoChat — free account

Abstract

In the context of the development of prototypic assessment instruments in the areas of cognition, personality, and adaptive functioning, the issues of standardization, norming procedures, and the important psychometrics of test reliability and validity are evaluated critically. Criteria, guidelines, and simple rules of thumb are provided to assist the clinician faced with the challenge of choosing an appropriate test instrument for a given psychological assessment. Clinicians are often faced with the critical challenge of choosing the most appropriate available test instrument for a given psychological assessment of a child, adolescent, or adult of a particular age, gender, and class of disability. It is the purpose of this report to provide some criteria, guidelines, or simple rules of thumb to aid in this complex scientific decision. As such, it draws upon my experience with issues of test development, standardization, norming procedures, and important psychometrics, namely, test reliability and validity. As I and my colleagues noted in an earlier publication, the major areas of psychological functioning, in the normal development of infants, children, adolescents, adults, and elderly people, include cognitive, academic, personality, and adaptive behaviors (Sparrow, Fletcher, & Cicchetti, 1985). As such, the major examples or applications discussed in this article derive primarily, although not exclusively, from these several areas of human functioning.

Integrity signals

Registry

Crossref · 10.1037/1040-3590.6.4.284

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Psychometric theory (2nd ed.).
Sitgreaves, R. (1979) · Contemporary Psychology · doi:10.1037/018882 · Cited by 14,384
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
Cooper, A. M., & Michels, R. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.1.128 · Cited by 7,419
Manual for the Wechsler Adult Intelligence Scale.
Wechsler, D. (1955) · Psychological Corp. eBooks · Cited by 4,941
Essentials of Psychological Testing
Rosner, B., & Cronbach, L. J. (1960) · The American Journal of Psychology · doi:10.2307/1419921 · Cited by 4,524
Statistical Methods for Rates and Proportions, 2nd ed
GROVE, W. A. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.12.1644-a · Cited by 3,756
The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354

Show all 43 references

Sorted by citations

Items 801–900 of 1,086

A brief marijuana intervention for non-treatment-seeking young adult women.
Stein, M. D., Hagerty, C. E., Herman, D. S., Phipps, M. G., & Anderson, B. J. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2010.11.001 · Cited by 61
Tutorial on use of intraclass correlation coefficients for assessing intertest reliability and its application in functional near-infrared spectroscopy–based brain imaging
Li, L., Zeng, L., Lin, Z.-J., Cazzell, M., & Liu, H. (2015) · Journal of Biomedical Optics · doi:10.1117/1.jbo.20.5.050801 · Cited by 78
Effectiveness of Prompt Mental Health Care, the Norwegian Version of Improving Access to Psychological Therapies: A Randomized Controlled Trial
Knapstad, M., Lervik, L. V., Sæther, S. M. M., Aarø, L. E., & Smith, O. R. F. (2019) · Psychotherapy and Psychosomatics · doi:10.1159/000504453 · Cited by 65
Initial Validity and Reliability of the Portuguese Borg Rating of Perceived Exertion 6-20 Scale
Cabral, L. L., Nakamura, F., Stefanello, J. M., Pessoa, L., Smirmaul, B., & Pereira, G. (2020) · Measurement in Physical Education and Exercise Science · doi:10.1080/1091367x.2019.1710709 · Cited by 51
“The classification of ICC ranged from poor (.0–0.39), fair (0.4–- 0.59), good (0.6–0.74) to excellent (0.75–1.00) (Cicchetti, 1994).”
Influential
What is the Status of Multi-Informant Treatment Fidelity Research?
McLeod, B. D., Porter, N., Hogue, A., Becker‐Haimes, E. M., & Jensen‐Doss, A. (2022) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2022.2151713 · Cited by 64
Foreign language learning boredom: Refining its measurement and determining its role in language learning
Li, C., Feng, E., Zhao, X., & Dewaele, J. (2024) · Studies in Second Language Acquisition · doi:10.1017/s0272263124000366 · Cited by 61
“75) (Cicchetti, 1994).”
Reliability of the Autism Spectrum Disorders-Comorbid for Children (ASD-CC)
Matson, J. L., & Wilkins, J. W. (2008) · Journal of Developmental and Physical Disabilities · doi:10.1007/s10882-008-9100-1 · Cited by 61
The video assessment of simulated encounters-revised (VASE-R): Reliability and validity of a revised measure of motivational interviewing skills
Rosengren, D. B., Hartzler, B. J., Baer, J. S., Wells, E. A., & Dunn, C. W. (2008) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.03.018 · Cited by 61
Using a Tangible Versus a Multi-touch Graphical User Interface to Support Data Exploration at a Museum Exhibit
Ma, J., Sindorf, L., Liao, I., & Frazier, J. R. (2015) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/2677199.2680555 · Cited by 63
Critical evaluation of self-rated quality of life in mild cognitive impairment and Alzheimer's disease — Further evidence for the impact of anosognosia and global cognitive impairment
Berwig, M., Leicht, H., & Gertz, H.-J. (2009) · The journal of nutrition health & aging · doi:10.1007/s12603-009-0063-4 · Cited by 62
Diagnostic tools for REM sleep behavior disorder
Neikrug, A. B., & Ancoli‐Israel, S. (2011) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2011.08.004 · Cited by 61
A Preliminary Investigation into the Utility of the Adult Behavior Checklist in the Assessment of Psychopathology in People with Low IQ
Tenneij, N. H., & Koot, H. M. (2007) · Journal of Applied Research in Intellectual Disabilities · doi:10.1111/j.1468-3148.2007.00383.x · Cited by 61
The Smoking Abstinence Questionnaire: measurement of smokers' abstinence‐related expectancies
Hendricks, P. S., Wood, S. B., Baker, M. R., Delucchi, K., & Hall, S. M. (2010) · Addiction · doi:10.1111/j.1360-0443.2010.03338.x · Cited by 63
A Replication of Rorschach and MMPI-2 Convergent Validity
Meyer, G. J., Riethmiller, R. J., Brooks, R. D., Benoit, W. A., & Handler, L. (2000) · Journal of Personality Assessment · doi:10.1207/s15327752jpa7402_3 · Cited by 61
Interrater Agreement on the Visual Analysis of Individual Tiers and Functional Relations in Multiple Baseline Designs
Wolfe, K., Seaman, M. A., & Drasgow, E. (2016) · Behavior Modification · doi:10.1177/0145445516644699 · Cited by 61
High-resolution18F-FDG PET/CT for assessing disease activity in rheumatoid and psoriatic arthritis: findings of a prospective pilot study
Chaudhari, A. J., Ferrero, A., Godinez, F., Yang, K., Shelton, D. K., Hunter, J. C., Naguwa, S. M., Boone, J. M., Raychaudhuri, S. P., & Badawi, R. D. (2016) · British Journal of Radiology · doi:10.1259/bjr.20160138 · Cited by 61
Competence and Adherence Scale for Cognitive Behavioral Therapy (CAS-CBT) for anxiety disorders in youth: Psychometric properties.
Bjaastad, J. F., Haugland, B. S. M., Fjermestad, K. W., Torsheim, T., Havik, O. E., Heiervang, E. R., & Öst, L. (2015) · Psychological Assessment · doi:10.1037/pas0000230 · Cited by 61
Persisting Issues in Pedagogical Agent Research
Schroeder, N. L., & Gotch, C. M. (2015) · Journal of Educational Computing Research · doi:10.1177/0735633115597625 · Cited by 61
What’s the story? A computational analysis of narrative competence in autism
Lee, M., Martin, G. E., Hogan, A. L., Hano, D., Gordon, P. C., & Losh, M. C. (2017) · Autism · doi:10.1177/1362361316677957 · Cited by 61
Problematic internet use, psychopathology, personality, defense and coping
Laconi, S., Vigouroux, M., Lafuente, C., & Chabrol, H. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.03.025 · Cited by 62
Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health
Dorsey, S., Kerns, S. E. U., Lucid, L., Pullmann, M. D., Harrison, J. P., Berliner, L., Thompson, K., & Deblinger, E. (2018) · Implementation Science · doi:10.1186/s13012-017-0708-3 · Cited by 61
Translation, cross-cultural adaptation and psychometric properties of the Nepali versions of numerical pain rating scale and global rating of change
Sharma, S., Palanchoke, J., Reed, D., & Haxby Abbott, J. (2017) · Health and Quality of Life Outcomes · doi:10.1186/s12955-017-0812-8 · Cited by 59
How social engineers use persuasion principles during vishing attacks
Jones, K. S., Armstrong, M. E., Tornblad, M. K., & Siami Namin, A. (2021) · Information & Computer Security · doi:10.1108/ics-07-2020-0113 · Cited by 61
Ready, Set, Change! Development and usability testing of an online readiness for change decision support tool for healthcare organizations
Timmings, C., Khan, S., Moore, J. E., Marquez, C., Pyka, K., & Straus, S. E. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0262-y · Cited by 70
Reproducibility and Agreement of Anterior Segment Parameter Measurements Obtained Using the CASIA2 and Spectralis OCT2 Optical Coherence Tomography Devices
Xu, B. Y., Mai, D. D., Penteado, R. C., Saunders, L. J., & Weinreb, R. N. (2017) · Journal of Glaucoma · doi:10.1097/ijg.0000000000000788 · Cited by 60
Study of an Extensive Set of Eye Movement Features: Extraction Methods and Statistical Analysis
Rigas, I., Friedman, L., & Komogortsev, O. V. (2018) · Journal of Eye Movement Research · doi:10.16910/jemr.11.1.3 · Cited by 60
The sustainable start‐up paradox: Predicting the business and climate performance of start‐ups
Leendertse, J., van Rijnsoever, F. J., & Eveleens, C. P. (2021) · Business Strategy and the Environment · doi:10.1002/bse.2667 · Cited by 64
Reliability and Validity Test of the Indonesian Version of the Hamilton Anxiety Rating Scale (HAM-A) to Measure Work-related Stress in Nursing
Ramdan, I. M. (2019) · Jurnal NERS · doi:10.20473/jn.v13i2.10673 · Cited by 60
Assessment of health status and quality of life outcomes for children with asthma
Annett, R. D. (2001) · Journal of Allergy and Clinical Immunology · doi:10.1067/mai.2001.114949 · Cited by 60
“Is This Normal? Is This Not Normal? There Is No Set Example”: Sexual Health Intervention Preferences of LGBT Youth in Romantic Relationships
Greene, G. J., Fisher, K. A., Kuper, L. E., Andrews, R., & Mustanski, B. S. (2014) · Sexuality Research and Social Policy · doi:10.1007/s13178-014-0169-2 · Cited by 71
Psychosocial impact of dental aesthetics in adolescence: validity and reliability of a questionnaire across age-groups
Klages, U., Erbe, C., Sandru, S. D., Brüllman, D., & Wehrbein, H. (2014) · Quality of Life Research · doi:10.1007/s11136-014-0767-8 · Cited by 60
Psychometric considerations in using error-related brain activity as a biomarker in psychotic disorders.
Foti, D., Kotov, R., & Hajcak, G. (2013) · Journal of Abnormal Psychology · doi:10.1037/a0032618 · Cited by 61
Assessing Attachment in Psychotherapy: Validation of the Patient Attachment Coding System (PACS)
Talia, A., Miller‐Bottome, M., & Daniel, S. I. F. (2015) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1990 · Cited by 63
Fundamental questions of cross-cultural psychology
van de Vijver, F. J. R., Chasiotis, A., & Breugelmans, S. M. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511974090.002 · Cited by 61
Are Eyes a Mirror of the Soul? What Eye Wrinkles Reveal about a Horse’s Emotional State
Hintze, S., Smith, S. E., Patt, A., Bachmann, I., & Würbel, H. (2016) · PLoS ONE · doi:10.1371/journal.pone.0164017 · Cited by 60
SBIRT Training in Social Work Education: Evaluating Change Using Standardized Patient Simulation
Sacco, P., Ting, L. A., Crouch, T. B., Emery, L., Moreland, M. L., Bright, C. L., Frey, J. J., & DiClemente, C. C. (2017) · Journal of Social Work Practice in the Addictions · doi:10.1080/1533256x.2017.1302886 · Cited by 60
The Counseling Competencies Scale: Validation and Refinement
Lambie, G. W., Mullen, P. R., Swank, J. M., & Blount, A. J. (2017) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2017.1358964 · Cited by 60
Modifiable individual and work-related factors associated with neck pain in 740 office workers: a cross-sectional study
Chen, X., O’Leary, S. P., & Johnston, V. (2018) · Brazilian Journal of Physical Therapy · doi:10.1016/j.bjpt.2018.03.003 · Cited by 60
Can grimace scales estimate the pain status in horses and mice? A statistical approach to identify a classifier
Costa, E. D., Pascuzzo, R., Leach, M. C., Dai, F., Lebelt, D., Vantini, S., & Minero, M. (2018) · PLoS ONE · doi:10.1371/journal.pone.0200339 · Cited by 60
Expert judgments for performance shaping Factors’ multiplier design in human reliability analysis
Liu, P., Qiu, Y., Hu, J., Tong, J., Zhao, J., & Li, Z. (2018) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2018.12.022 · Cited by 60
“96]), indicating excellent reliability overall [64].”
A Mental Health Program Report Card: A Multidimensional Approach to Performance Monitoring in Public Sector Programs
Rosenheck, R. A., & Cicchetti, D. V. (1998) · Community Mental Health Journal · doi:10.1023/a:1018720414126 · Cited by 60
Self-citation
The Blank Page: Effects of Constraint on CreativityPreprint
Joyce, C. K. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1552835 · Cited by 60
Higher education institutions and the use of online instruction and online tools and resources during the COVID-19 outbreak - An online review of selected U.S. and SA's universitiesPreprint
Chaka, C. (2020) · Research Square · doi:10.21203/rs.3.rs-61482/v1 · Cited by 70
“For example, kappa values are weighted as follows: .40 to .60 = fair; .60 to .75 = good; and .75 to 1.00 = excellent (see Chaka, 2019; Chaka, Lephalala, & Ngesi, 2017; Cicchetti, 1994; Zawacki-Richter et al., 2019; cf. Burla et al., 2008; Everitt, 1996).”
Influential
Self-regulation and control in personality functioning
Carver, C. S., & Scheier, M. F. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511596544.027 · Cited by 59
Confidence and capital raising
Huang, W., Silvio Vismara, A., & Wei, X. (2021) · Journal of Corporate Finance · doi:10.1016/j.jcorpfin.2021.101900 · Cited by 56
A Method to Optimize the Response Range While Maintaining Rorschach Comprehensive System Validity
Dean, K. L., Viglione, D. J., Perry, W., & Meyer, G. J. (2007) · Journal of Personality Assessment · doi:10.1080/00223890701468543 · Cited by 59
Training medical students to conduct motivational interviewing: A randomized controlled trial
Daeppen, J., Fortini, C., Bertholet, N., Bonvin, R., Berney, A., Michaud, P., Layat, C., & Gaume, J. (2012) · Patient Education and Counseling · doi:10.1016/j.pec.2011.12.005 · Cited by 59
An Inter-Rater Reliability Study for the Rorschach Performance Assessment System
Viglione, D. J., Blume-Marcovici, A. C., Miller, H. L., Giromini, L., & Meyer, G. J. (2012) · Journal of Personality Assessment · doi:10.1080/00223891.2012.684118 · Cited by 59
Assessment of Trait and State Aspects of Depression in Schizophrenia
Chiappelli, J., Nugent, K. L., Thangavelu, K., Searcy, K., & Hong, L. E. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt069 · Cited by 59
Participation in Early Childhood Educational Environments for Young Children with and Without Developmental Disabilities and Delays: A Mixed Methods Study
Benjamin‐Thomas, T. E., Lucas‐Thompson, R. G., Little, L. M., Davies, P. L., & Khetani, M. A. (2016) · Physical & Occupational Therapy In Pediatrics · doi:10.3109/01942638.2015.1130007 · Cited by 61
Disagreement in Parental Reports of Father Involvement
Charles, P., Spielfogel, J. E., Gorman‐Smith, D., Schoeny, M. E., Henry, D. B., & Tolan, P. H. (2016) · Journal of Family Issues · doi:10.1177/0192513x16644639 · Cited by 59
Validation of a Smartphone Image-Based Dietary Assessment Method for Pregnant Women
Ashman, A. M., Collins, C. E., Brown, L., Rae, K. M., & Rollo, M. E. (2017) · Nutrients · doi:10.3390/nu9010073 · Cited by 57
Psychometric Versus Actuarial Interpretation of Intelligence and Related Aptitude Batteries
Canivez, G. L. (2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199796304.013.0004 · Cited by 62
Quantification of collagen organization in histopathology samples using liquid crystal based polarization microscopy
Keikhosravi, A., Liu, Y., Drifka, C. R., Woo, K. M., Verma, A., Oldenbourg, R., & Eliceiri, K. W. (2017) · Biomedical Optics Express · doi:10.1364/boe.8.004243 · Cited by 59
A preliminary study of occupants’ use of manual lighting controls in private offices: A case study
Gilani, S., & O'Brien, W. (2018) · Energy and Buildings · doi:10.1016/j.enbuild.2017.11.055 · Cited by 50
Randomized Placebo‐Controlled Trial Assessing the Effect of 24‐Week Fenofibrate Therapy on Circulating Markers of Abdominal Aortic Aneurysm: Outcomes From the FAME‐2 Trial
Pinchbeck, J. L., Moxon, J. V., Rowbotham, S. E., Bourke, M., Lazzaroni, S. M., Morton, S. K., Matthews, E. O., Hendy, K., Jones, R. E., Bourke, B. M., et al. (2018) · Journal of the American Heart Association · doi:10.1161/jaha.118.009866 · Cited by 59
Intergenerational transmission of emotion dysregulation: Part II. Developmental origins of newborn neurobehavior
Ostlund, B. D., Vlisides‐Henry, R. D., Crowell, S. E., Raby, K. L., Terrell, S., Brown, M. A., Tinajero, R., Shakiba, N., Monk, C. E., Shakib, J. H., et al. (2019) · Development and Psychopathology · doi:10.1017/s0954579419000440 · Cited by 61
Histopathological investigation of complex gill disease in sea farmed Atlantic salmon
Gjessing, M. C., Steinum, T. M., Olsen, A. B., Lie, K. I., Tavornpanich, S., Colquhoun, D. J., & Gjevre, A. (2019) · PLoS ONE · doi:10.1371/journal.pone.0222926 · Cited by 59
Automated Knee Osteoarthritis Assessment Increases Physicians’ Agreement Rate and Accuracy: Data from the Osteoarthritis Initiative
Nehrer, S., Ljuhar, R., Steindl, P., Simon, R., Maurer, D., Ljuhar, D., Bertalan, Z., Dimai, H. P., Goetz, C., & Paixão, T. (2019) · Cartilage · doi:10.1177/1947603519888793 · Cited by 59
“According to proposed guidelines for the interpretation of ICC values, 16 the agreement rate went from “good” to “excellent” for KL grade, and from “fair” to “good” for sclerosis and osteophyte OARSI grades, as well as for the diagnosis of OA ( Fig.”
Method
Incorporating context in linking crimes: an exploratory study of situational similarity and if‐then contingencies
Woodhams, J., Hollin, C. R., & Bull, R. (2008) · Journal of Investigative Psychology and Offender Profiling · doi:10.1002/jip.75 · Cited by 60
Relationships between implicit and explicit uncertainty monitoring and mindreading: Evidence from autism spectrum disorder
Nicholson, T., Williams, D. M., Grainger, C., Lind, S. E., & Carruthers, P. (2019) · Consciousness and Cognition · doi:10.1016/j.concog.2019.01.013 · Cited by 57
Developing a Diagnostic Algorithm for the Music-Based Scale for Autism Diagnostics (MUSAD) Assessing Adults with Intellectual Disability
Bergmann, T. J., Heinrich, M., Ziegler, M. D., Dziobek, I., Diefenbacher, A., & Sappok, T. (2019) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-019-04069-y · Cited by 58
Congruence Gaps Between Adolescents With Cancer and Their Families Regarding Values, Goals, and Beliefs About End-of-Life Care
Friebert, S. E., Grossoehme, D. H., Baker, J. N., Needle, J. S., Thompkins, J. D., Cheng, Y. I., Wang, J., & Lyon, M. E. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.5424 · Cited by 57
ThermalWear: Exploring Wearable On-chest Thermal Displays to Augment Voice Messages with Affect
Ali, A. E., Yang, X., Ananthanarayan, S., Röggla, T., Jansen, J., Hartcher-O’Brien, J., Jansen, K. M. B., & Cesar, P. S. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376682 · Cited by 64
“81) had high degree of agreement amongst raters, which suggests a minimal amount of measurement error and high statistical power [8].”
Background
Accuracy of Temporo-Spatial and Lower Limb Joint Kinematics Parameters Using OpenPose for Various Gait Patterns With Orthosis
Yamamoto, M., Shimatani, K., Hasegawa, M., Kurita, Y., Ishige, Y., & Takemura, H. (2021) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2021.3135879 · Cited by 58
Virtual reality as a teaching method for resuscitation training in undergraduate first year medical students during COVID-19 pandemic: a randomised controlled trial
Moll-Khosrawi, P., Falb, A., Pinnschmidt, H. O., Zöllner, C., & Issleib, M. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03533-1 · Cited by 58
“75 and 1 as an excellent correlation [29].”
Background
Convergent and incremental predictive validity of clinician, self-report, and structured interview diagnoses for personality disorders over 5 years.
Samuel, D. B., Sanislow, C. A., Hopwood, C. J., Shea, M. T., Skodol, A. E., Morey, L. C., Ansell, E. B., Markowitz, J. C., Zanarini, M. C., & Grilo, C. M. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0032813 · Cited by 58
Vineland Screener 0–12 years research version (NL). Constructing a screening instrument to assess adaptive behaviour
van Duijn, G., Dijkxhoorn, Y. M., Noens, I. L. J., SCHOLTE, E. M., & van Berckelaer‐Onnes, I. (2009) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.282 · Cited by 58
KIRAT: Law enforcement’s prioritization tool for investigating indecent image offenders.
Long, M. L., Alison, L. J., Tejeiro, R. A., Hendricks, E. L., & Giles, S. (2016) · Psychology Public Policy and Law · doi:10.1037/law0000069 · Cited by 58
Impact of the Choice of Risk Model for Identifying Low-risk Patients Using the 2014 American College of Cardiology/American Heart Association Perioperative Guidelines
Glance, L. G., Faden, E., Dutton, R. P., Lustik, S. J., Li, Y., Eaton, M. P., & Dick, A. W. (2018) · Anesthesiology · doi:10.1097/aln.0000000000002341 · Cited by 58
Small changes, big gains: A curriculum-wide study of teaching practices and student learning in undergraduate biology
Weir, L. K., Barker, M. K., McDonnell, L., Schimpf, N. G., Rodela, T. M., & Schulte, P. M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0220900 · Cited by 69
Craving and opioid use disorder: A scoping review
Kleykamp, B. A., Santis, M. D., Dworkin, R. H., Huhn, A. S., Kampman, K. M., Montoya, I. D., Preston, K. L., Ramey, T. S., Smith, S. M., Turk, D. C., et al. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.107639 · Cited by 58
Diagnosing developmental prosopagnosia: repeat assessment using the Cambridge Face Memory Test
Murray, E., & Bate, S. (2020) · Royal Society Open Science · doi:10.1098/rsos.200884 · Cited by 58
Improved Conversation Outcomes After Social Communication Skills Training for People With Traumatic Brain Injury and Their Communication Partners: A Clinical Trial Investigating In-Person and Telehealth Delivery
Rietdijk, R., Power, E., Attard, M., Heard, R., & Togher, L. (2020) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2019_jslhr-19-00076 · Cited by 55
Auditory-Perceptual Rating of Connected Speech in Aphasia
Casilio, M., Rising, K., Beeson, P. M., Bunton, K., & Wilson, S. M. (2019) · American Journal of Speech-Language Pathology · doi:10.1044/2018_ajslp-18-0192 · Cited by 57
Stability of steady hand force production explored across spaces and methods of analysis
de Freitas, P. B., de Freitas, S. M. S. F., Lewis, M. M., Huang, X., & Latash, M. L. (2018) · Experimental Brain Research · doi:10.1007/s00221-018-5238-y · Cited by 57
Radar Recorded Child Vital Sign Public Dataset and Deep Learning-Based Age Group Classification Framework for Vehicular Application
Yoo, S., Ahmed, S., Kang, S. M., Hwang, D., Lee, J., Son, J., & Cho, S. H. (2021) · Sensors · doi:10.3390/s21072412 · Cited by 62
“A previous study [30] reported that an ICC between 0.”
Method
Calibrating Pedestrians' Trust in Automated Vehicles
Faas, S. M., Kraus, J., Schoenhals, A., & Baumann, M. R. K. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445738 · Cited by 63
A meta-analysis of Libet-style experiments
Braun, M. N., Wessler, J., & Friese, M. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.06.018 · Cited by 63
“Interrater reliability for the study coding was high by common standards (Cicchetti, 1994), κ = 0.”
Background
Structural and functional connectivity reconstruction with CATO - A Connectivity Analysis TOolbox
de Lange, S. C., Helwegen, K., & van den Heuvel, M. P. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.120108 · Cited by 54
Psychosocial Functioning and Health-Related Quality of Life Associated with Posttraumatic Stress Disorder in Male and Female Iraq and Afghanistan War Veterans: The VALOR Registry
Fang, S. C., Schnurr, P. P., Kulish, A. L., Holowka, D. W., Marx, B. P., Keane, T. M., & Rosen, R. C. (2015) · Journal of Women s Health · doi:10.1089/jwh.2014.5096 · Cited by 57
Development and psychometric properties of the OCD Family Functioning (OFF) Scale.
Stewart, S. E., Hu, Y.-P., Hezel, D. M., Proujansky, R., Lamstein, A., Walsh, C., Ben-Joseph, E. P., Gironda, C. M., Jenike, M. A., GELLER, D. A., et al. (2011) · Journal of Family Psychology · doi:10.1037/a0023735 · Cited by 57
Reliability of use, abuse, and dependence of four types of inhalants in adolescents and young adults
Ridenour, T. A., Bray, B. C., & Cottler, L. B. (2007) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2007.05.004 · Cited by 57
Foreign Language Reading Anxiety in a Jordanian EFL Context: A Qualitative Study
Al-Shboul, M. M., Ahmad, I. S., Nordin, M. S., & Rahman, Z. A. (2013) · English Language Teaching · doi:10.5539/elt.v6n6p38 · Cited by 64
Validation of a smartphone-based measurement tool for the quantification of level walking
Furrer, M., Bichsel, L., Niederer, M., Baur, H., & Schmid, S. (2015) · Gait & Posture · doi:10.1016/j.gaitpost.2015.06.003 · Cited by 55
Narrative abilities in early successive bilingual Slovak–English children: A cross-language comparison
Kapalková, S., Polišenská, K., Marková, L., & Fenton, J. (2015) · Applied Psycholinguistics · doi:10.1017/s0142716415000454 · Cited by 42
Psychometric properties of the Trauma and Distress Scale, TADS, in an adult community sample in Finland
Salokangas, R. K. R., Schultze‐Lutter, F., Patterson, P. H., von Reventlow, H. G., Heinimaa, M., From, T., Luutonen, S. H., Hankala, J., Kotimäki, M., & Tuominen, L. J. (2016) · European Journal of Psychotraumatology · doi:10.3402/ejpt.v7.30062 · Cited by 57
Pilot Randomized Controlled Trial of Omega-3 and Individual–Family Psychoeducational Psychotherapy for Children and Adolescents With Depression
Fristad, M. A., Vesco, A. T., Young, A. S., Healy, K. Z., Nader, E. S., Gardner, W. P., Seidenfeld, A. M., Wolfson, H. L., & Arnold, L. E. (2016) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2016.1233500 · Cited by 61
Test-Retest Reliability and Agreement Between In-Person and Video Assessment of Facial Mimetic Function Using the eFACE Facial Grading System
Banks, C. A., Jowett, N., & Hadlock, T. A. (2016) · JAMA Facial Plastic Surgery · doi:10.1001/jamafacial.2016.1620 · Cited by 57
Effects of robots’ intonation and bodily appearance on robot-mediated communicative treatment outcomes for children with autism spectrum disorder
van Straten, C. L., Smeekens, I., Barakova, E. I., Glennon, J. C., Buitelaar, J. K., & Chen, A. (2017) · Personal and Ubiquitous Computing · doi:10.1007/s00779-017-1060-y · Cited by 57
Sexual Offender Treatment Effectiveness Within Cognitive-Behavioral Programs: A Meta-Analytic Investigation of General, Sexual, and Violent Recidivism
Harrison, J. L., O’Toole, S. K., Ammen, S., Ahlmeyer, S., Harrell, S. N., & Hernandez, J. L. (2020) · Psychiatry Psychology and Law · doi:10.1080/13218719.2018.1485526 · Cited by 57
“Cicchetti (1994) defines interrater concordance rates with the following ranges: (1) poor agreement is .40, (2) fair agreement is .41 to .59, (3) good agreement is .60 to .74 and (4) excellent agreement is .75 to 1.00.”
BackgroundInfluential
Simple Procedures to Estimate Chance Agreement and Kappa for the Interrater Reliability of Response Segments Using the Rorschach Comprehensive System
Meyer, G. J. (1999) · Journal of Personality Assessment · doi:10.1207/s15327752jp720209 · Cited by 57
Reliability and validity of the Addiction Severity Index among outpatients with severe mental illness
Carey, K., Cocco, K., & Correia, C. (1997) · Psychological Assessment · doi:10.1037/1040-3590.9.4.422 · Cited by 59
Outcomes of the BEST in CLASS Intervention on Teachers' Use of Effective Practices, Self-Efficacy, and Classroom Quality
Conroy, M. A., Sutherland, K. S., Algina, J. J., Ladwig, C. N., Werch, B. L., Martínez, J. R., Jessee, G., & Gyure, M. E. (2019) · School Psychology Review · doi:10.17105/spr-2018-0003.v48-1 · Cited by 56
Empirical support for interrater reliability of Rorschach Comprehensive System coding
Viglione, D. J., & Taylor, N. (2002) · Journal of Clinical Psychology · doi:10.1002/jclp.10121 · Cited by 56
The route to change: Within-session predictors of change plan completion in a motivational interview
Magill, M., Apodaca, T. R., Barnett, N. P., & Monti, P. M. (2010) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2009.12.001 · Cited by 56
From counselor skill to decreased marijuana use: Does change talk matter?
Barnett, E. Y., Moyers, T. B., Sussman, S. Y., Smith, C. A., Rohrbach, L. A., Sun, P., & Spruijt‐Metz, D. (2013) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2013.11.004 · Cited by 55
Modelling job satisfaction in low-level jobs: Differences between full-time and part-time employees in the Greek retail sector
Giannikis, S. K., & Mihail, D. M. (2011) · European Management Journal · doi:10.1016/j.emj.2010.12.002 · Cited by 56
Development of the Therapist Empathy Scale
Decker, S. E., Nich, C., Carroll, K. M., & Martino, S. (2013) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465813000039 · Cited by 63
Erste Ergebnisse zu Reliabilität und Validität der OPD-2 Strukturachse
Benecke, C., Koschier, A., Peham, D., Bock, A., Dahlbender, R. W., Biebl, W., & Doering, S. (2009) · Zeitschrift für psychosomatische Medizin und Psychotherapie · doi:10.13109/zptm.2009.55.1.84 · Cited by 56

Authors: Cicchetti, D. V.
Affiliations: Veterans Health Administration (US)
Corresponding author: Cicchetti, Domenic V.
Venue: Psychological Assessment
Publisher: American Psychological Association (APA)
Published: 1994-12
Volume: 6
Issue: 4
Pages: 284-290
ISSN: 1040-3590 (ISSN-L)
1939-134X
DOI: 10.1037/1040-3590.6.4.284
OpenAlex: W2063085086
Cited by: 9,349
References: 43
Citations by year: 2026: 538 · 2025: 654 · 2024: 693 · 2023: 753 · 2022: 842 · 2021: 886 · 2020: 882 · 2019: 825 · 2018: 786 · 2017: 611 · 2016: 355 · 2015: 308 · 2014: 209 · 2013: 152 · 2012: 139
FWCI: 17.61
Type: journal article
Language: en
Open access: closed
Locations: Psychological Assessment (publishedVersion)
Topics: Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
Keywords: test selection, standardized assessment, test standardization, test norming, test reliability, test validity, psychometrics, test development, cognitive assessment, personality assessment, adaptive behavior, children and adolescents, adults, older adults, disability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks