Cited by 9,349Psychological Testing and AssessmentPsychometric Methodologies and TestingHistorical and Modern Theater Studies

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Cicchetti, Domenic V.·1994·Psychological Assessment

DOI 10.1037/1040-3590.6.4.284

Open this paper in CoChat — free account

Abstract

In the context of the development of prototypic assessment instruments in the areas of cognition, personality, and adaptive functioning, the issues of standardization, norming procedures, and the important psychometrics of test reliability and validity are evaluated critically. Criteria, guidelines, and simple rules of thumb are provided to assist the clinician faced with the challenge of choosing an appropriate test instrument for a given psychological assessment. Clinicians are often faced with the critical challenge of choosing the most appropriate available test instrument for a given psychological assessment of a child, adolescent, or adult of a particular age, gender, and class of disability. It is the purpose of this report to provide some criteria, guidelines, or simple rules of thumb to aid in this complex scientific decision. As such, it draws upon my experience with issues of test development, standardization, norming procedures, and important psychometrics, namely, test reliability and validity. As I and my colleagues noted in an earlier publication, the major areas of psychological functioning, in the normal development of infants, children, adolescents, adults, and elderly people, include cognitive, academic, personality, and adaptive behaviors (Sparrow, Fletcher, & Cicchetti, 1985). As such, the major examples or applications discussed in this article derive primarily, although not exclusively, from these several areas of human functioning.

Integrity signals

Registry

Crossref · 10.1037/1040-3590.6.4.284

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Psychometric theory (2nd ed.).
Sitgreaves, R. (1979) · Contemporary Psychology · doi:10.1037/018882 · Cited by 14,384
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
Cooper, A. M., & Michels, R. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.1.128 · Cited by 7,419
Manual for the Wechsler Adult Intelligence Scale.
Wechsler, D. (1955) · Psychological Corp. eBooks · Cited by 4,941
Essentials of Psychological Testing
Rosner, B., & Cronbach, L. J. (1960) · The American Journal of Psychology · doi:10.2307/1419921 · Cited by 4,524
Statistical Methods for Rates and Proportions, 2nd ed
GROVE, W. A. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.12.1644-a · Cited by 3,756
The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354

Show all 43 references

Sorted by citations

Items 501–600 of 1,086

Advanced virtual monoenergetic images: improving the contrast of dual-energy CT pulmonary angiography
Meier, A., Wurnig, M. C., Desbiolles, L., Leschka, S., Frauenfelder, T., & Alkadhi, H. (2015) · Clinical Radiology · doi:10.1016/j.crad.2015.06.094 · Cited by 86
Adherence to evidence-based guidelines among diabetes self-management apps
Breland, J. Y., Yeh, V. M., & Yu, J. (2013) · Translational Behavioral Medicine · doi:10.1007/s13142-013-0205-4 · Cited by 85
Lighting up the office: The effect of wall luminance on room appraisal, office workers' performance, and subjective alertness
de Vries, A., Souman, J. L., de Ruyter, B., Heynderickx, I. E. J., & de Kort, Y. A. W. (2018) · Building and Environment · doi:10.1016/j.buildenv.2018.06.046 · Cited by 86
Comparing internal and external lead users as sources of innovation
Schweisfurth, T. G. (2016) · Research Policy · doi:10.1016/j.respol.2016.11.002 · Cited by 85
Time and Space in Strategy Discourse: Implications for Intertemporal Choice
Crilly, D. (2017) · Strategic Management Journal · doi:10.1002/smj.2687 · Cited by 88
Resting-state EEG delta power is associated with psychological pain in adults with a history of depression
Meerwijk, E. L., Ford, J. M., & Weiss, S. J. (2015) · Biological Psychology · doi:10.1016/j.biopsycho.2015.01.003 · Cited by 84
Reliability, Validity, and Classification Accuracy of the DSM-5 Diagnostic Criteria for Gambling Disorder and Comparison to DSM-IV
Stinchfield, R. D., McCready, J., Turner, N. E., Jiménez‐Múrcia, S., Petry, N. M., Grant, J. E., Welte, J. W., Chapman, H. A., & Winters, K. C. (2015) · Journal of Gambling Studies · doi:10.1007/s10899-015-9573-7 · Cited by 84
Examining teachers' classroom management profiles: Incorporating a focus on culturally responsive practice
Gaias, L. M., Johnson, S. L., Bottiani, J. H., Debnam, K. J., & Bradshaw, C. P. (2019) · Journal of School Psychology · doi:10.1016/j.jsp.2019.07.017 · Cited by 111
“Intraclass correlations (ICC) on the six dimensions across the three ASSIST observations ranged from .72 to .81, with an average of .75, indicating relatively little variability across the three cycles (Cicchetti, 1994).”
Background
Envisioning innovation: Does visionary leadership engender team innovative performance through goal alignment?
Mascareño, J., Rietzschel, E. F., & Wisse, B. M. (2019) · Creativity and Innovation Management · doi:10.1111/caim.12341 · Cited by 89
“ICC3 indicated a good level of agreement (ICC3 = .77; Cicchetti, 1994).”
Towards clinical application: Repetitive sensor position re-calibration for improved reliability of gait parameters
Hamacher, D., Hamacher, D., Taylor, W. R., Singh, N. B., & Schega, L. (2014) · Gait & Posture · doi:10.1016/j.gaitpost.2014.01.020 · Cited by 85
Short-term annoyance reactions to stationary and time-varying wind turbine and road traffic noise: A laboratory study
Schäffer, B., Schlittmeier, S. J., Pieren, R., Heutschi, K., Brink, M., Graf, R., & Hellbrück, J. (2016) · The Journal of the Acoustical Society of America · doi:10.1121/1.4949566 · Cited by 83
The order of disorder: Deconstructing visual disorder and its effect on rule-breaking.
Kotabe, H., Kardan, O., & Berman, M. G. (2016) · Journal of Experimental Psychology General · doi:10.1037/xge0000240 · Cited by 87
Reliability of the Modified Ashworth Scale and Modified Tardieu Scale in patients with spinal cord injuries
Akpınar, P., Atıcı, A., Özkan, F. Ü., Aktaş, İ., Külcü, D. G., Sarı, A., & Durmus, B. (2017) · Spinal Cord · doi:10.1038/sc.2017.48 · Cited by 83
The Structural Relationship among Digital Literacy, Learning Strategies, and Core Competencies among South Korean College Students
Kim, K. T. (2019) · Educational Sciences Theory & Practice · doi:10.12738/estp.2019.2.001 · Cited by 112
Creative Problem Solving in Primary Education: Exploring the Role of Fact Finding, Problem Finding, and Solution Finding across Tasks
van Hooijdonk, M., Mainhard, T., Kroesbergen, E. H., & van Tartwijk, J. (2020) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2020.100665 · Cited by 83
“Originality was rated with a rating scheme by the two raters (ICC = .83, indicating excellent agreement; Cicchetti, 1994) on a five-point Likert scale.”
MethodInfluential
Accuracy of Three Commercial Wearable Devices for Sleep Tracking in Healthy Adults
Robbins, R., Weaver, M. D., Sullivan, J. P., Quan, S. F., Gilmore, K., Shaw, S., Benz, A., Qadri, S., Barger, L. K., Czeisler, C. A., et al. (2024) · Sensors · doi:10.3390/s24206532 · Cited by 83
“Concordance is deemed poor if the ICC is below 0.40, fair if between 0.40 and 0.59, good if between 0.60 and 0.74, and excellent if above 0.75 [23].”
BackgroundInfluential
Relationship between Self‐Report and Proxy Ratings on Assessed Personal Quality of Life‐Related Outcomes
Claes, C., Vandevelde, S., Hove, G. V., van Loon, J. H. M., Verschelden, G., & Schalock, R. L. (2012) · Journal of Policy and Practice in Intellectual Disabilities · doi:10.1111/j.1741-1130.2012.00353.x · Cited by 84
Semantic Response Consistency and Protocol Validity in Structured Personality Assessment: The Case of the NEO-PI-R
Kurtz, J. E., & Parrish, C. L. (2001) · Journal of Personality Assessment · doi:10.1207/s15327752jpa7602_12 · Cited by 83
Measuring the social interactions of people with traumatic brain injury and their communication partners: The adapted Kagan scales
Togher, L., Power, E., Tate, R. L., McDonald, S., & Rietdijk, R. (2010) · Aphasiology · doi:10.1080/02687030903422478 · Cited by 83
Reliability and Validity of the Beck Depression and Anxiety Inventories in Caucasian Americans and Latinos
Contreras, S., Fernandez, S., Malcarne, V., Ingram, R., & Vaccarino, V. (2004) · Hispanic Journal of Behavioral Sciences · doi:10.1177/0739986304269164 · Cited by 94
Validierung einer deutschsprachigen 16-Item-Version des Inventars der Persönlichkeitsorganisation (IPO-16)
Zimmermann, J., Benecke, C., Hörz, S., Rentrop, M., Peham, D., Bock, A., Wallner, T., Schauenburg, H., Frommer, J., Huber, D., et al. (2013) · Diagnostica · doi:10.1026/0012-1924/a000076 · Cited by 82
Neural responses to functional and experiential ad appeals: Explaining ad effectiveness
Couwenberg, L. E., Boksem, M. A. S., Dietvorst, R. C., Worm, L., Verbeke, W. J. M. I., & Smidts, A. (2016) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2016.10.005 · Cited by 87
Magnetic Resonance Imaging–Based Grading of Cartilaginous Bone Tumors
Fritz, B., Müller, D. A., Sutter, R., Wurnig, M. C., Wagner, M. W., Pfirrmann, C. W. A., & Fischer, M. A. (2018) · Investigative Radiology · doi:10.1097/rli.0000000000000486 · Cited by 82
Neutering increases the risk of obesity in male dogs but not in bitches — A cross-sectional study of dog- and owner-related risk factors for obesity in Danish companion dogs
Bjørnvad, C. R., Gloor, S., Johansen, S. S., Sandøe, P., & Lund, T. B. (2019) · Preventive Veterinary Medicine · doi:10.1016/j.prevetmed.2019.104730 · Cited by 82
“Depending on the source, these coefficients are considered excellent (Cicchetti, 1994) or good (Koo and Li, 2016).”
Background
Reproducibility assessment of neuromelanin-sensitive magnetic resonance imaging protocols for region-of-interest and voxelwise analyses
Wengler, K., He, X., Abi‐Dargham, A., & Horga, G. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.116457 · Cited by 82
“The maximum ICC is 1, indicating perfect reliability, ICC over 0.75 indicates “excellent” reliability, ICC between 0.75 and 0.6 indicates “good” reliability, ICC between 0.6 and 0.4 indicates “fair” reliability, and ICC under 0.4 indicates “poor” reliability (Cicchetti, 1994).”
Influential
The Autism Biomarkers Consortium for Clinical Trials: Initial Evaluation of a Battery of Candidate EEG Biomarkers
Webb, S. J., Naples, A. J., Levin, A. R., Hellemann, G., Borland, H., Benton, J., Carlos, C., McAllister, T., Santhosh, M., Seow, H. Y., et al. (2022) · American Journal of Psychiatry · doi:10.1176/appi.ajp.21050485 · Cited by 82
Pathological video game playing in Spanish and British adolescents: Towards the exploration of Internet Gaming Disorder symptomatology
López-Fernández, O., Honrubia-Serrano, M. L., Baguley, T. S., & Griffiths, M. D. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.10.011 · Cited by 82
Validation of a New Measure of Prospective Memory: The Royal Prince Alfred Prospective Memory Test
Radford, K. A., Lah, S. S., Say, M. J., & Miller, L. A. (2010) · The Clinical Neuropsychologist · doi:10.1080/13854046.2010.529463 · Cited by 82
Anorexia nervosa and bulimia nervosa: A meta-analysis of executive functioning
Hirst, R. B., Beard, C. L., Colby, K. A., Quittner, Z., Mills, B. M., & Lavender, J. M. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.08.011 · Cited by 81
Test–retest reliability of five frequently used executive tasks in healthy adults
Soveri, A., Lehtonen, M., Karlsson, L. C., Lukasik, K., Antfolk, J., & Laine, M. (2018) · Applied Neuropsychology: Adult · doi:10.1080/23279095.2016.1263795 · Cited by 81
Clinician acquisition and retention of Motivational Interviewing skills: a two-and-a-half-year exploratory study
Forsberg, L., Forsberg, L. G., Lindqvist, H., & Helgason, Á. R. (2010) · Substance Abuse Treatment Prevention and Policy · doi:10.1186/1747-597x-5-8 · Cited by 81
Predictive validity of the Classroom Strategies Scale—Observer Form on statewide testing scores: An initial investigation.
Reddy, L. A., Fabiano, G. A., Dudek, C. M., & Hsu, L. M. (2013) · School Psychology Quarterly · doi:10.1037/spq0000041 · Cited by 81
Multi-modality 3D mandibular resection planning in head and neck cancer using CT and MRI data fusion: A clinical series
Kraeima, J., Dorgelo, B., Gülbitti, H. A., Steenbakkers, R. J. H. M., Schepman, K., Roodenburg, J. L. N., Spijkervet, F. K. L., Schepers, R. H., & Witjes, M. J. H. (2018) · Oral Oncology · doi:10.1016/j.oraloncology.2018.03.013 · Cited by 81
Chronic Toxoplasma infection is associated with distinct alterations in the synaptic protein composition
Lang, D. G., Schott, B. H., van Ham, M., Morton, L., Kulikovskaja, L., Herrera‐Molina, R., Pielot, R., Klawonn, F., Montag, D., Jänsch, L., et al. (2018) · Journal of Neuroinflammation · doi:10.1186/s12974-018-1242-1 · Cited by 77
Increasing quantity without compromising quality: How managerial framing affects intrapreneurship
Rigtering, C., Weitzel, U., & Muehlfeld, K. S. (2018) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2018.11.002 · Cited by 84
Food safety knowledge, attitudes and practices of food handlers: A cross-sectional study in school kitchens in Espírito Santo, Brazil
da Vitória, A. G., Oliveira, J. D. S. C., Pereira, L. C. D. A., de Faria, C. P., & José, J. F. B. D. S. (2021) · BMC Public Health · doi:10.1186/s12889-021-10282-1 · Cited by 81
Personality and emotion
Reisenzein, R., & Weber, H. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511596544.007 · Cited by 84
The clinical utility of the Maslach Burnout Inventory in a clinical population.
Kleijweg, J. H. M., Verbraak, M. J. P. M., & van Dijk, M. K. (2013) · Psychological Assessment · doi:10.1037/a0031334 · Cited by 82
The Effectiveness and Cost of Clinical Supervision for Motivational Interviewing: A Randomized Controlled Trial
Martino, S., Paris, M., Anez, L. M., Nich, C., Canning‐Ball, M., Hunkele, K. A., Olmstead, T. A., & Carroll, K. M. (2016) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2016.04.005 · Cited by 81
A Meta-Analysis of Viewing Time Measures of Sexual Interest in Children
Schmidt, A. F., Babchishin, K. M., & Lehmann, R. (2016) · Archives of Sexual Behavior · doi:10.1007/s10508-016-0806-3 · Cited by 81
Measuring Shared Decision Making
Sepucha, K., & Scholl, I. (2014) · Circulation Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.113.000350 · Cited by 80
The objectivity of the Autism Diagnostic Observation Schedule (ADOS) in naturalistic clinical settings
Zander, E., Willfors, C., Berggren, S., Olsson, N. C., Coco, C., Elmund, A., Moretti, Å. H., Holm, A., Jifält, I., Kosieradzki, R., et al. (2015) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-015-0793-2 · Cited by 88
Core Items for a Standardized Resource Use Measure: Expert Delphi Consensus Survey
Thorn, J. C., BROOKES, S. T., Ridyard, C. H., Riley, R. A., Hughes, D. A., Wordsworth, S., Noble, S., Thornton, G., & Hollingworth, W. (2017) · Value in Health · doi:10.1016/j.jval.2017.06.011 · Cited by 79
The composition and initial evaluation of a grimace scale in ferrets after surgical implantation of a telemetry probe
Reijgwart, M. L., Schoemaker, N. J., Pascuzzo, R., Leach, M. C., Stodel, M., de Nies, L., Hendriksen, C. F. M., van der Meer, M., Vinke, C. M., & van Zeeland, Y. R. A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0187986 · Cited by 80
The comprehensive anatomical spinal osteotomy and anterior column realignment classification
Uribe, J. S., Schwab, F. J., Mundis, G. M., Xu, D. S., Januszewski, J., Kanter, A. S., Okonkwo, D. O., Hu, S. S., Deviren, V., Eastlack, R. K., et al. (2018) · Journal of Neurosurgery Spine · doi:10.3171/2018.4.spine171206 · Cited by 80
The Work and Social Adjustment Scale for Youth: A Measure for Assessing Youth Psychosocial Impairment Regardless of Mental Health Status
Reyes, A. D. L., Makol, B. A., Racz, S. J., Youngstrom, E. A., Lerner, M. D., & Keeley, L. M. (2018) · Journal of Child and Family Studies · doi:10.1007/s10826-018-1238-6 · Cited by 80
Examining the influence of active ingredients of motivational interviewing on client change talk
Hurlocker, M. C., O'Sickey, A. J., Houck, J. M., & Moyers, T. B. (2018) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2018.10.001 · Cited by 81
Neurodevelopmental delay: Case definition & guidelines for data collection, analysis, and presentation of immunization safety data
Villagomez, A. N., Muñoz, F. M., Peterson, R. L., Colbert, A. M., Gladstone, M., MacDonald, B., Wilson, R., Fairlie, L., Gerner, G. J., Patterson, J. K., et al. (2019) · Vaccine · doi:10.1016/j.vaccine.2019.05.027 · Cited by 80
“General guidelines [143] suggest that for measures of internal consistency (e.”
Background
Building a Composite Indicator to Measure Environmental Sustainability Using Alternative Weighting Methods
Gómez-Limón, J. A., Arriaza, M., & Guerrero-Baena, M. D. (2020) · Sustainability · doi:10.3390/su12114398 · Cited by 88
“To interpret ICC, Cicchetti [63] gives some guidelines: <0.40, 0.40–0.59, 0.60–0.74, and >0.74 for poor, fair, good and excellent reliability, respectively.”
MethodInfluential
Cross-sectoral inter-rater reliability of the clinical frailty scale – a Danish translation and validation study
Nissen, S. K., Fournaise, A., Lauridsen, J. T., Ryg, J., Nickel, C. H., Gudex, C. M., Brabrand, M., & Andersen‐Ranberg, K. (2020) · BMC Geriatrics · doi:10.1186/s12877-020-01850-y · Cited by 86
Development and validation of the Kilifi Stigma Scale for Epilepsy in Kenya
Mbuba, C. K., Abubakar, A. A., Odermatt, P., Newton, C. R. J. C., & Carter, J. A. (2012) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2012.02.019 · Cited by 80
Randomized trial of training and supervision in motivational interviewing with adolescent drug treatment practitioners
Mitcheson, L., Butor-Bhavsar, K., & McCambridge, J. (2009) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2008.11.001 · Cited by 80
Validity and Reliability of Visual Analog Scaling for Assessment of Hypernasality and Audible Nasal Emission in Children with Repaired Cleft Palate
Baylis, A. L., Chapman, K., & Whitehill, T. L. (2014) · The Cleft Palate-Craniofacial Journal · doi:10.1597/14-040 · Cited by 86
Behavior of the Lumbar Multifidus During Lower Extremity Movements in People with Recurrent Low Back Pain During Symptom Remission
MacDonald, D. A., Dawson, A. P., & Hodges, P. W. (2011) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2011.3410 · Cited by 80
Does mindfulness meditation increase empathy? An experiment
Ridderinkhof, A., de Bruin, E. I., Brummelman, E., & Bögels, S. M. (2017) · Self and Identity · doi:10.1080/15298868.2016.1269667 · Cited by 87
A Novel Severity Assessment Scoring System for Hidradenitis Suppurativa
Hessam, S., Scholl, L., Sand, M. S., Schmitz, L., Reitenbach, S., & Bechara, F. G. (2018) · JAMA Dermatology · doi:10.1001/jamadermatol.2017.5890 · Cited by 80
Internal and Temporal Reliability Estimates for Informant Ratings of Personality Using the NEO PI-R and IAS
Kurtz, J. E., Lee, P. A., & Sherker, J. L. (1999) · Assessment · doi:10.1177/107319119900600201 · Cited by 79
Sex estimation using computed tomography of the mandible
Tunis, T. S., Sarig, R., Cohen, H., Medlej, B., Peled, N., & May, H. (2017) · International Journal of Legal Medicine · doi:10.1007/s00414-017-1554-1 · Cited by 79
Investigating the validity of the DN4 in a consecutive population of patients with chronic pain
Timmerman, H., Steegers, M. A. H., Huygen, F. J. P. M., Goeman, J. J., van Dasselaar, N. T., Schenkels, M. J., Wilder‐Smith, O. H. G., Wolff, A. P., & Vissers, K. C. P. (2017) · PLoS ONE · doi:10.1371/journal.pone.0187961 · Cited by 79
Emotion regulation, conflict resolution, and spillover on subsequent family functioning.
Low, R. S. T., Overall, N. C., Cross, E. J., & Henderson, A. M. E. (2018) · Emotion · doi:10.1037/emo0000519 · Cited by 79
Effects of mental health interventions with Asian Americans: a review and meta-analysis
Huey, S. J., & Tilley, J. L. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000346 · Cited by 79
Polish Version of the Resilience Scale (RS-14): A Validity and Reliability Study in Three Samples
Surżykiewicz, J., Konaszewski, K., & Wagnild, G. M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02762 · Cited by 93
Ultrafast dynamic contrast-enhanced breast MRI may generate prognostic imaging markers of breast cancer
Onishi, N., Sadinski, M., Hughes, M. C., Ko, E. S., Gibbs, P., Gallagher, K. M., Fung, M., Hunt, T. M., Martinez, D. F., Shukla‐Dave, A., et al. (2020) · Breast Cancer Research · doi:10.1186/s13058-020-01292-9 · Cited by 79
What do we do when we analyse the temporal aspects of computer-supported collaborative learning? A systematic literature review
Lämsä, J., Hämäläinen, R., Koskinen, P., Viiri, J., & Lampi, E. (2021) · Educational Research Review · doi:10.1016/j.edurev.2021.100387 · Cited by 110
A Pilot Randomized Controlled Trial of Virtual Reality Distraction to Reduce Procedural Pain During Subcutaneous Port Access in Children and Adolescents With Cancer
Hundert, A. S., Birnie, K. A., Abla, O., Positano, K., Cassiani, C., Lloyd, S., Tiessen, P. H., Lalloo, C., Jibb, L., & Stinson, J. (2021) · Clinical Journal of Pain · doi:10.1097/ajp.0000000000001017 · Cited by 85
Communication of Diagnostic Uncertainty in Primary Care and Its Impact on Patient Experience: an Integrative Systematic Review
Dahm, M. R., Cattanach, W., Williams, M., Basseal, J. M., Gleason, K. T., & Crock, C. (2022) · Journal of General Internal Medicine · doi:10.1007/s11606-022-07768-y · Cited by 79
From green advertising to sustainable behavior: a systematic literature review through the lens of value-belief-norm framework
Lima, P. A. B., Falguera, F. P. S., da Silva, H. M. R., Maciel, S., Mariano, E. B., & Elgaaïed‐Gambier, L. (2023) · International Journal of Advertising · doi:10.1080/02650487.2023.2199668 · Cited by 88
“Since a coefficient of 0.60 or higher is generally considered to be a strong level of agreement (Cicchetti 1994; McHugh 2012), these results are acceptable.”
ResultInfluential
Cognitive profile analysis: A shared professional myth.
Watkins, M. W. (2000) · School Psychology Quarterly · doi:10.1037/h0088802 · Cited by 82
Assessing fidelity in individual and family therapy for adolescent substance abuse
Hogue, A., Dauber, S., Chinchilla, P., Fried, A., Henderson, C., Inclan, J., Reiner, R. H., & Liddle, H. A. (2008) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2007.09.002 · Cited by 78
Interoception is Impaired in Children, But Not Adults, with Autism Spectrum Disorder
Nicholson, T., Williams, D., Carpenter, K., & Kallitsounaki, A. (2019) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-019-04079-w · Cited by 78
Brief Report of Preliminary Outcomes of an Emotion Regulation Intervention for Children with Autism Spectrum Disorder
Thomson, K. M., Riosa, P. B., & Weiss, J. A. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-015-2446-1 · Cited by 90
Development of the Motivational Interviewing Supervision and Training Scale.
Madson, M. B., Campbell, T. C., Barrett, D. E., Brondino, M. J., & Melchert, T. P. (2005) · Psychology of Addictive Behaviors · doi:10.1037/0893-164x.19.3.303 · Cited by 78
Are we Baby Boomers, Gen X and Gen Y? A qualitative inquiry into generation cohorts in Malaysia
Ting, H., Lim, T., de Run, E. C., Koh, H., & Murni, S. (2017) · Kasetsart Journal of Social Sciences · doi:10.1016/j.kjss.2017.06.004 · Cited by 77
Association between irritability and suicide-related outcomes across the life-course. Systematic review of both community and clinical studies
Orri, M., Perret, L. C., Turecki, G., & Geoffroy, M. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.07.010 · Cited by 79
How to Select Balance Measures Sensitive to Parkinson’s Disease from Body-Worn Inertial Sensors—Separating the Trees from the Forest
Hasegawa, N., Shah, V. V., Carlson‐Kuhta, P., Nutt, J. G., Horak, F. B., & Mancini, M. (2019) · Sensors · doi:10.3390/s19153320 · Cited by 77
“The ICC represents the test-retest reliability estimates, and the MDC represents the minimum amount of change that must take place for the difference to be considered “real” rather than measurement error [58,72]; thus, these values are very useful for clinical assessment.”
Method
Triage accuracy and causes of mistriage using the Korean Triage and Acuity Scale
Moon, S.-H., Shim, J. L., Park, K.-S., & Park, C.-S. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216972 · Cited by 77
A Deep Learning Approach for Meibomian Gland Atrophy Evaluation in Meibography Images
Wang, J., Yeh, T. N., Chakraborty, R., Yu, S. X., & Lin, M. C. (2019) · Translational Vision Science & Technology · doi:10.1167/tvst.8.6.37 · Cited by 78
Reliability of the DIERS Formetric 4D Spine Shape Parameters in Adults without Postural Deformities
Degenhardt, B. F., Starks, Z., & Bhatia, S. (2020) · BioMed Research International · doi:10.1155/2020/1796247 · Cited by 77
“ICC less than 0.40 indicated poor reliability, 0.4–0.59 indicated fair reliability, 0.6–0.74 indicated good reliability, and 0.75–1.0 indicated excellent reliability [23].”
Influential
Development and Validation of a Wearable Inertial Sensors-Based Automated System for Assessing Work-Related Musculoskeletal Disorders in the Workspace
Huang, C., Kim, W., Zhang, Y., & Xiong, S. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17176050 · Cited by 77
“The interpretatio of ICC follows previous guidelines [57]: ICC < 0.”
MethodInfluential
Evidence-Based Assessment of Compulsive Skin Picking, Chronic Tic Disorders and Trichotillomania in Children
McGuire, J., Kugler, B. B., Park, J. M., Horng, B., Lewin, A., Murphy, T., & Storch, E. (2012) · Child Psychiatry and Human Development · doi:10.1007/s10578-012-0300-7
Psychological Measures As Predictors of Military Training Performance
Hartmann, E., Sunde, T., Kristensen, W., & Martinussen, M. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_17 · Cited by 82
Preoperative posterior tilt of at least 20° increased the risk of fixation failure in Garden-I and -II femoral neck fractures
Dolatowski, F. C., Adampour, M., Frihagen, F., Stavem, K., Utvåg, S. E., & Hoelsbrekken, S. E. (2016) · Acta Orthopaedica · doi:10.3109/17453674.2016.1155253 · Cited by 77
Acute skeletal muscle wasting and relation to physical function in patients requiring extracorporeal membrane oxygenation (ECMO)
Hayes, K., Holland, A. E., Pellegrino, V. A., Mathur, S., & Hodgson, C. L. (2018) · Journal of Critical Care · doi:10.1016/j.jcrc.2018.08.002 · Cited by 77
Block observations of neighbourhood physical disorder are associated with neighbourhood crime, firearm injuries and deaths, and teen births
Wei, E. H., Hipwell, A. E., Pardini, D. A., Beyers, J. M., & Loeber, R. (2005) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2004.027060 · Cited by 77
Accounting for diversity in suicide research: Sampling and sample reporting practices in the United States
Cha, C. B., Tezanos, K. M., Peros, O. M., Ng, M. Y., Ribeiro, J. D., Nock, M. K., & Franklin, J. C. (2018) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12344 · Cited by 77
The field validity of Static-99/R sex offender risk assessment tool in California.
Hanson, R. K., Lunetta, A., Phenix, A., Neeley, J., & Epperson, D. L. (2014) · Journal of Threat Assessment and Management · doi:10.1037/tam0000014 · Cited by 79
Acquiring research‐grade ERPs on a shoestring budget: A comparison of a modified Emotiv and commercial SynAmps EEG system
Barham, M. P., Clark, G. M., Hayden, M. J., Enticott, P. G., Conduit, R., & Lum, J. A. G. (2017) · Psychophysiology · doi:10.1111/psyp.12888 · Cited by 76
The acute effects of high-intensity interval training and moderate-intensity continuous exercise on declarative memory and inhibitory control
Kao, S., Drollette, E. S., Ritondale, J. P., Khan, N. A., & Hillman, C. H. (2018) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2018.05.011 · Cited by 80
Gaining Insight Into Human Nature: A Review of Literature Classroom Intervention Studies
Schrijvers, M., Janssen, T., Fialho, O., & Rijlaarsdam, G. (2019) · Review of Educational Research · doi:10.3102/0034654318812914 · Cited by 76
Nest Building Behavior as an Early Indicator of Behavioral Deficits in Mice
Neely, C. L. C., Pedemonte, K. A., Boggs, K. N., & Flinn, J. M. (2019) · Journal of Visualized Experiments · doi:10.3791/60139 · Cited by 76
Validation of the clinical frailty score (CFS) in French language
Abraham, P. S., Courvoisier, D. S., Annweiler, C., Lenoir, C., MILLIEN, T., DALMAZ, F., Flaatten, H. K., Moreno, R. P., Christensen, S., de Lange, D. W., et al. (2019) · BMC Geriatrics · doi:10.1186/s12877-019-1315-8 · Cited by 82
Day-to-Day Test-Retest Reliability of EEG Profiles in Children With Autism Spectrum Disorder and Typical Development
Levin, A. R., Naples, A. J., Scheffler, A. W., Webb, S. J., Shic, F., Sugar, C. A., Murias, M., Bernier, R., Chawarska, K., Dawson, G., et al. (2020) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2020.00021 · Cited by 76
“ICC values less than 0.40 are considered poor, between 0.40 and 0.59 fair, between 0.60 and 0.74 good, and between 0.75 and 1.00 excellent (Cicchetti, 1994).”
BackgroundInfluential
Comparing the effects of different methodological decisions on the error-related negativity and its association with behaviour and gender
Sandre, A., Banica, I., Riesel, A., Flake, J. K., Klawohn, J., & Weinberg, A. (2020) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2020.06.016 · Cited by 76
Age and environment-related differences in gait in healthy adults using wearables
Czech, M. D., Psaltos, D., Zhang, H., Adamusiak, T., Calicchio, M. L., Kelekar, A., Messere, A., Dijk, K. R. A. V., Ramos, V. F. M. L., Demanuele, C., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00334-y · Cited by 76
Adherence to Principles of Motivational Interviewing and Client Within-Session Behavior
Catley, D., Harris, K. J., Mayo, M. S., Hall, S., Okuyemi, K. S., Boardman, T., & Ahluwalia, J. S. (2005) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465805002432 · Cited by 76
Intimacy, Monogamy, and Condom Problems Drive Unprotected Sex Among Young Men in Serious Relationships with Other Men: A Mixed Methods Dyadic Study
Greene, G. J., Andrews, R., Kuper, L. E., & Mustanski, B. S. (2013) · Archives of Sexual Behavior · doi:10.1007/s10508-013-0210-1 · Cited by 84
Mental health screening in addiction, corrections and social service settings: Validating the MMS
Alexander, M. J., Haugland, G., Lin, S. P., Bertollo, D. N., & McCorry, F. A. (2008) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-007-9100-x · Cited by 71
Implementation of internet-delivered CBT for children with anxiety disorders in a rural area: A feasibility trial
Jolstedt, M., Ljótsson, B., Fredlander, S., Tedgård, T., Hallberg, A., Ekeljung, A., Högström, J., Mataix-Cols, D., Serlachius, E., & Vigerland, S. (2018) · Internet Interventions · doi:10.1016/j.invent.2017.11.003 · Cited by 75
Beyond the crisis: did the Ebola epidemic improve resilience of Liberia’s health system?
Ling, E. J., Larson, E., Macauley, R., Kodl, Y., VanDeBogert, B., Baawo, S., & Kruk, M. E. (2017) · Health Policy and Planning · doi:10.1093/heapol/czx109 · Cited by 81
Using otolith chronologies to understand long‐term trends and extrinsic drivers of growth in fisheries
Martino, J. C., Fowler, A. J., Doubleday, Z. A., Grammer, G. L., & Gillanders, B. M. (2019) · Ecosphere · doi:10.1002/ecs2.2553 · Cited by 80

Authors: Cicchetti, D. V.
Affiliations: Veterans Health Administration (US)
Corresponding author: Cicchetti, Domenic V.
Venue: Psychological Assessment
Publisher: American Psychological Association (APA)
Published: 1994-12
Volume: 6
Issue: 4
Pages: 284-290
ISSN: 1040-3590 (ISSN-L)
1939-134X
DOI: 10.1037/1040-3590.6.4.284
OpenAlex: W2063085086
Cited by: 9,349
References: 43
Citations by year: 2026: 538 · 2025: 654 · 2024: 693 · 2023: 753 · 2022: 842 · 2021: 886 · 2020: 882 · 2019: 825 · 2018: 786 · 2017: 611 · 2016: 355 · 2015: 308 · 2014: 209 · 2013: 152 · 2012: 139
FWCI: 17.61
Type: journal article
Language: en
Open access: closed
Locations: Psychological Assessment (publishedVersion)
Topics: Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
Keywords: test selection, standardized assessment, test standardization, test norming, test reliability, test validity, psychometrics, test development, cognitive assessment, personality assessment, adaptive behavior, children and adolescents, adults, older adults, disability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks