Cited by 9,349Psychological Testing and AssessmentPsychometric Methodologies and TestingHistorical and Modern Theater Studies

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Cicchetti, Domenic V.·1994·Psychological Assessment

DOI 10.1037/1040-3590.6.4.284

Open this paper in CoChat — free account

Abstract

In the context of the development of prototypic assessment instruments in the areas of cognition, personality, and adaptive functioning, the issues of standardization, norming procedures, and the important psychometrics of test reliability and validity are evaluated critically. Criteria, guidelines, and simple rules of thumb are provided to assist the clinician faced with the challenge of choosing an appropriate test instrument for a given psychological assessment. Clinicians are often faced with the critical challenge of choosing the most appropriate available test instrument for a given psychological assessment of a child, adolescent, or adult of a particular age, gender, and class of disability. It is the purpose of this report to provide some criteria, guidelines, or simple rules of thumb to aid in this complex scientific decision. As such, it draws upon my experience with issues of test development, standardization, norming procedures, and important psychometrics, namely, test reliability and validity. As I and my colleagues noted in an earlier publication, the major areas of psychological functioning, in the normal development of infants, children, adolescents, adults, and elderly people, include cognitive, academic, personality, and adaptive behaviors (Sparrow, Fletcher, & Cicchetti, 1985). As such, the major examples or applications discussed in this article derive primarily, although not exclusively, from these several areas of human functioning.

Integrity signals

Registry

Crossref · 10.1037/1040-3590.6.4.284

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Psychometric theory (2nd ed.).
Sitgreaves, R. (1979) · Contemporary Psychology · doi:10.1037/018882 · Cited by 14,384
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
Cooper, A. M., & Michels, R. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.1.128 · Cited by 7,419
Manual for the Wechsler Adult Intelligence Scale.
Wechsler, D. (1955) · Psychological Corp. eBooks · Cited by 4,941
Essentials of Psychological Testing
Rosner, B., & Cronbach, L. J. (1960) · The American Journal of Psychology · doi:10.2307/1419921 · Cited by 4,524
Statistical Methods for Rates and Proportions, 2nd ed
GROVE, W. A. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.12.1644-a · Cited by 3,756
The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354

Show all 43 references

Sorted by citations

Items 901–1,000 of 1,086

Long-term changes in time spent walking and subsequent cognitive and structural brain changes in older adults
Best, J. R., Rosano, C., Aizenstein, H. J., Tian, Q., Boudreau, R. M., Ayonayon, H. N., Satterfield, S., Simonsick, E. M., Studenski, S. A., Yaffe, K. S., et al. (2017) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2017.05.023 · Cited by 56
Paradoxical Thinking as a Conflict-Resolution Intervention: Comparison to Alternative Interventions and Examination of Psychological Mechanisms
Hameiri, B., Nabet, E., Bar‐Tal, D., & Halperin, E. (2017) · Personality and Social Psychology Bulletin · doi:10.1177/0146167217736048 · Cited by 56
The Creativity Challenge Game: An educational intervention for creativity enhancement with the integration of Information and Communication Technologies (ICTs)
Stolaki, A., & Economides, A. A. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.05.009 · Cited by 66
Limbic system structure volumes and associated neurocognitive functioning in former NFL players
Lepage, C., Muehlmann, M., Tripodis, Y., Hufschmidt, J., Stamm, J. M., Green, K., Wróbel, P., Schultz, V., Weir, I. R., Alosco, M. L., et al. (2018) · Brain Imaging and Behavior · doi:10.1007/s11682-018-9895-z · Cited by 56
Hepatocellular Carcinoma: Texture Analysis of Preoperative Computed Tomography Images Can Provide Markers of Tumor Grade and Disease-Free Survival
Oh, J., Lee, J. M., Park, J., Joo, I., Yoon, J. H., Lee, D. H., Ganeshan, B., & Han, J. K. (2019) · Korean Journal of Radiology · doi:10.3348/kjr.2018.0501 · Cited by 56
Validity for the Assessing Classroom Sociocultural Equity Scale (ACSES) in Early Childhood Classrooms
Curenton, S. M., Iruka, I. U., Humphries, M. L., Jensen, B., Durden, T. R., Rochester, S. E., Sims, J., Whittaker, J. V., & Kinzie, M. B. (2019) · Early Education and Development · doi:10.1080/10409289.2019.1611331 · Cited by 60
Impact of international entry choices on the nature and type of innovation: Evidence from emerging economy firms from the Indian bio-pharmaceutical industry
Thakur–Wernz, P., Cantwell, J., & Samant, S. (2019) · International Business Review · doi:10.1016/j.ibusrev.2019.101601 · Cited by 57
Home care quality indicators based on the Resident Assessment Instrument-Home Care (RAI-HC): a systematic review
Wagner, A., Schaffert, R., Möckli, N., Zúñiga, F., & Dratva, J. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05238-x · Cited by 65
The impact of alliance-focused and facilitative interpersonal relationship training on therapist skills: An RCT of brief training
Perlman, M. R., Anderson, T., Foley, V. K., Mimnaugh, S., & Safran, J. D. (2020) · Psychotherapy Research · doi:10.1080/10503307.2020.1722862 · Cited by 64
“61 may be considered “good” within the broader field of psychological measurement (Cicchetti, 1994), typical ICCs reported in prior FIS research typically strive for ICC values above .”
BackgroundMethod
Measurement Properties of the EQ-5D-Y: A Systematic Review
Golicki, D., & Młyńczak, K. (2022) · Value in Health · doi:10.1016/j.jval.2022.05.013 · Cited by 58
Designing Collaborative Intelligence Systems for Employee-AI Service Co-Production
Blaurock, M., Büttgen, M., & Schepers, J. (2024) · Journal of Service Research · doi:10.1177/10946705241238751 · Cited by 65
“The data was analyzed by two researchers along pre-de ﬁ ned coding rules (Cohen ’ s Kapa = 0.68; an inter-coder reliability considered satisfactory; Cicchetti 1994).”
Influential
9. A critical review of adolescent problem gambling assessment instruments
Stinchfield, R. D. (2011) · De Gruyter eBooks · doi:10.1515/9783110255690.147 · Cited by 55
Psychometric properties of the Contingency Management Competence Scale☆
Petry, N. M., Alessi, S. M., Ledgerwood, D. M., & Sierra, S. (2010) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2009.12.027 · Cited by 55
Development and validation of the stressful life event questionnaire
Roohafza, H., Ramezani, M. A., Sadeghi, M., Shahnam, M., Zolfagari, B., & Sarrafzadegan, N. (2011) · International Journal of Public Health · doi:10.1007/s00038-011-0232-1 · Cited by 55
Assessment of a motivational interviewing curriculum for year 3 medical students using a standardized patient case
Haeseler, F., Fortin, A. H., Pfeiffer, C. A., Walters, C. A., & Martino, S. (2010) · Patient Education and Counseling · doi:10.1016/j.pec.2010.10.029 · Cited by 55
Preliminary Development of the Elementary School Students’ Subjective Well-Being in School Scale
Liu, W., Tian, L., Huebner, E. S., Zheng, X., & Li, Z. (2014) · Social Indicators Research · doi:10.1007/s11205-014-0614-x · Cited by 76
Content and quality
Radun, J. E., Leisti, T., Häkkinen, J. P., Ojanen, H. J., Olives, J.-L., Vuori, T., & Nyman, G. (2008) · ACM Transactions on Applied Perception · doi:10.1145/1278760.1278762 · Cited by 55
Test-retest reliability and predictive validity of a juvenile guide dog behavior test
Harvey, N. D., Craigon, P. J., Sommerville, R., McMillan, C., Green, M. J., England, G., & Asher, L. (2015) · Journal of Veterinary Behavior · doi:10.1016/j.jveb.2015.09.005 · Cited by 57
Ultrasound Shear Wave Elastography: A Novel Method to Evaluate Bladder Pressure
Sturm, R. M., Yerkes, E. B., Nicholas, J. L., Snow-Lisy, D. C., Saldano, D. D., Gandor, P. L., Halline, C., Rosoklija, I., Rychlik, K. L., Johnson, E. K., et al. (2017) · The Journal of Urology · doi:10.1016/j.juro.2017.03.127 · Cited by 55
Shades of Sexualization: When Sexualization Becomes Sexual Objectification
Fasoli, F., Durante, F., Mari, S., Zogmaister, C., & Volpato, C. (2018) · Sex Roles · doi:10.1007/s11199-017-0808-1 · Cited by 58
Simulation Training for Residents Focused on Mechanical Ventilation
Spadaro, S., Karbing, D. S., Fogagnolo, A., Ragazzi, R., Mojoli, F., Astolfi, L., Gioia, A., Marangoni, E., Rees, S. E., & Volta, C. A. (2017) · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0000000000000249 · Cited by 55
In God's Hands: How Reminders of God Dampen the Effectiveness of Fear Appeals
Wu, E. C., & Cutright, K. M. (2017) · Journal of Marketing Research · doi:10.1509/jmr.15.0246 · Cited by 55
Rhythmic ostensive gestures: How adults facilitate infants’ entrance into early triadic interactions
Moreno-Núñez, A., Rodríguez, C., & del Olmo, M. J. (2017) · Infant Behavior and Development · doi:10.1016/j.infbeh.2017.09.003 · Cited by 55
Distinguishing benign from malignant thyroid nodules using thyroid ultrasonography: utility of adding superb microvascular imaging and elastography
Ahn, H. S., Lee, J. B., Seo, M., Park, S. H., & Choi, B. I. (2017) · La radiologia medica · doi:10.1007/s11547-017-0839-2 · Cited by 55
Moderate-intensity exercise boosts the N2 neural inhibition marker: A randomized and counterbalanced ERP study with precisely controlled exercise intensity
Ligeza, T. S., Maciejczyk, M., Kałamała, P., Szyguła, Z., & Wyczesany, M. (2018) · Biological Psychology · doi:10.1016/j.biopsycho.2018.04.003 · Cited by 55
Social content and emotional valence modulate gaze fixations in dynamic scenes
Rubo, M., & Gamer, M. (2018) · Scientific Reports · doi:10.1038/s41598-018-22127-w · Cited by 62
The role of foreign language anxiety on L2 utterance fluency during a final exam
Castillejo, S. P. (2018) · Language Testing · doi:10.1177/0265532218777783 · Cited by 61
Interobserver Agreement for the Standardized Reporting System PSMA-RADS 1.0 on 18F-DCFPyL PET/CT Imaging
Werner, R. A., Bundschuh, R. A., Bundschuh, L., Javadi, M. S., Leal, J. P., Higuchi, T., Pienta, K. J., Buck, A. K., Pomper, M. G., Gorin, M. A., et al. (2018) · Journal of Nuclear Medicine · doi:10.2967/jnumed.118.217588 · Cited by 55
Agreement between mothers’, fathers’, and teachers’ ratings of behavioural and emotional problems in 3–5-year-old children
Fält, E., Wallby, T., Sarkadi, A., Salari, R., & Fabian, H. M. (2018) · PLoS ONE · doi:10.1371/journal.pone.0206752 · Cited by 55
Robust estimation of sulcal morphology
Madan, C. R. (2019) · Brain Informatics · doi:10.1186/s40708-019-0098-1 · Cited by 56
Linking spatial ability, spatial strategies, and spatial creativity: A step to clarify the fuzzy relationship between spatial ability and creativity
Suh, J., & Cho, J. Y. (2020) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2020.100628 · Cited by 55
Measuring motivation to change in offenders
McMurran, M., Tyler, P. A., Hogue, T. E., Cooper, K., Dunseath, W., & McDaid, D. (1998) · Psychology Crime and Law · doi:10.1080/10683169808401746 · Cited by 55
Development and validation of a brief instrument for routine outcome monitoring in opioid maintenance pharmacotherapy services: The brief treatment outcome measure (BTOM)
Lawrinson, P., Copeland, J., & Indig, D. (2005) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2005.04.001 · Cited by 54
The Persistent Complex Bereavement Inventory: A Measure Based on the DSM-5
Lee, S. A. (2015) · Death Studies · doi:10.1080/07481187.2015.1029144 · Cited by 55
HEADS: Headline Generation as Sequence Prediction Using an Abstract Feature-Rich Space
Colmenares, C. A., Litvak, M., Mantrach, A., & Silvestri, F. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1014 · Cited by 54
Objective assessment of the contribution of dental esthetics and facial attractiveness in men via eye tracking
Baker, R. S., Fields, H. W., Beck, F. M., Firestone, A. R., & Rosenstiel, S. (2018) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2017.08.016 · Cited by 54
An algorithm for actigraphy-based sleep/wake scoring: Comparison with polysomnography
Lüdtke, S., Hermann, W., Kirste, T., Beneš, H., & Teipel, S. J. (2020) · Clinical Neurophysiology · doi:10.1016/j.clinph.2020.10.019 · Cited by 55
Working from home during the COVID‐19 crisis: How self‐control strategies elucidate employees' job performance
Troll, E. S., Venz, L., Weitzenegger, F., & Loschelder, D. D. (2021) · Applied Psychology · doi:10.1111/apps.12352 · Cited by 78
“We calculated interrater reliability using kappa (κ) for these categorical data (Cohen, 1968). κ = .82 suggested high reliability according to common standards (Cicchetti, 1994).”
BackgroundMethod
Lung Ultrasound Signs to Diagnose and Discriminate Interstitial Syndromes in ICU Patients: A Diagnostic Accuracy Study in Two Cohorts*
Heldeweg, M. L. A., Smit, M. R., Kramer-Elliott, S. R., Haaksma, M. E., Smit, J. M., Hagens, L. A., Heijnen, N. F. L., Jonkman, A. H., Paulus, F., Schultz, M. J., et al. (2022) · Critical Care Medicine · doi:10.1097/ccm.0000000000005620 · Cited by 54
“001), indicating excellent agreement (11).”
Exploring the alcohol expectancy memory network: The utility of free associates.
Reich, R. R., & Goldman, M. S. (2005) · Psychology of Addictive Behaviors · doi:10.1037/0893-164x.19.3.317 · Cited by 54
Reliability and Validity of the Matson Evaluation of Social Skills With Youngsters
Matson, J. L., Neal, D., Fodstad, J. C., Hess, J. A., Mahan, S., & Rivet, T. T. (2010) · Behavior Modification · doi:10.1177/0145445510384844 · Cited by 54
Glenohumeral Abduction Contracture in Children with Unresolved Neonatal Brachial Plexus Palsy
Eismann, E. A., Little, K. J., Laor, T., & Cornwall, R. (2015) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.n.00203 · Cited by 54
Does the choice of EQ-5D tariff matter? A comparison of the Swedish EQ-5D-3L index score with UK, US, Germany and Denmark among type 2 diabetes patients
Kiadaliri, A., Eliasson, B., & Gerdtham, U. (2015) · Health and Quality of Life Outcomes · doi:10.1186/s12955-015-0344-z · Cited by 55
Sustain talk predicts poorer outcomes among mandated college student drinkers receiving a brief motivational intervention.
Apodaca, T. R., Borsari, B. E., Jackson, K. M., Magill, M., Longabaugh, R., Mastroleo, N. R., & Barnett, N. P. (2014) · Psychology of Addictive Behaviors · doi:10.1037/a0037296 · Cited by 54
Reliability and criterion validity of self-measured waist, hip, and neck circumferences
Barrios, P. L., Martin‐Biggers, J. T., Quick, V., & Byrd‐Bredbenner, C. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0150-2 · Cited by 54
Online Health Information Regarding Male Infertility: An Evaluation of Readability, Suitability, and Quality
Robins, S., Barr, H. J., Idelson, R., Lambert, S., & Zelkowitz, P. (2016) · Interactive Journal of Medical Research · doi:10.2196/ijmr.6440 · Cited by 54
Initial development and preliminary psychometric properties of the Prodromal Inventory of Negative Symptoms (PINS)
Pelletier‐Baldelli, A., Strauss, G. P., Visser, K. H., & Mittal, V. A. (2017) · Schizophrenia Research · doi:10.1016/j.schres.2017.01.055 · Cited by 54
Reliability and Fall Risk Detection for the BESTest and Mini-BESTest in Older Adults
Anson, E. R., Thompson, E. D., Ma, L., & Jeka, J. J. (2017) · Journal of Geriatric Physical Therapy · doi:10.1519/jpt.0000000000000123 · Cited by 54
Effects of fluency training on reading competence in primary school children: The role of prosody
Calet, N., Palma, N. G., & Defior, S. (2017) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.04.006 · Cited by 54
In Vivo Noninvasive Measurement of Young’s Modulus of Elasticity in Human Eyes: A Feasibility Study
Sit, A. J., Lin, S.-C., Kazemi, A., McLaren, J. W., Pruet, C. M., & Zhang, X. (2017) · Journal of Glaucoma · doi:10.1097/ijg.0000000000000774 · Cited by 54
Kinect-based assessment of lower limb kinematics and dynamic postural control during the star excursion balance test
Eltoukhy, M. A., Kuenze, C. M., Oh, J., Wooten, S. V., & Signorile, J. F. (2017) · Gait & Posture · doi:10.1016/j.gaitpost.2017.09.010 · Cited by 54
Randomised controlled trial to assess the effect of a Just-in-Time training on procedural performance: a proof-of-concept study to address procedural skill decay
Branzetti, J. B., Adedipe, A. A., Gittinger, M., Rosenman, E. D., Brolliar, S. M., Chipman, A. K., Grand, J. A., & Fernandez, R. (2017) · BMJ Quality & Safety · doi:10.1136/bmjqs-2017-006656 · Cited by 54
Scan-rescan reproducibility of ventricular and atrial MRI feature tracking strain
Lamy, J., Soulat, G., Evin, M. A., Huber, A. T., Cesare, A. D., Giron, A., Diébold, B., Redheuil, A. B., Mousseaux, É., & Kachenoura, N. (2017) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.11.015 · Cited by 54
A n adaptive semantic matching paradigm for reliable and valid language mapping in individuals with aphasia
Wilson, S. M., Yen, M., & Eriksson, D. K. (2018) · Human Brain Mapping · doi:10.1002/hbm.24077 · Cited by 58
Psychometric validation of the PTSD Checklist-5 among female Filipino migrant workers
Hall, B. J., Yip, P. S. Y., Garabiles, M. R., Lao, C. K., Chan, E. W. W., & Marx, B. P. (2019) · European Journal of Psychotraumatology · doi:10.1080/20008198.2019.1571378 · Cited by 57
Test-retest reliability of adolescents’ self-reported physical activity item in two consecutive surveys
Ng, K., Hämylä, R., Tynjälä, J., Villberg, J. J., Tammelin, T., Kannas, L. K., & Kokko, S. P. (2019) · Archives of Public Health · doi:10.1186/s13690-019-0335-3 · Cited by 54
Association of Pain Centralization and Patient‐Reported Pain in Active Rheumatoid Arthritis
Heisler, A. C., Song, J., Dunlop, D. D., Wohlfahrt, A., Bingham, C. O., Bolster, M. B., Clauw, D. J., Marder, W., Phillips, K., Neogi, T., et al. (2019) · Arthritis Care & Research · doi:10.1002/acr.23994 · Cited by 54
“To minimize these effects, rigorous training and standardization methods were employed, resulting in overall ICCs in the good to excellent range (19,23).”
Method
Improving clinical refractive results of cataract surgery by machine learning
Šramka, M., Slovák, M., Tučková, J., & Stodůlka, P. (2019) · PeerJ · doi:10.7717/peerj.7202 · Cited by 54
Adaptive Inspirational Design Stimuli: Using Design Output to Computationally Search for Stimuli That Impact Concept Generation
Goucher-Lambert, K., Gyory, J. T., Kotovsky, K., & Cagan, J. (2020) · Journal of Mechanical Design · doi:10.1115/1.4046077 · Cited by 54
“The ICC values for novelty (0.78), feasibility (0.65), and usefulness (0.79) were all good or excellent [38].”
BackgroundInfluential
Spot-On Creativity: Creativity Biases and Their Differential Effects on Consumer Responses in (Non-)Real-Time Marketing
Mazerant, K., Willemsen, L. M., Neijens, P. C., & van Noort, G. (2020) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2020.06.004 · Cited by 54
“74 indicate acceptable inter-coder reliability (Cicchetti, 1994; Koo & Li, 2016), which implies that these measures can be used in further analyses.”
BackgroundMethodInfluential
Core Elements of Family Therapy for Adolescent Behavior Problems: Empirical Distillation of Three Manualized Treatments
Hogue, A., Bobek, M., Dauber, S., Henderson, C. E., McLeod, B. D., & Southam-Gerow, M. A. (2019) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2018.1555762 · Cited by 53
Reliability Statistics
Sainani, K. L. (2017) · PM&R · doi:10.1016/j.pmrj.2017.05.001 · Cited by 69
Non‐word repetition performance in Slovak‐speaking children with and without SLI: novel scoring methods
Kapalková, S., Polišenská, K., & Vicenová, Z. (2012) · International Journal of Language & Communication Disorders · doi:10.1111/j.1460-6984.2012.00189.x · Cited by 53
All role transitions are not experienced equally: Associations among self-change, emotional reactions, and self-concept clarity
Slotter, E. B., & Walsh, C. M. (2017) · Self and Identity · doi:10.1080/15298868.2017.1280528 · Cited by 60
Benchmarking Treatment Response in Tourette’s Disorder: A Psychometric Evaluation and Signal Detection Analysis of the Parent Tic Questionnaire
Ricketts, E. J., Mcguire, J. F., Chang, S. W., Bose, D., Rasch, M., Woods, D. W., Specht, M. W., Walkup, J. T., Scahill, L. D., Wilhelm, S., et al. (2017) · Behavior Therapy · doi:10.1016/j.beth.2017.05.006 · Cited by 53
Schema therapy for borderline personality disorder: A qualitative study of patients’ perceptions
Tan, Y. M., Lee, C. W., Averbeck, L. E., Wilde, O. B.-D., Farrell, J. M., Faßbinder, E., Jacob, G. A., Martius, D., Wastiaux, S., Zarbock, G., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0206039 · Cited by 62
Test-retest reliability of the human functional connectome over consecutive days: identifying highly reliable portions and assessing the impact of methodological choices
Tozzi, L., Fleming, S. L., Taylor, Z. D., Raterink, C., & Williams, L. M. (2020) · Network Neuroscience · doi:10.1162/netn_a_00148 · Cited by 47
“We also show the proportion of edges having poor (ICC < 0.40), fair (ICC = 0.40–0.60), good (ICC = 0.60–0.75), or excellent (ICC > 0.75) reliability, defined in accordance to Cicchetti (1994).”
Influential
Validation of the Achievement Emotions Questionnaire for Physical Education (AEQ-PE)
Fierro-Suero, S., Almagro, B. J., & Buñuel, P. S.-L. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17124560 · Cited by 53
Recommendations for weight management in osteoarthritis: A systematic review of clinical practice guidelines
Lim, Y. Z., Wong, J. O., Hussain, S. M., Estee, M. M., Zolio, L., Page, M. J., Harrison, C. L., Wluka, A. E., Wang, Y., & Cicuttini, F. (2022) · Osteoarthritis and Cartilage Open · doi:10.1016/j.ocarto.2022.100298 · Cited by 58
Cortical abnormalities and association with symptom dimensions across the depressive spectrum
Lener, M. S., Kundu, P., Wong, E. W., DeWilde, K. E., Tang, C. Y., Balchandani, P., & Murrough, J. W. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.10.027 · Cited by 57
Reliability and validity of a new physical activity questionnaire for India
Anjana, R. M., Sudha, V., Lakshmipriya, N., Subhashini, S., Pradeepa, R., Geetha, L., Bai, M. R., Gayathri, R., Deepa, M., Ranjit Unnikrishnan, I., et al. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0196-2 · Cited by 55
The use of adjunct displays to facilitate comprehension of causal relationships in expository text
McCrudden, M. T., Schraw, G. J., & Lehman, S. (2007) · Instructional Science · doi:10.1007/s11251-007-9036-3 · Cited by 58
Science Teacher Attitudes Toward Inquiry-Based Teaching and Learning
DiBiase, W. J., & McDonald, J. R. (2015) · The Clearing House A Journal of Educational Strategies Issues and Ideas · doi:10.1080/00098655.2014.987717 · Cited by 74
The Interclinician Reliability of Rorschach Interpretation in Four Data Sets
Meyer, G. J., Mihura, J. L., & Smith, B. L. (2005) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8403_09 · Cited by 53
Nurse moral disengagement
Fida, R., Tramontano, C., Paciello, M., Kangasniemi, M. K., Sili, A., Bobbio, A., & Barbaranelli, C. (2015) · Nursing Ethics · doi:10.1177/0969733015574924 · Cited by 55
The Marriage Checkup: Increasing Access to Marital Health Care
Morrill, M. I., Fleming, C. E., Harp, A. G., Sollenberger, J. W., Darling, E. V., & Córdova, J. V. (2011) · Family Process · doi:10.1111/j.1545-5300.2011.01372.x · Cited by 53
Impact of Group Size on Classroom On-Task Behavior and Work Productivity in Children With ADHD
Hart, K. C., Massetti, G. M., Fabiano, G. A., Pariseau, M. E., & Pelham, W. E. (2010) · Journal of Emotional and Behavioral Disorders · doi:10.1177/1063426609353762 · Cited by 53
The National League for Nursing Project to Explore the Use of Simulation for High-Stakes Assessment: Process, Outcomes, and Recommendations
Rizzolo, M. A., Kardong‐Edgren, S., Oermann, M. H., & Jeffries, P. R. (2015) · Nursing Education Perspectives · doi:10.5480/15-1639 · Cited by 53
Assessing sleep architecture and continuity measures through the analysis of heart rate and wrist movement recordings in healthy subjects: comparison with results based on polysomnography
Muzet, A. G., Werner, S., Fuchs, G., Roth, T. G., Saoud, J. B., Viola, A., Schaffhauser, J.-Y., & Luthringer, R. (2016) · Sleep Medicine · doi:10.1016/j.sleep.2016.01.015 · Cited by 53
Exploring Selective Exposure and Confirmation Bias as Processes Underlying Employee Work Happiness: An Intervention Study
Williams, P., Kern, M. L., & Waters, L. E. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00878 · Cited by 66
Illuminance required to detect a pavement obstacle of critical size
Fotios, S. A., & Uttley, J. (2016) · Lighting Research & Technology · doi:10.1177/1477153516659783 · Cited by 53
Simultaneous multi-slice echo planar diffusion weighted imaging of the liver and the pancreas: Optimization of signal-to-noise ratio and acquisition time and application to intravoxel incoherent motion analysis
Boss, A., Barth, B. K., Filli, L., Kenkel, D., Wurnig, M. C., Piccirelli, M., & Reiner, C. S. (2016) · European Journal of Radiology · doi:10.1016/j.ejrad.2016.09.002 · Cited by 53
A transdiagnostic approach to examining the incremental predictive power of emotion regulation and basic personality dimensions.
Stanton, K. J., Rozek, D. C., Stasik-O’Brien, S. M., Ellickson‐Larew, S., & Watson, D. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000208 · Cited by 60
An Ultrasound Surface Wave Technique for Assessing Skin and Lung Diseases
Zhang, X., Zhou, B., Kalra, S., Bartholmai, B. J., Greenleaf, J. F., & Osborn, T. G. (2017) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2017.10.010 · Cited by 53
Repeatability of gait analysis measurements in Thoroughbreds in training
Caviedes, M. F. S., Forbes, B. S., & Pfau, T. (2017) · Equine Veterinary Journal · doi:10.1111/evj.12802 · Cited by 53
Attention deficit hyperactivity disorder and autism spectrum disorder symptoms in school-age children born very preterm
Bröring, T., Oostrom, K. J., van Dijk‐Lokkart, E. M., Lafeber, H. N., Brugman, A., & Oosterlaan, J. (2018) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2018.01.001 · Cited by 59
Physically Active Lessons Improve Lesson Activity and On-Task Behavior: A Cluster-Randomized Controlled Trial of the “Virtual Traveller” Intervention
Norris, E., Dunsmuir, S., Duke‐Williams, O., Stamatakis, E. A., & Shelton, N. J. (2018) · Health Education & Behavior · doi:10.1177/1090198118762106 · Cited by 51
A Reliable Method to Assess Keel Bone Fractures in Laying Hens From Radiographs Using a Tagged Visual Analogue Scale
Rufener, C., Baur, S., Stratmann, A., & Toscano, M. (2018) · Frontiers in Veterinary Science · doi:10.3389/fvets.2018.00124 · Cited by 52
Reliability of Magnetoencephalography and High-Density Electroencephalography Resting-State Functional Connectivity Metrics
Marquetand, J. C., Vannoni, S., Carboni, M., Hegner, Y. L., Stier, C., Braun, C., & Focke, N. K. (2019) · Brain Connectivity · doi:10.1089/brain.2019.0662 · Cited by 53
“We regarded 0–0.4 as poor, 0.4– 0.59 as fair, 0.6–0.74 as good, 0.75–1 as excellent agreement, according to proposed guidelines (Cicchetti, 1994).”
Influential
Comparative Content Analysis of Self-Report Scales for Level of Personality Functioning
Waugh, M. H., McClain, C. M., Mariotti, E. C., Mulay, A. L., DeVore, E. N., Lenger, K. A., Russell, A. N., Florimbio, A. R., Lewis, K. C., Ridenour, J. M., et al. (2020) · Journal of Personality Assessment · doi:10.1080/00223891.2019.1705464 · Cited by 56
Obtaining secondary students’ perceptions of instructional quality: Two-level structure and measurement invariance
Wisniewski, B., Zierer, K., Dresel, M., & Daumiller, M. H. (2020) · Learning and Instruction · doi:10.1016/j.learninstruc.2020.101303 · Cited by 58
“…(Bliese, 2000), they can be used to calculate the theoretically assumed sample sizes that provide different levels of reliability for each item, using Cicchetti's (1994) suggested guidelines for interpretation (fair reliability from .40, good reliability from .60, excellent reliability from .75).”
Method
Temporal Stability of WISC-III Subtest Composite: Strengths and Weaknesses.
Watkins, M. W., & Canivez, G. L. (2004) · Psychological Assessment · doi:10.1037/1040-3590.16.2.133 · Cited by 53
Psychometric properties of the WHO Quality of Life questionnaire (WHOQOL-100) in patients with chronic diseases and their caregivers in China.
Li, L., Young, D., Xiao, S., Zhou, X. N., & Zhou, L. (2004) · Europe PMC (PubMed Central) · Cited by 53
Adverse Impact of Coercive Treatments on Psychiatric Inpatients’ Satisfaction with Care
Strauss, J. L., Zervakis, J. B., Stechuchak, K. M., Olsen, M. K., Swanson, J., Swartz, M. S., Weinberger, M., Marx, C. E., Calhoun, P. S., Bradford, D. W., et al. (2013) · Community Mental Health Journal · doi:10.1007/s10597-012-9539-5 · Cited by 52
Reliability of Therapist Self-Report on Treatment Targets and Focus in Family-Based Intervention
Hogue, A., Dauber, S., Henderson, C. E., & Liddle, H. A. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0520-6 · Cited by 52
Attachment Narratives in Refugee Children: Interrater Reliability and Qualitative Analysis in Pilot Findings From a Two‐Site Study
Haene, L. D., Dalgaard, N. T., Montgomery, E., Grietens, H. W. E., & Verschueren, K. (2013) · Journal of Traumatic Stress · doi:10.1002/jts.21820 · Cited by 52
Assessment of the tibial slope is highly dependent on the type and accuracy of the preceding acquisition
Gwinner, C., Fuchs, M. A., Sentuerk, U., Perka, C., Walter, T., Schatka, I., & Rogasch, J. M. M. (2019) · Archives of Orthopaedic and Trauma Surgery · doi:10.1007/s00402-019-03201-y · Cited by 52
Temporal Stability of Self‐Reported Trauma Exposure on the Life Events Checklist for DSM‐5
Pugach, C. P., Nomamiukor, F. O., Gay, N. G., & Wisco, B. E. (2020) · Journal of Traumatic Stress · doi:10.1002/jts.22611 · Cited by 52
Non‐Motor Fluctuations in Parkinson's Disease: Validation of the Non‐Motor Fluctuation Assessment Questionnaire
Kleiner, G., Fernandez, H. H., Chou, K. L., Fasano, A. A., Duque, K. R., Hengartner, D., Law, A., Margolius, A. J., Poon, Y., Sáenz‐Farret, M., et al. (2021) · Movement Disorders · doi:10.1002/mds.28507 · Cited by 52
“70 to indicate adequate stability.(28) Concurrent validity was assessed using Spearman’s rank-order”
Method
Internal consistency and test-retest reliability: A reliability generalization meta-analysis of the Childhood Trauma Questionnaire – Short Form (CTQ-SF)
Badenes‐Ribera, L., Georgieva, S., Tomás, J. M., & Pérez, J. J. N. (2024) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2024.106941 · Cited by 60

Authors: Cicchetti, D. V.
Affiliations: Veterans Health Administration (US)
Corresponding author: Cicchetti, Domenic V.
Venue: Psychological Assessment
Publisher: American Psychological Association (APA)
Published: 1994-12
Volume: 6
Issue: 4
Pages: 284-290
ISSN: 1040-3590 (ISSN-L)
1939-134X
DOI: 10.1037/1040-3590.6.4.284
OpenAlex: W2063085086
Cited by: 9,349
References: 43
Citations by year: 2026: 538 · 2025: 654 · 2024: 693 · 2023: 753 · 2022: 842 · 2021: 886 · 2020: 882 · 2019: 825 · 2018: 786 · 2017: 611 · 2016: 355 · 2015: 308 · 2014: 209 · 2013: 152 · 2012: 139
FWCI: 17.61
Type: journal article
Language: en
Open access: closed
Locations: Psychological Assessment (publishedVersion)
Topics: Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
Keywords: test selection, standardized assessment, test standardization, test norming, test reliability, test validity, psychometrics, test development, cognitive assessment, personality assessment, adaptive behavior, children and adolescents, adults, older adults, disability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks