Cited by 9,349Psychological Testing and AssessmentPsychometric Methodologies and TestingHistorical and Modern Theater Studies

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Cicchetti, Domenic V.·1994·Psychological Assessment

DOI 10.1037/1040-3590.6.4.284

Open this paper in CoChat — free account

Abstract

In the context of the development of prototypic assessment instruments in the areas of cognition, personality, and adaptive functioning, the issues of standardization, norming procedures, and the important psychometrics of test reliability and validity are evaluated critically. Criteria, guidelines, and simple rules of thumb are provided to assist the clinician faced with the challenge of choosing an appropriate test instrument for a given psychological assessment. Clinicians are often faced with the critical challenge of choosing the most appropriate available test instrument for a given psychological assessment of a child, adolescent, or adult of a particular age, gender, and class of disability. It is the purpose of this report to provide some criteria, guidelines, or simple rules of thumb to aid in this complex scientific decision. As such, it draws upon my experience with issues of test development, standardization, norming procedures, and important psychometrics, namely, test reliability and validity. As I and my colleagues noted in an earlier publication, the major areas of psychological functioning, in the normal development of infants, children, adolescents, adults, and elderly people, include cognitive, academic, personality, and adaptive behaviors (Sparrow, Fletcher, & Cicchetti, 1985). As such, the major examples or applications discussed in this article derive primarily, although not exclusively, from these several areas of human functioning.

Integrity signals

Registry

Crossref · 10.1037/1040-3590.6.4.284

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Psychometric theory (2nd ed.).
Sitgreaves, R. (1979) · Contemporary Psychology · doi:10.1037/018882 · Cited by 14,384
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
Cooper, A. M., & Michels, R. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.1.128 · Cited by 7,419
Manual for the Wechsler Adult Intelligence Scale.
Wechsler, D. (1955) · Psychological Corp. eBooks · Cited by 4,941
Essentials of Psychological Testing
Rosner, B., & Cronbach, L. J. (1960) · The American Journal of Psychology · doi:10.2307/1419921 · Cited by 4,524
Statistical Methods for Rates and Proportions, 2nd ed
GROVE, W. A. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.12.1644-a · Cited by 3,756
The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354

Show all 43 references

Sorted by citations

Items 701–800 of 1,086

Frequency of Eating Homegrown Produce Is Associated with Higher Intake among Parents and Their Preschool-Aged Children in Rural Missouri
Nanney, M. S., Johnson, S., Elliott, M., & Haire-Joshu, D. L. (2007) · Journal of the American Dietetic Association · doi:10.1016/j.jada.2007.01.009 · Cited by 68
Evaluating Corneal Fluorescein Staining Using a Novel Automated Method
Amparo, F., Wang, H., Yin, J., Marmalidou, A., & Dana, R. (2017) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.17-21831 · Cited by 68
Hippocampal Blood Flow Is Increased After 20 min of Moderate-Intensity Exercise
Steventon, J. J., Foster, C., Furby, H., Helme, D., Wise, R. G., & Murphy, K. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhz104 · Cited by 73
Let’s Make Your Request More Persuasive: Modeling Persuasive Strategies via Semi-Supervised Neural Nets on Crowdfunding Platforms
Yang, D., Chen, J., Yang, Z., Jurafsky, D., & Hovy, E. H. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1364 · Cited by 68
A Systematic Review of Passing as Non-autistic in Autism Spectrum Disorder
Libsack, E. J., Keenan, E. G., Freden, C. E., Mirmina, J., Iskhakov, N., Krishnathasan, D., & Lerner, M. D. (2021) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-021-00365-1 · Cited by 68
“Coder reliability was calculated for the subset of triplecoded articles and was assessed to be acceptable via Fleiss’ Kappa (Fleiss, 1975) for categorical variables (all κ ≥ 0.59) and excellent via intraclass correlations (ICC 2,3) (Shrout & Fleiss, 1979) for all continuous variables (all ICC ≥ 0.79) (Cicchetti, 1994).”
MethodInfluential
Blended care in the treatment of subthreshold symptoms of depression and psychosis in emerging adults: A randomised controlled trial of Acceptance and Commitment Therapy in Daily-Life (ACT-DL)
van Aubel, E., Bakker, J. M., Batink, T., Michielse, S., Goossens, L., Lange, I., Schruers, K., Lieverse, R., Marcelis, M., van Amelsvoort, T., et al. (2020) · Behaviour Research and Therapy · doi:10.1016/j.brat.2020.103592 · Cited by 57
Untitled work
Giluk (2009) · doi:10.1017/s003329172000389x · Cited by 68
“Inter-rater reliabilities were good to excellent (i.e. Ks and ICCs ⩾ 0.74; Cicchetti, 1994).”
MethodInfluential
Treatment Features Associated with Youth Cognitive Behavioral Therapy Follow-Up Effects for Internalizing Disorders: A Meta-Analysis
Sun, M. M. C., Rith‐Najarian, L., Williamson, T. J., & Chorpita, B. F. (2018) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2018.1443459 · Cited by 68
Three‐dimensional simultaneous brain T1, T2, and ADC mapping with MR Multitasking
Ma, S., Nguyen, C. T., Han, F., Wang, N., Deng, Z., Binesh, N., Moser, F. G., Christodoulou, A., & Li, D. (2019) · Magnetic Resonance in Medicine · doi:10.1002/mrm.28092 · Cited by 67
Efficacy and acceptability of mindfulness-based interventions for military veterans: A systematic review and meta-analysis
Goldberg, S. B., Riordan, K. M., Sun, S., Kearney, D. J., & Simpson, T. L. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2020.110232 · Cited by 69
Recommendations for Diagnosis and Treatment of Lumbosacral Radicular Pain: A Systematic Review of Clinical Practice Guidelines
Khorami, A. K., Oliveira, C. B., Maher, C. G., Bindels, P., Machado, G. C., Pinto, R. Z., Koes, B. W., & Chiarotto, A. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10112482 · Cited by 79
A Reasonable Officer: Examining the Relationships Among Stress, Training, and Performance in a Highly Realistic Lethal Force Scenario
Baldwin, S., Bennell, C., Blaskovits, B., Brown, A. S., Jenkins, B., Lawrence, C., McGale, H., Semple, T., & Andersen, J. P. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.759132 · Cited by 92
“82]) were in the good– excellent (Cicchetti, 1994) or moderate–good range (Koo and Li, 2016).”
BackgroundMethodInfluential
Customer journey management capability in business-to-business markets: Its bright and dark sides and overall impact on firm performance
Homburg, C., & Tischer, M. (2023) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-023-00923-9 · Cited by 98
Relationship between prediction accuracy and feature importance reliability: An empirical and theoretical study
Chen, J., Ooi, L. Q. R., Tan, T. W. K., Zhang, S., Li, J., Asplund, C. L., Eickhoff, S. B., Bzdok, D., Holmes, A. J., & Yeo, B. T. T. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.120115 · Cited by 64
“53 were achieved for personality and mental health at the full sample size, which are considered “fair” split-half reliabilities (Cicchetti, 1994).”
Influential
Evaluating Performance and Agreement of Coronary Heart Disease Polygenic Risk Scores
Abramowitz, S. A., Boulier, K. M., Keat, K., Cardone, K. M., Shivakumar, M., DePaolo, J. S., Judy, R., Bermudez, F., Mimouni, N., Neylan, C. J., et al. (2024) · JAMA · doi:10.1001/jama.2024.23784 · Cited by 69
Personality dimensions and their behavioral correlates in wild Virunga mountain gorillas (Gorilla beringei beringei).
Eckardt, W., Steklis, H. D., Steklis, N. G., Fletcher, A. W., Stoinski, T. S., & Weiß, A. (2014) · Journal of comparative psychology · doi:10.1037/a0038370 · Cited by 67
Measuring Performance Directly Using the Veterans Health Administration Electronic Medical Record: A Comparison With External Peer Review
Goulet, J., Erdos, J. J., Kancir, S., Levin, F., Wright, S. M., Daniels, S. M., Nilan, L., & Justice, A. (2007) · Medical Care · doi:10.1097/01.mlr.0000244510.09001.e5 · Cited by 73
Validity and Stability of the Youth Psychopathic Traits Inventory in a Nonforensic Sample of Young Adults
Campbell, M. A., Doucette, N. L., & French, S. A. (2009) · Journal of Personality Assessment · doi:10.1080/00223890903228679 · Cited by 67
Neurobehavioral Symptoms and Family Functioning in Traumatically Brain-Injured Adults
Groom, K. N., Shaw, T. G., O'Connor, M. E., Howard, N., & Pickens, A. (1998) · Archives of Clinical Neuropsychology · doi:10.1016/s0887-6177(98)00005-5 · Cited by 67
Training substance abuse clinicians in motivational interviewing using live supervision via teleconferencing.
Smith, J. L., Carpenter, K. M., Amrhein, P. C., Brooks, A. C., Levin, D., Schreiber, E. A., Travaglini, L. A., Hu, M., & Nunes, E. V. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028176 · Cited by 68
First adoption of consumer innovations: Exploring market failure and alleviating factors
de Jong, J. P. J., Gillert, N. L., & Stock, R. (2018) · Research Policy · doi:10.1016/j.respol.2018.01.004 · Cited by 67
Promoting pupils’ creative thinking in primary school mathematics: A case study
Schoevers, E. M., Leseman, P. P. M., Slot, E. M., Bakker, A., Keijzer, R., & Kroesbergen, E. H. (2019) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2019.02.003 · Cited by 78
Standardizing Assessment of Spoken Discourse in Aphasia: A Working Group With Deliverables
Stark, B. C., Dutta, M., Murray, L. L., Bryant, L., Fromm, D., MacWhinney, B., Ramage, A. E., Roberts, A., den Ouden, D., Brock, K. L., et al. (2020) · American Journal of Speech-Language Pathology · doi:10.1044/2020_ajslp-19-00093 · Cited by 67
Convergent Reliability and Validity of the Questions About Behavioral Function and the Motivation Assessment Scale: A Replication Study
Shogren, K. A., & Rojahn, J. (2003) · Journal of Developmental and Physical Disabilities · doi:10.1023/a:1026314316977 · Cited by 67
A latent state‐trait analysis of interoceptive accuracy
Wittkamp, M. F., Bertsch, K., Vögele, C., & Schulz, A. (2018) · Psychophysiology · doi:10.1111/psyp.13055 · Cited by 72
Motivational interviewing may facilitate professional interactions with inspectees during environmental inspections and enforcement conversations
Forsberg, L., Wickström, H., & Källmén, H. (2014) · PeerJ · doi:10.7717/peerj.508 · Cited by 66
3D anthropometric algorithms for the estimation of measurements required for specialized garment design
Markiewicz, Ł., Witkowski, M., Sitnik, R., & Mielicka, E. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.04.052 · Cited by 66
Effects of traumatic brain injury on sleep and enlarged perivascular spaces
Opel, R. A., Christy, A. L., Boespflug, E. L., Weymann, K. B., Case, B. M., Pollock, J. M., Silbert, L. C., & Lim, M. M. (2018) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1177/0271678x18791632 · Cited by 67
Boost in Test–Retest Reliability in Resting State fMRI with Predictive Modeling
Taxali, A., Angstadt, M., Rutherford, S. E., & Sripada, C. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa390 · Cited by 76
Cone Photoreceptor Irregularity on Adaptive Optics Scanning Laser Ophthalmoscopy Correlates With Severity of Diabetic Retinopathy and Macular Edema
Lammer, J., Prager, S. G., Cheney, M. C., Ahmed, A., Radwan, S. H., Burns, S. A., Silva, P. S., & Sun, J. K. (2016) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.16-19537 · Cited by 66
Psychometric properties of the Mental Health and Social Inadaptation Assessment for Adolescents (MIA) in a population‐based sample
Côté, S. M., Orri, M., Brendgen, M. R., Vitaro, F., Boivin, M., Japel, C., Séguin, J. R., Geoffroy, M., Rouquette, A., Falissard, B., et al. (2017) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1566 · Cited by 66
REPEATABILITY OF AUTOMATED VESSEL DENSITY AND SUPERFICIAL AND DEEP FOVEAL AVASCULAR ZONE AREA MEASUREMENTS USING OPTICAL COHERENCE TOMOGRAPHY ANGIOGRAPHY
Yanık, Ö., Demirel, S., Özmert, E., & Batıoğlu, F. (2017) · Retina · doi:10.1097/iae.0000000000001671 · Cited by 66
Reliability of MRI-Derived Depth of Invasion of Oral Tongue Cancer
Murakami, R., Shiraishi, S., Yoshida, R., Sakata, J., Yamana, K., Hirosue, A., Uchiyama, Y., Nakayama, H., & Yamashita, Y. (2018) · Academic Radiology · doi:10.1016/j.acra.2018.08.021 · Cited by 66
Social dominance hierarchy type and rank contribute to phenotypic variation within cages of laboratory mice
Varholick, J. A., Pontiggia, A., Murphy, E., Daniele, V., Palme, R., Voelkl, B., Würbel, H., & Bailoo, J. D. (2019) · Scientific Reports · doi:10.1038/s41598-019-49612-0 · Cited by 74
Accuracy of augmented reality surgical navigation for minimally invasive pedicle screw insertion in the thoracic and lumbar spine with a new tracking device
Peh, S., Chatterjea, A., Pfarr, J., Schäfer, J. P., Weuster, M., Klüter, T., Seekamp, A., & Lippross, S. (2019) · The Spine Journal · doi:10.1016/j.spinee.2019.12.009 · Cited by 66
Screening for autism spectrum disorder in a naturalistic home setting using the Systematic Observation of Red Flags (SORF) at 18–24 months.
Dow, D., Day, T. N., Kutta, T. J., Nottke, C., & Wetherby, A. M. (2020) · Autism Research · doi:10.1002/aur.2226 · Cited by 65
“Reliability was measured using intraclass correlation generalizability (g) coefficients to assess inter-rater agreement for measurement of continuous clinical outcomes [Cicchetti, 1994].”
Method
Mobile apps for speech-language therapy in adults with communication disorders: review of content and quality
Vaezipour, A., Campbell, J., Theodoros, D., & Russell, T. (2020) · JMIR mhealth and uhealth · doi:10.2196/18858 · Cited by 65
“The overall MARS score demonstrated a good [33] level of interrater reliability (two-way mixed intraclass correlation coefficient (ICC) 0.”
Method
Factor Structure and Validity of the Therapy Process Observational Coding System for Child Psychotherapy–Alliance Scale
Fjermestad, K. W., McLeod, B. D., Heiervang, E. R., Havik, O. E., Öst, L., & Haugland, B. S. M. (2012) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2012.651999 · Cited by 65
The dissemination of motivational interviewing in Swedish county councils: Results of a randomized controlled trial
Beckman, M., Forsberg, L., Lindqvist, H., Diez, M., Persson, J. E., & Ghaderi, A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0181715 · Cited by 65
Comparing the diagnostic concepts of ICD-10 somatoform disorders and DSM-5 somatic symptom disorders in patients from a psychosomatic outpatient clinic
Hüsing, P., Löwe, B., & Toussaint, A. C. (2018) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2018.08.001 · Cited by 64
Validity of the EQ-5D-5L and EQ-5D-3L in patients with Crohn’s disease
Rencz, F., Lakatos, P. L., Gulàcsi, L., Brodszky, V., Kürti, Z., Lovas, S., Banai, J., Herszényi, L., Cserni, T., Molnár, T., et al. (2018) · Quality of Life Research · doi:10.1007/s11136-018-2003-4 · Cited by 63
Accelerated single-shot T2-weighted fat-suppressed (FS) MRI of the liver with deep learning–based image reconstruction: qualitative and quantitative comparison of image quality with conventional T2-weighted FS sequence
Shanbhogue, K., Tong, A. Y., Smereka, P. N., Nickel, D. M., Arberet, S., Anthopolos, R., & Chandarana, H. (2021) · European Radiology · doi:10.1007/s00330-021-08008-3 · Cited by 66
A Validation Study of a Commercial Wearable Device to Automatically Detect and Estimate Sleep
Miller, D. J., Roach, G. D., Lastella, M., Scanlan, A. T., Bellenger, C. R., Halson, S. L., & Sargent, C. (2021) · Biosensors · doi:10.3390/bios11060185 · Cited by 65
Assessing Autistic Traits in a Taiwan Preschool Population: Cross-Cultural Validation of the Social Responsiveness Scale (SRS)
Wang, J. J., Lee, L.-C., Chen, Y. S., & Hsu, J.-W. (2012) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-012-1499-7 · Cited by 64
Anxiety disorders in children and adolescents with intellectual disability: Prevalence and assessment
Reardon, T. C., Gray, K. M., & Melvin, G. A. (2014) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2014.10.007 · Cited by 75
Compliance and schizophrenia: the predictive potential of insight into illness, symptoms, and side effects
Kao, Y.-C., & Liu, Y. (2010) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2010.03.007 · Cited by 65
Is the “Yoga Bod” the new skinny?
Webb, J. B., Thomas, E. V., Warren‐Findlow, J., Padro, M., Burris, E. N., & Suddreth, E. (2016) · Body Image · doi:10.1016/j.bodyim.2016.11.005 · Cited by 73
Quantitative susceptibility mapping (QSM) and R2* in the human brain at 3 T
Feng, X., Deistung, A., & Reichenbach, J. R. (2017) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2017.05.003 · Cited by 65
Reproducibility of Heart Rate Variability Is Parameter and Sleep Stage Dependent
Herzig, D., Eser, P., Omlin, X., Riener, R., Wilhelm, M., & Achermann, P. (2018) · Frontiers in Physiology · doi:10.3389/fphys.2017.01100 · Cited by 67
Alberta Stroke Program Early CT Score Versus Computed Tomographic Perfusion to Predict Functional Outcome After Successful Reperfusion in Acute Ischemic Stroke
Demeestere, J., Scheldeman, L., Cornelissen, S. A., Heye, S., Wouters, A., Dupont, P. J., Christensen, S., Mlynash, M., Albers, G. W., Lansberg, M. G., et al. (2018) · Stroke · doi:10.1161/strokeaha.118.021961 · Cited by 65
Development and reliability assessment of a new quality appraisal tool for cross-sectional studies using biomarker data (BIOCROSS)
Wirsching, J., Graßmann, S., Eichelmann, F., Harms, L. M., Schenk, M., Barth, E., Berndzen, A., Olalekan, M., Sarmini, L., Zuberer, H., et al. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0583-x · Cited by 63
More than words: Narrator engagement during storytelling increases children’s word learning, story comprehension, and on-task behavior
Lenhart, J., Lenhard, W., Vaahtoranta, E., & Suggate, S. P. (2020) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2019.12.009 · Cited by 79
Measuring the Implementation of UDL in Classrooms and Schools: Initial Field Test Results
Basham, J. D., Gardner, J. E., & Smith, S. J. (2020) · Remedial and Special Education · doi:10.1177/0741932520908015 · Cited by 84
Evolution of epitope-specific IgE and IgG4 antibodies in children enrolled in the LEAP trial
Suárez‐Fariñas, M., Suprun, M., Bahnson, H. T., Raghunathan, R. R., Getts, R. C., Toit, G. D., Lack, G., & Sampson, H. A. (2021) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2021.01.030 · Cited by 64
An investigation on the use of automated feedback in Turkish EFL students’ writing classes
Han, T., & Sarı, E. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2022.2067179 · Cited by 64
“The resulting ICC was in the excellent range for all categories (ICC= 0.99 for grammar, 0.98 for usage and mechanics) (Cicchetti, 1994).”
BackgroundResultInfluential
Diagnostic accuracy of the Primary Care PTSD Screen for DSM‐5 (PC‐PTSD‐5) within a civilian primary care sample
Williamson, M. L. C., Stickley, M. M., Armstrong, T. W., Jackson, K., & Console, K. (2022) · Journal of Clinical Psychology · doi:10.1002/jclp.23405 · Cited by 73
Integrating multi-informant reports of youth mental health: A construct validation test of Kraemer and colleagues’ (2003) Satellite Model
Charamut, N. R., Racz, S. J., Wang, M., & Reyes, A. D. L. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.911629 · Cited by 64
“We interpreted these calculations relative to conventions for α (e.g., Nunnally and Bernstein, 1994) and ICCs (e.g., Cicchetti, 1994).”
BackgroundMethodInfluential
Alexithymia in patients with substance use disorders: State or trait?
de Haan, H. A., van der Palen, J. A. M., Wijdeveld, T. A. G. M., Buitelaar, J. K., & de Jong, C. A. J. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2013.12.047 · Cited by 68
Does playing video games with violent content temporarily increase aggressive inclinations? A pre-registered experimental study
McCarthy, R. J., Coley, S. L., Wagner, M. F., Zengel, B., & Basham, A. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.10.009 · Cited by 64
H ippocampal subfields at ultra high field MRI: A n overview of segmentation and measurement methods
Giuliano, A., Donatelli, G., Cosottini, M., Tosetti, M., Retico, A., & Fantacci, M. E. (2017) · Hippocampus · doi:10.1002/hipo.22717 · Cited by 64
The Juggling Act of Supervision in Community Mental Health: Implications for Supporting Evidence-Based Treatment
Dorsey, S., Pullmann, M. D., Kerns, S. E. U., Jungbluth, N. J., Meza, R. D., Thompson, K., & Berliner, L. (2017) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-017-0796-z · Cited by 65
Body growth and life history in wild mountain gorillas (Gorilla beringei beringei) from Volcanoes National Park, Rwanda
Galbany, J., Abavandimwe, D., Vakiener, M. M., Eckardt, W., Mudakikwa, A. B., Ndagijimana, F., Stoinski, T. S., & McFarlin, S. C. (2017) · American Journal of Physical Anthropology · doi:10.1002/ajpa.23232 · Cited by 64
Mathematics Classroom Observation Protocol for Practices (MCOP 2 ): A validation study
Gleason, J., Livers, S. D., & Zelkowski, J. (2017) · Investigations in Mathematics Learning · doi:10.1080/19477503.2017.1308697 · Cited by 64
Teaching historical thinking and reasoning: Construction of an observation instrument
Gestsdóttir, S. M., van Boxtel, C., & van Drie, J. P. (2018) · British Educational Research Journal · doi:10.1002/berj.3471 · Cited by 64
Retrospective Self-Reported Symptoms of Attention-Deficit Hyperactivity Disorder: Reliability of the Wender Utah Rating Scale
Rossini, E. D., & O'Connor, M. A. (1995) · Psychological Reports · doi:10.2466/pr0.1995.77.3.751 · Cited by 64
Initial validation of the prekindergarten Classroom Observation Tool and goal setting system for data-based coaching.
Crawford, A. D., Zucker, T. A., Williams, J. M., Bhavsar, V., & Landry, S. H. (2013) · School Psychology Quarterly · doi:10.1037/spq0000033 · Cited by 64
Smartphone applications for the evaluation of pathologic shoulder range of motion and shoulder scores—a comparative study
Mejia‐Hernandez, K., Chang, A. C., Eardley-Harris, N., Jaarsma, R. L., Gill, T. K., & McLean, J. M. (2018) · JSES Open Access · doi:10.1016/j.jses.2017.10.001 · Cited by 63
EchoEFNet: Multi-task deep learning network for automatic calculation of left ventricular ejection fraction in 2D echocardiography
Li, H., Wang, Y., Qu, M., Cao, P., Feng, C., & Yang, J. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106705 · Cited by 64
In-session processes of brief motivational interventions in two trials with mandated college students.
Borsari, B. E., Apodaca, T. R., Jackson, K. M., Mastroleo, N. R., Magill, M., Barnett, N. P., & Carey, K. B. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0037635 · Cited by 63
Potential predictors in neonaticide: the impact of the circumstances of pregnancy
Amon, S., Putkonen, H., Weizmann‐Henelius, G., Almiron, M. P., Formann, A. K., Voracek, M., Eronen, M., Yourstone, J., Friedrich, M. H., & Klier, C. M. (2012) · Archives of Women s Mental Health · doi:10.1007/s00737-012-0268-0 · Cited by 63
Validation of a Clinically Sensitive, Observational Coding System for Parenting Behaviors: The Parenting Clinical Observation Schedule
Hill, C., Maskowitz, K., Danis, B., & Wakschlag, L. S. (2008) · Parenting · doi:10.1080/15295190802045469 · Cited by 67
On the reliability and standard errors of measurement of contrast measures from the D-KEFS
CRAWFORD, J. R., SUTHERLAND, D., & Garthwaite, P. H. (2008) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617708081228 · Cited by 63
Crowdsourcing: a valid alternative to expert evaluation of robotic surgery skills
Polin, M. R., Siddiqui, N. Y., Comstock, B. A., Hesham, H., Brown, C. T. A., Lendvay, T. S., & Martino, M. A. (2016) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2016.06.033 · Cited by 63
Comparison of automatic summarisation methods for clinical free text notes
Moen, H., Peltonen, L., Heimonen, J., Airola, A., Pahikkala, T., Salakoski, T., & Salanterä, S. (2016) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2016.01.003 · Cited by 65
Reproducibility and Relative Validity of a Short Food Frequency Questionnaire in 9–10 Year-Old Children
Saeedi, P., Skeaff, S. A., Wong, J. E., & Skidmore, P. M. L. (2016) · Nutrients · doi:10.3390/nu8050271 · Cited by 66
A comparison study of clinician-rated atopic dermatitis outcome measures for intermediate- to dark-skinned patients
Zhao, C. Y., Hao, E. Y., Oh, D. D., Daniel, B. S., Martin, L. K., Su, J. C., Rodrigues, M. A., & Murrell, D. F. (2016) · British Journal of Dermatology · doi:10.1111/bjd.15271 · Cited by 63
Fostering elementary school children's public speaking skills: A randomized controlled trial
Herbein, E., Golle, J., Tibus, M., Schiefer, J., Trautwein, U., & Zettler, I. (2017) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.10.008 · Cited by 75
Is Small Still Beautiful for the Strengths and Difficulties Questionnaire? Novel Findings Using Exploratory Structural Equation Modeling
Garrido, L. E., Barrada, J. R., Aguasvivas, J., Martínez‐Molina, A., Arias, V. B., Golino, H. F., Legaz, E., Ferrís, G., & Rojo‐Moreno, L. (2018) · Assessment · doi:10.1177/1073191118780461 · Cited by 72
Engaging the Hearts and Minds of Followers: Leader Empathy and Language Style Matching During Appraisal Interviews
Meinecke, A. L., & Kauffeld, S. (2018) · Journal of Business and Psychology · doi:10.1007/s10869-018-9554-9 · Cited by 73
Exploring Interaction Fidelity in Virtual Reality
Rogers, K., Funke, J. F., Frommel, J., Stamm, S., & Weber, M. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300644 · Cited by 63
Impact of risk assessment instruments on rates of pretrial detention, postconviction placements, and release: A systematic review and meta-analysis.
Viljoen, J. L., Jonnson, M. R., Cochrane, D. M., Vargen, L. M., & Vincent, G. M. (2019) · Law and Human Behavior · doi:10.1037/lhb0000344 · Cited by 67
Multidimensional assessment of nicotine dependence in adolescents
Clark, D. B., Wood, D. S., Martin, C. S., Cornelius, J. R., Lynch, K. G., & Shiffman, S. S. (2004) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2004.08.019 · Cited by 64
Reynolds Adolescent Depression Scale-second edition: a reliable and useful instrument
Osman, A., Gutierrez, P. M., Bagge, C. L., Fang, Q., & Emmerich, A. (2010) · Journal of Clinical Psychology · doi:10.1002/jclp.20727 · Cited by 62
Protective Effects of Interpersonal Mindfulness for Teachers’ Emotional Supportiveness in the Classroom
Molloy Elreda, L., Jennings, P. A., DeMauro, A. A., Mischenko, P. P., & Brown, J. L. (2019) · Mindfulness · doi:10.1007/s12671-018-0996-y · Cited by 62
Effect of a significant other on client change talk in motivational interviewing.
Apodaca, T. R., Magill, M., Longabaugh, R., Jackson, K. M., & Monti, P. M. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0030881 · Cited by 62
Tree species impact on understory vegetation: Vascular plant communities of Scots pine and Norway spruce managed stands in northern Europe
Petersson, L., Holmström, E., Lindbladh, M., & Felton, A. (2019) · Forest Ecology and Management · doi:10.1016/j.foreco.2019.06.011 · Cited by 62
Testing a deliberate practice workshop for developing appropriate responsivity to resistance markers.
Westra, H. A., Norouzian, N., Poulin, L. E., Coyne, A. E., Constantino, M. J., Hara, K. M., Olson, D. A., & Antony, M. M. (2020) · Psychotherapy · doi:10.1037/pst0000311 · Cited by 62
Psychometric properties of Fagerstrom Test of Nicotine Dependence
Sharma, M., Suman, L. N., Srivastava, K., Suma, N., & Vishwakarma, A. (2021) · Industrial Psychiatry Journal · doi:10.4103/ipj.ipj_51_21 · Cited by 62
“[36] An alpha coefficient of 0.70–0.79 considered as“fair;” an alpha of 0.80–0.89 is “good,” and an alpha of 0.090 or higher is “excellent.””
Influential
Assessing the Alignment of Large Language Models With Human Values for Mental Health Integration: Cross-Sectional Study Using Schwartz’s Theory of Basic Values
Hadar‐Shoval, D., Asraf, K., Mizrachi, Y., Haber, Y., & Elyoseph, Z. (2024) · JMIR Mental Health · doi:10.2196/55988 · Cited by 81
“The obtained ICC was 0.851 (95% CI 0.626-0.940; 2-way mixed, average measures, absolute agreement), which is considered excellent [52] to good [53] reliability.”
BackgroundInfluential
Continuity of care: Validation of a new self-report measure for individuals using mental health services
Durbin, J., Goering, P. N., Streiner, D. L., & Pink, G. H. (2004) · The Journal of Behavioral Health Services & Research · doi:10.1007/bf02287291 · Cited by 62
Assessment of Alcohol and Other Drug Use by Runaway Youths
Slesnick, N., & Tonigan, J. S. (2004) · Alcoholism Treatment Quarterly · doi:10.1300/j020v22n02_03 · Cited by 62
The Effects of Using Concept Mapping for Improving Advanced Level Biology Students' Lower- and Higher-Order Cognitive Skills
Bramwell-Lalor, S., & Rainford, M. (2013) · International Journal of Science Education · doi:10.1080/09500693.2013.829255 · Cited by 66
Measuring Change in Social Interaction Skills of Young Children with Autism
Cunningham, A. (2011) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-011-1280-3 · Cited by 68
Psychometric Properties of the Alcohol Use Disorders Identification Test: A Korean Version
Kim, S. S., Gulick, E. E., Nam, K. A., & Kim, S. H. (2008) · Archives of Psychiatric Nursing · doi:10.1016/j.apnu.2007.07.005 · Cited by 62
Estandarización de la Escala Wechsler de Inteligencia Para Adultos-Cuarta Edición en Chile
Rosas, R., Tenorio, M., Pizarro, M., Cumsille, P., Bosch, A., Carvajal, S. A., Carmona, M., Pérez-Salas, C., Pino, E., Vizcarra, B., et al. (2014) · Psykhe (Santiago) · doi:10.7764/psykhe.23.1.529 · Cited by 80
Arthroscopic Versus Open Ankle Arthrodesis: A Systematic Review
Park, J. H., Kim, H. J., Suh, D. H., Lee, J. W., Kim, H. J., Oh, M. J., & Choi, G. W. (2017) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2017.08.284 · Cited by 62
Follower behavior renders leader behavior endogenous: The simultaneity problem, estimation challenges, and solutions
Güntner, A. V., Klonek, F. E., Lehmann‐Willenbrock, N., & Kauffeld, S. (2020) · The Leadership Quarterly · doi:10.1016/j.leaqua.2020.101441 · Cited by 62
The stereotyped behavior scale: psychometric properties and norms
Rojahn, J., Matlock, S. T., & Tassé, M. J. (2000) · Research in Developmental Disabilities · doi:10.1016/s0891-4222(00)00057-3 · Cited by 62
Estimating the reliability of a test split into two parts of equal or unequal length.
Feldt, L. S., & Charter, R. A. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.1.102 · Cited by 62
Rank2Tell: A Multimodal Driving Dataset for Joint Importance Ranking and Reasoning
Sachdeva, E., Agarwal, N., Chundi, S., Roelofs, S., Li, J., Kochenderfer, M., Choi, C., & Dariush, B. (2024) · 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv57701.2024.00734 · Cited by 63
“To assess the quality of the dataset, we compute intra-class correlation (ICC) [34] for the entire dataset, yielding 0.92, which shows excellent inter-rater agreement [7].”
MethodInfluential

Authors: Cicchetti, D. V.
Affiliations: Veterans Health Administration (US)
Corresponding author: Cicchetti, Domenic V.
Venue: Psychological Assessment
Publisher: American Psychological Association (APA)
Published: 1994-12
Volume: 6
Issue: 4
Pages: 284-290
ISSN: 1040-3590 (ISSN-L)
1939-134X
DOI: 10.1037/1040-3590.6.4.284
OpenAlex: W2063085086
Cited by: 9,349
References: 43
Citations by year: 2026: 538 · 2025: 654 · 2024: 693 · 2023: 753 · 2022: 842 · 2021: 886 · 2020: 882 · 2019: 825 · 2018: 786 · 2017: 611 · 2016: 355 · 2015: 308 · 2014: 209 · 2013: 152 · 2012: 139
FWCI: 17.61
Type: journal article
Language: en
Open access: closed
Locations: Psychological Assessment (publishedVersion)
Topics: Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
Keywords: test selection, standardized assessment, test standardization, test norming, test reliability, test validity, psychometrics, test development, cognitive assessment, personality assessment, adaptive behavior, children and adolescents, adults, older adults, disability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks