The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Intraclass correlations: Uses in assessing rater reliability.
Abstract
Reliability coefficients often take the form of intraclass correlation coefficients. In this article, guidelines are given for choosing among six different forms of the intraclass correlation for reliability studies in which n target are rated by k judges. Relevant to the choice of the coefficient are the appropriate statistical model for the reliability and the application to be made of the reliability results. Confidence intervals for each of the forms are reviewed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As a result, the inter-rater agreement was quite high for categorical variables (mean Cohen's kappa = 0.73, SD = 0.13) and for continuous variables (mean intraclass correlation [26] = 0.80, SD = .14).”
From Social Relationships and Mortality Risk: A Meta-analytic Review (2010) · cites this paper as [26]
In the citing paper
“we used the methodology Shrout and Fleiss (1979) describe and computed the Shrout-Fleiss single ICC score agreement of .998, which is considered quite high (Koo and Li 2016).”
From Driving Brand Engagement Through Online Social Influencers: An Empirical Investigation of Sponsored Blogging Campaigns (2019) · cites this paper as Shrout and Fleiss (1979)
In the citing paper
“In contrast, Cohen's quadratically weighted kappa converges to two-factor intraclass correlation coefficients with random and fixed raters (i.e., the so-called ICC (2,1) and ICC(3,1) coefficients), where the items and raters are the two factors (Carrasco, 2010;Fleiss & Cohen, 1973;Janson & Olsson, 2001;Schuster, 2004;Schuster & Smith, 2005;Shrout & Fleiss, 1979;Warrens, 2014).”
From Quadratically Weighted Agreement Coefficients: Interpretations and Connections (2026) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“A sample of 11% of video data was double coded by the researcher and an experienced coder (the developer of CHIPPA). Inter‐rater reliability was based on intra‐class correlation (ICC) statistics from the mean rating for the two coders (k = 2) using a two‐way mixed effects consistency model (see Table 2 below) and resulted in good to excellent reliability across the CHIPPA subscales (Koo & Li, 2016”
From A plausible role of imagination in pretend play, counterfactual reasoning, and executive functions (2023) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“The results suggest that coders showed high agreement (intraclass correlation [2, 1] = 0.85; Shrout & Fleiss, 1979).”
From Respiratory and cognitive mediators of treatment change in panic disorder: Evidence for intervention specificity. (2010) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“Interrater reliability of the pre- and posttreatment assessments was excellent (intraclass correlations [2, 1] = 0.97 and 0.96, respectively; Shrout & Fleiss, 1979).”
From Respiratory and cognitive mediators of treatment change in panic disorder: Evidence for intervention specificity. (2010) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“ICC decomposes observed variance into between-query variance (task difficulty) and within-query variance (agent inconsistency), highlighting whether reported results reflect true capability or measurement noise.”
From Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation (2025) · cites this paper as Shrout and Fleiss 1979
In the citing paper
“The ICC quantifies the proportion of total variance attributable to differences between tasks and can be understood as a function of both the difficulty of the dataset (variance between tasks) and the consistency of the agent (variance within tasks).”
From Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation (2025) · cites this paper as Shrout and Fleiss 1979
In the citing paper
“Reproducibility of the final placenta, fetus and amniotic fluid volume in millilitres was assessed using the ICC (2,1) [37], [38] for inter-observer repeatability between the semi-automated Random Walker results, regarded as the ground-truth used for performance evaluation, and the newly generated FCNN outputs.”
From Fully Automated 3-D Ultrasound Segmentation of the Placenta, Amniotic Fluid, and Fetus for Early Pregnancy Assessment (2021) · cites this paper as [37]
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 27,137
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.3102/00028312006001112 · Cited by 8,013
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,012
Snedecor, G. W., & Cochran, W. G. (1967) · Cited by 6,573
Scheffé, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,625
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
The Intraclass Correlation Coefficient as a Measure of Reliability
Bartko, J. (1966) · Psychological Reports · doi:10.2466/pr0.1966.19.1.3 · Cited by 2,206
Statistics for the social sciences
Hays, W. L. (1973) · Medical Entomology and Zoology · Cited by 2,081
The theory of the estimation of test reliability
Kuder, G. F., & Richardson, M. W. (1937) · Psychometrika · doi:10.1007/bf02288391 · Cited by 1,953
Cited by
Sorted by citations
Items 22,601–22,700 of 23,883
Vurma, A., Meister, E., Meister, L., et al. (2025) · Music Perception An Interdisciplinary Journal · doi:10.1525/mp.2025.2675211
Perception of Vocal Tremor After Deep Brain Stimulation in Varying Speech Contexts
Belsky, M. A., Ma, Y., Halpern, C. H., et al. (2025) · Journal of Voice · doi:10.1016/j.jvoice.2025.09.026
Tamura, I., Tajima, M., Kumano, S., & Otsuka, K. (2025) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3716553.3750801
Lesnovska, K. P., Schäfer, S., Zabana, Y., Anes, I. F., Guagnozzi, D., Mihály, E., Miehlke, S., Madisch, A., Marinoni, B., Latella, G., et al. (2025) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjaf153
Towards Robust Brain Midline Shift Detection: A YOLO-Based 3D Slicer Extension with a Novel Dataset
Pehli̇vanoğlu, M. K., Albayrak, N. B., Karhan, D., et al. (2025) · Neuroinformatics · doi:10.1007/s12021-025-09748-z
Haider, M. F., Aslam, M., Azfar, R. W., et al. (2025) · International Journal of Construction Management · doi:10.1080/15623599.2025.2567749
Vanderweyen, D., Seifeldine, K., Philibert, M., et al. (2025) · Research Square · doi:10.21203/rs.3.rs-7715526/v1
Kitadai, Y., Takigawa, H., Nagao, A., et al. (2025) · Helicobacter · doi:10.1111/hel.70079
Zhao, Y., Wang, H., Tse, C., & Chen, Q. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02849-2
Thakur, K., & Goyal, M. (2025) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2025.09.030
Limited predictive value of L1 picture-norms for L2 picture-naming performance
Hirosh, Z., Kreiner, H., & Degani, T. (2025) · Applied Psycholinguistics · doi:10.1017/s0142716425100179
Financial advice behavior: humans versus AIPreprint
Baeckström, Y., & Matkovskyy, R. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5626138
Veerasathian, T., Rattanapitoon, S. K., Thitimahatthanakusol, P., & Rattanapitoon, N. K. (2025) · Clinical Neurology and Neurosurgery · doi:10.1016/j.clineuro.2025.109203
Goikoetxea-Sotelo, G., & van Hedel, H. J. A. (2025) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2025.1641003 · Cited by 1
Test-retest reliability of edge-level resting-state functional connectivity in people with aphasia
Johnson, J. P., Dickey, M. W., Bohland, J. W., & Hula, W. D. (2025) · Neuroimage Reports · doi:10.1016/j.ynirp.2025.100296
Computed Tomography Appearance and Characteristics of Presumptively Normal Brachial Plexus in Dogs
Hummel, I., Passon‐Vastenburg, M., & den Hertog, E. (2025) · Veterinary Radiology & Ultrasound · doi:10.1111/vru.70102
Ma, Y. (2025) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2025.102036
Zhu, M., Willems, P. J. B., Marcellis, R. G. J., et al. (2025) · Gait & Posture · doi:10.1016/j.gaitpost.2025.110016
Reliability of ultrasound measurement of glenohumeral instability
Malmberg, C. A. E., Andreasen, K. R., Bencke, J., Kjær, B. H., Hölmich, P., & Barfod, K. W. (2025) · Danish Medical Journal · doi:10.61409/a11240835
Svoboda, E., Marciniak, A., Pinzón, A., Bořil, T., Wada, N., Alexandrov, B., Hatabu, H., Guttmann, C. R. G., & Valtchinov, V. I. (2025) · doi:10.2196/preprints.84773
Meta4BR: Avaliando a Fidelidade Metafórica em Traduções de Metáforas para o Português por LLMs
Stellet, L., Leite, I., Assis, G., & Paes, A. (2025) · Simpósio Brasileiro de Tecnologia da Informação e da Linguagem Humana (STIL) · doi:10.5753/stil.2025.37845
Ruíz-Íñiguez, R., Sacristán-Martín, O., Burgos-Julián, F. A., Casillas-Barragán, B., Resurrección, D., & Duncan, L. G. (2025) · Mindfulness · doi:10.1007/s12671-025-02694-6
Sarkkinen, E., Niemistö, D., Luukkainen, N., et al. (2025) · Journal of Motor Learning and Development · doi:10.1123/jmld.2025-0028
Ohyama, T. (2025) · Japanese Journal of Biometrics · doi:10.5691/jjb.46.75
Xu, Y., Dong, J., Fan, Y., Shao, Y., Jiang, C., Jin, L., Cao, Y., & Li, Q. (2024) · International Symposium of Chinese CHI (Chinese CHI) · doi:10.1145/3758871.3758887
Principles of Psychological Assessment
Goodby, E., & Haynes, P. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009028967.008
Optimizing the mirror illusion during mirror therapy: evidence from unimpaired individuals
Kim, J.-M., Challis, F. O., Koo, C. C. Y., Leung, C. L., Lo, L. H., Yeo, S.-H., & Punt, T. D. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1666002
Characterization of cutaneous reflexes elicited from saphenous nerve stimulationPreprint
Hardesty, R. L., Parra, S. R., Wolpaw, J. R., & Brangaccio, J. A. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.10.30.685609
Spanish adaptation of the Primary Lateral Sclerosis Functional Rating Scale (PLSFRS)
Puchades, A. C., Panadés, M. P., Sintes, M. B., et al. (2025) · Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration · doi:10.1080/21678421.2025.2574678
Uncertainty-adjusted gender bias in student evaluations of teachingPreprint
Castagnetti, C., & Töpfer, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5691232
Liu, Y., Wang, P., Han, H., & Clarkson, P. J. (2025) · Ergonomics · doi:10.1080/00140139.2025.2580412
Li, X., Kim, Y., Son, I., et al. (2025) · Medicina · doi:10.3390/medicina61111963
Monfort-Pañego, M., Łabęcka, M. K., Miñana-Signes, V., et al. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14217793
Wu, C., Chan, R. W., Chiang, Y.-N., et al. (2025) · Journal of Speech Language and Hearing Research · doi:10.1044/2025_jslhr-25-00341
Yu, L., Cui, L., Cui, L., et al. (2025) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2025.102661
Alberola‐Zorrilla, P., Ugarte, R. E., Pérez‐Alenda, S., et al. (2025) · Health Science Reports · doi:10.1002/hsr2.71443
Schröder, A., & Lundqvist, L. (2025) · International Journal of Nursing Practice · doi:10.1111/ijn.70082
Lee, H. S., Kim, K. B., Ko, J. H., et al. (2025) · Medicine · doi:10.1097/md.0000000000045057
Young, D. L., Ling, L., Zhang, C., et al. (2025) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2025.10.015
Akbarifar, F., Maghsoodi, N., Dukelow, S. P., Scott, S. H., & Mousavi, P. (2026) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-026-02012-8
Selecting monitor and wall luminance levels in office settings: An adaptive experimental study
Daneels, R., Clauwaert, J., Meuret, Y., & Ryckaert, W. R. (2025) · Applied Ergonomics · doi:10.1016/j.apergo.2025.104679
BRUSSONI, M. J., Ramsden, R., Grieve, S., Mount, D., Fox, E. A., Herrington, S., Lin, Y., Johnson, S. E., Lloyd, J. L., Elliot, E., et al. (2025) · JMIR Research Protocols · doi:10.2196/77956
Beyond Fog: Measuring Managerial Obfuscation Using LLMPreprint
Wang, R. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5719297
How collective culture and trust bridge leadership and instruction: A moderated mediation model
Ay, İ., & Okçu, V. (2025) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-025-01054-1
Mackanga, J., Fischer-Lokou, J., & Guéguen, N. (2025) · Cogent Psychology · doi:10.1080/23311908.2025.2581455
Hayes, H., Presson, A. P., Zhang, C., et al. (2025) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2025.11.001
The perception of prosocial agents by chimpanzees and humans
Brocard, S., Berton, C., Wilson, V. A. D., Bickel, B., & Zuberbühler, K. (2025) · Royal Society Open Science · doi:10.1098/rsos.250916
Document Encoding Effects on Large Language Model Response Time and Consistency
Martes, D. O., & Kachouie, N. N. (2025) · Computers · doi:10.3390/computers14110493
Singerman, L. J., Gugiu, C., Tschosik, E., Doll, H., Singerman, B., & Gentile, B. (2025) · Retina · doi:10.1097/iae.0000000000004625
Advancing text summarization with specialized datasets: computer science and geography domains
Faheem, H. B., Wali, A., Muzammil, S., Mahmood, H., Sarfraz, S., & Asif, H. (2025) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqaf124
Drijver, H. E., Didden, R., & Schuengel, C. (2025) · Journal of Applied Research in Intellectual Disabilities · doi:10.1111/jar.70150 · Cited by 1
Bhutada, A. M., Carnaby, G., Broughton, W. A., Beverly, B. L., & Garand, K. L. (2025) · Perspectives of the ASHA Special Interest Groups · doi:10.1044/2025_persp-25-00034
Abolhassani, N., Fustinoni, S., & Henchoz, Y. (2025) · BMC Geriatrics · doi:10.1186/s12877-025-06494-4
Behavioral syndromes are associated with social plasticity and competence in a wild primate
Tkaczynski, P., Campbell, L., MacLarnon, A. M., et al. (2025) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-025-03670-9
Theiss, L., Lou, C., & Jagodzinski, M. (2025) · Journal of Medical Engineering & Technology · doi:10.1080/03091902.2025.2591761
Comparing Teacher Professional Development Initiatives in Three Caribbean Countries
Bissessar, C. S. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64802-411-520251004
Carballo-Afonso, R., Ayán, C., Varela, S., et al. (2025) · Perceptual and Motor Skills · doi:10.1177/00315125251392450
Tanaka, M. J., Crasta, N., Hammerle, M. V. V., et al. (2025) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.25.00707
Nielsen, F. K., Jurik, A. G., Lindgren, L., & Egund, N. (2025) · Acta Radiologica · doi:10.1177/02841851251394540
May, A. K., Holland, A. E., Hill, C. J., Bondarenko, J., Walsh, J., Morris, N. R., Hayes, K., & Dowman, L. (2025) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000003899
Shirado, K., Kido, T., Kawabata, N., et al. (2025) · Cureus · doi:10.7759/cureus.97690
Leysens, G., Corput, E. V. D., Feyaerts, A. F., et al. (2025) · Discover Education · doi:10.1007/s44217-025-00556-w
Edger-Lacoursière, Z., Calva, V., Germain, N., Malo-Leclerc, I., Marois-Pagé, E., Schneider, G., Shashoua, D., Tremblay, C., Vaillancourt, A., Sawicki, J., et al. (2025) · Burns · doi:10.1016/j.burns.2025.107804
Observational studies in educational contexts: Key issues and challenges
Kitsantas, A., Cheema, J., Park, J. Y., & Kitsantas, P. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-26629-4.00185-4
Multi-technique approach for the characterization of titanium dioxide color additive
Khan, S. A., Dong, S., Ferguson, M. S., et al. (2025) · NanoImpact · doi:10.1016/j.impact.2025.100599
Kantor, J., Vanderslott, S., Morrison, M. C., et al. (2025) · Vaccines · doi:10.3390/vaccines13121200
Park, K.-M., Lee, D., Lee, J., Beom, J., & Lee, S. J. (2025) · Biomedical Engineering Letters · doi:10.1007/s13534-025-00534-z · Cited by 1
Agonias, K. B., Birch, J. G., Sucato, D. J., et al. (2025) · Journal of Pediatric Orthopaedics · doi:10.1097/bpo.0000000000003174
Disentangling The Effect of Uncertainty Types on Alliance Governance Choice
Mellewigt, T., Madhok, A., Weller, I., Keyhani, M., & König, F. (2016) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-68123-502-820251002
Racine, E., Bégin-Pépin, M., & Benoit‐Biancamano, M. (2025) · Journal of Veterinary Diagnostic Investigation · doi:10.1177/10406387251395204
Martínez-Martin, M. S., García, M. E. G., Araujo-Ruano, E. J., et al. (2025) · Thyroid Research · doi:10.1186/s13044-025-00275-2
Ma, M. K.-H., Fong, M. C., & Wang, W. Y. (2025) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc58623.2025.11251614
Longitudinal Stability of Detrended Fluctuation Analysis in Monthly Recorded EEG Signals *
Uudeberg, T., Päeske, L., & Bachmann, M. (2025) · doi:10.1109/embc58623.2025.11253319
Reliable Objective Assessment of Friedreich Ataxia Through Isolation Forest-Based Anomaly Detection
Ranaweera, K., Randeniya, M., Pathirana, P. N., et al. (2025) · doi:10.1109/embc58623.2025.11253335
Yee, A., Brooks, W. J., Palchik, G. A., et al. (2025) · Journal of Osteopathic Medicine · doi:10.1515/jom-2025-0084
Quality and Multifunctionality in Mobile Apps for Gestational Diabetes: Systematic App Review
Zhao, Q., Cooke, A., Huang, L., Tang, Y., & Dowding, D. (2025) · JMIR mhealth and uhealth · doi:10.2196/76862
Listener Ratings of Stuttering: Evaluating Two Auditory–Perceptual Scales
Johnson, A., Bullen, A., Sokolov, S., Eadie, T. L., Kokaly, M., & Cler, G. J. (2025) · Journal of Speech Language and Hearing Research · doi:10.1044/2025_jslhr-25-00109
Wong, Y. S., Pye, R. E., Su, I.-A., Ceci, S. J., Hamsan, H. H., Kamaluddin, M. R., Badayai, A. R. A., & Chung, K. L. (2025) · Psychology Crime and Law · doi:10.1080/1068316x.2025.2598297
Rey-Osterrieth Complex Figure copy scoring systems in a dementia clinic sample
Ashendorf, L., Taylor, B., & Kelly, M. M. (2025) · The Clinical Neuropsychologist · doi:10.1080/13854046.2025.2595225
Felker, G., Girard, E., Beauger, D., et al. (2025) · Journal of Pharmaceutical Health Services Research · doi:10.1093/jphsr/rmaf023
Personality, Stereotypy, and Responses to Crate Entry in Captive Giant Pandas
Li, M., Fan, X., Huang, H., Zhang, H., Li, H., Zhao, X., Peng, W., Yin, H. J., Deng, T., Wu, K., et al. (2025) · Animals · doi:10.3390/ani15243535 · Cited by 1
Gaile, M., Simona, S., Larsson, P., et al. (2025) · Medicina · doi:10.3390/medicina61122180
Huang, C., Abdelfattah, A., DeRuiter, R. M., et al. (2025) · Journal of the American Society of Nephrology · doi:10.1681/asn.0000000968
How Deep Is Their Understanding? The Illusion of Explanatory Depth in Pediatric Dentistry TrainingPreprint
Šurdilović, D., Padmanabhan, V., Islam, M. S., et al. (2025) · Research Square · doi:10.21203/rs.3.rs-8262006/v1
Zuo, L., An, Y., Liu, X., et al. (2025) · Abdominal Radiology · doi:10.1007/s00261-025-05287-y
Sanguino-Jaramillo, M., Domínguez-Vargas, A., Galeano-Lopez, J., & Cavadía-Carrascal, G. (2025) · Journal Français d Ophtalmologie · doi:10.1016/j.jfo.2025.104710
Lam, W. Y. S., Kwong, E., Leung, R. C. K., et al. (2025) · Sensors · doi:10.3390/s25237396
Epifani, S., Castigliego, G., Razzicchia, G., Seiwald-Sonderegger, E., & Kecskemeti, L. (2026) · JMIR AI · doi:10.2196/90750
Meler, A. (2025) · Social Network Analysis and Mining · doi:10.1007/s13278-025-01538-4
Zandstra, N., Derksen, E. W. C., Miggiels, M. F., Dekker, J., ten Klooster, P. M., Beekman, A. T. F., & van Dijk, M. K. (2025) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2602004
Spontaneous Fluctuations in Alpha Peak Frequency along the Posterior-to-Anterior Cortical Plane
Balaji, V., Schnitzler, A., & Lange, J. (2025) · eNeuro · doi:10.1523/eneuro.0118-25.2025
THE STAFF-MEETING BEHAVIORS OF EFFECTIVE, GOAL-FOCUSED LEADERS
Karip, M. S. (2014)
Quantifying motor control of the lumbar spine by a dynamic sitting device; a pilot reliability study
Gijssel, M. (2011) · Utrecht University Repository (Utrecht University)
Defay, D. K., Southard, T. E., Lidral, A. C., et al. (2011) · doi:10.17077/etd.9hqq3ok6
Camp, J. (2012) · Digital Scholarship - UNLV (University of Nevada Reno) · doi:10.34917/4332638
van Alphen, J. B. (2013) · Utrecht University Repository (Utrecht University)
Multiple pathologies in dementia : correlations with clinical diagnoses
Echávarri, C. (2012) · Research Publications (Maastricht University) · doi:10.26481/dis.20121018ce
Defining a “Good” Communimetric Measurement Tool
Lyons, J. S. (2009) · Springer eBooks · doi:10.1007/978-0-387-92822-7_4
Gabin, M. (2009) · Unitec Research Bank (Unitec Institute of Technology)
Metadata
- Authors
- Shrout, P. E., & Fleiss, J. L.
- Affiliations
- Columbia University (US)
- ORCID
- Shrout, Patrick E.
- Venue
- Psychological Bulletin
- Published
- 1979
- Volume
- 86
- Issue
- 2
- Pages
- 420-428
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2141403362
- Cited by
- 24,532
- References
- 20
- Citations by year
- 2026: 1452 · 2025: 1085 · 2024: 998 · 2023: 1023 · 2022: 1083 · 2021: 1379 · 2020: 1189 · 2019: 1116 · 2018: 1178 · 2017: 1113 · 2016: 1106 · 2015: 1057 · 2014: 1172 · 2013: 1044 · 2012: 914
- FWCI
- 13.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Multidisciplinary Science and Engineering Research
- Keywords
- intraclass correlation coefficient, rater reliability, inter-rater reliability, reliability coefficients, confidence intervals, multiple raters
- MeSH terms
- Humans, Reproducibility of Results, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
