The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Intraclass correlations: Uses in assessing rater reliability.
Abstract
Reliability coefficients often take the form of intraclass correlation coefficients. In this article, guidelines are given for choosing among six different forms of the intraclass correlation for reliability studies in which n target are rated by k judges. Relevant to the choice of the coefficient are the appropriate statistical model for the reliability and the application to be made of the reliability results. Confidence intervals for each of the forms are reviewed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As a result, the inter-rater agreement was quite high for categorical variables (mean Cohen's kappa = 0.73, SD = 0.13) and for continuous variables (mean intraclass correlation [26] = 0.80, SD = .14).”
From Social Relationships and Mortality Risk: A Meta-analytic Review (2010) · cites this paper as [26]
In the citing paper
“we used the methodology Shrout and Fleiss (1979) describe and computed the Shrout-Fleiss single ICC score agreement of .998, which is considered quite high (Koo and Li 2016).”
From Driving Brand Engagement Through Online Social Influencers: An Empirical Investigation of Sponsored Blogging Campaigns (2019) · cites this paper as Shrout and Fleiss (1979)
In the citing paper
“In contrast, Cohen's quadratically weighted kappa converges to two-factor intraclass correlation coefficients with random and fixed raters (i.e., the so-called ICC (2,1) and ICC(3,1) coefficients), where the items and raters are the two factors (Carrasco, 2010;Fleiss & Cohen, 1973;Janson & Olsson, 2001;Schuster, 2004;Schuster & Smith, 2005;Shrout & Fleiss, 1979;Warrens, 2014).”
From Quadratically Weighted Agreement Coefficients: Interpretations and Connections (2026) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“A sample of 11% of video data was double coded by the researcher and an experienced coder (the developer of CHIPPA). Inter‐rater reliability was based on intra‐class correlation (ICC) statistics from the mean rating for the two coders (k = 2) using a two‐way mixed effects consistency model (see Table 2 below) and resulted in good to excellent reliability across the CHIPPA subscales (Koo & Li, 2016”
From A plausible role of imagination in pretend play, counterfactual reasoning, and executive functions (2023) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“The results suggest that coders showed high agreement (intraclass correlation [2, 1] = 0.85; Shrout & Fleiss, 1979).”
From Respiratory and cognitive mediators of treatment change in panic disorder: Evidence for intervention specificity. (2010) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“Interrater reliability of the pre- and posttreatment assessments was excellent (intraclass correlations [2, 1] = 0.97 and 0.96, respectively; Shrout & Fleiss, 1979).”
From Respiratory and cognitive mediators of treatment change in panic disorder: Evidence for intervention specificity. (2010) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“ICC decomposes observed variance into between-query variance (task difficulty) and within-query variance (agent inconsistency), highlighting whether reported results reflect true capability or measurement noise.”
From Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation (2025) · cites this paper as Shrout and Fleiss 1979
In the citing paper
“The ICC quantifies the proportion of total variance attributable to differences between tasks and can be understood as a function of both the difficulty of the dataset (variance between tasks) and the consistency of the agent (variance within tasks).”
From Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation (2025) · cites this paper as Shrout and Fleiss 1979
In the citing paper
“Reproducibility of the final placenta, fetus and amniotic fluid volume in millilitres was assessed using the ICC (2,1) [37], [38] for inter-observer repeatability between the semi-automated Random Walker results, regarded as the ground-truth used for performance evaluation, and the newly generated FCNN outputs.”
From Fully Automated 3-D Ultrasound Segmentation of the Placenta, Amniotic Fluid, and Fetus for Early Pregnancy Assessment (2021) · cites this paper as [37]
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 27,137
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.3102/00028312006001112 · Cited by 8,013
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,012
Snedecor, G. W., & Cochran, W. G. (1967) · Cited by 6,573
Scheffé, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,625
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
The Intraclass Correlation Coefficient as a Measure of Reliability
Bartko, J. (1966) · Psychological Reports · doi:10.2466/pr0.1966.19.1.3 · Cited by 2,206
Statistics for the social sciences
Hays, W. L. (1973) · Medical Entomology and Zoology · Cited by 2,081
The theory of the estimation of test reliability
Kuder, G. F., & Richardson, M. W. (1937) · Psychometrika · doi:10.1007/bf02288391 · Cited by 1,953
Cited by
Sorted by citations
Items 22,501–22,600 of 23,883
Schwannborg, L. R., Starholm, I. M., Solberg, M. B., Langseth, I. I., & Gjøvaag, T. F. (2025) · Prosthetics and Orthotics International · doi:10.1097/pxr.0000000000000455
Clusters and case vignettes of impaired maternal–fetal bonding in pregnancy: A mixed method approach
Kitamura, T., Hada, A., Usui, Y., & Ohashi, Y. (2025) · Psychiatry and Clinical Neurosciences Reports · doi:10.1002/pcn5.70127
A selective approach to human age estimation: a case study of cranial suture closure methods
Shirobokov, I. G. (2025) · Vestnik arheologii, antropologii i ètnografii · doi:10.20874/2071-0437-2025-69-2-13
Drummond, K. N., Guzick, A. G., Spencer, S. D., Pinciotti, C. M., Bivins, E. J., Minhajuddin, A., Slater, H., Gorman, A., Goodman, L. C., Walker, R. A., et al. (2025) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.70088
Fahimfar, N., Eghtesad, S., Poustchi, H., Kohansal, K., Sepanlou, S. G., Ostovar, A., Esmaeili-Nadimi, A., Bahramali, E., Pourfarzi, F., Ghaffari, S., et al. (2025) · Journal of Public Health · doi:10.1093/pubmed/fdaf037
Raimundo, J. A. G., Tramontin, A. F., Martins, E. C., et al. (2025) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0000000000005154
Zadok, E., Ben-Moshe, Z., Gordon, I., & Golan, O. (2025) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-025-06903-y
Hytman, L., Mansueto, S., Chan, J., et al. (2025) · JAACAP Open · doi:10.1016/j.jaacop.2025.06.005
Pharmacokinetics and behavioural effects of a single oral dose of trazodone in rabbits
Gibert, A., Watanabe, R., Garbin, M., Juette, T., Beaudry, F., Desmarchelier, M. R., & Benedetti, I. C. (2025) · Veterinary Anaesthesia and Analgesia · doi:10.1016/j.vaa.2025.06.006
Schwantz, P. I., Klein, L. L., Douglas, A., et al. (2025) · International Journal of Sustainability in Higher Education · doi:10.1108/ijshe-06-2024-0392
Morrow, D. F., Thurman, H., Martin, M. C., Weirich, M. R., & Moore, A. B. (2025) · Journal of Applied Gerontology · doi:10.1177/07334648251353262
İlhan, M., Arslan, S. A., & Sertel, M. (2025) · European Spine Journal · doi:10.1007/s00586-025-09088-1
A survey and evaluation of text-to-speech systems for the Tamil language
Mahaganapathy, A., & Sarveswaran, K. (2025) · Natural Language Processing Journal · doi:10.1016/j.nlp.2025.100171
Yang, M., Qiu, Y., Bi, L., Xian, J., Li, Z., Yao, J., & Jin, H. (2025) · Life Sciences in Space Research · doi:10.1016/j.lssr.2025.06.010
Fu, P., Huang, Y., Huang, K., et al. (2025) · European Spine Journal · doi:10.1007/s00586-025-09097-0
Information Spillover in ‘Resting Memory’ and ‘Working Memory’Preprint
Koten, J. W., Vogrin, M., Wood, G. M. D. O., & Manner, H. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.06.26.661694
Effectiveness of Mental Countermeasures in Psychophysiological Detection of Deception
Kim, K., Hong, H., Hyung-Ki, J., et al. (2025) · Korean Journal of Stress Research · doi:10.17547/kjsr.2025.33.2.111
Automatically Deriving Developers’ Technical Expertise from the GitHub Social Network
Sun, Y., Wu, J., Zhao, X., Xu, H., Zhu, Y., Chen, Z., Wang, S., Jiang, H., & Huang, G. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3746451
Castillejos-Carrasco-Muñoz, R., Tapia-Toca, M. C., Ibáñez‐Vera, A. J., Peinado-Rubia, A. B., Sedeño-Vidal, A., & Lomas‐Vega, R. (2025) · Journal of Vestibular Research · doi:10.1177/09574271251357177
Dehghani, A., Keshavarzi, A., & Pourfarid, Y. (2025) · BMC Neurology · doi:10.1186/s12883-025-04270-w
Banditsaowapak, P., & Cheng, J. H.-C. (2025) · Journal of Dental Sciences · doi:10.1016/j.jds.2025.06.009
Billings, W. Z., Ge, Y., Skarlupka, A. L., et al. (2025) · medRxiv · doi:10.1101/2025.07.01.25330674
Validity and reliability of the KTT an isokinetic knee torque evaluation device
Meereis-Lemos, E. C. W., & Mota, C. B. (2025) · Journal of Bodywork and Movement Therapies · doi:10.1016/j.jbmt.2025.07.002
MRI‐Based Evaluation Improves the Validity of Rodent Nerve Regeneration Studies
Ogawa, K., Mahara, A., Morimoto, N., & Yamaoka, T. (2025) · Advanced Healthcare Materials · doi:10.1002/adhm.202501631
Stanford, S. E., Nickerson, A. B., Lopata, C. J., Fredrick, S. S., Donnelly, J. P., Rodgers, J. D., & Thomeer, M. L. (2025) · Focus on Autism and Other Developmental Disabilities · doi:10.1177/10883576251353482
Boselie, J. J. L. M., Hanssen, M. M., Vancleef, L. M. G., & Peters, M. L. (2025) · International Journal of Applied Positive Psychology · doi:10.1007/s41042-025-00238-w
Guo, Y., Peng, H., & Zhu, B. (2025) · PsyCh Journal · doi:10.1002/pchj.70039
Characterization of Nanoparticles in Titanium Dioxide Articles of CommercePreprint
Khan, S. A., Dong, S., Ferguson, M. S., et al. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5349667
Adaptation and Psychometric Evaluation of the Evidence-Based Practice Mentoring Scale into Turkish
Erden, Y., Ulupınar, F., & Uludağ, E. (2025) · Journal of Midwifery and Health Sciences · doi:10.62425/esbder.1503604
Schumayer, S., Laukhuf, J., & Straßer, T. (2025) · Current Eye Research · doi:10.1080/02713683.2025.2531524 · Cited by 1
Paköz, B., Durguncu, D., Düzgün, İ., et al. (2025) · Journal of Sport Rehabilitation · doi:10.1123/jsr.2024-0401
Drisko, J. W., & Maschi, T. M. (2015) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780190215491.002.0004
(2015) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780190215491.002.0044
Mariño, C. V., Caro‐Cañizares, I., Barrigón, M. L., et al. (2025) · Psiquiatría Biológica · doi:10.1016/j.psiq.2025.100741
Validation of 4D Ultrasound Strain Imaging of the Aortic Wall
Blasé, C., Derwich, W., Hegner, A., Schmitz‐Rixen, T., Oikonomou, K., Huß, A., & Wittek, A. (2025) · Lecture notes in bioengineering · doi:10.1007/978-3-031-94128-3_2
Designing mixed-reality narratives for life routines: a divergence-convergence approach
Chow, K. K. N. (2025) · Digital Creativity · doi:10.1080/14626268.2025.2528091
Eshun, S., Banyeh, M., & Frimpong¹, E. K. (2025) · Research Square · doi:10.21203/rs.3.rs-7025187/v1
Wu, B. (2025) · International Journal For Multidisciplinary Research · doi:10.36948/ijfmr.2025.v07i04.50932
Owusu-Darko, I. (2025) · International Journal of Latest Technology in Engineering Management & Applied Science · doi:10.51583/ijltemas.2025.1406000113
Students’ Perceptions of Teaching Quality
Jakšić, K., & Burić, I. (2025) · Psihologijske teme · doi:10.31820/pt.34.2.2
Investigating microvascular outcomes with ischemic preconditioning and passive stretch
Fenn, S. A., Dobbs, W. C., Walker, M. K., Scheuermann, B., & Caldwell, J. T. (2025) · Physiological Reports · doi:10.14814/phy2.70474
Maes, L., Peluso, J. P., Benzakoun, J., Demeestere, J., Khan, C. F., Desfontaines, P., Pauw, A. D., Collins, R., McCabe, D. J. H., Cronin, S., et al. (2025) · European Radiology · doi:10.1007/s00330-025-11899-1
Ogier, A. C. C., Baup, S., Ilanjian, G., et al. (2025) · medRxiv · doi:10.1101/2025.07.15.25331281
Zhao, J.-L., Chen, P.-M., Zhang, T., Xie, H., Zhang, Y.-S., Ng, S. S. M., Mao, Y., & Huang, D. (2025) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2025.1614305
One Face, Many Views: Cross-View Consistency of Facial Action Unit Analysis in Multi-Camera Settings
Vangara, K., Merino, X., Pangelinan, G., et al. (2025) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg61629.2025.11099444
Test-Retest Reliability of Self-Reported Internalizing Symptoms and Social Support in Autistic YouthPreprint
Becker, L., & Lecavalier, L. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5376908
How We Think About People: Beliefs About Human Nature in the Explanation of Conflict Behavior
Landwehr, A., Strubel, I. T., Kals, E., & Maes, J. (2025) · Conflict Resolution Quarterly · doi:10.1002/crq.70001 · Cited by 2
Jakobek, B. T., Couture, É. L., Ferrell, S. T., et al. (2025) · Journal of Herpetological Medicine and Surgery · doi:10.5818/jhms-d-24-00056
Decoding fetal motion in 4D ultrasound with DeepLabCut
Inubashiri, E., Kaishi, Y., Miyake, T., et al. (2025) · Journal of Medical Ultrasonics · doi:10.1007/s10396-025-01557-w
Guidelines for Criterion-Referenced Standard Setting Procedure in Dental Assessment
Ho, T. K., Roudsari, R. V., & Kassim, N. L. A. (2025) · Springer eBooks · doi:10.1007/978-981-97-0275-6_45-1
Ruff, C., König, S. G., Rattay, T. W., et al. (2025) · Diagnostics · doi:10.3390/diagnostics15162057
Godkin, F. E., Ooteghem, K. V., Beyer, K. B., Weber, K. S., Cornish, B. F., Tang, A., Martens, K. A. E., & McIlroy, W. E. (2025) · Digital Health · doi:10.1177/20552076251367506 · Cited by 2
Quality of clinical practice guidelines in Japan: a time trend analysis using AGREE II scores
Hatakeyama, Y., Seto, K., Onishi, R., et al. (2025) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzaf081
Herrin, I., Harik, L. M., Larkin, E., Simpson, G. K., Falcó, C., Blankenship, C., Wilmore, R., Gut, N., & KELLY, G. L. (2025) · PM&R · doi:10.1002/pmrj.13448
Anwar, A., Khalifa, Y., Lucatorto, E., Coyle, J. L., & Sejdić, E. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110887
Bosch, F. H., Jager‐Wittenaar, H., Keuning-Wesseling, G., Hiddingh, J., Eshuis, H., van der Schans, C. P., Niemeijer, A. S., & Nieuwenhuis, M. K. (2025) · Burns · doi:10.1016/j.burns.2025.107673 · Cited by 1
Özvar, G. B., Ayvat, F., Ayvat, E., & Kılınç, M. (2025) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x251369245
Bui, T. N. H., Wu, Y., Tseng, C.-F., et al. (2025) · Journal of Dental Sciences · doi:10.1016/j.jds.2025.08.013
Doshi, P. K., Karnavat, C., & Agarbattiwala, R. (2025) · medRxiv · doi:10.1101/2025.08.24.25334315
Chanel, B., Babault, N., & Cometti, C. (2025) · European Journal of Applied Physiology · doi:10.1007/s00421-025-05944-6
Silva, L. C., Constantino, C. S., Teixeira, R. J. V., Castanheira, J. C., Oliveira, F. P. M., & Costa, D. C. (2025) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-025-01638-9
Fujita, Y., & Takeshima, T. (2025) · Nutrients · doi:10.3390/nu17172822
A Unified Framework for Reliability Analysis in Neuroimaging With Krippendorff's α
Vinding, M. C. (2025) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.70192
Venous Architecture Predicts Hemorrhage Risk in Sporadic CCM With DVA
Liu, Y., Zheng, W., Yuan, J., et al. (2025) · Stroke · doi:10.1161/strokeaha.125.052339
Rabanal-Rodríguez, G., Navarro‐Santana, M. J., Díaz‐Arribas, M. J., Morales, C. R., Aragonés, P., Sanz-Ayan, P., & Plaza‐Manzano, G. (2025) · Research Square · doi:10.21203/rs.3.rs-7320295/v1
Tyczyńska, K. M., Krajewski, P. K., Kuc, D., Krawiec, P., Wawryka, P., Zalewski, A., Kwiatkowska, B., Szepietowski, J. C., & Batko, B. P. (2025) · Reumatologia/Rheumatology · doi:10.5114/reum/209210
Rauland, A., Meisler, S. L., Alexander‐Bloch, A. F., Bagautdinova, J., Baller, E. B., Gur, R. E., Gur, R. C., Luo, A. C., Moore, T. M., Popovych, O. V., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.09.02.673635
Assessing the reproducibility of facebow transfers: A mesh-based intra-observer study
Ferreira, L., Ribeiro, A., & Decaup, P.-H. (2025) · Journal of Prosthetic Dentistry · doi:10.1016/j.prosdent.2025.08.038
Corbetta, D., Sarasso, E., Gardoni, A., et al. (2025) · Journal of Neurology · doi:10.1007/s00415-025-13365-w
Han, Y. C., Thompson, K. R., & Reber, P. J. (2025) · Journal of Intelligence · doi:10.3390/jintelligence13090115 · Cited by 1
Vogt, A., Ganter, I., Kaup, B., & Rahman, R. A. (2025) · Acta Psychologica · doi:10.1016/j.actpsy.2025.105498
Matton, C., Ngan, C. C., & Andrysek, J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0331895
Development and clinical validation of an auditory naming test in persons with post-stroke aphasia
Spooren, K., Sevenants, J., Barberis, M., Persoone, S., & Vandermosten, M. (2025) · Aphasiology · doi:10.1080/02687038.2025.2555861
Husu, E., Helminen, T. M., Muuvila, M., Lauttia, J., Eriksson, K. J., Nevalainen, J., & Kylliäinen, A. (2025) · Research in Autism · doi:10.1016/j.reia.2025.202697 · Cited by 2
Capturing expert uncertainty: ICC-informed soft labelling for volcano-seismicity
Mitchinson, S., Johnson, J. H., Milner, B. P., Lamb, O. D., & Behr, Y. (2025) · Bulletin of Volcanology · doi:10.1007/s00445-025-01875-4
Wang, W., Liu, Y., Shi, P. A., et al. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1611438
Cine magnetic resonance imaging of uterine peristalsis in patients with endometrial fibrosis
Liang, H., Zhou, N., Chen, Y., Sun, K., Zhu, H., Jiang, P., Wang, H., Hu, Q., Zhou, K., Hu, Y., et al. (2025) · Fertility and Sterility · doi:10.1016/j.fertnstert.2025.09.017
Grisch, D., Weber, O., Krautwurst, B. K., et al. (2025) · Children · doi:10.3390/children12091254
Fun Surveys? Developing an Innovative Approach to Assessing Learning Through Citizen Science
Allf, B., Larson, L. R., Goodwin, J., et al. (2025) · Citizen Science Theory and Practice · doi:10.5334/cstp.796
Brøckner, H., Jensen, S. N., Hennings, K., & Mørch, C. D. (2025) · Muscle & Nerve · doi:10.1002/mus.70031
He, H., Yang, Z., Dong, L., et al. (2025) · Asian Spine Journal · doi:10.31616/asj.2025.0107
Caron-Racine, G., Bergeron, A.-M., Lemyre, M., Arendas, K., Lefebvre, J., & Maheux‐Lacroix, S. (2025) · Journal of Obstetrics and Gynaecology Canada · doi:10.1016/j.jogc.2025.103130
Experience of the Original Phantom-Based Training in Contrast-Enhanced Ultrasound Imaging
Borsukov, A. V., Shestakova, D. Y., Buzulukov, Y. P., et al. (2025) · Journal of oncology diagnostic radiology and radiotherapy · doi:10.37174/2587-7593-2025-8-3-64-77
MacKay‐Brandt, A., Garcia-Barnett, D., Gan, K. X., Ripley, O., Gazes, E., Milham, M. P., & Colcombe, S. J. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1640417 · Cited by 1
Psychometric Validation and Preliminary Clinical Correlation of an Experiential Foraging Task
McInnes, A. N., Sullivan, C. R. P., MacDonald, A. W., & Widge, A. S. (2025) · Assessment · doi:10.1177/10731911251376214
Two-handed task performance in upper limb prosthesis users: rethinking measurement approaches
Resnik, L. J., Borgia, M. L., Heinemann, A. W., Stevens, P. M., & Ni, P. (2025) · Disability and Rehabilitation · doi:10.1080/09638288.2025.2561856
Ichikawa, Y., Sato, S., Sumi, M., Yoshida, M., Kimura, M., Kato, Y., & Kikutani, T. (2025) · Journal of Oral Rehabilitation · doi:10.1111/joor.70065
Simonetti, S., Fattorini, N., D’Amico, V. L., Corsi, I., & Olmastroni, S. (2025) · Polar Biology · doi:10.1007/s00300-025-03422-5
Crowley, C., Duffy, G., & Kerry, J. P. (2025) · Research Square · doi:10.21203/rs.3.rs-7584102/v1
Correa, E. J., Curtis, J. A., Alcalá, L. R., Ibañez-Rodriguez, J. A., Morato, M., Folha, G. A., Alcalá, C. R., Garcı́a-Iriarte, M. T., Plaza, G., & O’Connor-Reina, C. (2025) · International Journal of Orofacial Myology · doi:10.3390/ijom51020009
Naik, H., Mathias, S. D., Turner, M. P., et al. (2025) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-025-04012-8
Nieser, K. J., Tancredi, D. J., & Harris, A. H. S. (2025) · Health Services Research · doi:10.1111/1475-6773.70050
de la Fuente, R., Galvez-Yanjari, V., Delfino, A. E., Lira, R., Hurtado, C., Muñoz-Gama, J., & Sepúlveda, M. (2025) · BMC Anesthesiology · doi:10.1186/s12871-025-03341-2 · Cited by 2
Khan, A. H., Bhuiyan, M. S. H., Al‐Amin, H. M., Sutradhar, R., & Haque, M. S. (2025) · Health Science Reports · doi:10.1002/hsr2.71333
Fang, L., Huang, C., Lin, B., Lei, K., Zhou, J., Zhong, X., Liu, Y., & Liu, J. (2025) · JMIR mhealth and uhealth · doi:10.2196/66339
Lim, C., Yoon, S.-M., & Park, Y. (2025) · Indian Journal of Orthopaedics · doi:10.1007/s43465-025-01542-y
Arends, C. R., Haack, C. A., van der Molen, L., et al. (2025) · Lymphatic Research and Biology · doi:10.1177/15578585251385299
Maya-Martínez, A. D., Cauli, O., Giménez‐Espert, M. D. C., et al. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1669928
DNA-based prediction of external ear morphology in the Chinese population: an exploratory study
Wang, X., Zhao, Z., Wu, J., Li, Y., Yang, Y., Liu, B., Zhou, C.-Y., Wang, C., Chen, X., & Song, F. (2025) · PeerJ · doi:10.7717/peerj.20169
Zhang, L., Ni, N., Wu, L., Zhou, L., Ning, S., Liu, C., Wang, T., Tan, J.-Y. B., Sun, D., Zhang, H., et al. (2025) · Health and Quality of Life Outcomes · doi:10.1186/s12955-025-02438-z
Metadata
- Authors
- Shrout, P. E., & Fleiss, J. L.
- Affiliations
- Columbia University (US)
- ORCID
- Shrout, Patrick E.
- Venue
- Psychological Bulletin
- Published
- 1979
- Volume
- 86
- Issue
- 2
- Pages
- 420-428
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2141403362
- Cited by
- 24,532
- References
- 20
- Citations by year
- 2026: 1452 · 2025: 1085 · 2024: 998 · 2023: 1023 · 2022: 1083 · 2021: 1379 · 2020: 1189 · 2019: 1116 · 2018: 1178 · 2017: 1113 · 2016: 1106 · 2015: 1057 · 2014: 1172 · 2013: 1044 · 2012: 914
- FWCI
- 13.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Multidisciplinary Science and Engineering Research
- Keywords
- intraclass correlation coefficient, rater reliability, inter-rater reliability, reliability coefficients, confidence intervals, multiple raters
- MeSH terms
- Humans, Reproducibility of Results, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
