The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Intraclass correlations: Uses in assessing rater reliability.
Abstract
Reliability coefficients often take the form of intraclass correlation coefficients. In this article, guidelines are given for choosing among six different forms of the intraclass correlation for reliability studies in which n target are rated by k judges. Relevant to the choice of the coefficient are the appropriate statistical model for the reliability and the application to be made of the reliability results. Confidence intervals for each of the forms are reviewed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As a result, the inter-rater agreement was quite high for categorical variables (mean Cohen's kappa = 0.73, SD = 0.13) and for continuous variables (mean intraclass correlation [26] = 0.80, SD = .14).”
From Social Relationships and Mortality Risk: A Meta-analytic Review (2010) · cites this paper as [26]
In the citing paper
“we used the methodology Shrout and Fleiss (1979) describe and computed the Shrout-Fleiss single ICC score agreement of .998, which is considered quite high (Koo and Li 2016).”
From Driving Brand Engagement Through Online Social Influencers: An Empirical Investigation of Sponsored Blogging Campaigns (2019) · cites this paper as Shrout and Fleiss (1979)
In the citing paper
“In contrast, Cohen's quadratically weighted kappa converges to two-factor intraclass correlation coefficients with random and fixed raters (i.e., the so-called ICC (2,1) and ICC(3,1) coefficients), where the items and raters are the two factors (Carrasco, 2010;Fleiss & Cohen, 1973;Janson & Olsson, 2001;Schuster, 2004;Schuster & Smith, 2005;Shrout & Fleiss, 1979;Warrens, 2014).”
From Quadratically Weighted Agreement Coefficients: Interpretations and Connections (2026) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“A sample of 11% of video data was double coded by the researcher and an experienced coder (the developer of CHIPPA). Inter‐rater reliability was based on intra‐class correlation (ICC) statistics from the mean rating for the two coders (k = 2) using a two‐way mixed effects consistency model (see Table 2 below) and resulted in good to excellent reliability across the CHIPPA subscales (Koo & Li, 2016”
From A plausible role of imagination in pretend play, counterfactual reasoning, and executive functions (2023) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“The results suggest that coders showed high agreement (intraclass correlation [2, 1] = 0.85; Shrout & Fleiss, 1979).”
From Respiratory and cognitive mediators of treatment change in panic disorder: Evidence for intervention specificity. (2010) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“Interrater reliability of the pre- and posttreatment assessments was excellent (intraclass correlations [2, 1] = 0.97 and 0.96, respectively; Shrout & Fleiss, 1979).”
From Respiratory and cognitive mediators of treatment change in panic disorder: Evidence for intervention specificity. (2010) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“ICC decomposes observed variance into between-query variance (task difficulty) and within-query variance (agent inconsistency), highlighting whether reported results reflect true capability or measurement noise.”
From Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation (2025) · cites this paper as Shrout and Fleiss 1979
In the citing paper
“The ICC quantifies the proportion of total variance attributable to differences between tasks and can be understood as a function of both the difficulty of the dataset (variance between tasks) and the consistency of the agent (variance within tasks).”
From Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation (2025) · cites this paper as Shrout and Fleiss 1979
In the citing paper
“Reproducibility of the final placenta, fetus and amniotic fluid volume in millilitres was assessed using the ICC (2,1) [37], [38] for inter-observer repeatability between the semi-automated Random Walker results, regarded as the ground-truth used for performance evaluation, and the newly generated FCNN outputs.”
From Fully Automated 3-D Ultrasound Segmentation of the Placenta, Amniotic Fluid, and Fetus for Early Pregnancy Assessment (2021) · cites this paper as [37]
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 27,137
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.3102/00028312006001112 · Cited by 8,013
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,012
Snedecor, G. W., & Cochran, W. G. (1967) · Cited by 6,573
Scheffé, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,625
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
The Intraclass Correlation Coefficient as a Measure of Reliability
Bartko, J. (1966) · Psychological Reports · doi:10.2466/pr0.1966.19.1.3 · Cited by 2,206
Statistics for the social sciences
Hays, W. L. (1973) · Medical Entomology and Zoology · Cited by 2,081
The theory of the estimation of test reliability
Kuder, G. F., & Richardson, M. W. (1937) · Psychometrika · doi:10.1007/bf02288391 · Cited by 1,953
Cited by
Sorted by citations
Items 18,101–18,200 of 23,883
Wilson, S., Suttle, C., Shah, R., Conway, M. L., & Ctori, I. (2024) · Ophthalmic and Physiological Optics · doi:10.1111/opo.13358 · Cited by 3
Díaz‐Fernández, Á., Moena‐León, M., Reezigt, R. R., Beetsma, A. J., Reneman, M. F., Albajes, K., Osuna‐Pérez, M. C., Martínez, A. R. O., & Lomas‐Vega, R. (2024) · Physiotherapy Theory and Practice · doi:10.1080/09593985.2024.2383929 · Cited by 3
Wethe, J. V., Bogle, J. M., Dodick, D. W., Howard, M., Gould, A. R., Butterfield, R. J., Buras, M. R., Adler, J. S., Talaber, A., Soma, D. B., et al. (2024) · Diagnostics · doi:10.3390/diagnostics14151661 · Cited by 3
[Translated article] Cross-Cultural Validation of the RosaQoL Scale in Spanish Language
Redonnet, M. S., Losada, J. D. P., & Ribera, M. (2024) · Actas Dermo-Sifiliográficas · doi:10.1016/j.ad.2024.02.035 · Cited by 3
Wilson, S. C., Teghipco, A., Sayers, S., Newman‐Norlund, R., Newman-Norlund, S. E., & Fridriksson, J. (2024) · American Journal of Speech-Language Pathology · doi:10.1044/2024_ajslp-24-00005 · Cited by 3
Li, K., Huang, L., Xiao, Q., et al. (2024) · Frontiers in Pediatrics · doi:10.3389/fped.2024.1424313 · Cited by 3
Personality in Asian elephants (Elephas maximus): Temporal stability and methods of assessment
Rutherford, L., Murray, L., Holmes, L., & Williams, E. (2024) · Personality and Individual Differences · doi:10.1016/j.paid.2024.112851 · Cited by 4
Pritchard, A. J., Bliss‐Moreau, E., Balasubramaniam, K. N., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0309946 · Cited by 3
Aitken, H. D., Goetz, J. E., Sailer, W. M., et al. (2024) · Clinical Anatomy · doi:10.1002/ca.24221 · Cited by 3
Wender, C. L. A., Farrar, E., & Sandroff, B. M. (2024) · Brain Injury · doi:10.1080/02699052.2024.2403632 · Cited by 3
Parry, I. S., Wilson, M., Starcevich, A., et al. (2024) · American Journal of Occupational Therapy · doi:10.5014/ajot.2024.050773 · Cited by 3
Gerg, A., Wagner, C., & Keiner, M. (2024) · Sport Sciences for Health · doi:10.1007/s11332-024-01276-8 · Cited by 4
Braarud, P. Ø., & Simensen, J. E. (2024) · Safety Science · doi:10.1016/j.ssci.2024.106694 · Cited by 3
Goikoetxea-Sotelo, G., & van Hedel, H. J. A. (2024) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2024.1405304 · Cited by 3
Mathiesen, L., Nguyen, T. B. M., Dæhlen, I., et al. (2024) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzae100 · Cited by 3
Beltrame, L. S. A., Bronzato, J. D., Almeida, T. J. D. S., et al. (2024) · Dental Traumatology · doi:10.1111/edt.13006 · Cited by 3
Evaluation of three acetabular measurement methods for total hip replacement in dogs
Wilson, J. N., Filliquist, B., Garcia, T. C., et al. (2024) · Veterinary Surgery · doi:10.1111/vsu.14190 · Cited by 3
Tanaka, H., Miyamoto, K., Bagnou, J. H., Prigent, E., Clavel, C., Martin, J., & Nakamura, S. (2024) · JMIR Formative Research · doi:10.2196/59261 · Cited by 3
Turunen, A., Lappalainen, N., Huuskonen, H., et al. (2024) · Journal of Fish Biology · doi:10.1111/jfb.15988 · Cited by 3
Sun, J., Mao, Z., Zhang, S., Zhou, S., Zhou, T., Xie, C., Yuan, Y., Zhao, X., Wang, C., Ma, Y., et al. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.11.037 · Cited by 3
Association of Yeo’s index with clinical outcomes in rheumatic mitral stenosis
Leow, R., Li, T. Y., Chan, M.-W., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-76534-3 · Cited by 3
Behavioral Observation and Coding
Thorson, K. R., & West, T. V. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123.017 · Cited by 4
Marsden, D. W., & Sezer, L. A. (2024) · British Journal of Industrial Relations · doi:10.1111/bjir.12869 · Cited by 4
Traducción y validación de la Escala clínica de fragilidad (ECF) al español en Chile
Browne, J., Balcázar, P., Palacios, J., et al. (2024) · Revista Española de Geriatría y Gerontología · doi:10.1016/j.regg.2024.101619 · Cited by 3
Pérez‐Nombela, S., Merino‐Andrés, J., Gómez‐Soriano, J., et al. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14020391 · Cited by 3
Dubot, B., Deniau, M., Ramiandrisoa, D., et al. (2025) · Journal of Visualized Experiments · doi:10.3791/66985 · Cited by 3
Yue, Y., Niu, Y., Tang, W., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-91082-0 · Cited by 3
McMurray’s test is influenced by perimeniscal synovitis in degenerative meniscus tears
Jin, Y. J., Park, J. Y., Chung, J. Y., et al. (2025) · Knee Surgery and Related Research · doi:10.1186/s43019-024-00242-5 · Cited by 3
Ploumen, R. A. W., Mommertz, J. A., Rutten, I. J. G., et al. (2025) · European Journal of Radiology · doi:10.1016/j.ejrad.2025.112040 · Cited by 3
Schaun, G. Z., Raidl, P., Andrade, L. S., David, G. B., Marins, E. F., Häfele, M. S., Pinto, S. S., Csapo, R., & Alberton, C. L. (2025) · GeroScience · doi:10.1007/s11357-025-01590-0 · Cited by 3
Tendon stump change as a risk factor for structural failure of arthroscopic rotator cuff repair
Kawamata, J., Fukuta, S., Kano, M., et al. (2025) · JSES International · doi:10.1016/j.jseint.2025.02.011 · Cited by 3
Brown, L., Hogarth, L. W., Buhmann, R., et al. (2025) · International Journal of Performance Analysis in Sport · doi:10.1080/24748668.2025.2479941 · Cited by 3
Mylonas, K., Chatzis, G., Makrypidi, V., Chrysanthopoulos, G., Gkrilias, P., Τσεκούρα, Μ., Billis, E. V., Tsepis, E., Tsirogiannis, G. A., & Fousekis, K. (2025) · Journal of Physical Therapy Science · doi:10.1589/jpts.37.171 · Cited by 3
Lyons, K. M., Stock, M. S., Hanney, W. J., & Anderson, A. W. (2025) · International Journal of Sports Physical Therapy · doi:10.26603/001c.132173 · Cited by 3
Takaike, H., Kato, A., Miura, J., Takagi, S., & Babazono, T. (2025) · Patient Education and Counseling · doi:10.1016/j.pec.2025.108765 · Cited by 3
Ahmar, A. E., Schnell, S., Ansari, S. A., et al. (2025) · Interface Focus · doi:10.1098/rsfs.2024.0040 · Cited by 3
Miljevic, A., Murphy, O. W., Fitzgerald, P. B., & Bailey, N. W. (2025) · Clinical Neurophysiology · doi:10.1016/j.clinph.2025.03.042 · Cited by 3
Mullin, H. A., Carpenter, C. M., Cwiek, A. P., Lan, G., Chase, S. O., Carter, E. E., Vervoordt, S. M., Rabinowitz, A. R., Venkatesan, U. M., & Hillary, F. G. (2025) · Network Neuroscience · doi:10.1162/netn_a_00459 · Cited by 3
Espinoza‐Bravo, C., Rejano‐Campo, M., Domínguez‐Navarro, F., et al. (2025) · Journal of Ultrasound in Medicine · doi:10.1002/jum.16697 · Cited by 3
Nittel, C. M., Hohmann, D. M., Jansen, A., Sommer, J. B., Krauß, R., Völk, M., Kamp‐Becker, I., Weber, S., Becker, K., & Stroth, S. (2025) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2025.111993 · Cited by 3
Röhner, J., Degro, G. M., Holden, R. R., & Schütz, A. (2025) · International Journal of Selection and Assessment · doi:10.1111/ijsa.70012 · Cited by 3
Meehan, C. L., & Baker, W. J. (2025) · Transportation Geotechnics · doi:10.1016/j.trgeo.2025.101574 · Cited by 3
Su, H., Yang, D., Hong, L., et al. (2025) · BMC Oral Health · doi:10.1186/s12903-025-06298-3 · Cited by 3
Zhang, W., Zhuang, D., Wei, W., Li, Y., Ma, L., Du, H., Jin, A., He, J., & Li, X. (2025) · Clinical & Translational Oncology · doi:10.1007/s12094-025-03945-7 · Cited by 3
Serhan, Y., Darawshy, S., Wei, W., Margulies, D. S., Nenning, K., & Ovadia‐Caro, S. (2025) · Brain Structure and Function · doi:10.1007/s00429-025-02976-8 · Cited by 3
González‐Sánchez, M., Reina-Ruiz, Á. J., Molina‐Torres, G., Trzcińska, S., Carrasco-Vega, E., Lochmannová, A., & Galán-Mercant, A. (2025) · Medicina · doi:10.3390/medicina61071254 · Cited by 5
Witte, K., Thalmann, M., & Schulz, E. (2025) · Scientific Reports · doi:10.1038/s41598-025-09152-2 · Cited by 6
Increased Posterior Tibial Slope Is Associated with Isolated Meniscal Injuries: A Case-Control Study
von Schwarzenberg, K., Babasiz, T., Hockmann, J. P., et al. (2025) · Medicina · doi:10.3390/medicina61081368 · Cited by 3
Fang, M., Ma, Q., & Xu, B. (2025) · Journal of Radiation Research and Applied Sciences · doi:10.1016/j.jrras.2025.101782 · Cited by 6
Absolute Length Distribution of Human Telomeres with Single-Molecule Techniques
Gao, H. C., Ma, K., Cao, Z., Hu, X., Wang, Y., Lu, M., Zhao, X., Zhou, J., Liu, Y., Wang, M., et al. (2025) · ACS Nano · doi:10.1021/acsnano.5c11090 · Cited by 4
Comparison of alternative νLamax determination approaches in cycling and rowing
Micke, F., Mühlenhoff, S., Swoboda, A., & Held, S. (2025) · Journal of Sports Sciences · doi:10.1080/02640414.2025.2567795 · Cited by 3
Validation of a wearable low-cost EMG prototype device to support knee extension exercises
Liu, Z., Mumuni, I., Tehrany, R., et al. (2025) · doi:10.1109/embc58623.2025.11254678 · Cited by 3
Self-citation practices in applied linguistics
Plonsky, L., & Sudina, E. (2025) · Journal of Second Language Studies · doi:10.1075/jsls.00052.plo · Cited by 3
Intra‐ and Interlaboratory Reproducibility of an ELISA Serological Test for Lyme Disease
Tammemägi, M. C., Frank, J. W., LeBlanc, M. L., & Artsob, H. (1994) · Canadian Journal of Infectious Diseases and Medical Microbiology · doi:10.1155/1995/626945 · Cited by 3
Ferreira, J. F., Conceição, N., & Vasco, A. B. (1969) · Psicologia · doi:10.17575/rpsicol.v25i1.284 · Cited by 3
GROUP BEHAVIOR IN TELEVISION SITCOMS
Keyton, J., Warren, R., Alexander, A., & Behrend, D. A. (2007) · Journal of Children and Media · doi:10.1080/17482790701531995 · Cited by 3
Statistische Bewertung neuer Methoden in der forensischen Anthropologie
Ramsthaler, F., & Verhoff, M. A. (2014) · Rechtsmedizin · doi:10.1007/s00194-014-0948-3 · Cited by 3
Reliabilitet av den norske versjonen av Timed Up and Go (TUG)
Botolfsen, P., & Helbostad, J. L. (2010) · NORA - Norwegian Open Research Archives · Cited by 3
Wong, W., Lam, C. L. K., Leung, K. F., et al. (2011) · Quality of Life Research · doi:10.1007/s11136-011-9987-3 · Cited by 3
Malinowsky, C. W., Kassberg, A.-C., Larsson-Lund, M., et al. (2014) · Disability and Rehabilitation Assistive Technology · doi:10.3109/17483107.2014.968812 · Cited by 3
Shin, J. K., Lee, J. S., Kang, S. S., et al. (2014) · Clinical Spine Surgery A Spine Publication · doi:10.1097/bsd.0000000000000105 · Cited by 3
Measuring Instruments In Cardiology Adapted Into Portuguese Language Of Brazil: A Systematic Review
Cornélio, M. E., Alexandre, N. M. C., & São‐João, T. M. (2014) · Revista da Escola de Enfermagem da USP · doi:10.1590/s0080-6234201400002000023 · Cited by 3
Examining Computerized Software Reliability to Measure Individual Exposure Time
Smith, A. M., Stuart, M. J., Larson, D. R., et al. (2014) · Clinical Journal of Sport Medicine · doi:10.1097/jsm.0000000000000033 · Cited by 3
Hepgüler, S., Atamaz, F. C., Pinar, Y. A., et al. (2012) · Rheumatology International · doi:10.1007/s00296-012-2443-z · Cited by 3
Effect of Dystrophin Deficiency on Selected Intrinsic Laryngeal Muscles of themdxMouse
Fry, L., Stemple, J. C., Andreatta, R. D., Harrison, A. L., & Andrade, F. H. (2009) · Journal of Speech Language and Hearing Research · doi:10.1044/1092-4388(2009/09-0010 · Cited by 3
Ekerstad, N., Löfmark, R., Andersson, D., et al. (2011) · Scandinavian Journal of Public Health · doi:10.1177/1403494811405092 · Cited by 3
A PROCEDURE FOR CODING SELF-REGARD FROM NARRATIVE SELF-DESCRIPTIONS
Anderson, W. P. (2006) · Psychological Reports · doi:10.2466/pr0.99.3.879-893 · Cited by 3
Yusoff, M. S. B., Yaacob, M. J., Naing, N. N., et al. (2013) · Education in Medicine Journal · doi:10.5959/eimj.v5i4.189 · Cited by 3
Küçükdeveci, A. A., Ataman, Ş., Genç, A., et al. (2014) · Rheumatology International · doi:10.1007/s00296-014-3050-y · Cited by 3
Interpreting organizational survey results: a critical application of the self-serving bias
Hausdorf, P. A., Risavy, S. D., & Stanley, D. J. (2011) · Organization Management Journal · doi:10.1057/omj.2011.11 · Cited by 3
Wong, Y. H., Yip, T. L., & Chan, R. Y. K. (2013) · Journal of Transnational Management · doi:10.1080/15475778.2013.752746 · Cited by 3
Mental Representations in Women With Panic Disorder
Porcerelli, J. H., Huprich, S. K., & Markova, T. (2010) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0b013e3181cc41ca · Cited by 3
In vitro biomechanical evaluation of fibular movement in below knee amputations
Asa, B., Payne, M. W. C., Wilson, T. D., et al. (2014) · Clinical Biomechanics · doi:10.1016/j.clinbiomech.2014.03.005 · Cited by 3
Usefulness of 7-day Holter monitoring for heart rate variability nonlinear dynamics evaluation
Goya–Esteban, R., Barquero‐Pérez, Ó., Caamaño, A. J., et al. (2011) · Computing in cardiology · Cited by 3
Holtzworth‐Munroe, A., Applegate, A. G., Rudd, B. N., et al. (2013) · Journal of the Scholarship of Teaching and Learning · Cited by 3
Collazo, N. A. J., Elen, J., & Clarebout, G. (2013) · Lirias · Cited by 3
Towards an operational definition of pharmacy clinical competency
Douglas, C. A. (2011) · PhDT · Cited by 3
Measurement Errors of Angles in Digital Pictures Using Graphic Software
Sato, Y., Murakami, K., & Fujisawa, H. (2010) · Rigakuryoho Kagaku · doi:10.1589/rika.25.977 · Cited by 3
Hoover, J., Karunanayake, C., Torresyap, V., et al. (2014) · International Journal of Prosthodontics and Restorative Dentistry · doi:10.5005/jp-journals-10019-1104 · Cited by 3
Visual hybrids induce anxiety: A microgenetic approach.
Glicksohn, J., & Yaniv, H. (2016) · Psychology of Consciousness Theory Research and Practice · doi:10.1037/cns0000085 · Cited by 3
Hayes, R. P., Ni, X., Heiselman, D., & Kinchen, K. (2016) · International Journal of Clinical Practice · doi:10.1111/ijcp.12828 · Cited by 3
Operator differences in thermal quantitative sensory testing
Boland‐Freitas, R., Coward, S., Lofts, A., et al. (2016) · Clinical Neurophysiology Practice · doi:10.1016/j.cnp.2016.10.001 · Cited by 3
Physiological Features of the Internal Jugular Vein from B-Mode Ultrasound Imagery
Smith, J. P., Shehata, M., Powell, R., et al. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-50832-0_30 · Cited by 3
Plys, E., & Qualls, S. H. (2016) · Journal of Housing for the Elderly · doi:10.1080/02763893.2016.1224789 · Cited by 3
Visee, C. E. (2012) · Cited by 3
Computer-Based Algorithmic Determination of Muscle Movement Onset Using M-Mode Ultrasonography
Tweedell, A. J., Haynes, C. A., & Tenan, M. S. (2017) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2016.12.019 · Cited by 3
Pretend Aggression in Play, Aggressive Behavior, and Parenting Style
Fehr, K. K. (2010) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 3
Speech intelligibility in multilingual spaces
Kitapçi, K. (2016) · ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) · Cited by 3
The Reliability of Plasma Exosome Concentrations in Healthy Male Individuals
Abu-Seer, E. (2017) · J of Health Science · doi:10.17265/2328-7136/2017.02.004 · Cited by 3
Flueck, J. L. (2017) · Journal of Visualized Experiments · doi:10.3791/55485 · Cited by 3
Test–Retest Reliability of the Functional Performance Test
Hash, N. R., & Sandrey, M. A. (2015) · Athletic Training & Sports Health Care · doi:10.3928/19425864-20150422-07 · Cited by 3
Young, C. A., Wong, S. M., Quincey, A. C., & Tennant, A. (2017) · PM&R · doi:10.1016/j.pmrj.2017.06.014 · Cited by 3
Burgos, P. M. H., Menéndez, F. L., Candales, M. D., & López‐Candales, A. (2017) · Indian Heart Journal · doi:10.1016/j.ihj.2017.08.019 · Cited by 2
Fluoroscopic Estimation of Thoracic Dimensional Changes in Healthy Dogs
Chan, J. C., Johnson, L. R., Brown, C. S., et al. (2017) · Journal of Veterinary Internal Medicine · doi:10.1111/jvim.14825 · Cited by 3
de Cartagena, U., Simancas‐Pallares, M., Tovar, L. L. A., et al. (2017) · Biosalud · doi:10.17151/biosa.2017.16.1.4 · Cited by 3
Li, D., Lin, C., & Chen, F.-C. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.02.032 · Cited by 3
Repeatability of USCOM®-measured cardiac output in normotensive non-pregnant and pregnant women
Mangos, J. G., Pettit, F. M., Preece, R., Harris, K., & Brown, M. A. (2018) · Pregnancy Hypertension · doi:10.1016/j.preghy.2018.03.009 · Cited by 3
Wu, G., Zhang, R., Mao, H., et al. (2018) · European Radiology · doi:10.1007/s00330-018-5525-9 · Cited by 3
Content Analysis of Social Phobics’ Discourse in Cognitive-Behavioral Therapy
Biran, M. W., Simons, K. J., & Stiles, W. B. (2002) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.2002.56.2.233 · Cited by 3
Metadata
- Authors
- Shrout, P. E., & Fleiss, J. L.
- Affiliations
- Columbia University (US)
- ORCID
- Shrout, Patrick E.
- Venue
- Psychological Bulletin
- Published
- 1979
- Volume
- 86
- Issue
- 2
- Pages
- 420-428
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2141403362
- Cited by
- 24,532
- References
- 20
- Citations by year
- 2026: 1452 · 2025: 1085 · 2024: 998 · 2023: 1023 · 2022: 1083 · 2021: 1379 · 2020: 1189 · 2019: 1116 · 2018: 1178 · 2017: 1113 · 2016: 1106 · 2015: 1057 · 2014: 1172 · 2013: 1044 · 2012: 914
- FWCI
- 13.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Multidisciplinary Science and Engineering Research
- Keywords
- intraclass correlation coefficient, rater reliability, inter-rater reliability, reliability coefficients, confidence intervals, multiple raters
- MeSH terms
- Humans, Reproducibility of Results, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
