The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Intraclass correlations: Uses in assessing rater reliability.
Abstract
Reliability coefficients often take the form of intraclass correlation coefficients. In this article, guidelines are given for choosing among six different forms of the intraclass correlation for reliability studies in which n target are rated by k judges. Relevant to the choice of the coefficient are the appropriate statistical model for the reliability and the application to be made of the reliability results. Confidence intervals for each of the forms are reviewed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As a result, the inter-rater agreement was quite high for categorical variables (mean Cohen's kappa = 0.73, SD = 0.13) and for continuous variables (mean intraclass correlation [26] = 0.80, SD = .14).”
From Social Relationships and Mortality Risk: A Meta-analytic Review (2010) · cites this paper as [26]
In the citing paper
“we used the methodology Shrout and Fleiss (1979) describe and computed the Shrout-Fleiss single ICC score agreement of .998, which is considered quite high (Koo and Li 2016).”
From Driving Brand Engagement Through Online Social Influencers: An Empirical Investigation of Sponsored Blogging Campaigns (2019) · cites this paper as Shrout and Fleiss (1979)
In the citing paper
“In contrast, Cohen's quadratically weighted kappa converges to two-factor intraclass correlation coefficients with random and fixed raters (i.e., the so-called ICC (2,1) and ICC(3,1) coefficients), where the items and raters are the two factors (Carrasco, 2010;Fleiss & Cohen, 1973;Janson & Olsson, 2001;Schuster, 2004;Schuster & Smith, 2005;Shrout & Fleiss, 1979;Warrens, 2014).”
From Quadratically Weighted Agreement Coefficients: Interpretations and Connections (2026) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“A sample of 11% of video data was double coded by the researcher and an experienced coder (the developer of CHIPPA). Inter‐rater reliability was based on intra‐class correlation (ICC) statistics from the mean rating for the two coders (k = 2) using a two‐way mixed effects consistency model (see Table 2 below) and resulted in good to excellent reliability across the CHIPPA subscales (Koo & Li, 2016”
From A plausible role of imagination in pretend play, counterfactual reasoning, and executive functions (2023) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“The results suggest that coders showed high agreement (intraclass correlation [2, 1] = 0.85; Shrout & Fleiss, 1979).”
From Respiratory and cognitive mediators of treatment change in panic disorder: Evidence for intervention specificity. (2010) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“Interrater reliability of the pre- and posttreatment assessments was excellent (intraclass correlations [2, 1] = 0.97 and 0.96, respectively; Shrout & Fleiss, 1979).”
From Respiratory and cognitive mediators of treatment change in panic disorder: Evidence for intervention specificity. (2010) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“ICC decomposes observed variance into between-query variance (task difficulty) and within-query variance (agent inconsistency), highlighting whether reported results reflect true capability or measurement noise.”
From Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation (2025) · cites this paper as Shrout and Fleiss 1979
In the citing paper
“The ICC quantifies the proportion of total variance attributable to differences between tasks and can be understood as a function of both the difficulty of the dataset (variance between tasks) and the consistency of the agent (variance within tasks).”
From Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation (2025) · cites this paper as Shrout and Fleiss 1979
In the citing paper
“Reproducibility of the final placenta, fetus and amniotic fluid volume in millilitres was assessed using the ICC (2,1) [37], [38] for inter-observer repeatability between the semi-automated Random Walker results, regarded as the ground-truth used for performance evaluation, and the newly generated FCNN outputs.”
From Fully Automated 3-D Ultrasound Segmentation of the Placenta, Amniotic Fluid, and Fetus for Early Pregnancy Assessment (2021) · cites this paper as [37]
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 27,137
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.3102/00028312006001112 · Cited by 8,013
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,012
Snedecor, G. W., & Cochran, W. G. (1967) · Cited by 6,573
Scheffé, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,625
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
The Intraclass Correlation Coefficient as a Measure of Reliability
Bartko, J. (1966) · Psychological Reports · doi:10.2466/pr0.1966.19.1.3 · Cited by 2,206
Statistics for the social sciences
Hays, W. L. (1973) · Medical Entomology and Zoology · Cited by 2,081
The theory of the estimation of test reliability
Kuder, G. F., & Richardson, M. W. (1937) · Psychometrika · doi:10.1007/bf02288391 · Cited by 1,953
Cited by
Sorted by citations
Items 7,301–7,400 of 23,882
Xie, Z., Canalda-Baltrons, A., d’Enfert, C., & Manichanh, C. (2023) · Microbiome · doi:10.1186/s40168-023-01693-w · Cited by 36
Croxford, E., Gao, Y., Pellegrino, N., Wong, K., Wills, G. J., First, E., Schnier, M., Burton, K. A., Ebby, C. G., Gorski, J. K., et al. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf068 · Cited by 53
Thibodeau, P. H., Perko, V. L., & Flusberg, S. J. (2015) · Social Science & Medicine · doi:10.1016/j.socscimed.2015.07.023 · Cited by 36
Yoshinaga, K., Manabe, O., Katoh, C., Chen, L., Klein, R., Naya, M., deKemp, R. A., Williams, K., Beanlands, R. S., & Tamaki, N. (2010) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-010-1541-y · Cited by 36
Evaluation of 3 commercially available materials for resolution of white spot lesions
Ballard, R. W., Hagan, J. L., Phaup, A. N., et al. (2013) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2012.08.020 · Cited by 36
Šedivý, P., Kipfelsberger, M. C., Dezortová, M., et al. (2015) · Medical Physics · doi:10.1118/1.4914448 · Cited by 36
The reliability of a rambling–trembling analysis of center of pressure measures
Słomka, K. J., Juras, G., Sobota, G., et al. (2012) · Gait & Posture · doi:10.1016/j.gaitpost.2012.07.005 · Cited by 36
Development of a rapid knee cartilage damage quantification method using magnetic resonance images
Zhang, M., Driban, J. B., Price, L. L., et al. (2014) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-15-264 · Cited by 36
de Gee, E. A., Verdurmen, J. E. E., Bransen, E., de Jonge, J. M., & Schippers, G. M. (2014) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2014.05.001 · Cited by 38
Rao, S., Baumhauer, J. F., & Nawoczenski, D. A. (2011) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2011.04.006 · Cited by 36
Twenty Best Practices for Just Employee Performance Reviews
Posthuma, R. A., & Campion, M. A. (2008) · Compensation & Benefits Review · doi:10.1177/0886368707312139 · Cited by 36
Bergström, L., Svensson, P., & Hartelius, L. (2013) · International Journal of Speech-Language Pathology · doi:10.3109/17549507.2013.855259 · Cited by 36
Mallat, J., Barrailler, S., Lemyze, M., Pepy, F., Gasan, G., Tronchon, L., & Thévenin, D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0056635 · Cited by 36
A randomized pilot study of anger treatment for Iraq and Afghanistan veterans
Shea, M. T., Lambert, J., & Reddy, M. K. (2013) · Behaviour Research and Therapy · doi:10.1016/j.brat.2013.05.013 · Cited by 36
Doguet, V., & Jubeau, M. (2014) · European Journal of Applied Physiology · doi:10.1007/s00421-014-2969-8 · Cited by 36
Choi, Y., Karremans, J. C., & Barendregt, H. P. (2011) · The Journal of Positive Psychology · doi:10.1080/17439760.2011.626788 · Cited by 43
Test–retest reliability of [11C]AZ10419369 binding to 5-HT1B receptors in human brain
Nord, M., Finnema, S. J., Schain, M., Halldin, C., & Farde, L. (2013) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-013-2529-1 · Cited by 36
Lam, S. C. B., Wald, M., Rajapakse, C. S., Liu, Y., Saha, P. K., & Wehrli, F. W. (2011) · Bone · doi:10.1016/j.bone.2011.07.010 · Cited by 37
Retracted: Anatomy of the hip capsule and pericapsular structures: A cadaveric study
Cooper, H. J., Walters, B. L., & Rodríguez, J. A. (2015) · Clinical Anatomy · doi:10.1002/ca.22539 · Cited by 36
RetractedThe Impact of Significant Others in Motivational Enhancement Therapy: Findings from Project MATCH
Manuel, J. K., Houck, J. M., & Moyers, T. B. (2011) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465811000592 · Cited by 36
Leader Behaviors as Mediators of the Leader Characteristics - Follower Satisfaction Relationship
Blickle, G., Frieder, R. E., Oerder, K., Wihler, A., von Below, A., Schütte, N., Matanovic, A., Mudlagk, D., Kokudeva, T., & Ferris, G. R. (2013) · Group & Organization Management · doi:10.1177/1059601113503183 · Cited by 36
Impact of component supplier branding on profitability
Worm, S., & Srivastava, R. K. (2014) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2014.05.005 · Cited by 36
Naredo, E., Möller, I., Gutiérrez, M., Bong, D. A., Cobo‐Ibáñez, T., Corominas, H., Corrales, A., Geso, L. D., García-Vivar, M. L., Iagnocco, A., et al. (2011) · Rheumatology · doi:10.1093/rheumatology/ker206 · Cited by 34
Increasing Children’s Physical Activity During School Recess Periods
Chin, J. J., & Ludwig, D. A. (2014) · American Journal of Public Health · doi:10.2105/ajph.2012.301132r · Cited by 36
Twiss, S. D., Cairns, C., Culloch, R. M., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049598 · Cited by 36
Team Mental Models of Expertise Location
Ellwart, T., Konradt, U., & Rack, O. (2014) · Small Group Research · doi:10.1177/1046496414521303 · Cited by 37
Guggenberger, R., Nanz, D., Bussmann, L., Chhabra, A. B., Fischer, M. A., Hodler, J., Pfirrmann, C. W. A., & Andreisek, G. (2013) · European Journal of Radiology · doi:10.1016/j.ejrad.2013.05.011 · Cited by 35
Data-Driven and Predefined ROI-Based Quantification of Long-Term Resting-State fMRI Reproducibility
Song, X., Panych, L. P., & Chen, N. (2015) · Brain Connectivity · doi:10.1089/brain.2015.0349 · Cited by 35
Kossek, E. E., Huang, J. L. W., Piszczek, M. M., Fleenor, J. W., & Ruderman, M. N. (2015) · Human Resource Management · doi:10.1002/hrm.21763 · Cited by 39
Ross, F. J., Metro, D. G., Beaman, S. T., et al. (2016) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2015.12.026 · Cited by 36
Goldman, R. E., Hilsenroth, M. J., Owen, J. J., & Gold, J. R. (2013) · Journal of Psychotherapy Integration · doi:10.1037/a0034363 · Cited by 36
Leoni, D., Falla, D., Heitz, C., Capra, G., Clijsen, R., Egloff, M., Cescon, C., Baeyens, J., & Barbero, M. (2016) · Pain Practice · doi:10.1111/papr.12429 · Cited by 35
Collaboration enhances later individual memory for emotional material
Bärthel, G. A., Wessel, I., Huntjens, R. J. C., & Verwoerd, J. (2016) · Memory · doi:10.1080/09658211.2016.1208248 · Cited by 37
Manca, A., Ginatempo, F., Cabboi, M. P., Mercante, B., Ortu, E., Dragone, D., de Natale, E. R., Dvir, Z., Rothwell, J. C., & Deriu, F. (2016) · European Journal of Applied Physiology · doi:10.1007/s00421-016-3451-6 · Cited by 36
Termenón, M., Achard, S., Jaillard, A. S., & Delon‐Martin, C. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00084 · Cited by 38
Muse, K., McManus, F. V., Rakovshik, S., & Thwaites, R. (2016) · Psychological Assessment · doi:10.1037/pas0000372 · Cited by 40
Liou, S., & Lan, X. (2017) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022116640897 · Cited by 36
White, N. J., Forsyth, B., Lee, A., & Machado, L. (2017) · Psychological Assessment · doi:10.1037/pas0000503 · Cited by 43
Masson, M. L. V., & de Araújo, T. M. (2017) · Journal of Voice · doi:10.1016/j.jvoice.2017.04.013 · Cited by 37
Common marmoset (Callithrix jacchus) personality.
Koski, S. E., Buchanan‐Smith, H. M., Ash, H., Burkart, J. M., Bugnyar, T., & Weiß, A. (2017) · Journal of comparative psychology · doi:10.1037/com0000089 · Cited by 39
Vincent, A. S., Roebuck‐Spencer, T., Fuenzalida, E., & Gilliland, K. (2017) · The Clinical Neuropsychologist · doi:10.1080/13854046.2017.1368716 · Cited by 36
Tabard-Fougère, A., Rose-Dulcina, K., Pittet, V., Dayer, R., Vuillerme, N., & Armand, S. (2017) · Gait & Posture · doi:10.1016/j.gaitpost.2017.10.026 · Cited by 36
Explorations of wearable technology for tracking self and others
Koo, S. H., & Fallon, K. (2018) · Fashion and Textiles · doi:10.1186/s40691-017-0123-z · Cited by 36
Is Older Age Associated with Higher Self- and Other-Rated ASD Characteristics?
Lever, A. G., & Geurts, H. M. (2018) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-017-3444-2 · Cited by 27
Acar, İ. H., Veziroğlu-Çelik, M., Garcia, A. S., Colgrove, A., Raikes, H. H., Gönen, M., & Encinger, A. J. (2018) · Early Childhood Education Journal · doi:10.1007/s10643-018-0893-y · Cited by 36
Kang, H. B., Amoako, G., Neil, S., & Dow, S. P. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174180 · Cited by 43
Kiefer, L. S., Fabian, J., Lorbeer, R., Machann, J., Storz, C., Kraus, M. S., Wintermeyer, E., Schlett, C. L., Roemer, F. W., Nikolaou, K., et al. (2018) · British Journal of Radiology · doi:10.1259/bjr.20180019 · Cited by 35
Mokhtarinia, H. R., Hosseini, A., Maleki-Ghahfarokhi, A., Gabel, C. P., & Zohrabi, M. (2018) · Health and Quality of Life Outcomes · doi:10.1186/s12955-018-0928-5 · Cited by 36
Neubert, T.-A., Dusch, M., Karst, M., & Beißner, F. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.8409 · Cited by 36
Anterior scleral thickness changes with accommodation in myopes and emmetropes
Woodman‐Pieterse, E. C., Read, S. A., Collins, M. J., et al. (2018) · Experimental Eye Research · doi:10.1016/j.exer.2018.07.023 · Cited by 36
Cerda-Vega, E., Jerez‐Mayorga, D., Payer, R. M., Campos‐Jara, C., Guzmán‐Guzmán, I. P., Reyes, A. P., & Ríos, L. J. C. (2018) · PLoS ONE · doi:10.1371/journal.pone.0202248 · Cited by 36
Tu, M.-C., Lo, C., Huang, C.-F., Huang, W., Deng, J. F., & Hsu, Y. (2018) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2018.00268 · Cited by 35
Vervaet, R., Houtte, M. V., & Stevens, P. A. J. (2018) · Teaching and Teacher Education · doi:10.1016/j.tate.2018.08.009 · Cited by 36
Landers, R. N., Collmus, A. B., & Williams, H. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.09.011 · Cited by 46
Owens, J. S., Evans, S. W., Coles, E. K., Holdaway, A. S., Himawan, L. K., Mixon, C. S., & Egan, T. E. (2018) · Journal of Emotional and Behavioral Disorders · doi:10.1177/1063426618795440 · Cited by 36
Variation in dental morphology and inference of continental ancestry in admixed Latin Americans
Delgado, M., Ramírez, L. M., Adhikari, K., Fuentes‐Guajardo, M., Zanolli, C., González‐José, R., Canizales, S., Bortolini, M. C., Poletti, G., Gallo, C., et al. (2018) · American Journal of Physical Anthropology · doi:10.1002/ajpa.23756 · Cited by 36
Interchangeability of radiomic features between [18F]‐ FDG PET / CT and [18F]‐ FDG PET / MR
Vuong, D., Tanadini‐Lang, S., Huellner, M. W., Veit‐Haibach, P., Unkelbach, J., Andratschke, N. H., Kraft, J., Gückenberger, M., & Bogowicz, M. (2019) · Medical Physics · doi:10.1002/mp.13422 · Cited by 36
Li, Z., Duan, H., Zhao, K., & Ding, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2923755 · Cited by 34
Merisaari, H., Taimen, P., Shiradkar, R., Ettala, O. O., Pesola, M., Saunavaara, J. P., Boström, P. J., Madabhushi, A., Aronen, H. J., & Jambor, I. (2019) · Magnetic Resonance in Medicine · doi:10.1002/mrm.28058 · Cited by 36
Estimation of Spinal Loading During Manual Materials Handling Using Inertial Motion Capture
Larsen, F. G., Svenningsen, F. P., Andersen, M. S., de Zee, M., & Skals, S. (2019) · Annals of Biomedical Engineering · doi:10.1007/s10439-019-02409-8 · Cited by 42
Hassanzahraee, M., Zoghi, M., & Jaberzadeh, S. J. (2019) · Brain Connectivity · doi:10.1089/brain.2019.0714 · Cited by 36
Stok, K. S., Burghardt, A. J., Boutroy, S., Peters, M., Manske, S. L., Stadelmann, V. A., Vilayphiou, N., van den Bergh, J. P., Geusens, P., Li, X., et al. (2020) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims.2019.12.11 · Cited by 36
A Transfer Learning Approach to Heatmap Regression for Action Unit Intensity Estimation
Ντίνου, Ι., Sánchez, E., Bulat, A., Valstar, M., & Tzimiropoulos, G. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3061605 · Cited by 36
Elbashir, M. Z., Sutton, S. G., Mahama, H., & Arnold, V. (2020) · Accounting and Finance · doi:10.1111/acfi.12644 · Cited by 36
Zhou, J., Damasceno, P. F., Chachad, R., Cheung, J., Ballatori, A. M., Lotz, J. C., Lazar, A. A., Link, T. M., Fields, A. J., & Krug, R. (2020) · Frontiers in Endocrinology · doi:10.3389/fendo.2020.00612 · Cited by 36
Prabhu, R., Bracken, J., Armstrong, C., Jablokow, K., Simpson, T. W., & Meisel, N. A. (2020) · International Journal of Design Creativity and Innovation · doi:10.1080/21650349.2020.1813633 · Cited by 36
Xu, Z., Zhang, H., Yan, W., et al. (2020) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2020.09.004 · Cited by 36
Unobtrusive Pain Monitoring in Older Adults With Dementia Using Pairwise and Contrastive Training
Rezaei, S., Moturu, A., Zhao, S., Prkachin, K. M., Hadjistavropoulos, T., & Taati, B. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3045743 · Cited by 39
Martinato, M., Lorenzoni, G., Zanchi, T., Bergamin, A., Buratin, A., Azzolina, D., & Gregori, D. (2021) · JMIR mhealth and uhealth · doi:10.2196/20966 · Cited by 37
Cooper, M., van Rijn, B., Chryssafidou, E., & Stiles, W. B. (2021) · Counselling Psychology Quarterly · doi:10.1080/09515070.2021.1877620 · Cited by 39
The Dialectical Behavior Therapy Adherence Coding Scale (DBT ACS): Psychometric properties.
Harned, M. S., Korslund, K. E., Schmidt, S. C., & Gallop, R. (2021) · Psychological Assessment · doi:10.1037/pas0000999 · Cited by 36
Dudău, D. P., & Sava, F. A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.570568 · Cited by 36
Audio Matters Too: How Audial Avatar Customization Enhances Visual Avatar Customization
Kao, D., Ratan, R., Mousas, C., Joshi, A., & Melcer, E. F. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501848 · Cited by 39
Silva, L. D. C., Belrose, C., Trousselard, M., Rea, B., Seery, E., Verdonk, C. G., Duffaud, A. M., & Verdonk, C. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.946271 · Cited by 44
Is Flexibility More than Fluency and Originality?
Weiss, S., & Wilhelm, O. (2022) · Journal of Intelligence · doi:10.3390/jintelligence10040096 · Cited by 64
Furukawa, E., Okuhara, T., Okada, H., Shirabe, R., Yokota, R., Iye, R., & Kiuchi, T. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192315763 · Cited by 40
Marital Cognitions and Depression in the Context of Marital Discord
Sayers, S. L., Kohn, C. S., Fresco, D. M., Bellack, A. S., & Sarwer, D. B. (2001) · Cognitive Therapy and Research · doi:10.1023/a:1012967222638 · Cited by 36
Tracking of Physical Activity and Inactivity in Middle School Girls
Baggett, C. D., Stevens, J., McMurray, R. G., Evenson, K. R., Murray, D. M., Catellier, D., & He, K. (2008) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e318180c390 · Cited by 36
Measuring symptom occurrence and symptom distress: development of the symptom experience index
Fu, M. R., McDaniel, R. W., & Rhodes, V. A. (2007) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04335.x · Cited by 36
Dunn, K. M., Jordan, K. P., & Croft, P. R. (2009) · Primary Health Care Research & Development · doi:10.1017/s1463423609990296 · Cited by 36
Kamibayashi, T., Tsuchida, T., Demura, Y., Tsujikawa, T., Okazawa, H., Kudoh, T., & Kimura, H. (2008) · Molecular Imaging and Biology · doi:10.1007/s11307-008-0132-9 · Cited by 36
Prediction of Dynamic Foot Posture During Running Using the Longitudinal Arch Angle
McPoil, T. G., & Cornwall, M. W. (2007) · Journal of the American Podiatric Medical Association · doi:10.7547/0970102 · Cited by 36
Kapp, J. M., Jackson-Thompson, J., Petroski, G. F., & Schootman, M. (2008) · Public Health · doi:10.1016/j.puhe.2008.10.005 · Cited by 36
Clinical Measurement of Muscle Tone Using a Velocity-Corrected Modified Ashworth Scale
Smith, A. W., Jamshidi, M., & Lo, S. K. (2002) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/00002060-200203000-00008 · Cited by 36
Smith, J. D., Stormshak, E. A., & Kavanagh, K. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0566-0 · Cited by 38
The impact of Kaizen on safety in modular home manufacturing
James, J., Ikuma, L. H., Nahmens, I., et al. (2013) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-013-5315-0 · Cited by 36
Pre-existent vertebral rotation in the human spine is influenced by body position
Janssen, M. M. A., Vincken, K. L., Kemp, B., et al. (2010) · European Spine Journal · doi:10.1007/s00586-010-1400-3 · Cited by 36
Stokes, J., Pogge, D. L., Powell-Lunder, J. A., et al. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8101_02 · Cited by 36
Reliability of the Zurich Neuromotor Assessment
Rousson, V., Gasser, T., Caflisch, J., et al. (2008) · The Clinical Neuropsychologist · doi:10.1080/13854040601076702 · Cited by 36
In Vitro Simulation of the Stance Phase in Human Gait
Kim, K. J. (2001) · Journal of Musculoskeletal Research · doi:10.1016/s0218-9577(01)00049-0 · Cited by 36
de Bruin, E. D., Hubli, M., Hofer, P., Wolf, P., Murer, K., & Zijlstra, W. (2012) · Journal of Aging Research · doi:10.1155/2012/954378 · Cited by 35
Pickard, A. S., Lin, H., Knight, S. J., Sharifi, R., Wu, Z., Hung, S.-Y., Witt, W. P., Chang, C.-H., & Bennett, C. L. (2009) · Medical Care · doi:10.1097/mlr.0b013e31818475f4 · Cited by 36
Mac‐Thiong, J., Pinel-Giroux, F., de Guise, J. A., et al. (2007) · European Spine Journal · doi:10.1007/s00586-007-0314-1 · Cited by 36
Pole, N., Ablon, J. S., & O’Connor, L. E. (2008) · Journal of Counseling Psychology · doi:10.1037/0022-0167.55.2.221 · Cited by 36
Cerebellar Volume and Cerebellar Metabolic Characteristics in Adults with Dyslexia
Laycock, S. K., Wilkinson, I. D., Wallis, L. I., Darwent, G., Wonders, S., Fawcett, A. J., Griffiths, P. D., & Nicolson, R. I. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1416.002 · Cited by 36
Miao, Y., Juhász, C., Wu, J., et al. (2011) · American Journal of Neuroradiology · doi:10.3174/ajnr.a2540 · Cited by 36
Boe, S. G., Dalton, B. H., Harwood, B. J., et al. (2009) · Clinical Neurophysiology · doi:10.1016/j.clinph.2009.02.168 · Cited by 36
Repeatability of the Oxford Foot Model for Kinematic Gait Analysis of the Foot and Ankle
van Hoeve, S., & JPAM, W. P. V. (2015) · Clinical Research on Foot & Ankle · doi:10.4172/2329-910x.1000171 · Cited by 36
Reliability and Validity of Clinically Assessing First-Ray Mobility of the Foot
Cornwall, M. W., Fishco, W. D., McPoil, T. G., et al. (2004) · Journal of the American Podiatric Medical Association · doi:10.7547/0940470 · Cited by 36
Kvrgic, S., Beck, E., Cavelti, M., Kossowsky, J., Stieglitz, R., & Vauth, R. (2011) · International Journal of Social Psychiatry · doi:10.1177/0020764011399004 · Cited by 36
Metadata
- Authors
- Shrout, P. E., & Fleiss, J. L.
- Affiliations
- Columbia University (US)
- ORCID
- Shrout, Patrick E.
- Venue
- Psychological Bulletin
- Published
- 1979
- Volume
- 86
- Issue
- 2
- Pages
- 420-428
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2141403362
- Cited by
- 24,532
- References
- 20
- Citations by year
- 2026: 1452 · 2025: 1085 · 2024: 998 · 2023: 1023 · 2022: 1083 · 2021: 1379 · 2020: 1189 · 2019: 1116 · 2018: 1178 · 2017: 1113 · 2016: 1106 · 2015: 1057 · 2014: 1172 · 2013: 1044 · 2012: 914
- FWCI
- 13.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Multidisciplinary Science and Engineering Research
- Keywords
- intraclass correlation coefficient, rater reliability, inter-rater reliability, reliability coefficients, confidence intervals, multiple raters
- MeSH terms
- Humans, Reproducibility of Results, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
