The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Intraclass correlations: Uses in assessing rater reliability.
Abstract
Reliability coefficients often take the form of intraclass correlation coefficients. In this article, guidelines are given for choosing among six different forms of the intraclass correlation for reliability studies in which n target are rated by k judges. Relevant to the choice of the coefficient are the appropriate statistical model for the reliability and the application to be made of the reliability results. Confidence intervals for each of the forms are reviewed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As a result, the inter-rater agreement was quite high for categorical variables (mean Cohen's kappa = 0.73, SD = 0.13) and for continuous variables (mean intraclass correlation [26] = 0.80, SD = .14).”
From Social Relationships and Mortality Risk: A Meta-analytic Review (2010) · cites this paper as [26]
In the citing paper
“we used the methodology Shrout and Fleiss (1979) describe and computed the Shrout-Fleiss single ICC score agreement of .998, which is considered quite high (Koo and Li 2016).”
From Driving Brand Engagement Through Online Social Influencers: An Empirical Investigation of Sponsored Blogging Campaigns (2019) · cites this paper as Shrout and Fleiss (1979)
In the citing paper
“In contrast, Cohen's quadratically weighted kappa converges to two-factor intraclass correlation coefficients with random and fixed raters (i.e., the so-called ICC (2,1) and ICC(3,1) coefficients), where the items and raters are the two factors (Carrasco, 2010;Fleiss & Cohen, 1973;Janson & Olsson, 2001;Schuster, 2004;Schuster & Smith, 2005;Shrout & Fleiss, 1979;Warrens, 2014).”
From Quadratically Weighted Agreement Coefficients: Interpretations and Connections (2026) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“A sample of 11% of video data was double coded by the researcher and an experienced coder (the developer of CHIPPA). Inter‐rater reliability was based on intra‐class correlation (ICC) statistics from the mean rating for the two coders (k = 2) using a two‐way mixed effects consistency model (see Table 2 below) and resulted in good to excellent reliability across the CHIPPA subscales (Koo & Li, 2016”
From A plausible role of imagination in pretend play, counterfactual reasoning, and executive functions (2023) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“The results suggest that coders showed high agreement (intraclass correlation [2, 1] = 0.85; Shrout & Fleiss, 1979).”
From Respiratory and cognitive mediators of treatment change in panic disorder: Evidence for intervention specificity. (2010) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“Interrater reliability of the pre- and posttreatment assessments was excellent (intraclass correlations [2, 1] = 0.97 and 0.96, respectively; Shrout & Fleiss, 1979).”
From Respiratory and cognitive mediators of treatment change in panic disorder: Evidence for intervention specificity. (2010) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“ICC decomposes observed variance into between-query variance (task difficulty) and within-query variance (agent inconsistency), highlighting whether reported results reflect true capability or measurement noise.”
From Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation (2025) · cites this paper as Shrout and Fleiss 1979
In the citing paper
“The ICC quantifies the proportion of total variance attributable to differences between tasks and can be understood as a function of both the difficulty of the dataset (variance between tasks) and the consistency of the agent (variance within tasks).”
From Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation (2025) · cites this paper as Shrout and Fleiss 1979
In the citing paper
“Reproducibility of the final placenta, fetus and amniotic fluid volume in millilitres was assessed using the ICC (2,1) [37], [38] for inter-observer repeatability between the semi-automated Random Walker results, regarded as the ground-truth used for performance evaluation, and the newly generated FCNN outputs.”
From Fully Automated 3-D Ultrasound Segmentation of the Placenta, Amniotic Fluid, and Fetus for Early Pregnancy Assessment (2021) · cites this paper as [37]
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 27,137
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.3102/00028312006001112 · Cited by 8,013
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,012
Snedecor, G. W., & Cochran, W. G. (1967) · Cited by 6,573
Scheffé, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,625
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
The Intraclass Correlation Coefficient as a Measure of Reliability
Bartko, J. (1966) · Psychological Reports · doi:10.2466/pr0.1966.19.1.3 · Cited by 2,206
Statistics for the social sciences
Hays, W. L. (1973) · Medical Entomology and Zoology · Cited by 2,081
The theory of the estimation of test reliability
Kuder, G. F., & Richardson, M. W. (1937) · Psychometrika · doi:10.1007/bf02288391 · Cited by 1,953
Cited by
Sorted by citations
Items 5,601–5,700 of 23,883
Neurological soft signs in psychometrically identified schizotypy
Kaczorowski, J. A., Neus Barrantes-vidal, A., & Kwapil, T. R. (2009) · Schizophrenia Research · doi:10.1016/j.schres.2009.06.018 · Cited by 53
School ethnic composition and aspirations of immigrant students in Belgium
Houtte, M. V., & Stevens, P. A. J. (2009) · British Educational Research Journal · doi:10.1080/01411920902802180 · Cited by 50
Physiological Falls Risk Assessment in Older People with Alzheimer’s Disease
Lorbach, E. R., Webster, K. E., Menz, H. B., et al. (2007) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000107101 · Cited by 50
Liu, Y., Chen, R., Chen, Y., Mei, Q., & Salib, S. (2012) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2124295.2124356 · Cited by 49
Shirley, N., & Montes, P. A. R. (2015) · Journal of Forensic Sciences · doi:10.1111/1556-4029.12617 · Cited by 52
Measuring Acetabular Component Version After THA: CT or Plain Radiograph?
McArthur, B. A., Cross, M. B., Geatrakas, C., et al. (2012) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-012-2292-9 · Cited by 50
Seibert, T. M., Majid, D. S. A., Aron, A. R., Corey‐Bloom, J., & Brewer, J. B. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.08.105 · Cited by 50
Template based rotation: A method for functional connectivity analysis with a priori templates
Schultz, A. P., Chhatwal, J. P., Huijbers, W., Hedden, T., Dijk, K. R. A. V., McLaren, D. G., Ward, A. M., Wigman, S. E., & Sperling, R. A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.08.022 · Cited by 50
The multi-stage fitness test as a predictor of endurance fitness in wheelchair athletes
Goosey-Tolfrey, V. L., & Tolfrey, K. (2008) · Journal of Sports Sciences · doi:10.1080/02640410701624531 · Cited by 50
McCauley, S. R., Wilde, E. A., Bigler, E. D., Chu, Z. D., Yallampalli, R., Oni, M. B., Wu, T. C., Ramos, M. A., Pedroza, C., Vásquez, A. C., et al. (2011) · Journal of Neurotrauma · doi:10.1089/neu.2010.1555 · Cited by 49
Willetts, L., Parker, K., Wesselius, L., et al. (2011) · Respiratory Research · doi:10.1186/1465-9921-12-116 · Cited by 50
Huyge, E., Maele, D. V., & Houtte, M. V. (2014) · Gender and Education · doi:10.1080/09540253.2014.972921 · Cited by 51
Huang, E. P., Wang, X. F., Choudhury, K. R., McShane, L. M., Gönen, M., Ye, J., Buckler, A. J., Kinahan, P. E., Reeves, A. P., Jackson, E. F., et al. (2014) · Statistical Methods in Medical Research · doi:10.1177/0962280214537394 · Cited by 51
Jang, S. H., & Kwon, H. G. (2015) · Neuroscience Letters · doi:10.1016/j.neulet.2015.01.071 · Cited by 50
Jin, S., Ning, X., & Mirka, G. A. (2012) · Journal of Electromyography and Kinesiology · doi:10.1016/j.jelekin.2012.01.003 · Cited by 50
Meyer, N., Lauwers‐Cancès, V., Lourari, S., Laurent, J., Konstantinou, M. P., Lagarde, J., Krief, B., Batatia, H., Lamant, L., & Paul, C. F. (2014) · British Journal of Dermatology · doi:10.1111/bjd.13129 · Cited by 50
Schuster‐Amft, C., Hahn, S., & Ettlin, T. M. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-106 · Cited by 50
Compton, M. T., Fantes, F., Wan, C. R., Johnson, S., & Walker, E. F. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2014.12.048 · Cited by 50
Bornstein, M. H., Suwalsky, J. T. D., Putnick, D. L., Gini, M., Venuti, P., de Falco, S., Heslington, M., & de Galperín, C. Z. (2010) · International Journal of Behavioral Development · doi:10.1177/0165025409339080 · Cited by 55
Digital image analysis versus clinical assessment of wound epithelialization: A validation study
Bloemen, M. C. T., Boekema, B. K. H. L., Vlig, M., et al. (2012) · Burns · doi:10.1016/j.burns.2012.02.003 · Cited by 50
The Majority of Genetic Variation in Orangutan Personality and Subjective Well-Being is Nonadditive
Adams, M. J., King, J. E., & Weiß, A. (2012) · Behavior Genetics · doi:10.1007/s10519-012-9537-y · Cited by 52
Both Scanning Plane and Observer Affect Measurements of Scaphoid Deformity
Ring, D., Patterson, J. D., Levitz, S., et al. (2005) · The Journal Of Hand Surgery · doi:10.1016/j.jhsa.2005.03.001 · Cited by 50
Church, A. K., VanDerMeid, K. R., Baig, N. A., et al. (2015) · Clinical & Experimental Immunology · doi:10.1111/cei.12697 · Cited by 50
Palosaari, K. (2004) · British journal of rheumatology · doi:10.1093/rheumatology/keh302 · Cited by 50
Tomarken, A. J., Han, G. T., & Corbett, B. A. (2015) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2015.08.016 · Cited by 49
Interferon-gamma inducible protein-10 as a potential biomarker in localized scleroderma
Magee, K. E., Zigler, C. K., Kurzinski, K. L., et al. (2013) · Arthritis Research & Therapy · doi:10.1186/ar4378 · Cited by 50
The Effectiveness of Group Voice Therapy: A Group Climate Perspective
Law, T. K. T., Lee, K., Ho, F. N.-Y., Vlantis, A. C., van Hasselt, A. C., & Tong, M. C. F. (2011) · Journal of Voice · doi:10.1016/j.jvoice.2010.12.003 · Cited by 50
Qian, W., Chan, Q., Mak, H. K., Zhang, Z., Anthony, M., Yau, K. K. W., Khong, P., Chan, K. H., & Kim, M. (2011) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.22575 · Cited by 53
Rochester, L., Rafferty, D., Dotchin, C. L., Msuya, O., Minde, V., & Walker, R. W. (2010) · Movement Disorders · doi:10.1002/mds.22978 · Cited by 50
Multidimensional Neuropathic Pain Phenotypes after Spinal Cord Injury
Widerström-Noga, E. G., Felix, E. R., Adcock, J. P., Escalona, M., & Tibbett, J. A. (2015) · Journal of Neurotrauma · doi:10.1089/neu.2015.4040 · Cited by 50
Wray, T. B., Kahler, C. W., & Monti, P. M. (2016) · AIDS and Behavior · doi:10.1007/s10461-015-1272-y · Cited by 53
Kümmel, J., Bergmann, J., Prieske, O., Krämer, A., Granacher, U., & Grüber, M. (2016) · BMC Sports Science Medicine and Rehabilitation · doi:10.1186/s13102-016-0027-z · Cited by 50
Graser, J. V., Letsch, C., & van Hedel, H. J. A. (2016) · BMC Neurology · doi:10.1186/s12883-016-0538-y · Cited by 50
Engaged teams deliver better service performance in innovation climates
Buades, E. G., Martínez‐Tur, V., Ortiz-Bonnín, S., & Silla, J. M. P. (2016) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2016.1171752 · Cited by 50
Quality assessment of clinical guidelines in China: 1993 - 2010.
Chen, Y., Yao, L., Xiao, X.-J., Wang, Q., Wang, Z.-H., Liang, F., Liang, H., Wang, X., Shen, X., Xie, C.-C., et al. (2012) · PubMed · doi:10.3760/cma.j.issn.0366-6999.2012.20.011 · Cited by 50
Hicks, C. M., Kiss, A., Bandiera, G. W., & Denny, C. J. (2012) · Canadian Journal of Emergency Medicine · doi:10.2310/8000.2012.120580 · Cited by 51
Diffusion tensor imaging MR neurography for the detection of polyneuropathy in type 1 diabetes
Væggemose, M., Pham, M., Ringgaard, S., Tankişi, H., Ejskjær, N., Heiland, S., Poulsen, P. L., & Andersen, H. (2016) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.25415 · Cited by 50
How heritable is empathy? Differential effects of measurement and subcomponents
Melchers, M., Montag, C., Reuter, M., Spinath, F. M., & Hahn, E. (2016) · Motivation and Emotion · doi:10.1007/s11031-016-9573-7 · Cited by 56
Daugherty, A. M., & Raz, N. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.09.044 · Cited by 51
Amount of Epithelioid Differentiation Is a Predictor of Survival in Malignant Pleural Mesothelioma
Vigneswaran, W. T., Kircheva, D. Y., Ananthanarayanan, V., et al. (2016) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2016.08.063 · Cited by 50
Auliffe, S. M., McCreesh, K. M., Purtill, H., & O’Sullivan, K. (2016) · Physical Therapy in Sport · doi:10.1016/j.ptsp.2016.12.002 · Cited by 51
Dong, X., Wang, L., Tao, Y., Suo, X.-L., Li, Y.-C., Liu, F., Zhao, Y., & Zhang, Q. (2016) · International Journal of COPD · doi:10.2147/copd.s117626 · Cited by 51
Eliasson, K., Palm, P., Nyman, T., & Forsman, M. (2017) · Applied Ergonomics · doi:10.1016/j.apergo.2017.02.004 · Cited by 54
Akkarakittichoke, N., & Janwantanakul, P. (2017) · Safety and Health at Work · doi:10.1016/j.shaw.2016.10.005 · Cited by 50
Self-Report Dietary Assessment Tools Used in Canadian Research: A Scoping Review
Kirkpatrick, S. I., Vanderlee, L., Raffoul, A., Stapleton, J. E., Csizmadi, I., Boucher, B. A., Massarelli, I., Rondeau, I., & Robson, P. J. (2017) · Advances in Nutrition · doi:10.3945/an.116.014027 · Cited by 50
Biomass responses in a temperate European grassland through 17 years of elevated CO 2
Andresen, L. C., Yuan, N., Seibert, R., et al. (2017) · Global Change Biology · doi:10.1111/gcb.13705 · Cited by 50
Longitudinal characterization of biomarkers for spinal muscular atrophy
Bonati, U., Holiga, Š., Hellbach, N., Risterucci, C., Bergauer, T., Tang, W., Hafner, P., Thoeni, A., Bieri, O., Gerlach, I., et al. (2017) · Annals of Clinical and Translational Neurology · doi:10.1002/acn3.406 · Cited by 50
The role of cone-beam breast-CT for breast cancer detection relative to breast density
Wienbeck, S., Uhlig, J., Luftner-Nagel, S., et al. (2017) · European Radiology · doi:10.1007/s00330-017-4911-z · Cited by 50
Martin, S. S., Wichmann, J. L., Weyer, H., et al. (2017) · European Journal of Radiology · doi:10.1016/j.ejrad.2017.06.017 · Cited by 50
Schnerr, R. S., Jansen, J. F. A., Uludaǧ, K., Hofman, P. A. M., Wildberger, J. E., van Oostenbrugge, R. J., & Backes, W. H. (2017) · Frontiers in Physiology · doi:10.3389/fphys.2017.00961 · Cited by 50
Whyte, M. P., Fujita, K. P., Moseley, S., et al. (2018) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.3377 · Cited by 50
Cao, H., McEwen, S. C., Forsyth, J. K., Gee, D. G., Bearden, C. E., Addington, J., Goodyear, B. G., Cadenhead, K. S., Mirzakhanian, H., Cornblatt, B. A., et al. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhy032 · Cited by 51
Blum, M. R., Gencer, B., Adam, L., Feller, M., Collet, T., da Costa, B. R., Moutzouri, E., Dopheide, J. F., Depairon, M., Sykiotis, G. P., et al. (2018) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2018-00279 · Cited by 53
Vrieze, T. D., Vos, L., Gebruers, N., Groef, A. D., Dams, L., der Gucht, E. V., Nevelsteen, I., & Devoogdt, N. (2019) · Lymphatic Research and Biology · doi:10.1089/lrb.2018.0025 · Cited by 51
Wochatz, M., Tilgner, N., Mueller, S., Rabe, S., Eichler, S., John, M., Völler, H., & Mayer, F. (2019) · Gait & Posture · doi:10.1016/j.gaitpost.2019.03.020 · Cited by 54
The EmojiGrid as a Tool to Assess Experienced and Perceived Emotions
Toet, A., & van Erp, J. B. F. (2019) · Psych · doi:10.3390/psych1010036 · Cited by 51
Heritability and Cognitive Relevance of Structural Brain Controllability
Lee, W. H., Rodrigue, A., Glahn, D. C., Bassett, D. S., & Frangou, S. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhz293 · Cited by 49
Chang, N., Cui, L., Luo, Y., Chang, Z., Yu, B., & Liu, Z. (2020) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims.2020.02.21 · Cited by 49
Berre, C. L., Flamant, M., Bouguen, G., et al. (2020) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjaa100 · Cited by 50
Estimation and validation of individualized dynamic brain models with resting state fMRI
Singh, M. F., Braver, T. S., Cole, M. W., & Ching, S. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117046 · Cited by 47
Saggio, G., Tombolini, F., & Ruggiero, A. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3016642 · Cited by 54
Donisi, L., Pagano, G., Cesarelli, G., Coccia, A., Amitrano, F., & D’Addio, G. (2020) · Measurement · doi:10.1016/j.measurement.2020.108642 · Cited by 51
Erbaş, Y., Kalokerinos, E. K., Kuppens, P., van Halem, S., & Ceulemans, E. (2021) · Assessment · doi:10.1177/1073191121990089 · Cited by 51
Pariente, B., Torres, J., Burisch, J. M., et al. (2021) · Gastroenterology · doi:10.1053/j.gastro.2021.05.049 · Cited by 50
Psychotherapy adherence of therapists treating HIV-positive patients with depressive symptoms.
Markowitz, J. C., Spielman, L. A., Scarvalone, P., & Perry, S. W. (2000) · PubMed Central · Cited by 49
Sanfilippo, S., Canis, M. J., Ouchchane, L., Botchorishvili, R., Artonne, C., Janny, L., & Brugnon, F. (2011) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-011-9649-y · Cited by 50
Kothmann, E., Danjoux, G. R., Owen, S. J., Parry, A., Turley, A., & Batterham, A. M. (2008) · Anaesthesia · doi:10.1111/j.1365-2044.2008.05690.x · Cited by 50
The Practical Hearing Aids Skills Test—Revised
Doherty, K. A., & Desjardins, J. L. (2012) · American Journal of Audiology · doi:10.1044/1059-0889(2012/11-0019 · Cited by 49
Primary Closure vs Second-Intention Treatment of Skin Punch Biopsy Sites
Christenson, L. J., Phillips, P. K., Weaver, A. L., & Otley, C. C. (2005) · Archives of Dermatology · doi:10.1001/archderm.141.9.1093 · Cited by 50
Reproducibility of self-reported melanoma risk factors in a large cohort study of Norwegian women
Veierød, M. B., Parr, C. L., Lund, E., & Hjartåker, A. (2008) · Melanoma Research · doi:10.1097/cmr.0b013e3282f120d2 · Cited by 50
Rosenbach, M. A., Yeung, H., Chu, E. Y., Kim, E. J., Payne, A. S., Takeshita, J., Vittorio, C. C., Wanat, K. A., Werth, V. P., & Gelfand, J. M. (2013) · JAMA Dermatology · doi:10.1001/jamadermatol.2013.60 · Cited by 50
Bourgeois, F. T., Simons, W. W., Olson, K. L., Brownstein, J. S., & Mandl, K. D. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.984 · Cited by 49
The effects of joint angle and reliability on knee proprioception
Pincivero, D. M., BACHMEIER, B., & COELHO, A. J. (2001) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-200110000-00015 · Cited by 50
Effect of the posterior cruciate ligament in knee-joint proprioception in total knee arthroplasty
Lattanzio, P., Chess, D. G., & MacDermid, J. C. (1998) · The Journal of Arthroplasty · doi:10.1016/s0883-5403(98)90059-6 · Cited by 50
Reproducibility of Dynamic MR Imaging Pelvic Measurements: A Multi-institutional Study
Lockhart, M. E., Fielding, J. R., Richter, H. E., Brubaker, L. T., Salomon, C. G., Ye, W., Hakim, C. M., Wai, C. Y., Stolpen, A. H., & Weber, A. M. (2008) · Radiology · doi:10.1148/radiol.2492072009 · Cited by 50
Aquatic Instructors’ Attitudes Toward Teaching Students with Disabilities
Conatser, P., Block, M. E., & Lepore, M. (2000) · Adapted Physical Activity Quarterly · doi:10.1123/apaq.17.2.197 · Cited by 50
Fritz, J. M., Delitto, A., Erhard, R. E., & Roman, M. (1998) · Physical Therapy · doi:10.1093/ptj/78.10.1046 · Cited by 49
Harms, P. D., Roberts, B. W., & Wood, D. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2006.08.001 · Cited by 50
Richards, M., Stern, Y., Mader, K., et al. (1993) · Annals of Neurology · doi:10.1002/ana.410330307 · Cited by 50
Estimation procedures affect the center of pressure frequency analysis
Vieira, T., de Oliveira, L. F., & Nadal, J. (2009) · Brazilian Journal of Medical and Biological Research · doi:10.1590/s0100-879x2009000700012 · Cited by 50
Stuart, A., Kalinowski, J. S., Saltuklaroglu, T., et al. (2006) · Disability and Rehabilitation · doi:10.1080/09638280500386635 · Cited by 50
An Acute Care Physical Therapy Clinical Practice Database for Outcomes Research
Shields, R. K., Leo, K. C., Miller, B., Dostal, W. F., & Barr, R. N. (1994) · Physical Therapy · doi:10.1093/ptj/74.5.463 · Cited by 50
Morphett, A. L., Crawford, C. M., & Lee, D. H. (2003) · Journal of Manipulative and Physiological Therapeutics · doi:10.1016/s0161-4754(02)54107-5 · Cited by 50
The prevalence of cortical gray matter atrophy may be overestimated in the healthy aging brain.
Burgmans, S., van Boxtel, M. P. J., Vuurman, E. F. P. M., Smeets, F., Gronenschild, E. H. B. M., Uylings, H. B. M., & Jolles, J. (2009) · Neuropsychology · doi:10.1037/a0016161 · Cited by 50
Öhman, A., Nilsson, S., & Beckung, E. (2009) · Physiotherapy Theory and Practice · doi:10.1080/09593980802686904 · Cited by 50
Role of the Mother's Touch in Failure to Thrive: A Preliminary Investigation
Polan, H. J., & Ward, M. J. (1994) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199410000-00005 · Cited by 50
Cicchetti, D. V. (1984) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00026558 · Cited by 50
Rogers, J. S., Witt, P. L., Gross, M. T., et al. (1998) · Physical Therapy · doi:10.1093/ptj/78.11.1175 · Cited by 50
Tammemägi, M. C., Frank, J. W., LeBlanc, M. L., Artsob, H., & Streiner, D. L. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00243-j · Cited by 50
Shrout, P. E., & Begg, M. D. (2005) · Encyclopedia of Biostatistics · doi:10.1002/0470011815.b2a17159 · Cited by 50
Self-citationPark, S. W., Ko, M. J., Kim, Y.-B., et al. (2020) · Journal of Orthopaedic Surgery and Research · doi:10.1186/s13018-020-1545-7 · Cited by 50
Ivison, S., Malek, M., Garcia, R. V., Broady, R., Halpin, A., Richaud, M., Brant, R. F., Wang, S.-I., Goupil, M., Guan, Q., et al. (2018) · JCI Insight · doi:10.1172/jci.insight.121867 · Cited by 49
Barbaro, J., & Dissanayake, C. (2007) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-006-0267-y · Cited by 49
Younossi, Z. M., Afendy, A., Stepanova, M., Racila, A., Nader, F., Gomel, R., Safer, R., Lenderking, W. R., Skalicky, A., Kleinman, L., et al. (2018) · Hepatology · doi:10.1002/hep.29664 · Cited by 48
Ryan, J. L., Artéro, S., Carrière, I., Maller, J. J., Meslin, C., Ritchie, K. A., & Ancelin, M. (2015) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.08.022 · Cited by 49
Molinari, V., Kunik, M. E., Mulsant, B. H., & Rifai, A. H. (1998) · PubMed · Cited by 49
The Effects of Politeness-Related Instruction on Medical Tutoring
Bromme, R., Brummernhenrich, B., Becker, B.-M., & Jucks, R. (2012) · Communication Education · doi:10.1080/03634523.2012.691979 · Cited by 49
Interrater reliability and aspects of validity of the myositis damage index
Sultan, S. M., Allen, E., Cooper, R. G., et al. (2011) · Annals of the Rheumatic Diseases · doi:10.1136/ard.2010.142117 · Cited by 49
Tump, A. N., Wolf, M., Krause, J., & Kurvers, R. H. J. M. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2018.0155 · Cited by 49
Alonso-Royo, R., Sánchez-Torrelo, C. M., Ibáñez‐Vera, A. J., Zagalaz‐Anula, N., Castellote‐Caballero, Y., Obrero‐Gaitán, E., Rodríguez‐Almagro, D., & Lomas‐Vega, R. (2021) · Diagnostics · doi:10.3390/diagnostics11030472 · Cited by 50
Metadata
- Authors
- Shrout, P. E., & Fleiss, J. L.
- Affiliations
- Columbia University (US)
- ORCID
- Shrout, Patrick E.
- Venue
- Psychological Bulletin
- Published
- 1979
- Volume
- 86
- Issue
- 2
- Pages
- 420-428
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2141403362
- Cited by
- 24,532
- References
- 20
- Citations by year
- 2026: 1452 · 2025: 1085 · 2024: 998 · 2023: 1023 · 2022: 1083 · 2021: 1379 · 2020: 1189 · 2019: 1116 · 2018: 1178 · 2017: 1113 · 2016: 1106 · 2015: 1057 · 2014: 1172 · 2013: 1044 · 2012: 914
- FWCI
- 13.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Multidisciplinary Science and Engineering Research
- Keywords
- intraclass correlation coefficient, rater reliability, inter-rater reliability, reliability coefficients, confidence intervals, multiple raters
- MeSH terms
- Humans, Reproducibility of Results, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
