The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Intraclass correlations: Uses in assessing rater reliability.
Abstract
Reliability coefficients often take the form of intraclass correlation coefficients. In this article, guidelines are given for choosing among six different forms of the intraclass correlation for reliability studies in which n target are rated by k judges. Relevant to the choice of the coefficient are the appropriate statistical model for the reliability and the application to be made of the reliability results. Confidence intervals for each of the forms are reviewed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As a result, the inter-rater agreement was quite high for categorical variables (mean Cohen's kappa = 0.73, SD = 0.13) and for continuous variables (mean intraclass correlation [26] = 0.80, SD = .14).”
From Social Relationships and Mortality Risk: A Meta-analytic Review (2010) · cites this paper as [26]
In the citing paper
“we used the methodology Shrout and Fleiss (1979) describe and computed the Shrout-Fleiss single ICC score agreement of .998, which is considered quite high (Koo and Li 2016).”
From Driving Brand Engagement Through Online Social Influencers: An Empirical Investigation of Sponsored Blogging Campaigns (2019) · cites this paper as Shrout and Fleiss (1979)
In the citing paper
“In contrast, Cohen's quadratically weighted kappa converges to two-factor intraclass correlation coefficients with random and fixed raters (i.e., the so-called ICC (2,1) and ICC(3,1) coefficients), where the items and raters are the two factors (Carrasco, 2010;Fleiss & Cohen, 1973;Janson & Olsson, 2001;Schuster, 2004;Schuster & Smith, 2005;Shrout & Fleiss, 1979;Warrens, 2014).”
From Quadratically Weighted Agreement Coefficients: Interpretations and Connections (2026) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“A sample of 11% of video data was double coded by the researcher and an experienced coder (the developer of CHIPPA). Inter‐rater reliability was based on intra‐class correlation (ICC) statistics from the mean rating for the two coders (k = 2) using a two‐way mixed effects consistency model (see Table 2 below) and resulted in good to excellent reliability across the CHIPPA subscales (Koo & Li, 2016”
From A plausible role of imagination in pretend play, counterfactual reasoning, and executive functions (2023) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“The results suggest that coders showed high agreement (intraclass correlation [2, 1] = 0.85; Shrout & Fleiss, 1979).”
From Respiratory and cognitive mediators of treatment change in panic disorder: Evidence for intervention specificity. (2010) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“Interrater reliability of the pre- and posttreatment assessments was excellent (intraclass correlations [2, 1] = 0.97 and 0.96, respectively; Shrout & Fleiss, 1979).”
From Respiratory and cognitive mediators of treatment change in panic disorder: Evidence for intervention specificity. (2010) · cites this paper as Shrout & Fleiss, 1979
In the citing paper
“ICC decomposes observed variance into between-query variance (task difficulty) and within-query variance (agent inconsistency), highlighting whether reported results reflect true capability or measurement noise.”
From Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation (2025) · cites this paper as Shrout and Fleiss 1979
In the citing paper
“The ICC quantifies the proportion of total variance attributable to differences between tasks and can be understood as a function of both the difficulty of the dataset (variance between tasks) and the consistency of the agent (variance within tasks).”
From Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation (2025) · cites this paper as Shrout and Fleiss 1979
In the citing paper
“Reproducibility of the final placenta, fetus and amniotic fluid volume in millilitres was assessed using the ICC (2,1) [37], [38] for inter-observer repeatability between the semi-automated Random Walker results, regarded as the ground-truth used for performance evaluation, and the newly generated FCNN outputs.”
From Fully Automated 3-D Ultrasound Segmentation of the Placenta, Amniotic Fluid, and Fetus for Early Pregnancy Assessment (2021) · cites this paper as [37]
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 27,137
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.3102/00028312006001112 · Cited by 8,013
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,012
Snedecor, G. W., & Cochran, W. G. (1967) · Cited by 6,573
Scheffé, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,625
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
The Intraclass Correlation Coefficient as a Measure of Reliability
Bartko, J. J. (1966) · Psychological Reports · doi:10.2466/pr0.1966.19.1.3 · Cited by 2,342
Statistics for the social sciences
Hays, W. L. (1973) · Medical Entomology and Zoology · Cited by 2,081
The theory of the estimation of test reliability
Kuder, G. F., & Richardson, M. W. (1937) · Psychometrika · doi:10.1007/bf02288391 · Cited by 1,953
Cited by
Sorted by citations
Items 14,701–14,800 of 23,881
Seely, K. R., Wang, K. L., Tai, V., et al. (2020) · Translational Vision Science & Technology · doi:10.1167/tvst.9.9.16 · Cited by 9
Kuijpers, R., Smulders, E., Groen, B. E., Smits-Engelsman, B. C. M., der Sanden, M. W. G. N., & Weerdesteyn, V. (2020) · Disability and Rehabilitation · doi:10.1080/09638288.2020.1802523 · Cited by 9
Hand-Held Dynamometry in the Inpatient Care Setting After Total Knee Arthroplasty
Eymır, M., Yüksel, E., Ünver, B., et al. (2020) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000001592 · Cited by 9
Dabrh, A. M. A., Waller, T. A., Bonacci, R. P., Nawaz, A. J., Keith, J. J., Agarwal, A., Merfeld, J., Nordin, T., Winscott, M., Belda, T. E., et al. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02290-3 · Cited by 9
Yeung, L., Hale, C., Rizvi, B. M., Igwe, K. C., Sloan, R. P., Honig, L. S., Small, S. A., & Brickman, A. M. (2020) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2020.10.031 · Cited by 10
Bäckström, M., Björklund, F., Persson, R., & Lima‐Costa, A. R. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.557544 · Cited by 14
Koranyi, S., Philipp, R., Garzón, L. Q., Scheffold, K., Schulz‐Kindermann, F., Härter, M. C., Rodin, G., & Mehnert, A. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.561997 · Cited by 9
Zhang, Z., Vernekar, D., Qian, W., & Kim, M. (2021) · BMC Medical Imaging · doi:10.1186/s12880-021-00549-9 · Cited by 9
Psychometric Rigor of the Brief Religious Coping Measure (RCOPE) in Persian-Speaking Older Adults
Rezaeipandari, H., Morowatisharifabad, M. A., Mohammadpoorasl, A., et al. (2021) · Journal of Religion and Health · doi:10.1007/s10943-021-01229-2 · Cited by 9
3D optical scanning as an objective and reliable tool for volumetry of the foot and ankle region
Hofmann, B., Konopka, K., Fischer, D., et al. (2021) · Foot and Ankle Surgery · doi:10.1016/j.fas.2021.03.009 · Cited by 9
Blümel, S., Stadelmann, V. A., Brioschi, M., et al. (2021) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-021-04133-8 · Cited by 9
Ezeamama, A. E., Zalwango, S., Sikorskii, A. E., Tuke, R., Musoke, P., Giordani, B., & Boivin, M. (2021) · HIV Medicine · doi:10.1111/hiv.13094 · Cited by 9
Apte, S. S., Radonjic, A., Wong, B., et al. (2021) · Journal of Surgical Oncology · doi:10.1002/jso.26494 · Cited by 9
Acetyl‐CoA‐driven respiration in frozen muscle contributes to the diagnosis of mitochondrial disease
dos Reis, F. H. Z., Andrião-Escarso, S. H., Araujo, J. S., Espreáfico, E. M., Alberici, L. C., & Sobreira, C. F. D. R. (2021) · European Journal of Clinical Investigation · doi:10.1111/eci.13574 · Cited by 9
Usefulness of three‐dimensional computed tomography for patellofemoral measurement
Lee, K. W., Seo, D.-K., Bae, J.-Y., et al. (2021) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1007/s00167-021-06624-6 · Cited by 9
Recker, F., Jin, L., Veith, P., Lauterbach, M., Karakostas, P., & Schäfer, V. S. (2021) · Diagnostics · doi:10.3390/diagnostics11061106 · Cited by 9
She did it her way: An analysis of female rebellion in contemporary Bollywood movies
Karandikar, S., Kapoor, H., Diwakar, S., et al. (2021) · South Asian Popular Culture · doi:10.1080/14746689.2021.1940548 · Cited by 9
Ultrasound: Reliability of a Pocket-Sized System in the Assessment of Swallowing
Winiker, K., Burnip, E., Gozdzikowska, K., et al. (2021) · Journal of Speech Language and Hearing Research · doi:10.1044/2021_jslhr-21-00026 · Cited by 9
Pan, C., Wang, G., Li, Y., et al. (2021) · European Spine Journal · doi:10.1007/s00586-021-06947-5 · Cited by 9
Williams, R. J., Brown, E. C., Clark, D., Pike, G. B., & Ramasubbu, R. (2021) · Brain and Behavior · doi:10.1002/brb3.2287 · Cited by 8
Jung, J.-M., Chung, C. K., Kim, C. H., Yang, S. H., Won, Y. I., & Choi, Y. (2021) · World Neurosurgery · doi:10.1016/j.wneu.2021.08.031 · Cited by 9
The Effects of Loaded Plyometrics and Short Sprints in U19 Male Soccer Players in Tunisia
Aloui, G., Hermassi, S., Hayes, L. D., Bouhafs, E. G., Chelly, M. S., & Schwesig, R. (2021) · Applied Sciences · doi:10.3390/app11167621 · Cited by 9
Conflict Behaviors Mediate Effects of Manipulated Leader-Member Exchange on Team-Oriented Outcomes
Fletcher, K. A., & Brannick, M. Τ. (2021) · Journal of Business and Psychology · doi:10.1007/s10869-021-09775-y · Cited by 9
Negrin, L. L., Zeitler, C., & Hofbauer, M. (2021) · The American Journal of Sports Medicine · doi:10.1177/03635465211049226 · Cited by 9
Fredum, H. G., Rost, F., Ulberg, R., Midgley, N., Thorén, A., Aker, J. F. D., Johansen, H., Sandvand, L., Tosterud, L., & Dahl, H. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.708401 · Cited by 9
Sheldon, S. H., Jazayeri, M., Pierpoline, M., et al. (2021) · Journal of Cardiovascular Electrophysiology · doi:10.1111/jce.15300 · Cited by 9
Hamed, A., DasMahapatra, P., Lyn, N., Gwaltney, C. J., Iaconangelo, C., Serrano, D., Modur, V. R., & Politei, J. M. (2021) · Molecular Genetics and Metabolism Reports · doi:10.1016/j.ymgmr.2021.100824 · Cited by 9
Evidence-Based Artificial Intelligence in Medical Imaging
Streiner, D. L., Saboury, B., & Zukotynski, K. (2021) · PET Clinics · doi:10.1016/j.cpet.2021.09.005 · Cited by 9
MANAGEMENT APPROACHES TO MERGER EVOKED CULTURAL CHANGE AND ACCULTURATION OUTCOMES
Kavanagh, M., & Ashkanasy, N. M. (2004) · Advances in mergers & acquisitions/Advances in mergers and acquisitions · doi:10.1016/s1479-361x(04)03001-7 · Cited by 9
Wygant, D. B., Tylicki, J. L., Disney, L. F., et al. (2021) · Journal of Personality Assessment · doi:10.1080/00223891.2021.2006673 · Cited by 9
Xu, C., Shen, Q., Xu, J., et al. (2021) · Global Spine Journal · doi:10.1177/21925682211062498 · Cited by 9
Hashida, N., Tada, Y., Suzuki, M., Ito, K., Kato, Y., Tamiya, H., & Ishikawa, J. (2022) · Scientific Reports · doi:10.1038/s41598-022-05577-1 · Cited by 9
Children’s Spatial Play With a Block Building Touchscreen Application
Polinsky, N., Lemley, B., Flynn, R. M., Wartella, E. A., & Uttal, D. H. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.871895 · Cited by 11
Load-Induced Changes of Inter-Limb Asymmetries in Dynamic Postural Control in Healthy Subjects
Heil, J. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.824730 · Cited by 9
Reliability and feasibility of skeletal muscle ultrasound in the acute burn setting
Schieffelers, D. R., Dombrecht, D., Lafaire, C., Cuyper, L. D., Rose, T., Meirte, J., Gebruers, N., van Breda, E., & Daele, U. V. (2022) · Burns · doi:10.1016/j.burns.2022.03.003 · Cited by 9
Sosa-Moreno, A., Lee, G. O., Engen, A. V., Sun, K., Uruchima, J., Kwong, L. H., Ludwig-Borycz, E. F., Caruso, B. A., Cevallos, W., Lévy, K., et al. (2022) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.21-1099 · Cited by 15
Guerouah, Z., Lin, S., & Toronov, V. Y. (2021) · Applied Sciences · doi:10.3390/app12010371 · Cited by 9
Keiner, M., Kadlubowski, B., Hartmann, H., & Klaus, W. (2021) · International Journal of Sports and Exercise Medicine · doi:10.23937/2469-5718/1510190 · Cited by 12
Utility of Diagnostic Ultrasound in the Assessment of Patellar Instability
Bhimani, R., Ashkani‐Esfahani, S., Mirochnik, K., et al. (2022) · Orthopaedic Journal of Sports Medicine · doi:10.1177/23259671221098748 · Cited by 9
Oporia, F., Nuwaha, F., Kibira, S. P. S., et al. (2022) · Injury Prevention · doi:10.1136/injuryprev-2022-044608 · Cited by 9
Vaz, J., Bartley, A., & Hunt, J. (2022) · BMC Zoology · doi:10.1186/s40850-022-00126-9 · Cited by 10
Schauf, T., Dufner, M., Nestler, S., & Rau, R. (2022) · Personality and Social Psychology Bulletin · doi:10.1177/01461672221107205 · Cited by 9
Bulut, S., Karakaya, J., Öksüz, S., et al. (2022) · Rheumatology International · doi:10.1007/s00296-022-05170-9 · Cited by 9
Sowl, S., Amrein‐Beardsley, A., & Collins, C. (2022) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2022.102139 · Cited by 9
Habersack, A., Zussner, T., Thaller, S., Tilp, M., Švehlík, M., & Kruse, A. (2022) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1007/s00167-022-07076-2 · Cited by 9
Chang, J., Porter, I. R., Forman, M. A., et al. (2022) · Veterinary Radiology & Ultrasound · doi:10.1111/vru.13148 · Cited by 9
Wang, J., Zhang, Q., Liu, F., et al. (2022) · Frontiers in Surgery · doi:10.3389/fsurg.2022.912357 · Cited by 9
FEAFA+: an extended well-annotated dataset for facial expression analysis and 3D facial animation
Gan, W., Xue, J., Lu, K., Yan, Y., Gao, P., & Lyu, J. (2022) · International Conference on Digital Image Processing · doi:10.1117/12.2643588 · Cited by 9
Sheeran, S., Hartsfield, J. K., Omami, G., et al. (2022) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2022.10.004 · Cited by 9
Segond, N., Terzi, N., Duhem, H., et al. (2022) · Resuscitation · doi:10.1016/j.resuscitation.2022.109685 · Cited by 9
Liu, H., Zhao, D., Huang, Y., et al. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2023.1129918 · Cited by 9
Flôres, F. S., Lourenço, J., Phan, L. H., Jacobs, S., Willig, R., Marconcin, P., Casanova, N., Soares, D. P., Clemente, F. M., & Silva, A. F. (2023) · Children · doi:10.3390/children10040743 · Cited by 9
Tanaka, M. J., LaPorte, Z. L., Perry, N. P. J., et al. (2023) · Orthopaedic Journal of Sports Medicine · doi:10.1177/23259671231169730 · Cited by 9
Anatomic Assessment of L1-S1 Neuroforaminal Dimensions Using Computed Tomography
Harianja, G., Razzouk, J. A., Lindsey, W. W., et al. (2023) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.22.01394 · Cited by 9
Wilt, J. A., Sun, J., Jacques-Hamilton, R., & Smillie, L. D. (2023) · Self and Identity · doi:10.1080/15298868.2023.2246672 · Cited by 11
von der Emde, L. A., Mallwitz, M., Vaisband, M., Hasenauer, J., Saßmannshausen, M., Terheyden, J. H., Agostini, H. T., Altay, L., Atia, R., Bandello, F. M., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-43417-y · Cited by 9
Zhou, H., Zhou, J., Qin, C., Tian, Q., Zhou, S., Qin, Y., Wu, Y., Shi, J. Q., & Feng, F. (2023) · Academic Radiology · doi:10.1016/j.acra.2023.09.026 · Cited by 9
Automatic Detection and Intensity Estimation of Spontaneous Smiles
Girard, J. M. (2014) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 9
Pakhale, S. S., Wood-Dauphinée, S., Spahija, A., Collet, J., Maltais, F., Bernard, S., Baltzan, M., Rouleau, M., Bourbeau, J., & for the Respiratory Health Network of the FRSQ (2012) · Canadian Respiratory Journal · doi:10.1155/2012/914138 · Cited by 9
DiDonato, R. M., & Surprenant, A. M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00778 · Cited by 11
Digital imaging analysis to assess scar phenotype
Smith, B. J., Nidey, N., Miller, S. F., et al. (2014) · Wound Repair and Regeneration · doi:10.1111/wrr.12141 · Cited by 9
Martinez-Mier, E. A., Soto-Rojas, A. E., Buckley, C. M., et al. (2009) · PubMed · Cited by 9
Real-time identification of coherent generator groups
Demetriou, P., Hadjidemetriou, L., Kyriacou, A., et al. (2015) · doi:10.1109/ptc.2015.7232619 · Cited by 9
Gugiu, M. R., Gugiu, P. C., & Baldus, R. (2012) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v8i19.362 · Cited by 11
Dunleavy, K., Mariano, H., Wiater, T., et al. (2010) · Journal of Back and Musculoskeletal Rehabilitation · doi:10.3233/bmr-2010-0269 · Cited by 9
Gulbrandsen, P., Østbye, T., Lyna, P. R., Dolor, R. J., Tulsky, J. A., Alexander, S. C., & Pollak, K. I. (2012) · PubMed · Cited by 9
Reliability and validity of a measure of role functioning among people with psychiatric disabilities
Harris, M., Gladman, B., Hennessy, N., Lloyd, C., Mowry, B. J., & Waghorn, G. (2011) · Australian Occupational Therapy Journal · doi:10.1111/j.1440-1630.2010.00921.x · Cited by 9
Comparison of Site-Based Versus Central Ratings in a Study of Generalized Anxiety Disorder
Williams, J. B. W., Kobak, K. A., Giller, E. L., et al. (2015) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0000000000000422 · Cited by 9
Reliability of Visual Measurement of Forefoot Alignment
Cornwall, M. W., McPoil, T. G., Fishco, W. D., et al. (2004) · Foot & Ankle International · doi:10.1177/107110070402501009 · Cited by 9
Villar, P., Luengo, M. A., Romero, E., et al. (2014) · Psychology Crime and Law · doi:10.1080/1068316x.2014.885970 · Cited by 9
Practice-Based Evidence: Patients Who Did Not Respond to Group Analysis
Lorentzen, S., Høglend, P., Martinsen, E., & Ringdal, E. (2011) · International journal of group psychotherapy · doi:10.1521/ijgp.2011.61.3.366 · Cited by 8
Lavigueur, S., Tremblay, R. E., & Saucier, J. (1993) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1993.tb01065.x · Cited by 9
Pérez‐Matute, P., Pérez‐Martínez, L., Blanco, J. R., et al. (2013) · Journal of the International AIDS Society · doi:10.7448/ias.16.1.18609 · Cited by 9
Exploring the Relationship Between Interrater Correlations and Validity of Peer Ratings
Kasten, R., & Nevo, B. (2008) · Human Performance · doi:10.1080/08959280801917792 · Cited by 9
Christen, D., Zwahlen, A., & Müller, R. (2013) · Journal of the mechanical behavior of biomedical materials/Journal of mechanical behavior of biomedical materials · doi:10.1016/j.jmbbm.2013.10.010 · Cited by 9
Emulating real-life situations with a play task to observe parenting skills and child behaviors.
Rusby, J. C., Metzler, C. W., Sanders, M. R., & Crowley, R. N. (2015) · Journal of Family Psychology · doi:10.1037/fam0000056 · Cited by 9
The Development of Interpersonal Relationships in Individuals With Schizophrenia
Nisenson, L. G., Berenbaum, H., & Good, T. L. (2001) · Psychiatry · doi:10.1521/psyc.64.2.111.18618 · Cited by 9
Ivanova, J. I., Mytelka, D. S., Duh, M. S., et al. (2013) · Patient · doi:10.1007/s40271-013-0018-z · Cited by 9
Slomkowski, C. L., Wasserman, G. A., Schaffer, D., et al. (1997) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1997.tb01858.x · Cited by 9
Reliability of distortion-product otoacoustic emissions in the common marmoset (Callithrix jacchus)
Valero, M. D., & Ratnam, R. (2011) · Hearing Research · doi:10.1016/j.heares.2011.07.004 · Cited by 9
Dijkstra, L., & van Eijnatten, F. M. (2009) · Quality & Quantity · doi:10.1007/s11135-009-9249-4 · Cited by 9
Cooper, M. A., Herda, T. J., Herda, A. A., Costa, P. B., Ryan, E. D., & Cramer, J. T. (2013) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0b013e31828159ac · Cited by 9
Kooiman, B. J., & Sheehan, D. P. (2014) · American Journal of Distance Education · doi:10.1080/08923647.2014.957946 · Cited by 9
Interrater reliability of endoscopic parameters following sinus surgery
Smith, T. L., Hwang, P. H., Murr, A. H., Lavigne, F., & Koreck, A. (2011) · The Laryngoscope · doi:10.1002/lary.22440 · Cited by 10
PET-CT and diagnostic CT: The synergy of metabolic and morphological data in onco-haematology
Ricard, F., Giammarile, F., Tychyj-Pinel, C., Houzard, C., Decullier, É., Chateau, F., Manichon, A., Orliaguet, I., Michallet, A., Salles, G., et al. (2013) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2013.07.008 · Cited by 9
Wenner, Y., Wismann, S., Jäger, M., Pons‐Kühnemann, J., & Lorenz, B. (2011) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-011-1630-z · Cited by 9
Pryseley, A., Ledent, E. Y., Drewes, A. M., Staahl, C., Olesen, A. E., & Arendt‐Nielsen, L. (2009) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/j.1742-7843.2009.00408.x · Cited by 9
Hunt, M. A., Ciacca, S. R. D., Jones, I. C., et al. (2010) · Physiotherapy Canada · doi:10.3138/physio.62.3.235 · Cited by 9
Ζetou, E., Papadakis, L., Vernadakıs, N., et al. (2014) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2014.09.328 · Cited by 9
Relationship Patterns Questionnaire (RPQ): Psychometric properties and clinical applications
Kurth, R. A., Körner, A., Geyer, M. A., et al. (2004) · Psychotherapy Research · doi:10.1093/ptr/kph037 · Cited by 9
Cross-Context Agreement of the Adjustment Scales for Children and Adolescents
Schaefer, B. A., Watkins, M. W., & Canivez, G. L. (2001) · Journal of Psychoeducational Assessment · doi:10.1177/073428290101900202 · Cited by 9
Macroscopic marital interaction coding systems: Are they interchangeable?
Bélanger, C., Sabourin, S., Laughrea, K., Dulude, D., & Wright, J. C. (1993) · Behaviour Research and Therapy · doi:10.1016/0005-7967(93)90010-r · Cited by 9
Mariano, E. R., Yun, R., Kim, T. E., & Carvalho, B. (2014) · Journal of Ultrasound in Medicine · doi:10.7863/ultra.33.5.905 · Cited by 9
The Effects of Warnings and Speeding on Scale Scores and Convergent Validity of Conscientiousness
Robie, C., Taggar, S., & Brown, D. J. (2009) · Human Performance · doi:10.1080/08959280903120287 · Cited by 11
Thibault-Gagnon, S., Gentilcore‐Saulnier, E., Auchincloss, C., & McLean, L. (2014) · Physiotherapy Canada · doi:10.3138/ptc.2013-50 · Cited by 9
Reliability of Soleus H-Reflexes in Standing and Walking Post-Incomplete Spinal Cord Injury
Phadke, C. P., Thompson, F. J., Trimble, M. H., Behrman, A. L., & Kukulka, C. G. (2010) · International Journal of Neuroscience · doi:10.3109/00207450903337739 · Cited by 9
Janik, T. J., Harrison, D. E., Harrison, D. E., et al. (2001) · Journal of Manipulative and Physiological Therapeutics · doi:10.1016/s0161-4754(01)53921-4 · Cited by 9
O'Connor, B. P., & Dyce, J. A. (1993) · Basic and Applied Social Psychology · doi:10.1207/s15324834basp1401_6 · Cited by 9
Simple overlay device for determining radial head and neck height
Moon, J.-G., Southgate, R. D., Fitzsimmons, J. S., & O’Driscoll, S. W. (2010) · Skeletal Radiology · doi:10.1007/s00256-010-0893-5 · Cited by 9
Responses of FEV6, FVC, and FET to inhaled bronchodilator in the adult general population
Kainu, A., Lindqvist, A. E., Sarna, S. J., Lundbäck, B., & Sovijärvi, A. R. A. (2009) · Respiratory Research · doi:10.1186/1465-9921-10-71 · Cited by 11
Metadata
- Authors
- Shrout, P. E., & Fleiss, J. L.
- Affiliations
- Columbia University (US)
- ORCID
- Shrout, Patrick E.
- Venue
- Psychological Bulletin
- Published
- 1979
- Volume
- 86
- Issue
- 2
- Pages
- 420-428
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2141403362
- Cited by
- 24,532
- References
- 20
- Citations by year
- 2026: 1452 · 2025: 1085 · 2024: 998 · 2023: 1023 · 2022: 1083 · 2021: 1379 · 2020: 1189 · 2019: 1116 · 2018: 1178 · 2017: 1113 · 2016: 1106 · 2015: 1057 · 2014: 1172 · 2013: 1044 · 2012: 914
- FWCI
- 13.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Multidisciplinary Science and Engineering Research
- Keywords
- intraclass correlation coefficient, rater reliability, inter-rater reliability, reliability coefficients, confidence intervals, multiple raters
- MeSH terms
- Humans, Reproducibility of Results, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
