Confidence Limits for Intraclass Reliability Coefficients
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
A reliability coefficient (R) calculated using sample data may differ considerably in value from the population reliability coefficient. The reporting of confidence limits for the population reliability coefficient assists a person in interpreting the goodness of a sample reliability coefficient. The study was designed to (a) present the procedures for calculating confidence limits for R, (b) present confidence limits for several values of R and several sample sizes, and (c) describe a program in SPSS (1999) that provides confidence limits and hypothesis testing for Rs. The confidence limits for 3 different values of R, 2 different ANOVA models, 2 different sample sizes, 2 different numbers of repeated measures, and 2 different criterion scores were calculated. The confidence limits became narrower as R increased in value, as sample size increased in value, and as the number of repeated measures increased. For a given (a) R, (b) sample size, (c) number of repeated measures, and (d) criterion score, the confidence limits are the same for a 1-way and a 2-way Analysis of Variance model. Furthermore, when all other factors are equal, the confidence limits tend to be narrower for a criterion score that is a single score rather than a mean score. Based on the confidence limits reported, a sample size of at least 50 is needed to have relatively narrow confidence limits.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903
Measurement for Evaluation in Physical Education and Exercise Science
Baumgartner, T. A., & Jackson, A. S. (1987) · Medical Entomology and Zoology · Cited by 464
Self-citationIntroduction to measurement in physical education and exercise science
Safrit, M. J. (1986) · Medical Entomology and Zoology · Cited by 348
How “Significant” is Your Reliability?
Morrow, J. R., & Jackson, A. W. (1993) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1993.10608821 · Cited by 176
Approximate Interval Estimation for a Certain Intraclass Correlation Coefficient
Fleiss, J. L., & Shrout, P. E. (1978) · Psychometrika · doi:10.1007/bf02293867 · Cited by 148
The Sampling Theory for the Intraclass Reliability Coefficient
Feldt, L. S. (1990) · Applied Measurement in Education · doi:10.1207/s15324818ame0304_5 · Cited by 22
Research works printed but not linked: 1
- Ferguson, G. A. & Takane, Y. (1989). Statistical analysis in psychology and education (6th ed.). New York: McGraw-Hill.
Cited by
Esco, M. R., & Flatt, A. A. (2014) · PubMed · Cited by 362
Test-retest reliability of computerized concussion assessment programs.
Broglio, S. P., Ferrara, M. S., Macciocchi, S. N., Baumgartner, T. A., & Elliott, R. (2007) · PubMed · Cited by 330
Self-citationNimphius, S., Callaghan, S. J., Spiteri, T., & Lockie, R. G. (2016) · Journal of Strength and Conditioning Research · doi:10.1519/jsc.0000000000001421 · Cited by 316
Sports-Related Concussions in Youth: Improving the Science, Changing the Culture
(2014) · National Academies Press eBooks · doi:10.17226/18377 · Cited by 139
Hori, N., Newton, R. U., Kawamori, N., McGuigan, M. R., Kraemer, W. J., & Nosaka, K. (2009) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0b013e3181a00ca2 · Cited by 267
Metadata
- Authors
- Baumgartner, T. A., & Chung, H.
- ORCID
- Chung, Hyuk
- Venue
- Measurement in Physical Education and Exercise Science
- Publisher
- Informa UK Limited
- Published
- 2001-09
- Volume
- 5
- Issue
- 3
- Pages
- 179-188
- ISSN
- 1091-367X (ISSN-L)
- 1532-7841
- OpenAlex
- W2086799524
- Cited by
- 249
- References
- 7
- Citations by year
- 2026: 7 · 2025: 8 · 2024: 19 · 2023: 17 · 2022: 32 · 2021: 26 · 2020: 14 · 2019: 20 · 2018: 16 · 2017: 12 · 2016: 18 · 2015: 5 · 2014: 17 · 2013: 9 · 2012: 7
- FWCI
- 1.08
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Measurement in Physical Education and Exercise Science (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Education › Sports Science and Education
- Keywords
- reliability coefficients, confidence limits, sample size, repeated measures, analysis of variance models, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Confidence Limits for Intraclass Reliability Coefficients. https://app.cochat.ai/papers/10.1207/s15327841mpee0503_4
- The paper
- Baumgartner, T. A., & Chung, H. (2001). Confidence Limits for Intraclass Reliability Coefficients. Measurement in Physical Education and Exercise Science. https://doi.org/10.1207/s15327841mpee0503_4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.