CoChat

Confidence Limits for Intraclass Reliability Coefficients

Baumgartner, Ted A., Chung, Hyuk · 2001 · Measurement in Physical Education and Exercise Science

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Abstract

A reliability coefficient (R) calculated using sample data may differ considerably in value from the population reliability coefficient. The reporting of confidence limits for the population reliability coefficient assists a person in interpreting the goodness of a sample reliability coefficient. The study was designed to (a) present the procedures for calculating confidence limits for R, (b) present confidence limits for several values of R and several sample sizes, and (c) describe a program in SPSS (1999) that provides confidence limits and hypothesis testing for Rs. The confidence limits for 3 different values of R, 2 different ANOVA models, 2 different sample sizes, 2 different numbers of repeated measures, and 2 different criterion scores were calculated. The confidence limits became narrower as R increased in value, as sample size increased in value, and as the number of repeated measures increased. For a given (a) R, (b) sample size, (c) number of repeated measures, and (d) criterion score, the confidence limits are the same for a 1-way and a 2-way Analysis of Variance model. Furthermore, when all other factors are equal, the confidence limits tend to be narrower for a criterion score that is a single score rather than a mean score. Based on the confidence limits reported, a sample size of at least 50 is needed to have relatively narrow confidence limits.

Overview

Integrity signals

Registry

Crossref · 10.1207/s15327841mpee0503_4

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 7 references

Research works printed but not linked: 1

  1. Ferguson, G. A. & Takane, Y. (1989). Statistical analysis in psychology and education (6th ed.). New York: McGraw-Hill.

Cited by

See all 277

Metadata

Authors
Baumgartner, T. A., & Chung, H.
Venue
Measurement in Physical Education and Exercise Science
Published
2001-09
Volume
5
Issue
3
Pages
179-188
ISSN
  • 1091-367X (ISSN-L)
  • 1532-7841
OpenAlex
W2086799524
Cited by
249
References
7
Citations by year
2026: 7 · 2025: 8 · 2024: 19 · 2023: 17 · 2022: 32 · 2021: 26 · 2020: 14 · 2019: 20 · 2018: 16 · 2017: 12 · 2016: 18 · 2015: 5 · 2014: 17 · 2013: 9 · 2012: 7
FWCI
1.08
Type
journal article
Language
en
Open access
closed
Locations
Measurement in Physical Education and Exercise Science (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
  • Social Sciences › Education › Sports Science and Education
Keywords
reliability coefficients, confidence limits, sample size, repeated measures, analysis of variance models, hypothesis testing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Confidence Limits for Intraclass Reliability Coefficients. https://app.cochat.ai/papers/10.1207/s15327841mpee0503_4
The paper
Baumgartner, T. A., & Chung, H. (2001). Confidence Limits for Intraclass Reliability Coefficients. Measurement in Physical Education and Exercise Science. https://doi.org/10.1207/s15327841mpee0503_4

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.