The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Treating Cronbach’s Alpha Reliability Coefficients as Data in Counseling Research
Abstract
Scientific associations and measurement experts in psychology and education have voiced various standards and best-practice recommendations concerning reliability data over the years. Yet in the counseling psychology literature, there is virtually no single-source compilation and articulation of good practices for reporting, analyzing, and interpreting reliability to guide applied researchers intending to use scales rather than develop them. Therefore, focusing on Cronbach’s alpha internal consistency reliability estimates, this article (a) defines and provides rationales for seven broad categories of good practices for reporting, analyzing, interpreting, and using reliability data and (b) illustrates some pragmatic strategies for implementing the good practices with respect to reliability data in quantitative studies involving already-developed scales. The authors’ recommendations for good rather than best practices acknowledge that additional or alternative practices may be required when scale development is the researcher’s focus. The authors summarize their good practices in tabular form.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
(1991) · Cited by 15,554
The social readjustment rating scale
Holmes, T. H., & Rahe, R. H. (1967) · Journal of Psychosomatic Research · doi:10.1016/0022-3999(67)90010-4 · Cited by 11,067
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 9×
“Our discussion focuses on Cronbach’s (1951) coefficient alpha (hereafter alpha) because, reportedly, it is the most frequently used procedure for estimating reliability in applied psychology (e.g., Cortina, 1993; Peterson, 1994).”
BackgroundMethodInfluentialScale Development Research: A Content Analysis and Recommendations for Best Practices
Worthington, R. L., & Whittaker, T. A. (2006) · The Counseling Psychologist · doi:10.1177/0011000006288127 · Cited by 4,087
Measurement, Design, and Analysis: An Integrated Approach.
Funk, S. G., Pedhazur, E. J., & Schmelkin, L. P. (1992) · Journal of the American Statistical Association · doi:10.2307/2290248 · Cited by 4,018
Starting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794
A Meta-Analysis of Cronbach's Coefficient Alpha
Peterson, R. A. (1994) · Journal of Consumer Research · doi:10.1086/209405 · Cited by 3,028
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
A Brief Guide to Structural Equation Modeling
Weston, R., & Gore, P. A. (2006) · The Counseling Psychologist · doi:10.1177/0011000006286345 · Cited by 2,718
Uses and abuses of coefficient alpha
Schmitt, N. (1996) · Psychological Assessment · doi:10.1037/1040-3590.8.4.350 · Cited by 2,588
Standards for Educational and Psychological Testing.
García, E. J. (2017) · Revista Española de Pedagogía · doi:10.22550/2174-0909.3051 · Cited by 2,217
Black and white racial identity: theory, research, and practice
(1990) · Choice Reviews Online · doi:10.5860/choice.28-0596 · Cited by 2,062
Moses, L. E., & Lindquist, E. F. (1951) · Journal of the American Statistical Association · doi:10.2307/2280411 · Cited by 1,661
Handbook of counseling psychology
Brown, S. D., & Lent, R. W. (1992) · John Wiley & Sons, Inc. eBooks · Cited by 1,162
Landrine, H., & Klonoff, E. A. (1996) · Journal of Black Psychology · doi:10.1177/00957984960222002 · Cited by 1,154
Introduction to Psychological Measurement
Nunnally, J. C. (1970) · Medical Entomology and Zoology · Cited by 1,070
Being Inconsistent About Consistency: When Coefficient Alpha Does and Doesn't Matter
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8003_01 · Cited by 1,070
Handbook of Counseling Psychology
Schell, B. J. (1994) · Family & Community Health · doi:10.1097/00003727-199404000-00010 · Cited by 830
Kerres Malecki, C., & Kilpatrick Demary, M. (2002) · Psychology in the Schools · doi:10.1002/pits.10004 · Cited by 731
Kahn, J. H. (2006) · The Counseling Psychologist · doi:10.1177/0011000006286347 · Cited by 695
Toward a Theoretical Explanation of the Effects of Race on Counseling A Black and White Model
Helms, J. E. (1984) · The Counseling Psychologist · doi:10.1177/0011000084124013 · Cited by 575
Self-citationWhat If There Were No Significance Tests?
(2016) · Routledge eBooks · doi:10.4324/9781315629049 · Cited by 542
Limitations of Coefficient Alpha as an Index of Test Unidimensionality1
Green, S. B., Lissitz, R. W., & Mulaik, S. A. (1977) · Educational and Psychological Measurement · doi:10.1177/001316447703700403 · Cited by 522 · cited 1×
“…be sizable even when analyzing the responses to a measure yields many factors, if responses to the items defined by one factor correlate slightly positively with items defined by other factors or dimensions (Cortina, 1993; Cronbach, 1951; Green et al., 1977; Kahn, 2006 [this issue]; Schmitt, 1996).”
BackgroundDoes item homogeneity indicate internal consistency or item redundancy in psychometric scales?
Boyle, G. J. (1991) · Personality and Individual Differences · doi:10.1016/0191-8869(91)90115-r · Cited by 495
Vacha-Haase, T. (1998) · Educational and Psychological Measurement · doi:10.1177/0013164498058001002 · Cited by 449
Journal of Consumer Psychology: The Official Journal of The Society for Consumer Psychology
Maheswaran, D. (2009) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2009.06.003 · Cited by 433
Advancing Alpha: Measuring Reliability With Confidence
Iacobucci, D., & Duhachek, A. (2003) · Journal of Consumer Psychology · doi:10.1207/s15327663jcp1304_14 · Cited by 374
Psychometrics Is Datametrics: The Test Is Not Reliable
Thompson, B., & Vacha-Haase, T. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970448 · Cited by 357
Educational and Psychological Measurement
(1962) · Educational and Psychological Measurement · doi:10.1177/001316446202200432 · Cited by 352
Coefficient alpha and related internal consistency reliability coefficients.
Osburn, H. G. (2000) · Psychological Methods · doi:10.1037//1082-989x.5.3.343 · Cited by 351
Feldt, L. S. (1969) · Psychometrika · doi:10.1007/bf02289364 · Cited by 345
Advancing Alpha: Measuring Reliability with ConfidencePreprint
Iacobucci, D., & Duhachek, A. (2003) · SSRN Electronic Journal · Cited by 282
Score Reliability: Contemporary Thinking on Reliability Issues
Thompson, B. (2002) · Cited by 255
Dawis, R. V. (1987) · Journal of Counseling Psychology · doi:10.1037/0022-0167.34.4.481 · Cited by 229
Fan, X., & Thompson, B. (2001) · Educational and Psychological Measurement · doi:10.1177/0013164401614001 · Cited by 218
Effect-Size Measures and Meta-Analytic Thinking in Counseling Psychology Research
Henson, R. K. (2006) · The Counseling Psychologist · doi:10.1177/0011000005283558 · Cited by 199
Yin, P., & Fan, X. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970466 · Cited by 197 · cited 1×
“We use the DG and referent data, summarized in Table 1 to illustrate several types of RG studies that are easily accomplished and, as Yin and Fan (2000) point out, will make it possible to understand how and why the reliability of measurements obtained from a particular scale vary across studies.”
MethodConfidence Intervals About Score Reliability Coefficients, Please: An EPM Guidelines Editorial
Fan, X., & Thompson, B. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971365 · Cited by 191
Vacha-Haase, T., Kogan, L. R., & Thompson, B. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970682 · Cited by 187
Internal consistency estimates of reliability
Ferketich, S. (1990) · Research in Nursing & Health · doi:10.1002/nur.4770130612 · Cited by 182
(1969) · The Counseling Psychologist · doi:10.1177/001100006900100302 · Cited by 176
Feldt, L. S. (1980) · Psychometrika · doi:10.1007/bf02293600 · Cited by 166
Thompson, B. (2003) · Sage eBooks · doi:10.4135/9781412985789 · Cited by 166
Alpha Inflation? The Impact of Eliminating Scale Items on Cronbach's Alpha
Kopalle, P. K., & Lehmann, D. R. (1997) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1997.2702 · Cited by 156
Construct Validation in Counseling Psychology Research
Hoyt, W. T., Warbasse, R. E., & Chu, E. Y. (2006) · The Counseling Psychologist · doi:10.1177/0011000006287389 · Cited by 144
Discriminant Analysis in Counseling Psychology Research
Sherry, A. R. (2006) · The Counseling Psychologist · doi:10.1177/0011000006287103 · Cited by 133
A Framework for Reporting and Interpreting Internal Consistency Reliability Estimates
Onwuegbuzie, A. J., & Daniel, L. G. (2002) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2002.12069052 · Cited by 130
A coefficient alpha for test-retest data.
Green, S. B. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.1.88 · Cited by 88
Trends in reporting psychometric properties of scales used in counseling psychology research.
Meier, S. T., & Davis, S. R. (1990) · Journal of Counseling Psychology · doi:10.1037/0022-0167.37.1.113 · Cited by 79
Estimating the reliability of a test split into two parts of equal or unequal length.
Feldt, L. S., & Charter, R. A. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.1.102 · Cited by 72
Helms, J. E. (1999) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.1999.12068979 · Cited by 64
Self-citationBlock, C. J., Roberson, L., & Neuger, D. A. (1995) · Journal of Vocational Behavior · doi:10.1006/jvbe.1995.1005 · Cited by 59
The Problem of Negative Reliabilities
Krus, D. J., & Helmstadter, G. C. (1993) · Educational and Psychological Measurement · doi:10.1177/0013164493053003005 · Cited by 47
Feldt, L. S., & Ankenmann, R. D. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.4.366 · Cited by 42
The Importance of Reliability as It Relates to True Score Confidence Intervals
Charter, R. A., & Feldt, L. S. (2002) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2002.12069053 · Cited by 30
Higher-order factors in the differential emotions scale (DES-III)
Boyle, G. J. (1986) · Personality and Individual Differences · doi:10.1016/0191-8869(86)90005-x · Cited by 27
Advances in psychometric theory and methods.
Bolt, D. M., & Rounds, J. (2000) · Cited by 7
Cited by
Scale Development Research: A Content Analysis and Recommendations for Best Practices
Worthington, R. L., & Whittaker, T. A. (2006) · The Counseling Psychologist · doi:10.1177/0011000006288127 · Cited by 4,087
A Brief Guide to Structural Equation Modeling
Weston, R., & Gore, P. A. (2006) · The Counseling Psychologist · doi:10.1177/0011000006286345 · Cited by 2,718
Racism as a Determinant of Health: A Systematic Review and Meta-Analysis
Paradies, Y., Ben, J., Denson, N., Elias, A., Priest, N., Pieterse, A., Gupta, A., Kelaher, M., & Gee, G. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138511 · Cited by 2,610
“8 or higher) [62], exposure timeframe (less than 3 years/3 years or more/not specified).”
BackgroundKahn, J. H. (2006) · The Counseling Psychologist · doi:10.1177/0011000006286347 · Cited by 695
Ponterotto, J. G., & Ruckdeschel, D. E. (2007) · Perceptual and Motor Skills · doi:10.2466/pms.105.3.997-1014 · Cited by 555
Metadata
- Authors
- Helms, J. E., Henze, K. T., Sass, T. L., & Mifsud, V. A.
- Venue
- The Counseling Psychologist
- Publisher
- SAGE Publications
- Published
- 2006-09
- Volume
- 34
- Issue
- 5
- Pages
- 630-660
- ISSN
- 0011-0000 (ISSN-L)
- 1552-3861
- OpenAlex
- W2107864861
- Cited by
- 276
- References
- 58
- FWCI
- 16.79
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.