Making Reliability Reliable: A Systematic Approach to Reliability Coefficients
The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Abstract
The current conventions for test score reliability coefficients are unsystematic and chaotic. Reliability coefficients have long been denoted using names that are unrelated to each other, with each formula being generated through different methods, and they have been represented inconsistently. Such inconsistency prevents organizational researchers from understanding the whole picture and misleads them into using coefficient alpha unconditionally. This study provides a systematic naming convention, formula-generating methods, and methods of representing each of the reliability coefficients. This study offers an easy-to-use solution to the issue of choosing between coefficient alpha and composite reliability. This study introduces a calculator that enables its users to obtain the values of various multidimensional reliability coefficients with a few mouse clicks. This study also presents illustrative numerical examples to provide a better understanding of the characteristics and computations of reliability coefficients.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Cronbach's alpha is not structural equation modeling (SEM) based, yet it is the most commonly-reported reliability coefficient in studies using SEM (Cho, 2016).”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Cho, 2016
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · cited 8×
“One estimator goes by the name of the fourth person to propose it (Cronbach, 1951), and others do not bear the name of any developers.”
BackgroundMethodInfluentialStructural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology · doi:10.2307/2072165 · Cited by 17,442
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,277 · cited 1×
“This study assumes that no specific factors exist to circumvent the controversial issue of specific factors and errors (Bollen, 1989).”
BackgroundStatistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
EQS : structural equations program manual
Bentler, P. M. (1989) · Medical Entomology and Zoology · Cited by 9,669
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 2×
“Many users perform the reverse; they calculate reliability to identify unidimensionality, misconceiving that a high value of a unidimensional reliability coefficient indicates unidimensionality (Cortina, 1993; Green, Lissitz, & Mulaik, 1977; Hattie, 1985; Schmitt, 1996).”
BackgroundStatistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Test Theory: A Unified Treatment
Zwick, R., & McDonald, R. P. (2000) · Journal of the American Statistical Association · doi:10.2307/2669496 · Cited by 3,603
Dunn, T. J., Baguley, T., & Brunsden, V. (2014) · British Journal of Psychology · doi:10.1111/bjop.12046 · Cited by 3,596 · cited 3×
“In addition to Jöreskog’s (1971) work, two approaches deserve mention. Let pi denote the ratio of the length of item i (i.e., li) to the total length (i.e., Pk i1⁄41 li), and let siX denote Pk j1⁄41 sij. Raju’s (1977) generalization of his previous formula (~ rR1977) is algebraically equivalent to rC .”
BackgroundMethodHandbook of Structural Equation Modeling
Howard, A. L. (2013) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2013.769397 · Cited by 3,440
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814 · cited 2×
“…studies such as Cortina (1993) and Schmitt (1996) offered influential lessons on alpha for organizational researchers, it is still commonly misconceived and widely misused (Cho & Kim, 2015; Dunn, Baguley, & Brunsden, 2013; Green & Yang, 2009a; Raykov, 2012; Sijtsma, 2009a; Yang & Green, 2011).”
BackgroundUses and abuses of coefficient alpha
Schmitt, N. (1996) · Psychological Assessment · doi:10.1037/1040-3590.8.4.350 · Cited by 2,588 · cited 2×
“Many users perform the reverse; they calculate reliability to identify unidimensionality, misconceiving that a high value of a unidimensional reliability coefficient indicates unidimensionality (Cortina, 1993; Green, Lissitz, & Mulaik, 1977; Hattie, 1985; Schmitt, 1996).”
BackgroundDouglas, O. B., & Holland, B. F. (2015) · Fundamentals of educational psychology. · doi:10.1037/14910-020 · Cited by 2,272
Statistical Methods for Research Workers.
I., L., & Fisher, R. A. (1926) · Journal of the Royal Statistical Society · doi:10.2307/2341488 · Cited by 2,128
The Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112 · cited 2×
“The answer is affirmative in many cases because a common construct is what scale developers originally intended to measure and what typical researchers are most interested in (Cho & Kim, 2015; Reise, 2012).”
BackgroundThe Sources of Four Commonly Reported Cutoff Criteria: What Did They Really Say?
Lance, C. E., Butts, M. M., & Michels, L. C. (2006) · Organizational Research Methods · doi:10.1177/1094428105284919 · Cited by 2,053
The Theory of the Estimation of Test Reliability
Kuder, G. F., & Richardson, M. W. (1937) · Psychometrika · doi:10.1007/bf02288391 · Cited by 2,002
Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma
Revelle, W., & Zinbarg, R. E. (2009) · Psychometrika · doi:10.1007/s11336-008-9102-z · Cited by 1,628 · cited 4×
“…applicable to multidimensional models, and Zinbarg, Revelle, Yovel, and Li (2005) more explicitly expressed McDonald’s proposal, recommending it be categorized into o, which were relabeled as ot in Revelle and Zinbarg (2009), and oH (or oh). oH is called hierarchical omega or omega hierarchical.”
BackgroundMethodResultInfluentialMy Current Thoughts on Coefficient Alpha and Successor Procedures
Cronbach, L. J., & Shavelson, R. J. (2004) · Educational and Psychological Measurement · doi:10.1177/0013164404266386 · Cited by 1,606 · cited 7×
“One estimator goes by the name of the fourth person to propose it (Cronbach, 1951), and others do not bear the name of any developers.”
BackgroundMethodInfluentialStatistical analysis of sets of congeneric tests
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291393 · Cited by 1,481
Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005) · Psychometrika · doi:10.1007/s11336-003-0974-7 · Cited by 1,439 · cited 2×
“…level; however, they used the term to denote the ratio of the variances due to group factors to test score variances (i.e., % group factor in Table 8), which is different from the way Zinbarg et al. (2005) defined hierarchical omega at the test reliability level (i.e., % general factor).”
BackgroundMethodRice, T. K. (2014) · Encyclopedia of Special Education · doi:10.1002/9781118660584.ese1088 · Cited by 1,335
STATISTICAL ANALYSIS OF SETS OF CONGENERIC TESTS*
Jo̎reskog, K. G. (1969) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1969.tb00777.x · Cited by 1,203 · cited 3×
“Jöreskog (1971) also did not suggest a special name for the reliability coefficient he developed and simply called it reliability.”
BackgroundInfluentialCORRELATION CALCULATED FROM FAULTY DATA
SPEARMAN, C. (1910) · British Journal of Psychology, 1904-1920 · doi:10.1111/j.2044-8295.1910.tb00206.x · Cited by 1,144 · cited 2×
“For more than a hundred years, numerous researchers (e.g., Brown, 1910; Spearman, 1910) have developed reliability coefficients in various ways, but during this process, they were named, interpreted and expressed inconsistently.”
BackgroundA Basis for Analyzing Test-Retest Reliability
Guttman, L. (1945) · Psychometrika · doi:10.1007/bf02288892 · Cited by 1,122 · cited 4×
“Second, Cronbach (1951) positioned alpha as a reliability coefficient, whereas Guttman (1945) described li as lower-bound estimators of reliability, which was mathematically correct but represented an unpopular description.”
BackgroundMethodInfluentialOn the relationship between coefficient alpha and composite reliability.
Peterson, R. A., & Kim, Y. (2013) · Journal of Applied Psychology · doi:10.1037/a0030767 · Cited by 1,104 · cited 1×
“Composite reliability, which is based on a unidimensional SEM measurement model, is the second most frequently used reliability coefficient in organizational research (Peterson & Kim, 2013).”
MethodThe Development of Hierarchical Factor Solutions
Schmid, J., & Leiman, J. M. (1957) · Psychometrika · doi:10.1007/bf02289209 · Cited by 1,098 · cited 1×
“Applying its formula to a second-order factor model requires a Schmid–Leiman transformation (Schmid & Leiman, 1957) of the parameter estimates (Brunner, Nagy, & Wilhelm, 2012; Yung et al., 1999), which is unfamiliar to typical organizational researchers.”
MethodMethodology Review: Assessing Unidimensionality of Tests and ltenls
Hattie, J. (1985) · Applied Psychological Measurement · doi:10.1177/014662168500900204 · Cited by 1,013 · cited 1×
“For example, to derive formulas that are algebraically equivalent, Hoyt (1941) used the ANOVA approach, whereas Cronbach (1951) calculated the average of the split-half reliability coefficient obtained from all possible split halves.”
Method(1921) · Mind · doi:10.1093/mind/xxx.119.375 · Cited by 867
The European Health Psychologist
Todorova, I. L. G., Araújo‐Soares, V., & Sniehotta, F. F. (2005) · European Health Psychologist · Cited by 777
Cronbach’s Coefficient Alpha: Well Known but Poorly Understood
Cho, E., & Kim, S. (2015) · Organizational Research Methods · doi:10.1177/1094428114555994 · Cited by 764
Self-citationGraham, J. M. (2006) · Educational and Psychological Measurement · doi:10.1177/0013164406288165 · Cited by 687
Factor Analysis and Related Methods
Widaman, K. F., & McDonald, R. P. (1987) · Journal of Educational Statistics · doi:10.2307/1164692 · Cited by 664
Regression: A Second Course in Statistics
Ziegel, E. (1988) · Technometrics · doi:10.1080/00401706.1988.10488352 · Cited by 601
SOME EXPERIMENTAL RESULTS IN THE CORRELATION OF MENTAL ABILITIES 1
BROWN, W. (1910) · British Journal of Psychology, 1904-1920 · doi:10.1111/j.2044-8295.1910.tb00207.x · Cited by 559 · cited 2×
“For more than a hundred years, numerous researchers (e.g., Brown, 1910; Spearman, 1910) have developed reliability coefficients in various ways, but during this process, they were named, interpreted and expressed inconsistently.”
BackgroundFactor Analysis and Related Methods
McDonald, R. P. (2014) · Psychology Press eBooks · doi:10.4324/9781315802510 · Cited by 533 · cited 6×
“The system includes most of the reliability coefficients commonly used in real-world data analyses or explained in research methods textbooks such as the Spearman–Brown formula, the Flanagan–Rulon formula, standardized alpha, alpha, stratified alpha, McDonald’s omega, and so-called composite reliability. This study pr…”
BackgroundMethodInfluentialLimitations of Coefficient Alpha as an Index of Test Unidimensionality1
Green, S. B., Lissitz, R. W., & Mulaik, S. A. (1977) · Educational and Psychological Measurement · doi:10.1177/001316447703700403 · Cited by 522
Test Reliability Estimated by Analysis of Variance
Hoyt, C. (1941) · Psychometrika · doi:10.1007/bf02289270 · Cited by 513 · cited 2×
“For example, to derive formulas that are algebraically equivalent, Hoyt (1941) used the ANOVA approach, whereas Cronbach (1951) calculated the average of the split-half reliability coefficient obtained from all possible split halves.”
BackgroundMethodCoefficient Alpha: A Reliability Coefficient for the 21st Century?
Yang, Y., & Green, S. B. (2011) · Journal of Psychoeducational Assessment · doi:10.1177/0734282911406668 · Cited by 479 · cited 1×
“…studies such as Cortina (1993) and Schmitt (1996) offered influential lessons on alpha for organizational researchers, it is still commonly misconceived and widely misused (Cho & Kim, 2015; Dunn, Baguley, & Brunsden, 2013; Green & Yang, 2009a; Raykov, 2012; Sijtsma, 2009a; Yang & Green, 2011).”
BackgroundCoefficient Alpha and the Reliability of Composite Measurements
Novick, M. R., & Lewis, C. (1967) · Psychometrika · doi:10.1007/bf02289400 · Cited by 466
A Tutorial on Hierarchically Structured Constructs
Brunner, M., Nagy, G., & Wilhelm, O. (2012) · Journal of Personality · doi:10.1111/j.1467-6494.2011.00749.x · Cited by 459 · cited 7×
“Brunner et al. (2012) advocated the use of only subtest reliability coefficients when a correlated factors model is selected.”
BackgroundMethodInfluentialCOEFFICIENT ALPHA AND THE RELIABILITY OF COMPOSITE MEASUREMENTS
Novick, M. R., & Lewis, C. (1966) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1966.tb00356.x · Cited by 446 · cited 1×
“The unidimensional tau-equivalent model (Novick & Lewis, 1967) restricts the factor loadings of each item to be equal (i.e., li ¼ l for all i).”
BackgroundGreen, S. B., & Yang, Y. (2009) · Psychometrika · doi:10.1007/s11336-008-9099-3 · Cited by 428 · cited 2×
“…studies such as Cortina (1993) and Schmitt (1996) offered influential lessons on alpha for organizational researchers, it is still commonly misconceived and widely misused (Cho & Kim, 2015; Dunn, Baguley, & Brunsden, 2013; Green & Yang, 2009a; Raykov, 2012; Sijtsma, 2009a; Yang & Green, 2011).”
BackgroundZinbarg, R. E., Yovel, I., Revelle, W., & McDonald, R. P. (2006) · Applied Psychological Measurement · doi:10.1177/0146621605278814 · Cited by 422 · cited 1×
“Although hierarchical omega is a matter of degree, dimensionality is a yes-or-no issue (Zinbarg et al., 2006); all data are either unidimensional or multidimensional.”
BackgroundAlpha, Dimension-Free, and Model-Based Internal Consistency Reliability
Bentler, P. M. (2009) · Psychometrika · doi:10.1007/s11336-008-9100-1 · Cited by 405 · cited 1×
“Other notations are explained in Appendices A and B. although little consensus exists about exactly which alternative technique should replace alpha (Bentler, 2009; Green & Yang, 2009b; Hunt & Bentler, 2015; Osburn, 2000; Revelle & Zinbarg, 2009; Schmidt, Le, & Ilies, 2003; Sijtsma, 2009b; van der…”
BackgroundOn the Relationship between the Higher-Order Factor Model and the Hierarchical Factor Model
Yung, Y.-F., Thissen, D., & McLeod, L. D. (1999) · Psychometrika · doi:10.1007/bf02294531 · Cited by 403
Hierarchical Cluster Analysis And The Internal Structure Of Tests
Revelle, W. (1979) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1401_4 · Cited by 397 · cited 3×
“Although it seems intuitively attractive, the average is not as meaningful as the maximum (Osburn, 2000) or the minimum (Revelle, 1979) of the l4 values that are obtained from all possible split-halves (for a modern interpretation, see Hunt & Bentler, 2015).”
BackgroundMethodMiller, M. B. (1995) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705519509540013 · Cited by 377 · cited 1×
“For example, Miller (1995) employed an SEM path diagram to explain the meaning of alpha and its correct use.”
MethodSchmidt, F. L., Le, H., & Ilies, R. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.206 · Cited by 362
Coefficient alpha and related internal consistency reliability coefficients.
Osburn, H. G. (2000) · Psychological Methods · doi:10.1037//1082-989x.5.3.343 · Cited by 351 · cited 3×
“Although it seems intuitively attractive, the average is not as meaningful as the maximum (Osburn, 2000) or the minimum (Revelle, 1979) of the l4 values that are obtained from all possible split-halves (for a modern interpretation, see Hunt & Bentler, 2015).”
BackgroundResultPeters, G.-J. (2014) · DSpace (Open University in the Netherlands) · doi:10.17605/osf.io/tnrxv · Cited by 334 · cited 1×
“For example, Peters (2014) claimed that we should abandon alpha because it is ‘‘a fatally flawed estimate of its reliability’’ (p. 56).”
BackgroundCommentary on Coefficient Alpha: A Cautionary Tale
Green, S. B., & Yang, Y. (2009) · Psychometrika · doi:10.1007/s11336-008-9098-4 · Cited by 312 · cited 2×
“…studies such as Cortina (1993) and Schmitt (1996) offered influential lessons on alpha for organizational researchers, it is still commonly misconceived and widely misused (Cho & Kim, 2015; Dunn, Baguley, & Brunsden, 2013; Green & Yang, 2009a; Raykov, 2012; Sijtsma, 2009a; Yang & Green, 2011).”
BackgroundGreen, S. B., & Yang, Y. (2015) · Educational Measurement: Issues and Practice · doi:10.1111/emip.12100 · Cited by 233 · cited 1×
“Previous studies are increasingly using omega as a general name for various SEM-based reliability coefficients (Brunner et al., 2012; Cho & Kim, 2015; Dunn et al., 2013; Green & Yang, 2015; Lucke, 2005; Padilla & Divers, 2013; Revelle & Zinbarg, 2009).”
MethodSociological Methodology 1972.
Acock, A. C., & Costner, H. L. (1975) · Contemporary Sociology · doi:10.2307/2064039 · Cited by 230
Generalizability in Factorable Domains: "Domain Validity and Generalizability"1
McDonald, R. P. (1978) · Educational and Psychological Measurement · doi:10.1177/001316447803800111 · Cited by 187 · cited 2×
“McDonald (1978) defined omega in a multidimensional context and later used the term regardless of the dimensionality (McDonald, 1999).”
BackgroundMethodReliability Beyond Theory and Into Practice
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9103-y · Cited by 164 · cited 2×
“…studies such as Cortina (1993) and Schmitt (1996) offered influential lessons on alpha for organizational researchers, it is still commonly misconceived and widely misused (Cho & Kim, 2015; Dunn, Baguley, & Brunsden, 2013; Green & Yang, 2009a; Raykov, 2012; Sijtsma, 2009a; Yang & Green, 2011).”
BackgroundScale construction and development using structural equation modeling.
Raykov, T. (2012) · Cited by 148
A General Method of Estimating the Reliability of a Composite
Werts, C. E., Rock, D. R., Linn, R. L., & Jöreskog, K. G. (1978) · Educational and Psychological Measurement · doi:10.1177/001316447803800412 · Cited by 116
Generalizability of Stratified-Parallel Tests
Rajaratnam, N., Cronbach, L. J., & Gleser, G. C. (1965) · Psychometrika · doi:10.1007/bf02289746 · Cited by 99 · cited 1×
“…and the tau-equivalent form of hierarchical omega are as follows: rBT ¼ s2General þ s2Group s2X ¼ k 2 sd þ nkð ss sdÞ s2X ; and oHT ¼ s2General s2X ¼ k 2 sd s2X : Rajaratnam, Cronbach, and Gleser (1965) applied generalizability theory to derive stratified alpha, where the term stratified…”
BackgroundFalk, C. F., & Savalei, V. (2011) · Journal of Personality Assessment · doi:10.1080/00223891.2011.594129 · Cited by 90 · cited 18×
“Second, the concept of hierarchical omega and unidimensionality should be distinguished.”
InfluentialA Latent Class Approach to Estimating Test-Score Reliability
van der Ark, L. A., van der Palm, D. W., & Sijtsma, K. (2011) · Applied Psychological Measurement · doi:10.1177/0146621610392911 · Cited by 81 · cited 1×
“…explained in Appendices A and B. although little consensus exists about exactly which alternative technique should replace alpha (Bentler, 2009; Green & Yang, 2009b; Hunt & Bentler, 2015; Osburn, 2000; Revelle & Zinbarg, 2009; Schmidt, Le, & Ilies, 2003; Sijtsma, 2009b; van der Ark et al., 2011).”
BackgroundEstimating ωh for Structures Containing Two Group Factors: Perils and Prospects
Zinbarg, R. E., Revelle, W., & Yovel, I. (2007) · Applied Psychological Measurement · doi:10.1177/0146621606291558 · Cited by 77 · cited 2×
“McDonald (1985, 1999) and Zinbarg, Revelle, and Yovel (2007) argued that alpha is a special case of omega when the data meet a certain prerequisite.”
BackgroundA Series of Lower Bounds to the Reliability of a Test
ten Berge, J. M. F., & Zegers, F. E. (1978) · Psychometrika · doi:10.1007/bf02293815 · Cited by 73 · cited 1×
“…rules for naming a newly developed reliability coefficient do not exist, a naming method that was popular in the past is choosing one of the Greek letters, for example, a(Cronbach, 1951), b (Revelle, 1979), l (Guttman, 1945), m (Ten Berge & Zegers, 1978), y (Armor, 1974), and o (McDonald, 1978).”
MethodTest Reliability and Effective Test Length
Angoff, W. H. (1953) · Psychometrika · doi:10.1007/bf02289023 · Cited by 64 · cited 1×
“…(1970) original formula (~rR1970) is algebraically equivalent to rSC , that is, ~rR1970 ¼ s12 p1p2s2X ¼ ðl1 þ l2Þðl1 þ l2Þl1l2 l1l2s2X ¼ ðl1 þ l2Þ 2 s2X ¼ rSC : Second, Angoff (1953) and Feldt (1975) independently introduced a split-half reliability coefficient for when the relative item lengths…”
A Generalization of Coefficient Alpha
Raju, N. S. (1977) · Psychometrika · doi:10.1007/bf02295978 · Cited by 57
TEST RELIABILITY AND EFFECTIVE TEST LENGTH
Angoff, W. H. (1952) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1952.tb00029.x · Cited by 51
Estimation of the Reliability of a Test Divided into Two Parts of Unequal Length
Feldt, L. S. (1975) · Psychometrika · doi:10.1007/bf02291556 · Cited by 44 · cited 18×
“Second, the concept of hierarchical omega and unidimensionality should be distinguished.”
InfluentialLucke, J. F. (2005) · Applied Psychological Measurement · doi:10.1177/0146621604272739 · Cited by 44 · cited 2×
“Previous studies are increasingly using omega as a general name for various SEM-based reliability coefficients (Brunner et al., 2012; Cho & Kim, 2015; Dunn et al., 2013; Green & Yang, 2015; Lucke, 2005; Padilla & Divers, 2013; Revelle & Zinbarg, 2009).”
MethodA proposed procedure for increasing the efficiency of objective tests.
Flanagan, J. C. (1937) · Journal of Educational Psychology · doi:10.1037/h0057430 · Cited by 31 · cited 1×
“…reliability (rST ) are as follows: Sst ¼ l2 þ s2e1 l 2 l2 l2 þ s2e2 ¼ s 2 1 s12 s12 s22 ¼ s12 s12s12 s12 þ s21 s12 00 s22 s12 ; and rST ¼ s2T s2X ¼ 4s12 s2X : Flanagan (1937), Guttman (l4, 1945), Rulon (1939), and Mosier (1941) proposed formulas that are algebraically equivalent to rST : ~rF…”
Quantile Lower Bounds to Reliability Based on Locally Optimal Splits
Hunt, T. D., & Bentler, P. M. (2013) · Psychometrika · doi:10.1007/s11336-013-9393-6 · Cited by 26 · cited 2×
“Although it seems intuitively attractive, the average is not as meaningful as the maximum (Osburn, 2000) or the minimum (Revelle, 1979) of the l4 values that are obtained from all possible split-halves (for a modern interpretation, see Hunt & Bentler, 2015).”
BackgroundRae, G. (2006) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711005x72485 · Cited by 21 · cited 2×
“The formula for stratified alpha (~ rBT ) is algebraically equivalent to rBT (Rae, 2008):”
MethodCoefficient Omega Bootstrap Confidence Intervals
Padilla, M. A., & Divers, J. (2013) · Educational and Psychological Measurement · doi:10.1177/0013164413492765 · Cited by 21 · cited 1×
“Previous studies are increasingly using omega as a general name for various SEM-based reliability coefficients (Brunner et al., 2012; Cho & Kim, 2015; Dunn et al., 2013; Green & Yang, 2015; Lucke, 2005; Padilla & Divers, 2013; Revelle & Zinbarg, 2009).”
MethodA Short Cut in the Estimation of Split-Halves Coefficients
Mosier, C. I. (1941) · Educational and Psychological Measurement · doi:10.1177/001316444100100133 · Cited by 13 · cited 1×
“…l 2 l2 l2 þ s2e2 ¼ s 2 1 s12 s12 s22 ¼ s12 s12s12 s12 þ s21 s12 00 s22 s12 ; and rST ¼ s2T s2X ¼ 4s12 s2X : Flanagan (1937), Guttman (l4, 1945), Rulon (1939), and Mosier (1941) proposed formulas that are algebraically equivalent to rST : ~rF ¼ 4r12s1s2 s21 þ s22 þ 2r12s1s2 ¼ 4s12 s21 þ s22 þ…”
Confirmatory factor analysis using Microsoft Excel
Miles, J. N. V. (2005) · Behavior Research Methods · doi:10.3758/bf03192739 · Cited by 12
Research works printed but not linked: 10
- Armor D. J., 1974, Sociological methodology, 17
- Cronbach L. J., 1978, Current Contents, 13, 263
- Feldt L. S., 1989, Educational measurement, 105
- Hair J. F., 2010, Multivariate data analysis
- Kamata A., 2003, Estimating reliability for multidimensional composite scale scores
- 10.1037/1082-989X.5.3.343 · doi:10.1037/1082-989x.5.3.343 · Paper page
- Peters G. J. Y., 2014, European Health Psychologist, 16, 56
- Raju N. S., 1970, Proceedings of the 78th Annual Convention of APA, 5, 143
- Spearman C., 1910, British Journal Psychology, 3, 271
- Tang W., 2012, Paper presented at the annual meeting of the American Educational Research Association
Cited by
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024) · Asia Pacific Journal of Management · doi:10.1007/s10490-023-09871-y · Cited by 2,262
“Using a simulation study, Voorhees et al. (2016) extended the HTMT method to covariance-based SEM and provided initial supporting evidence.”
InfluentialAn Updated Guideline for Assessing Discriminant Validity
Rönkkö, M., & Cho, E. (2022) · Organizational Research Methods · doi:10.1177/1094428120968614 · Cited by 1,309
Self-citationGabriel, A. S., Podsakoff, N. P., Beal, D. J., Scott, B. A., Sonnentag, S., Trougakos, J. P., & Butts, M. M. (2019) · Organizational Research Methods · doi:10.1177/1094428118802626 · Cited by 755
“Thus, we encourage researchers to employ the procedures described by Geldhof et al. in their article (Mplus syntax is provided) to estimate and report multilevel reliabilities for their Level 1 measures, identifying the specific type of reliability calculated (see also Cho, 2016).”
MethodUn viaje alrededor de alfa y omega para estimar la fiabilidad de consistencia interna
Viladrich, C., Angulo-Brunet, A., & Doval, E. (2017) · Anales de Psicología · doi:10.6018/analesps.33.3.268401 · Cited by 699
Li, G., Li, L., Choi, T., & Sethi, S. P. (2020) · Journal of Operations Management · doi:10.1002/joom.1061 · Cited by 423
Metadata
- Authors
- Cho, E.
- Affiliations
- Kwangwoon University (KR)
- Corresponding author
- Cho, Eunseong
- ORCID
- Cho, Eunseong
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2016-07-08
- Volume
- 19
- Issue
- 4
- Pages
- 651-682
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2474970179
- Cited by
- 378
- References
- 74
- Citations by year
- 2026: 35 · 2025: 46 · 2024: 51 · 2023: 56 · 2022: 42 · 2021: 56 · 2020: 40 · 2019: 23 · 2018: 21 · 2017: 8
- FWCI
- 18.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Organizational Research Methods (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Keywords
- test score reliability, reliability coefficients, Cronbach's alpha, composite reliability, measurement reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.