Making Reliability Reliable: A Systematic Approach to Reliability Coefficients
The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Abstract
The current conventions for test score reliability coefficients are unsystematic and chaotic. Reliability coefficients have long been denoted using names that are unrelated to each other, with each formula being generated through different methods, and they have been represented inconsistently. Such inconsistency prevents organizational researchers from understanding the whole picture and misleads them into using coefficient alpha unconditionally. This study provides a systematic naming convention, formula-generating methods, and methods of representing each of the reliability coefficients. This study offers an easy-to-use solution to the issue of choosing between coefficient alpha and composite reliability. This study introduces a calculator that enables its users to obtain the values of various multidimensional reliability coefficients with a few mouse clicks. This study also presents illustrative numerical examples to provide a better understanding of the characteristics and computations of reliability coefficients.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Cronbach's alpha is not structural equation modeling (SEM) based, yet it is the most commonly-reported reliability coefficient in studies using SEM (Cho, 2016).”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Cho, 2016
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · cited 8×
“One estimator goes by the name of the fourth person to propose it (Cronbach, 1951), and others do not bear the name of any developers.”
BackgroundMethodInfluentialStructural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology · doi:10.2307/2072165 · Cited by 17,442
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,277 · cited 1×
“This study assumes that no specific factors exist to circumvent the controversial issue of specific factors and errors (Bollen, 1989).”
BackgroundStatistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
EQS : structural equations program manual
Bentler, P. M. (1989) · Medical Entomology and Zoology · Cited by 9,669
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 2×
“Many users perform the reverse; they calculate reliability to identify unidimensionality, misconceiving that a high value of a unidimensional reliability coefficient indicates unidimensionality (Cortina, 1993; Green, Lissitz, & Mulaik, 1977; Hattie, 1985; Schmitt, 1996).”
BackgroundStatistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Test Theory: A Unified Treatment
Zwick, R., & McDonald, R. P. (2000) · Journal of the American Statistical Association · doi:10.2307/2669496 · Cited by 3,603
Dunn, T. J., Baguley, T., & Brunsden, V. (2014) · British Journal of Psychology · doi:10.1111/bjop.12046 · Cited by 3,596 · cited 3×
“In addition to Jöreskog’s (1971) work, two approaches deserve mention. Let pi denote the ratio of the length of item i (i.e., li) to the total length (i.e., Pk i1⁄41 li), and let siX denote Pk j1⁄41 sij. Raju’s (1977) generalization of his previous formula (~ rR1977) is algebraically equivalent to rC .”
BackgroundMethodHandbook of Structural Equation Modeling
Howard, A. L. (2013) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2013.769397 · Cited by 3,440
Research works printed but not linked: 10
- Armor D. J., 1974, Sociological methodology, 17
- Cronbach L. J., 1978, Current Contents, 13, 263
- Feldt L. S., 1989, Educational measurement, 105
- Hair J. F., 2010, Multivariate data analysis
- Kamata A., 2003, Estimating reliability for multidimensional composite scale scores
- 10.1037/1082-989X.5.3.343 · doi:10.1037/1082-989x.5.3.343 · Paper page
- Peters G. J. Y., 2014, European Health Psychologist, 16, 56
- Raju N. S., 1970, Proceedings of the 78th Annual Convention of APA, 5, 143
- Spearman C., 1910, British Journal Psychology, 3, 271
- Tang W., 2012, Paper presented at the annual meeting of the American Educational Research Association
Cited by
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024) · Asia Pacific Journal of Management · doi:10.1007/s10490-023-09871-y · Cited by 2,262
“Using a simulation study, Voorhees et al. (2016) extended the HTMT method to covariance-based SEM and provided initial supporting evidence.”
InfluentialAn Updated Guideline for Assessing Discriminant Validity
Rönkkö, M., & Cho, E. (2022) · Organizational Research Methods · doi:10.1177/1094428120968614 · Cited by 1,309
Self-citationGabriel, A. S., Podsakoff, N. P., Beal, D. J., Scott, B. A., Sonnentag, S., Trougakos, J. P., & Butts, M. M. (2019) · Organizational Research Methods · doi:10.1177/1094428118802626 · Cited by 755
“Thus, we encourage researchers to employ the procedures described by Geldhof et al. in their article (Mplus syntax is provided) to estimate and report multilevel reliabilities for their Level 1 measures, identifying the specific type of reliability calculated (see also Cho, 2016).”
MethodUn viaje alrededor de alfa y omega para estimar la fiabilidad de consistencia interna
Viladrich, C., Angulo-Brunet, A., & Doval, E. (2017) · Anales de Psicología · doi:10.6018/analesps.33.3.268401 · Cited by 699
Li, G., Li, L., Choi, T., & Sethi, S. P. (2020) · Journal of Operations Management · doi:10.1002/joom.1061 · Cited by 423
Kalkbrenner, M. T. (2023) · Counseling Outcome Research and Evaluation · doi:10.1080/21501378.2021.1940118 · Cited by 395
“, 2014; McNeish, 2018), science education (Taber, 2018), organizational research (Cho, 2016), clinical neuropsychology (Watkins, 2017), poverty measurement (Nájera Catalán, 2019), and statistics (Şimşek & Noyan, 2013).”
BackgroundLambert, L. S., & Newman, D. A. (2023) · Organizational Research Methods · doi:10.1177/10944281221115374 · Cited by 259
“…indices include coef fi cient omega ( ω h , which relaxes the assumption of tau equivalence, and also indexes unidimensionality) and composite reliabilities (which are appropriate for a construct of multiple related dimensions for either tau equivalent or congeneric measurement models; Cho, 2016).”
BackgroundChatterjee, S., Rana, N. P., Tamilmani, K., & Sharma, A. (2021) · Industrial Marketing Management · doi:10.1016/j.indmarman.2021.07.013 · Cited by 251
“In line with Anderson and Gerbing (1988), three ad hoc tests such as standardized factor loadings (FL), composite reliabilities (CR) (Cho, 2016), and average variance extracted (AVE) (Fornell & Larcker, 1981) were employed to measure the convergent validity of constructs (Tamilmani, Rana, Nunkoo,…”
MethodBlockchain-supported business model design, supply chain resilience, and firm performance
Li, G., Xue, J., Li, N., & Ivanov, D. (2022) · Transportation Research Part E: Logistics and Transportation Review · doi:10.1016/j.tre.2022.102773 · Cited by 234
Estimating reliability: A comparison of Cronbach's α, McDonald's ωt and the greatest lower bound
Malkewitz, C. P., Schwall, P., Meesters, C., & Hardt, J. (2023) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2022.100368 · Cited by 199
Nikookar, E., & Yanadori, Y. (2022) · International Journal of Operations & Production Management · doi:10.1108/ijopm-04-2021-0272 · Cited by 199
Gawankar, S. A., Gunasekaran, A., & Kamble, S. (2020) · International Journal of Production Research · doi:10.1080/00207543.2019.1668070 · Cited by 195
“…validity, all the measurement items must have their factor loadings ≥ 0.5 (Hair et al. 2014), congeneric reliability ( ρ C ) of the measurement constructs must be ≥ 0.70 (Cho 2016) and construct’s average variance extracted (AVE) must be ≥ 0.50 (Fornell and Larcker 1981; Hair et al.2014).”
BackgroundInfluentialBeyond ANOVA: An Introduction to Structural Equation Models for Experimental Designs
Breitsohl, H. (2019) · Organizational Research Methods · doi:10.1177/1094428118754988 · Cited by 136
The Reliability of the Wisconsin Card Sorting Test in Clinical Practice
Kopp, B., Lange, F., & Steinke, A. (2019) · Assessment · doi:10.1177/1073191119866257 · Cited by 155
“Hence, psychologists have long studied the problem of reliability, in an attempt to understand how to estimate reliability as well as the ways to use these estimates (Cho, 2016; Nunnally & Bernstein, 1994; Revelle & Condon, 2018).”
BackgroundKrieglstein, F., Beege, M., Rey, G. D., Ginns, P., Krell, M., & Schneider, S. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09683-4 · Cited by 118
“Several well-known methods for estimating reliability have been established — internal consistency, parallel test, and test–retest (Schuurman & Hamaker, 2019), while various authors also rely on the split-half method to measure reliability (e.g., Cho, 2016; Thompson et al., 2010).”
MethodKalkbrenner, M. T. (2024) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2023.2283637 · Cited by 193
“A number of scholars have expressed considerable concerns on the prolific use of coefficient alpha in the extant literature without investigators first completing the necessary assumption checking procedures (Cho, 2016; Dunn et al., 2014; Hayes & Coutts, 2020; McNeish, 2018).”
BackgroundAn empirical analysis of alleged misunderstandings of coefficient alpha
Hoekstra, R., Vugteveen, J., Warrens, M. J., & Kruyen, P. M. (2018) · International Journal of Social Research Methodology · doi:10.1080/13645579.2018.1547523 · Cited by 163
“To be clear, both sides in this debate seem to agree that simply always using coefficient alpha, as seems to be standard practice for many, is unjustified (Cho, 2016).”
BackgroundSijtsma, K., & Pfadt, J. M. (2021) · Psychometrika · doi:10.1007/s11336-021-09789-8 · Cited by 171
“First, we reject the claim that coefficient α is only useful if the items in the test satisfy the mathematical model of essential τ -equivalence (Lord & Novick, 1968, discussed later; e.g., Cho, 2016; Cho & Kim, 2015; Dunn, Baguley, & Brunsden, 2014; Graham, 2006; Teo& Fan, 2013).”
BackgroundMethodRevisión de los criterios para validez convergente estimada a través de la Varianza Media Extraída
de la Rubia, J. M. (2019) · Psychologia · doi:10.21500/19002386.4119 · Cited by 152
A Corporate Purpose as an Antecedent to Employee Motivation and Work Engagement
van Tuin, L., Schaufeli, W. B., den Broeck, A. V., & van Rhenen, W. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.572343 · Cited by 148
“Reliabilities are reported through Cronbach’s alpha (α), congeneric reliability (ρ C), and average variance extracted (AVE, Peterson and Kim, 2013; Cho, 2016; Hair et al., 2017).”
MethodPsychometric Evaluation of the Short Sensory Profile in Youth with Autism Spectrum Disorder
Williams, Z. J., Failla, M. D., Gotham, K. O., Woynaroski, T. G., & Cascio, C. (2018) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-018-3678-7 · Cited by 91
“89), but this estimate of scale reliability assumes that the scale in question is unidimensional (Gignac, 2014) and is not appropriate to determine the general factor saturation of a multidimensional composite score (Brunner, Nagy, & Wilhelm, 2012; Cho, 2016; Gignac, 2014; Revelle & Zinbarg, 2009; Rodriguez, Reise, &…”
BackgroundMeta‐Analysis of Coefficient Alpha: A Reliability Generalization Study
Greco, L. M., O'Boyle, E. H., Cockburn, B. S., & Yuan, Z. (2018) · Journal of Management Studies · doi:10.1111/joms.12328 · Cited by 87
The Differential Impacts of Two Forms of Insufficient Effort Responding
DeSimone, J. A., DeSimone, A. J., Harms, P. D., & Wood, D. (2018) · Applied Psychology · doi:10.1111/apps.12117 · Cited by 87
“Although alpha is influenced by more than just inter-item correlations (Cortina, 1993), it is the most common reliability coefficient reported in the organisational sciences (Cho, 2016).”
BackgroundClayson, P. E., Brush, C. J., & Hajcak, G. (2021) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2021.04.004 · Cited by 85
Clayson, P. E., Baldwin, S. A., & Larson, M. J. (2021) · Psychophysiology · doi:10.1111/psyp.13762 · Cited by 84
Bergström, M., & Baviskar, S. (2021) · Journal of Evidence-Based Social Work · doi:10.1080/26408066.2020.1788477 · Cited by 80
Engaging leadership: Enhancing work engagement through intrinsic values and need satisfaction
van Tuin, L., Schaufeli, W. B., & den Broeck, A. V. (2021) · Human Resource Development Quarterly · doi:10.1002/hrdq.21430 · Cited by 138
“Reliability for the applied measures was estimated with composite reliability or congeneric reliability ( ρ C ; Cho, 2016), which typically is computed in combination with structural equation modeling (Peterson & Kim, 2013).”
MethodClayson, P. E. (2020) · Psychophysiology · doi:10.1111/psyp.13583 · Cited by 73
Data quality over data quantity in computational cognitive neuroscience
Kolossa, A., & Kopp, B. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.01.005 · Cited by 68
Lünich, M. (2022) · Springer eBooks · doi:10.1007/978-3-658-36368-0 · Cited by 71
Basch, J. M., & Melchers, K. G. (2019) · Personnel Assessment and Decisions · doi:10.25035/pad.2019.03.002 · Cited by 79
Shining with the Stars? Unearthing how group star proportion shapes non‐star performance
Call, M. L., Campbell, E. M., Dunford, B. B., Boswell, W. R., & Boss, R. W. (2020) · Personnel Psychology · doi:10.1111/peps.12420 · Cited by 71
Recognize the Value of the Sum Score, Psychometrics’ Greatest Accomplishment
Sijtsma, K., Ellis, J. L., & Borsboom, D. (2024) · Psychometrika · doi:10.1007/s11336-024-09964-7 · Cited by 98
“Next, some authors have equated this condition with a 1-factor model the items must satisfy or else the lower bound is useless (Cho, 2016; Cho & Kim, 2015; Dunn et al., 2014; Graham, 2006; Green & Yang, 2009; Miller, 1995).”
Neither Cronbach’s Alpha nor McDonald’s Omega: A Commentary on Sijtsma and Pfadt
Cho, E. (2021) · Psychometrika · doi:10.1007/s11336-021-09801-1 · Cited by 90
“This proof is not dramatic, given that λ4 is a lower bound of reliability (Cho & Kim, 2015) and represents a special case of ρT involving two items (Cho, 2016).”
BackgroundMethodSelf-citationWeyn, S., Leeuwen, K. G. V., Pluess, M., Lionetti, F., Greven, C. U., Goossens, L., Colpin, H., Noortgate, W. V. D., Verschueren, K., Bastin, M., et al. (2019) · Current Psychology · doi:10.1007/s12144-019-00254-5 · Cited by 78
Factors impacting employee turnover intentions among professionals in Sri Lankan startups
Kanchana, L., & Jayathilaka, R. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281729 · Cited by 122
“The most common measure of reliability is Cronbach’s alpha (α) value, which determines whether the internal instruments are constant [43].”
BackgroundTrust in artificial intelligence within production management – an exploration of antecedents
Saßmannshausen, T. M., Burggräf, P., Wagner, J., Hassenzahl, M., Heupel, T., & Steinberg, F. (2021) · Ergonomics · doi:10.1080/00140139.2021.1909755 · Cited by 74
“Two of them are the most common coefficients according to Cho (2016): the congeneric reliability (also composite reliability and upper bound of IC) and the tau-equivalent reliability (also Cronbach ’ s Alpha and lower bound of IC).”
BackgroundImpact of materialism on purchase intention of sustainable luxury goods: An empirical study in India
Kaur, J., Parida, R., Ghosh, S. T., & Lavuri, R. (2021) · Society and Business Review · doi:10.1108/sbr-10-2020-0130 · Cited by 68
Yang, L., Wang, W., Huang, P., & Nguyen, A. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-022-09803-5 · Cited by 65
“…reliability and research design for within-person studies using unidimensional scales, we urge future research to examine how to choose appropriate within-person research design in optimizing within-person reliability for studies focusing on multidimensional constructs (for a review see Cho, 2016).”
BackgroundThe relative importance of improvement routines for implementing lean practices
Knol, W. H., Slomp, J., Schouteten, R., & Lauche, K. (2018) · International Journal of Operations & Production Management · doi:10.1108/ijopm-01-2018-0010 · Cited by 68
Tarka, P. (2019) · Journal of International Consumer Marketing · doi:10.1080/08961530.2019.1695240 · Cited by 69
“The reason why we used the Composite Reliability, not the Alpha to investigate reliability of P-YMS and P-RCBS, has resulted from two main aspects (see Cho 2016).”
MethodVosylis, R., & Erentaitė, R. (2019) · Emerging Adulthood · doi:10.1177/2167696819856763 · Cited by 58
“To assess the reliability of the scales, composite reliability estimates for congeneric factors (designated as r coefficients) were calculated for each of the scales, using formulas, guidelines, and a tool provided by Cho (2016).”
MethodA Matter of Trust? Examination of Chatbot Usage in Insurance Business
Cardona, D. R., Janssen, A., Guhr, N., Breitner, M. H., & Milde, J. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.068 · Cited by 67
The Org-B5: Development of a Short Work Frame-of-Reference Measure of the Big Five
Pathki, C. S., Kluemper, D. H., Meuser, J. D., & McLarty, B. D. (2021) · Journal of Management · doi:10.1177/01492063211002627 · Cited by 55
“Scholars have pointed out limitations of using alpha as a sole index of reliability and recommend employing supplementary indices (Cho, 2016; Cho & Kim, 2015; Cortina, 1993; Greco, O’Boyle, Cockburn, & Yuan, 2018).”
MethodScale use and abuse: Towards best practices in the deployment of scales
Haws, K. L., Sample, K. L., & Hulland, J. S. (2022) · Journal of Consumer Psychology · doi:10.1002/jcpy.1320 · Cited by 57
Buchmann, I., & Randerath, J. (2017) · Cortex · doi:10.1016/j.cortex.2017.06.001 · Cited by 51
Scale purification: state-of-the-art review and guidelines
Wieland, A., Köck, F., & Josiassen, A. (2018) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-11-2017-0740 · Cited by 47
Rocabado, G. A., Kilpatrick, N., Mooring, S. R., & Lewis, J. E. (2019) · Journal of Chemical Education · doi:10.1021/acs.jchemed.9b00516 · Cited by 48
Blount, I., & Li, M. (2020) · Journal of Supply Chain Management · doi:10.1111/jscm.12237 · Cited by 50
Bourque, J., Doucet, D., LeBlanc, J., Dupuis, J. B., & Nadeau, J. (2020) · Revue des sciences de l éducation · doi:10.7202/1067534ar · Cited by 72
“Cho (2016) compare quant à lui l’alpha à une marque de commerce qui s’est taillé une place et qui conserve une part importante du marché.”
BackgroundInfluentialPeng, H. H., Lu, Y., & Gupta, S. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.122338 · Cited by 47
The psychometric upgrade psychophysiology needs
Clayson, P. E. (2024) · Psychophysiology · doi:10.1111/psyp.14522 · Cited by 39
Almenara, J. C., Pérez, S. M., Valencia-Ortíz, R., Nuñez, J. P. L., Hernández, M. L. O., & López, I. C. H. (2020) · Revista Complutense de Educación · doi:10.5209/rced.61722 · Cited by 64
Bayesian Estimation of Single-Test Reliability Coefficients
Pfadt, J. M., van den Bergh, D., Sijtsma, K., Moshagen, M., & Wagenmakers, E. (2021) · Multivariate Behavioral Research · doi:10.1080/00273171.2021.1891855 · Cited by 48
Breitsohl, H., & Steidelmüller, C. (2017) · Applied Psychology · doi:10.1111/apps.12121 · Cited by 44
“We report those measures, the content of which is secondary to the purpose of this paper, for the sake of completeness, including estimates of congeneric reliability (q̂C ; Cho, 2016; this is sometimes referred to as factor or composite reliability) from the control group.”
BackgroundResultWeinzierl, S., Lepa, S., & Ackermann, D. (2018) · The Journal of the Acoustical Society of America · doi:10.1121/1.5051453 · Cited by 45
Wang, L., Yang, X., Zhu, F., & Klakegg, O. J. (2022) · Journal of Management in Engineering · doi:10.1061/jmenea.meeng-4936 · Cited by 37
Methodological challenges and insights for future international business research
Aguinis, H., Bergh, D. D., & Molina-Azorín, J. F. (2022) · Journal of International Business Studies · doi:10.1057/s41267-022-00578-8 · Cited by 35
“Indeed, several scholars have examined the history, conditions, and assumptions of CA (Cho, 2016; Cho & Kim, 2015; Schmidt & Hunter, 1996) and concluded that it may have more limited application than IB researchers usually recognize.”
BackgroundRELEX: An Excel-based software tool for sampling split-half reliability coefficients
Steinke, A., & Kopp, B. (2020) · Methods in Psychology · doi:10.1016/j.metip.2020.100023 · Cited by 34
Benchmarking Teamwork of Humans and Cobots—An Overview of Metrics, Strategies, and Tasks
Riedelbauch, D., Höllerich, N., & Henrich, D. (2023) · IEEE Access · doi:10.1109/access.2023.3271602 · Cited by 44
“A popular way to prove reliability is to investigate the internal consistency via the tau-equivalent reliability (formally known as Cronbach’s alpha ) – see Cho et al.for detailed guidelines [188].”
Gana, K., Boudouda, N. E., Youssef, S. B., Calcagni, N., & Broc, G. (2021) · Pratiques Psychologiques · doi:10.1016/j.prps.2021.02.001 · Cited by 45
Coronavirus Anxiety Scale: A New Instrument to Measure Anxiety Symptoms Associated with COVID-19
González-Rivera, J. A., Rosario-Rodríguez, A., & Cruz-Santos, A. (2020) · Interacciones Revista de Avances en Psicología · doi:10.24016/2020.v6n3.163 · Cited by 49
Virtual internship during the COVID-19 pandemic: exploring IT students satisfaction
AlGhamdi, R. A. (2022) · Education + Training · doi:10.1108/et-12-2020-0363 · Cited by 29
Otoo, F. N. K., & Rather, N. A. (2024) · Rajagiri Management Journal · doi:10.1108/ramj-09-2023-0267 · Cited by 83
¿Es el final del alfa de Cronbach?
Ventura‐León, J. (2018) · Adicciones · doi:10.20882/adicciones.1037 · Cited by 28
The Development of a Short Form of an Irrational/Rational Beliefs Scale
Digiuseppe, R. A., Gorman, B. S., Raptis, J., Boie, A. A., Agiurgioaei, F., Leaf, R. C., & Robin, M. W. (2021) · Journal of Rational-Emotive & Cognitive-Behavior Therapy · doi:10.1007/s10942-021-00386-3 · Cited by 32
Steinke, A., Kopp, B., & Lange, F. (2021) · Brain Sciences · doi:10.3390/brainsci11050529 · Cited by 40
A tutorial on Bayesian single-test reliability analysis with JASP
Pfadt, J. M., van den Bergh, D., Sijtsma, K., & Wagenmakers, E. (2022) · Behavior Research Methods · doi:10.3758/s13428-021-01778-0 · Cited by 38
“In light of the many critiques on Cronbach’s α (e.g., Cho, 2016; McNeish, 2018) and the advocacy of alternative estimators (Oosterwijk et al., 2016; Revelle & Zinbarg, 2009; Sijtsma, 2009), below we briefly mention some key properties of the various single-test reliability coefficients.”
BackgroundSchaarschmidt, M., & Könsgen, R. (2019) · Journal of Business Research · doi:10.1016/j.jbusres.2019.04.004 · Cited by 28
The nexus between information and consumer confusion: information provider vs information recipient
Dharmasena, T., & Jayathilaka, R. (2020) · Tourism Review · doi:10.1108/tr-06-2019-0252 · Cited by 29
Martínez-Ventura, J., Arbones, E. D. M., Omarrementería, C. S., Galan, J., & Calero, M. (2021) · Sustainability · doi:10.3390/su13179596 · Cited by 28
Abdulla, F., Hossain, M. M., Huq, M. N., Hai, A., Rahman, A., Kabir, R., Peya, F. J., Islam, S., & Khan, H. T. A. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.02.094 · Cited by 33
A hybrid e-logistics service quality approach: modeling the evolution of B2C e-commerce
Uvet, H., Dickens, J. M., Anderson, J. R., Glassburner, A. V., & Boone, C. A. (2023) · The International Journal of Logistics Management · doi:10.1108/ijlm-06-2023-0238 · Cited by 39
Caricati, L., & Sollami, A. (2017) · Journal of Theoretical Social Psychology · doi:10.1002/jts5.15 · Cited by 27
Zhang, X., van Donk, D. P., & Jayaram, J. (2020) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102191 · Cited by 33
“…; i n t e r - o r g a n i z a t i o n a l p o w e r d e p e n d e n c e ; c oo p e r a t i v e n e ss R a n g a n a t h a n , T e o a n d D h a l i w a l ( 2011 ) , T a n a n d L u d w i g ( 2016 ) , W u a n d C h u a n g ( 2010 ) act in congruence – as though they were extensions of the same firm.”
BackgroundMethodCronbach-alfa: vele vagy nélküle?
Kárász, J. T., Nagy, O. N., Széll, K., & Takács, S. (2022) · Magyar Pszichológiai Szemle · doi:10.1556/0016.2022.00004 · Cited by 53
Gao, L., & Liu, Z. (2023) · Sustainability · doi:10.3390/su151813961 · Cited by 32
“7 suggests that the reliability is less satisfactory [42].”
BackgroundWang, Y., & Ford, M. T. (2020) · Journal of Organizational Behavior · doi:10.1002/job.2475 · Cited by 24
“is more suitable for the framework of structural equation modeling (SEM; Cho, 2016).”
MethodMartinot, D., Beaton, A. M., Tougas, F., Redersdorff, S., & Rinfret, N. (2020) · Social Psychology of Education · doi:10.1007/s11218-020-09592-w · Cited by 30
“Researchers have argued that Cronbach’s alpha is a biased estimate of the reliability of a measure when the tau-equivalency assumption is violated (Cho 2016; Green and Yang 2009; Trizano-Hermosilla and Alvarado 2016).”
BackgroundRoad Safety Perception Questionnaire (RSPQ) in Latin America: A Development and Validation Study
Molina, F. E. E., Ramírez, B. A., Izquierdo, F. A., & Ortega, D. C. Z. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18052433 · Cited by 22
Michulek, J., Gajanová, Ľ., Křižanová, A., & Nadányiová, M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1135199 · Cited by 30
“The internal consistency of answers and individual questions was checked using Cronbach’s alpha, which is the most frequently used method for determining the reliability of data in the social sciences as well (Drost, 2011; Dunn et al., 2014; Cho, 2016; Bardhoshi and Erford, 2017; McNeish, 2018).”
MethodResultInfluentialWord of mouth communication in political marketing: Understanding and managing referrals
Chowdhury, T. A., & Naheed, S. (2018) · Journal of Marketing Communications · doi:10.1080/13527266.2018.1523217 · Cited by 25
“70, our constructs were reliable from the perspective of internal consistency (Cho, 2016).”
BackgroundMethodInfluentialDehghani, M. A., Karavidas, D., Rese, A., & Açikgöz, F. (2023) · Information Technology and People · doi:10.1108/itp-10-2022-0821 · Cited by 29
de Araujo, J., Gomes, C. M. A., & Jelihovschi, E. G. (2023) · Psicologia Reflexão e Crítica · doi:10.1186/s41155-023-00280-0 · Cited by 49
“Although alpha is the most widely used reliability index, the psychometric literature has recommended the use of omega or similar since it produces a more accurate estimate of the reliability of latent variables by considering their factor loadings (Cho, 2016).”
MethodWhy researchers should be cautious about using PLS-SEM
Henseler, J., Schuberth, F., Lee, N. J., & Kemény, I. (2025) · Industrial Marketing Management · doi:10.1016/j.indmarman.2024.01.017 · Cited by 44
Waddimba, A. C., Bennett, M., Fresnedo, M., Ledbetter, T. G., & Warren, A. M. (2021) · Mayo Clinic Proceedings Innovations Quality & Outcomes · doi:10.1016/j.mayocpiqo.2021.08.009 · Cited by 29
How signaling mechanisms reduce “lemons” from online group buying (OGB) markets? A study of China
Hossain, M. A., Rahman, S., Chowdhury, T. A., Chan, C., Yang, X., & Su, Q. (2018) · International Journal of Physical Distribution & Logistics Management · doi:10.1108/ijpdlm-02-2017-0113 · Cited by 28
Fashion attributes preferred by young Bangladeshi consumers while buying casual clothes
Chowdhury, T. A., & Akter, T. (2018) · Journal of Fashion Marketing and Management · doi:10.1108/jfmm-02-2018-0018 · Cited by 21
Achieving plant responsiveness from reconfigurable technology: Intervening role of SCM
Ortega-Jimenez, C. H., Garrido‐Vega, P., & Torres, C. A. C. (2019) · International Journal of Production Economics · doi:10.1016/j.ijpe.2019.06.001 · Cited by 24
Exploring the development of professional values in an online RN-to-BSN program
Knecht, L. D., Dabney, B. W., Cook, L. E., & Gilbert, G. E. (2019) · Nursing Ethics · doi:10.1177/0969733019850237 · Cited by 24
“96).(25) These values are commensurate with those reported in the literature.”
ResultMahmood, A., Rehman, N., Huang, X., & Zamani, N. (2025) · BMC Psychology · doi:10.1186/s40359-025-02767-0 · Cited by 25
Grant, A., & Cassidy, S. (2021) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2021.12.006 · Cited by 30
Alcaraz‐Ibáñez, M., Paterna, A., Sicilia, Á., & Griffiths, M. D. (2022) · Journal of Behavioral Addictions · doi:10.1556/2006.2022.00014 · Cited by 25
Dessie, A. S., Calhoun, A. W., Kanjanauptom, P., Gilbert, G. E., Ekpenyong, A., Lewiss, R. E., Rabiner, J. E., Tsze, D. S., & Kessler, D. O. (2022) · Journal of Ultrasound in Medicine · doi:10.1002/jum.16095 · Cited by 22
Why We Might Still be Concerned About Low Cronbach’s Alphas in Domain-specific Knowledge Tests
Zitzmann, S., & Orona, G. A. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10015-5 · Cited by 36
“Using for it, we arrive at: This ratio compares the amount of true score variance to the scale score variance, which is exactly what a reliability coefficient is expected to do (Cho, 2016).”
Escala para medir la adicción de estudiantes a las redes sociales
Almenara, J. C., Ríos, J. L. P. D. D. L., & Valencia-Ortíz, R. (2019) · Convergencia Revista de Ciencias Sociales · doi:10.29101/crcs.v27i0.11834 · Cited by 22
Going green in Ecuador: Unpacking the motivations behind brand loyalty for organic products
Bonisoli, L., & Guañuna, R. A. B. (2023) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2023.138116 · Cited by 28
Sinclair, R., Nodi, S. S., & Kabir, M. A. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.108527 · Cited by 27
Blacksmith, N., Behrend, T. S., Dalal, R. S., & Hayes, T. L. (2018) · Personality and Individual Differences · doi:10.1016/j.paid.2018.10.024 · Cited by 22
Use and abuse of social media by adolescents: a study in Mexico
Valencia Ortiz, R., & Castaño Garrido, C. (2019) · Pixel-Bit, Revista de Medios y Educación · doi:10.12795/pixelbit.2019.i54.01 · Cited by 19
Metadata
- Authors
- Cho, E.
- Affiliations
- Kwangwoon University (KR)
- Corresponding author
- Cho, Eunseong
- ORCID
- Cho, Eunseong
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2016-07-08
- Volume
- 19
- Issue
- 4
- Pages
- 651-682
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2474970179
- Cited by
- 378
- References
- 74
- Citations by year
- 2026: 35 · 2025: 46 · 2024: 51 · 2023: 56 · 2022: 42 · 2021: 56 · 2020: 40 · 2019: 23 · 2018: 21 · 2017: 8
- FWCI
- 18.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Organizational Research Methods (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Keywords
- test score reliability, reliability coefficients, Cronbach's alpha, composite reliability, measurement reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.