Making Reliability Reliable: A Systematic Approach to Reliability Coefficients
The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Abstract
The current conventions for test score reliability coefficients are unsystematic and chaotic. Reliability coefficients have long been denoted using names that are unrelated to each other, with each formula being generated through different methods, and they have been represented inconsistently. Such inconsistency prevents organizational researchers from understanding the whole picture and misleads them into using coefficient alpha unconditionally. This study provides a systematic naming convention, formula-generating methods, and methods of representing each of the reliability coefficients. This study offers an easy-to-use solution to the issue of choosing between coefficient alpha and composite reliability. This study introduces a calculator that enables its users to obtain the values of various multidimensional reliability coefficients with a few mouse clicks. This study also presents illustrative numerical examples to provide a better understanding of the characteristics and computations of reliability coefficients.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Cronbach's alpha is not structural equation modeling (SEM) based, yet it is the most commonly-reported reliability coefficient in studies using SEM (Cho, 2016).”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Cho, 2016
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · cited 8×
“One estimator goes by the name of the fourth person to propose it (Cronbach, 1951), and others do not bear the name of any developers.”
BackgroundMethodInfluentialStructural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology · doi:10.2307/2072165 · Cited by 17,442
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,277 · cited 1×
“This study assumes that no specific factors exist to circumvent the controversial issue of specific factors and errors (Bollen, 1989).”
BackgroundStatistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
EQS : structural equations program manual
Bentler, P. M. (1989) · Medical Entomology and Zoology · Cited by 9,669
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 2×
“Many users perform the reverse; they calculate reliability to identify unidimensionality, misconceiving that a high value of a unidimensional reliability coefficient indicates unidimensionality (Cortina, 1993; Green, Lissitz, & Mulaik, 1977; Hattie, 1985; Schmitt, 1996).”
BackgroundStatistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Test Theory: A Unified Treatment
Zwick, R., & McDonald, R. P. (2000) · Journal of the American Statistical Association · doi:10.2307/2669496 · Cited by 3,603
Dunn, T. J., Baguley, T., & Brunsden, V. (2014) · British Journal of Psychology · doi:10.1111/bjop.12046 · Cited by 3,596 · cited 3×
“In addition to Jöreskog’s (1971) work, two approaches deserve mention. Let pi denote the ratio of the length of item i (i.e., li) to the total length (i.e., Pk i1⁄41 li), and let siX denote Pk j1⁄41 sij. Raju’s (1977) generalization of his previous formula (~ rR1977) is algebraically equivalent to rC .”
BackgroundMethodHandbook of Structural Equation Modeling
Howard, A. L. (2013) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2013.769397 · Cited by 3,440
Research works printed but not linked: 10
- Armor D. J., 1974, Sociological methodology, 17
- Cronbach L. J., 1978, Current Contents, 13, 263
- Feldt L. S., 1989, Educational measurement, 105
- Hair J. F., 2010, Multivariate data analysis
- Kamata A., 2003, Estimating reliability for multidimensional composite scale scores
- 10.1037/1082-989X.5.3.343 · doi:10.1037/1082-989x.5.3.343 · Paper page
- Peters G. J. Y., 2014, European Health Psychologist, 16, 56
- Raju N. S., 1970, Proceedings of the 78th Annual Convention of APA, 5, 143
- Spearman C., 1910, British Journal Psychology, 3, 271
- Tang W., 2012, Paper presented at the annual meeting of the American Educational Research Association
Cited by
Items 301–378 of 378
de la Rubia, J. M., Ávila, M. M., Bajonero-Canónico, P., & Villarreal-Garza, C. M. (2019) · Psicooncología · doi:10.5209/psic.65592 · Cited by 1
Predictive Models in Human Development Planning
Mishra, M., & Chatterjee, S. (2020) · Springer eBooks · doi:10.1007/978-981-15-4083-7_8 · Cited by 1
Toward a Spatial Measure of Twenty-First-Century Developmental State Capacity
Bohrt, M. A., Graizbord, D., & Heller, P. R. P. (2020) · Sociology of Development · doi:10.1525/sod.2020.6.2.250 · Cited by 3
Fatores de sucesso do relacionamento entre agricultores e indústria de sementes de milho
Lopes, J. A., Carvalho, J. M., & Leitão, F. O. (2021) · Revista de Economia e Sociologia Rural · doi:10.1590/1806-9479.2021.229897 · Cited by 1
Alghamdi, A. K. H., Al-Hattam, A., & Abdulsalam, N. (2021) · International Journal of Leadership in Education · doi:10.1080/13603124.2021.1914351 · Cited by 1
“The split-half correlation coefficient was 0.959 (i.e. the extent to which all parts of the test contribute equally to what is being measured; Cho, 2016).”
InfluentialChowdhury, T. A., & Anon, N. Z. (2021) · Journal of Global Fashion Marketing · doi:10.1080/20932685.2021.1939758 · Cited by 1
Chowdhury, T. A. (2021) · Review of Social Economy · doi:10.1080/00346764.2021.1939120 · Cited by 1
Methodical Basics of Empirical Research
Fischer, H. E., Boone, W. J., & Krabbe, H. (2021) · Challenges in physics education · doi:10.1007/978-3-030-87391-2_16 · Cited by 1
Brown, C. S., & Amir, N. (2022) · Biological Psychology · doi:10.1016/j.biopsycho.2022.108443 · Cited by 1
Diseño y validación de la escala de pensamiento pseudocientífico
Jaimes, F., García-Belaunde, V., & Pomar, F. L. D. (2023) · Desde el Sur Revista de Ciencias Humanas y Sociales de la Universidad Científica del Sur · doi:10.21142/des-1501-2023-0010 · Cited by 1
Navigating Motivation at Work: About Leadership, Purpose, Values, and Basic Psychological Needs
van Tuin, L. (2021) · Utrecht University Repository (Utrecht University) · doi:10.33540/270 · Cited by 1
Lin, S. (2020) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/151433 · Cited by 1
Johnson, E. (2019) · SMU Scholar (Southern Methodist University)
A adaptação cultural e a validação da escala Social and Community Opportunities Profile (SCOPE)
dos Santos, J. C. (2019) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.83.2019.tde-23072019-153711
Potentials of Digital Business Models for the European Agriculture Sector
Härting, R.-C., Kaim, R., & Horsch, F. (2020) · Smart innovation, systems and technologies · doi:10.1007/978-981-15-5764-4_3
Disordered Eating and Compulsive Exercise in Collegiate Athletes
Power, K. (2020) · TUScholarShare (Temple University)
مقارنة معاملات ثبات درجات الاختبار في ظل مجموعة من الاشتراطات: دراسة محاکاة مونت کارلو
زارع, ن. م. س. (2021) · المجلة التربوية لکلية التربية بسوهاج · doi:10.21608/edusohag.2021.180584
Rindlisbacher, B. (2021) · Waxmann Verlag GmbH eBooks · doi:10.31244/9783830994244
What Does Different Personality Test and Behavioral Test Measure? and Do We Overuse Them?
(2021) · Journal of Psychology and Neuroscience · doi:10.47485/2693-2490.1047
The Effect of an Online Writing Community on ELT Students’ Academic Writing Motivation
Zeybek, G., Erdemir, N., & SAYIN, İ. (2022) · English language education · doi:10.1007/978-3-031-13540-8_18
Al-Adas, F. A., & Touqan, A. R. (2023) · An-Najah University Journal for Research - A (Natural Sciences) · doi:10.35552/anujr.a.37.2.2111
Closed formula of test length required for adaptive testing with medium probability of solution
Kárász, J. T., Széll, K., & Takács, S. (2023) · Quality Assurance in Education · doi:10.1108/qae-03-2023-0042 · Cited by 2
ชินตาปัญญากุล, ท. (2019) · Chula Digiverse · doi:10.58837/chula.the.2019.1173
Dual self-esteem in university students: validation of the rosemberg scale
Garro-Aburto, L. L., Salvador, H. H. V., Carrillo-Flores, J. W., Guisado, J. A. C., Sánchez, R. M. S., Aliaga-Pacora, A. A., & Alza-Salvatierra, V. J. (2023) · VISUAL REVIEW International Visual Culture Review / Revista Internacional de Cultura Visual · doi:10.37467/revvisual.v15.5137
“This is highlighted by different specialists in the field, such as Cho (2016), Moral de la Rubia (2019) and Revelle & Zinbarg (2009).”
BackgroundEnvironmental Sustainability Indicators: Saudi Arabia
Tawfik, R., Sayyah, M. A., Elsebaei, M., & Badr, E.-S. A. (2023) · Scientific Journal of King Faisal University Basic and Applied Sciences · doi:10.37575/b/agr/230040
Mahran, G. S. K., Ali, M. A. S., Mahdy, M. M., Hussien, M. A. M., Abdelwahab, O., Mohamed, S. A. A., & Abdelhafez, A. I. (2023) · Critical Care Nursing Quarterly · doi:10.1097/cnq.0000000000000489 · Cited by 3
Is it all about the costs? Cultural distance and adjustment of recent migrantsPreprint
Genoni, A., Décieux, J. P., & Murdock, E. (2023) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/uskq9
German translation and validation of the Interprofessional Facilitation Scale
Kerry, M. J., Paignon, A., Conti, J. W., Sy, M., & Huber, M. (2023) · Journal of Interprofessional Care · doi:10.1080/13561820.2023.2287024
“Omega coefficients ( ω ) are analogous to Cronbach’s alpha ( α ) when multidimensionality’s impact is unknown (Cho, 2016).”
MethodEidman, L., & Seratti, D. A. Z. (2023) · Revista Evaluar · doi:10.35670/1667-4545.v23.n3.43901
Rahadiansyah, S. (2024) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/1311/1/012005
“This value is the most common reliability among coefficient reliabilities and is recommended in structural equation models [40].”
BackgroundGonzales-Ramírez, K., Crisostomo-Calderon, D., Rengifo, C. A., & Travezaño-Cabrera, A. (2023) · Revista Argentina de Ciencias del Comportamiento ( RACC ) · doi:10.32348/1852.4206.v15.n2.34492 · Cited by 3
Nivel de cumplimiento de procesos de validación y análisis de escalas de medida en pediatría
García, J. A. M., & Martínez, L. (2024) · Andes pediatrica · doi:10.32641/andespediatr.v95i4.5081
SC-PA: A spot-checking model based on Stackelberg game theory for improving peer assessment
Xu, J. W., Yang, P., Xiao, T., Lv, P., Yu, M., & Yu, G. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100556 · Cited by 2
Chambers, R. A. (2022) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc1944370
Murrube, N., Eusébio, A., Eusébio, J., Horta, I., Foutinho, C., & Máquina, C. M. (2025) · Open Journal of Epidemiology · doi:10.4236/ojepi.2025.151004
German adaptation and validation of the Factors of Online Disinhibition Scale
Peschka, L., Höck, M., Carbon, C., Hajak, G., & Bergner-Köther, R. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100624 · Cited by 2
Zeng, P.-Y., & Yeh, S. (2025) · Mindfulness · doi:10.1007/s12671-025-02534-7 · Cited by 1
“The internal consistency of the trait mindfulness measure was evaluated using Cronbach’s alpha coefficient, yielding a value of 0.92, which indicates strong reliability (Cho, 2016).”
InfluentialClark, R., Brown, R., & Pridham, K. F. (2025) · Infant Behavior and Development · doi:10.1016/j.infbeh.2025.102038
Song, J., Fang, J., Huang, K.-R., Wu, M.-Z., Chen, F.-F., Zhu, M., Xu, W., Zheng, S.-F., & Qin, J.-F. (2025) · International Journal of Obesity · doi:10.1038/s41366-025-01750-4 · Cited by 1
Preliminary Psychometric Properties of the Letter Form Assessment Version 2 (LFA–2) Scale
Ray, K., Colyvas, K., Evans, R., Langlois, C., Blackwell, D., Johnson, T., Wales, K., & Lane, A. E. (2025) · American Journal of Occupational Therapy · doi:10.5014/ajot.2025.050893
“Coefficients of scale reliability were derived from the CFA based on Cho (2016), who also defined the v coefficient as the most appropriate measure of reliability for a bifactor model.”
The Impact of Social Media on Knowledge Sharing among Faculty Members in Saudi Universities
Almousa, N. A. (2024) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc2415961
Soh, G., Wamba, A., & Chen, M. (2024) · Mesure et évaluation en éducation · doi:10.7202/1118272ar
McMillan und Chavis (1986), McMillan (1996, 2011)
Krumbholz, F. (2025) · Springer eBooks · doi:10.1007/978-3-658-47919-0_5
Veerbhan, K. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5356599
Lepa, S., Ahrens, L., & Pfleiderer, M. (2025) · Jahrbuch der Deutschen Gesellschaft für Musikpsychologie/Jahrbuch Musikpsychologie · doi:10.5964/jbdgm.217
Dramatized Reading in the Classroom: Effect on Learner Readers’ Inferential Comprehension
Sanchez, L., Eschenauer, S., & Tsao, R. (2025) · Literacy Research and Instruction · doi:10.1080/19388071.2025.2557799
“…reasons: the number of items per test is less than 10, so α is not recommended (Herman, 2015; Pallant, 2020), α is not adapted to the model of our tests (Cho, 2016; Hoekstra et al., 2018) and finally the number of participants in the pilot study for each group was less than 100 (Yurdugül, 2008).”
Validation of a French version of the subjective cognitive load scale among college students
Tordet, C., Cazes, M., Leconte, L., Rougeot, C., & Jamet, É. (2025) · Psychologie Française · doi:10.1016/j.psfr.2025.05.002 · Cited by 2
Issues of Reliability in Music Education Research
Rose, M. A. (2025) · Bulletin of the Council for Research in Music Education · doi:10.5406/21627223.245.04
Villanueva, M. S., Sanz, M. T., López-Iñesta, E., Monferrer, L., & Valentín, G. L. (2025) · European Journal of Science and Mathematics Education · doi:10.30935/scimath/17522 · Cited by 1
Adventy, M. Y. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5898330
Psychometric Validation of the Chinese Version of the Virtual Reality System Usability Questionnaire
Li, J., Jing, M., Xing, H., Zhao, H., Hu, Y. S., Zhao, Y., Jin, H., Zhu, Y., Su, M., & Li, L. (2025) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s559547 · Cited by 1
Li, C., Zhang, Y., Qin, W., Xia, J., Shang, L., & Wang, L. (2024) · Figshare · doi:10.6084/m9.figshare.25989204
White, J. V., Aray, Y. N., & Bogatyreva, K. (2026) · Small Business Economics · doi:10.1007/s11187-025-01151-x · Cited by 2
A Structural Equation Model of Car Insurance Customers’ Willingness to use Chatbots
Bergmann, J. (2026) · Zeitschrift für die gesamte Versicherungswissenschaft · doi:10.3790/zverswiss.2026.1474501
McDonald's omega (ω) reliability
Ardağ, M. M. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-26629-4.00268-9
Zhao, J., Du, J., & Liu, X. (2026) · Journal of East European Management Studies · doi:10.31083/jeems39256 · Cited by 1
Theta reliability and new estimators beyond Alpha's shadow
Zumbo, B. D. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-26629-4.00147-7
Duong, L. T., & Khuong, P. D. (2026) · Interactive Learning Environments · doi:10.1080/10494820.2026.2643469 · Cited by 1
Optimizing the Short Dark Triad Scale Using an Ant Colony Optimization Algorithm
Knitter, L. A., Schultze, M., & Koch, T. (2026) · Assessment · doi:10.1177/10731911261423632
AI-Assisted Career Preparation and Skill Gap Awareness: A Retrospective Pretest-Posttest Study
Lai, J. W., Gagero, R. D. H., Zhang, L. B., Sze, C. C., & Lim, F. S. (2026) · Education Sciences · doi:10.3390/educsci16050689 · Cited by 2
Poudel, B., Tiwari, U., Bhatta, S., Shrestha, B., & Tripathi, K. M. (2026) · Cogent Food & Agriculture · doi:10.1080/23311932.2026.2673623
Is It All About the Costs? Cultural Distance and Adjustment of Recent German Migrants
Genoni, A., Décieux, J. P., & Murdock, E. (2026) · Journal of Cross-Cultural Psychology · doi:10.1177/00220221261455885
Lazarte-Aguirre, A., Luna, A., & Chong, M. (2026) · Sustainable Technology and Entrepreneurship · doi:10.1016/j.stae.2026.100147
Zitzmann, S., Krammer, G., Lindner, C., & Hecht, M. (2026) · Psychological Test Adaptation and Development · doi:10.1027/2698-1866/a000136
23511 Assessment of reliability in measurement
Johnson, A. J. (2026) · De Gruyter eBooks · doi:10.1515/9783111087139-011
Is it all about the costs? Cultural distance and adjustment of recent migrantsPreprint
Décieux, J. P., Genoni, A., & Murdock, E. (2026) · SocArXiv (OSF Preprints)
Rieckmann, L. M., & Baumann, M. (2026) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon67543.2026.11574231
“Although α underestimates the true reliability due to heterogeneo us factor loading [41], it indicates potential for improvement.”
Franco-Jimenez, R. A., Campos-Rosas, R. M., & Baños-Chaparro, J. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1886912
Zhao, Y., Kamaruddin, A. Y., Ladin, C. A., & Ai, L. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1881577
“The LOCs were specified reflectively at the item level, while the HOCs were also specified reflectively because their subdimensions were treated as manifestations rather than defining components of the corresponding constructs.”
InfluentialShanshal, S. A., Othman, S. H., & Younis, A. A. (2026) · Clinical Rheumatology · doi:10.1007/s10067-026-08345-y
Soh, G., Wamba, A., & Chen, M. (2024) · Mesure et évaluation en éducation · doi:10.7202/1127307ar
Collaborative play in a mentalisation-based serious game for adults with intellectual disabilities
Mesker, M. (., Derks, S. D. M., & Sterkenburg, P. S. (2026) · Journal of Intellectual & Developmental Disability · doi:10.3109/13668250.2026.2710754
Aydıner, A. S. (2026) · Anadolu Üniversitesi Sosyal Bilimler Dergisi · doi:10.18037/ausbd.1976789
Hu, X., Yan, H., & Zhan, S. (2026) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2026.104939
Ventura‐León, J., & Caycho‐Rodríguez, T. (2026) · Actualidades en Psicología · doi:10.15517/ap.v40i141.63550
“…et al., 2019 ), the use of principal component analyses, which produce non-replicable structures ( Booth & Murray, 2018 ), and an excessive dependence on coefficients such as Cronbach’s alpha without taking into account more reliable reliability indicators (Cho, 2016) are some of the main flaws.”
Duman, F., Alkandemir, A., & CİZRELİOĞULLARI, M. N. (2026) · Yönetim Bilimleri Dergisi · doi:10.35408/comuybd.1866942
Metadata
- Authors
- Cho, E.
- Affiliations
- Kwangwoon University (KR)
- Corresponding author
- Cho, Eunseong
- ORCID
- Cho, Eunseong
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2016-07-08
- Volume
- 19
- Issue
- 4
- Pages
- 651-682
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2474970179
- Cited by
- 378
- References
- 74
- Citations by year
- 2026: 35 · 2025: 46 · 2024: 51 · 2023: 56 · 2022: 42 · 2021: 56 · 2020: 40 · 2019: 23 · 2018: 21 · 2017: 8
- FWCI
- 18.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Organizational Research Methods (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Keywords
- test score reliability, reliability coefficients, Cronbach's alpha, composite reliability, measurement reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.