Confidence intervals for population reliability coefficients: Evaluation of methods, recommendations, and software for composite measures.
The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
Abstract
A composite score is the sum of a set of components. For example, a total test score can be defined as the sum of the individual items. The reliability of composite scores is of interest in a wide variety of contexts due to their widespread use and applicability to many disciplines. The psychometric literature has devoted considerable time to discussing how to best estimate the population reliability value. However, all point estimates of a reliability coefficient fail to convey the uncertainty associated with the estimate as it estimates the population value. Correspondingly, a confidence interval is recommended to convey the uncertainty with which the population value of the reliability coefficient has been estimated. However, many confidence interval methods for bracketing the population reliability coefficient exist and it is not clear which method is most appropriate in general or in a variety of specific circumstances. We evaluate these confidence interval methods for 4 reliability coefficients (coefficient alpha, coefficient omega, hierarchical omega, and categorical omega) under a variety of conditions with 3 large-scale Monte Carlo simulation studies. Our findings lead us to generally recommend bootstrap confidence intervals for hierarchical omega for continuous items and categorical omega for categorical items. All of the methods we discuss are implemented in the freely available R language and environment via the MBESS package.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“we agree with those viewing h as being a more appropriate measure of second-order reliability (Kelley & Pornprasertmanit, 2016;Zinbarg et al., 2005) because it considers both 2 and group-specific error as comprising the error term.”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Kelley & Pornprasertmanit, 2016
In the citing paper
“Omega total ( T ) represents the reliability of the combined first-order factors, whereas omega hierarchical ( h ) is the reliability of the second-order factor (Kelley & Pornprasertmanit, 2016;Zinbarg et al., 2005)”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Kelley & Pornprasertmanit, 2016
In the citing paper
“We prefer PCIs over bias-corrected and accelerated CIs (BC a CI) because PCIs have better coverage for both normal and nonnormal item distributions (Kelley & Pornprasertmanit, 2016).”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Kelley & Pornprasertmanit, 2016
In the citing paper
“While the appropriate sample size depends on the complexity of the model and the estimation method, Kelley and Pornprasertmanit (2016) found, using a simulation, that the coverage rates of CIs are good across reliability levels even at N = 50.”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Kelley and Pornprasertmanit (2016)
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · cited 1×
“The most widely used reliability coefficient used to estimate $(Y) is coefficient alpha (Cronbach, 1951).”
MethodAn Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
(1998) · Cited by 36,049
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.3102/00028312006001112 · Cited by 8,014
(2005) · Cited by 6,097
A scaled difference chi-square test statistic for moment structure analysis
Satorra, A., & Bentler, P. M. (2001) · Psychometrika · doi:10.1007/bf02296192 · Cited by 5,282
Introduction to Classical and Modern Test Theory
Crocker, L. M., & Algina, J. J. (1986) · Cited by 5,090
Cited by
Thanks coefficient alpha, we’ll take it from here.
McNeish, D. (2018) · Psychological Methods · doi:10.1037/met0000144 · Cited by 2,533
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024) · Asia Pacific Journal of Management · doi:10.1007/s10490-023-09871-y · Cited by 2,262
“…factor reliability because they treat 2 as the only error term, we agree with those viewing h as being a more appropriate measure of second-order reliability (Kelley & Pornprasertmanit, 2016; Zinbarg et al., 2005) because it considers both 2 and group-specific error as comprising the error term.”
InfluentialA Review of Key Likert Scale Development Advances: 1995–2019
Jebb, A. T., Ng, V., & Tay, L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.637547 · Cited by 770
Un viaje alrededor de alfa y omega para estimar la fiabilidad de consistencia interna
Viladrich, C., Angulo-Brunet, A., & Doval, E. (2017) · Anales de Psicología · doi:10.6018/analesps.33.3.268401 · Cited by 699
Flora, D. B. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920951747 · Cited by 561
The reliability of multidimensional neuropsychological measures: from alpha to omega
Watkins, M. W. (2017) · The Clinical Neuropsychologist · doi:10.1080/13854046.2017.1317364 · Cited by 271
Peer and teacher supports in relation to motivation and effort: A multi-level study
Wentzel, K. R., Muenks, K., McNeish, D., & Russell, S. (2017) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2016.11.002 · Cited by 264
Cabrera, A., Kolacz, J., Pailhez, G., Bulbena‐Cabre, A., Bulbena, A., & Porges, S. W. (2018) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1596 · Cited by 224
Villarreal-Zegarra, D., Copez-Lonzoy, A., Bernabé-Ortiz, A., Melendez-Torres, G. J., & Bazo-Alvarez, J. C. (2019) · PLOS ONE · doi:10.1371/journal.pone.0221717 · Cited by 191
Huarcaya-Victoria, J., Villarreal-Zegarra, D., Podestà, A., & Luna-Cuadros, M. A. (2022) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-020-00354-5 · Cited by 185
Omega over alpha for reliability estimation of unidimensional communication measures
Goodboy, A. K., & Martin, M. M. (2020) · Annals of the International Communication Association · doi:10.1080/23808985.2020.1846135 · Cited by 178
Utiliser le coefficient omega de McDonald à la place de l’alpha de Cronbach
Béland, S., Cousineau, D., & Loye, N. (2018) · McGill Journal of Education / Revue des sciences de l'éducation de McGill · doi:10.7202/1050915ar · Cited by 161
Extrinsic Convergent Validity Evidence to Prevent Jingle and Jangle Fallacies
González, O., MacKinnon, D. P., & Muniz, F. B. (2020) · Multivariate Behavioral Research · doi:10.1080/00273171.2019.1707061 · Cited by 161
Revisiting the Structure of the Short Dark Triad
Persson, B. N., Kajonius, P. J., & Garcia, D. (2019) · Assessment · doi:10.1177/1073191117701192 · Cited by 111
López‐Zafra, E., Ramos‐Álvarez, M. M., Ghoudani, K. E., Luque-Reca, O., Augusto-Landa, J. M., Zarhbouch, B., Alaoui, S., Cortés-Denia, D., & Pulido‐Martos, M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01529 · Cited by 130
Exploring consumers’ willingness to eat insects in Italy
Palmieri, N., Perito, M. A., Macrì, M. C., & Lupi, C. (2019) · British Food Journal · doi:10.1108/bfj-03-2019-0170 · Cited by 119
Komperda, R., Pentecost, T. C., & Barbera, J. (2018) · Journal of Chemical Education · doi:10.1021/acs.jchemed.8b00220 · Cited by 115
Psychometric Evaluation of the Short Sensory Profile in Youth with Autism Spectrum Disorder
Williams, Z. J., Failla, M. D., Gotham, K. O., Woynaroski, T. G., & Cascio, C. J. (2018) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-018-3678-7 · Cited by 106
Don’t Forget the Model in Your Model-based Reliability Coefficients: A Reply to McNeish ()
Savalei, V., & Reise, S. P. (2019) · Collabra Psychology · doi:10.1525/collabra.247 · Cited by 106
Swami, V., Todd, J., Azzi, V., Malaeb, D. N., Dine, A. S. E., Obeïd, S., & Hallit, S. R. (2022) · Body Image · doi:10.1016/j.bodyim.2022.07.008 · Cited by 90
Assunção, H., Lin, S., Sit, P., Cheung, K., Harju‐Luukkainen, H., Smith, T. J., Maloa, B. F. S., Campos, J. Á. D. B., Stepanovic-Ilic, I., Esposito, G., et al. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02796 · Cited by 98
Specificity-enhanced reliability coefficients.
Bentler, P. M. (2016) · Psychological Methods · doi:10.1037/met0000092 · Cited by 75
A Simulation Study on the Performance of Different Reliability Estimation Methods
Edwards, A. A., Joyner, K. J., & Schatschneider, C. W. (2021) · Educational and Psychological Measurement · doi:10.1177/0013164421994184 · Cited by 72
University student engagement inventory (USEI): Psychometric properties
Sinval, J., Casanova, J. R., Marôco, J. P., & Almeida, L. S. (2018) · Current Psychology · doi:10.1007/s12144-018-0082-6 · Cited by 80
Kraepelien, M., Blom, K., Forsell, E., Isacsson, N. H., Bjurner, P., Morin, C. M., Jernelöv, S., & Kaldo, V. (2021) · Sleep Medicine · doi:10.1016/j.sleep.2021.03.003 · Cited by 69
Ipanaqué-Zapata, M., Figueroa-Quiñones, J., Bazalar-Palacios, J., Arhuis-Inca, W., Quiñones-Negrete, M. M., & Villarreal‐Zegarra, D. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e13770 · Cited by 68
Assessing Raters: What Factors Predict Discernment in Novice Creativity Raters?
Ceh, S. M., Edelmann, C., Hofer, G., & Benedek, M. (2021) · The Journal of Creative Behavior · doi:10.1002/jocb.515 · Cited by 64
Alivernini, F., Manganelli, S., Cavicchiolo, E., & Lucidi, F. (2017) · Journal of Psychoeducational Assessment · doi:10.1177/0734282917732890 · Cited by 61
de Lijster, J. M., van den Dries, M. A., van der Ende, J., Utens, E. M. W. J., Jaddoe, V. W. V., Dieleman, G. C., Hillegers, M. H. J., Tiemeier, H. W., & Legerstee, J. S. (2019) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-019-00550-5 · Cited by 59
Bourque, J., Doucet, D., LeBlanc, J., Dupuis, J. B., & Nadeau, J. (2020) · Revue des sciences de l éducation · doi:10.7202/1067534ar · Cited by 72
Engagement profiles of elementary students in urban schools
Bae, C. L. L., DeBusk‐Lane, M., & Lester, A. M. (2020) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2020.101880 · Cited by 57
Gomez, R., Stavropoulos, V., & Griffiths, M. D. (2020) · PLoS ONE · doi:10.1371/journal.pone.0233998 · Cited by 60
Psychometric properties of an Italian translation of the Functionality Appreciation Scale (FAS)
Cerea, S., Todd, J., Ghisi, M., Mancin, P., & Swami, V. (2021) · Body Image · doi:10.1016/j.bodyim.2021.04.007 · Cited by 53
Flores-Kanter, P. E., Garrido, L. E., Moretti, L. S., & Medrano, L. A. (2021) · Journal of Clinical Psychology · doi:10.1002/jclp.23191 · Cited by 55
COVID-19 pandemic and health worker stress: The mediating effect of emotional regulation
García-Batista, Z. E., Guerra-Peña, K., Kandany, V. N., Marte, M. I., Garrido, L. E., Cantisano-Guzmán, L. M., Moretti, L. S., & Medrano, L. A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0259013 · Cited by 54
Villarreal‐Zegarra, D., Copez-Lonzoy, A. J. E., Vilela-Estrada, A. L., & Huarcaya-Victoria, J. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03456-z · Cited by 50
Performance of Coefficient Alpha and Its Alternatives: Effects of Different Types of Non-Normality
Xiao, L., & Hau, K. (2022) · Educational and Psychological Measurement · doi:10.1177/00131644221088240 · Cited by 54
Swami, V., Todd, J., Stieger, S., Furnham, A. F., Horne, G., & Tylka, T. L. (2020) · Body Image · doi:10.1016/j.bodyim.2020.11.007 · Cited by 53
Russell, J. D., Graham, R. A., Neill, E. L., & Weems, C. F. (2016) · Journal of Youth and Adolescence · doi:10.1007/s10964-016-0495-1 · Cited by 48
Bayesian Estimation of Single-Test Reliability Coefficients
Pfadt, J. M., van den Bergh, D., Sijtsma, K., Moshagen, M., & Wagenmakers, E. (2021) · Multivariate Behavioral Research · doi:10.1080/00273171.2021.1891855 · Cited by 48
Multidimensional Bullying Victimization Scale: Development and validation
Harbin, S. M., Kelley, M. L., Piscitello, J., & Walker, S. J. (2018) · Journal of School Violence · doi:10.1080/15388220.2017.1423491 · Cited by 45
Sommers-Spijkerman, M., Trompetter, H., ten Klooster, P., Schreurs, K., Gilbert, P., & Bohlmeijer, E. (2018) · Psychological Assessment · doi:10.1037/pas0000514 · Cited by 43
García-Batista, Z. E., Guerra-Peña, K., Garrido, L. E., Cantisano-Guzmán, L. M., Moretti, L. S., Vindel, A. C., Arias, V. B., & Medrano, L. A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.636693 · Cited by 44
Restorative Play: Videogames Improve Player Wellbeing After a Need-Frustrating Event
Tyack, A., Wyeth, P. A., & Johnson, D. M. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376332 · Cited by 47
Matsuyoshi, D., & Watanabe, K. (2020) · Psychological Research · doi:10.1007/s00426-020-01355-8 · Cited by 41
Tyack, A., & Wyeth, P. A. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3474709 · Cited by 44
Not all Online Sexual Activities Are the Same
Barrada, J. R., Ruiz-Gómez, P., Correa, A. B., & Castro, Á. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00339 · Cited by 43
Wang, N., Ren, F., & Zhou, X. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01355 · Cited by 42
Uncovering the Motivational Core of Traits: The Case of Conscientiousness
Costantini, G., Saraulli, D., & Perugini, M. (2020) · European Journal of Personality · doi:10.1002/per.2237 · Cited by 41
Evaluation of a bibliotherapy-based stress intervention for teachers
Eddy, C. L., Herman, K. C., Huang, F. L., & Reinke, W. M. (2021) · Teaching and Teacher Education · doi:10.1016/j.tate.2021.103543 · Cited by 38
Psychometric properties of a Romanian translation of the Functionality Appreciation Scale (FAS)
Swami, V., Todd, J., Goian, C., Tudorel, O. I., Barron, D. S., & Vintilă, M. (2021) · Body Image · doi:10.1016/j.bodyim.2021.02.010 · Cited by 38
Validity of the Satisfaction with Life Scale in Colombia and factorial equivalence with Spanish data
Ruiz, F. J., Suárez-Falcón, J. C., Flórez, C. L., Odriozola-González, P., Tovar, D., López-González, S., & Martín, R. B. (2019) · Revista Latinoamericana de Psicología · doi:10.14349/rlp.2019.v51.n2.1 · Cited by 43
Xu, J., Wang, C., Du, J., & Núñez, J. C. (2022) · Learning and Individual Differences · doi:10.1016/j.lindif.2022.102159 · Cited by 37
Short Forms of Wechsler Scales Assessing the Intellectually Gifted Children Using Simulation Data
Aubry, A., & Bourdin, B. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00830 · Cited by 39
Roberson, A. J., & Renshaw, T. L. (2017) · Journal of Psychoeducational Assessment · doi:10.1177/0734282917696932 · Cited by 37
A cautionary note on the finite sample behavior of maximal reliability.
Aguirre-Urreta, M. I., Rönkkö, M., & McIntosh, C. N. (2018) · Psychological Methods · doi:10.1037/met0000176 · Cited by 33
Heilala, V., Kelly, R., Saarela, M., Jääskelä, P., & Kärkkäinen, T. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2049142 · Cited by 34
A tutorial on the meta-analytic structural equation modeling of reliability coefficients.
Scherer, R., & Teo, T. P. (2020) · Psychological Methods · doi:10.1037/met0000261 · Cited by 35
Peters, G.-J., & Crutzen, R. (2020) · Psychology and Health · doi:10.1080/08870446.2020.1757098 · Cited by 32
Sinharoy, S. S., Conrad, A., Patrick, M., McManus, S., & Caruso, B. A. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-053104 · Cited by 32
misty: Miscellaneous Functions 'T. Yanagida'
Yanagida, T. (2020) · doi:10.32614/cran.package.misty · Cited by 35
Analyzing Monte Carlo Simulation Studies With Classification and Regression Trees
González, O., O’Rourke, H. P., Wurpts, I. C., & Grimm, K. J. (2017) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2017.1369353 · Cited by 31
Bell, S. M., Chalmers, R. P., & Flora, D. B. (2023) · Educational and Psychological Measurement · doi:10.1177/00131644231155804 · Cited by 29
Miroshnik, K. G., Shcherbakova, O., & Kaufman, J. C. (2021) · Creativity Research Journal · doi:10.1080/10400419.2021.1953823 · Cited by 30
Sinharoy, S. S., McManus, S., Conrad, A., Patrick, M., & Caruso, B. A. (2023) · World Development · doi:10.1016/j.worlddev.2023.106183 · Cited by 28
The Motivation to Play Scale (MOPS) - introducing a validated measure of gaming motivation
Holl, E. A., Sischka, P. E., Wagener, G. L., & Melzer, A. (2024) · Current Psychology · doi:10.1007/s12144-024-06631-z · Cited by 27
Recommendations for Adjudicating Among Alternative Structural Models of Psychopathology
Waldman, I. D., King, C. D., Poore, H. E., Luningham, J. M., Zinbarg, R. E., Krueger, R. F., Markon, K. E., Bornovalova, M. A., Chmielewski, M. S., Conway, C., et al. (2023) · Clinical Psychological Science · doi:10.1177/21677026221144256 · Cited by 30
Murray, A. L., Hemady, C. L., Do, H. P., Dunne, M. P., Foley, S., Osafo, J., Sikander, S., Madrid, B. J., Băban, A., Tăut, D., et al. (2022) · Psychological Assessment · doi:10.1037/pas0001154 · Cited by 31
Roos, C. A., Postmes, T., & Koudenburg, N. (2020) · Group Processes & Intergroup Relations · doi:10.1177/1368430220935989 · Cited by 26
Kraiss, J. T., ten Klooster, P. M., Chrispijn, M., Stevens, A. W. M. M., Kupka, R., & Bohlmeijer, E. T. (2019) · Journal of Clinical Psychology · doi:10.1002/jclp.22819 · Cited by 25
Forsell, E., Kraepelien, M., Blom, K., Isacsson, N. H., Jernelöv, S., Svanborg, C., Rosén, A., & Kaldo, V. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.07.057 · Cited by 27
PTSD networks of veterans with combat versus non-combat types of index trauma
Macia, K. S., Raines, A. M., Maieritsch, K. P., & Franklin, C. L. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.08.027 · Cited by 25
Macia, K. S., Carlson, E. B., Palmieri, P. A., Smith, S. R., Anglin, D. M., Ippen, C. G., Lieberman, A. F., Wong, E. C., Schell, T. L., & Waelde, L. C. (2022) · Assessment · doi:10.1177/10731911221133317 · Cited by 27
Character Strengths in Adults and Adolescents: Their Measurement and Association with Well-Being
Kretzschmar, A., Harzer, C., & Ruch, W. (2022) · Journal of Personality Assessment · doi:10.1080/00223891.2022.2043879 · Cited by 25
Macia, K. S., Moschetto, J. M., Wickham, R. E., Brown, L. M., & Waelde, L. C. (2020) · Journal of Traumatic Stress · doi:10.1002/jts.22569 · Cited by 23
Ballou, N., & van Rooij, A. J. (2021) · Royal Society Open Science · doi:10.1098/rsos.201385 · Cited by 23
Development and Initial Validation of the Adolescent Routines Questionnaire: Parent and Self-Report
Piscitello, J., Cummins, R. N., Kelley, M. L., & Meyer, K. (2018) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-018-9707-1 · Cited by 22
Understanding dentists’ caries management: The COM ‐B ICCMS ™ questionnaire
Abreu‐Placeres, N., Newton, T., Pitts, N. B., Garrido, L. E., Ekstrand, K., Ávila, V., & Martignon, S. (2018) · Community Dentistry And Oral Epidemiology · doi:10.1111/cdoe.12388 · Cited by 22
Modellbasierte Methoden der Reliabilitätsschätzung
Schermelleh-Engel, K., & Gäde, J. C. (2020) · Springer eBooks · doi:10.1007/978-3-662-61532-4_15 · Cited by 29
Villarreal‐Zegarra, D., Torres-Puente, R., Otazú-Alfaro, S., Al‐kassab‐Córdova, A., de Castro, J. R., & Mezones‐Holguín, E. (2022) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2022.110759 · Cited by 24
Siitonen, P., Honkapuro, S., Annala, S., & Wolff, A. (2024) · International Journal of Sustainable Energy · doi:10.1080/14786451.2024.2350756 · Cited by 24
Ruiz, F. J., Monroy-Cifuentes, A., & Suárez-Falcón, J. C. (2018) · Anales de Psicología · doi:10.6018/analesps.34.3.300281 · Cited by 22
Development and initial validation of the Generalized Tracking Questionnaire
Ruiz, F. J., Garcia-Martin, M., Suárez-Falcón, J. C., Bedoya-Valderrama, L., Segura‐Vargas, M. A., Peña-Vargas, A., Henao, Á. M., & Ávila-Campos, J. E. (2020) · PLoS ONE · doi:10.1371/journal.pone.0234393 · Cited by 22
McGuire, A. P., Hayden, C. L., Tomoum, R., & Kurz, A. S. (2022) · Journal of Happiness Studies · doi:10.1007/s10902-022-00533-2 · Cited by 21
Social Networks Addiction (SNA-6) – Short: Validity of Measurement in Mexican Youths
Salas-Blas, E., Merino-Soto, C., Pérez-Amezcua, B., & Toledano-Toledano, F. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.774847 · Cited by 20
Implementing alternative estimation methods to evaluate the reliability of Likert-scale instruments
Park, C. G. (2024) · Women s Health Nursing · doi:10.4069/whn.2024.03.12 · Cited by 20
Suzman, E., Williams, Z. J., Feldman, J. I., Failla, M. D., Cascio, C. J., Wallace, M. T., Niarchou, M., Sutcliffe, J. S., Wodka, E. L., & Woynaroski, T. G. (2021) · Molecular Autism · doi:10.1186/s13229-021-00440-y · Cited by 20
Bezdíček, O., Michalec, J., Kališová, L., Kufa, T., Děchtěrenko, F., Chlebovcová, M., Havlík, F., Green, M. F., & Nuechterlein, K. H. (2020) · Schizophrenia Research · doi:10.1016/j.schres.2020.02.004 · Cited by 21
Yang, Y., & Xia, Y. R. (2018) · Educational and Psychological Measurement · doi:10.1177/0013164417752008 · Cited by 20
Ruiz, F. J., Odriozola-González, P., Suárez-Falcón, J. C., & Segura-Vargas, M. A. (2022) · PeerJ · doi:10.7717/peerj.12670 · Cited by 19
Initial Development and Validation of the Student Wellbeing Teacher-Report Scale
Roberson, A. J., & Renshaw, T. L. (2019) · School Mental Health · doi:10.1007/s12310-018-09305-x · Cited by 20
Reinke, W. M., Herman, K. C., Huang, F. L., McCall, C. S., Holmes, S. R., Thompson, A. M., & Owens, S. (2021) · Journal of School Psychology · doi:10.1016/j.jsp.2021.10.001 · Cited by 22
Anastasiades, E., Todd, J., Argyrides, M., & Swami, V. (2023) · Body Image · doi:10.1016/j.bodyim.2023.01.010 · Cited by 19
An Investigation of the Psychometric Properties of the Early Identification System–Student Report
Huang, F. L., Reinke, W. M., Thompson, A. M., & Herman, K. C. (2018) · Journal of Psychoeducational Assessment · doi:10.1177/0734282918758791 · Cited by 18
Boeck, A. D., Pleysier, S., & Put, J. (2017) · Criminology & Criminal Justice · doi:10.1177/1748895817721273 · Cited by 20
McNeish, D., & Dumas, D. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02611-8 · Cited by 17
Structural Validity Evidence for the Oxford Utilitarianism Scale Across 15 Languages
Oshiro, B., McAuliffe, W. H. B., Luong, R., Santos, A. C., Findor, A., Kuzminska, A. O., Lantian, A., Özdoğru, A. A., Aczél, B., Dinić, B. M., et al. (2024) · Psychological Test Adaptation and Development · doi:10.1027/2698-1866/a000061 · Cited by 20
Scale Validation Conducting Confirmatory Factor Analysis: A Monte Carlo Simulation Study With LISREL
Ondé, D., & Alvarado, J. M. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00751 · Cited by 17
Measuring Real-Time Response in Real-Life Settings
Waldvogel, T., & Metz, T. (2019) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edz050 · Cited by 17
Swami, V., Todd, J., Stieger, S., & Tylka, T. L. (2020) · Body Image · doi:10.1016/j.bodyim.2020.08.006 · Cited by 17
Metadata
- Authors
- Kelley, K., & Pornprasertmanit, S.
- Affiliations
- University of Notre Dame (US)
- Texas Tech University (US)
- Venue
- Psychological Methods
- Published
- 2016
- Volume
- 21
- Issue
- 1
- Pages
- 69-92
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2295825737
- Cited by
- 259
- References
- 80
- Citations by year
- 2026: 20 · 2025: 17 · 2024: 27 · 2023: 31 · 2022: 35 · 2021: 38 · 2020: 29 · 2019: 22 · 2018: 22 · 2017: 13 · 2016: 4
- FWCI
- 22.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Notre Dame Deloitte Center for Ethical Leadership
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- confidence intervals, composite score, Cronbach's alpha, bootstrap confidence intervals, reliability estimation, Monte Carlo simulation, R software
- MeSH terms
- Humans, Psychometrics, Reproducibility of Results, Confidence Intervals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.