Applying Bifactor Statistical Indices in the Evaluation of Psychological Measures
Abstract
The purpose of this study was to apply a set of rarely reported psychometric indices that, nevertheless, are important to consider when evaluating psychological measures. All can be derived from a standardized loading matrix in a confirmatory bifactor model: omega reliability coefficients, factor determinacy, construct replicability, explained common variance, and percentage of uncontaminated correlations. We calculated these indices and extended the findings of 50 recent bifactor model estimation studies published in psychopathology, personality, and assessment journals. These bifactor derived indices (most not presented in the articles) provided a clearer and more complete picture of the psychometric properties of the assessment instruments. We reached 2 firm conclusions. First, although all measures had been tagged "multidimensional," unit-weighted total scores overwhelmingly reflected variance due to a single latent variable. Second, unit-weighted subscale scores often have ambiguous interpretations because their variance mostly reflects the general, not the specific, trait. Finally, we review the implications of our evaluations and consider the limits of inferences drawn from a bifactor modeling approach.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Omega is a reliability estimate that does not depend on the assumption of tau equivalence unlike Cronbach's alpha.
“Omega is a reliability estimate that does not depend on the assumption of tau equivalence unlike its classic counterpart Cronbach’s alpha [39].”
From Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis (2020) · cites this paper as [39]
When PUC is greater than .70 and ECV greater than .70, relative bias will be slight and the common variance can be regarded as essentially unidimensional.
“When PUC is greater than .70 and ECV greater than .70 relative bias will be slight and the common variance can be regarded as essentially unidimensional [39].”
From Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis (2020) · cites this paper as [39]
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · see citing works
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567 · see citing works
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814 · see citing works
The Scientific Use of Factor Analysis in Behavioral and Life Sciences
Cattell, R. B. (1978) · doi:10.1007/978-1-4684-2262-7 · Cited by 2,165 · see citing works
The Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112 · see citing works
Self-citationBorsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1061 · Cited by 1,733 · see citing works
Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma
Revelle, W., & Zinbarg, R. E. (2008) · Psychometrika · doi:10.1007/s11336-008-9102-z · Cited by 1,652 · see citing works
Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005) · Psychometrika · doi:10.1007/s11336-003-0974-7 · Cited by 1,439 · see citing works
Osman, A., Wong, J. L., Bagge, C. L., Freedenthal, S. L., Gutierrez, P. M., & Lozano, G. (2012) · Journal of Clinical Psychology · doi:10.1002/jclp.21908 · Cited by 1,097 · see citing works
Scoring and Modeling Psychological Measures in the Presence of Multidimensionality
Reise, S. P., Bonifay, W. E., & Haviland, M. G. (2013) · Journal of Personality Assessment · doi:10.1080/00223891.2012.725437 · Cited by 1,069 · see citing works
Self-citationReise, S. P., Scheines, R., Widaman, K. F., & Haviland, M. G. (2013) · Educational and Psychological Measurement · doi:10.1177/0013164412449831 · Cited by 766 · see citing works
Self-citationThe role of the bifactor model in resolving dimensionality issues in health outcomes measures
Reise, S. P., Morizot, J., & Hays, R. D. (2007) · Quality of Life Research · doi:10.1007/s11136-007-9183-7 · Cited by 747 · see citing works
Self-citationComputing and evaluating factor scores.
Grice, J. W. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.430 · Cited by 653 · see citing works
Does item homogeneity indicate internal consistency or item redundancy in psychometric scales?
Boyle, G. J. (1991) · Personality and Individual Differences · doi:10.1016/0191-8869(91)90115-r · Cited by 495 · see citing works
Zinbarg, R. E., Yovel, I., Revelle, W., & McDonald, R. P. (2006) · Applied Psychological Measurement · doi:10.1177/0146621605278814 · Cited by 422 · see citing works
The Hospital Anxiety and Depression Scale: A meta confirmatory factor analysis
Norton, S., Cosco, T. D., Doyle, F., Done, J., & Sacker, A. (2012) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2012.10.010 · Cited by 407 · see citing works
Alpha, Dimension-Free, and Model-Based Internal Consistency Reliability
Bentler, P. M. (2008) · Psychometrika · doi:10.1007/s11336-008-9100-1 · Cited by 404 · see citing works
The Greatest Lower Bound to the Reliability of a Test and the Hypothesis of Unidimensionality
ten Berge, J. M. F., & Sočan, G. (2004) · Psychometrika · doi:10.1007/bf02289858 · Cited by 334 · see citing works
When Can Subscores Have Value?
Haberman, S. J. (2008) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998607302636 · Cited by 240 · see citing works
The State-Trait Anxiety Inventory, Trait Version: Does It Really Measure Anxiety?
Bados, A., Gómez‐Benito, J., & Fort, G. B. (2010) · Journal of Personality Assessment · doi:10.1080/00223891.2010.513295 · Cited by 198 · see citing works
Ciucci, E., Baroncelli, A., Franchi, M., Golmaryami, F. N., & Frick, P. J. (2013) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-013-9384-z · Cited by 181 · see citing works
Iani, L., Lauriola, M., & Costantini, M. (2014) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-12-84 · Cited by 156 · see citing works
The Big Five Personality Factors as Predictors of Changes Across Time in Burnout and Its Facets
Armon, G., Shirom, A., & Melamed, S. (2011) · Journal of Personality · doi:10.1111/j.1467-6494.2011.00731.x · Cited by 150 · see citing works
Jonason, P. K., & Luévano, V. X. (2013) · Personality and Individual Differences · doi:10.1016/j.paid.2013.02.010 · Cited by 145 · see citing works
Using Logistic Approximations of Marginal Trace Lines to Develop Short Assessments
Stucky, B. D., Thissen, D., & Edelen, M. O. (2012) · Applied Psychological Measurement · doi:10.1177/0146621612462759 · Cited by 142 · see citing works
Osman, A., Gutierrez, P. M., Smith, K. D., Fang, Q., Lozano, G., & Devine, A. (2010) · Journal of Personality Assessment · doi:10.1080/00223890903379332 · Cited by 139 · see citing works
Bonifay, W. E., Reise, S. P., Scheines, R., & Meijer, R. R. (2015) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2014.938596 · Cited by 139 · see citing works
Self-citationByrd, A., Kahn, R. E., & Pardini, D. (2012) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-012-9315-4 · Cited by 136 · see citing works
Toplak, M. E., Pitch, A., Flora, D. B., Iwenofu, L., Ghelani, K., Jain, U., & Tannock, R. (2009) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-009-9336-y · Cited by 133 · see citing works
Testing the psychopathology of psychosis: evidence for a general psychosis dimension.
Reininghaus, U., Priebe, S., & Bentall, R. (2013) · Schizophrenia bulletin · doi:10.1093/schbul/sbr182 · Cited by 133 · see citing works
Using Hierarchical IRT Models to Create Unidimensional Measures From Multidimensional Data
Stucky, B. D., & Edelen, M. O. (2014) · doi:10.4324/9781315736013.ch9 · Cited by 120 · see citing works
Unidimensionality and interpretability of psychological instruments.
Gustafsson, J., & Åberg‐Bengtsson, L. (2010) · American Psychological Association eBooks · doi:10.1037/12074-005 · Cited by 113 · see citing works
Gignac, G. E., Palmer, B. R., & Stough, C. (2007) · Journal of Personality Assessment · doi:10.1080/00223890701629730 · Cited by 104 · see citing works
On the dimensionality of the Dispositional Hope Scale.
Brouwer, D., Meijer, R. R., Weekers, A. M., & Baneke, J. J. (2008) · Psychological Assessment · doi:10.1037/1040-3590.20.3.310 · Cited by 101 · see citing works
The Rosenberg Self-Esteem Scale: A Bifactor Answer to a Two-Factor Question?
McKay, M., Boduszek, D., & Harvey, S. A. (2014) · Journal of Personality Assessment · doi:10.1080/00223891.2014.923436 · Cited by 98 · see citing works
Freedenthal, S. L., Lamis, D. A., Osman, A., Kahlo, D. M., & Gutierrez, P. M. (2011) · Journal of Clinical Psychology · doi:10.1002/jclp.20782 · Cited by 92 · see citing works
Psychometric Evaluation of the Perceived Stress Scale in Multiple Sclerosis
Wu, S. M., & Amtmann, D. (2013) · ISRN Rehabilitation · doi:10.1155/2013/608356 · Cited by 91 · see citing works
What Lies Beneath the Dark Triad Dirty Dozen: Varied Relations with the Big Five
Jonason, P. K., Kaufman, S. B., Webster, G. D., & Geher, G. (2013) · Individual Differences Research · doi:10.65030/idr.11008 · Cited by 89 · see citing works
Structural equation modeling: Present and future. A festschrift in honor of Karl Joreskog.
Bunting, B. P. (2001) · British Journal of Mathematical and Statistical Psychology · Cited by 89 · see citing works
An NCME Instructional Module on Subscores
Sinharay, S., Puhan, G., & Haberman, S. J. (2011) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.2011.00208.x · Cited by 87 · see citing works
The hierarchical factor model of ADHD: invariant across age and national groupings?
Toplak, M. E., Sorge, G. B., Flora, D. B., Chen, W., Banaschewski, T., Buitelaar, J. K., Ebstein, R. P., Eisenberg, J., Franke, B., Gill, M., et al. (2011) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2011.02500.x · Cited by 83 · see citing works
Martel, M. M., von Eye, A., & Nigg, J. T. (2012) · International Journal of Behavioral Development · doi:10.1177/0165025412444077 · Cited by 74 · see citing works
Evidence for a General Factor Model of ADHD in Adults
Gibbins, C., Toplak, M. E., Flora, D. B., Weiss, M. D., & Tannock, R. (2011) · Journal of Attention Disorders · doi:10.1177/1087054711416310 · Cited by 67 · see citing works
Reichenheim, M. E., de Moraes, C. L., de Oliveira, A. S. D., & Lobato, G. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-93 · Cited by 66 · see citing works
Reporting subscores for institutions
Haberman, S. J., Sinharay, S., & Puhan, G. (2008) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711007x248875 · Cited by 63 · see citing works
Luciano, J. V., Barrada, J. R., Aguado, J., Osma, J., & García-Campayo, J. (2014) · Psychological Assessment · doi:10.1037/a0035284 · Cited by 62 · see citing works
Reynolds Adolescent Depression Scale-second edition: a reliable and useful instrument
Osman, A., Gutierrez, P. M., Bagge, C. L., Fang, Q., & Emmerich, A. (2010) · Journal of Clinical Psychology · doi:10.1002/jclp.20727 · Cited by 62 · see citing works
An Item Response Theory Analysis of the Narcissistic Personality Inventory
Ackerman, R. A., Donnellan, M. B., & Robins, R. W. (2012) · Journal of Personality Assessment · doi:10.1080/00223891.2011.645934 · Cited by 59 · see citing works
Wiesner, M., & Schanding, G. T. (2013) · Journal of School Psychology · doi:10.1016/j.jsp.2013.09.001 · Cited by 55 · see citing works
Ebesutani, C. K., Smith, A. M., Bernstein, A., Chorpita, B. F., Higa-McMillan, C. K., & Nakamura, B. J. (2011) · Psychological Assessment · doi:10.1037/a0023234 · Cited by 55 · see citing works
Olatunji, B. O., Ebesutani, C. K., Haidt, J., & Sawchuk, C. N. (2014) · Behavior Therapy · doi:10.1016/j.beth.2014.02.006 · Cited by 54 · see citing works
Yap, S. C. Y., Donnellan, M. B., Schwartz, S. J., Kim, S. Y., Castillo, L. G., Zamboanga, B. L., Weisskirch, R. S., Lee, R. M., Park, I. J. K., Whitbourne, S. K., et al. (2014) · Journal of Counseling Psychology · doi:10.1037/a0036253 · Cited by 52 · see citing works
Xie, J., Bi, Q., li, W., Shang, W., Yan, M., Yang, Y., Miao, D., & Zhang, H. (2012) · PLoS ONE · doi:10.1371/journal.pone.0047577 · Cited by 50 · see citing works
A psychometric examination of the Interpersonal Sexual Objectification Scale among college men.
Davidson, M. M., Gervais, S. J., Canivez, G. L., & Cole, B. P. (2013) · Journal of Counseling Psychology · doi:10.1037/a0032075 · Cited by 42 · see citing works
Yang, F. M., Tommet, D., & Jones, R. N. (2009) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2008.12.007 · Cited by 38 · see citing works
Yang, F. M., & Jones, R. N. (2008) · Psychosomatic Medicine · doi:10.1097/psy.0b013e31818ce4fa · Cited by 37 · see citing works
Gomez, R., Vance, A. L. A., & Gomez, R. M. (2013) · Journal of Attention Disorders · doi:10.1177/1087054713480034 · Cited by 35 · see citing works
Applying unidimensional item response theory models to psychological data.
Reise, S. P., Moore, T. M., & Haviland, M. G. (2013) · American Psychological Association eBooks · doi:10.1037/14047-006 · Cited by 35 · see citing works
Self-citationDimensionality Assessment Using the Full-Information Item Bifactor Analysis for Graded Response Data
Immekus, J. C., & Imbrie, P. K. (2008) · Educational and Psychological Measurement · doi:10.1177/0013164407313366 · Cited by 32 · see citing works
Stratton, K. J., Aggen, S. H., Richardson, L., Acierno, R. E., Kilpatrick, D. G., Gaboury, M. T., Tran, T. L., Trung, L. T., Tâm, N. T., Tran, T., et al. (2012) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2012.10.011 · Cited by 31 · see citing works
Gomez, R. (2012) · Personality and Individual Differences · doi:10.1016/j.paid.2012.11.025 · Cited by 31 · see citing works
A bifactor model of the Posttraumatic Growth Inventory
Thege, B. K., Kovács, É., & Balog, P. (2014) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2014.905208 · Cited by 30 · see citing works
Indeterminacy of Factor Score Estimates In Slightly Misspecified Confirmatory Factor Models
Beauducel, A. (2011) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1320120900 · Cited by 29 · see citing works
Further Evidence of the Reliability and Validity of the Multidimensional Anxiety
Osman, A., Williams, J. E., Espenschade, K., Gutierrez, P. M., Bailey, J., & Chowdhry, O. (2008) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-008-9095-z · Cited by 28 · see citing works
The Relationship Between Life Satisfaction and ADHD Symptoms in Middle School Students
Ogg, J. A., Bateman, L. P., Dedrick, R. F., & Suldo, S. M. (2014) · Journal of Attention Disorders · doi:10.1177/1087054714521292 · Cited by 26 · see citing works
The eACS: Attentional control in the presence of emotion
Barry, T. J., Hermans, D., Lenaert, B., Debeer, E., & Griffith, J. W. (2013) · Personality and Individual Differences · doi:10.1016/j.paid.2013.06.014 · Cited by 26 · see citing works
Psychometric Examination of the Interpersonal Sexual Objectification Scale Among College Men
Davidson, M. M., Gervais, S. J., Canivez, G. L., & Cole, B. P. (2013) · PsycEXTRA Dataset · doi:10.1037/e594022013-001 · Cited by 25 · see citing works
A Note on Assessing the Added Value of Subscores
Sinharay, S. (2013) · Educational Measurement Issues and Practice · doi:10.1111/emip.12021 · Cited by 23 · see citing works
Innamorati, M., Balsamo, M., Fairfield, B., Fabbricatore, M., Tamburello, A., & Saggino, A. (2014) · Depression Research and Treatment · doi:10.1155/2014/972424 · Cited by 19 · see citing works
A Bifactor Model of Disgust Proneness
Olatunji, B. O., Ebesutani, C. K., & Reise, S. P. (2014) · Assessment · doi:10.1177/1073191114541673 · Cited by 18 · see citing works
Self-citationCoco, A. L., Ingoglia, S., & Lundqvist, L. (2013) · Journal of Nonverbal Behavior · doi:10.1007/s10919-013-0166-9 · Cited by 17 · see citing works
Development and Validation of an Inventory for Measuring Student Attitudes Toward Calculus
Huang, Y., & Lin, S.-H. (2014) · Measurement and Evaluation in Counseling and Development · doi:10.1177/0748175614563314 · Cited by 16 · see citing works
ADHD bifactor model based on parent and teacher ratings of Malaysian children
Gomez, R. (2013) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2013.10.009 · Cited by 11 · see citing works
Zhang, J., Cui, M., Wang, W., Lu, H., Wu, Q., Zhu, X., Miao, D., Zhang, Y., Feng, X., & Xiao, W. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096451 · Cited by 11 · see citing works
Assessing Usual Seasonal Depression Symptoms: The Seasonality Assessment Form
Young, M. A., Hutman, P., Enggasser, J. L., & Meesters, Y. (2014) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-014-9440-3 · Cited by 9 · see citing works
The factor structure and composite reliability of the Profile of Emotional Distress
Hyland, P., Shevlin, M. E., Adamson, G., & Boduszek, D. (2013) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x13000214 · Cited by 8 · see citing works
A Bifactor Model of Anxiety Sensitivity: Analysis of the Anxiety Sensitivity Index-3
Ebesutani, C., McLeish, A. C., Luberto, C. M., Young, J., & Maack, D. J. (2013) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-013-9400-3 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Ferrando, P. J., & Lorenzo‐Seva, U. (2017) · Educational and Psychological Measurement · doi:10.1177/0013164417719308 · Cited by 588 · see citing works
Neff, K. D., Tóth-Király, I., Yarnell, L. M., Arimitsu, K., Castilho, P., Ghorbani, N., Guo, H. X., Hirsch, J. K., Hupfeld, J., Hutz, C. S., et al. (2019) · Psychological Assessment · doi:10.1037/pas0000629 · Cited by 397 · see citing works
Three Concerns With Applying a Bifactor Model as a Structure of Psychopathology
Bonifay, W. E., Lane, S. P., & Reise, S. P. (2016) · Clinical Psychological Science · doi:10.1177/2167702616657069 · Cited by 393 · see citing works
Self-citationZanon, C., Brenner, R. E., Baptista, M. N., Vogel, D. L., Rubin, M., Al-Darmaki, F. R., Gonçalves, M., Heath, P. J., Liao, H.-Y., Mackenzie, C. S., et al. (2020) · Assessment · doi:10.1177/1073191119887449 · Cited by 394 · see citing works
Twenty-five years with the 20-item Toronto Alexithymia Scale
Bagby, R. M., Parker, J. D. A., & Taylor, G. J. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2020.109940 · Cited by 334 · see citing works
The Development and Validation of the State Self-Compassion Scale (Long- and Short Form)
Neff, K. D., Tóth-Király, I., Knox, M. C., Kuchar, A., & Davidson, O. (2021) · Mindfulness · doi:10.1007/s12671-020-01505-4 · Cited by 309 · see citing works
Kleif, J., Waage, J., Christensen, K. B., & Gögenür, I. (2017) · British Journal of Anaesthesia · doi:10.1016/j.bja.2017.11.013 · Cited by 291 · see citing works
The reliability of multidimensional neuropsychological measures: from alpha to omega
Watkins, M. W. (2017) · The Clinical Neuropsychologist · doi:10.1080/13854046.2017.1317364 · Cited by 271 · see citing works
Perseverant grit and self-efficacy: Are both essential for children’s academic success?
Usher, E. L., Li, C. R., Butz, A. R., & Rojas, J. P. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000324 · Cited by 270 · see citing works
Two is more valid than one: Examining the factor structure of the Self-Compassion Scale (SCS).
Brenner, R. E., Heath, P. J., Vogel, D. L., & Credé, M. (2017) · Journal of Counseling Psychology · doi:10.1037/cou0000211 · Cited by 246 · see citing works
Disabato, D. J., Goodman, F. R., & Kashdan, T. B. (2018) · Journal of Personality · doi:10.1111/jopy.12382 · Cited by 232 · see citing works
Gignac, G. (2016) · Intelligence · doi:10.1016/j.intell.2016.01.006 · Cited by 214 · see citing works
Hammer, J. H., Parent, M. C., & Spiker, D. A. (2018) · Journal of Counseling Psychology · doi:10.1037/cou0000248 · Cited by 207 · see citing works
Decent work in Brazil: Context, conceptualization, and assessment
Ribeiro, M. A., Teixeira, M. A. P., & Ambiel, R. A. M. (2019) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2019.03.006 · Cited by 188 · see citing works
Development and Validation of the Self-Compassion Scale for Youth
Neff, K. D., Bluth, K., Tóth‐Király, I., Davidson, O., Knox, M. C., Williamson, Z. H., & Costigan, A. (2020) · Journal of Personality Assessment · doi:10.1080/00223891.2020.1729774 · Cited by 194 · see citing works
The CSS-12: development and validation of a short-form version of the cyberchondria severity scale
McElroy, E., Kearney, M., Touhey, J., Evans, J., Cooke, Y., & Shevlin, M. (2019) · Cyberpsychology Behavior and Social Networking · doi:10.1089/cyber.2018.0624 · Cited by 179 · see citing works
Decent work in France: Context, conceptualization, and assessment
Vignoli, E., Prudhomme, N., Terriot, K., Cohen‐Scali, V., Arnoux-Nicolas, C., Bernaud, J., & Lallemand, N. (2019) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2019.103345 · Cited by 175 · see citing works
Are fit indices used to test psychopathology structure biased? A simulation study
Greene, A. L., Eaton, N. R., Li, K., Forbes, M. K., Krueger, R. F., Markon, K. E., Waldman, I. D., Cicero, D. C., Conway, C. C., Docherty, A. R., et al. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000434 · Cited by 148 · see citing works
On the Complexity of Item Response Theory Models
Bonifay, W. E., & Cai, L. (2017) · Multivariate Behavioral Research · doi:10.1080/00273171.2017.1309262 · Cited by 152 · see citing works
Arias, V. B., Garrido, L. E., Jenaro, C., Martínez‐Molina, A., & Martínez, B. A. (2020) · Behavior Research Methods · doi:10.3758/s13428-020-01401-8 · Cited by 144 · see citing works
Stefana, A., Damiani, S., Granziol, U., Provenzani, U., Solmi, M., Youngstrom, E. A., & Fusar‐Poli, P. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1494261 · Cited by 197 · see citing works
Is Burnout a Depressive Condition? A 14-Sample Meta-Analytic and Bifactor Analytic Study
Bianchi, R., Verkuilen, J., Schonfeld, I. S., Hakanen, J., Jansson‐Fröjmark, M., García, G. M., Laurent, É., & Meier, L. L. (2021) · Clinical Psychological Science · doi:10.1177/2167702620979597 · Cited by 142 · see citing works
McElroy, E., Belsky, J., Carragher, N., Fearon, P. R. M., & Patalay, P. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12849 · Cited by 130 · see citing works
Selecting the “Best” Factor Structure and Moving Measurement Validation Forward: An Illustration
Schmitt, T. A., Sass, D. A., Chappelle, W. L., & Thompson, W. T. (2018) · Journal of Personality Assessment · doi:10.1080/00223891.2018.1449116 · Cited by 134 · see citing works
Cuesta‐Vargas, A., Neblett, R., Chiarotto, A., Kregel, J., Nijs, J., van Wilgen, C. P., Pitance, L., Knežević, A., Gatchel, R. J., Mayer, T. G., et al. (2017) · Journal of Pain · doi:10.1016/j.jpain.2017.11.006 · Cited by 129 · see citing works
Reis, D., Lehr, D., Heber, E., & Ebert, D. D. (2019) · Assessment · doi:10.1177/1073191117715731 · Cited by 127 · see citing works
The central sensitization inventory: A user’s manual
Neblett, R. (2018) · Journal of Applied Biobehavioral Research · doi:10.1111/jabr.12123 · Cited by 125 · see citing works
Dunn, K., & McCray, G. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01357 · Cited by 116 · see citing works
At what sample size do latent variable correlations stabilize?
Kretzschmar, A., & Gignac, G. E. (2019) · Journal of Research in Personality · doi:10.1016/j.jrp.2019.03.007 · Cited by 112 · see citing works
Is the PHQ-9 a unidimensional measure of depression? A 58,272-participant study.
Bianchi, R., Verkuilen, J., Toker, S., Schonfeld, I. S., Gerber, M., Brähler, E., & Kroenke, K. (2022) · Psychological Assessment · doi:10.1037/pas0001124 · Cited by 112 · see citing works
Revisiting the Structure of the Short Dark Triad
Persson, B. N., Kajonius, P., & Garcia, D. (2017) · Assessment · doi:10.1177/1073191117701192 · Cited by 111 · see citing works
Swami, V., Todd, J., & Barron, D. S. (2021) · Body Image · doi:10.1016/j.bodyim.2021.03.002 · Cited by 104 · see citing works
Working memory and short-term memory deficits in ADHD: A bifactor modeling approach
Kofler, M. J., Singh, L. J., Soto, E. F., Chan, E. S. M., Miller, C. E., Harmon, S. L., & Spiegel, J. A. (2020) · Neuropsychology · doi:10.1037/neu0000641 · Cited by 101 · see citing works
“…reliability of the general factor (working memory) and specific factors (phonological and visuospatial short-term memory) by providing estimates of the proportion of variance attributable to sources of common and specific variance, respectively; values >.70 are preferred (Rodriguez et al., 2016b).”
BackgroundQuattrone, D., Forti, M. D., Gayer-Anderson, C. E., Ferraro, L., Jongsma, H. E., Tripoli, G., Cascia, C. L., Barbera, D. L., Tarricone, I., Berardi, D., et al. (2018) · Psychological Medicine · doi:10.1017/s0033291718002131 · Cited by 99 · see citing works
Determinants of financial worry and rumination
de Bruijn, E.-J., & Antonides, G. (2020) · Journal of Economic Psychology · doi:10.1016/j.joep.2019.102233 · Cited by 102 · see citing works
Mol, M., van Schaik, A., Dozeman, E., Ruwaard, J., Vis, C., Ebert, D. D., Etzelmueller, A., Mathiasen, K., Moles, B., Mora, T., et al. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02627-8 · Cited by 92 · see citing works
Structural validation of the Self-Compassion Scale with a German general population sample
Coroiu, A., Kwakkenbos, L., Moran, C., Thombs, B., Albani, C., Bourkas, S., Zenger, M., Brähler, E., & Körner, A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0190771 · Cited by 90 · see citing works
Ray, J. V., & Frick, P. (2018) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2018.1504297 · Cited by 89 · see citing works
Are the PHQ-9 and GAD-7 Suitable for Use in India? A Psychometric Analysis
Man, J. D., Absetz, P., Sathish, T., Desloge, A., Haregu, T., Oldenburg, B. F., Johnson, L. C. M., Thankappan, K. R., & Williams, E. D. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.676398 · Cited by 99 · see citing works
Osborne, T. L., Michonski, J., Sayrs, J. H. R., Welch, S., & Anderson, L. K. (2017) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-017-9586-x · Cited by 99 · see citing works
Developing and Validating Clinical Questionnaires
Rosellini, A. J., & Brown, T. A. (2021) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-081219-115343 · Cited by 102 · see citing works
Psychometric Evaluation of the Short Sensory Profile in Youth with Autism Spectrum Disorder
Williams, Z. J., Failla, M. D., Gotham, K. O., Woynaroski, T. G., & Cascio, C. J. (2018) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-018-3678-7 · Cited by 96 · see citing works
Mansolf, M. A., & Reise, S. P. (2016) · Multivariate Behavioral Research · doi:10.1080/00273171.2016.1215898 · Cited by 91 · see citing works
Self-citationChen, I., Chen, C., Liao, X.-L., Chen, X.-M., Zheng, X., Tsai, Y., Lin, C., Griffiths, M. D., & Pakpour, A. H. (2023) · Acta Psychologica · doi:10.1016/j.actpsy.2023.104042 · Cited by 97 · see citing works
Quattrone, D., Ferraro, L., Tripoli, G., Cascia, C. L., Quigley, H., Quattrone, A., Jongsma, H. E., del Peschio, S., Gatto, G., EU-GEI group, et al. (2020) · Psychological Medicine · doi:10.1017/s0033291720000082 · Cited by 89 · see citing works
Forbes, M. K., Greene, A. L., Levin-Aspenson, H. F., Watts, A. L., Hallquist, M. N., Lahey, B. B., Markon, K. E., Patrick, C. J., Tackett, J. L., Waldman, I. D., et al. (2021) · Journal of Abnormal Psychology · doi:10.1037/abn0000533 · Cited by 89 · see citing works
Evaluating the psychometric properties of the Social Identity Questionnaire for Sport (SIQS)
Bruner, M. W., & Benson, A. J. (2017) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2017.12.006 · Cited by 90 · see citing works
Transcultural Adaptation of the Oldenburg Burnout Inventory (OLBI) for Brazil and Portugal
Sinval, J., Queirós, C. M. L., Pasian, S. R., & Marôco, J. P. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00338 · Cited by 89 · see citing works
Hystad, S. W., & Johnsen, B. H. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01300 · Cited by 86 · see citing works
Measuring Depression in Autistic Adults: Psychometric Validation of the Beck Depression Inventory–II
Williams, Z. J., Everaert, J., & Gotham, K. O. (2020) · Assessment · doi:10.1177/1073191120952889 · Cited by 84 · see citing works
Evaluating dimensional distinctness with correlated-factor models: Limitations and suggestions
Gignac, G. E., & Kretzschmar, A. (2017) · Intelligence · doi:10.1016/j.intell.2017.04.001 · Cited by 81 · see citing works
Oltmanns, J. R., & Widiger, T. A. (2018) · Psychological Assessment · doi:10.1037/pas0000616 · Cited by 82 · see citing works
Building Theories on Top of, and Not Independent of, Statistical Models: The Case of the p-factor
Watts, A. L., Lane, S. P., Bonifay, W. E., Steinley, D., & Meyer, F. A. C. (2020) · Psychological Inquiry · doi:10.1080/1047840x.2020.1853476 · Cited by 82 · see citing works
The Positive Valence Systems Scale: Development and Validation
Khazanov, G. K., Ruscio, A. M., & Forbes, C. N. (2019) · Assessment · doi:10.1177/1073191119869836 · Cited by 76 · see citing works
Saulnier, K. G., Allan, N. P., Raines, A. M., & Schmidt, N. B. (2019) · Psychiatry · doi:10.1080/00332747.2018.1560583 · Cited by 75 · see citing works
Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020) · Current Psychology · doi:10.1007/s12144-019-00602-5 · Cited by 77 · see citing works
Halamová, J., Kanovský, M., Gilbert, P., Troop, N. A., Zuroff, D. C., Hermanto, N., Petrocchi, N., Sommers‐Spijkerman, M., Kirby, J. N., Shahar, B., et al. (2018) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-018-9686-2 · Cited by 79 · see citing works
Burnout: Redefining its key symptoms
Tavella, G., Hadži-Pavlović, D., & Parker, G. B. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114023 · Cited by 79 · see citing works
Development and evaluation of the Internalized Racism in Asian Americans Scale (IRAAS)
Choi, A. Y., Israel, T., & Maeda, H. (2017) · Journal of Counseling Psychology · doi:10.1037/cou0000183 · Cited by 70 · see citing works
Investigating the genetic architecture of general and specific psychopathology in adolescence
Jones, H. J., Heron, J., Hammerton, G., Stochl, J., Jones, P. B., Cannon, M., Smith, G. D., Holmans, P., Lewis, G., Linden, D. E. J., et al. (2018) · Translational Psychiatry · doi:10.1038/s41398-018-0204-9 · Cited by 59 · see citing works
McEvoy, P. M., Hyett, M. P., Ehring, T. W., Johnson, S. L., Samtani, S., Anderson, R., & Moulds, M. L. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.02.072 · Cited by 69 · see citing works
Factor structure models of the SCL-90-R: Replicability across community samples of adolescents
Preti, A., Carta, M. G., & Петретто, Д. Р. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.12.146 · Cited by 68 · see citing works
What Is the General Factor of Psychopathology? Consistency of the p Factor Across Samples
Levin-Aspenson, H. F., Watson, D., Clark, L. A., & Zimmerman, M. A. (2020) · Assessment · doi:10.1177/1073191120954921 · Cited by 69 · see citing works
Laconi, S., Urbán, R., Kaliszewska-Czeremska, K., Kuss, D. J., Gnisci, A., Sergi, I., Barke, A., Jeromin, F., Groth, J., Gámez‐Guadix, M., et al. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00136 · Cited by 71 · see citing works
Boateng, G. O., Collins, S. M., Mbullo, P., Wekesa, P., Onono, M., Neilands, T. B., & Young, S. L. (2018) · PLoS ONE · doi:10.1371/journal.pone.0198591 · Cited by 68 · see citing works
Veneziani, C. A., Fuochi, G., & Voci, A. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2017.06.028 · Cited by 64 · see citing works
Sample Size Requirements for Bifactor Models
Bader, M., Jobst, L. J., & Moshagen, M. (2022) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2021.2019587 · Cited by 62 · see citing works
A five‐sample confirmatory factor analytic study of burnout‐depression overlap
Bianchi, R., Schonfeld, I. S., & Verkuilen, J. (2020) · Journal of Clinical Psychology · doi:10.1002/jclp.22927 · Cited by 60 · see citing works
Williams, Z. J., Cascio, C. J., & Woynaroski, T. G. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.897901 · Cited by 62 · see citing works
Smout, M. (2018) · Australian Psychologist · doi:10.1111/ap.12376 · Cited by 57 · see citing works
Wang, Y., Li, Y., Xiao, W., Fu, Y., & Jie, J. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01086 · Cited by 56 · see citing works
Lloyd, M., Sugden, N. A., Thomas, M., McGrath, A., & Skilbeck, C. E. (2023) · British Journal of Psychology · doi:10.1111/bjop.12637 · Cited by 55 · see citing works
University student engagement inventory (USEI): Psychometric properties
Sinval, J., Casanova, J. R., Marôco, J. P., & Almeida, L. S. (2018) · Current Psychology · doi:10.1007/s12144-018-0082-6 · Cited by 55 · see citing works
Teymoori, A., Gorbunova, A., Haghish, E. F., Real, R. G. L., Zeldovich, M., Wu, Y.-J., Polinder, S., Asendorf, T., Menon, D. K., & von Steinbüchel, N. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9030873 · Cited by 56 · see citing works
Is Burnout Primarily Linked to Work-Situated Factors? A Relative Weight Analytic Study
Bianchi, R., García, G. M., & Rolland, J. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.623912 · Cited by 60 · see citing works
Assessment of Fear of COVID-19 in Older Adults: Validation of the Fear of COVID-19 Scale
Caycho‐Rodríguez, T., Tomás, J. M., Barboza-Palomino, M., Ventura‐León, J., Gallegos, M., Reyes-Bossio, M. A., & Vilca, L. W. (2021) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-020-00438-2 · Cited by 53 · see citing works
Sánchez, J., Estrada‐Hernández, N., Booth, J., & Pan, D. (2021) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.12336 · Cited by 60 · see citing works
Using Genetics to Examine a General Liability to Childhood Psychopathology
Riglin, L., Thapar, A. K., Leppert, B., Martin, J., Richards, A. L., Anney, R., Smith, G. D., Tilling, K. M., Stergiakouli, E., Lahey, B. B., et al. (2019) · Behavior Genetics · doi:10.1007/s10519-019-09985-4 · Cited by 53 · see citing works
Pokropek, A., Marks, G., & Borgonovi, F. (2021) · Journal of Educational Psychology · doi:10.1037/edu0000687 · Cited by 50 · see citing works
Bianchi, R. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2020.109954 · Cited by 50 · see citing works
Mialhe, F. L., Moraes, K. L., Bado, F. M. R., Brasil, V. V., Sampaio, H. A. D. C., & Rebustini, F. (2021) · Revista Latino-Americana de Enfermagem · doi:10.1590/1518-8345.4362.3436 · Cited by 50 · see citing works
Neff, K. D., & Tóth‐Király, I. (2022) · Springer eBooks · doi:10.1007/978-3-030-77644-2_36-1 · Cited by 56 · see citing works
Bader, M., Hilbig, B. E., Zettler, I., & Moshagen, M. (2022) · Journal of Personality · doi:10.1111/jopy.12785 · Cited by 50 · see citing works
Gu, H., Wen, Z., & Fan, X. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2016.09.042 · Cited by 50 · see citing works
Feliu-Soler, A., Reche-Camba, E., Borràs, X., Pérez-Aranda, A., Andrés-Rodríguez, L., Peñarrubia-María, M. T., Navarro-Gil, M., García-Campayo, J., Bellón, J. A., & Luciano, J. V. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.02075 · Cited by 49 · see citing works
Watkins, M. W., Dombrowski, S. C., & Canivez, G. L. (2017) · International Journal of School & Educational Psychology · doi:10.1080/21683603.2017.1342580 · Cited by 49 · see citing works
Tiego, J., Oostermeijer, S., Prochazkova, L., Parkes, L., Dawson, A., Youssef, G. J., Oldenhof, E., Carter, A., Segrave, R. A., Fontenelle, L. F., et al. (2018) · CNS Spectrums · doi:10.1017/s1092852918001244 · Cited by 49 · see citing works
Yao, N., Qian, M., Jiang, Y., & Elhai, J. D. (2021) · Journal of Personality Assessment · doi:10.1080/00223891.2020.1739058 · Cited by 44 · see citing works
Greene, A. L., Watts, A. L., Forbes, M. K., Kotov, R., Krueger, R. F., & Eaton, N. R. (2022) · Psychological Methods · doi:10.1037/met0000465 · Cited by 47 · see citing works
Cross-Cultural Validation of the Turkish Version of the Decent Work Scale
Işık, E., Kozan, S., & Işık, A. N. (2018) · Journal of Career Assessment · doi:10.1177/1069072718763636 · Cited by 47 · see citing works
Poli, A., Maremmani, A. G. I., Chiorri, C., Mazzoni, G. P., Orrù, G., Kołacz, J., Porges, S. W., Conversano, C., Gemignani, A., & Miccoli, M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18073835 · Cited by 55 · see citing works
Joshanloo, M., & Jovanović, V. (2016) · Journal of Mental Health · doi:10.1080/09638237.2016.1222058 · Cited by 46 · see citing works
Canivez, G. L., Watkins, M. W., & McGill, R. J. (2018) · British Journal of Educational Psychology · doi:10.1111/bjep.12230 · Cited by 46 · see citing works
A bifactor analysis of the Weight Bias Internalization Scale: What are we really measuring?
Meadows, A., & Higgs, S. (2020) · Body Image · doi:10.1016/j.bodyim.2020.02.013 · Cited by 46 · see citing works
In search of cross-cultural competence: A comprehensive review of five measurement instruments
Chen, X., & Gabrenya, W. K. (2021) · International Journal of Intercultural Relations · doi:10.1016/j.ijintrel.2021.02.003 · Cited by 46 · see citing works
Grygiel, P., Humenny, G., & Rębisz, S. (2019) · Assessment · doi:10.1177/1073191116682298 · Cited by 44 · see citing works
Joshanloo, M., Jose, P. E., & Kielpikowski, M. (2016) · Journal of Happiness Studies · doi:10.1007/s10902-016-9767-4 · Cited by 45 · see citing works
Kern, M. L., Zeng, G., Hou, H., & Peng, K. (2018) · Journal of Psychoeducational Assessment · doi:10.1177/0734282918789561 · Cited by 52 · see citing works
Williams, Z. J., & Gotham, K. O. (2021) · Molecular Autism · doi:10.1186/s13229-021-00463-5 · Cited by 44 · see citing works
A Bifactor Approach to Model Multifaceted Constructs in Statistical Mediation Analysis
González, O., & MacKinnon, D. P. (2016) · Educational and Psychological Measurement · doi:10.1177/0013164416673689 · Cited by 44 · see citing works
- Authors
- Rodriguez, A., Reise, S. P., & Haviland, M. G.
- Affiliations
- University of California, Los Angeles (US)
- Loma Linda University (US)
- Corresponding author
- Reise, Steven P.
- Venue
- Journal of Personality Assessment
- Publisher
- Informa UK Limited
- Published
- 2015-10-29
- Volume
- 98
- Issue
- 3
- Pages
- 223-237
- ISSN
- 0022-3891 (ISSN-L)
- 1532-7752
- OpenAlex
- W1881923603
- Cited by
- 990
- References
- 77
- Citations by year
- 2026: 105 · 2025: 97 · 2024: 104 · 2023: 134 · 2022: 127 · 2021: 124 · 2020: 102 · 2019: 75 · 2018: 59 · 2017: 49 · 2016: 13
- FWCI
- 50.26
- Type
- journal article
- Language
- en
- Update notices
- correction (2015-12-23)
- Open access
- closed
- Locations
- Journal of Personality Assessment (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- bifactor model, multidimensional measure, personality assessment, psychopathology assessment
- MeSH terms
- Factor Analysis, Statistical, Humans, Models, Psychological, Psychometrics, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review