The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
How Performing PCA and CFA on the Same Data Equals Trouble: Overfitting in the Assessment of Internal Structure and Some Editorial Thoughts on It
Open accessAbstract
We regularly receive papers at EJPA where a principal component analysis (PCA) or an exploratory factor analysis (EFA) 1 is performed, followed by a confirmatory factor analysis (CFA) on the same (or partially overlapping) data.On the one hand, we are thankful for these submissions as they simplify the often tedious editorial task, by providing good grounds for on-desk rejection (see also Greiff & Ziegler, 2017).But when such grounds for rejection are all too regularly employed, they may instill a feeling of unease in the editor: Am I turning into a sour, nitpicking bureaucrat?Am I too strict and stuck with my own ideas of what good science is? Can we not let the data speak for itself?To confront such feelings of unease, we wanted to see whether the consequences of performing PCA and CFA on the same dataset are indeed so dire and justify rejection.To this end, we ran an experiment with simulated data and would like to share the results in this editorial.With the results of the simulation in mind, we will give some editorial advice on how authors can avoid trouble coming along with combining PCA and CFA.The R code and output for the experiment are provided in the online supplementary material.1 We fully agree with readers who take offense in the confusion of principal component analysis and exploratory factor analysis.The two are different techniques, involving different assumptions, estimation methods, and different interpretations of the results.We will discuss the differences in the section ''Some Nitpicking All the Same.''
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Scree Test For The Number Of Factors
Cattell, R. B. (1966) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr0102_10 · Cited by 13,554
Babyak, M. A. (2004) · Psychosomatic Medicine · doi:10.1097/01.psy.0000127692.23278.a9 · Cited by 2,061
Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning
Yarkoni, T., & Westfall, J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617693393 · Cited by 1,916
On the nature and direction of relationships between constructs and measures.
Edwards, J. R., & Bagozzi, R. P. (2000) · Psychological Methods · doi:10.1037//1082-989x.5.2.155 · Cited by 1,745
Why Psychological Assessment Needs to Start Worrying About Model Fit
Greiff, S., & Heene, M. (2017) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000450 · Cited by 132
Self-citationStaehelin, B. (1974) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.1974.tb70778.x · Cited by 48
Cited by
Swami, V., & Barron, D. (2019) · Body Image · doi:10.1016/j.bodyim.2018.08.014 · Cited by 454
Jamovi: An Easy to Use Statistical Software for the Social Scientists
ŞAHİN, M., & AYBEK, E. (2020) · International Journal of Assessment Tools in Education · doi:10.21449/ijate.661803 · Cited by 388
The Very Efficient Assessment of Need for Cognition: Developing a Six-Item Version
Lins de Holanda Coelho, G., H. P. Hanel, P., & J. Wolf, L. (2020) · Assessment · doi:10.1177/1073191118793208 · Cited by 358
Knollmann, M., Reissner, V., & Hebebrand, J. (2019) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-018-1204-2 · Cited by 66
Türkarslan, K. K., Kozak, E. D., & Yıldırım, J. C. (2023) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2023.102147 · Cited by 35
Metadata
- Authors
- Fokkema, M., & Greiff, S.
- Venue
- European Journal of Psychological Assessment
- Publisher
- Hogrefe Publishing Group
- Published
- 2017-11
- Volume
- 33
- Issue
- 6
- Pages
- 399-402
- ISSN
- 1015-5759 (ISSN-L)
- 2151-2426
- OpenAlex
- W2772491505
- Cited by
- 309
- References
- 6
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How Performing PCA and CFA on the Same Data Equals Trouble: Overfitting in the Assessment of Internal Structure and Some Editorial Thoughts on It. https://app.cochat.ai/papers/10.1027/1015-5759/a000460
- The paper
- Fokkema, M., & Greiff, S. (2017). How Performing PCA and CFA on the Same Data Equals Trouble: Overfitting in the Assessment of Internal Structure and Some Editorial Thoughts on It. European Journal of Psychological Assessment. https://doi.org/10.1027/1015-5759/a000460
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.