The Psychometric Costs of Applicants' Faking: Examining Measurement Invariance and Retest Correlations Across Response Conditions
Open accessThe DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Abstract
This study examines the stability of the response process and the rank-order of respondents responding to 3 personality scales in 4 different response conditions. Applicants to the University College of Teacher Education Styria (N = 243) completed personality scales as part of their college admission process. Half a year later, they retook the same personality scales in 1 of 3 randomly assigned experimental response conditions: honest, faking-good, or reproduce. Longitudinal means and covariance structure analyses showed that applicants' response processes could be partially reproduced after half a year, and respondents seemed to rely on an honest response behavior as a frame of reference. Additionally, applicants' faking behavior and instructed faking (faking-good) caused differences in the latent retest correlations and consistently affected measurement properties. The varying latent retest correlations indicated that faking can distort respondents' rank-order and thus the fairness of subsequent selection decisions, depending on the kind of faking behavior. Instructed faking (faking-good) even affected weak measurement invariance, whereas applicants' faking behavior did not. Consequently, correlations with personality scales-which can be utilized for predictive validity-may be readily interpreted for applicants. Faking behavior also introduced a uniform bias, implying that the classically observed mean raw score differences may not be readily interpreted.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, a study found that teacher education students’ responses to personality questionnaires were different before the application stage of the program and 6 months afterwards, indicating that they had potentially altered their personality responses to reflect socially desirable responses (Krammer et al. 2017).”
From A meta-analysis of the effects of teacher personality on teacher effectiveness and burnout (2019) · cites this paper as Krammer et al. 2017
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · cited 1×
“…goodness-of-fit statistics: nonsignificant x2 statistic, root mean square error of approximation (RMSEA) < .06, and comparative fit index (CFI) .95 (Hu & Bentler, 1999; Marsh, Hau, & Wen, 2004).1 Each model fit was also compared to its less restrictive precursor using the following criteria:…”
Methodlavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955 · cited 1×
“All calculations were carried out in R (R Core Team, 2015) using the lavaan package (Rosseel, 2012).”
MethodEvaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280 · cited 3×
“This implies that mean score differences do not only reflect mean individual differences, but also measurement bias (cf. Chen, 2008; Cheung & Rensvold, 2002; Li & Zumbo, 2009; Millsap, 2011).”
BackgroundVandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997 · cited 3×
“Consequently, scores of incumbents and applicants could not be directly compared in a meaningful way (e.g., Cheung & Rensvold, 2002; Millsap, 2011; Mislevy et al., 2013; Vandenberg & Lance, 2000).”
BackgroundMarsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691
Curran, P. J., West, S. G., & Finch, J. F. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.16 · Cited by 5,512
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536 · cited 1×
“If any of these equality constraints failed to fit the data, constraints were successively relaxed, and the models again compared (cf. Meredith, 1993; Vandenberg & Lance, 2000).”
BackgroundCorrections to test statistics and standard errors in covariance structure analysis.
Satorra, A., & Bentler, P. M. (1994) · Cited by 2,529
Power and sensitivity of alternative fit indices in tests of measurement invariance.
Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.3.568 · Cited by 1,668 · cited 1×
“Studies suggest the SRMR is influenced by the sample size, and advise against using DSRMR for measurement invariance analysis (e.g., Meade et al., 2008).”
MethodStatistical Approaches to Measurement Invariance
Millsap, R. E. (2012) · doi:10.4324/9780203821961 · Cited by 1,554
Research works printed but not linked: 11
- Arendasy, M., Sommer, M., & Feldhammer, M. (2011). Manual: Big Five Structure Inventory (BFSI). Mödling, Austria: Schuhfried.
- Bortz, J., & Döring, N. (2006). Forschungsmethoden und Evaluationfür Human- und Sozialwissenschaftler [Research methods and evaluation for the social sciences] (4th rev. ed.). Heidelberg, Germany: Springer.
- Costa, P. T., & McCrae, R. R. (1992). Neo PI–R professional manual. Odessa FL: Psychological Assessment Resources.
- 10.1037/0021-9010.84.2.155 · doi:10.1037/0021-9010.84.2.155 · Paper page
- Hogan, R. (1992). Hogan Personality Inventory manual (3rd ed.). Tulsa, OK: Hogan Assessment Systems.
- Mayr, J. (2011). Der Persönlichkeitsansatz der Lehrerforschung. [The personality approach to research in the field of teaching.] In E. Terhart, H. Bennewitz & M. Rothland (Eds.), Handbuch der Forschung zum Lehrerberuf [A research guide to the teaching profession] (pp. 125–148). Münster, Germany: Waxmann.
- Mayr, J., & Brandstätter, H. (1998). Lehrer/in werden? [Becoming a teacher?] Wien, Germany: Bundesministerium für Unterricht und kulturelle Angelegenheiten.
- 10.1037/0021-9010.83.4.634 · doi:10.1037/0021-9010.83.4.634 · Paper page
- Schaarschmidt, U., & Fischer, A. (2013). Manual Inventar zur Persönlichkeitsdiagnostik in Situationen [Inventory for personality assessment in situations] (Version 21—Revision 2). Mödling, Austria: SCHUHFRIED GmbH.
- 10.1037/0021-9010.84.4.551 · doi:10.1037/0021-9010.84.4.551 · Paper page
- Ziegler, M. (2011). Applicant faking: A look into the black box. The Industrial-Organizational Psychologist, 49, 29–36.
Cited by
A meta-analysis of the effects of teacher personality on teacher effectiveness and burnout
Kim, L. E., Jörg, V., & Klassen, R. M. (2019) · Educational Psychology Review · doi:10.1007/s10648-018-9458-2 · Cited by 406
“For example, a study found that teacher education students’ responses to personality questionnaires were different before the application stage of the program and 6 months afterwards, indicating that they had potentially altered their personality responses to reflect socially desirable responses (Krammer et al. 2017).”
Faking by actual applicants on personality tests: A meta‐analysis of within‐subjects studies
Hu, J., & Connelly, B. S. (2021) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12338 · Cited by 74
Schermer, J. A., Krammer, G., & Goffin, R. D. (2018) · Personality and Individual Differences · doi:10.1016/j.paid.2018.08.023 · Cited by 53
Self-citationBuehl, A., Melchers, K. G., Macan, T. M., & Kühnel, J. (2018) · Journal of Business and Psychology · doi:10.1007/s10869-018-9531-3 · Cited by 56
“This was also confirmed in a recent study by Krammer, Sommer, and Arendasy (2017) who found that individuals faked much more in an instructed fake-good condition then in a real selection situation in which they had completed the same personality scale earlier.”
ResultWilliams, M. M., Rogers, R., Sharf, A. J., & Ross, C. A. (2018) · Journal of Personality Assessment · doi:10.1080/00223891.2018.1455691 · Cited by 50
Metadata
- Authors
- Krammer, G., Sommer, M., & Arendasy, M. E.
- Affiliations
- University of Graz (AT)
- Corresponding author
- Krammer, Georg
- Venue
- Journal of Personality Assessment
- Publisher
- Informa UK Limited
- Published
- 2017-03-16
- Volume
- 99
- Issue
- 5
- Pages
- 510-523
- ISSN
- 0022-3891 (ISSN-L)
- 1532-7752
- OpenAlex
- W2597044433
- Cited by
- 25
- References
- 66
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 4 · 2023: 3 · 2022: 1 · 2021: 2 · 2020: 2 · 2019: 6 · 2018: 5
- FWCI
- 3.14
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Personality Assessment (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Psychology › Clinical Psychology › Personality Traits and Psychology
- Keywords
- faking, measurement invariance, personality scales, university admission, fairness in selection, predictive validity, longitudinal stability
- MeSH terms
- Adolescent, Adult, Female, Humans, Deception, Male, Personality, Personality Inventory, Psychometrics, Students, Universities, Reproducibility of Results, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Psychometric Costs of Applicants' Faking: Examining Measurement Invariance and Retest Correlations Across Response Conditions. https://app.cochat.ai/papers/10.1080/00223891.2017.1285781
- The paper
- Krammer, G., Sommer, M., & Arendasy, M. E. (2017). The Psychometric Costs of Applicants' Faking: Examining Measurement Invariance and Retest Correlations Across Response Conditions. Journal of Personality Assessment. https://doi.org/10.1080/00223891.2017.1285781
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.