Assessing Personality States: What to Consider when Constructing Personality State Measures
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Repeated assessments of personality states in daily diary or experience sampling studies have become a more and more common tool in the psychologist's toolbox. However, and contrary to the widely available literature on personality traits, no best practices for the development of personality state measures exist, and personality state measures have been developed in many different ways. To address this, we first define what a personality state is and discuss important components. On the basis of this, we define what a personality state measure is and suggest a general guideline for the development of such measures. Following the ABC of test construction can then guide the strategy for obtaining validity and reliability evidence: (A) What is the construct being measured? (B) What is the intended purpose of the measure? And (C) What is the targeted population of persons and situations? We then conclude with an example by developing an initial item pool for the assessment of conscientiousness personality states. © 2020 The Authors. European Journal of Personality published by John Wiley & Sons Ltd on behalf of European Association of Personality Psychology
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The critical incident technique.
Flanagan, J. C. (1954) · Psychological Bulletin · doi:10.1037/h0061470 · Cited by 8,191 · cited 1×
“The critical incident technique is described as a ‘procedure for gathering certain important facts concerning behavior in defined situations’ (Flanagan, 1954, p. 9).”
MethodThe proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
The development of markers for the Big-Five factor structure
Goldberg, L. R. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.26 · Cited by 5,530
Mischel, W., & Shoda, Y. (1995) · Psychological Review · doi:10.1037/0033-295x.102.2.246 · Cited by 3,889
Roberts, B. W., Walton, K. E., & Viechtbauer, W. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.1.1 · Cited by 3,318
Uses and abuses of coefficient alpha
Schmitt, N. (1996) · Psychological Assessment · doi:10.1037/1040-3590.8.4.350 · Cited by 2,588
A wandering mind is an unhappy mind
Killingsworth, M. A., & Gilbert, D. T. (2010) · Science · doi:10.1126/science.1192439 · Cited by 2,575
A personality trait-based interactionist model of job performance
Tett, R. P., & Burnett, D. D. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.3.500 · Cited by 2,241 · cited 2×
“34: 1037–1059 (2020) DOI: 10.1002/per this situation; that is, the situation must be relevant to the expression of the trait (Tett & Burnett, 2003; Tett & Guterman, 2000).”
BackgroundInfluentialSoto, C. J., & John, O. P. (2017) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000096 · Cited by 2,075 · cited 2×
“For example, the BFI-2 (Soto & John, 2017) contains items such as ‘Tends to be disorganized’ (reverse coded), ‘Tends to be lazy’ (reverse coded), or ‘Is dependable, steady’ (Soto & John, 2017, p. 142).”
BackgroundBetween facets and domains: 10 aspects of the Big Five.
DeYoung, C. G., Quilty, L. C., & Peterson, J. B. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.93.5.880 · Cited by 1,920
Belief and feeling: Evidence for an accessibility model of emotional self-report.
Robinson, M. D., & Clore, G. L. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.6.934 · Cited by 1,806
Bogg, T., & Roberts, B. W. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.6.887 · Cited by 1,632
Weinstein, N., & Ryan, R. M. (2010) · Journal of Personality and Social Psychology · doi:10.1037/a0016984 · Cited by 1,484
Fleeson, W. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.80.6.1011 · Cited by 1,436 · cited 7×
“For example, whole trait theory (Fleeson, 2001) postulates that, on the descriptive side, states, repeatedly assessed within one person, should form density distributions of behaviour and that the average personality state should therefore, roughly, correspond to the personality trait of that…”
BackgroundInfluentialThe NPI-16 as a short measure of narcissism.
Ames, D. R., Rose, P., & Anderson, C. P. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.03.002 · Cited by 1,349
Emotional experience improves with age: Evidence based on over 10 years of experience sampling
Carstensen, L. L., Turan, B., Scheibe, S., Ram, N., Ersner-Hershfield, H., Samanez-Larkin, G. R., Brooks, K. P., & Nesselroade, J. R. (2011) · Psychology and Aging · doi:10.1037/a0021285 · Cited by 1,223
Personality Trait Change in Adulthood
Roberts, B. W., & Mroczek, D. (2008) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2008.00543.x · Cited by 1,222
Hektner, J., Schmidt, J., & Csikszentmihalyi, M. (2007) · doi:10.4135/9781412984201 · Cited by 1,174
Lack of group-to-individual generalizability is a threat to human subjects research
Fisher, A. J., Medaglia, J. D., & Jeronimus, B. F. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1711978115 · Cited by 1,099
Personality and susceptibility to positive and negative emotional states.
Larsen, R. J., & Ketelaar, T. (1991) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.61.1.132 · Cited by 1,062
DeYoung, C. G. (2015) · Journal of Research in Personality · doi:10.1016/j.jrp.2014.07.004 · Cited by 1,057
Everyday temptations: an experience sampling study of desire, conflict, and self-control
Hofmann, W., Baumeister, R. F., Förster, G., & Vohs, K. D. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0026545 · Cited by 986
Fleeson, W., & Jayawickreme, E. (2015) · Journal of Research in Personality · doi:10.1016/j.jrp.2014.10.009 · Cited by 839 · cited 6×
“One of its central claims is that ‘traits can be conceptualized as density distributions of states’ (Fleeson & Jayawickreme, 2015, p. 82).”
BackgroundMethodInfluentialROBERTS, B. W., CHERNYSHENKO, O. S., STARK, S., & GOLDBERG, L. R. (2005) · Personnel Psychology · doi:10.1111/j.1744-6570.2005.00301.x · Cited by 786
Group Size, ICC Values, and Group-Level Correlations: A Simulation
Bliese, P. D. (1998) · Organizational Research Methods · doi:10.1177/109442819814001 · Cited by 636
Processes of Personality Development in Adulthood: The TESSERA Framework
Wrzus, C., & Roberts, B. W. (2017) · Personality and Social Psychology Review · doi:10.1177/1088868316652279 · Cited by 559 · cited 2×
“First, the measure could be put to use in a purely scientific context, that is, for the examination and testing of personality theories, such as hypotheses derived from whole trait theory (Fleeson & Jayawickreme, 2015; Jayawickreme et al., 2019) or the TESSERA framework (Wrzus & Roberts, 2017).”
BackgroundMethodEpisodic and semantic knowledge in emotional self-report: Evidence for two judgment processes.
Robinson, M. D., & Clore, G. L. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.83.1.198 · Cited by 531 · cited 1×
“On the other hand, an item could be too broad; in both cases, one is more likely to assess the person’s trait-like tendencies compared with their state-like tendencies (Robinson & Clore, 2002a, 2002b).”
BackgroundIlies, R., Schwind, K. M., Wagner, D. T., Johnson, M. D., DeRue, D. S., & Ilgen, D. R. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.5.1368 · Cited by 509
Volitional personality trait change: Can people choose to change their personality traits?
Hudson, N. W., & Fraley, R. C. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000021 · Cited by 463
Vazire, S., & Mehl, M. R. (2008) · Journal of Personality and Social Psychology · doi:10.1037/a0013314 · Cited by 458
Situation-based contingencies underlying trait-content manifestation in behavior
Fleeson, W. (2007) · Journal of Personality · doi:10.1111/j.1467-6494.2007.00458.x · Cited by 455
Complex affect dynamics add limited information to the prediction of psychological well-being.
Dejonckheere, E., Mestdagh, M., Houben, M., Rutten, I., Sels, L., Kuppens, P., & Tuerlinckx, F. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0555-0 · Cited by 431 · cited 1×
“…parameter, such as weighted means, median, person-standard deviations (Jones, Brown, Serfass, & Sherman, 2017), or a number of other parameters (Dejonckheere et al., 2019; Wright & Zimmermann, 2019; Zimmermann et al., 2019), each of which technically needs to be validated in their own right…”
BackgroundCross-situational generality and the interpersonal circumplex
Moskowitz, D. S. (1994) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.66.5.921 · Cited by 290
A century of research on conscientiousness at work
Wilmot, M. P., & Ones, D. S. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1908430116 · Cited by 215 · cited 1×
“Wilmot and Ones (2019) Meta-analysis of relation of conscientiousness and outcomes at work - Procrastination (r) -”
BackgroundLab And/Or Field? Measuring Personality Processes and Their Social Consequences
Wrzus, C., & Mehl, M. R. (2015) · European Journal of Personality · doi:10.1002/per.1986 · Cited by 200
Nostalgia and well-being in daily life: An ecological validity perspective.
Newman, D. B., Sachs, M. E., Stone, A. A., & Schwarz, N. (2020) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000236 · Cited by 198
Sim, S.-M., & Rasiah, R. I. (2006) · Annals of the Academy of Medicine, Singapore · doi:10.47102/annals-acadmedsg.v35n2p67 · Cited by 196 · cited 1×
“Items with extreme item difficulties can potentially lead to attenuated correlations owing to restricted variance (Sim & Rasiah, 2006) and can make it therefore harder to test hypotheses at the within-person level.”
BackgroundAffect, Behaviour, Cognition and Desire in the Big Five: An Analysis of Item Content and Structure
Wilt, J., & Revelle, W. (2015) · European Journal of Personality · doi:10.1002/per.2002 · Cited by 187 · cited 2×
“This is very similar to what Wilt and Revelle (2015) observed in their analysis of Big Five trait items.”
BackgroundResultHudson, N. W., Briley, D. A., Chopik, W. J., & Derringer, J. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000221 · Cited by 169 · cited 4×
“For example, Hudson et al. (2018) showed that completing certain weekly challenges can lead to higher conscientiousness in participants.”
BackgroundResultInfluentialMoskowitz, D. S., Russell, J. J., Sadikaj, G., & Sutton, R. (2009) · Canadian Psychology / Psychologie canadienne · doi:10.1037/a0016625 · Cited by 103 · cited 2×
“Alternatively, and especially suited for one-item state measures, one can estimate the stability of the average-state score across several measurement occasions (Moskowitz et al., 2009).”
BackgroundMethodThe Wax and Wane of Narcissism: Grandiose Narcissism as a Process or State
Giacomin, M., & Jordan, C. H. (2016) · Journal of Personality · doi:10.1111/jopy.12148 · Cited by 103
Silvia, P. J., Kwapil, T. R., Walsh, M. A., & Myin-Germeys, I. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0353-y · Cited by 97
Single-item Big Five ratings in a social network design
Denissen, J. J. A., Geenen, R., Selfhout, M., & van Aken, M. A. G. (2008) · European Journal of Personality · doi:10.1002/per.662 · Cited by 91
Zimmermann, J., Woods, W. C., Ritter, S., Happel, M., Masuhr, O., Jaeger, U., Spitzer, C., & Wright, A. G. C. (2019) · Psychological Assessment · doi:10.1037/pas0000625 · Cited by 87 · cited 3×
“…median, person-standard deviations (Jones, Brown, Serfass, & Sherman, 2017), or a number of other parameters (Dejonckheere et al., 2019; Wright & Zimmermann, 2019; Zimmermann et al., 2019), each of which technically needs to be validated in their own right and based on theoretical assumptions.”
BackgroundTimmermans, T., Van Mechelen, I., & Kuppens, P. (2010) · European Journal of Personality · doi:10.1002/per.756 · Cited by 39
Cited by
Horstmann, K. T., Rauthmann, J. F., Sherman, R. A., & Ziegler, M. (2021) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000357 · Cited by 89
Self-citationIndividual differences in contingencies between situation characteristics and personality states.
Kuper, N., Breil, S. M., Horstmann, K. T., Roemer, L., Lischetzke, T., Sherman, R. A., Back, M. D., Denissen, J. J. A., & Rauthmann, J. F. (2022) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000435 · Cited by 63
Self-citationWhy are you (un)conscientious? The dynamic interplay of goals, states, and traits in everyday life
Di Sarno, M., Costantini, G., Richetin, J., Preti, E., & Perugini, M. (2023) · Journal of Personality · doi:10.1111/jopy.12701 · Cited by 18
Roemer, L., Stoll, G., Rounds, J., & Ziegler, M. (2023) · Journal of Research in Personality · doi:10.1016/j.jrp.2023.104386 · Cited by 10
Self-citationA Conceptual Framework to Integrate Research Programs on Self-Regulation in Education
Wortha, F., Gerjets, P., Azevedo, R., Bernacki, M., Brucker, B., Bühler, B., Ehlis, A.-C., Kasneci, E., Miyake, A., Murayama, K., et al. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10196-7
“Unlike state-like regulatory events, these SR-related traits are typically viewed as stable and are assessed via self-reports or observer ratings rather than repeated, in situ measurements, as they are considered to be enduring rather than fleeting (Horstmann & Ziegler, 2020).”
Metadata
- Authors
- Horstmann, K. T., & Ziegler, M.
- Venue
- European Journal of Personality
- Publisher
- SAGE Publications
- Published
- 2020-12
- Volume
- 34
- Issue
- 6
- Pages
- 1037-1059
- ISSN
- 0890-2070 (ISSN-L)
- 1099-0984
- OpenAlex
- W3024753549
- Cited by
- 149
- References
- 45
- FWCI
- 7.62
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.