The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
What is being assessed and why it matters: The impact of transient error on trait research.
Abstract
Temporal instability can reflect either true psychological change or transient measurement error, and it is important that trait psychologists be able to distinguish one from the other. The authors report results from large retest studies of Big Five, trait affectivity, and personality disorder measures across time frames (2 months and 2 weeks) over which these constructs should show little or no true change. On average, nearly 25% of the variance in the measures was a product of transient error rather than true change; however, the proportion of error varied widely-but consistently-across measures. In addition, a reexamination of long-term longitudinal data demonstrated that ignoring transient error can lead to inaccurate conclusions. Most notably, a substantial portion of the observed instability in the Big Five and trait affectivity is due to transient error; thus, these traits are even more stable than commonly thought. The present data further suggest that previous reports of differential stability between the Big Five and trait affectivity are due, in part, to differential levels of transient error in measures of these constructs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Emerging adulthood: A theory of development from the late teens through the twenties.
Arnett, J. J. (2000) · American Psychologist · doi:10.1037/0003-066x.55.5.469 · Cited by 16,843
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567
Self-citationEcological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Validation of the five-factor model of personality across instruments and observers.
McCrae, R. R., & Costa, P. T. (1987) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.52.1.81 · Cited by 6,404
The development of markers for the Big-Five factor structure
Goldberg, L. R. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.26 · Cited by 5,530
Schwarz, N., & Clore, G. L. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.45.3.513 · Cited by 4,952
Roberts, B. W., & DelVecchio, W. F. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.1.3 · Cited by 3,241
Personality Development: Stability and Change
Caspi, A., Roberts, B. W., & Shiner, R. L. (2005) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.141913 · Cited by 2,699
The SPQ: A Scale for the Assessment of Schizotypal Personality Based on DSM-III-R Criteria
Raine, A. (1991) · Schizophrenia Bulletin · doi:10.1093/schbul/17.4.555 · Cited by 2,164
Belief and feeling: Evidence for an accessibility model of emotional self-report.
Robinson, M. D., & Clore, G. L. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.6.934 · Cited by 1,806
Cited by
Kotov, R., Gamez, W., Schmidt, F., & Watson, D. (2010) · Psychological Bulletin · doi:10.1037/a0020327 · Cited by 2,677
Self-citationPersonality and depression: explanatory models and review of the evidence
Klein, D. N., Kotov, R., & Bufferd, S. J. (2011) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032210-104540 · Cited by 886
Internal consistency, retest reliability, and their implications for personality scale validity
McCrae, R. R., Kurtz, J. E., Yamagata, S., & Terracciano, A. (2011) · Personality and Social Psychology Review · doi:10.1177/1088868310366253 · Cited by 874
Neuroticism and common mental disorders: meaning and utility of a complex relationship.
Ormel, J., Jeronimus, B. F., Kotov, R., Riese, H., Bos, E. H., Hankin, B., Rosmalen, J. G. M., & Oldehinkel, A. J. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.04.003 · Cited by 703
Construct Validation in Social and Personality Research: Current Practice and Recommendations
Flake, J. K., Pek, J., & Hehman, E. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617693063 · Cited by 697
Gámez, W., Chmielewski, M., Kotov, R., Ruggero, C., & Watson, D. (2011) · Psychological Assessment · doi:10.1037/a0023242 · Cited by 524
Self-citationReliability from α to ω: A tutorial.
Revelle, W., & Condon, D. M. (2019) · Psychological Assessment · doi:10.1037/pas0000754 · Cited by 506
Personality and obesity across the adult life span.
Sutin, A. R., Ferrucci, L., Zonderman, A. B., & Terracciano, A. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0024286 · Cited by 417
Anusic, I., & Schimmack, U. (2016) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000066 · Cited by 312
A More Nuanced View of Reliability: Specificity in the Trait Hierarchy
McCrae, R. R. (2015) · Personality and Social Psychology Review · doi:10.1177/1088868314541857 · Cited by 292
The 24-item Brief HEXACO Inventory (BHI)
de Vries, R. E. (2013) · Journal of Research in Personality · doi:10.1016/j.jrp.2013.09.003 · Cited by 278
Scale quality: alpha is an inadequate estimate and factor-analytic evidence is needed first of all
Crutzen, R., & Peters, G.-J. Y. (2017) · Health Psychology Review · doi:10.1080/17437199.2015.1124240 · Cited by 253
Experiential Avoidance: An Examination of the Construct Validity of the AAQ-II and MEAQ
Rochefort, C., Baldwin, A. S., & Chmielewski, M. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.08.008 · Cited by 247
Self-citationWeuve, J., Proust‐Lima, C., Power, M. C., Gross, A. L., Hofer, S. M., Thiébaut, R., Chêne, G., Glymour, M. M., Dufouil, C., & Initiative, M. (2015) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2015.06.1885 · Cited by 243
The robust reliability of neuropsychological measures: meta-analyses of test-retest correlations
Calamia, M., Markon, K., & Tranel, D. (2013) · The Clinical Neuropsychologist · doi:10.1080/13854046.2013.809795 · Cited by 207
The Long-Term Stability of Self-Esteem: Its Time-Dependent Decay and Nonzero Asymptote
Kuster, F., & Orth, U. (2013) · Personality and Social Psychology Bulletin · doi:10.1177/0146167213480189 · Cited by 117
Neural mechanisms underlying heterogeneity in the presentation of anxious temperament
Shackman, A. J., Fox, A. S., Oler, J. A., Shelton, S. E., Davidson, R. J., & Kalin, N. H. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1214364110 · Cited by 113
Katz, B. A., Matanky, K., Aviram, G., & Yovel, I. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101842 · Cited by 109
Ten‐Year Rank‐Order Stability of Personality Traits and Disorders in a Clinical Sample
Hopwood, C. J., Morey, L. C., Donnellan, M. B., Samuel, D. B., Grilo, C. M., McGlashan, T. H., Shea, M. T., Zanarini, M. C., Gunderson, J. G., & Skodol, A. E. (2013) · Journal of Personality · doi:10.1111/j.1467-6494.2012.00801.x · Cited by 98
“Given the recommendations by Chmielewski and Watson (2009) and McCrae et al. (2011), we focus here on dependability-corrected estimates.”
BackgroundMethodResultInfluentialDevelopment and Validation of the Faceted Inventory of the Five-Factor Model (FI-FFM)
Watson, D., Nus, E., & Wu, K. D. (2019) · Assessment · doi:10.1177/1073191117711022 · Cited by 83
Self-citationPuyané, M., Subirà, S., Torres, A., Roca, A., Garcia-Esteve, L., & Gelabert, E. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.11.010 · Cited by 81
Naragon-Gainey, K., Prenoveau, J. M., Brown, T. A., & Zinbarg, R. E. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000197 · Cited by 54
Szkodny, L. E., & Newman, M. G. (2019) · Assessment · doi:10.1177/1073191117698753 · Cited by 38
The short-term stability of life satisfaction judgments
Lucas, R. E., Freedman, V. A., & Cornman, J. C. (2018) · Emotion · doi:10.1037/emo0000357 · Cited by 27
“Recently, emotion researchers have proposed combining long- and short-term measures as a way of providing estimates of reliability that are more appropriate for constructs like affect and emotion (e.g., Chmielewski, Sala, Tang, & Baldwin, 2016; Chmielewski & Watson, 2009).”
A novel way to quantify schizophrenia symptoms in clinical trials
Medvedev, O. N., Berk, M., Dean, O. M., Brown, E., Sandham, M. H., Dipnall, J. F., McNamara, R. K., Sumich, A., Krägeloh, C. U., Narayanan, A., et al. (2021) · European Journal of Clinical Investigation · doi:10.1111/eci.13398 · Cited by 23
Crossing the seven Cs of internal consistency: Assessing the reliability of formative instruments
Gruijters, S. L. K., Fleuren, B. P. I., & Peters, G. J. (2021) · doi:10.31234/osf.io/qar39 · Cited by 17
Metadata
- Authors
- Chmielewski, M., & Watson, D.
- Venue
- Journal of Personality and Social Psychology
- Published
- 2009
- Volume
- 97
- Issue
- 1
- Pages
- 186-202
- ISSN
- 0022-3514 (ISSN-L)
- 1939-1315
- OpenAlex
- W2157011056
- Cited by
- 173
- References
- 21
- FWCI
- 8.44
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.