Constructing validity: New developments in creating objective measuring instruments.
Open accessAbstract
In this update of Clark and Watson (1995), we provide a synopsis of major points of our earlier article and discuss issues in scale construction that have become more salient as clinical and personality assessment has progressed over the past quarter-century. It remains true that the primary goal of scale development is to create valid measures of underlying constructs and that Loevinger's theoretical scheme provides a powerful model for scale development. We still discuss practical issues to help developers maximize their measures' construct validity, reiterating the importance of (a) clear conceptualization of target constructs, (b) an overinclusive initial item pool, (c) paying careful attention to item wording, (d) testing the item pool against closely related constructs, (e) choosing validation samples thoughtfully, and (f) emphasizing unidimensionality over internal consistency. We have added (g) consideration of the hierarchical structures of personality and psychopathology in scale development, discussion of (h) codeveloping scales in the context of these structures, (i) "orphan," and "interstitial" constructs, which do not fit neatly within these structures, (j) problems with "conglomerate" constructs, and (k) developing alternative versions of measures, including short forms, translations, informant versions, and age-based adaptations. Finally, we have expanded our discussions of (l) item-response theory and of external validity, emphasizing (m) convergent and discriminant validity, (n) incremental validity, and (o) cross-method analyses, such as questionnaires and interviews. We conclude by reaffirming that all mature sciences are built on the bedrock of sound measurement and that psychology must redouble its efforts to develop reliable and valid measures. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A high coefficient alpha is difficult to obtain in scales with few items, given its relationship to length (ie, 12 versus five items on factor 2).
“however, a high coefficient alpha is difficult to obtain in scales with few items, given its relationship to length (ie, 12 versus five items on factor 2) [49].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · see citing works
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · see citing works
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116 · see citing works
Psychometric theory (2nd ed.).
Sitgreaves, R. (1979) · Contemporary Psychology · doi:10.1037/018882 · Cited by 14,384 · see citing works
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298 · see citing works
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195 · see citing works
Evaluating the use of exploratory factor analysis in psychological research.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.3.272 · Cited by 9,587 · see citing works
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 7× · see citing works
“As a more specific guideline, we recommend that the AIC fall in the range of .15 to .50 (see Briggs & Cheek, 1986), with the scale’s optimal value determined by the generality versus specificity of the target construct.”
BackgroundMethodInfluentialGrit: perseverance and passion for long-term goals
Duckworth, A. L., Peterson, C., Matthews, M. D., & Kelly, D. R. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.92.6.1087 · Cited by 6,911 · see citing works
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567 · see citing works
Self-citationSample size in factor analysis.
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.1.84 · Cited by 5,497 · see citing works
Starting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794 · see citing works
Development and validation of the short grit scale (grit-s)
Duckworth, A. L., & Quinn, P. D. (2009) · Journal of Personality Assessment · doi:10.1080/00223890802634290 · Cited by 3,376 · see citing works
Standards for Educational and Psychological Testing
(2007) · Sage eBooks · doi:10.4135/9781412952644.n432 · Cited by 3,137 · see citing works
Relation of sample size to the stability of component patterns.
Guadagnoli, E., & Velicer, W. F. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.2.265 · Cited by 2,880 · see citing works
Content validity in psychological assessment: A functional approach to concepts and methods.
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995) · Psychological Assessment · doi:10.1037//1040-3590.7.3.238 · Cited by 2,387 · cited 1× · see citing works
“This obviously is an ideal to be striven for, not an absolute requirement (see also Comrey, 1988; Haynes, Richard, & Kubany, 1995).”
BackgroundThe role of factor analysis in the development and evaluation of personality scales
Briggs, S. R., & Cheek, J. M. (1986) · Journal of Personality · doi:10.1111/j.1467-6494.1986.tb00391.x · Cited by 2,365 · see citing works
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298 · see citing works
Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., Cella, D., & PROMIS Cooperative Group (2011) · Assessment · doi:10.1177/1073191111411667 · Cited by 2,132 · see citing works
Trait-names: A psycho-lexical study.
Allport, G. W., & Odbert, H. S. (1936) · Psychological Monographs · doi:10.1037/h0093360 · Cited by 2,018 · see citing works
Meehl, P. E. (1978) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.46.4.806 · Cited by 1,952 · see citing works
Initial construction of a maladaptive personality trait model and inventory for DSM-5
Krueger, R. F., Derringer, J., Markon, K. E., Watson, D., & Skodol, A. E. (2012) · Psychological Medicine · doi:10.1017/s0033291711002674 · Cited by 1,908 · see citing works
Self-citationThe validity of the multi-informant approach to assessing child and adolescent mental health.
Reyes, A. D. L., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. A. (2015) · Psychological Bulletin · doi:10.1037/a0038498 · Cited by 1,706 · see citing works
Much ado about grit: A meta-analytic synthesis of the grit literature
Credé, M., Tynan, M. C., & Harms, P. D. (2017) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000102 · Cited by 1,653 · see citing works
Objective Tests as Instruments of Psychological Theory
Loevinger, J. (1957) · Psychological Reports · doi:10.2466/pr0.1957.3.3.635 · Cited by 1,476 · see citing works
Watson, D., & Clark, L. A. (1992) · Journal of Personality · doi:10.1111/j.1467-6494.1992.tb00980.x · Cited by 1,154 · see citing works
Self-citationFactor-analytic methods of scale development in personality and clinical psychology
Comrey, A. L. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.5.754 · Cited by 1,154 · see citing works
Connelly, B. S., & Ones, D. S. (2010) · Psychological Bulletin · doi:10.1037/a0021212 · Cited by 1,059 · see citing works
On the sins of short-form development.
Smith, G. T., McCarthy, D. M., & Anderson, K. G. (2000) · Psychological Assessment · doi:10.1037/1040-3590.12.1.102 · Cited by 965 · see citing works
Russell, D. W. (2002) · Personality and Social Psychology Bulletin · doi:10.1177/014616702237645 · Cited by 954 · see citing works
Tellegen, A., & Waller, N. G. (2008) · The SAGE Handbook of Personality Theory and Assessment: Volume 2 — Personality Measurement and Testing · doi:10.4135/9781849200479.n13 · Cited by 905 · see citing works
Structures of personality and their relevance to psychopathology.
Watson, D., Clark, L. A., & Harkness, A. R. (1994) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.103.1.18 · Cited by 800 · see citing works
Self-citationDevelopment and validation of the Inventory of Depression and Anxiety Symptoms (IDAS).
Watson, D., O'Hara, M. W., Simms, L. J., Kotov, R., Chmielewski, M., McDade-Montez, E. A., Gamez, W., & Stuart, S. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.3.253 · Cited by 740 · see citing works
Self-citation(1983) · PubMed · Cited by 734 · see citing works
Item Response Theory and Clinical Measurement
Reise, S. P., & Waller, N. G. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.032408.153553 · Cited by 722 · see citing works
Diagnosing Personality Disorders
Zimmerman, M. A. (1994) · Archives of General Psychiatry · doi:10.1001/archpsyc.1994.03950030061006 · Cited by 721 · see citing works
The NEO–PI–3: A More Readable Revised NEO Personality Inventory
McCrae, R. R., Costa, P. T., & Martin, T. (2005) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8403_05 · Cited by 701 · see citing works
Standards of validity and the validity of standards in performance asessment
Messick, S. (1995) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1995.tb00881.x · Cited by 697 · see citing works
Markon, K. E., Chmielewski, M., & Miller, C. J. (2011) · Psychological Bulletin · doi:10.1037/a0023678 · Cited by 656 · see citing works
Haslam, N., Holland, E., & Kuppens, P. (2012) · Psychological Medicine · doi:10.1017/s0033291711001966 · Cited by 611 · cited 1× · see citing works
“…since the publication of our previous article, considerable research has confirmed that dimensional models fit the vast majority of data best (Haslam, Holland, & Kuppens, 2012; Markon, Chmielewski, & Miller, 2011a, 2011b), so anyone considering either a class or a dynamic model should have a…”
BackgroundHunsley, J. D., & Meyer, G. J. (2003) · Psychological Assessment · doi:10.1037/1040-3590.15.4.446 · Cited by 569 · see citing works
Approaches to personality inventory construction: A comparison of merits.
Burisch, M. (1984) · American Psychologist · doi:10.1037/0003-066x.39.3.214 · Cited by 549 · see citing works
Does item homogeneity indicate internal consistency or item redundancy in psychometric scales?
Boyle, G. J. (1991) · Personality and Individual Differences · doi:10.1016/0191-8869(91)90115-r · Cited by 495 · see citing works
Simms, L. J., Zelazny, K., Williams, T. F., & Bernstein, L. A. (2019) · Psychological Assessment · doi:10.1037/pas0000648 · Cited by 455 · see citing works
Measurement error masks bipolarity in affect ratings.
GREEN, D. P., Goldman, S. L., & Salovey, P. (1993) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.64.6.1029 · Cited by 437 · see citing works
The Investigation of Personality Structure: Statistical Models
Finch, J. F., & West, S. G. (1997) · Journal of Research in Personality · doi:10.1006/jrpe.1997.2194 · Cited by 406 · see citing works
Assessment of Adult Psychopathology: Meta-Analyses and Implications of Cross-Informant Correlations.
Achenbach, T. M., Krukowski, R. A., Dumenci, L., & Ivanova, M. Y. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.3.361 · Cited by 406 · see citing works
Funder, D. C. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412445309 · Cited by 400 · see citing works
DSM-III field trials: I. Initial interrater diagnostic reliability
(1979) · American Journal of Psychiatry · doi:10.1176/ajp.136.6.815 · Cited by 394 · see citing works
The dynamics of “structured” personality tests
Meehl, P. E. (2000) · Journal of Clinical Psychology · doi:10.1002/(sici)1097-4679(200003)56:3 · Cited by 362 · see citing works
Schmidt, F. L., Le, H., & Ilies, R. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.206 · Cited by 362 · see citing works
Tackett, J. L., Lahey, B. B., van Hulle, C., Waldman, I., Krueger, R. F., & Rathouz, P. J. (2013) · Journal of Abnormal Psychology · doi:10.1037/a0034151 · Cited by 360 · see citing works
Putnam, S. P., Rothbart, M. K., & Gartstein, M. A. (2008) · Infant and Child Development · doi:10.1002/icd.582 · Cited by 324 · see citing works
Watson, D., Clark, L., & Tellegen, A. (1984) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.47.1.127 · Cited by 321 · see citing works
Self-citationMethodological considerations in the refinement of clinical assessment instruments.
Smith, G. T., & McCarthy, D. M. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.300 · Cited by 311 · see citing works
Global self-esteem in relation to structural models of personality and affectivity
Watson, D., Suls, J., & Haig, J. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.83.1.185 · Cited by 303 · see citing works
Self-citationA More Nuanced View of Reliability
McCrae, R. R. (2014) · Personality and Social Psychology Review · doi:10.1177/1088868314541857 · Cited by 293 · see citing works
Special Feature: Personality Disorder Assessment: The Challenge of Construct Validity
Clark, L. A., Livesley, W. J., & Morey, L. C. (1997) · Journal of Personality Disorders · doi:10.1521/pedi.1997.11.3.205 · Cited by 257 · see citing works
Self-citationWatson, D., Clark, L. A., & Chmielewski, M. (2008) · Journal of Personality · doi:10.1111/j.1467-6494.2008.00531.x · Cited by 234 · cited 3× · see citing works
“Nonetheless, demonstrating good convergent/discriminant validity between self-report and interview measures of constructs provides support for both methods (e.g., Dornbach-Bender et al., 2017; Watson et al., 2008).”
BackgroundMethodSelf-citationPersonality Traits Beyond the Big Five: Are They Within the HEXACO Space?
Lee, K., Ogunfowora, B., & Ashton, M. C. (2005) · Journal of Personality · doi:10.1111/j.1467-6494.2005.00354.x · Cited by 226 · see citing works
Global self-esteem in relation to structural models of personality and affectivity.
Watson, D., Suls, J., & Haig, J. (2002) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.83.1.185 · Cited by 221 · see citing works
Self-citationHow IRT can solve problems of ipsative data in forced-choice questionnaires.
Brown, A., & Maydeu‐Olivares, A. (2012) · Psychological Methods · doi:10.1037/a0030641 · Cited by 217 · see citing works
The attenuation paradox in test theory.
Loevinger, J. (1954) · Psychological Bulletin · doi:10.1037/h0058543 · Cited by 198 · see citing works
Personality Assessment via Questionnaires
Angleitner, A., & Wiggins, J. S. (1986) · Springer eBooks · doi:10.1007/978-3-642-70751-3 · Cited by 195 · see citing works
Achenbach, T. M., Ivanova, M. Y., & Rescorla, L. A. (2017) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2017.03.006 · Cited by 186 · see citing works
The value of suppressor effects in explicating the construct validity of symptom measures.
Watson, D., Clark, L. A., Chmielewski, M., & Kotov, R. (2013) · Psychological Assessment · doi:10.1037/a0032781 · Cited by 176 · see citing works
Self-citationPersonality inDSM–5:Helping Delineate Personality Disorder Content and Framing the Metastructure
Krueger, R. F., Eaton, N. R., Derringer, J. L., Markon, K. E., Watson, D., & Skodol, A. E. (2011) · Journal of Personality Assessment · doi:10.1080/00223891.2011.577478 · Cited by 154 · see citing works
Self-citationExtraversion and psychopathology: A facet-level analysis.
Watson, D., Stasik, S. M., Ellickson‐Larew, S., & Stanton, K. J. (2015) · Journal of Abnormal Psychology · doi:10.1037/abn0000051 · Cited by 129 · see citing works
Self-citationBeyond Description in Interpersonal Construct Validation
Zimmermann, J., & Wright, A. G. C. (2015) · Assessment · doi:10.1177/1073191115621795 · Cited by 122 · see citing works
Testing and Assessment in Cross‐Cultural Psychology
Geisinger, K. F. (2003) · Wiley eBooks · doi:10.1002/0471264385.wei1005 · Cited by 115 · see citing works
The discriminant (and convergent) validity of the Personality Inventory for DSM–5.
Crego, C., Gore, W. L., Rojas, S. L., & Widiger, T. A. (2015) · Personality Disorders Theory Research and Treatment · doi:10.1037/per0000118 · Cited by 114 · see citing works
The construct validation approach to personality scale construction.
Simms, L. J., & Watson, D. (2007) · Cited by 99 · see citing works
Self-citationMansolf, M. A., & Reise, S. P. (2016) · Multivariate Behavioral Research · doi:10.1080/00273171.2016.1215898 · Cited by 91 · see citing works
Development and Validation of the Faceted Inventory of the Five-Factor Model (FI-FFM)
Watson, D., Nus, E., & Wu, K. D. (2019) · Assessment · doi:10.1177/1073191117711022 · Cited by 83 · see citing works
Self-citationGreen, B. F. (1978) · American Psychologist · doi:10.1037/0003-066x.33.7.664 · Cited by 78 · see citing works
The structure and short-term stability of the emotional disorders: a dimensional approach
Kotov, R., Perlman, G., Gámez, W., & Watson, D. (2014) · Psychological Medicine · doi:10.1017/s0033291714002815 · Cited by 77 · see citing works
Self-citationWatson, D., Stanton, K. J., & Clark, L. A. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.09.065 · Cited by 71 · see citing works
Self-citationPain analgesia among adolescent self-injurers
Glenn, J. J., Michel, B. D., Franklin, J. C., Hooley, J. M., & Nock, M. K. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.08.016 · Cited by 68 · see citing works
Schwartz, S. J., Benet‐Martínez, V., Knight, G. P., Unger, J. B., Zamboanga, B. L., Rosiers, S. E. D., Stephens, D. P., Huang, S., & Szapocznik, J. (2013) · Psychological Assessment · doi:10.1037/a0034717 · Cited by 60 · see citing works
Assessment of dependency, agreeableness, and their relationship.
Lowe, J. R., Edmundson, M., & Widiger, T. A. (2009) · Psychological Assessment · doi:10.1037/a0016899 · Cited by 55 · see citing works
The Schedule for Nonadaptive and Adaptive Personality for Youth (SNAP-Y)
Linde, J. A., Stringer, D. M., Simms, L. J., & Clark, L. A. (2013) · Assessment · doi:10.1177/1073191113489847 · Cited by 47 · see citing works
Self-citationMacCann, C., & Roberts, R. D. (2010) · Cited by 30 · see citing works
Ahmed, S. R., Fowler, P. J., & Toro, P. A. (2010) · Mental Health Religion & Culture · doi:10.1080/13674671003762685 · Cited by 25 · see citing works
Objective tests as instruments of psychological theory and research.
Watson, D. (2012) · American Psychological Association eBooks · doi:10.1037/13619-019 · Cited by 22 · see citing works
Self-citationDornbach‐Bender, A., Ruggero, C. J., Waszczuk, M. A., Gámez, W., Watson, D., & Kotov, R. (2017) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2017.06.011 · Cited by 21 · see citing works
Self-citationThe effect of symptom visibility on informant reporting.
McDade‐Montez, E., Watson, D., O’Hara, M. W., & Denburg, N. L. (2008) · Psychology and Aging · doi:10.1037/a0014297 · Cited by 19 · see citing works
Self-citationBrief Moral Decision-Making Questionnaire: A Rasch-derived short form of the Greene dilemmas.
Carmona-Perera, M., Caracuel, A., Pérez-Garcı́a, M., & Verdejo‐García, A. (2015) · Psychological Assessment · doi:10.1037/pas0000049 · Cited by 14 · see citing works
Comparing countdown- and IRT-based approaches to computerized adaptive personality testing.
Rudick, M. M., Yam, W. H., & Simms, L. J. (2013) · Psychological Assessment · doi:10.1037/a0032541 · Cited by 11 · see citing works
Flagged first, then by citations
Research works printed but not linked: 5
- Clark LA, Simms LJ, Wu Kevin, D., & Casillas A (2014). Schedule for Nonadaptive and Adaptive Personality-2nd Edition (SNAP-2): Manual for Administration, Scoring, and Interpretation. Notre Dame, IN: University of Notre Dame.
- Markon KE, Chmielewski M, & Miller CJ (2011b). “The reliability and validity of discrete and continuous measures of psychopathology: A quantitative review”: Correction to Markon et al. (2011). Psychological Bulletin, 137(6), 1– 1093. doi: 10.1037/a0025727 21574681 · DOI
- Meehl PE & Golden RR (1982). Taxometric methods In Kendall PC & Butcher JN (Eds.). Handbook of research methods in clinical psychology (pp. 127– 181). New York: Wiley.
- Reise SP, Ainsworth AT, & Haviland MG (2005). Item response theory: Fundamentals, applications, and promise in psychological research. Current Directions in Psychological Science, 14(2), 95– 101. doi: 10.1111/j.0963-7214.2005.00342.x · DOI
- Soto CJ, & John OP (2017). Short and extra-short forms of the Big Five Inventory–2: The BFI-2-S and BFI-2-XS. Journal of Research in Personality, 68, 69– 81.doi: 10.1016/j.jrp.2017.02.004 · DOI · Paper page
Cited by
Sorted by citations
Weathers, F. W., Bovin, M. J., Lee, D. J., Sloan, D. M., Schnurr, P. P., Kaloupek, D. G., Keane, T. M., & Marx, B. P. (2018) · Psychological Assessment · doi:10.1037/pas0000486 · Cited by 1,799 · see citing works
Duckworth, A. L., & Yeager, D. S. (2015) · Educational Researcher · doi:10.3102/0013189x15584327 · Cited by 993 · see citing works
Wilkins, K. C., Lang, A. J., & Norman, S. B. (2011) · Depression and Anxiety · doi:10.1002/da.20837 · Cited by 946 · see citing works
How can we conceptualize behavioural addiction without pathologizing common behaviours?
Kardefelt‐Winther, D., Heeren, A., Schimmenti, A., van Rooij, A., Maurage, P., Carras, M., Edman, J., Blaszczynski, A., Khazaal, Y., & Billieux, J. (2017) · Addiction · doi:10.1111/add.13763 · Cited by 780 · see citing works
Kotov, R., Krueger, R. F., Watson, D., Cicero, D. C., Conway, C. C., DeYoung, C. G., Eaton, N. R., Forbes, M. K., Hallquist, M. N., Latzman, R. D., et al. (2021) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-081219-093304 · Cited by 596 · see citing works
Self-citationMrazek, M. D., Phillips, D. T., Franklin, M. S., Broadway, J. M., & Schooler, J. W. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00560 · Cited by 400 · see citing works
Olderbak, S., Wilhelm, O., Olaru, G., Geiger, M., Brenneman, M. W., & Roberts, R. D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01503 · Cited by 228 · see citing works
Developing a tool for measuring the decision-making competence of older adults.
Finucane, M. L., & Gullion, C. M. (2010) · Psychology and Aging · doi:10.1037/a0019106 · Cited by 202 · see citing works
Psychometric properties of the PTSD Checklist for DSM-5: a pilot study
Sveen, J., Bondjers, K., & Willebrand, M. (2016) · European Journal of Psychotraumatology · doi:10.3402/ejpt.v7.30165 · Cited by 186 · see citing works
The Intolerance of Uncertainty Scale for Children: A psychometric evaluation.
Comer, J. S., Roy, A. K., Furr, J. M., Gotimer, K., Beidas, R. S., Dugas, M. J., & Kendall, P. C. (2009) · Psychological Assessment · doi:10.1037/a0016719 · Cited by 162 · see citing works
Self-stigma in substance abuse: development of a new measure
Luoma, J. B., Nobles, R. H., Drake, C. E., Hayes, S. C., O’Hair, A., Fletcher, L., & Kohlenberg, B. S. (2013) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-012-9323-4 · Cited by 150 · see citing works
Green, K. T., Hayward, L. C., Williams, A. M., Dennis, P. A., Bryan, B. C., Taber, K. H., Mid-Atlantic Mental Illness Research, E. A. C. C. W., Davidson, J. R. T., Beckham, J. C., Calhoun, P. S., et al. (2014) · Assessment · doi:10.1177/1073191114524014 · Cited by 111 · see citing works
Brailovskaia, J., & Margraf, J. (2024) · Current Psychology · doi:10.1007/s12144-022-03182-z · Cited by 101 · see citing works
Aggarwal, N. K., Glass, A., Tirado, A., Boiler, M., Nicasio, A., Alegría, M., Wall, M., & Lewis-Fernández, R. (2014) · Journal of Health Care for the Poor and Underserved · doi:10.1353/hpu.2014.0132 · Cited by 90 · see citing works
Desmedt, O., Luminet, O., Maurage, P., & Corneille, O. (2025) · Perspectives on Psychological Science · doi:10.1177/17456916231191537 · Cited by 80 · see citing works
Acceptance and Commitment Therapy Processes and Mediation: Challenges and How to Address Them
Arch, J. J., Fishbein, J. N., Finkelstein, L. B., & Luoma, J. B. (2023) · Behavior Therapy · doi:10.1016/j.beth.2022.07.005 · Cited by 72 · see citing works
Martela, F., Bradshaw, E. L., & Ryan, R. M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02174 · Cited by 69 · see citing works
Miloff, A., Carlbring, P., Hamilton, W., Andersson, G., Reuterskiöld, L., & Lindner, P. (2020) · Journal of Medical Internet Research · doi:10.2196/16660 · Cited by 60 · see citing works
Coercive Control in the Courtroom: the Legal Abuse Scale (LAS)
Gutowski, E. R., & Goodman, L. A. (2023) · Journal of Family Violence · doi:10.1007/s10896-022-00408-3 · Cited by 57 · see citing works
Hanley, A. W., Bernstein, A., Nakamura, Y., Hadash, Y., Rojas, J., Tennant, K. E., Jensen, R. L., & Garland, E. L. (2020) · Psychological Assessment · doi:10.1037/pas0000931 · Cited by 45 · see citing works
Introduction and behavioral validation of the climate change distress and impairment scale
Hepp, J., Klein, S. A., Horsten, L. K., Urbild, J., & Lane, S. P. (2023) · Scientific Reports · doi:10.1038/s41598-023-37573-4 · Cited by 41 · see citing works
A psychometric framework for evaluating and shaping personality traits in large language models
Serapio-García, G., Safdari, M., Crepy, C., Sun, L., Fitz, S., Romero, P., Abdulhai, M., Faust, A., & Matarić, M. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01115-6 · Cited by 30 · see citing works
Bui, T. H. T., Tran, T. M. D., Nguyen, T. N. T., Vu, T. C., Ngo, X. D., Nguyen, T. H. P., & Do, T. L. H. (2022) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2021.2019585 · Cited by 22 · see citing works
Trujillo, C. M., Anderson, T. R., & Pelaez, N. J. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.15-03-0051 · Cited by 19 · see citing works
Kofler, M. J., Groves, N. B., Singh, L. J., Soto, E. F., Chan, E. S. M., Irwin, L. N., & Miller, C. E. (2020) · Psychological Assessment · doi:10.1037/pas0000856 · Cited by 13 · see citing works
Decoupling personality and acute psychiatric symptoms in a depressed sample and a community sample.
Fournier, J. C., Wright, A. G. C., Tackett, J. L., Uliaszek, A. A., Pilkonis, P. A., Manuck, S. B., & Bagby, R. M. (2019) · Clinical Psychological Science · doi:10.1177/2167702618813989 · Cited by 10 · see citing works
Measuring mindfulness: A systematic review and evaluation of self-report mindfulness scales
Chems-Maarif, R., Cavanagh, K., Baer, R., Gu, J., & Strauss, C. (2026) · Clinical Psychology Review · doi:10.1016/j.cpr.2026.102719 · Cited by 7 · see citing works
Psychometric properties of the experiences of maternity care scale among Iranian women
Jafari, E., Asghari-Jafarabadi, M., Mirghafourvand, M., & Mohammad-Alizadeh-Charandabi, S. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11065-1 · Cited by 3 · see citing works
- Authors
- Clark, L. A., & Watson, D.
- Venue
- Psychological Assessment
- Published
- 2019-12
- Volume
- 31
- Issue
- 12
- Pages
- 1412-1427
- ISSN
- 1040-3590 (ISSN-L)
- 1939-134X
- PMC
- PMC6754793
- OpenAlex
- W2923413722
- Cited by
- 1,470
- References
- 88
- Citations by year
- 2026: 254 · 2025: 247 · 2024: 210 · 2023: 210 · 2022: 143 · 2021: 127 · 2020: 71 · 2019: 49 · 2018: 24 · 2017: 16 · 2016: 19 · 2015: 15 · 2014: 21 · 2013: 16 · 2012: 12
- FWCI
- 69.53
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Psychological Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (R01-MH068472)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Psychology › Clinical Psychology › Personality Traits and Psychology
- Keywords
- scale development, construct validity, personality assessment, psychopathology, item pool, item wording, validation samples, unidimensionality, short form, translation, item response theory, generalizability, convergent validity, discriminant validity, incremental validity
- MeSH terms
- Adolescent, Adult, Female, Humans, Interviews as Topic, Male, Personality Assessment, Personality Disorders, Psychometrics, Surveys and Questionnaires, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
