Constructing validity: Basic issues in objective scale development.

Clark, Lee Anna; Watson, David

doi:10.1037/1040-3590.7.3.309

Cited by 6,567Psychometric Methodologies and TestingHealth Education and ValidationPsychological Testing and Assessment

Constructing validity: Basic issues in objective scale development.

Clark, Lee Anna, Watson, David·1995·Psychological Assessment

DOI 10.1037/1040-3590.7.3.309

Open this paper in CoChat — free account

Abstract

A primary goal of scale development is to create a valid measure of an underlying construct. We discuss theoretical principles, practical issues, and pragmatic decisions to help developers maximize the construct validity of scales and subscales. First, it is essential to begin with a clear conceptualization of the target construct. Moreover, the content of the initial item pool should be overinclusive and item wording needs careful attention. Next, the item pool should be tested, along with variables that assess closely related constructs, on a heterogeneous sample representing the entire range of the target population. Finally, in selecting scale items, the goal is unidimensionality rather than internal consistency ; this means that virtually all interitem correlations should be moderate in magnitude. Factor analysis can play a crucial role in ensuring the unidimensionality and discriminant validity of scales.

Integrity signals

Registry

Crossref · 10.1037/1040-3590.7.3.309

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The two factors represent the same construct.
“Furthermore, the intercorrelation between the two factors is .5, which also suggests that the two factors represent the same construct (Clark & Watson, 1995).”
From Preliminary Psychometric Properties of the Acceptance and Action Questionnaire–II: A Revised Measure of Psychological Inflexibility and Experiential Avoidance (2011) · cites this paper as Clark & Watson, 1995
The MIS-PL has acceptable reliability despite lower Cronbach's alpha indices compared to the original version.
“All items achieved values above the recommended 0.20, which makes it possible, despite the lower Cronbach’s alpha indices compared to the original version, to consider the MIS-PL a tool with acceptable reliability (Clark and Watson, 1995).”
From Psychometric Evaluation of the Polish Version of the Mindfulness Inventory for Sport (MIS-PL) (2024) · cites this paper as Clark and Watson, 1995
All MIS-PL items achieved item-total correlations above the recommended 0.20.
“An additional analysis of the item-total correlation matrix showed that all items achieved values above the recommended 0.20 (Clark and Watson, 1995).”
From Psychometric Evaluation of the Polish Version of the Mindfulness Inventory for Sport (MIS-PL) (2024) · cites this paper as Clark and Watson, 1995
Writing items for any self-report questionnaire requires authors to define or conceptualize the construct they are attempting to measure.
“As the process of writing items for any self-report questionnaire requires authors to define or conceptualize the construct they are attempting to measure (Clark & Watson, 1995)”
From Using Self-Report Assessment Methods to Explore Facets of Mindfulness (2006) · cites this paper as Clark & Watson, 1995
The average inter-item correlation of the ACO Model in Study 2 was 0.20, which is acceptable according to Clark and Watson (1995).
“The average inter-item correlation (0.20) was acceptable according to Clark and Watson (1995)”
From A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings (2015) · cites this paper as Clark and Watson (1995)

Omega and CFA simultaneously provide estimates of both homogeneity and reliability, unlike traditional estimates which do not assess homogeneity.
“We chose these two tools, instead of traditional measures of internal consistency (i.e., Cronbach's Alpha [Cronbach, 1951] or KR-20 for dichotomous data [Kuder and Richardson, 1937]) because unlike traditional estimates which do not assess homogeneity (Cortina, 1993; Clark and Watson, 1995), omega and CFA, simultaneously provide estimates of both.”
From A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings (2015) · cites this paper as Clark and Watson, 1995
The range of inter-item correlations for the ACO 10-item solution (−0.07 to 0.36) falls outside the recommendations of Clark and Watson (1995).
“however the range of inter-item correlations (−0.07 to 0.36) still falls outside of their recommendations.”
From A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings (2015) · cites this paper as Clark and Watson (1995)
The average inter-item correlation and the range of inter-item correlations are outside the range recommended by Clark and Watson (1995) for sufficient internal consistency (0.15 to 0.50).
“The average inter-item correlation, as well as the range of inter-item correlations, are outside the range recommended by Clark and Watson (1995) for sufficient internal consistency (recommended values range from 0.15 to 0.50).”
From A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings (2015) · cites this paper as Clark and Watson, 1995
The range of inter-item correlations for the ACO Model in Study 2 (−0.07 to 0.59) falls outside the recommendation of Clark and Watson (1995).
“however the range of inter-item correlations (-0.07 to 0.59) still falls outside of their recommendation.”
From A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings (2015) · cites this paper as Clark and Watson (1995)
The average inter-item correlation of the ACO 10-item solution was 0.18, which is acceptable according to Clark and Watson (1995).
“The average inter-item correlation (0.18) is acceptable according to Clark and Watson (1995)”
From A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings (2015) · cites this paper as Clark and Watson (1995)

Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · see citing works
Psychometric theory (2nd ed.).
Sitgreaves, R. (1979) · Contemporary Psychology · doi:10.1037/018882 · Cited by 14,384 · see citing works
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195 · see citing works
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · see citing works
Negative affectivity: the disposition to experience aversive emotional states
Watson, D., & Clark, L. A. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.96.3.465 · Cited by 4,636 · see citing works
Self-citation
Handbook of Personality : Theory and Research
Pervin, L. A. (1992) · Cited by 4,543 · see citing works
Factor analysis in the development and refinement of clinical assessment instruments.
Floyd, F. J., & Widaman, K. F. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.286 · Cited by 3,970 · see citing works
Fundamentals of item response theory
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4185 · Cited by 3,417 · see citing works
Relation of sample size to the stability of component patterns.
Guadagnoli, E., & Velicer, W. F. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.2.265 · Cited by 2,880 · see citing works
Content validity in psychological assessment: A functional approach to concepts and methods.
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995) · Psychological Assessment · doi:10.1037//1040-3590.7.3.238 · Cited by 2,387 · see citing works
The role of factor analysis in the development and evaluation of personality scales
Briggs, S. R., & Cheek, J. M. (1986) · Journal of Personality · doi:10.1111/j.1467-6494.1986.tb00391.x · Cited by 2,365 · see citing works
The theory of the estimation of test reliability
Kuder, G. F., & Richardson, M. W. (1937) · Psychometrika · doi:10.1007/bf02288391 · Cited by 1,953 · see citing works
Objective Tests as Instruments of Psychological Theory
Loevinger, J. (1957) · Psychological Reports · doi:10.2466/pr0.1957.3.3.635 · Cited by 1,476 · see citing works
Untitled work
(1990) · Medical Entomology and Zoology · Cited by 1,350 · see citing works
Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance.
Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.3.552 · Cited by 1,225 · see citing works
Factor-analytic methods of scale development in personality and clinical psychology
Comrey, A. L. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.5.754 · Cited by 1,154 · see citing works
An empirically derived inventory to measure social fears and anxiety: The Social Phobia and Anxiety Inventory.
Turner, S. M., Beidel, D. C., Dancu, C. V., & Stanley, M. A. (1989) · Psychological Assessment: A Journal of Consulting and Clinical Psychology · doi:10.1037/1040-3590.1.1.35 · Cited by 887 · see citing works
Structures of personality and their relevance to psychopathology.
Watson, D., Clark, L. A., & Harkness, A. R. (1994) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.103.1.18 · Cited by 800 · see citing works
Self-citation
Untitled work
(1983) · PubMed · Cited by 734 · see citing works
Handbook of research methods in clinical psychology
(2003) · Choice Reviews Online · doi:10.5860/choice.41-2486 · Cited by 701 · see citing works
A Handbook of Test Construction: Introduction to Psychometric Design
Kline, P. (1987) · Medical Entomology and Zoology · Cited by 626 · see citing works
Current topics in clinical and community psychology
Spielberger, C. D. (1969) · Academic Press eBooks · Cited by 581 · see citing works
Limitations of Coefficient Alpha as an Index of Test Unidimensionality1
Green, S. B., Lissitz, R. W., & Mulaik, S. A. (1977) · Educational and Psychological Measurement · doi:10.1177/001316447703700403 · Cited by 522 · see citing works
Does item homogeneity indicate internal consistency or item redundancy in psychometric scales?
Boyle, G. J. (1991) · Personality and Individual Differences · doi:10.1016/0191-8869(91)90115-r · Cited by 495 · see citing works
A Sequential System for Personality Scale Development
Jackson, D. N. (1970) · Current topics in clinical and community psychology · doi:10.1016/b978-0-12-153502-5.50008-4 · Cited by 492 · see citing works
Diagnosis and Classification of Psychopathology: Challenges to the Current System and Future Directions
Clark, L. A., Watson, D., & Reynolds, S. (1995) · Annual Review of Psychology · doi:10.1146/annurev.ps.46.020195.001005 · Cited by 458 · see citing works
Self-citation
Measurement error masks bipolarity in affect ratings.
GREEN, D. P., Goldman, S. L., & Salovey, P. (1993) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.64.6.1029 · Cited by 437 · see citing works
The dynamics of “structured” personality tests
Meehl, P. E. (2000) · Journal of Clinical Psychology · doi:10.1002/(sici)1097-4679(200003)56:3 · Cited by 362 · see citing works
Component analysis versus common factor analysis: A Monte Carlo study.
Snook, S. C., & Gorsuch, R. L. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.106.1.148 · Cited by 354 · see citing works
Methodological considerations in the refinement of clinical assessment instruments.
Smith, G. T., & McCarthy, D. M. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.300 · Cited by 311 · see citing works
How should multifaceted personality constructs be tested? Issues illustrated by self-monitoring, attributional style, and hardiness.
Carver, C. S. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.56.4.577 · Cited by 289 · see citing works
The attenuation paradox in test theory.
Loevinger, J. (1954) · Psychological Bulletin · doi:10.1037/h0058543 · Cited by 198 · see citing works
Personality Assessment via Questionnaires
Angleitner, A., & Wiggins, J. S. (1986) · Springer eBooks · doi:10.1007/978-3-642-70751-3 · Cited by 195 · see citing works
Factor structure and construct validity of the Block Child Rearing Practices Report (CRPR).
Deković, M., Janssens, J., & Gerris, J. (1991) · Psychological Assessment · doi:10.1037/1040-3590.3.2.182 · Cited by 171 · see citing works
Schedule for Nonadaptive and Adaptive Personality (SNAP)
Vanderbleek, E. N., & Clark, L. A. (2018) · Springer eBooks · doi:10.1007/978-3-319-57111-9_9008 · Cited by 160 · see citing works
Self-citation
Traitedness and the assessment of response pattern scalability.
Reise, S. P., & Waller, N. G. (1993) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.65.1.143 · Cited by 114 · see citing works
Semantic Space is (Approximately) Bipolar
Bentler, P. M. (1969) · The Journal of Psychology · doi:10.1080/00223980.1969.10543067 · Cited by 112 · see citing works
Assessing psychopathology using structured test-item response latencies.
Holden, R. R., Fekken, G. C., & Cotton, D. H. G. (1991) · Psychological Assessment · doi:10.1037/1040-3590.3.1.111 · Cited by 107 · see citing works
In defense of measurement.
Green, B. F. (1978) · American Psychologist · doi:10.1037/0003-066x.33.7.664 · Cited by 78 · see citing works
Maximizing the Discriminating Power of a Multiple-Score Test
Loevinger, J., Gleser, G. C., & DuBois, P. H. (1953) · Psychometrika · doi:10.1007/bf02289266 · Cited by 58 · see citing works
Taxonomic analysis redux: Some statistical considerations for testing a latent class model.
Gangestad, S. W., & Snyder, M. (1991) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.61.1.141 · Cited by 56 · see citing works
Enhancing the precision of the Mississippi Scale for Combat-Related Posttraumatic Stress Disorder: An application of item response theory.
King, D. W., King, L. A., Fairbank, J. A., Schlenger, W. E., & Surface, C. R. (1993) · Psychological Assessment · doi:10.1037/1040-3590.5.4.457 · Cited by 44 · see citing works
The Cocaine Expectancy Questionnaire (CEQ): Construction and predictive utility.
Jaffé, A., & Kilbey, M. M. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.1.18 · Cited by 40 · see citing works

Flagged first, then by citations

1 of the 44 references couldn’t be matched to a known paper.

Sorted by citations

A new criterion for assessing discriminant validity in variance-based structural equation modeling
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-014-0403-8 · Cited by 38,459 · see citing works
Using Self-Report Assessment Methods to Explore Facets of Mindfulness
Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006) · Assessment · doi:10.1177/1073191105283504 · Cited by 7,511 · see citing works
Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00149 · Cited by 5,925 · see citing works
The Posttraumatic Stress Disorder Checklist for <i>DSM‐5</i> (PCL‐5): Development and Initial Psychometric Evaluation
Blevins, C. A., Weathers, F. W., Davis, M. T., Witte, T. K., & Domino, J. L. (2015) · Journal of Traumatic Stress · doi:10.1002/jts.22059 · Cited by 5,233 · see citing works
The meaning in life questionnaire: assessing the presence of and search for meaning in life
Steger, M. F., Frazier, P., Oishi, S., & Kaler, M. (2006) · Journal of Counseling Psychology · doi:10.1037/0022-0167.53.1.80 · Cited by 4,843 · see citing works
Preliminary Psychometric Properties of the Acceptance and Action Questionnaire–II: A Revised Measure of Psychological Inflexibility and Experiential Avoidance
Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011) · Behavior Therapy · doi:10.1016/j.beth.2011.03.007 · Cited by 3,950 · see citing works
Starting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794 · see citing works
Construct Measurement and Validation Procedures in MIS and Behavioral Research: Integrating New and Existing Techniques1
MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011) · MIS Quarterly · doi:10.2307/23044045 · Cited by 3,165 · see citing works
Assessment of Mindfulness by Self-Report: The Kentucky Inventory of Mindfulness Skills
Baer, R. A., Smith, G. T., & Allen, K. B. (2004) · Assessment · doi:10.1177/1073191104268029 · Cited by 2,298 · see citing works
Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024) · Asia Pacific Journal of Management · doi:10.1007/s10490-023-09871-y · Cited by 2,262 · see citing works
“…with second-order factors violate the assumption of unidimensionality of measures (i.e., each indicator assesses a single underlying construct; Clark & Watson, 1995), and therefore Cronbach’s alpha and CR are not appropriate reliability measures because they ignore the second-order factor…”
Market Orientation: A Meta-Analytic Review and Assessment of its Antecedents and Impact on Performance
Kirca, A. H., Jayachandran, S., & Bearden, W. O. (2005) · Journal of Marketing · doi:10.1509/jmkg.69.2.24.60761 · Cited by 2,182 · see citing works
The Clinician-Administered PTSD Scale for DSM–5 (CAPS-5): Development and initial psychometric evaluation in military veterans.
Weathers, F. W., Bovin, M. J., Lee, D. J., Sloan, D. M., Schnurr, P. P., Kaloupek, D. G., Keane, T. M., & Marx, B. P. (2018) · Psychological Assessment · doi:10.1037/pas0000486 · Cited by 1,799 · see citing works
Current Concepts in Validity and Reliability for Psychometric Instruments: Theory and Application
Cook, D. A., & Beckman, T. J. (2006) · The American Journal of Medicine · doi:10.1016/j.amjmed.2005.10.036 · Cited by 1,745 · see citing works
Validity of Antonovsky’s sense of coherence scale: a systematic review
Eriksson, M., & Lindström, B. (2005) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2003.018085 · Cited by 1,542 · see citing works
The Toronto Mindfulness Scale: Development and validation
Lau, M. A., Bishop, S. R., Segal, Z. V., Buis, T., Anderson, N. D., Carlson, L., Shapiro, S., Carmody, J., Abbey, S., & Devins, G. (2006) · Journal of Clinical Psychology · doi:10.1002/jclp.20326 · Cited by 1,456 · see citing works
Constructing validity: New developments in creating objective measuring instruments.
Clark, L. A., & Watson, D. (2019) · Psychological Assessment · doi:10.1037/pas0000626 · Cited by 1,470 · see citing works
Self-citation
The Material Values Scale: Measurement Properties and Development of a Short Form
Richins, M. L. (2004) · Journal of Consumer Research · doi:10.1086/383436 · Cited by 1,427 · see citing works
Development of the Gender Minority Stress and Resilience Measure.
Testa, R. J., Habarth, J., Peta, J., Balsam, K., & Bockting, W. (2015) · Psychology of Sexual Orientation and Gender Diversity · doi:10.1037/sgd0000081 · Cited by 1,406 · see citing works
Initial construction and validation of the Pathological Narcissism Inventory.
Pincus, A. L., Ansell, E. B., Pimentel, C. A., Cain, N. M., Wright, A. G. C., & Levy, K. N. (2009) · Psychological Assessment · doi:10.1037/a0016530 · Cited by 1,334 · see citing works
Developing and validating measures of facets of customer-based brand equity
Netemeyer, R. G., Krishnan, B., Pullig, C., Wang, G., Yagci, M. I., Dean, D. H., Ricks, J. M., & Wirth, F. F. (2003) · Journal of Business Research · doi:10.1016/s0148-2963(01)00303-4 · Cited by 1,352 · see citing works
Beyond confidence: Development of a measure assessing the 5C psychological antecedents of vaccination
Betsch, C., Schmid, P., Heinemeier, D., Korn, L., Holtmann, C., & Böhm, R. (2018) · PLoS ONE · doi:10.1371/journal.pone.0208601 · Cited by 1,276 · see citing works
The authentic personality: a theoretical and empirical conceptualization and the development of the authenticity scale
Wood, A. M., Linley, P. A., Maltby, J., Baliousis, M., & Joseph, S. (2008) · Journal of Counseling Psychology · doi:10.1037/0022-0167.55.3.385 · Cited by 1,237 · see citing works
Why employees do bad things: Moral disengagement and unethical organizational behavior
MOORE, C., DETERT, J. R., KLEBE TREVIÑO, L., BAKER, V. L., & MAYER, D. M. (2012) · Personnel Psychology · doi:10.1111/j.1744-6570.2011.01237.x · Cited by 1,159 · see citing works
Ten Steps in Scale Development and Reporting: A Guide for Researchers
Carpenter, S. (2018) · Communication Methods and Measures · doi:10.1080/19312458.2017.1396583 · Cited by 1,141 · see citing works
The Depression Anxiety Stress Scales—21 (DASS‐21): Further Examination of Dimensions, Scale Reliability, and Correlates
Osman, A., Wong, J. L., Bagge, C. L., Freedenthal, S. L., Gutierrez, P. M., & Lozano, G. (2012) · Journal of Clinical Psychology · doi:10.1002/jclp.21908 · Cited by 1,097 · see citing works
Online social media fatigue and psychological wellbeing – A study of compulsive use, fear of missing out, fatigue, anxiety and depression
Dhir, A., Yossatorn, Y., Kaur, P., & Chen, S. (2018) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.01.012 · Cited by 1,033 · see citing works
Anticipatory and consummatory components of the experience of pleasure: A scale development study
Gard, D. E., Gard, M. G., Kring, A. M., & John, O. P. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.11.001 · Cited by 1,015 · see citing works
Applying Bifactor Statistical Indices in the Evaluation of Psychological Measures
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016) · Journal of Personality Assessment · doi:10.1080/00223891.2015.1089249 · Cited by 990 · see citing works
Measurement Matters: Assessing Personal Qualities Other Than Cognitive Ability for Educational Purposes
Duckworth, A. L., & Yeager, D. S. (2015) · Educational Researcher · doi:10.3102/0013189x15584327 · Cited by 993 · see citing works
Measuring user competence in using artificial intelligence: Validity and reliability of artificial intelligence literacy scale
Wang, B., Rau, P.-L. P., & Yuan, T. (2023) · Behaviour & Information Technology · doi:10.1080/0144929x.2022.2072768 · Cited by 1,036 · see citing works
Binge eating in massively obese patients undergoing bariatric surgery
Adami, G., Gandolfo, P., Bauer, B., & Scopinaro, N. (1995) · International Journal of Eating Disorders · doi:10.1002/1098-108x(199501)17:1 · Cited by 128 · see citing works
A step-by-step approach to using SAS for factor analysis and structural equation modeling
Hatcher, L., & O’Rourke, N. (2014) · CERN Document Server (European Organization for Nuclear Research) · Cited by 949 · see citing works
The Assessment of Present-Moment Awareness and Acceptance: The Philadelphia Mindfulness Scale
Cardaciotto, L., Herbert, J. D., Forman, E. M., Moitra, E., & Farrow, V. (2008) · Assessment · doi:10.1177/1073191107311467 · Cited by 940 · see citing works
Synthesis of the psychometric properties of the PTSD checklist (PCL) military, civilian, and specific versions
Wilkins, K. C., Lang, A. J., & Norman, S. B. (2011) · Depression and Anxiety · doi:10.1002/da.20837 · Cited by 946 · see citing works
Psychometric analysis of the PTSD Checklist-5 (PCL-5) among treatment-seeking military service members.
Wortmann, J. H., Jordan, A. H., Weathers, F. W., Resick, P. A., Dondanville, K. A., Hall-Clark, B., Foa, E. B., Young-McCaughan, S., Yarvis, J. S., Hembree, E. A., et al. (2016) · Psychological Assessment · doi:10.1037/pas0000260 · Cited by 913 · see citing works
Construct Validity: Advances in Theory and Methodology
Strauss, M., & Smith, G. T. (2009) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.032408.153639 · Cited by 768 · see citing works
Developing and investigating the use of single-item measures in organizational research.
Fisher, G. G., Matthews, R. A., & Gibbons, A. M. (2015) · Journal of Occupational Health Psychology · doi:10.1037/a0039139 · Cited by 794 · see citing works
Scale development: ten main limitations and recommendations to improve future research practices
Morgado, F. F. D. R., Meireles, J. F. F., Neves, C. M., Amaral, A. C. S., & Ferreira, M. E. C. (2017) · Psicologia Reflexão e Crítica · doi:10.1186/s41155-016-0057-1 · Cited by 790 · see citing works
A Review of Key Likert Scale Development Advances: 1995–2019
Jebb, A. T., Ng, V., & Tay, L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.637547 · Cited by 932 · see citing works
How can we conceptualize behavioural addiction without pathologizing common behaviours?
Kardefelt‐Winther, D., Heeren, A., Schimmenti, A., van Rooij, A., Maurage, P., Carras, M., Edman, J., Blaszczynski, A., Khazaal, Y., & Billieux, J. (2017) · Addiction · doi:10.1111/add.13763 · Cited by 780 · see citing works
The Psychology of Worldviews
Koltko-Rivera, M. E. (2004) · Review of General Psychology · doi:10.1037/1089-2680.8.1.3 · Cited by 788 · see citing works
Multidimensionality and Structural Coefficient Bias in Structural Equation Modeling: A Bifactor Perspective
Reise, S. P., Scheines, R., Widaman, K. F., & Haviland, M. G. (2013) · Educational and Psychological Measurement · doi:10.1177/0013164412449831 · Cited by 766 · see citing works
Validation of a new scale for measuring problematic Internet use: Implications for pre-employment screening
Davis, R. A., Flett, G. L., & Besser, A. (2002) · CyberPsychology & Behavior · doi:10.1089/109493102760275581 · Cited by 750 · see citing works
Development and validation of the Inventory of Depression and Anxiety Symptoms (IDAS).
Watson, D., O'Hara, M. W., Simms, L. J., Kotov, R., Chmielewski, M., McDade-Montez, E. A., Gamez, W., & Stuart, S. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.3.253 · Cited by 740 · see citing works
Self-citation
Measurement and Mismeasurement of Mood: Recurrent and Emergent issues
Watson, D., & Clark, L. A. (1997) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6802_4 · Cited by 720 · see citing works
Self-citation
The big five personality dimensions and job performance
Rothmann, S., & Coetzer, E. P. (2003) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v29i1.88 · Cited by 717 · see citing works
A Generalized Multidimensional Scale for Measuring Customer Engagement
Vivek, S. D., Beatty, S. E., Dalela, V., & Morgan, R. M. (2014) · The Journal of Marketing Theory and Practice · doi:10.2753/mtp1069-6679220404 · Cited by 742 · see citing works
Construct Validation in Social and Personality Research
Flake, J. K., Pek, J. C. X., & Hehman, E. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617693063 · Cited by 715 · see citing works
The Italian Version of the Depression Anxiety Stress Scales-21: Factor Structure and Psychometric Properties on Community and Clinical Samples
Bottesi, G., Ghisi, M., Altoè, G., Conforti, E., Melli, G., & Sica, C. (2015) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2015.04.005 · Cited by 701 · see citing works
Social Media, Political Expression, and Political Participation: Panel Analysis of Lagged and Concurrent Relationships
de Zúñiga, H. G., Molyneux, L., & Zheng, P. (2014) · Journal of Communication · doi:10.1111/jcom.12103 · Cited by 649 · see citing works
The development of a financial toxicity patient‐reported outcome in cancer: The COST measure
de Souza, J. A., Yap, B. J., Hlubocky, F. J., Wroblewski, K., Ratain, M. J., Cella, D. F., & Daugherty, C. K. (2014) · Cancer · doi:10.1002/cncr.28814 · Cited by 695 · see citing works
Firms Reap what they Sow: The Effects of Shared Values and Perceived Organizational Justice on Customers’ Evaluations of Complaint Handling
Maxham, J. G., & Netemeyer, R. G. (2003) · Journal of Marketing · doi:10.1509/jmkg.67.1.46.18591 · Cited by 649 · see citing works
On orthorexia nervosa: A review of the literature and proposed diagnostic criteria
Dunn, T. M., & Bratman, S. (2016) · Eating Behaviors · doi:10.1016/j.eatbeh.2015.12.006 · Cited by 635 · see citing works
One Size Doesn’t Fit All: Using Factor Analysis to Gather Validity Evidence When Using Surveys in Your Research
Knekta, E., Runyon, C., & Eddy, S. L. (2019) · CBE—Life Sciences Education · doi:10.1187/cbe.18-04-0064 · Cited by 694 · see citing works
Psychometric properties of the State-Trait Inventory for Cognitive and Somatic Anxiety (STICSA): Comparison to the State-Trait Anxiety Inventory (STAI).
Grös, D. F., Antony, M. M., Simms, L. J., & McCabe, R. E. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.4.369 · Cited by 615 · see citing works
Toward a theory of distinct types of “impulsive” behaviors: A meta-analysis of self-report and behavioral measures.
Sharma, L., Markon, K. E., & Clark, L. A. (2014) · Psychological Bulletin · doi:10.1037/a0034418 · Cited by 630 · see citing works
Self-citation
Adaptational Style and Dispositional Structure: Coping in the Context of the Five‐Factor Model
Watson, D., & Hubbard, B. (1996) · Journal of Personality · doi:10.1111/j.1467-6494.1996.tb00943.x · Cited by 624 · see citing works
Self-citation
Mental illness stigma and ethnocultural beliefs, values, and norms: An integrative review
Abdullah, T., & Brown, T. L. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.05.003 · Cited by 661 · see citing works
The Sources of Meaning and Meaning in Life Questionnaire (SoMe): Relations to demographics and well-being
Schnell, T. (2009) · The Journal of Positive Psychology · doi:10.1080/17439760903271074 · Cited by 625 · see citing works
DSM-Oriented and empirically based approaches to constructing scales from the same item pools
Achenbach, T. M., Dumenci, L., & Rescorla, L. A. (2003) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3203_02 · Cited by 615 · see citing works
Taking Stock of Moral Approaches to Leadership: An Integrative Review of Ethical, Authentic, and Servant Leadership
Lemoine, G. J., Hartnell, C. A., & Leroy, H. (2019) · Academy of Management Annals · doi:10.5465/annals.2016.0121 · Cited by 614 · see citing works
Psychometric Evaluation of the Moral Injury Events Scale
Nash, W. P., Carper, T. L. M., Mills, M. A., Au, T. M., Goldsmith, A. A., & Litz, B. T. (2013) · Military Medicine · doi:10.7205/milmed-d-13-00017 · Cited by 620 · see citing works
ISSUES AND STRATEGIES FOR REDUCING THE LENGTH OF SELF‐REPORT SCALES
Stanton, J. M., Sinar, E. F., Balzer, W. K., & Smith, P. C. (2002) · Personnel Psychology · doi:10.1111/j.1744-6570.2002.tb00108.x · Cited by 608 · see citing works
A Brief Instrument to Assess Both Burnout and Professional Fulfillment in Physicians: Reliability and Validity, Including Correlation with Self-Reported Medical Errors, in a Sample of Resident and Practicing Physicians
Trockel, M., Bohman, B., Lesure, E., Hamidi, M. S., Welle, D., Roberts, L., & Shanafelt, T. (2018) · Academic Psychiatry · doi:10.1007/s40596-017-0849-3 · Cited by 602 · see citing works
Trust in News Media
Kohring, M., & Matthes, J. (2007) · Communication Research · doi:10.1177/0093650206298071 · Cited by 600 · see citing works
Deployment Risk and Resilience Inventory: A Collection of Measures for Studying Deployment-Related Experiences of Military Personnel and Veterans
King, L. A., King, D. W., Vogt, D. S., Knight, J., & Samper, R. E. (2006) · Military Psychology · doi:10.1207/s15327876mp1802_1 · Cited by 599 · see citing works
Development and validation of the Sociocultural Attitudes Towards Appearance Questionnaire-4 (SATAQ-4).
Schaefer, L. M., Burke, N. L., Thompson, J. K., Dedrick, R. F., Heinberg, L. J., Calogero, R. M., Bardone‐Cone, A. M., Higgins, M. K., Frederick, D. A., Kelly, M. C., et al. (2014) · Psychological Assessment · doi:10.1037/a0037917 · Cited by 591 · see citing works
Computing whether she belongs: Stereotypes undermine girls’ interest and sense of belonging in computer science.
Master, A., Cheryan, S., & Meltzoff, A. N. (2015) · Journal of Educational Psychology · doi:10.1037/edu0000061 · Cited by 607 · see citing works
Motivations for sex and risky sexual behavior among adolescents and young adults: A functional perspective.
Cooper, M. L., Shapiro, C. M., & Powers, A. M. (1998) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.75.6.1528 · Cited by 583 · see citing works
Motivations for sex and risky sexual behavior among adolescents and young adults: A functional perspective.
Cooper, M. L., Shapiro, C. M., & Powers, A. M. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.75.6.1528 · Cited by 586 · see citing works
A Systematic Review of Human Resource Management Systems and Their Measurement
Boon, C. T., den Hartog, D. D., & Lepak, D. (2019) · Journal of Management · doi:10.1177/0149206318818718 · Cited by 523 · see citing works
The Construct Validity and Refinement of Process-Based Policing Measures
Reisig, M. D., Bratton, J., & Gertz, M. G. (2007) · Criminal Justice and Behavior · doi:10.1177/0093854807301275 · Cited by 564 · see citing works
An Overview of Coefficient Alpha and a Reliability Matrix for Estimating Adequacy of Internal Consistency Coefficients with Psychological Research Measures
Ponterotto, J. G., & Ruckdeschel, D. E. (2007) · Perceptual and Motor Skills · doi:10.2466/pms.105.3.997-1014 · Cited by 555 · see citing works
Development of a Measure of Experiential Avoidance: The Multidimensional Experiential Avoidance Questionnaire
Gámez, W., Chmielewski, M., Kotov, R., Ruggero, C., & Watson, D. (2011) · Psychological Assessment · doi:10.1037/a0023242 · Cited by 524 · see citing works
Self-citation
Clinical handbook of mindfulness
(2009) · doi:10.1007/978-0-387-09593-6 · Cited by 543 · see citing works
Horton and Wohl revisited: exploring viewers’ experience of parasocial interaction
Hartmann, T., & Goldhoorn, C. (2011) · Journal of Communication · doi:10.1111/j.1460-2466.2011.01595.x · Cited by 569 · see citing works
Beyond work and family: A measure of work/nonwork interference and enhancement.
Fisher, G. G., Bulger, C. A., & Smith, C. S. (2009) · Journal of Occupational Health Psychology · doi:10.1037/a0016737 · Cited by 735 · see citing works
Toward DSM—V and the classification of psychopathology.
Widiger, T. A., & Clark, L. A. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.6.946 · Cited by 540 · see citing works
Self-citation
Methodological issues in interviewing and using self-report questionnaires with people with mental retardation.
Finlay, W. M. L., & Lyons, E. (2001) · Psychological Assessment · doi:10.1037/1040-3590.13.3.319 · Cited by 521 · see citing works
Linking Green Human Resource Management Practices to Environmental Performance in Hotel Industry
Yusoff, Y. M., Nejati, M., Kee, D. M. H., & Amran, A. (2018) · Global Business Review · doi:10.1177/0972150918779294 · Cited by 520 · see citing works
Psychological inflexibility in childhood and adolescence: development and evaluation of the Avoidance and Fusion Questionnaire for Youth
Greco, L. A., Lambert, W., & Baer, R. A. (2008) · Psychological Assessment · doi:10.1037/1040-3590.20.2.93 · Cited by 514 · see citing works
A Multiple Motives Approach to Tobacco Dependence: The Wisconsin Inventory of Smoking Dependence Motives (WISDM-68).
Piper, M. E., Piasecki, T. M., Federman, E. B., Bolt, D. M., Smith, S. S., Fiore, M. C., & Baker, T. B. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.2.139 · Cited by 510 · see citing works
Development and Validation of the Calling and Vocation Questionnaire (CVQ) and Brief Calling Scale (BCS)
Dik, B. J., Eldridge, B. M., Steger, M. F., & Duffy, R. D. (2012) · Journal of Career Assessment · doi:10.1177/1069072711434410 · Cited by 513 · see citing works
Development and validation of the Eating Pathology Symptoms Inventory (EPSI).
Forbush, K. T., Wildes, J. E., Pollack, L. O., Dunbar, D., Luo, J., Patterson, K., Petruzzi, L. J., Pollpeter, M. J., Miller, H. L., Stone, A. M., et al. (2013) · Psychological Assessment · doi:10.1037/a0032639 · Cited by 506 · see citing works
Self-citation
Disentangling Components of Flexibility via the Hexaflex Model: Development and Validation of the Multidimensional Psychological Flexibility Inventory (MPFI)
Rolffs, J. L., Rogge, R. D., & Wilson, K. G. (2018) · Assessment · doi:10.1177/1073191116645905 · Cited by 504 · see citing works
The development and validation of the comprehensive assessment of acceptance and commitment therapy processes (CompACT)
Francis, A. W., Dawson, D. L., & Golijani-Moghaddam, N. (2016) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2016.05.003 · Cited by 496 · see citing works
The five-dimensional curiosity scale: Capturing the bandwidth of curiosity and identifying four unique subgroups of curious people
Kashdan, T. B., Stiksma, M. C., Disabato, D. J., McKnight, P. E., Bekier, J., Kaji, J., & Lazarus, R. (2017) · Journal of Research in Personality · doi:10.1016/j.jrp.2017.11.011 · Cited by 499 · see citing works
Development and Validation of New Anxiety and Bipolar Symptom Scales for an Expanded Version of the IDAS (the IDAS-II)
Watson, D., O’Hara, M. W., Naragon-Gainey, K., Koffel, E., Chmielewski, M., Kotov, R., Stasik, S. M., & Ruggero, C. J. (2012) · Assessment · doi:10.1177/1073191112449857 · Cited by 470 · see citing works
Self-citation
The Concept of Mental Toughness: Tests of Dimensionality, Nomological Network, and Traitness
Gucciardi, D. F., Hanton, S., Gordon, S., Mallett, C. J., & Temby, P. (2014) · Journal of Personality · doi:10.1111/jopy.12079 · Cited by 544 · see citing works
The Measurement of Curiosity As a Feeling of Deprivation
Litman, J. A., & Jimerson, T. L. (2004) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8202_3 · Cited by 481 · see citing works
Development of a Scale to Measure Professional Skepticism
Hurtt, R. K. (2010) · Auditing A Journal of Practice & Theory · doi:10.2308/aud.2010.29.1.149 · Cited by 476 · see citing works
Green marketing orientation: Conceptualization, scale development and validation
Papadas, K. A., Avlonitis, G. J., & Carrigan, M. (2017) · Journal of Business Research · doi:10.1016/j.jbusres.2017.05.024 · Cited by 528 · see citing works
The brief experiential avoidance questionnaire: Development and initial validation
Gámez, W., Chmielewski, M., Kotov, R., Ruggero, C., Suzuki, N., & Watson, D. (2014) · Psychological Assessment · doi:10.1037/a0034473 · Cited by 450 · see citing works
Self-citation
Brand origin recognition accuracy: its antecedents and consumers’ cognitive limitations
Samiee, S., Shimp, T. A., & Sharma, S. (2005) · Journal of International Business Studies · doi:10.1057/palgrave.jibs.8400145 · Cited by 456 · see citing works
The Relation among Organizational Culture, Knowledge Management, and Innovation Capability: Its Implication for Open Innovation
Lam, L. N. H., Nguyen, P. V., Le, N. T. T., & Tran, K. T. (2021) · Journal of Open Innovation Technology Market and Complexity · doi:10.3390/joitmc7010066 · Cited by 543 · see citing works
Translation and Validation of Body Image Instruments: Challenges, Good Practice Guidelines, and Reporting Recommendations for Test Adaptation
Swami, V., & Barron, D. (2019) · Body Image · doi:10.1016/j.bodyim.2018.08.014 · Cited by 454 · see citing works
The Alzheimer's Disease Knowledge Scale: Development and Psychometric Properties
Carpenter, B. D., Balsis, S. M., Otilingam, P. G., Hanson, P. K., & Gatz, M. (2009) · The Gerontologist · doi:10.1093/geront/gnp023 · Cited by 452 · see citing works
Internet Privacy Concerns and Social Awareness as Determinants of Intention to Transact
Dinev, T., & Hart, P. (2005) · International Journal of Electronic Commerce · doi:10.2753/jec1086-4415100201 · Cited by 448 · see citing works
Assessing the basic traits associated with psychopathy: Development and validation of the Elemental Psychopathy Assessment.
Lynam, D. R., Gaughan, E. T., Miller, J. D., Miller, D. J., Mullins‐Sweatt, S. N., & Widiger, T. A. (2010) · Psychological Assessment · doi:10.1037/a0021146 · Cited by 442 · see citing works
Microaggressions
Lilienfeld, S. O. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691616659391 · Cited by 437 · see citing works

Authors: Clark, L. A., & Watson, D.
Affiliations: University of Iowa (US)
University of Notre Dame (US)
ORCID: Clark, Lee Anna
Watson, David
Venue: Psychological Assessment
Publisher: American Psychological Association (APA)
Published: 1995-09
Volume: 7
Issue: 3
Pages: 309-319
ISSN: 1040-3590 (ISSN-L)
1939-134X
DOI: 10.1037/1040-3590.7.3.309
OpenAlex: W2005364767
Cited by: 6,567
References: 44
Citations by year: 2026: 393 · 2025: 319 · 2024: 313 · 2023: 343 · 2022: 337 · 2021: 455 · 2020: 420 · 2019: 404 · 2018: 432 · 2017: 359 · 2016: 357 · 2015: 352 · 2014: 353 · 2013: 269 · 2012: 248
FWCI: 18.16
Type: journal article
Language: en
Open access: closed
Locations: Psychological Assessment (publishedVersion)
Topics: Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Education › Health Education and Validation
Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
Keywords: construct validity, scale development, item pool, item wording, unidimensionality, internal consistency, factor analysis, discriminant validity, subscales, construct conceptualization

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Constructing validity: Basic issues in objective scale development.

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks