Incremental Validity Principles in Test Construction.
Abstract
The authors articulate 5 basic principles for enhancing incremental validity, both among elements within a test and between tests, during test construction: (a) careful, precise articulation of each element or facet within the content domain; (b) reliable measurement of each facet through use of multiple, alternate-form items; (c) examination of incremental validity at the facet level rather than the broad construct level; (d) use of items that represent single facets rather than combinations of facets; and (e) empirical examination of whether there is a broad construct or a combination of separate constructs. Using these principles, the authors offer specific suggestions for modifications in 3 classic test construction approaches; (a) criterion keying, (b) inductive test construction, and (c) deductive test construction. Implementation of these suggestions is likely to provide theoretical clarification and improved prediction.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Reliable assessment of clearly specified facets within a test is the most informative way of evaluating incremental validity.
“Smith et al. (2003) argued that reliable assessment of clearly specified facets within a test is the most informative way of evaluating incremental validity.”
From Using Self-Report Assessment Methods to Explore Facets of Mindfulness (2006) · cites this paper as Smith et al. (2003)
Items loading on more than one factor may be less useful than those loading on a single factor because they can obscure the facet structure of the instrument, the relationships between facets and other measures, and the incremental validity of some facets over others.
“As Smith et al. (2003) have noted, such items may be less useful than those loading on a single factor because they can obscure the facet structure of the instrument, the relationships between facets and other measures, and the incremental validity of some facets over others in predicting relevant variables.”
From Using Self-Report Assessment Methods to Explore Facets of Mindfulness (2006) · cites this paper as Smith et al. (2003)
Cites
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195 · see citing works
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567 · see citing works
Content validity in psychological assessment: A functional approach to concepts and methods.
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995) · Psychological Assessment · doi:10.1037//1040-3590.7.3.238 · Cited by 2,387 · see citing works
Factor-analytic methods of scale development in personality and clinical psychology
Comrey, A. L. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.5.754 · Cited by 1,154 · see citing works
Multidimensional constructs in organizational behavior research: an integrative analytical framework
Edwards, J. R. (2001) · Organizational Research Methods · doi:10.1177/109442810142004 · Cited by 1,128 · see citing works
Hohlstein, L. A., Smith, G. T., & Atlas, J. G. (1998) · Psychological Assessment · doi:10.1037/1040-3590.10.1.49 · Cited by 263 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Using Self-Report Assessment Methods to Explore Facets of Mindfulness
Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006) · Assessment · doi:10.1177/1073191105283504 · Cited by 7,511 · see citing works
“Smith et al. (2003) argued that reliable assessment of clearly specified facets within a test is the most informative way of evaluating incremental validity.”
BackgroundSelf-citationBaer, R. A., Smith, G. T., Lykins, E., Button, D., Krietemeyer, J., Sauer, S., Walsh, E., Duggan, D., & Williams, J. M. G. (2008) · Assessment · doi:10.1177/1073191107313003 · Cited by 2,930 · see citing works
Self-citationAssessment of Mindfulness by Self-Report: The Kentucky Inventory of Mindfulness Skills
Baer, R. A., Smith, G. T., & Allen, K. B. (2004) · Assessment · doi:10.1177/1073191104268029 · Cited by 2,298 · see citing works
Self-citationThe validity of the multi-informant approach to assessing child and adolescent mental health.
Reyes, A. D. L., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. A. (2015) · Psychological Bulletin · doi:10.1037/a0038498 · Cited by 1,706 · see citing works
“That is, the expertise of each informant should result in reports from which scores reflect different facets of patients' concerns (i.e., different contexts in which patients display concerns; see also Smith et al., 2003).”
Cyders, M. A., Smith, G. T., Spillane, N. S., Fischer, S., Annus, A. M., & Peterson, C. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.1.107 · Cited by 1,193 · see citing works
Self-citationA Review of Key Likert Scale Development Advances: 1995–2019
Jebb, A. T., Ng, V., & Tay, L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.637547 · Cited by 933 · see citing works
Construct Validity: Advances in Theory and Methodology
Strauss, M. E., & Smith, G. T. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.032408.153639 · Cited by 806 · see citing works
“N IH -PA Author M anuscript N IH -PA Author M anuscript N IH -PA Author M anuscript unidimensional symptoms as the preferred objects of theoretical study and measure validation (Edwards 2001; McGrath 2005; Smith et al. 2003; Smith & Combs, 2008).”
BackgroundSelf-citationOn the Validity and Utility of Discriminating Among Impulsivity-Like Traits
Smith, G. T., Fischer, S. F., Cyders, M., Annus, A. M., Spillane, N. S., & McCarthy, D. (2007) · Assessment (Odessa, Fla.) · doi:10.1177/1073191106295527 · Cited by 629 · see citing works
“This occurs because one is, essentially, averaging the predictive variance of one facet with the nonpredictive variance of the other (Smith et al., 2003).”
BackgroundSelf-citationCyders, M., & Coskunpinar, A. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.06.001 · Cited by 547 · see citing works
Coskunpinar, A., Dir, A. L., & Cyders, M. A. (2013) · Alcoholism: Clinical and Experimental Research · doi:10.1111/acer.12131 · Cited by 541 · see citing works
A Systematic Review of Human Resource Management Systems and Their Measurement
Boon, C. T., den Hartog, D. D., & Lepak, D. (2019) · Journal of Management · doi:10.1177/0149206318818718 · Cited by 523 · see citing works
“The item types used are increasingly mixed, resulting in ambiguous scales with heterogeneous items that may not represent the same underlying construct (cf. Strauss & Smith, 2009).”
InfluentialThe Assessment of Mindfulness with Self-Report Measures: Existing Scales and Open Issues
Bergomi, C., Tschacher, W., & Kupper, Z. (2013) · Mindfulness · doi:10.1007/s12671-012-0110-9 · Cited by 506 · see citing works
“This is an important limitation for the analysis of the differential contributions of each aspect of mindfulness and of their association with other constructs (Smith et al. 2003; Smith and McCarthy 1995).”
BackgroundAssessing relationship quality in mandated community treatment: Blending care with control.
Skeem, J. L., Louden, J. E., Polaschek, D. L. L., & Camp, J. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.4.397 · Cited by 426 · see citing works
“In this section, we describe each of these main findings.”
Baer, R. A., Lykins, E. L. B., & Peters, J. R. (2012) · The Journal of Positive Psychology · doi:10.1080/17439760.2012.674548 · Cited by 389 · see citing works
“Van Dam et al. (2011) also suggested that self-compassion may be easier to assess than mindfulness because the SCS measures attitudes toward the self, whereas the MAAS measures frequency of past conscious states, which may be difficult for many people to report on.”
InfluentialThe role of fearless dominance in psychopathy: confusions, controversies, and clarifications.
Lilienfeld, S., Patrick, C. J., Benning, S., Berg, J. M., Sellbom, M., & Edens, J. (2012) · Personality disorders · doi:10.1037/a0026987 · Cited by 355 · see citing works
Incremental Validity of New Clinical Assessment Measures.
Haynes, S. N., & Lench, H. C. (2003) · Psychological Assessment · doi:10.1037/1040-3590.15.4.456 · Cited by 324 · see citing works
“This process presumably results in a homogeneous, internally consistent, and robust measure that taps the intended construct with minimal error (see Smith et al., 2003, for recommendations regarding instrument development).”
BackgroundInfluentialFischer, S. F., Smith, G. T., & Cyders, M. (2008) · Clinical Psychology Review · doi:10.1016/j.cpr.2008.09.001 · Cited by 333 · see citing works
Self-citationDiez pasos para la construcción de un test
Muñiz, J., & Fonseca-Pedrero, E. (2019) · Psicothema · doi:10.7334/psicothema2018.291 · Cited by 330 · see citing works
“Hay que evitar dejar fuera alguna faceta o dominio relevante (infrarrepresentación), así como ponderar en demasía una faceta o dominio (sobrerrepresentación) de la variable (Smith et al., 2003).”
On Construct Validity: Issues of Method and Measurement.
Smith, G. T. (2005) · Psychological Assessment · doi:10.1037/1040-3590.17.4.396 · Cited by 291 · see citing works
“Clinical prediction is often improved with such differentiation (Smith et al., 2003).”
BackgroundSelf-citationMindfulness and Counseling Self‐Efficacy: The Mediating Role of Attention and Empathy
Greason, P. B., & Cashwell, C. S. (2009) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.2009.tb00083.x · Cited by 272 · see citing works
Not all mind wandering is created equal: dissociating deliberate from spontaneous mind wandering
Seli, P., Carriere, J. S. A., & Smilek, D. (2015) · Psychological Research · doi:10.1007/s00426-014-0617-x · Cited by 262 · see citing works
Lying takes time: A meta-analysis on reaction time measures of deception.
Suchotzki, K., Verschuère, B., Bockstaele, B. V., Ben‐Shakhar, G., & Crombez, G. (2017) · Psychological Bulletin · doi:10.1037/bul0000087 · Cited by 288 · see citing works
Statistical Control Requires Causal Justification
Wysocki, A. C., Lawson, K. M., & Rhemtulla, M. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221095823 · Cited by 236 · see citing works
“The first is to establish the clinical usefulness of a test to predict a specific criterion (Smith et al., 2003).”
BackgroundFiguring out la femme fatale: conceptual and assessment issues concerning psychopathy in females.
Forouzan, E., & Cooke, D. (2005) · Behavioral sciences & the law · doi:10.1002/bsl.669 · Cited by 224 · see citing works
Dir, A. L., Coskunpinar, A., Steiner, J., & Cyders, M. (2013) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2012.0545 · Cited by 211 · see citing works
“34 We also thought that expectancies could differ based on sending sext messages and receiving sext messages, as these are unique behavioral outcomes.”
Assessing Psychological Flexibility: What Does It Add Above and Beyond Existing Constructs?
Gloster, A. T., Klotsche, J., Chaker, S., Hummel, K. V., & Hoyer, J. (2011) · Psychological Assessment · doi:10.1037/a0024135 · Cited by 206 · see citing works
The general factor of psychopathology
Smith, G. T., Atkinson, E. A., Davis, H. A., Riley, E. N., & Oltmanns, J. R. (2020) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-071119-115848 · Cited by 195 · see citing works
“To understand the clinical utility of p as an index of overall impairment, we argue that the presence of p must be understood along with other findings that support focusing on lower-level, homogeneous constructs (McGrath 2005, Smith et al. 2003, Smith & McCarthy 1995, Strauss & Smith 2009).”
Self-citationCooke, D., Hart, S., Logan, C., & Michie, C. (2012) · International Journal of Forensic Mental Health · doi:10.1080/14999013.2012.746759 · Cited by 194 · see citing works
“This latter finding has theoretical significance because multifaceted traits are combinations of domains that covary because of some underlying common cause whereas compound traits are merely combinations of distinct constructs (Cooke et al., 2007; Smith et al., 2003).”
BackgroundSmith, G. T., McCarthy, D., & Zapolski, T. (2009) · Psychological Assessment · doi:10.1037/a0016699 · Cited by 190 · see citing works
“If one uses single scores from multidimensional tests, one has simply moved the heterogeneity problem from the item level to the scale level (Smith et al., 2003).”
BackgroundSelf-citationSkeem, J., & Cooke, D. (2010) · Psychological Assessment · doi:10.1037/a0014862 · Cited by 175 · see citing works
Measuring Mindfulness: First Steps Towards the Development of a Comprehensive Mindfulness Scale
Bergomi, C., Tschacher, W., & Kupper, Z. (2013) · Mindfulness · doi:10.1007/s12671-012-0102-9 · Cited by 173 · see citing works
“An important research issue is the need to measure complex constructs at the component level, which allows testing hypotheses about their relationships with other variables (Hough and Schneider 1995; Smith et al. 2003; Smith and McCarthy 1995).”
BackgroundUnderstanding the structure of the Psychopathy Checklist – Revised
Cooke, D. J., Michie, C., & Skeem, J. L. (2007) · The British Journal of Psychiatry · doi:10.1192/bjp.190.5.s39 · Cited by 175 · see citing works
A meta-analysis of the relationship between trait mindfulness and substance use behaviors
Karyadi, K. A., VanderVeen, J. D., & Cyders, M. A. (2014) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2014.07.014 · Cited by 158 · see citing works
“Collapsing across different mindfulness facets (e.g. observing, describing, acting with awareness, nonreactivity , and non-judgment) could weaken or obscure the robust relationship of specific facets of mindfulness with substance use behaviors (see Smith et al., 2003).”
BackgroundHaynes, S. N., Mumma, G. H., & Pinson, C. (2009) · Clinical Psychology Review · doi:10.1016/j.cpr.2008.12.003 · Cited by 142 · see citing works
David, E. J., & Okazaki, S. (2006) · Journal of Counseling Psychology · doi:10.1037/0022-0167.53.2.241 · Cited by 149 · see citing works
UPPS-P model impulsivity and marijuana use behaviors in adolescents: A meta-analysis
VanderVeen, J. D., Hershberger, A. R., & Cyders, M. A. (2016) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2016.09.016 · Cited by 151 · see citing works
The Big Three Perfectionism Scale
Smith, M. M., Saklofske, D. H., Stoeber, J., & Sherry, S. (2016) · Journal of Psychoeducational Assessment · doi:10.1177/0734282916651539 · Cited by 210 · see citing works
“Additionally, as noted by Smith et al. (2003), the theoretical contention that broad factors underlie groups of facets must be empirically tested, rather than assumed.”
The relationship between self-report and lab task conceptualizations of impulsivity
Cyders, M. A., & Coskunpinar, A. (2012) · Journal of Research in Personality · doi:10.1016/j.jrp.2011.11.005 · Cited by 136 · see citing works
Lilienfeld, S., Smith, S. F., Sauvigné, K. C., Patrick, C. J., Drislane, L. E., Latzman, R. D., & Krueger, R. (2016) · Psychological Assessment · doi:10.1037/pas0000244 · Cited by 134 · see citing works
Incremental Validity of the Trait Emotional Intelligence Questionnaire–Short Form (TEIQue–SF)
Siegling, A., Vesely, A. K., Petrides, K., & Saklofske, D. (2015) · Journal of Personality Assessment · doi:10.1080/00223891.2015.1013219 · Cited by 119 · see citing works
Mezo, P. G. (2008) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-008-9104-2 · Cited by 106 · see citing works
“All things being equal, constituent components of a construct are, by definition, less reliable and valid than the construct as a whole (Smith et al. 2003).”
BackgroundMills, M., & Fullagar, C. J. A. (2008) · The Journal of psychology · doi:10.3200/jrlp.142.5.533-556 · Cited by 105 · see citing works
Michalak, J., Zarbock, G., Drews, M., Otto, D., Mertens, D., Ströhle, G., Schwinger, M., Dahme, B., & Heidenreich, T. (2016) · Zeitschrift für Gesundheitspsychologie · doi:10.1026/0943-8149/a000149 · Cited by 118 · see citing works
Construct Validity of Adolescents’ Self-Reported Big Five Personality Traits
Morizot, J. (2014) · Assessment · doi:10.1177/1073191114524015 · Cited by 91 · see citing works
“In principle, to be valid, short measures should have items tapping all of the most important primary traits subsumed in a given Big Five trait (Haynes et al., 1995; Smith et al., 2003).”
BackgroundKreis, M. K. F., Cooke, D. J., Michie, C., Hoff, H. A., & Logan, C. (2012) · Journal of Personality Disorders · doi:10.1521/pedi.2012.26.3.402 · Cited by 99 · see citing works
Impulsivity and substance-related attentional bias: a meta-analytic review.
Coskunpinar, A., & Cyders, M. (2013) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2013.05.008 · Cited by 87 · see citing works
Appraisals and Suicidality: The Mediating Role of Defeat and Entrapment
Taylor, P. J., Wood, A. M., Gooding, P., & Tarrier, N. (2010) · Archives of Suicide Research · doi:10.1080/13811118.2010.494138 · Cited by 79 · see citing works
“Nevertheless, low internal reliability does not increase the likelihood of spurious results, but will instead reduce the strength of the correlations this variable shares with others (Smith, Fischer, & Fister, 2003 ; Zuckerman, Hodgins, Zuckerman et al, 1993).”
BackgroundSpinhoven, P., Drost, J., de Rooij, M., van Hemert, A. M., & Penninx, B. W. J. H. (2016) · Cognitive Therapy and Research · doi:10.1007/s10608-015-9747-8 · Cited by 76 · see citing works
“…is replete with constructs that have difficulty establishing incremental validity above and beyond those that came before (Haynes and Lench 2003; Smith et al. 2003), it is crucial to study into more detail how experiential avoidance works together with other psychological constructs in…”
BackgroundThe Personal Acquaintance Measure: a tool for appraising one's acquaintance with any person.
Starzyk, K. B., Holden, R., Fabrigar, L., & MacDonald, T. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.90.5.833 · Cited by 76 · see citing works
Introduction to the special section on incremental validity and utility in clinical assessment.
Hunsley, J. (2003) · Psychological Assessment · doi:10.1037/1040-3590.15.4.443 · Cited by 76 · see citing works
Hughes, D. J. (2018) · Wiley eBooks · doi:10.1002/9781118489772.ch24 · Cited by 79 · see citing works
Does Personal Intelligence Exist? Evidence From a New Ability-Based Measure
Mayer, J. D., Panter, A. T., & Caruso, D. R. (2012) · Journal of Personality Assessment · doi:10.1080/00223891.2011.646108 · Cited by 67 · see citing works
“Treatments of test validity argue that a new test must measure qualities that are both (a) independent of conceptually unrelated measures, and yet (b) exhibit correlations that one might expect of the new concept ( Clark & Watson, 1995 ; Smith, Fischer, & Fister, 2003 ).”
BackgroundHoff, H., Rypdal, K., Mykletun, A., & Cooke, D. (2012) · Journal of Personality Disorders · doi:10.1521/pedi.2012.26.3.414 · Cited by 70
HJEMDAL, O., FRIBORG, O., & STILES, T. C. (2012) · Scandinavian Journal of Psychology · doi:10.1111/j.1467-9450.2011.00928.x · Cited by 67 · see citing works
Siegling, A. B., & Petrides, K. V. (2016) · PLOS ONE · doi:10.1371/journal.pone.0153073 · Cited by 66 · see citing works
“The problem is that such facets compromise the validity and explanatory effects of the global composite and measure when combined with the other facets [46].”
BackgroundStröhle, G., Nachtigall, C., Michalak, J., & Heidenreich, T. (2010) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/1616-3443/a000001 · Cited by 64 · see citing works
Fergus, T. A., Valentiner, D. P., McGrath, P. B., Gier-Lonsway, S. L., & Jencius, S. T. (2013) · Psychiatry Research · doi:10.1016/j.psychres.2013.04.020 · Cited by 53 · see citing works
“Specifically, if future research finds that the CAS-1 is multidimensional, use of the total scale would essentially provide an average of the correlations between the CAS-1 dimensions and criteria (Smith et al., 2003).”
BackgroundThe Acceptance of Myths About Intimate Partner Violence Against Women (AMIVAW) Scale
Megías, J. L., Toro-García, V., & Carretero-Dios, H. (2018) · Psychology of Women Quarterly · doi:10.1177/0361684317742638 · Cited by 55 · see citing works
Theory and utility--key themes in evidence-based assessment: comment on the special section.
Mcfall, R. M. (2005) · Psychological Assessment · doi:10.1037/1040-3590.17.3.312 · Cited by 51 · see citing works
Noninvasive Psychophysiological Ambulatory Recordings
Houtveen, J. H., & de Geus, E. J. C. (2009) · European Psychologist · doi:10.1027/1016-9040.14.2.132 · Cited by 46 · see citing works
Is psychopathy a syndrome? Commentary on Marcus, Fulton, and Edens.
Lilienfeld, S. (2013) · Personality disorders · doi:10.1037/a0027544 · Cited by 47
The emperor with no clothes: A critique of collectivism and individualism.
Wong, Y. J., Wang, S.-Y., & Klann, E. M. (2018) · Archives of Scientific Psychology · doi:10.1037/arc0000059 · Cited by 46 · see citing works
Big Five Personality Trait Short Questionnaire: Preliminary Validation with Spanish Adults
Ortet, G., Martinez, T. L. R., Mezquita, L., Morizot, J., & Ibáñez, M. (2017) · The Spanish Journal of Psychology · doi:10.1017/sjp.2017.8 · Cited by 45 · see citing works
The dimensionality of impulsivity: Perspectives and implications for emerging adult drinking.
Stamates, A. L., & Lau‐Barraco, C. (2017) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000153 · Cited by 50 · see citing works
Four-year stability, change, and multidirectionality of well-being in very-old age.
Wettstein, M., Schilling, O. K., Reidick, O., & Wahl, H. (2015) · Psychology and Aging · doi:10.1037/pag0000037 · Cited by 44 · see citing works
Lilienfeld, S., Watts, A. L., Murphy, B. A., Costello, T. H., Bowes, S. M., Smith, S. F., Latzman, R. D., Haslam, N., & Tabb, K. (2019) · Journal of Personality Disorders · doi:10.1521/pedi.2019.33.5.577 · Cited by 42 · see citing works
Capturing clinical complexity: Towards a personality-oriented measure of psychopathy
Cooke, D., & Logan, C. (2015) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2015.04.004 · Cited by 40 · see citing works
A network approach to the five-facet model of mindfulness
Heeren, A., Lannoy, S., Coussement, C., Hoebeke, Y., Verschuren, A., Blanchard, M. A., Chakroun-Baggioni, N., Philippot, P., & Gierski, F. (2021) · Scientific Reports · doi:10.1038/s41598-021-94151-2 · Cited by 39 · see citing works
Kranzler, J. H., Benson, N., & Floyd, R. G. (2015) · Psychological Assessment · doi:10.1037/pas0000119 · Cited by 39 · see citing works
Construct Validity and Confirmatory Factor Analysis of the Self-Control and Self-Management Scale
Mezo, P. G., & Short, M. M. (2012) · Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement · doi:10.1037/a0024414 · Cited by 38 · see citing works
UPPS-P impulsive personality traits and adolescent cigarette smoking: A meta-analysis
Bos, J., Hayden, M. J., Lum, J. A. G., & Staiger, P. K. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.01.018 · Cited by 41 · see citing works
Skopp, N. A., Edens, J., & Ruiz, M. (2007) · Journal of Personality Assessment · doi:10.1080/00223890709336841 · Cited by 36 · see citing works
Um, M., Hershberger, A. R., Whitt, Z. T., & Cyders, M. A. (2018) · Borderline Personality Disorder and Emotion Dysregulation · doi:10.1186/s40479-018-0084-x · Cited by 42 · see citing works
“In fact, this lack of specificity in criteria goes directly against the purported goal of the DSM-5 to promote further scientific knowledge concerning etiology and treatment of disorders, giving credence to the oft-cited criticisms of too much heterogeneity within disorders and too much overlap between disorders [73].”
BackgroundRodríguez-Carvajal, R., García-Rubio, C., Paniagua, D., García-Diex, G., & de Rivas, S. (2016) · Anales de Psicología · doi:10.6018/analesps.32.3.261681 · Cited by 34 · see citing works
Sellbom, M., Cooke, D., & Shou, Y.-Y. (2019) · Psychological Assessment · doi:10.1037/pas0000714 · Cited by 33
Morote, R., Hjemdal, O., Krysinska, K. E., Martínez, P., & Corveleyn, J. M. T. (2017) · BMC Psychology · doi:10.1186/s40359-017-0205-0 · Cited by 40 · see citing works
“This final model was used to compare the unique predictive capacity of each scale of the instruments (β weights) [61].”
BackgroundMethodCyders, M. (2015) · Personality disorders · doi:10.1037/per0000123 · Cited by 32 · see citing works
“As described by Smith, Fischer, and Fister (2003), aggregating across measures assessing different aspects of impulsive behavior (as would be the case if measures of CI were combined with measures of RRI) would result in a lack of construct homogeneity (see Strauss & Smith, 2009), which could (1)…”
Siegling, A., Petrides, K., & Martskvishvili, K. (2014) · European Journal of Personality · doi:10.1002/per.1976 · Cited by 32 · see citing works
“Facets can have two types of variance: reliable common variance, which is due to the target construct and shared with the other facets, and reliable specific variance, which is unrelated to the target construct (Smith et al., 2003).”
BackgroundMethodInfluentialPsychometric properties of a Romanian translation of the Functionality Appreciation Scale (FAS)
Swami, V., Todd, J., Goian, C., Tudorel, O. I., Barron, D. S., & Vintilă, M. (2021) · Body Image · doi:10.1016/j.bodyim.2021.02.010 · Cited by 35 · see citing works
Andrei, F., Mancini, G., Trombini, E., Baldaro, B., & Russo, P. M. (2014) · Personality and Individual Differences · doi:10.1016/j.paid.2014.02.007 · Cited by 31 · see citing works
Cooke, D., & Sellbom, M. (2019) · Psychological Assessment · doi:10.1037/pas0000676 · Cited by 28 · see citing works
The Trait Emotional Intelligence Questionnaire
Andrei, F., Smith, M. M., Surcinelli, P., Baldaro, B., & Saklofske, D. (2016) · Measurement and Evaluation in Counseling and Development · doi:10.1177/0748175615596786 · Cited by 28 · see citing works
Reliability and Validity of the Reduced Spanish Version of the Iowa Infant Feeding Attitude Scale
Tomás-Almarcha, R., Oliver‐Roig, A., & Richart‐Martínez, M. (2016) · Journal of Obstetric, Gynecologic & Neonatal Nursing · doi:10.1016/j.jogn.2016.08.001 · Cited by 23 · see citing works
Cyders, M., Burris, J. L., & Carlson, C. (2011) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9221-5 · Cited by 24 · see citing works
“diagnoses, and/or personality traits [21].”
Content Validity and Metric Properties of a Pool of Items Developed to Assess Humor Appreciation
Carretero‐Dios, H., Pérez, C., & Buela‐Casal, G. (2009) · The Spanish Journal of Psychology · doi:10.1017/s1138741600002146 · Cited by 26 · see citing works
Inteligência emocional e desempenho no trabalho: um estudo com MSCEIT, BPR-5 e 16PF
Cobêro, C., Primi, R., & Muniz, M. (2006) · Paidéia (Ribeirão Preto) · doi:10.1590/s0103-863x2006000300005 · Cited by 21 · see citing works
Development and validation of the Self-Harm Screening Inventory (SHSI) for adolescents
Kim, S., Seo, D., Park, J.-C., Son, Y., Lee, J. H., Yoon, D., Kim, J.-W., Yoo, J., & Lee, J.-S. (2022) · PLoS ONE · doi:10.1371/journal.pone.0262723 · Cited by 20 · see citing works
“The factor structure for the preliminary SHSI was determined based on the model fit indices and interpretability [47].”
MethodMaltby, J., Day, L., Hall, S. S., & Chivers, S. (2019) · Assessment (Odessa, Fla.) · doi:10.1177/1073191117738045 · Cited by 20 · see citing works
Offenbächer, M., Sauer, S., Hieblinger, R., Hufford, D., Walach, H., & Kohls, N. (2011) · Disability and Rehabilitation · doi:10.3109/09638288.2011.573902 · Cited by 20 · see citing works
“Several authors have argued that assessment of complex constructs such as mindfulness at the facet level is essential for clarifying their relationship with other variables [25,26].”
BackgroundDevelopmental Considerations for Assessment and Treatment of Impulsivity in Older Adults
Liu, M. A., Argyriou, E., & Cyders, M. A. (2020) · Current topics in behavioral neurosciences · doi:10.1007/7854_2019_124 · Cited by 29 · see citing works
Psychopathic Personality Disorder
Cooke, D. J. (2018) · European journal of analytic philosophy · doi:10.31820/ejap.14.1.1 · Cited by 30 · see citing works
“…between a concept and the measures of that concept, promotes our understanding of associations amongst different measurement procedures, and may in turn further inform our understanding of the nature of the concept (Cook and Campbell 1978; Cooke et al. 2012; Hart and Cook 2012; Smith et al. 2003).”
BackgroundMethodInfluentialPsychometrics and Psychological Assessment
Hunsley, J. D., & Allan, T. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108235433.002 · Cited by 33 · see citing works
Louis, J., Wood, A., & Lockwood, G. (2018) · Assessment (Odessa, Fla.) · doi:10.1177/1073191118798464 · Cited by 18 · see citing works
Why do Different Individuals Progress Along Different Life Trajectories?
Smith, G. T. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01148.x · Cited by 17 · see citing works
“Valid Theory Testing I believe recent validity theory writings have identified an important problem plaguing many tests of psychological theories, implying that many theory tests may suffer from a fundamental lack of clarity (Edwards, 2001; Hough & Schneider, 1995; McGrath, 2005; Schneider, Hough, & Dunnette, 1996; Sm…”
BackgroundSelf-citationKirkpatrick, T., Joyce, E., Milton, J., Duggan, C., Tyrer, P., & Rogers, R. (2007) · The British journal of psychiatry. Supplement · doi:10.1192/bjp.190.5.s20 · Cited by 16 · see citing works
Siegling, A., Vesely, A. K., Saklofske, D., Frederickson, N. L., & Petrides, K. (2017) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000267 · Cited by 16 · see citing works
Perfectionism and a Healthy Attitude toward Oneself: Could Humor Be a Resource?
Fabio, A. D., Smith, M. M., & Saklofske, D. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17010201 · Cited by 15 · see citing works
“The publication of the new Big Three Perfectionism Scale (BTPS) [12] reflects recent advances in perfectionism research [12,14].”
BackgroundExploring the impact of choral singing on mindfulness
Lynch, J., & Wilson, C. (2018) · Psychology of Music · doi:10.1177/0305735617729452 · Cited by 15 · see citing works
Creación de la Escala sobre Habilidades de Comunicación en Profesionales de la Salud, EHC-PS
Leal‐Costa, C., González, S. T., Román, C. J. V.-D. H., & Marín, J. R. (2016) · Digitum: Institutional Repository of the University of Murcia (University of Murcia) · doi:10.6018/analesps.31.3.184701 · Cited by 15 · see citing works
- Authors
- Smith, G. T., Fischer, S., & Fister, S. M.
- Affiliations
- University of Kentucky (US)
- Venue
- Psychological Assessment
- Published
- 2003-12
- Volume
- 15
- Issue
- 4
- Pages
- 467-477
- ISSN
- 1040-3590 (ISSN-L)
- 1939-134X
- OpenAlex
- W2088786239
- Cited by
- 205
- References
- 0
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 2 · 2023: 4 · 2022: 12 · 2021: 12 · 2020: 8 · 2019: 9 · 2018: 12 · 2017: 10 · 2016: 11 · 2015: 22 · 2014: 8 · 2013: 15 · 2012: 16
- FWCI
- 5.54
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Assessment (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Education › Educational Assessment and Pedagogy
- Keywords
- incremental validity, test development, construct validity, prediction
- MeSH terms
- Humans, Personality Assessment, Personality Inventory, Psychological Tests, Psychometrics, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
