Cited by 78Personality Traits and PsychologyPsychometric Methodologies and TestingPsychological Testing and Assessment

Bandwidth and Fidelity on the NEO-Five Factor Inventory: Replicability and Reliability of Item Cluster Subcomponents

Open access
Chapman, Benjamin P.·2007·Journal of Personality Assessment

Abstract

Many users of the NEO-Five Factor Inventory (NEO-FFI; Costa & McCrae, 1992) are unaware that Saucier (1998) developed item cluster subcomponents for each broad domain of the instrument similar to the facets of the Revised NEO Personality Inventory (Costa & McCrae, 1992). In this study, I examined the following: the replicability of the subcomponents in young adult university and middle-aged community samples; whether item keying accounted for additional covariance among items; subcomponent correlations with a measure of socially desirable responding; subcomponent reliabilities; and subcomponent discriminant validity with respect to age-relevant criterion items expected to reflect varying associations with broad and narrow traits. Confirmatory factor analyses revealed that all subcomponents were recoverable across samples and that the addition of method factors representing positive and negative item keying improved model fit. The subcomponents correlated no more with a measure of socially desirable responding than their parent domains and showed good average reliability. Correlations with criterion items suggested that subcomponents may prove useful in specifying which elements of NEO-FFI domains are more or less related to variables of interest. I discuss their use for enhancing the precision of findings obtained with NEO-FFI domain scores.

AI snapshot

Written from the paper’s full text.

TL;DR

Saucier’s (1998) NEO-FFI item-cluster subcomponents were largely replicable across young-adult university and middle-aged community samples, and adding positive/negative item-keying method factors improved model fit. The subcomponents showed fair-to-good reliability and some criterion-specific predictive advantages over broad domains, except for the unconventionality cluster.

Key findings

  • Confirmatory factor analyses recovered all subcomponents across samples; trait-only models had adequate RMSEA fit (e.g., .048 for Conscientiousness to .086 for Extraversion in middle-aged adults), and adding positive/negative keying method factors reduced RMSEAs and lowered AIC values.
  • Of 60 NEO-FFI items, 53 loaded primarily on their trait factor and 7 loaded higher on their method factor; 45/60 items were invariant across samples under the three-subcomponent Neuroticism scheme and 43/60 under the two-subcomponent scheme.
  • Average subcomponent reliability was .72 (.73 without unconventionality) in middle-aged adults and .66 (.68 without unconventionality) in young adults, comparable to Saucier’s .70/.66 and the average NEO-PI-R facet alpha of .70; unconventionality was an exception (e.g., α = .27 middle-aged, α = .01 young adults).
  • Social desirability correlations were small but significant and age-moderated; criterion correlations suggested some subcomponents may specify domain-outcome links, e.g., aesthetic interests predicted artistic hobbies slightly better than broad Openness, and sociability predicted opposite-sex socializing better than broad Extraversion, though goal striving did not predict job satisfaction and self-reproach did not predict suicidal ideation.

Methods

  • Two independent samples: Sample 1 included 308 young adults (74% women; age M = 20, SD = 2.2; 66% White); Sample 2 included 256 middle-aged community adults (62% women; age M = 49, SD = 5.4; 76% White). Usable NEO-FFI data were available for 305 young adults and 209 midlife adults; Table 4 reports N = 291 young adults and N = 204 middle-aged adults.
  • Measures included the NEO-FFI and Saucier’s item-cluster subcomponents, the 10-item Marlowe-Crowne Social Desirability Scale, the Revised UCLA Loneliness Scale, and single-item criterion measures for each sample.
  • Analyses used multiple-group confirmatory factor analysis on polychoric correlation matrices with ML robust estimation, Satorra-Bentler chi-square, AIC, CFI, and RMSEA; reliability was assessed with Cronbach’s α, Raykov’s ρ, and Bentler’s θ; criterion correlations were also corrected for attenuation due to measurement error.

Limitations

  • The paper states five limitations: generalizability to other populations requires further investigation; the study relied on self-report only; Saucier’s development sample (N = 732) was larger than the middle-aged sample; criterion measures were few and mostly single-item, with no significance testing of subcomponent-versus-domain correlation differences; and latent-variable modeling may inflate correlations among narrow traits within a domain, risking collinearity.
  • The text also makes evident that the unconventionality subcomponent was poorly defined and unreliable, with low loadings (all below .40) and very low internal consistency in both samples.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1080/00223890701268082

Cites

79 of 79 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 74 cited sources checked · 0 supported · 0 flagged

  • Findingown data
    § Abstract

    The subcomponents showed good average reliability.

    “The subcomponents correlated no more with a measure of socially desirable responding than their parent domains and showed good average reliability.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The two samples (young adult university students and middle-aged community adults) are suitable for cross-validating the NEO-FFI subcomponents across age and demographics.
  • Findingown data
    § Abstract

    The addition of method factors representing positive and negative item keying improved model fit.

    “Confirmatory factor analyses revealed that all subcomponents were recoverable across samples and that the addition of method factors representing positive and negative item keying improved model fit.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The two samples (young adult university students and middle-aged community adults) are suitable for cross-validating the NEO-FFI subcomponents across age and demographics.
  • Findingown data
    § Abstract

    Confirmatory factor analyses revealed that all subcomponents were recoverable across samples.

    “Confirmatory factor analyses revealed that all subcomponents were recoverable across samples and that the addition of method factors representing positive and negative item keying improved model fit.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The two samples (young adult university students and middle-aged community adults) are suitable for cross-validating the NEO-FFI subcomponents across age and demographics.
  • Findingown data
    § Abstract

    The subcomponents correlated no more with a measure of socially desirable responding than their parent domains.

    “The subcomponents correlated no more with a measure of socially desirable responding than their parent domains and showed good average reliability.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The two samples (young adult university students and middle-aged community adults) are suitable for cross-validating the NEO-FFI subcomponents across age and demographics.
  • Findingown data
    § DISCUSSION

    The vast majority of items functioned quite similarly across age groups.

    “On the whole however, these analyses revealed that not only was the basic factor configuration of Saucier’s (1998) lower tier NEO-FFI traits recoverable in somewhat different samples but that the vast majority of items functioned quite similarly across age groups.”
    Quote in the paperSubstantial claim
  • May combine two claims. 22
  • Classified as probably not a substantial claim. 35
  • May combine two claims.

    Findingown data
    § DISCUSSION

    Decomposing Neuroticism into only two subcomponents, Item 56 characterizes self-reproach better in middle-aged respondents.

    “Under the tripartite arrangement, Item 41, which deals with feeling discouraged and giving up when hardship is encountered, characterizes trait depression better in young than midlife adults; decomposing Neuroticism into only two subcomponents, Item 56, which asks about shame, characterizes self-reproach better in middle-aged respondents.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data
    § RESULTS

    Item 36 loaded slightly higher on negative affect in the young adults.

    “In the bipartite alternative, Item 51 loaded marginally (.64 vs. .63) and Item 36 slightly (.64 vs. .58) higher on negative affect in the young adults, whereas item 21 loaded slightly (.57 vs. .56) and 56 moderately (.74 vs. .95) higher on negative affect in the middle-aged adults.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning
    § RESULTS

    Correlations among the trait factors tended to be above .60, with the Neuroticism subcomponents in the .90s.

    “Correlations among the trait factors tended to be above .60, with the Neuroticism subcomponents in the .90s; this was expected given that different elements of a multifaceted construct must by definition be strongly correlated; and when measurement error is removed in latent variable models, these correlations increase, sometimes substantially.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Different elements of a multifaceted construct must by definition be strongly correlated.
    • Rests on an assumption: When measurement error is removed in latent variable models, correlations increase, sometimes substantially.
  • May combine two claims.

    Findingown data
    § RESULTS

    Among the middle-aged adults, all subcomponents from either Neuroticism scheme correlated negatively with social desirability, whereas all subcomponents of Agreeableness and Conscientiousness correlated positively with social desirability.

    “Among the middle-aged adults (Ns = 204–207, ps < .005), all subcomponents from either Neuroticism scheme correlated negatively with social desirability, whereas all subcomponents of Agreeableness and Conscientiousness correlated positively with social desirability.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § RESULTS

    Some specific hypotheses were supported in the uncorrected correlations; when measurement error was corrected, many were supported.

    “Some specific hypotheses were supported in the uncorrected correlations; and when measurement error was corrected, many were supported.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § RESULTS

    Of the 60 NEO-FFI items, 53 loaded primarily on their trait factor, whereas 7 loaded higher on their respective method factor.

    “Of the 60 NEO-FFI items, 53 loaded primarily on their trait factor, whereas 7 loaded higher on their respective method factor.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingnone given
    § DISCUSSION

    Social desirability correlations were small but significant and were moderated by age group.

    “Social desirability correlations were small but significant and were moderated by age group.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § RESULTS

    The pattern for both samples suggested moderate to strong correlation among subcomponents within a domain and much smaller correlations between item clusters from different domains.

    “The pattern for both samples suggested moderate to strong correlation among subcomponents within a domain and much smaller correlations between item clusters from different domains.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § RESULTS

    The appropriate congeneric reliability estimates ranged from fair to good and were slightly higher in the middle-aged sample.

    “In general, it can be seen that the appropriate congeneric reliability estimates, bolded in Table 3 (i.e., either α or ρ, depending on tau equivalency) ranged from fair to good, and were slightly higher in the middle-aged sample.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingcitation
    § RESULTS

    For the young adults, the average subcomponent reliability was .66 (.68 without unconventionality), equal to what Saucier obtained in his college sample.

    “For the young adults, the average subcomponent reliability was .66 (.68 without unconventionality), equal to what Saucier obtained in his college sample.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Saucier, 1998

      Not checked in the free run.

  • May combine two claims.

    Findingown data
    § RESULTS

    Average reliability across the subcomponents in the middle-aged sample was .72 (.73 without unconventionality), slightly higher than that reported by Saucier (1998; .70 for his midlife sample) and the average NEO-FFI facet reliability (.70).

    “Average reliability across the subcomponents in the middle-aged sample was .72 (.73 without unconventionality), slightly higher than that reported by Saucier (1998; .70 for his midlife sample) and the average NEO-FFI facet reliability (.70), both of which are based strictly on α.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Saucier, 1998

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § Abstract

    Broadband Neuroticism scores mask important phenotypic variation and may lead to imprecise results and interpretations.

    “Broadband Neuroticism scores mask such important phenotypic variation,2 and may lead to accordingly imprecise results and interpretations.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation
    § Abstract

    The NEO-FFI is a brief version of the NEO-PI-R designed to provide speedy and convenient measurement of the Five Factor Model domains.

    “The 60-item NEO-Five Factor Inventory (NEO-FFI; Costa & McCrae, 1992) is a brief version of the NEO-PI-R designed to provide speedy and convenient measurement of the Five Factor Model domains; however, it does so by relinquishing information about the narrow traits that comprise each broad factor.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Costa & McCrae, 1992

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation
    § Abstract

    Saucier (1998) derived item cluster subcomponents for the NEO-FFI that provided a more specific level of trait measurement.

    “To remedy this, Saucier (1998) derived item cluster subcomponents for the NEO-FFI that provided a more specific level of trait measurement.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Saucier, 1998

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § METHOD

    Raykov recommended that the RMSEA be given the heaviest weight in assessing models based on personality data because it is less affected by violations of multivariate normality typically seen in personality data.

    “Raykov (1998) recommended that the root mean square error of approximation (RMSEA), an absolute fit index, be given the heaviest weight in assessing models based on personality data because it is less affected by violations of multivariate normality typically seen in personality data.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Raykov, 1998

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § Abstract

    Weiss and Costa (2005) supplemented their overall finding that Conscientiousness was inversely related to mortality with facet-level analyses that indicated that it was primarily the self-discipline facet that confers longevity.

    “For instance, Weiss and Costa (2005) recently supplemented their overall finding that Conscientiousness was inversely related to mortality with facet-level analyses that indicated that it was primarily the self-discipline facet that confers longevity.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Weiss & Costa, 2005

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation
    § METHOD

    Polychoric correlation matrices were suggested for use with the ordinal response scales of personality instruments.

    “I estimated models from polychoric correlation matrices, which approximate the continuous distributions underlying response scales involving ordinal categories (Olsson, 1979) and were suggested for use with the ordinal response scales of personality instruments (Panter, Swygert, Dahlstrom, & Tanaka, 1997).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Panter, Swygert, Dahlstrom, & Tanaka, 1997

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § Abstract

    The two-subcomponent Neuroticism scoring scheme was empirically derived, whereas the three-subcomponent scheme was rationally derived by Saucier to provide separate measures of anxiety and depression.

    “Table 1 also reveals that the Neuroticism domain may be decomposed into either two or three item-cluster subcomponents; the former scoring scheme was empirically derived (as were all other sets of subcomponents), whereas the latter was rationally derived by Saucier to provide separate measures of anxiety and depression.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Saucier, 1998

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given
    § Abstract

    The higher reliability of broad trait scales means only that a general, multidimensional construct has been measured with greater precision.

    “First, the higher reliability of broad trait scales means only that a general, multidimensional construct has been measured with greater precision.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation
    § Abstract

    Personality traits can be measured in hierarchical tiers that vary in generality.

    “Most researchers have agreed that personality traits can be measured in hierarchical tiers that vary in generality (Cattell & Krug, 1986; Costa & McCrae, 1997; Eysenck, 1998; Goldberg, 1990).”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Cattell & Krug, 1986

      Not checked in the free run.

    • cites Costa & McCrae, 1997

      Not checked in the free run.

    • cites Eysenck, 1998

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisereasoning
    § Abstract

    The exact substantive meaning of a correlation between a broad trait and a criterion may be difficult to discern because the broad trait involves several components.

    “A third reason narrow traits remain important is that the exact substantive meaning of a correlation between a broad trait and a criterion may be difficult to discern because the broad trait involves several components.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisereasoning
    § Abstract

    The replicability and psychometric characteristics of Saucier's subcomponents in cross-validation samples remain largely unknown.

    “However, their replicability and psychometric characteristics in cross-validation samples remain largely unknown.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation
    § Abstract

    Traits at higher levels of multistratum taxonomies are composites of more fine-grained specific traits.

    “Traits at higher levels of multistratum taxonomies are merely composites of more fine-grained specific traits.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation
    § Abstract

    Within the Five Factor Model, the broad trait of Conscientiousness is composed of narrow attributes such as self-discipline, achievement orientation, and orderliness.

    “For example, within the Five Factor Model of personality (Costa & McCrae, 1997; Digman, 1990; Goldberg, 1990; John & Srivastava, 1999), the broad trait of Conscientiousness is composed of narrow attributes such as self-discipline, achievement orientation, and orderliness.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Costa & McCrae, 1997

      Not checked in the free run.

    • cites Digman, 1990

      Not checked in the free run.

    • cites Goldberg, 1990

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation
    § METHOD

    Polychoric correlation matrices approximate the continuous distributions underlying response scales involving ordinal categories.

    “I estimated models from polychoric correlation matrices, which approximate the continuous distributions underlying response scales involving ordinal categories (Olsson, 1979) and were suggested for use with the ordinal response scales of personality instruments (Panter, Swygert, Dahlstrom, & Tanaka, 1997).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Olsson, 1979

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning
    § Abstract

    Saucier's NEO-FFI subcomponents represent a potentially important tool for users of the NEO-FFI.

    “These arguments for the use of narrow trait composites suggest that Saucier’s (1998) NEO-FFI subcomponents represent a potentially important tool for users of the NEO-FFI.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Saucier, 1998

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation
    § Abstract

    Ashton argued that the greater reliability of broadband trait scales does not always mean they have better predictive power.

    “A second reason lower order, narrow traits are important was highlighted by Ashton (1998). Ashton argued that the greater reliability of broadband trait scales does not always mean they have better predictive power.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Ashton, 1998

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation
    § Abstract

    Cronbach and Gleser discussed a general relationship between bandwidth and fidelity in which increasing bandwidth tends to reduce fidelity.

    “Rather than concerning themselves with the specific case of hierarchical personality inventories, Cronbach and Gleser (1965) discussed a general relationship between bandwidth and fidelity in which increasing bandwidth tends to reduce fidelity.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Cronbach & Gleser, 1965

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation
    § METHOD

    Beauducell and Wittman suggested the RMSEA as a trustworthy index of model fit after simulation studies intended to reflect conditions typical of personality data.

    “Similarly, after extensive simulation studies intended to reflect conditions typical of personality data (i.e., simple structure violations, non-normality, smaller sample sizes), Beauducell and Wittman (2005) also suggested the RMSEA as a trustworthy index of model fit.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Beauducell & Wittman, 2005

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § METHOD

    The use of single-item criterion measures is common in survey research methodology and is consistent with prior bandwidth-fidelity research.

    “The use of single-item criterion measures is common in survey research methodology and is consistent with prior bandwidth-fidelity research (cf. Ashton, 1998; Paunonen, 1998, 2003).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Ashton, 1998

      Not checked in the free run.

    • cites Paunonen, 1998

      Not checked in the free run.

    • cites Paunonen, 2003

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation
    § Abstract

    The NEO-PI-R permits users to capture information about higher order broad traits as well as the lower order, narrow traits that compose them.

    “The commonly used Revised NEO Personality Inventory (NEO-PI-R; Costa & McCrae, 1992) permits users to capture information about such higher order broad traits as well as the lower order, narrow traits that compose them (cf. Costa & McCrae, 1995).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Costa & McCrae, 1992

      Not checked in the free run.

    • cites Costa & McCrae, 1995

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § DISCUSSION

    Social desirability has itself been considered a personality trait reflecting positive characteristics or a sense of well-being rather than a dissembling response style per se.

    “However, social desirability has itself been considered a personality trait reflecting positive characteristics or a sense of well-being rather than a dissembling response style per se (McCrae, 1986; McCrae & Costa, 1983).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites McCrae, 1986

      Not checked in the free run.

    • cites McCrae & Costa, 1983

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation
    § RESULTS

    α may be high in multidimensional scales and thus should not be regarded as a measure of homogeneity.

    “However, domain αs af-firmed the well-known psychometric fact that α may be high in multidimensional scales (Streiner, 2003a, 2003b) and thus should be not be regarded as a measure of “homogeneity” (Cortina, 1993).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Streiner, 2003a, 2003b

      Not checked in the free run.

    • cites Cortina, 1993

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning
    § RESULTS

    θ may be regarded as a more appropriate reliability estimate for the domains.

    “Whereas α and ρ were intended for use with congeneric item sets, θ, which entails no such assumption, may be regarded as a more appropriate reliability estimate for the domains.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: The NEO-FFI domains are multidimensional rather than congeneric by definition.
  • Classified as probably not a substantial claim.

    Study design and conductreasoning
    § DISCUSSION

    These trait-only models were fairly strict tests of cross-validation in that they posited no additional sources of covariation among items other than factors corresponding to narrow personality traits within each domain.

    “These trait-only models were fairly strict tests of cross-validation in that they posited no additional sources of covariation among items other than factors corresponding to narrow personality traits within each domain.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation
    § RESULTS

    θ makes no assumptions about the dimensionality of a composite and always exceeds alpha.

    “This coefficient makes no assumptions about the dimensionality of a composite and always exceeds alpha (Bentler, 1972, in press).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Bentler, 1972, in press

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation
    § DISCUSSION

    These results bear no necessary connection to the NEO-FFI validity question "Have you responded accurately and honestly".

    “As one reviewer pointed out, whether social desirability is viewed as a substantively meaningful trait in and of itself or not, these results bear no necessary connection to the NEO-FFI validity question “Have you responded accurately and honestly” (Costa & McCrae, 1992).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Costa & McCrae, 1992

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § DISCUSSION

    Scores on the short Marlowe-Crowne are correlated with age on the order of .30, at least in women.

    “Some work has also indicated scores on the short Marlowe-Crowne are correlated with age on the order of .30, at least in women (Ray, 1988; Ray & Lovejoy, 2003).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Ray, 1988

      Not checked in the free run.

    • cites Ray & Lovejoy, 2003

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § DISCUSSION

    α is strongly affected by the number of items in a scale.

    “Streiner (2003b), among others, emphasized the well-known fact that α is strongly affected the number of items in a scale and, like Cortina (1993), cautioned against blind use of α to evaluate an instrument’s reliability without consideration for factors that affect α (Streiner, 2003a).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Streiner, 2003b

      Not checked in the free run.

    • cites Cortina, 1993

      Not checked in the free run.

    • cites Streiner, 2003a

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given
    § DISCUSSION

    These analyses suggest that either item keying and/or social desirability may have affected subcomponent scores, albeit minimally.

    “These analyses suggest that either item keying and/or social desirability may have affected subcomponent scores, albeit minimally.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given
    § DISCUSSION

    I did not subject differences between subcomponent and domain criterion correlations to significance testing.

    “I did not subject differences between subcomponent and domain criterion correlations to significance testing.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § DISCUSSION

    Because the NEO-FFI subcomponents are located beneath domains in a factorial hierarchy, they cannot be measured with the same number of items as the broad domains, and reductions in reliability are inevitable.

    “because the NEO-FFI subcomponents are located beneath domains in a factorial hierarchy, they cannot be measured with same number of items as the broad domains, and, all other things being equal, reductions in reliability are inevitable.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The NEO-FFI subcomponents are located beneath domains in a factorial hierarchy.
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning
    § DISCUSSION

    Modeling narrow traits as latent variables may inflate correlations between them even more by removing measurement error.

    “modeling them as latent variables may inflate these correlations even more by removing measurement error.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning
    § DISCUSSION

    The shared variance among sibling subcomponents captured by broadband composite scores appeared to outweigh the specific variance of each subcomponent in these cases, resulting in higher criterion correlations for the domains rather than their subcomponents.

    “The shared variance among “sibling” subcomponents captured by broadband composite scores appeared to outweigh the specific variance of each subcomponent in these cases, which resulted in higher criterion correlations for the domains rather than their subcomponents.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § DISCUSSION

    Cronbach's alpha may often be a reasonable lower bound estimate of true score variance within a scale.

    “α may still often be a reasonable lower bound estimate of true score variance within a scale (Cortina, 1993)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Cortina, 1993

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § DISCUSSION

    If one could use the same number of items to measure a specific trait and a broad, multidimensional trait, the narrower bandwidth measure would show higher fidelity.

    “if one could use the same number of items to measure a specific trait and a broad, multidimensional trait, the narrower bandwidth measure would show higher fidelity.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Cronbach and Gleser’s (1965)

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning
    § DISCUSSION

    These correlations may mean that whatever positive trait might be tapped by the Marlowe-Crowne is associated with all elements of Neuroticism, Agreeableness, and Conscientiousness in middle-aged adults but with only a limited set of these domains' subcomponents in young adults.

    “In this context, these correlations may also mean that whatever positive trait might be tapped by the Marlowe-Crowne is associated with all elements of Neuroticism, Agreeableness, and Conscientiousness in middle-aged adults but with only with a limited set of these domains’ subcomponents in young adults.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation
    § DISCUSSION

    The observed average internal consistency reliabilities compare favorably with the average reliability of .70 for the NEO-PI-R facets and provide further evidence of the subcomponents' stability.

    “these numbers compare favorably with the average (α-based) reliability of .70 for the NEO-PI-R facets and, in this context, provide further evidence of the subcomponents’ stability.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Saucier

      Not checked in the free run.

  • May combine two claims.

    Premisecitation
    § DISCUSSION

    The unconventionality item cluster evidenced the lowest reliability and greatest cross-validation α shrinkage in Saucier's (1998) work.

    “it also evidenced the lowest reliability and greatest cross-validation α shrinkage in Saucier’s (1998) work.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Saucier’s (1998)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given
    § DISCUSSION

    The measurement of unconventionality as a lower order trait raises a paradox: respondents need be at least somewhat conventional in their interpretations of items measuring unconventionality, and the items need to elicit a standard pattern of covariation across samples.

    “This raises an interesting paradox about the measurement of unconventionality itself as a lower order trait: Respondents need be at least somewhat conventional in their interpretations of items measuring unconventionality, and the items need to elicit a standard pattern of covariation across samples.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The psychometric consistency of a trait in a population depends on shared convention in the interpretation of items.
  • Classified as probably not a substantial claim.

    Premisecitation
    § DISCUSSION

    α is not a measure of dimensionality or homogeneity.

    “It is well known in the psychometric literature that α is not a measure of dimensionality or homogeneity (Cortina, 1993; Streiner, 2003a), and for this reason, alternative estimates of reliability provide a better estimate of true reliability when scales are not con-generic or essentially tau equivalent (Zinbarg et al., 2005; see also Bentler, in press).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Cortina, 1993

      Not checked in the free run.

    • cites Streiner, 2003a

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation
    § DISCUSSION

    Saucier's (1998) development sample (N = 732) was considerably larger than this middle-aged sample.

    “Saucier’s (1998) development sample (N = 732) was considerably larger than this middle-aged sample”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Saucier’s (1998)

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data
    § DISCUSSION

    With the exception of unconventionality, the narrow trait subcomponents embedded in the NEO-FFI were stable across independent samples, comparable in reliability to NEO-PI-R facets, and offer the potential to measure personality at higher specificity than is possible with only broadband domain scores.

    “with the exception of unconventionality, the narrow trait subcomponents embedded in the NEO-FFI were stable across independent samples, comparable in reliability to NEO-PI-R facets, and offer the potential to measure personality at higher specificity than is possible with only broadband domain scores.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The psychometric consistency of a trait in a population depends on shared convention in the interpretation of items.
    • Rests on an assumption: The item content of unconventionality tapped a dimension of personality defined by the rejection of intellectual and cultural norms; high scorers would be free thinking and unshackled by social and attitudinal conventions.
    • Rests on an assumption: The NEO-FFI subcomponents are located beneath domains in a factorial hierarchy.
53 of 53
  • The paper relies on this without support.

    The two samples (young adult university students and middle-aged community adults) are suitable for cross-validating the NEO-FFI subcomponents across age and demographics.

    “Sample 1 consisted of 308 young adults drawn from large introductory psychology classes (74% women; age M = 20, SD = 2.2; 66% White). Sample 2 consisted of 256 middle-age adults drawn from the community (62% women; age M = 49, SD = 5.4; 76% White).”
  • The authors state this as an assumption.

    The NEO-FFI domains are multidimensional rather than congeneric by definition.

    “Because the domains are multidimensional rather than congeneric by definition, I did not test essential tau equivalence.”
  • The authors state this as an assumption.

    Different elements of a multifaceted construct must by definition be strongly correlated.

    “this was expected given that different elements of a multifaceted construct must by definition be strongly correlated”
  • The paper relies on this without support.

    When measurement error is removed in latent variable models, correlations increase, sometimes substantially.

    “and when measurement error is removed in latent variable models, these correlations increase, sometimes substantially.”
  • The paper relies on this without support.

    The psychometric consistency of a trait in a population depends on shared convention in the interpretation of items.

    “By definition, however, the psychometric consistency of a trait in the population depends on shared convention in the interpretation of items.”
  • The paper relies on this without support.

    The correction for attenuation due to measurement error may tend to favor shorter scales, other things being equal.

    “The correction for attenuation due to measurement error may tend to favor shorter scales, other things being equal”
  • The paper relies on this without support.

    Strong correlations between narrow traits within the same domain are virtually axiomatic.

    “although strong correlations between narrow traits within the same domain are virtually axiomatic”
  • The paper relies on this without support.

    The item content of unconventionality tapped a dimension of personality defined by the rejection of intellectual and cultural norms; high scorers would be free thinking and unshackled by social and attitudinal conventions.

    “The item content tapped a dimension of personality defined by the rejection of intellectual and cultural norms; high scorers would be free thinking and unshackled by social and attitudinal conventions.”
  • The paper relies on this without support.

    The NEO-FFI subcomponents are located beneath domains in a factorial hierarchy.

    “because the NEO-FFI subcomponents are located beneath domains in a factorial hierarchy”
  • The paper relies on this without support.

    The middle-aged sample was demographically quite similar to Saucier's derivation sample.

    “This is not surprising because the middle-aged sample was demographically quite similar to that in which Saucier (1998) derived the subcomponents.”
10 of 10

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Table 4 sample positions are reversed in the prose

    Major

    The prose places young adults below the diagonal and middle-aged adults above it; the table note says the opposite.

  • Neuroticism items are assigned to the wrong bipartite subcomponent

    Minor

    The results say Items 51, 36, 21, and 56 loaded on negative affect in the two-subcomponent scheme. Table 1 assigns all four to self-reproach, not negative affect.

  • A corrected criterion correlation is unchanged despite imperfect reliability

    Minor

    Table 6 gives the young-adult positive-affect correlation with loneliness as −.57 both before and after correction for attenuation. Table 3 reports young-adult positive-affect reliability below one, so correcting that nonzero correlation for measurement error must increase its absolute magnitude.

3 of 3

Cites

Flagged first, then by citations

7 of the 86 references couldn’t be matched to a known paper.

Research works printed but not linked: 9

  1. Akaike H., Proceedings of the Second International Symposium on Information Theory, 267
  2. Bentler P. M., Handbook of structural equation models.
  3. Costa P. T., 1992, Neo–PI, revised: Technical manual.
  4. Nunnally J. C., 1994, Psychometric theory
  5. 10.1002/(sici)1099-1379(199611)17:6<609::aid-job1828>3.0.co;2-k · DOI
  6. Satorra A., 1988, Proceedings of the American Statistical Association,, 308
  7. Schinka J. A., 1997, Journal of Personality Assessment, 7, 395
  8. Tanaka J. S., 1993, Testing structural equation models, 10
  9. Zitzow D., 1984, Journal of College Student Personnel, 25, 160

Cited by

Sorted by citations

Authors
Chapman, B. P.
Affiliations
University of Rochester Medicine (US)
Corresponding author
Chapman, Benjamin P.
Venue
Journal of Personality Assessment
Published
2007-03-27
Volume
88
Issue
2
Pages
220-234
ISSN
  • 0022-3891 (ISSN-L)
  • 1532-7752
OpenAlex
W2025207988
Cited by
77
References
86
Citations by year
2026: 4 · 2024: 6 · 2023: 1 · 2022: 2 · 2021: 6 · 2020: 6 · 2019: 5 · 2018: 4 · 2017: 5 · 2016: 6 · 2015: 9 · 2014: 6 · 2013: 3
FWCI
3.62
Type
journal article
Language
en
Open access
Locations
  • Journal of Personality Assessment (publishedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • National Institutes of Health
  • National Institute on Aging (L30 AG031021)
  • National Institute of Mental Health (T32MH073452)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Personality Traits and Psychology
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
  • Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
Keywords
NEO-FFI, personality assessment, replicability, reliability statistics, methodological factors, social desirability bias, discriminant validity, young adults, middle-aged adults
MeSH terms
Adult, Factor Analysis, Statistical, Female, Humans, Interpersonal Relations, Male, Middle Aged, Personality Disorders, Personality Inventory, Psychometrics, Surveys and Questionnaires, Self-Assessment, Social Desirability, Reproducibility of Results

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review