The development and evaluation of a brief form of the Normative Male Alexithymia Scale (NMAS-BF).
Open accessAbstract
= 505 men) were from Amazon Mechanical Turk participants. First, dimensionality was reassessed using exploratory factor analysis, which supported the unidimensional structure. Second, based on these results, three 6-item models of the NMAS-Brief Form (NMAS-BF) were developed, based on classical test theory (CTT), CTT optimized to avoid item redundancy, and item response theory (IRT). Third, the relative fits of these versions were assessed using confirmatory factor analysis on a separate part of the sample, finding that the IRT version was the best fitting model. Fourth, evidence for reliability for the NMAS-BF items (α = .80) and validity was found. Convergent evidence for validity was supported by a significant, moderate, positive correlation between the latent constructs of the NMAS-BF and Toronto Alexithymia Scale-20 (TAS-20), which measures clinical alexithymia. Concurrent evidence for validity of the latent factor of the NMAS-BF was assessed in a structural regression model which found that the NMAS-BF uniquely predicted RE scores when TAS-20 scores were included in the model. Finally, incremental evidence for validity was examined using hierarchical multiple regression, finding that NMAS-BF scores significantly predicted variance in RE scores above and beyond that predicted by TAS-20 scores. The results are discussed in relation to prior literature, future research directions, applications to counseling practice, and limitations. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
1 of 38 cited sources checked · 1 supported · 0 flagged
- Premisecitation
MTurk data are valid and reliable when appropriate selection criteria and attention checks are used.
“Data obtained from MTurk has been demonstrated to be valid and reliable when appropriate selection criteria and attention checks are used (Casler, Bickel, & Hackett, 2013; Peer, Vosgerau, & Acquisti, 2014), as was the case in this study.”
Quote in the paperSubstantial claim1 of 2 sources checked- cites Casler, Bickel, & Hackett, 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Peer, Vosgerau, & Acquisti, 2014 source
- Findingown data
A confirmatory factor analysis on a separate portion of the sample showed that the six-item IRT-based NMAS-BF model fit better than the other candidate models.
“Third, the relative fits of these versions were assessed using confirmatory factor analysis on a separate part of the sample, finding that the IRT version was the best fitting model.”
Quote in the paperSubstantial claim - Findingown data
An exploratory factor analysis of the NMAS in the present sample supported a single-factor structure.
“First, dimensionality was reassessed using exploratory factor analysis, which supported the unidimensional structure.”
Quote in the paperSubstantial claim - Findingown data
The NMAS-BF items showed internal consistency reliability with a Cronbach's alpha of .80.
“Fourth, evidence for reliability for the NMAS-BF items (α = .80) and validity was found.”
Quote in the paperSubstantial claim - Findingreasoning
Model 2 (loading/content optimized) showed marginal-to-poor fit: CFI=.908, TLI=.847, RMSEA=.186, SRMR=.049.
“CFI = .908; TLI = .847; RMSEA = .186 (90% CI [.152, .223]); SRMR = .049.”
Quote in the paperSubstantial claim
- Findingown data
Model 3 (IRT-based) showed decent fit: CFI=.978, TLI=.963, RMSEA=.063, SRMR=.030.
“CFI = .978; TLI = .963; RMSEA = .063 (90% CI [.016, .105]); SRMR = .030.”
Quote in the paperSubstantial claim - Findingown data
Parallel analysis indicated that a two-factor structure best represented the dimensionality of the data.
“The analysis indicated that a two-factor structure best represented the dimensionality of the data.”
Quote in the paperSubstantial claim - Findingown data
Model 1 (CTT-based six highest loading items) showed marginal-to-poor fit: CFI=.915, TLI=.858, RMSEA=.192, SRMR=.041.
“CFI = .915; TLI = .858; RMSEA = .192 (90% CI [.157, .228]); SRMR = .041.”
Quote in the paperSubstantial claim - Findingown data
Two items were removed from consideration because their responses violated accepted infit/outfit criteria.
“Two items were removed from consideration because responses violated accepted infit/outfit criteria.”
Quote in the paperSubstantial claim - Findingcitation
The IRT model demonstrated a superior test information function curve, higher and smoother than the other models.
“In addition to the superior fit indices, the IRT model demonstrated a superior test information function curve as the test information function was higher and smoother (Mallinckrodt et al., 2016; Figure 1).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Mallinckrodt et al., 2016
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
SEM requires at least three manifest variables to indicate a latent factor without local identification problems.
“construction of latent variables in SEM requires use of at least three manifest variables to indicate a latent factor without causing local identification problems (Little, Cunningham, Shahar, & Widaman, 2002).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Little, Cunningham, Shahar, & Widaman, 2002
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
NMA reduces the likelihood that affected men will benefit from counseling, which requires active emotional engagement.
“It also makes it less likely that such men will be able to benefit from counseling, which requires active engagement with one’s emotions.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Levant (2001)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Study design and conductown data
The data were only mildly nonnormal, with skew from -0.42 to 1.28 and kurtosis from -1.08 to 0.61.
“The data were only mildly nonnormally distributed, with values of skew ranging from −0.42 to 1.28 and values of kurtosis ranging from −1.08 to 0.61.”
Quote in the paperNot a substantial claim - Premisecitation
NMA makes affected men more likely to cope with stress in ways that increase the likelihood of substance abuse, violent behavior, sexual compulsions, and stress-related illnesses.
“Consequently, it predisposes such men to deal with stress in ways that make certain forms of pathology more likely, such as substance abuse, violent behavior, sexual compulsions, and stress-related illnesses.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Levant (2001)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Study design and conductown data
Thirty participants were removed from the data set for failing the validity check item.
“Thirty participants were removed from the data set for failing to correctly respond to the validity check item.”
Quote in the paperNot a substantial claim - Study design and conductown data
The NMAS, TAS-20, and RE scales had no univariate outliers (z > 3.29).
“The three scales (NMAS, TAS-20, and RE) evidenced no univariate outliers (i.e., z scores >3.29).”
Quote in the paperNot a substantial claim - Study design and conductown data
For the EFA, 247 randomly selected cases exceeded the minimum N of less than 178 indicated by MacCallum et al.'s criteria for 20 observed variables.
“For the EFA, we used the MacCallum, Browne, & Sugawara (1996, Table 4) criteria. With 20 observed variables, there were 210 degrees of freedom, indicating that the minimum N is <178. We had randomly selected 247 cases from the full data set of 505, which is more than adequate.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites MacCallum, Browne, & Sugawara (1996, Table 4)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Study design and conductcitation
For the CFA, 258 cases exceeded Kline's recommended minimum of 180 participants for 18 freely estimated parameters.
“For the CFA, we used the remaining 258 cases, and for the validity analyses we used the full data set of 505. Kline (2016) recommended a minimum of 10 participants for every freely estimated parameter. The CFAs had 18 parameters, requiring 180 participants. Our N of 258 exceeds this number.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Kline (2016)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Among men in heterosexual relationships, NMA is positively associated with fear of intimacy.
“NMA is negatively correlated with relationship satisfaction and communication quality and positively correlated with fear of intimacy in men in heterosexual relationships (Karakis & Levant, 2012).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Karakis & Levant, 2012
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
After demographic variables were controlled, traditional masculinity ideology explained unique variance in alexithymia among men across racial and ethnic groups.
“After controlling for demographic variables, TMI accounted for unique variance in alexithymia in men.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Levant et al. (2003)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Study design and conductown data
No items selected to compose the NMAS-BF demonstrated disordered thresholds.
“No items selected to compose the NMAS-BF demonstrated disordered thresholds.”
Quote in the paperSubstantial claim - Study design and conductreasoning
Participants without Internet access were implicitly excluded by the use of MTurk recruitment.
“Fourth, participants without Internet access were implicitly excluded by the use of MTurk recruitment.”
Quote in the paperNot a substantial claim - Study design and conductnone given
The evaluation of validity evidence was limited to just two criterion variables.
“Fifth, our evaluation of evidence for validity was limited to just two criterion variables.”
Quote in the paperNot a substantial claim - Study design and conductown data
The measurement model for the concurrent validity analysis showed reasonable fit: χ2(41)=152.70, p<.001, CFI=.950, TLI=.933, RMSEA=.073, SRMR=.038.
“The CFA of the measurement model produced reasonable fit to the data, χ2(41) = 152.70, p < .001, CFI = .950, TLI = .933, RMSEA = .073 (90% CI [.061, .086]), SRMR = .038.”
Quote in the paperSubstantial claim - Premisecitation
In other research, as many as half of significant correlations using raw scores were not significant using latent variables.
“The hazards of relying on raw scores have been strikingly demonstrated in other research, where as many as half of the significant correlations using raw scores were not significant using latent variables (Levant et al., 2016; Levant et al., 2017).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Levant et al., 2016
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Levant et al., 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationnone given
The present study demonstrates advantages of SEM and IRT for assessing psychometric properties of scales used in counseling psychology research, particularly for item selection, dimensionality assessment, and using latent variables to evaluate validity.
“Second, the present study demonstrates the advantages of SEM and IRT for assessing the psychometric properties of any scale used in counseling psychology research—in particular, for the selection of items, the assessment of dimensionality, and the use of latent variables for evaluating evidence for validity.”
Quote in the paperSubstantial claim
- May combine two claims. 33
- The quote only partly states this claim. 2
- Classified as probably not a substantial claim. 14
- Not yet classified. 1
May combine two claims.
Findingown dataIn a structural regression model, latent NMAS-BF scores uniquely predicted RE scores when TAS-20 scores were also in the model, supporting concurrent validity.
“Concurrent evidence for validity of the latent factor of the NMAS-BF was assessed in a structural regression model which found that the NMAS-BF uniquely predicted RE scores when TAS-20 scores were included in the model.”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataThe NMAS items were best represented by a one-factor solution, with factor loadings .40 to .85, supporting H1's specified one-factor dimensionality.
“Finally, based on prior research (Levant et al., 2006) and the scree plot,1 the data were analyzed for a one-factor solution, in which the resulting factor loadings ranged from .40 to .85.”
- Also stated in: § EFAs of Responses to the NMAS · plain
“H1 had specified one-factor dimensionality and thus was supported.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Levant et al., 2006
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Also stated in: § EFAs of Responses to the NMAS · plain
May combine two claims.
Findingown dataIn hierarchical multiple regression, NMAS-BF scores accounted for variance in RE scores beyond that explained by TAS-20 scores, supporting incremental validity.
“Finally, incremental evidence for validity was examined using hierarchical multiple regression, finding that NMAS-BF scores significantly predicted variance in RE scores above and beyond that predicted by TAS-20 scores.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe latent NMAS-BF and TAS-20 constructs were significantly and moderately positively correlated, which supported convergent validity.
“Convergent evidence for validity was supported by a significant, moderate, positive correlation between the latent constructs of the NMAS-BF and Toronto Alexithymia Scale-20 (TAS-20), which measures clinical alexithymia.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataNMAS-BF scores significantly predicted variance in RE scores above and beyond alexithymia scores, supporting H5.
“The results are shown in Table 6, where it can be seen that NMAS-BF scores significantly predicted variance in RE scores above and beyond that predicted by alexithymia scores, supporting H5.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe correlation between latent NMA and alexithymia was significant, moderate-to-strong, positive (.57, p < .001), providing convergent validity evidence and supporting H3.
“The correlation between the latent constructs of normative male alexithymia and alexithymia was significant, moderate-to-strong, and positive (.57, p < .001), providing convergent evidence for validity and supporting H3.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe NMAS-BF uniquely predicted RE scores when alexithymia scores were included in the model, supporting H4.
“The results are shown in Table 5, where it can be seen that the NMAS-BF uniquely predicted RE scores when alexithymia scores were included in the model, supporting H4.”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationThe reliability coefficient for the NMAS-BF was .80, representing good reliability.
“The reliability coefficient for the NMAS-BF was .80, which, according to Ponterotto and Ruckdeschel’s (2007) criteria represents good reliability.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Ponterotto and Ruckdeschel’s (2007) source
May combine two claims.
Study design and conductown dataMissing data was low: 0.2% to 0.6% per item and less than 1% per participant on average, below the 10% cutoff for available item analysis.
“Among the remaining participants, a low level of missing data was observed at the item level (0.2% to 0.6% missing responses per item). The average percentage of missing responses per participant over all items was less than 1%, which is below Parent’s (2013) cutoff of 10% for using available item analysis.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Parent (2013)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationThe RE subscale showed significant correlations with a latent NMAS factor, the CMNI-46 Emotional Control factor, and the GRCS-SF RE factor, providing concurrent validity evidence.
“Using structural equation modeling (SEM), RE showed significant correlations with a latent NMAS factor, the Conformity to Masculine Norms Inventory-46 Emotional Control specific factor, and Gender Role Conflict Scale-SF RE first-order factor, providing concurrent evidence for validity (Levant et al., 2016).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Levant et al., 2016
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Premisenone givenNMA and clinical alexithymia overlap in difficulty identifying and describing feelings but differ on externally oriented thinking and on the socialized restriction of vulnerable and caring emotions.
“These two constructs overlap in terms of difficulties in identifying and describing feelings, but do not overlap on the more severe aspects of alexithymia (i.e., externally oriented thinking), on the one hand, nor on the socialized process of restricting the expression of vulnerable and caring emotions, on the other hand.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe TAS-20 has demonstrated convergent validity through negative associations with psychological mindedness, need-for-cognition, affective orientation, and emotional intelligence.
“Convergent validity has been demonstrated by negative associations with closely related constructs such as psychological mindedness, need-for-cognition, affective orientation, and emotional intelligence (see Taylor, 2004, for a summary of research using a broad array of student, community, and clinical samples).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Taylor, 2004
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationA meta-analysis of 41 samples found a small mean difference in alexithymia between women and men (Hedges' d = .22), with men higher, and no significant moderation by clinical versus nonclinical population or by alexithymia measure.
“An effect size estimate based on 41 existing samples found consistent, although expectedly small, differences in mean alexithymia between women and men (Hedges’ d = .22). Men exhibited higher levels of alexithymia. There were no significant moderator effects for clinical versus nonclinical populations or alexithymia measure used, although there were relatively few clinical samples and most studies”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Levant, Hall, Williams, & Hasan, 2009
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductcitationThe present study used appropriate selection criteria and attention checks.
“Data obtained from MTurk has been demonstrated to be valid and reliable when appropriate selection criteria and attention checks are used (Casler, Bickel, & Hackett, 2013; Peer, Vosgerau, & Acquisti, 2014), as was the case in this study.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationAmong men in heterosexual relationships, NMA is inversely associated with relationship satisfaction and communication quality.
“NMA is negatively correlated with relationship satisfaction and communication quality and positively correlated with fear of intimacy in men in heterosexual relationships (Karakis & Levant, 2012).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Karakis & Levant, 2012
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationIn nonclinical samples, findings on gender differences in alexithymia are mixed: of 32 studies, 17 found men more alexithymic, one found women more alexithymic, and 14 found no difference.
“However, the 32 studies using nonclinical samples presented a different picture: 17 of these studies found males more alexithymic than females, one found females more alexithymic than males, and 14 found no differences between males and females.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Levant et al. (2006)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe TAS-20 is the most widely used measure of alexithymia.
“The TAS-20 (Bagby et al., 1994) is the most widely used measure of alexithymia, a construct referring to a cluster of characteristics including difficulty identifying and describing feelings, and externally oriented thinking.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bagby et al., 1994 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe TAS-20 total scale had coefficient alphas from .80 to .83 across three samples.
“The scale developers reported total scale coefficient αs from .80 to .83 in the three different samples.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataBartlett's test of sphericity was statistically significant, supporting factorability of the correlation matrix.
“Bartlett’s test of sphericity (Bartlett, 1954) was statistically significant, again further supporting the factorability of the correlation matrix.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Bartlett, 1954
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationThe original NMAS is a 20-item unidimensional scale with internal consistency α = .92 and test-retest reliability r = .91 over one to two months.
“Exploratory and confirmatory factor analyses using separate samples indicated that the NMAS consisted of a single 20-item factor. Men’s scores on the NMAS displayed very good internal consistency (α = .92) and test–retest reliability (r = .91) over a 1–2 month period.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Levant et al. (2006)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
Study design and conductown dataFor the validity structural regression, 505 cases exceeded the required 360 participants for 36 parameters.
“The validity analysis using structural regression had 36 parameters, requiring 360 participants. Our N of 505 exceeds this number.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningA measure with acceptable fit statistics is needed.
“Hence there is a need for measure with acceptable fit statistics.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningIf the NMAS-BF explains unique and incremental variance in RE when TAS-20 is in the model, this would suggest that the NMAS-BF measures a form of alexithymia more directly tied to men's gender role socialization than the TAS-20.
“If we find that the NMAS-BF explains both unique and incremental variance in RE when the TAS-20 is in the model that would suggest that the NMAS-BF may be tapping a form of alexithymia that is more directly related to men’s gender role socialization than the TAS-20.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationLevant et al. (2016) reported an alpha coefficient of .82 for the RE subscale.
“Levant et al. (2016) reported an alpha coefficient of .82.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Levant et al., 2016
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationThe scaled chi-square goodness-of-fit test depends on sample size and is overly sensitive to trivial model misfit when samples are large.
“However, because this statistic is dependent on sample size, it is overly sensitive to trivial sources of model misfit when sample sizes are large, as in the current study (Cheung & Rensvold, 2002).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Cheung & Rensvold, 2002
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
InterpretationreasoningThe 20-item NMAS is long for a unidimensional scale and may cause participant fatigue because it is likely to be one of several assessments in batteries on masculine socialization and emotional expression.
“Furthermore, the 20-item NMAS is long for a unidimensional scale, potentially creating participant fatigue as the NMAS is likely to be one of several assessments used in batteries related to masculine socialization and emotional expression.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationNMA prevents affected men from using the effective stress-management strategy of identifying, contemplating, and discussing emotional reactions to stressors or trauma with others.
“Furthermore, as Levant (2001) theorized, NMA blocks men who suffer from it from utilizing the most effective means known for dealing with life’s stresses and traumas—namely, identifying, thinking about, and discussing one’s emotional responses to a stressor or trauma with a friend, family member, or counselor.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Levant (2001)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataThe survey included two validity check items, and 30 participants who failed them were removed and excluded from all analyses.
“The survey contained two validity check items (e.g., “Please check strongly agree;” 30 participants were removed from the data set for failing to correctly respond to the validity check item and are not included in any analyses.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing).
PremisecitationMild-to-moderate alexithymia is more common among men whose boyhood socialization was more strongly shaped by traditional masculinity ideology.
“Levant (1992, 1995, 2001) drew on the GRSP to theorize that mild-to-moderate forms of alexithymia would occur more frequently among men whose socialization as boys was informed to greater degrees by traditional masculinity ideology (TMI).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Levant (1992, 1995, 2001)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims. The quote only partly states this claim.
PremisecitationConformity to the masculine norm of emotional control mediated the positive RE-alexithymia relationship; that relationship was stronger for Latino men and weaker for Asian American men, and the RE-by-race moderation was mediated through emotional control.
“Conformity to the masculine norm of emotional control mediated the positive relationship between RE and alexithymia. In addition, the positive relationship between RE and alexithymia was stronger for Latino men versus men from other racial groups, but weaker for Asian American men versus men from other racial groups.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Levant, Wong, Karakis, and Welsh (2015)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Not yet classified.
PremiseThe original NMAS factor structure did not meet contemporary incremental fit standards (TLI = .85, CFI = .87), although its RMSEA of .08 met the ≤.08 criterion.
“However, the incremental fit indices did not support the factor structure of the original NMAS using contemporary standards (i.e., Tucker-Lewis index [TLI] = .85, comparative fit index [CFI] = .87). Although root-mean-square error of approximation (RMSEA; 0.08) met the criterion of ≤.08, Gignac, Palmer, and Stough (2007) pointed out that such absolute fit indices “may erroneously suggest”
Quote in the paperNot yet classified0 of 2 sources checked- cites Levant et al. (2006)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Gignac, Palmer, and Stough (2007) source
May combine two claims.
Study design and conductcitationThe Kaiser-Meyer-Olkin value was .93, exceeding the suggested .60, supporting factorability.
“The Kaiser-Meyer-Olkin value was .93, which exceeds the suggested value of .60 (Kaiser, 1974).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Kaiser, 1974
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationRace and gender did not moderate the TMI-alexithymia relationship, but the race moderation was strongly affected by gender: TMI was more strongly related to alexithymia for White men than for racial minority men, and for racial minority women than for White women.
“While neither race nor gender moderated the relationship between these two variables, the moderating effect of race on the relationship between TMI and alexithymia was strongly affected by gender: TMI was more strongly related to alexithymia for White men than for racial minority men, whereas TMI was more strongly related to alexithymia for racial minority women than for White women.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Levant & Wong, 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
PremisecitationInfit and outfit values under .60 or over 1.40 indicate unexpected response patterns influenced by factors other than the underlying construct.
“Infit and outfit values under .60 or over 1.40 indicate that the patterns of responses were unexpected (i.e., response patterns appear to be influenced by factors other than the construct underlying the measure; Mallinckrodt et al., 2016).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Mallinckrodt et al., 2016
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationUsing latent rather than manifest variables to assess validity is important because prior research found that many raw-score correlations became non-significant when latent variables were used.
“The use of latent instead of manifest variables to assess validity is important because prior research has found that many significant correlations calculated from raw scores were not significant when using latent variables (Levant, Alto, McKelvey, Richmond, & McDermott, 2017; Levant et al., 2016).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Levant, Alto, McKelvey, Richmond, & McDermott, 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Levant et al., 2016
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim. May combine two claims.
PremisecitationEvidence from developmental psychology supports that boys are socialized to avoid expressing vulnerable and caring emotions while girls are encouraged to be expressive, which is theorized to create gender differences in alexithymia.
“Levant’s (2001) review of relevant developmental psychology research literature on the emotion socialization of boys concluded that the evidence supported the view that boys are socialized to avoid the expression of vulnerable and caring emotions, whereas girls are encouraged to be expressive, which he theorized was likely to produce gender differences in alexithymia.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Levant’s (2001)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataEight multivariate outliers (1.58% of the sample) were identified by Mahalanobis distance; they were not extreme and were not deleted or modified.
“Likewise, the same scales yielded eight multivariate outliers (1.58% of the sample) as evidenced by Mahalanobis distance procedures. Given the relatively small percentage of outliers and the fact that no outliers were extreme in magnitude, we followed recommendations from Myers, Gamst, and Guarino (2013) and did not delete or modify outlier cases.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Myers, Gamst, and Guarino (2013)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataThe sample was composed mostly of White heterosexual men from the United States, limiting generalizability.
“Second, our sample was composed of mostly White heterosexual men from the United States. Explorations of the construct of normative male alexithymia within more diverse samples and contexts may be useful to inform interventions and clinical work with diverse samples of men.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataAll parcels had significant loadings on their factors; standardized loadings were .81-.82 for NMAS-BF, .70-.85 for TAS-20, and .73-.85 for RE indicators.
“All of the parcels had significant loadings on their respective factors; the standardized loadings ranged from .81 to .82 for the NMAS-BF, and .70 to .85 for the TAS-20. In addition, where manifest indicators were used (i.e., for RE), all indicators had significant loadings on their factor and ranged from .73 to .85.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe results provided evidence for internal consistency reliability and for convergent, concurrent, and incremental validity, supporting use of the NMAS-BF.
“The results also provided evidence for internal consistency reliability, and for convergent, concurrent, and incremental evidence for validity, supporting the use of the NMAS-BF.”
- Also stated in: § Conclusions · plain
“First, there is evidence supporting the unidimensionality and internal constancy reliability; in addition there is convergent, concurrent, and incremental evidence for the validity of the NMAS-BF, although additional research is called for in investigating the test–retest reliability and measurement invariance across groups of men defined by race, age, and sexual orientation.”
Quote in the paperSubstantial claim- Also stated in: § Conclusions · plain
May combine two claims.
Interpretationown dataModel 3 was the preferred model, and H2 was supported.
“Hence Model 3 was the preferred model, and H2 was supported.”
- Also stated in: § Discussion · plain
“The model based on IRT was superior to models based on CTT and CTT optimized to reduce redundancy.”
Quote in the paperSubstantial claim- Also stated in: § Discussion · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe study did not collect data on participants' socioeconomic status and educational attainment.
“Third, we did not collect data on participants’ socioeconomic status and educational attainment.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningThe self-report nature of the surveys introduces the possibility of socially desirable responding, which was not measured in this study.
“First, the self-report nature of the surveys introduces the possibility of socially desirable responding (SDR). SDR was not measured in our study; however, a recent article demonstrated that SDR is not always a problem (Tracey, 2016).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tracey, 2016 source
May combine two claims.
InterpretationreasoningThe study has not demonstrated that differences in alexithymia or NMA are due to socialization, and thus a central element of GRSP theory has not been tested.
“we have not demonstrated that these differences are due to socialization, and thus we have not yet tested a central element of the GRSP theory. We thus do not know for certain whether NMA (as measured by the NMAS-BF) is related to masculine socialization.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe items selected through IRT encompass a wider range of aspects of NMA than those selected via CTT, making the NMAS-BF more useful as a brief assessment.
“The items selected through IRT encompass a wider range of aspects of normative male alexithymia compared with those selected via CCT, making the NMAS-BF more useful as a brief assessment.”
Quote in the paperSubstantial claim
The authors state this as an assumption.
Normative male alexithymia is a mild-to-moderate form of alexithymia that is normative for men because of gender-linked socialization practices.
“The NMAS-BF is intended to measure a mild-to-moderate form of alexithymia theorized to be normative for men due to gender-linked socialization practices—NMA.”
The paper relies on this without support.
The construct assessed by the NMAS-BF would likely be only one of several assessment instruments in future studies, and brevity would minimize participant burden.
“Second, we intended for the NMAS-BF to be a brief scale because the construct assessed would likely be only one of several assessment instruments included in future studies, and brevity would minimize participant burden.”
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentχ²(41) = 152.7reported p < .001 · recomputed p < .001
“χ2(41) = 152.70, p < .001”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Regression direction conflicts with the reported prediction
MinorThe described model regresses NMAS-BF and TAS-20 on RE, making RE the predictor. The reported interpretation instead says NMAS-BF predicts RE.
“latent factors representing the NMAS-BF and the TAS-20, using parcels as discussed above, were regressed on the latent factor of RE”
“the NMAS-BF uniquely predicted RE scores when alexithymia scores were included in the model, supporting H4.”
American Indian percentage is too low
MinorFive of 505 participants is approximately 1.0%, not 0.8%. The reported 0.8% corresponds more closely to four participants.
Reported 0.8 · recomputed 0.990099
“five (0.8%) as American Indian”
Concurrent validity is assigned to two different hypotheses
MinorThe methods call H3 the concurrent-validity hypothesis, but the stated hypotheses assign concurrent validity to H4 and convergent validity to H3.
“For the concurrent validity hypothesis (H3)”
“Hypothesis 4 (H4): concurrent evidence for validity would be demonstrated by latent NMAS-BF scores uniquely predicting latent RE scores when latent alexithymia scores are included in the model.”
Cites
Bagby, R. M., Parker, J. D. A., & Taylor, G. J. (1994) · Journal of Psychosomatic Research · doi:10.1016/0022-3999(94)90005-1 · Cited by 5,293 · cited 2× · see citing works
“The TAS-20 (Bagby et al., 1994) is the most widely used measure of alexithymia, a construct referring to a cluster of characteristics including difficulty identifying and describing feelings, and externally oriented thinking. Participants rated their agreement with 20 statements on a 5-point scale (1 strongly disagree…”
Reputation as a sufficient condition for data quality on Amazon Mechanical Turk
Peer, E., Vosgerau, J., & Acquisti, A. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0434-y · Cited by 1,618 · see citing works
A Comparison of Bifactor and Second-Order Models of Quality of Life
Chen, F. F., West, S., & Sousa, K. (2006) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4102_5 · Cited by 955 · see citing works
Ponterotto, J. G., & Ruckdeschel, D. E. (2007) · Perceptual and Motor Skills · doi:10.2466/pms.105.3.997-1014 · Cited by 555 · cited 1× · see citing works
“80, which, according to Ponterotto and Ruckdeschel’s (2007) criteria represents good reliability.”
Levant, R. F., Hall, R. J., & Rankin, T. J. (2013) · Journal of Counseling Psychology · doi:10.1037/a0031545 · Cited by 222 · cited 3× · see citing works
“RE subscale of the Male Role Norms Inventory—Short Form (MRNI-SF).”
InfluentialSelf-citationA note on socially desirable responding.
Tracey, T. J. G. (2016) · Journal of Counseling Psychology · doi:10.1037/cou0000135 · Cited by 110 · cited 1× · see citing works
“SDR was not measured in our study; however, a recent article demonstrated that SDR is not always a problem (Tracey, 2016).”
Gignac, G. E., Palmer, B. R., & Stough, C. (2007) · Journal of Personality Assessment · doi:10.1080/00223890701629730 · Cited by 104 · cited 1× · see citing works
“Although root-mean-square error of approximation (RMSEA; 0.08) met the criterion of .08, Gignac, Palmer, and Stough (2007) pointed out that such absolute fit indices “may erroneously suggest satisfactory levels of model fit simply because the items are only weakly correlated” (p. 248).”
InfluentialLevant, R. F., Hall, R. J., Weigold, I. K., & McCurdy, E. R. (2016) · Journal of Counseling Psychology · doi:10.1037/cou0000171 · Cited by 37 · cited 4× · see citing works
“Levant et al. (2016) reported an alpha coefficient of .82.”
InfluentialSelf-citationMcDermott, R. C., Levant, R. F., Hammer, J. H., Hall, R. J., McKelvey, D. K., & Jones, Z. K. (2017) · Journal of Counseling Psychology · doi:10.1037/cou0000225 · Cited by 32 · cited 1× · see citing works
“It was subsequently used in two samples diverse in terms of race/ethnicity and sexual orientation: Levant et al., 2015; McDermott et al., 2017).”
Self-citationLevant, R. F., Alto, K. M., McKelvey, D. K., et al. (2017) · Journal of Counseling Psychology · doi:10.1037/cou0000230 · Cited by 16 · cited 1× · see citing works
“The hazards of relying on raw scores have been strikingly demonstrated in other research, where as many as half of the significant correlations using raw scores were not significant using latent variables (Levant et al., 2016; Levant et al., 2017).”
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Caregivers in anorexia nervosa: is grief underlying parental burden?
Duclos, J., Piva, G., Riquin, É., Lalanne, C., Meilleur, D., Blondin, S., EVHAN Group, Berthoz, S., Duclos, J., Mattar, L., et al. (2023) · Eating and Weight Disorders - Studies on Anorexia Bulimia and Obesity · doi:10.1007/s40519-023-01530-x · Cited by 15 · see citing works
“Differences between genders have already been shown in depression [55], anxiety [56] and alexithymia [13, 54, 57].”
BackgroundSideridis, G. D., Tsaousis, I., & Ghamdi, H. (2022) · Educational and Psychological Measurement · doi:10.1177/00131644221130482 · Cited by 12 · see citing works
Stigma and help-seeking behaviours of men with depression: a literature review
Covello, K. (2020) · Mental Health Practice · doi:10.7748/mhp.2020.e1474 · Cited by 11 · see citing works
Lisi, G., Rossi, R., Ribolsi, M., Lorenzo, G. D., Parisi, C., Siracusano, M., Morciano, L., Stefano, A. D., Pesaresi, A., Niolu, C., et al. (2020) · Psychological Medicine · doi:10.1017/s0033291720002767 · Cited by 10 · see citing works
Levant, R. F., Gregor, M. A., & Alto, K. M. (2021) · Psychology and Health · doi:10.1080/08870446.2021.1871907 · Cited by 8 · see citing works
“Prior scale development research has found that psychometric properties can be improved by removing poorly performing items and creating a shorter scale (e.g. Levant & Parent, 2019).”
BackgroundSelf-citationZhang, X., Huang, L., Wang, F., & Zhang, H. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.119676 · Cited by 6 · see citing works
Casassa, E., Bergeron, A., Maruani, A., et al. (2020) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.17037 · Cited by 6 · see citing works
Wang, F., Zhang, X., Huang, L., Zhang, X., Jie, W., Chang, X., Chu, Y., Wang, L., Jia, W., & Zhang, B. (2025) · Scientific Reports · doi:10.1038/s41598-024-82958-8 · Cited by 4 · see citing works
Miniati, M., Lippi, M. E., Palagini, L., Conversano, C., Orrù, G., Gemignani, A., & Perugi, G. (2024) · Healthcare · doi:10.3390/healthcare12050586 · Cited by 4 · see citing works
“However, several studies pointed out that alexithymic traits might be more frequent among males than females as a consequence of the so-called ‘normative male alexithymia’ [42], characterized by a deficit in processing emotions.”
BackgroundDevelopment and Standardisation of Masculine Emotional Expressivity Scale (MEES)
Saxena, S., Khurana, R., Kalsi, N., & Vyas, K. (2025) · Annals of Neurosciences · doi:10.1177/09727531251372711
ÖZEL, İ. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1851206
“Therefore, the present study should primarily be interpreted as a psychometric validation study of a brief measure designed to assess masculinity-related emotional restriction (Levant and Parent, 2019).”
InfluentialMen in Couple Therapy: The Modern Bind, Intimacy Requires What Socialization Restricts
Stahlschmidt, H. J. (2026) · The Family Journal · doi:10.1177/10664807261483720
- Authors
- Levant, R. F., & Parent, M. C.
- Venue
- Journal of Counseling Psychology
- Published
- 2019-03
- Volume
- 66
- Issue
- 2
- Pages
- 224-233
- ISSN
- 0022-0167 (ISSN-L)
- 1939-2168
- PMC
- PMC10388695
- OpenAlex
- W2895383725
- Cited by
- 12
- References
- 10
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 1 · 2023: 1 · 2022: 1 · 2021: 1 · 2020: 3
- FWCI
- 0.78
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Counseling Psychology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (P2CHD042849)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Psychosomatic Disorders and Their Treatments
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- alexithymia, Toronto Alexithymia Scale-20, psychometric validation, item response theory, classical test theory, reliability statistics, incremental validity
- MeSH terms
- Adult, Affective Symptoms, Aged, Factor Analysis, Statistical, Female, Humans, Male, Middle Aged, Brief Psychiatric Rating Scale, Psychometrics, Socialization, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-09-28.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review