Measuring Theory of Mind in Adults with Autism Spectrum Disorder

May combine two claims.

The final A-ToM items discriminated IQ-matched adults with ASD from controls on the social items but not the physical items.

“The final items discriminated IQ-matched adults with ASD from controls on the social but not the physical items.”

May combine two claims.

Corrected item-total correlations for Components 1 and 2 ranged from 0.32 to 0.55 and 0.24 to 0.40, respectively.

“Corrected item-total correlations for Components 1 and 2 ranged from 0.32 to 0.55 and 0.24 to 0.40, respectively5.”

May combine two claims.

Test-retest coefficients (r) were 0.82 and 0.64 for the A-ToM social and physical scales, respectively.

“Test retest coefficients (r) were 0.82 and 0.64 for the A-ToM social and physical scales, respectively.”

May combine two claims.

Component 2 corresponded to a physical component, with all six purported physical items loading on this component (loadings 0.59 to 0.41), as did two items (party and bunnies) with loadings of 0.40 and 0.53, which also loaded on the social component (loadings 0.69 and 0.36).

“Component 2 corresponded to a physical component. All six of the purported physical items loaded on this component, with loadings ranging from 0.59 to 0.41, as did two items (party and bunnies) with loadings of 0.40 and 0.53, which also loaded on the social component, with loadings of 0.69 and 0.36.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The final A-ToM scale comprises six social and six physical items.

“The six social and six physical items3 that comprised the final scale (after the psychometric analyses) can be accessed via the link below:”

May combine two claims.

Inter-rater reliability, using Cohen's kappa, was 0.77 for the 6-item A-ToM social scale and 0.88 for the 6-item A-ToM physical scale.

“Inter-rater reliability, using Cohen’s kappa, was 0.77 for the 6-item A-ToM social scale and 0.88 for the 6-item A-ToM physical scale.”

May combine two claims.

A parallel analysis indicated two components and the PCA was repeated to extract a two component solution.

“The outcomes of this analysis indicated two components and the PCA was repeated to extract a two component solution.”

May combine two claims.

The correlations between the A-ToM social and physical sub-tests and the AQ50 were −0.004 and −0.045, respectively, for the ASD sample.

“Interestingly, the respective correlations between the A-ToM social and physical sub-tests and the AQ50, which we used as a filler task, were −0.004 and −0.045, respectively, for the ASD sample”

May combine two claims.

The CI and effect size statistics in Table 3 suggest that the ASD sample performed worse than controls on the A-ToM social sub-test, with the group difference effect size much lower for the A-ToM physical sub-test.

“The CI and effect size statistics shown in Table 3 suggest that the ASD sample performed worse than the controls on the A-ToM social sub-test, with the group difference effect size much lower for the A-ToM physical sub-test.”

May combine two claims.

After item-pool reduction, the social items did not emerge as significantly more difficult overall than the physical items for either the ASD sample (M = 0.61, SD = 0.21 vs. M = 0.55, SD = 0.16; t(10) = 0.57, p = .58) or the non-ASD controls (M = 0.76, SD = 0.21 vs. M = 0.61, SD = 0.14; t(10) = 1.45, p = .18).

“Importantly, the outcome of the reduction of the item pool was such that the social items did not emerge as significantly more difficult overall than the physical items (contrary to what Fletcher et al. 1995, had found for the original Strange Stories physical items) for either the ASD sample (M = 0.61, SD = 0.21 vs. M = 0.55, SD = 0.16), t (10) = 0.57, p = .58, or the non-ASD controls (M = 0.76,”

• cites Fletcher et al. 1995 sourceNot checked yet

  Not checked in the free run.

May combine two claims.

Although some participants in both groups were close to or at ceiling on the social sub-test, this pattern was less marked for ASD participants, and extremely low social scores were more prevalent for ASD participants.

“Although some participants in both groups were close to or at ceiling on the social sub-test, this pattern was less marked for the ASD participants. Moreover, extremely low social scores were more prevalent for ASD participants.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The final six social items included examples of faux pas (1), sarcasm (2), white lie (1), bluff or persuasion (1) and perspective taking or misunderstanding (1).

“The final six items included examples of faux pas (1), sarcasm (2), white lie (1), bluff or persuasion (1) and perspective taking or misunderstanding (1).”

May combine two claims.

VCI did not predict group membership, but after controlling for VCI, the Strange Stories social score did, with each one-unit increase on the social scale increasing the odds of being classified as a control group member by a factor of 1.46.

“The VCI did not predict group membership but, after controlling for VCI, the Strange Stories social score did, with each increase of one-unit on the social scale increasing the odds of being classified as a control group member by a factor of 1.46.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The trend was for correlations with VCI to be a little stronger than for PRI.

“As Tables 6, 7 and 8 shows, the trend was for correlations with VCI to be a little stronger than for PRI, and for the social-VCI correlation to be a little stronger for the Strange Stories than for the A-ToM.”

May combine two claims.

For the Frith-Happé animations, effect size indices suggest small group differences in the expected directions on the mental and feelings categorization scales, but not on the random or goal-directed scales.

“For the Frith- Happé animations, the other instrument included to examine convergent validity, the effect size indices shown in Table 3 suggest small group differences, in the expected directions, on the mental and feelings categorization (but not the random or goal-directed) scales.”

May combine two claims.

For the Strange Stories, the CI and effect size patterns for the social sub-test were similar to those for the A-ToM, with the two groups clearly differentiated on the social sub-test.

“For the Strange Stories, the CI and effect size patterns for the social sub-test were similar in nature to those for the A-ToM, with the two groups clearly differentiated on the social sub-test.”

May combine two claims.

Some individuals with ASD had little difficulty interpreting social interactions accurately, while others were quite markedly impaired.

“Some individuals clearly had little difficulty interpreting the social interactions accurately; others were quite markedly impaired.”

May combine two claims.

Although the ASD group performed worse on the mental and feelings measures of the Frith-Happé animations, the effect sizes were relatively weak and the differences were not significant with VCI controlled.

“Although the ASD group performed worse on the mental and feelings measures of the Frith-Happé animations, the effect sizes were relatively weak and the differences were not significant with VCI controlled.”

May combine two claims.

Despite clear group differentiation on the A-ToM social scale, variability in ToM performance within the ASD sample was substantial.

“Despite the clear group differentiation on the A-ToM social scale, the variability in ToM performance within the ASD sample was substantial.”

May combine two claims.

The expected group differences emerged on the empathy and social anxiety scales of the Interpersonal Reactivity Index and the mini-SPIN, yet these measures were uncorrelated with the A-ToM social scale.

“Second, the expected group differences emerged on the empathy and social anxiety scales of the Interpersonal Reactivity Index and the mini-SPIN, yet these measures were uncorrelated with the A-ToM social scale.”

• cites Davis 1983 sourceNot checked yet

  Not checked in the free run.

• cites Connor et al. 2001 sourceNot checked yet

  Not checked in the free run.

May combine two claims.

On the Strange Stories, the groups were clearly differentiated on the social scale, but they were also differentiated on the physical scale.

“On the Strange Stories, the groups were clearly differentiated on the social scale–but they were also differentiated on the physical scale and the differentiation on both scales persisted after controlling for VCI.”

Classified as probably not a substantial claim.

VCI was used as a covariate in analyses.

“Accordingly, the VCI was used as a covariate in analyses.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Frith (2004) suggested that much of the apparent variability in ToM test performance in adult samples may reflect the extent to which the task allows an individual to hack out a solution to a problem.

“In a similar vein, Frith (2004) suggested that much of the apparent variability in ToM test performance that may be seen in adult samples may reflect the extent to which the task allows an individual to hack out a solution to a problem.”

• cites Frith (2004) sourceNot checked yet

  Not checked in the free run.

May combine two claims.

Persons with ASD have unique cognitive profiles and matching with typical controls is difficult.

“We acknowledge that persons with ASD have unique cognitive profiles and matching with typical controls is difficult; thus, the use of scales such as the Wechsler Scales is preferred as it taps the diversity in abilities (cf. Mottron 2004).”

• cites Mottron 2004 sourceNot checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The 25 scenarios were incorporated into a VLC Media Player playlist in a random order, with four different randomly-ordered versions created for counterbalancing purposes and social and physical videos distributed randomly throughout each version.

“The 25 scenarios were incorporated into a VLC Media Player playlist in a random order. Four different randomly-ordered versions were created for counterbalancing purposes, with social and physical videos distributed randomly throughout each version.”

May combine two claims.

A Kaiser-Meyer-Olkin measure (KMO = 0.82) exceeding 0.6 and Bartlett's Test of Sphericity, χ2(66) = 364.7, p < .001, confirmed the adequacy of the sample size and the correlations between items.

“A Kaiser–Meyer–Olkin measure (KMO = 0.82) exceeding 0.6 (Tabachnick and Fidell 2001) and Bartlett’s Test of Sphericity, χ 2 (66) = 364.7, p < .001, respectively, confirmed the adequacy of the sample size and the correlations between items.”

• cites Tabachnick and Fidell 2001Not checked yet

  Not checked in the free run.

Classified as probably not a substantial claim. May combine two claims.

Performance IQ was the preferred match because it is less affected by verbal demands and thought to be a purer reflection of IQ.

“Performance IQ was our preferred match as it is less affected by the verbal demands of the test and thus thought to be a purer reflection of IQ.”

May combine two claims.

White et al. (2011) found that adults with ASD were less effective than age and IQ-matched controls at identifying mental state interactions and categorizing emotions.

“White et al. (2011) found that adults with ASD were less effective than age and IQ-matched controls at identifying mental state interactions and categorizing emotions.”

• cites White et al. (2011) sourceNot checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

Selection of the 60 s interval was based on a pilot study in which 25 upper-level psychology students were group-tested, recording the time it took for most of the group to complete their response to each question.

“Selection of this interval was based on a pilot study in which we group-tested 25 upper-level psychology students, recording the time it took for most of the group to complete their response to each question.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The WASI-II Block Design and Matrix Reasoning subtests make up the Perceptual Reasoning component, while the Vocabulary and Similarities subtests make up the Verbal Comprehension component.

“The Block Design and Matrix Reasoning subtests make up the Perceptual Reasoning component, while the Vocabulary and Similarities subtests make up the Verbal Comprehension component.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The Mini-SPIN is a three item, self-report screener for generalized social anxiety disorder.

“The Mini-SPIN–based on an item analysis of the Social Phobia Inventory (see Connor et al. 2001, for psychometric data)–is a three item, self-report screener for generalized social anxiety disorder.”

• cites Connor et al. 2001 sourceNot checked yet

  Not checked in the free run.

Classified as probably not a substantial claim.

The two convergent validity measures used were the Strange Stories test and the Frith-Happé animations.

“The two measures used were the Strange Stories test and the Frith-Happé animations (White et al. 2011).”

• cites White et al. 2011 sourceNot checked yet

  Not checked in the free run.

Classified as probably not a substantial claim. May combine two claims.

Participants' answers were rated on a 0-2 scale (0 = incorrect, 1 = partially correct, 2 = correct), with scoring criteria providing examples for each answer type for each item.

“Participants’ answers were rated on a 0–2 scale: 0 (incorrect), 1 (partially correct) or 2 (correct), with the scoring criteria providing examples for each answer type provided for each item”

Probably not a substantial claim: may not pass S3 (load-bearing).

The remaining 12 ASD participants were diagnosed by a psychologist recognized by the local agency or by two qualified diagnosticians.

“The other 12 participants were diagnosed either by a psychologist recognized by the local agency or by two qualified diagnosticians.”

Classified as probably not a substantial claim.

The use of scales such as the Wechsler Scales is preferred for matching because it taps the diversity in abilities.

“We acknowledge that persons with ASD have unique cognitive profiles and matching with typical controls is difficult; thus, the use of scales such as the Wechsler Scales is preferred as it taps the diversity in abilities (cf. Mottron 2004).”

• cites Mottron 2004 sourceNot checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

Participants were instructed at the beginning of the task that they would have 60 s in which to record their response for each question.

“Participants were instructed at the beginning of the task that they would have 60 s in which to record their response for each question.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Reliability and validity data for the WASI-II are reported in McCrimmon & Smith (2012).

“Reliability and validity data are reported in McCrimmon & Smith (2012).”

• cites McCrimmon & Smith (2012) sourceNot checked yet

  Not checked in the free run.

May combine two claims.

All but 12 ASD participants were diagnosed by two qualified diagnosticians and met DSM-IV-TR criteria.

“All but 12 participants were registered with the local agency that coordinates statewide assessment and provision of services. All individuals registered with the local agency had been diagnosed by two qualified diagnosticians and met DSM-IV-TR [APA 2000] criteria.”

• cites APA 2000Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The Interpersonal Reactivity Index comprises four seven-item, self-report sub-scales which tap four different aspects of empathy.

“The Interpersonal Reactivity Index (see Davis 1983, for reliability and construct validity data) comprises four seven-item, self-report sub-scales which tap four different aspects of empathy.”

• cites Davis 1983 sourceNot checked yet

  Not checked in the free run.

Classified as probably not a substantial claim. May combine two claims.

To assess inter-rater reliability, two observers blind to participant group studied and practiced with the scoring protocols and, after training, scored 30% (N = 73) of the response sheets.

“To assess inter-rater reliability for the A-ToM and the Strange Stories, two observers (blind to participant’s group) studied, and practiced with, the scoring protocols and, after training, scored 30% (N = 73) of the response sheets.”

May combine two claims.

Although verbal IQ contributed to group differences, the A-ToM social, but not the physical, sub-test discriminated the ASD from the non-ASD sample, thereby meeting one of the expectations for the instrument.

“In sum, although verbal IQ clearly contributed to group differences (see Table 5), the A-ToM social, but not the physical, sub-test discriminated the ASD from the non-ASD sample, thereby meeting one of the expectations for the instrument.”

Classified as probably not a substantial claim.

To examine stability of the A-ToM, 40 individuals were retested by one of the two administrators at intervals ranging from 2 to 83 weeks (M = 23.7 weeks, SD = 23.4 weeks).

“To examine stability of the A-ToM, 40 individuals were retested by one of the two administrators at intervals ranging from 2 to 83 weeks (M = 23.7 weeks, SD = 23.4 weeks).”

Probably not a substantial claim: may not pass S3 (load-bearing).

All physical items were based on, or adapted from, items described in Happé (1999).

“All physical items were based on, or adapted from, items described in Happé (1999).”

• cites Happé (1999)Not checked yet

  Not checked in the free run.

May combine two claims.

For the Strange Stories, even after removing VCI, group membership was differentiated by both the social and physical sub-tests rather than by the social sub-test alone, which undermines the discriminative capacity of the Strange Stories for adult samples.

“Thus, for the Strange Stories, even after removing VCI, group membership was differentiated by both the social and physical sub-tests rather than by the social sub-test alone, a finding which undermines the discriminative capacity of the Strange Stories for adult samples.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Three of the six final social items were based on, or adapted from, items described in Happé (1999), and the other three were from the pool developed for this study.

“Three of these six items were based on, or adapted from, items described in Happé (1999), and the other three items were from the pool developed for this study.”

• cites Happé (1999)Not checked yet

  Not checked in the free run.

May combine two claims.

There were clear group differences but also marked variability within groups on the A-ToM social sub-test.

“In other words, there were clear group differences but there was also marked variability within groups.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The presentation order of the A-ToM and Strange Stories was counterbalanced.

“The presentation order of the A-ToM and Strange Stories was counterbalanced.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

There were two test administrators, both of whom had completed honors level studies in psychology.

“There were two test administrators, both of whom had completed honors level studies in psychology.”

Classified as probably not a substantial claim. May combine two claims.

If lack of a ToM deficit does not preclude diagnosis, it would call into question whether a ToM deficit should be considered a core feature of the disorder, at least in adulthood.

“If indeed this proved to be the case it would call into question whether a ToM deficit should be considered a core feature of the disorder (at least in adulthood).”

May combine two claims.

While a ToM deficit may be indicative of ASD in adults, the lack of one (at least as detected on an instrument such as the A-ToM) may not preclude a diagnosis.

“Thus, while a ToM deficit may be indicative of ASD in adults, the lack of one (at least as detected on an instrument such as the A-ToM) may not preclude a diagnosis.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Examinees are likely to perceive the A-ToM scenarios as realistic (face validity), although this was not formally assessed.

“Moreover, the characteristics of the stimuli are such that examinees are likely to perceive the scenarios as realistic (i.e., as having face validity, although we did not formally assess this), thereby providing a plausible starting point for client-clinician discussions about the nuances of social interaction and the interpretation of the interpersonal behaviors of others.”