Understanding and Using the Brief Implicit Association Test: Recommended Scoring Procedures

“Self-reported attitudes and individual difference measures Each participant received a random selection of self-report measures including (a) 7-point relative preference for Democrats compared to Republicans, White people compared to Black people, and Self compared to Other; (b) 11-point warmth ratings for each of tho…”

“Also, the order of measurement blocks is a well-known influence on response latency measures like the IAT [2, 24].”

“Assessments that minimize random error in measurement of height and weight will maximize their correlation, getting it closest to the true correlation (assuming that the assessments are not influenced by the same extraneous influence; see also [7]).”

“Also, the BIAT has found application in many studies already [10–13] The present studies analyzed data from a very large data collection in a study that administrated a random selection of measures of attitudes regarding race, politics and the self from a large pool of possible indirect and direct attitude measures [1…”

“Other implicit measures In addition to Brief IATs measuring the three topics of interest, participants were randomly assigned to complete one or more of seven other implicit measures about the same topics – the IAT, Go/No-go Association Task (GNAT) [27], single-target (ST-IAT) [28], Sorting Paired Features [29], Evalu…”

“Other implicit measures In addition to Brief IATs measuring the three topics of interest, participants were randomly assigned to complete one or more of seven other implicit measures about the same topics – the IAT, Go/No-go Association Task (GNAT) [27], single-target (ST-IAT) [28], Sorting Paired Features [29], Evalu…”

“Both elicit strong effects favoring whites to blacks and self to others respectively [15–17].”

“Likewise, Black and White people have different implicit racial attitudes – each more inclined to show positivity toward their own racial group, though Whites more so – providing another group difference criterion [16].”

“Also, the order of measurement blocks is a well-known influence on response latency measures like the IAT [2, 24].”

“Other implicit measures In addition to Brief IATs measuring the three topics of interest, participants were randomly assigned to complete one or more of seven other implicit measures about the same topics – the IAT, Go/No-go Association Task (GNAT) [27], single-target (ST-IAT) [28], Sorting Paired Features [29], Evalu…”

“In particular, the self-esteem BIAT showed weak relations with other implicit measures and with the criterion variables for both good and bad-focal blocks [14;37].”

“Nevertheless, it is well established that these constructs are related [20].”

“Dual-process and dual-system perspectives in attitudes research presume that implicit and explicit attitudes are distinct constructs – the former measured indirectly with procedures like the BIAT, the latter measured directly with selfreport procedures (see [5-6] for a review).”

“Self-reported attitudes and individual difference measures Each participant received a random selection of self-report measures including (a) 7-point relative preference for Democrats compared to Republicans, White people compared to Black people, and Self compared to Other; (b) 11-point warmth ratings for each of tho…”

“Sriram and Greenwald [8] observed that the Brief IAT showed stronger construct validity for response blocks when good was focal compared to when bad was focal.”

“Salience asymmetries are a potential influence on IAT effects [39–41], and could likewise influence BIAT effects.”

“Separate evidence is required to justify the interpretation of the measures as assessments of distinct constructs (for more in-depth treatment of this topic see ([21], [22]).”

“Unkelbach and colleagues [38] proposed that positive information is more similar to other positive information and is more strongly associated with other positive information, in comparison to the similarity and association that negative information share with other negative information [38].”

“With the IAT, D reduces the impact of extraneous influences like average response latency [25–26], and increases sensitivity to detecting relations with known covariates [7].”

“Other implicit measures In addition to Brief IATs measuring the three topics of interest, participants were randomly assigned to complete one or more of seven other implicit measures about the same topics – the IAT, Go/No-go Association Task (GNAT) [27], single-target (ST-IAT) [28], Sorting Paired Features [29], Evalu…”

“Other implicit measures In addition to Brief IATs measuring the three topics of interest, participants were randomly assigned to complete one or more of seven other implicit measures about the same topics – the IAT, Go/No-go Association Task (GNAT) [27], single-target (ST-IAT) [28], Sorting Paired Features [29], Evalu…”

“The third topic – political attitudes – is polarized with liberals or Democrats preferring Democrats and conservatives or Republicans preferring Republicans, even implicitly [18–19].”

“Dual-process and dual-system perspectives in attitudes research presume that implicit and explicit attitudes are distinct constructs – the former measured indirectly with procedures like the BIAT, the latter measured directly with selfreport procedures (see [5-6] for a review).”

“The third topic – political attitudes – is polarized with liberals or Democrats preferring Democrats and conservatives or Republicans preferring Republicans, even implicitly [18–19].”

“In addition, there is potential for further developments in improving research efficiency with optimal algorithms through the creation and refinement of new scoring methods and simulations [23;43].”

“For Study 3, about half the participants were randomly assigned to complete the race Multi-Category Implicit Association Test (MC-IAT; Nosek et al., 2014).”

“Scoring procedures adhered to the recommendations by Greenwald and colleagues (Greenwald et al., 2003; Nosek et al., 2012).”

“), which is computed as the difference between mean latencies of the two BIAT blocks divided by the standard deviation of latencies in the two blocks (Nosek et al., 2013).”

“This makes the BIAT particularly useful to sociologists, for whom study length and respondent fatigue are often concerns (Nosek et al. 2014).”

“However, we also employed a widely used technique to assess implicit belief: the single-category implicit association test (Jong et al., 2012; Karpinski & Steinman, 2006; Nosek et al., 2014).”

“While IAT is the object of considerable controversy among organizational psychologists 56 and social psychologists 57 , as well as in the popular press 58 , the consensus is that it outperforms other indirect measures of biases in terms of internal validity 54,59 .”

“First, the recommended IAT scores assess faster or slower sorting of target social groups with characteristic attributes (Nosek et al., 2014).”

“More detailed descriptions of the IAT are available [35].”

“A d-score (algorithm from Nosek et al., 2014) of the average reaction times for stereotypecongruent pairings versus stereotype-incongruent pairings represents participants’ gender stereotypical implicit associations, with positive numbers indicating a stereotypic Engineering = Male association.”

“D is computed as the difference between response latencies and standard deviations of two different combinations of concepts (Nosek et al., 2014).”

“A similar approach of comparing strength of known-groups differences has been used when evaluating measures of explicit racial attitudes (Axt, 2018), measures of implicit political attitudes (Bar-Anan & Nosek, 2014), or scoring algorithms for a single implicit measure (Nosek et al., 2014).”

“The best measures of each will minimize error and maximize the correlation between height and weight closest to its true relationship in that sample (see also Greenwald, Nosek, & Banaji, 2003; Nosek et al., 2012).”

“21 27–30 Therefore, it is important to briefly consider its strengths and limitations.”

“The outcome measure is computed as the standardised difference in latencies between the different combined blocks (modified D-score algorithm [49]).”

“BIAT responses were scored by the D algorithm (Nosek et al., 2014), such that more positive scores reflected a stronger association between White people and good and Black people and bad.”

“On the other hand, the sense of the correlations (negative in all cases) indicated that participants who showed rejection on implicit measures also showed it on explicit ones, and participants who showed acceptance on implicit measures also showed it on explicit ones, which could be considered as an indicator that bot…”

“The only study with an adult sample to report the internal consistency of a reduced-length race-attitude IAT (e.g., Brief-IATs; Sriram and Greenwald, 2009; Nosek et al., 2014) found the internal consistency to be 0.81 (Bar-Anan and Nosek, 2014).”

“Based on Nosek et al. (2014), we recoded latencies shorter than 400 ms (2.7% of all trials) to 400 ms and latencies greater than 2,000 ms (5.6% of all trials) to 2,000 ms, removed trials greater than 10,000 ms (0.2% of all trials) and excluded participants with more than 10% of trials under 300 ms…”

“This disadvantageous practice is common in research on the IAT (Greenwald et al., 2003).”

“Data from all critical blocks were used to compute BIAT scores, according to the scoring recommendations of Nosek and colleagues [55].”

“Online Learning Volume 19 Issue 3 (2015) 169 The BIAT scores were calculated according to the guidelines provided by Nosek et al. (2013) through two two-category contrast D scores, Caucasian versus African American and Caucasian versus Hispanic.”

“The BIAT was scored using current guidelines (Greenwald, Nosek, & Banaji, 2003; Nosek et al., 2014).”

“Likewise, racial and religious minorities report explicit preferences for their own group at levels greater than or equal to those of Whites and Christians (Axt, Ebersole, & Nosek, 2014).”

“Data analysis Following the guidelines outlined in Nosek, Bar-Anan, Sriram, Axt and Greenwald (19), participants’ weight bias were assessed by means of five D scores, representing five pairwise comparisons among the investigated weight categories: normal weight–obese, normal weight– overweight, normal weight–underweig…”

“According to recent recommendations for reaction time measures of implicit associations [46], we excluded children who had more than 10% of trials below 300ms (nstereotypeIAT = 0; nself-conceptIAT = 2) and children who had made errors on more than 30% of trials (nstereotypeIAT = 18; nself-conceptIAT = 25) on analyses…”

“explicit dimensions evaluated suggests that they are different constructs (Nosek et al., 2014; Nosek & Smyth, 2007).”

“A d-score (algorithm from Nosek et al., 2014) of the average reaction times for stereotypecongruent pairings versus stereotype-incongruent pairings represents participants’ gender stereotypical implicit associations, with positive numbers indicating a stereotypic Engineering = Male association.”

“Scores for the Target/Perpetrator B-IAT and Good/ Bad B-IAT were computed according to the recommended B-IAT algorithm described by Nosek et al. (2014).”

“Enhancing the measurement of implicit bias should yield stronger relations with related variables by minimizing random error and maximizing the ability to detect the true relationship between constructs (Axt, 2018; Nosek et al., 2014).”

“So as a second measure, we implement Brief Implicit Association Tests (BIAT), a barometer of learned racial associations that are instinctively expressed and not subject to cognitive control (Nosek et al., 2014).”

“Despite these modifications, the BIAT retains the favorable psychometric Frontiers in Psychology | www.frontiersin.org 5 June 2020 | Volume 11 | Article 1542 properties of the original IAT (Sriram and Greenwald, 2009; Bar-Anan and Nosek, 2014; Nosek et al., 2014).”

“In addition, it is important to note that we use the procedure “built-in penalty” in error latencies by computing the accumulated time of the wrong-plus-corrected response [54,68,69].”

“RTs, widely regarded as reliable indicators of cognitive processing, provide a robust measure of the mental effort required to resolve conflicts between automatic associations and task demands (Greenwald et al., 1998; Nosek et al., 2014).”

“This assumption that measurement error will only weaken the overall effect size is common in prior research on the IAT’s validity (see Bar-Anan & Nosek, 2014 and Nosek et al., 2005, for parallel reasoning).”

“Validation studies demonstrate how this version of the IAT has satisfactory validity, especially when the self is a focal category [32], as in the case of the items of an aIAT.”

“…participants with (a) extremely long latencies (> 10,000ms), which indicate possible distraction; (b) extremely short latencies (< 300ms for greater than 10% of trials); or (c) high error rates (> 30%), which indicate possible inattention (Greenwald, Nosek, and Banaji 2003; Nosek et al. 2014).”

“In this study, the D measure was applied [68], which was used for both the improved IAT and the subsequent Brief-IAT [69,70].”

“Of these, three adhered to Nosek’s guidelines for data processing, 80 which involved deleting responses from incorrect, incongruent trials, or no-go trials.”

“Unconscious associations are measured using a D score that has a theoretical range of 2 to + 2.(35) Respondents with a D-score equal to 0 ( – 0.”

“The preferences of the individual are inferred from the speed of responding to stimuli in a categorization task (Bar-Anan & Nosek, 2014; Blair et al., 2015; De Houwer et al., 2009; Greenwald, Nosek, & Banaji, 2003; Nosek, Greenwald, & Banaji, 2007).”

“, below 300 milliseconds [ms]; [41]) or not within the maximum time they were given to respond (i.”

“At the individual level, we computed two D scores per participant (Nosek et al. 2014).”

“In line with recommendations (Nosek et al., 2014), the D algorithm for BIAT was used to calculate implicit preference scores, which included the removal of trials >10,000 ms in length in addition to the removal of assessments where more than 10% of trials were completed in less than 300 ms (N = 55…”

“First, it has good psychometric properties together with a high versatility to measure stereotypes of all kinds (Nosek et al., 2014), including those revolving around warmth and competence (e.g., Imhoff et al., 2013).”

“…validity and reliability parameters for shorter batteries of cognitive measurement were raised (Sriram and Greenwald 2009; Benedict et al. 2012; Nosek et al. 2014), since even small changes in a test may be responsible for different effects when brief protocols are compared to the original…”

“For alcohol as an attitude object, Palfai and Ostafin (2003) were able to demonstrate a link between IAT approach/avoid scores and whether or not subjects indulged in binge drinking (i.”

“Scores for the Target/Perpetrator B-IAT and Good/Bad B-IAT were computed according to the recommended B-IAT algorithm described by Nosek et al. (2014).”

“Responses were analyzed using the D scoring algorithm (Nosek et al., 2014), with a higher score indicating more positive implicit associations toward more, versus less, physically attractive people (see online supplemental material for instructions).”

“Der BIAT (Sriram und Greenwald 2009; Nosek et al. 2014) stellt eine komprimierte Version des klassischen Implicit Association Tests (Greenwald et al. 1998; Fazio et al. 1995) dar.”

“…previous research on the scoring of indirect evaluation measures (Glashouwer et al., 2013; Greenwald et al., 2003; Koppehele-Gossel et al., 2020; Nosek et al., 2014; Richetin et al., 2015), the present research used the most diverse set of attitude objects, procedural task parameters,…”

“This variable measures a physician's bias toward patients from various racial groups [50-52].”

“The 300 ms cutoff represents the lower bound at which humans can comprehend stimuli and therefore has been commonly deemed best practice in response latency research (Fazio 1990; Greenwald, Nosek, and Banaji 2003; Nosek et al. 2014).”