New evidence on self-affirmation effects and theorized sources of heterogeneity from large-scale replications.
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Brief, targeted self-affirmation writing exercises have recently been offered as a way to reduce racial achievement gaps, but evidence about their effects in educational settings is mixed, leaving ambiguity about the likely benefits of these strategies if implemented broadly. A key limitation in interpreting these mixed results is that they come from studies conducted by different research teams with different procedures in different settings; it is therefore impossible to isolate whether different effects are the result of theorized heterogeneity, unidentified moderators, or idiosyncratic features of the different studies. We addressed this limitation by conducting a well-powered replication of self-affirmation in a setting where a previous large-scale field experiment demonstrated significant positive impacts, using the same procedures. We found no evidence of effects in this replication study and estimates were precise enough to reject benefits larger than an effect size of 0.10. These null effects were significantly different from persistent benefits in the prior study in the same setting, and extensive testing revealed that currently theorized moderators of self-affirmation effects could not explain the difference. These results highlight the potential fragility of self-affirmation in educational settings when implemented widely and the need for new theory, measures, and evidence about the necessary conditions for self-affirmation success.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Stereotype threat and the intellectual test performance of African Americans.
Steele, C. M., & Aronson, J. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.69.5.797 · Cited by 9,020
The Psychology of Self-Affirmation: Sustaining the Integrity of the Self
Steele, C. M. (1988) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60229-4 · Cited by 3,697 · cited 2×
“Threats to academic identity experienced by minority members in school can be muted by focusing attention on other specific aspects of identity (Critcher & Dunning, 2015; Sherman & Cohen, 2006; Steele, 1988; Walton, Paunesku, & Dweck, 2012).”
Contending with group image: The psychology of stereotype and social identity threat
Steele, C. M., Spencer, S. J., & Aronson, J. (2002) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(02)80009-0 · Cited by 2,201 · cited 1×
“This study is informed by theories of social identity threats, which create particular challenges for members of marginalized social groups in school (Steele et al., 2002).”
Social-Psychological Interventions in Education: They’re Not Magic
Yeager, D. S., & Walton, G. M. (2011) · Review of Educational Research · doi:10.3102/0034654311405999 · Cited by 1,345 · cited 7×
“Social–psychological interventions are also theoretically sensitive to features of the social environment in which they are implemented (Yeager & Walton, 2011).”
InfluentialBeyond Power Calculations: Assessing Type S (Sign) and Type M (Magnitude) Errors
Gelman, A., & Carlin, J. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614551642 · Cited by 1,343
The Psychology of Change: Self-Affirmation and Social Psychological Intervention
Cohen, G. L., & Sherman, D. K. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115137 · Cited by 1,302 · cited 5×
“…stereotype threat and thus moderate the effects of self-affirmation, including identifying with a negatively stereotyped group, being knowledgeable about self-relevant negative stereotypes, and caring about doing well in school (Aronson et al., 1999; Cohen & Sherman, 2014; Shapiro & Neuberg, 2007).”
InfluentialReducing the racial achievement gap: A social-psychological intervention
Cohen, G. L., Garcia, J., Apfel, N., & Master, A. (2006) · Science · doi:10.1126/science.1128317 · Cited by 1,073
Signaling Threat: How Situational Cues Affect Women in Math, Science, and Engineering Settings
Murphy, M. C., Steele, C. M., & Gross, J. J. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01995.x · Cited by 1,048
Mind-Set Interventions Are a Scalable Treatment for Academic Underachievement
Paunesku, D., Walton, G. M., Romero, C., Smith, E. N., Yeager, D. S., & Dweck, C. S. (2015) · Psychological Science · doi:10.1177/0956797615571017 · Cited by 981
Inzlicht, M., & Ben-Zeev, T. (2000) · Psychological Science · doi:10.1111/1467-9280.00272 · Cited by 835
Recursive Processes in Self-Affirmation: Intervening to Close the Minority Achievement Gap
Cohen, G. L., Garcia, J., Purdie-Vaughns, V., Apfel, N., & Brzustoski, P. (2009) · Science · doi:10.1126/science.1170769 · Cited by 800 · cited 11×
“The original self-affirmation study in a middle school setting was first reported by Cohen et al. (2006), with supplemental analyses elsewhere (Cohen et al., 2009; Cook et al., 2012; Shnabel et al., 2013).”
InfluentialReducing the Gender Achievement Gap in College Science: A Classroom Study of Values Affirmation
Miyake, A., Kost-Smith, L. E., Finkelstein, N. D., Pollock, S. J., Cohen, G. L., & Ito, T. A. (2010) · Science · doi:10.1126/science.1195996 · Cited by 746 · cited 3×
“For instance, although self-affirmation reduced gender disparities in performance in an introductory college physics course (Miyake et al., 2010), it was not beneficial in introductory science settings in which gender gaps and stereotype threat were not present (Lauer et al., 2013).”
The new science of wise psychological interventions
Walton, G. M. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721413512856 · Cited by 655 · cited 3×
“Reflection on important values provides a psychological buffer against the full brunt of detrimental stereotype threats in school, and because of the potentially recursive nature of threat and poor performance, subtle buffering early on may lead to substantial benefits over time (Cohen & Garcia, 2008; Cohen et al., 20…”
When beliefs yield to evidence: Reducing biased evaluation by affirming the self
Cohen, G. L., Aronson, J., & Steele, C. M. (2000) · Personality and Social Psychology Bulletin · doi:10.1177/01461672002611011 · Cited by 584
Experimental manipulations of self-affirmation: A systematic review
MCQueen, A., & Klein, W. M. P. (2006) · Self and Identity · doi:10.1080/15298860600805325 · Cited by 563 · cited 1×
“…values, has the potential to undermine students’ confidence if they write about activities in which they have low ability whereas other control writing prompts, which are more neutral or open-ended, might allow control participants to spontaneously affirm themselves (McQueen & Klein, 2006).”
Why Science Is Not Necessarily Self-Correcting
Ioannidis, J. P. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612464056 · Cited by 563 · cited 1×
“Theorized heterogeneity also complicates the fundamental enterprise of independent replication, which is increasingly recognized as necessary to build firm scientific understanding in psychology as in other fields (Ioannidis, 2005, 2012; Pashler & Harris, 2012).”
Shapiro, J. R., & Neuberg, S. L. (2007) · Personality and Social Psychology Review · doi:10.1177/1088868306294790 · Cited by 398
Sherman, D. K., Hartson, K. A., Binning, K. R., Purdie-Vaughns, V., Garcia, J., Taborsky-Barba, S., Tomassetti, S., Nussbaum, A. D., & Cohen, G. L. (2013) · Journal of Personality and Social Psychology · doi:10.1037/a0031495 · Cited by 371 · cited 12×
“Previous self-affirmation interventions highlight this point: Sherman et al. (2013) reported creating simplified versions in a setting with many English Language learners, and even in the original setting, the experimental protocols (including the number of exercises, and instructions for choosing…”
InfluentialClosing the social class achievement gap for first-generation students in undergraduate biology.
Harackiewicz, J. M., Canning, E. A., Tibbetts, Y., Giffen, C. J., Blair, S. S., Rouse, D. I., & Hyde, J. S. (2014) · Journal of Educational Psychology · doi:10.1037/a0034679 · Cited by 360 · cited 2×
“…theoretically threatened groups, such as African American and Hispanic middle-school students (Cohen, Garcia, Purdie-Vaughns, Apfel, & Brzustoski, 2009; Sherman et al., 2013), women in a college physics course (Miyake et al., 2010), and first-generation college students (Harackiewicz et al., 2014).”
Identity, Belonging, and Achievement: A Model, Interventions, Implications
Cohen, G. L., & Garcia, J. (2008) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2008.00607.x · Cited by 325 · cited 2×
“…against the full brunt of detrimental stereotype threats in school, and because of the potentially recursive nature of threat and poor performance, subtle buffering early on may lead to substantial benefits over time (Cohen & Garcia, 2008; Cohen et al., 2009; Taylor & Walton, 2011; Walton, 2014).”
Cook, J. E., Purdie-Vaughns, V., Garcia, J., & Cohen, G. L. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0026312 · Cited by 244 · cited 7×
“Based on the evidence that self-affirmation exercises are most effective earliest in the school year (Cook et al., 2012), we provided school officials with the option of omitting the winter exercise to reduce logistical challenges; four schools did so for Cohort 1 and two did so for Cohort 2.”
InfluentialAffirmed yet unaware: Exploring the role of awareness in the process of self-affirmation.
Sherman, D. K., Cohen, G. L., Nelson, L. D., Nussbaum, A. D., Bunyan, D. P., & Garcia, J. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0015451 · Cited by 223 · cited 6×
“Following their initial presentation (e.g., Cohen, Garcia, Apfel, & Master, 2006; Cohen et al., 2009; Sherman et al., 2009), we refer to these activities as selfaffirmation interventions throughout this article, reflecting the goal to allow students to “reaffirm their self-integrity” (Cohen et al.”
InfluentialThe Long-Term Effects and Cost-Effectiveness of Success for All
Borman, G. D., & Hewes, G. M. (2002) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737024004243 · Cited by 182
Self-citationWhen Self-Affirmations Reduce Defensiveness: Timing Is Key
Critcher, C. R., Dunning, D., & Armor, D. A. (2010) · Personality and Social Psychology Bulletin · doi:10.1177/0146167210369557 · Cited by 118 · cited 2×
“…design: that activities are administered during targeted times of potential stress, especially early in the school year (Cook et al., 2012; Critcher et al., 2010), that activities are not explicitly presented as externally imposed (Silverman et al., 2013), and that activities are not…”
Social identity and achievement gaps: Evidence from an affirmation intervention
Dee, T. S. (2015) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2014.906009 · Cited by 98 · cited 7×
“Like the recent replication by Dee (2015), our results suggest that self-affirmation has at best modest benefits for minority students when implemented at a large scale.”
InfluentialEnhancing a brief writing intervention to combat stereotype threat among middle-school students.
Bowen, N. K., Wegmann, K. M., & Webber, K. C. (2013) · Journal of Educational Psychology · doi:10.1037/a0031177 · Cited by 60
Self-affirmation as a deliberate coping strategy: The moderating role of choice
Silverman, A., Logel, C., & Cohen, G. L. (2013) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2012.08.005 · Cited by 45 · cited 3×
“These guidelines were based on theory and empirical evidence (Cohen & Sherman, 2014; Silverman et al., 2013), with the caveat that there is little existing guidance about how these features translate into best practice for teachers in established educational settings.”
Cited by
Persistence and Fadeout in the Impacts of Child and Adolescent Interventions
Bailey, D., Duncan, G. J., Odgers, C. L., & Yu, W. (2017) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2016.1232459 · Cited by 551
Improving Student Outcomes in Higher Education: The Science of Targeted Intervention
Harackiewicz, J. M., & Priniski, S. J. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011725 · Cited by 429
Scaling up behavioral science interventions in online education
Kizilcec, R. F., Reich, J., Yeomans, M., Dann, C., Brunskill, E., Lopez, G., Turkay, S., Williams, J. J., & Tingley, D. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1921417117 · Cited by 208
Beliefs in conspiracy theories following ostracism
Poon, K.-T., Chen, Z., & Wong, W.-Y. (2020) · Personality and Social Psychology Bulletin · doi:10.1177/0146167219898944 · Cited by 115
Tackling Educational Inequalities with Social Psychology: Identities, Contexts, and Interventions
Easterbrook, M. J., & Hadden, I. R. (2021) · Social Issues and Policy Review · doi:10.1111/sipr.12070 · Cited by 110
Metadata
- Authors
- Hanselman, P., Rozek, C. S., Grigg, J., & Borman, G. D.
- Venue
- Journal of Educational Psychology
- Published
- 2017-04
- Volume
- 109
- Issue
- 3
- Pages
- 405-424
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2513670557
- Cited by
- 81
- References
- 27
- FWCI
- 15.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.