The DOI matches its Crossref record; 105 of the 105 references it cites were found in a registry or an index; 10 of the 81 sources its claims cite were checked for support.
Do growth mindset interventions impact students’ academic achievement? A systematic review and meta-analysis with recommendations for best practices.
Open accessPublished version of a preprint
Abstract
According to mindset theory, students who believe their personal characteristics can change—that is, those who hold a growth mindset—will achieve more than students who believe their characteristics are fixed. Proponents of the theory have developed interventions to influence students’ mindsets, claiming that these interventions lead to large gains in academic achievement. Despite their popularity, the evidence for growth mindset intervention benefits has not been systematically evaluated considering both the quantity and quality of the evidence. Here, we provide such a review by (a) evaluating empirical studies’ adherence to a set of best practices essential for drawing causal conclusions and (b) conducting three meta-analyses. When examining all studies (63 studies, N = 97,672), we found major shortcomings in study design, analysis, and reporting, and suggestions of researcher and publication bias: Authors with a financial incentive to report positive findings published significantly larger effects than authors without this incentive. Across all studies, we observed a small overall effect: d ̅ = 0.05, 95% CI = [0.02, 0.09], which was non-significant after correcting for potential publication bias. No theoretically-meaningful moderators were significant. When examining only studies demonstrating the intervention influenced students’ mindsets as intended (13 studies, N = 18,355), the effect was non-significant: d ̅ = 0.04, 95% CI = [-0.01, 0.10]. When examining the highest-quality evidence (6 studies, N = 13,571), the effect was non-significant: d ̅ = 0.02, 95% CI = [-0.06, 0.10]. We conclude that apparent effects of growth mindset interventions on academic achievement are likely attributable to inadequate study design, reporting flaws, and bias.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This systematic review and meta-analysis finds that growth mindset interventions show only a small overall effect on academic achievement, and that effect becomes non-significant after correcting for publication bias. When analyses are restricted to studies that changed students’ mindsets as intended or to the highest-quality evidence, effects are non-significant.
Key findings
- Across all studies (63 studies, N = 97,672), the overall effect was small and significant: *d* = 0.05, 95% CI [0.02, 0.09], *p* = .004; after publication-bias correction, estimates were non-significant (*d* = 0.03 trim-and-fill; *d* = 0.01 PET).
- Among studies showing the intervention changed students’ mindsets as intended (13 studies, N = 18,355), the effect was non-significant: *d* = 0.04, 95% CI [−0.01, 0.10], *p* = .146.
- Among the highest-quality evidence (6 studies, N = 13,571), the effect was non-significant: *d* = 0.02, 95% CI [−0.06, 0.10], *p* = .666.
- Authors with a financial incentive to report positive findings published significantly larger effects than authors without this incentive; for financially incentivized authors, published effects averaged *d* = 0.18 versus unpublished *d* = 0.02, while for non-incentivized authors published effects averaged *d* = −0.10 versus unpublished *d* = 0.05.
Methods
- Systematic review and three random-effects meta-analyses of treatment-vs.-control growth mindset intervention studies measuring academic achievement (grades or standardized test scores), updating Sisk et al. (2018) through August 7, 2019.
- Meta-Analysis 1 included all eligible studies regardless of quality; Meta-Analysis 2 included only studies with evidence that the intervention significantly shifted treatment students’ mindsets toward growth mindset; Meta-Analysis 3 included studies with such mindset evidence and at least 60% of 10 best-practices criteria.
- Effect sizes were Cohen’s *d*, adjusted where possible for baseline achievement, dependent effects, and cluster design effects; analyses included moderator tests and publication-bias assessments (funnel plot, Egger’s regression, trim-and-fill, PET-PEESE).
Limitations
- Stated by the authors: search timeframe and inaccessible unpublished studies; English-language restriction; preregistered scope decisions; reliance on the assumption that mindset measures are valid and reliable; heterogeneity across models; and the generally low quality of included studies, which required lowering standards for Meta-Analysis 3.
- Evident in the text: no studies met all best-practices criteria; Meta-Analysis 3 still included studies that failed multiple best practices and may still overestimate effects; some alternate best-practices models were not preregistered but suggested by a reviewer; and the authors could not publish analysis code because they used Comprehensive Meta-Analysis software.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
97 Own interpretation · 87 Own result · 25 Sources not found · 21 No full text of the sources · 18 No basis given · 16 Own method · 7 Not checked yet · 4 Supported · 4 Partly supported · 2 Not supported · accuracy not yet measured
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Finally, blinding teachers to students' conditions reduces the chance that teachers' beliefs about condition effectiveness and knowledge of student assignment will influence their behavior toward the student or their evaluation of student performance (e.g., Ainsworth et al., 2015;Rosenthal & Jacobson, 1968).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Blinding
What the sources say
- Partly supportedcites Ainsworth et al., 2015 sourceExperimental — accuracy not yet measured
The Background to Every Child Counts evaluation (page not provided) says that teachers’ knowledge of assignment and beliefs about the programme could lead them to award higher marks, supporting the claim about evaluation of performance. The paper addresses bias in outcome assessment, not whether blinding changes teachers’ behavior toward students; it also notes that blinding teachers to allocation is extremely difficult. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites Rosenthal & Jacobson, 1968 source
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, given the weak links between mindset and motivational processes (e.g., Burgoyne et al., 2020;Burnette et al., 2013;Payne et a., 2007) and between these motivational processes and achievement (e.g., Burnette et al., 2013), one cannot infer the effect of mindset on academic achievement based on mindset's relationship to a motivational process.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Measuring Direct Outcomes Rather Than Indirect Outcomes
What the sources say
- Not checked — no full text of the sourcecites Burgoyne et al., 2020 source
- Partly supportedcites Burnette et al., 2013 sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Not checked — no full text of the sourcecites Payne et a., 2007 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Recent research (Burgoyne et al., 2018;Limeri et al., 2020) has questioned this assumption.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
What the sources say
- Not checked — no full text of the sourcecites Burgoyne et al., 2018 source
- Partly supportedcites Limeri et al., 2020 sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) questions the validity of the mindset scale for undergraduates, and the Discussion (page unavailable) suggests that differing interpretations of its items may introduce measurement error. The paper does not specifically assess measures collected before and after an intervention or establish that those measures are unreliable; it notes that some studies have reported test–retest reliability. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When examining the highest-quality evidence (6 studies, N = 13,571), the effect was non-significant: 𝑑 ̅ = 0.02, 95% CI = [-0.06,0.10].”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Abstract
plainn = 13,571- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Authors with a financial incentive to report positive findings published significantly larger effects than authors without this incentive.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Abstract
plaincorrelationaln = 97,672- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“which was non-significant after correcting for potential publication bias.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Abstract
plainn = 97,672- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When examining only studies demonstrating the intervention influenced students' mindsets as intended (13 studies, N = 18,355), the effect was non-significant: 𝑑 ̅ = 0.04, 95% CI = [-0.01,0.10].”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Abstract
plainn = 18,355- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The second meta-analysis model assumes that measures of mindset are valid and reliable, and that other factors are not the key mechanisms driving effects.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“No theoretically-meaningful moderators were significant.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Abstract
plainn = 97,672- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This process resulted in six studies meeting at least 60% of the best practices criteria.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Present Study
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When examining all studies (63 studies, N = 97,672), we found major shortcomings in study design, analysis, and reporting”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Abstract
plainn = 97,672- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Across all studies, we observed a small overall effect: 𝑑 ̅ = 0.05, 95% CI = [0.02,0.09]”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Abstract
plaindirectn = 97,672- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“No studies met all best practices criteria.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Present Study
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and suggestions of researcher and publication bias”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Abstract
hedgedn = 97,672- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“No studies included in our systematic review and meta-analyses artificially dichotomized continuous measures.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Using Continuous Variables Over Artificially Dichotomized Variables
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“They were not significantly different from one another, Q(1) = 0.96, p = .328.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Yeager et al. (2018); Yeager et al. (2019)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The Publication Status × Financial Incentive Status interaction is significant, F(1, 75) = 6.35, p = .014.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Yeager et al. (2018); Yeager et al. (2019)
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“About 10% of the null effects in this literature were described by the study authors as though they were significant.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Significant Effect Interpretation Issues
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In our search, the majority of published studies for which we found an unpublished version excluded participants from the published study.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Yeager et al. (2018); Yeager et al. (2019)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Relatedly, Yeager et al.'s (2014) Study 3 manipulation check failed: they found no measurable evidence for the impact of the growth mindset intervention on students' mindsets.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Significant Effect Interpretation Issues
What the sources say
- Not matchedcites Yeager et al.'s (2014)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Adherence to best practices varied considerably, with the majority (70%) of the independent samples meeting 50% or fewer best practices criteria (see Figure 4).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices Criteria
plainn = 79- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: Studies without the best-practice characteristics increase the risk to internal validity in individual study results.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The between-study variability in effect sizes due to heterogeneity rather than random error was moderate, I 2 = 39.14 (τ 2 = .005).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Standardized Difference in Means and 95% CI Study Name
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found no compelling evidence that mindset skeptics conducted any of the growth mindset interventions included in the current meta-analysis.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Financial Incentives
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In five of the seven cases, participants' data included in the unpublished version were excluded from the published version.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Figure 2
plainn = 5- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Across all studies regardless of quality, the overall meta-analytic average standardized mean difference in academic achievement between students receiving a growth mindset intervention and students in a control group was 𝑑 ̅ = 0.05, 95% CI = [0.02,0.09], p = .004.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Overall Results.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Less than one third of the documents (19 of 61) reported a statistically significant difference between treatment and control groups on academic achievement in the hypothesized direction.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Type I Error
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of the articles that reported a significant effect, about half attributed the effect to the intervention influencing students' mindsets without evidence the intervention had any effect on students' mindsets.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Significant Effect Interpretation Issues
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Articles with one or more authors with a financial incentive to report positive effects (30% of documents) were more than two and a half times as likely (56% vs. 21%) to find a significant difference between treatment and control groups on academic achievement in the hypothesized direction than articles where no authors had a financial incentive, χ 2 (1, N = 61) = 7.09, p = .008.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Financial Incentives
plaincorrelationaln = 61- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All authors either appeared neutral or expectant of positive effects.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Financial Incentives
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When examining these cases (13 studies, N = 18,355), the effect of growth mindset interventions on academic achievement was non-significant: 𝑑 ̅ = 0.04, 95% CI = [-0.01,0.10], p = .146.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
plainn = 18,355- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only 26% of the effect sizes came from studies that met this minimal standard of evidence.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
plainn = 18,355- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our moderator analysis testing whether the treatment effect varied by the length of time between the intervention and the measure of academic achievement was non-significant.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This meta-analysis had substantial heterogeneity, I 2 = 62.71% (τ 2 = .006).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The majority of them (five of seven) excluded participants prior to publication.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found that 58% of the samples-37% of the total studentsincluded in the meta-analysis reported equivalent academic achievement between the treatment and control groups at baseline.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conducting Theory-driven Analyses to Test Hypotheses.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For studies in which the intervention altered students' mindsets as intended, the overall meta-analytic average standardized mean difference between growth mindset treatment and control groups in academic achievement was non-significant, 𝑑 ̅ = 0.04, 95% CI = [-0.01,0.10], p = .146.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Overall Results.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After correcting for publication bias, there were no significant models that adhered to any number of any combination of best practices criteria.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We observed heterogeneity-differences in effects across studies-in each of our metaanalyses.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“significant effects were most likely to be reported by authors who had financial incentives to report significant effects”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This was the case for about 10% of the null effects in our meta-analysis.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found that, relative to authors with no perceived financial conflict of interest, studies with one or more authors with a financial incentive to report positive effects were more than two and half times as likely to report significant effects.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As the number of best practices met increased, the number of significant models decreased.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Many studies conducted in countries where the dominant language is not English nevertheless write the study report in English in an effort to publish in Englishlanguage journals (11% of the studies in the current meta-analysis).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The number of participants removed was as high as 6,222 students, half the total sample.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“For this meta-analysis, Egger's regression suggests multiple studies may have been conducted but are missing from the available literature and are not included in the present meta-analysis (recommended 1-tailed p = .034;Borenstein et al., 2005; 2-tailed p = .067),see Table 8.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Financial Incentives.
What the sources say
- Not matchedcites Borenstein et al., 2005
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Yet, authors with financial incentives were no more likely to find evidence that their growth mindset interventions changed students' mindsets than authors without”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Financial Incentives.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Despite mindset's popularity, no systematic review evaluating the quality and quantity of growth mindset interventions has previously been conducted.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found that the average effect size of studies where an author had a financial incentive to find positive results was not significantly different from the average effect size of studies where no authors had perceived financial conflicts of interest, see Table 8.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Financial Incentives.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Further, after correcting for publication bias, no meta-analytic models were significant.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found that even when considering the best evidence available (Meta-Analysis 3), we had to considerably lower quality standards to have enough studies to metaanalyze.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Approximately 1% of the total searched records were relevant to the present meta-analysis.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“First, almost all growth mindset interventions allow multiple factors to covary with experimental condition.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When no quality control was imposed, the metaanalytic model was significant.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When examining these cases (10 effects from 6 studies, N = 13,571), the effect of growth mindset interventions on academic achievement was non-significant: 𝑑 ̅ = 0.02, 95% CI = [-0.06,0.10], p = .666.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
plainn = 13,571- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our moderator analysis testing whether the treatment effect varied by level of challenge was non-significant.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only 25 of the 96 effect sizes were from studies that provided evidence that the growth mindset intervention influenced treatment students to have more of a growth mindset.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Method
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We know of no evidence to support this claim.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When examining the best available evidence, the effect of growth mindset interventions on academic achievement was non-significant: 𝑑 ̅ = 0.02, 95% CI = [-0.06,0.10], p = .666.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Authors with financial incentives to report positive effects appeared less likely to publish weaker effects than authors without such a financial incentive (significant Publication status × Financial incentive status interaction).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“No authors with a financial incentive 𝑑 ̅ = -0.37 95% CI [-0.63, -0.10] p = .007”
- Also stated in: § Additional information · hedged
“For published studies where no authors had a financial incentive to find positive results, the effect was significant, but negative, suggesting growth mindset interventions that changed students' mindsets harmed students' academic achievement, see Table 14.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Additional information · hedged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Similar to the results of the trim-and-fill, the PET estimate of the true effect after correcting for publication bias and other small-study effects was non-significant, 𝑑 ̅ = 0.01, see Table 8.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > PET-PEESE.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Low 𝑑 ̅ = 0.15 95% CI [0.002, 0.30] p = .047”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Standardized Difference in Means and 95% CI Study Name
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only 10% of the effects came from studies that both provided evidence the intervention changed students' mindsets and met more than half the best practices criteria.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
plainn = 13,571- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We observed that methodological, analytical, reporting, and conflict of interest standards are relatively lax in the mindset literature; this flexibility in standards might be the source of most significant growth mindset intervention effects that are reported.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Critically, when correcting for publication bias, the effect was non-significant, 𝑑 ̅ = 0.03, 95% CI [-0.01, 0.07], p = .097,or 𝑑 ̅”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
plainn = 97,672- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Critically, 71 of the 96 effect sizes included in Meta-Analysis 1 were from interventions with no measurable impact on students' mindsets.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Publication Bias Analysis Summary.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“No model, regardless of this requirement, revealed a significant growth mindset intervention effect after correcting for likely publication bias.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The PET analysis revealed a statistically significant slope, b = .42,95% CI [.07, .76],SE = .18,p = .019,indicating the presence of publication bias.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > PET-PEESE.
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If the estimated 10 studies missing from our meta-analysis were available and included, Duval and Tweedie's analysis estimated the overall effect would be non-significant, see Table 8.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Financial Incentives.
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“High challenge level (e.g., low grades) 𝑑 ̅ = 0.07 95% CI [0.01, 0.13] p = .019”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Standardized Difference in Means and 95% CI Study Name
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Instead, significant meta-analytic results only occurred when quality control was lacking, and these results were no longer significant after adjusting for publication bias.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Academic Challenge Status a Q(2) = 0.28, p = .870”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Standardized Difference in Means and 95% CI Study Name
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“No publication bias analyses suggested that this model's effect was impacted by publication bias, see Table 14.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Our meta-analysis included one very small sample (Fleurizard & Young, 2018, N = 10).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
What the sources say
- Not matchedcites Fleurizard & Young, 2018
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“No studies adhered to all of the best practices criteria.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Instead, significant meta-analytic results only occurred when quality control was lacking, and these results were no longer significant after adjusting for publication bias.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“estimated that 10 studies with smaller-than-average effect sizes were missing from the available literature.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Financial Incentives.
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The average growth mindset treatment effect size of studies where one or more authors had a financial incentive to find positive results was not significantly different than the average growth mindset treatment effect size where no authors had a perceived financial conflict of interest, see Table 14.”
- Also stated in: § Additional information · plain
“financial incentives, χ 2 (1, N = 61) = 0.13, p = .911.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
plainn = 61- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Additional information · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“No publication bias analyses suggested that this model's effect was impacted by publication bias.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Fewer than one in four interventions attempted to reduce expectancy bias by keeping students, study administrators, and teachers blind to condition.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As the number of best practices met increased, the number of significant models quickly decreased, such that no models where studies adhered to any combination of three or more best practices were significant, see Table 15.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Discussion
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“some highly-cited studies interpreted non-significant effects as though they were significant (e.g., Aronson et al., 2002;Good et al., 2003)”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
What the sources say
- Not matchedcites Aronson et al., 2002
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites Good et al., 2003 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, when imposing quality control by examining interventions that changed students' mindsets as intended or examining the highest-quality evidence, significant effects were conspicuously absent.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There were no studies that met all the best practices criteria.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Meta-Analysis 3: Best Available Evidence
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“there were not enough published studies by authors with financial incentives in this meta-analysis to conduct this moderator analysis.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“our trim-and-fill analysis estimated we were missing ten studies with smaller-than-average effect sizes.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Assuming construct measures are valid and reliable, manipulation checks are critical for drawing accurate conclusions about the effect of the independent variable on the dependent variable when the independent variable can only be manipulated indirectly (Hoewe, 2017), as is the case with growth mindset interventions.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Testing Whether the Intervention Influenced Treatment Students' Mindsets
What the sources say
- Not checked — no full text of the sourcecites Hoewe, 2017 source
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: Construct measures are valid and reliable.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only when the manipulation check succeeds is there evidence that an effect may be attributed to the hypothesized mechanism.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Testing Whether the Intervention Influenced Treatment Students' Mindsets
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When these factors are combined with the growth mindset intervention, changes in effort and challenge seeking following the intervention cannot be attributed to holding more of a growth mindset-it may be from directly encouraging students to engage in these behaviors.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > 4. Does Teaching Students to Have a Growth Mindset Lead to Higher Levels of Academic Achievement?
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Overall, Sisk and colleagues (2018) found a small meta-analytic standardized mean difference between intervention and control groups' academic achievement, favoring the interventions: 𝑑 ̅ = 0.08, 95% CI [0.02, 0.14].”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Do Growth Mindset Interventions Improve Students' Academic Achievement?
What the sources say
- Not checked — no full text of the sourcecites Sisk et al. (2018) source
plaindirectn = 38- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If manipulation checks are not included or the manipulation check fails, there is insufficient evidence to attribute intervention effects to the hypothesized mechanism.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Testing Whether the Intervention Influenced Treatment Students' Mindsets
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“For example, Outes and colleagues conducted a large-scale growth mindset intervention in Peru.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
What the sources say
- Not matchedcites Outes et al. (2017)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“These results suggest that at least some of the observed differences between treatment and control groups found in the mindset intervention literature might be driven by encouraging students to work harder.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > 4. Does Teaching Students to Have a Growth Mindset Lead to Higher Levels of Academic Achievement?
What the sources say
- Not checked — no full text of the sourcecites Li & Bates (2019) source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Without a control protocol that is otherwise identical to the treatment we cannot determine whether teaching a growth mindset is necessary.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Group Should Be Introduced
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Without blinding, subject-expectancy effects might occur, especially in cases where participants are aware or intuit that their assigned condition is designed to be beneficial (the treatment condition) or is not designed to be beneficial (the control condition) (Boot et al., 2013).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Blinding
What the sources say
- Not matchedcites Boot et al., 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“However, per-protocol analyses can introduce systematic bias by removing those who do not comply.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Of the 400 schools intended to administer the intervention, 161 schools did not receive the materials or did not administer the intervention.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
What the sources say
- Not matchedcites Outes et al. (2017)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Though intent-to-treat analyses are often viewed as a solution to the bias that can come with per protocol analyses, flexibility in intent-to-treat analysis decisions can also bias results.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We conclude that apparent effects of growth mindset interventions on academic achievement are likely attributable to inadequate study design, reporting flaws, and bias.”
- Also stated in: § Abstract · hedged
“positive results are rare and possibly spurious due to inadequately designed interventions, reporting flaws, and bias.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Abstract
hedgedconditionaln = 13,571- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Abstract · hedged
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We should therefore be concerned when failure to comply with treatment increases the reported effect of treatment.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Unfortunately, blinding to condition assignment does not ensure that expectations are equated: The intervention itself can influence students' expectations about improvement.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Blinding
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Multiple differences between treatment and control protocols make it unclear whether (a) differences between groups are due to changing students' mindsets, (b) mindset training must be augmented with encouragement to work harder to be effective, or (c) differences are simply due to encouragement to work harder.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > 4. Does Teaching Students to Have a Growth Mindset Lead to Higher Levels of Academic Achievement?
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The true explanatory effect of an intervention cannot be determined when researchers have such flexibility in applying estimates and adjustments.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
plain- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Non-significant results described as significant likely causes confusion about the impact of growth mindset interventions.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Significant Effect Interpretation Issues
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This result suggests that financial incentives may be the source of this difference.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Financial Incentives
hedgedconditionaln = 61- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These studies violate the assumption of independence and underestimate sampling error, as students within a classroom or school will be more similar to each other and more different from other groups due to factors (e.g., shared teachers, shared schedule) other than the experimental condition.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Type I Error
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“An ANCOVA controlling for pre-intervention differences would indicate a benefit of the intervention for the treatment group despite no improvement from the intervention (i.e., Lord's paradox, Lord, 1967; see also Wright, 2006).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Equivalent Control Group at Baseline
What the sources say
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This null result appears to be due to different publishing patterns between researchers with a financial incentive to find positive effects versus researchers without such a financial incentive.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Yeager et al. (2018); Yeager et al. (2019)
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Statistically controlling for pre-intervention differences does not necessarily solve this problem.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Equivalent Control Group at Baseline
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, an adjustment ostensibly intended to better reflect effects had students received the treatment, yielded effect sizes 830% to 1,800% of the effect sizes for students who received the treatment.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, failing to implement the treatment substantially increased the apparent effect of the treatment.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Financial incentives to report particular outcomes may influence study design, analyses, how findings are interpreted, and which results are reported and published (Roseman et al., 2011).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
What the sources say
- Not matchedcites Roseman et al., 2011
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“However, Paunesku and colleagues combined all three intervention groups into one (the mindset intervention, the sense-of-purpose intervention, and the combined mindset and sense-of-purpose intervention) and compared this single combined intervention group to the control group for one of their two outcomes.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention of Interest is Isolated from Other Treatments
What the sources say
- Not matchedcites Paunesku et al. (2015)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Differences in grades cannot be solely attributed to the treatment manipulation: students sharing a classroom have commonalities in their educational environment other than the treatment and therefore some degree of relatedness.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Type I Error
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Mindset theory skeptics appear less likely to conduct growth mindset interventions than mindset theory proponents.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Financial Incentives
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Publication suppression leads to a skewed representation of results in the available literature.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Figure 2
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Per-protocol analyses-analyses that only included the 239 schools that administered the treatment as intended-yielded ds = 0.03 and 0.01 for two academic achievement measures (see Sisk et al., 2018).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
What the sources say
- Not checked — no full text of the sourcecites Sisk et al., 2018 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“For example, Paunesku et al. (2015) conducted a study where students were randomly assigned to a control condition, a growth mindset intervention, a senseof-purpose intervention, or a growth-mindset-and-sense-of-purpose combined intervention.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention of Interest is Isolated from Other Treatments
What the sources say
- Not matchedcites Paunesku et al. (2015)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Examining whether a growth mindset intervention predicts a predictor of academic achievement does not provide strong evidence that the intervention directly predicts that outcome.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Measuring Direct Outcomes Rather Than Indirect Outcomes
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Although researchers no doubt view their own work as objective and untainted by corporate influences, evidence from fields like medicine raise doubts about the ability to remain neutral when financial incentives are aligned with one outcome (e.g., see Bekelman et al., 2003;Garg et al., 2005;Perlis et al., 2005).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
What the sources say
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, when the manipulation check fails, it is unclear whether the latent construct of growth mindset is responsible for the causal effect of the intervention.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Significant Effect Interpretation Issues
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Some mindset researchers profit from selling self-help books that tout the benefits of growth mindsets.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If the treatment and control groups differ on the outcome variable measure at baseline, the effect of the intervention may be ambiguous.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Equivalent Control Group at Baseline
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With 21 significance tests and an alpha level of .05,we should expect that one outcome will be significant by chance even if the null hypothesis is true, because the typical alpha level (.05) permits a false positive rate of 5%.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Controlling for the Familywise Error Rate
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By designing the study to combine multiple interventions, the effects of the growth mindset intervention cannot be isolated experimentally.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention of Interest is Isolated from Other Treatments
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Skewed representation can lead to misunderstandings regarding the strength or reliability of effects.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Figure 2
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All three tests indicated that the mindset intervention literature contains significant publication bias.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Publication Bias Analysis Summary.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This result suggests that findings unsupportive of growth mindset hypotheses are suppressed from publication.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“suggesting growth mindset interventions that changed students' mindsets harmed students' academic achievement”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Publication bias appeared to be a factor in our meta-analysis as well.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
hedgedcorrelationaln = 97,672- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By examining both the quantity and quality of evidence, researchers should be able to assess whether (a) true relationships exist between mindsets and motivations and behaviors, or whether (b) apparent relationships are due to measurement problems, inadequate study design, reporting flaws, and/or bias, as appears to be the case in the growth mindset intervention literature.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“When considering the publication bias-corrected estimates, 𝑑 ̅ = 0.03 and 𝑑 ̅ = 0.01, there is a 50.8/49.2to 50.3/49.7chance that a randomly selected student from the treatment group will have a higher score on the measure of academic achievement than a randomly selected student from the control group (Magnusson, 2020).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
What the sources say
- Not matchedcites Magnusson, 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Specifically, the claim that changing students' mindsets will impact their academic achievement is undermined by the null result for interventions that measurably changed students' mindsets.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, apparent effects of growth mindset interventions may be spurious and due to inadequate study design, inappropriate interpretation of results, and bias.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, overall effect sizes we observed are slightly upwardly biased.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When multiple characteristics of the protocol differ between groups, the mechanism of any effect is undeterminable.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“The strongest association was counter to mindset theory.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
What the sources say
- Not checked — no full text of the sourcecites Burgoyne et al., 2020 source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“One such issue occurs when studies assign classes or schools to condition rather than individual students, which inflates the Type I error rate (Hox, 1998;McCoach & Adelson, 2010).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
What the sources say
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“That said, the argument that growth mindsets lead to meaningful changes in motivation and behavior is not well supported.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The evidence for this claim is limited.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We observed that methodological, analytical, reporting, and conflict of interest standards are relatively lax in the mindset literature; this flexibility in standards might be the source of most significant growth mindset intervention effects that are reported.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our research indicates that treating all studies as having the same quality and ability to interpret mechanisms, and not accounting for bias, may lead to misleading conclusions.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We therefore cannot conclude that growth mindset interventions are more important for low-SES students than not-low SES students.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Publication Bias Analysis Summary.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is perhaps surprising that after nearly forty years of mindset research (Dweck first introduced the theory in 1983; see Dweck & Bempechat, 1983) with millions of dollars in funding, the theoretical underpinnings of mindset remain largely unsubstantiated.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, financial incentives may influence which effects are published.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“In a meta-analysis of measured mindsets and motivations, Burnette and colleagues (2013) generally found weak associations.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
What the sources say
- Not matchedcites Burnette and colleagues (2013)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This publication suppression biases the available evidence to appear more supportive of growth mindset intervention effects on students' academic achievement than may be warranted.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“the What Works Clearinghouse (2020) under the Department of Education uses a default intraclass correlation of ρ = .20for achievement outcomes if no intraclass correlation is provided by the study.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
What the sources say
- Not matchedcites What Works Clearinghouse (2020)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Excluding data and removing subsamples prior to publication leaves a skewed view of interventions' effects in the published literature.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Taken together along with Meta-Analysis 3, our results suggest that apparent effects of growth mindset interventions may be due to inadequate study designs, reporting flaws, and/or bias.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Discussion
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Likewise, in a preregistered, large-sample, direct test of mindset's associations with several motivations and behaviors assumed to originate from mindset (e.g., goal orientation, challenge seeking, resilience), we (Burgoyne et al., 2020) found weak and null relationships.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
What the sources say
- Not checked — no full text of the sourcecites Burgoyne et al., 2020 source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These results undermine the theoretical claims of mindset theory.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Post-test differences between treatment and control groups do not provide evidence that the growth mindset intervention influenced students' mindsets, because the groups could have differed at baseline or the control group could have become more fixed.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Method
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When considering the publication bias-corrected estimates, 𝑑 ̅ = 0.03 and 𝑑 ̅ = 0.01, there is 99-100% overlap between the treatment and control groups' academic achievement distributions.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In sum, despite the popularity of growth mindset interventions, the current evidence does not support claims that growth mindsets are beneficial for students' academic achievement.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Taken together, the overall uncorrected effect size found in the present meta-analysis is likely overestimated.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Publication Bias Analysis Summary.
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Taken together, our findings indicate that studies adhering to best practices are unlikely to demonstrate that growth mindset interventions benefit students' academic achievement.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Therefore, we cannot conclude that students' level of academic challenge is an important factor for determining the efficacy of a growth mindset intervention.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Publication Bias Analysis Summary.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This pattern suggests that apparent effects of growth mindset interventions on academic achievement are likely spurious and due to inadequate study design, flawed reporting, and bias.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Discussion
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- It may state two separate claims as one. 37
- Probably not a substantial claim. 98
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“Yet, the overall empirical evidence does not support this claim.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > 2. Does Holding a Growth Mindset Lead Students to Adopt Learning Goals, Increase
What the sources say
- Not checked — no full text of the sourcecites Payne et al. (2007) source
- Disputedcites Burnette et al. (2013) sourceExperimental — accuracy not yet measured
The paper reports the opposite of the attributed conclusion. Its goal-setting results find a positive association between incremental beliefs and learning goals; its goal-operating results find greater use of mastery-oriented and less use of helpless-oriented strategies. The Moderation by Ego-Threat results report that these associations were stronger when people faced a threat. These are associations rather than proof of causation, but the paper does not conclude that the overall evidence fails to support the proposed pattern. (LLM, conf=0.90)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites Burgoyne, Hambrick, & Macnamara, 2020 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“As another example, Yeager et al. (2019) only reported the results of the 50% of students performing below their school's median.They stated this was in part because lower-achieving students may have more academic difficulties and therefore may benefit more from a growth mindset intervention than higher-achieving students.Yet, they did not report a test of whether the treatment effect for lower-”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Testing for Differences Between Groups When Claiming Group Differences
What the sources say
- Disputedcites Yeager et al. (2019) sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 0 partially supported, 1 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Disputed
Every source the paper cites for this claim was checked and supports it.
In the paper
“Non-compliers might have certain characteristics that differ from compliers that would impact the effect of treatment (Shaya & Gu, 2007) and non-compliance might be higher in the treatment condition than in the control condition, violating the goal of random assignment.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
What the sources say
- Supportedcites Shaya & Gu, 2007 source
Split into 2 atoms — 2 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In an analysis of randomized controlled trials reported as using intent-to-treat analyses, Hollis and Campbell (1999) note that there is no standard definition of intent-to-treat and researchers vary widely in their interpretation.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
What the sources say
- Supportedcites Hollis and Campbell (1999) source
The Introduction states that there is 'no single definition' of intention-to-treat analysis and that the phrase seems to have different meanings for different authors. The Key messages also report that handling of deviations from randomised allocation varied widely among published trials. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Preregistration is required for all government-funded medical clinical trials in the United States (Food and Drug Administration, 2007; see also Kaplan & Irvin, 2015).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Following Detailed Preregistered Hypotheses, Design, and Analysis Plans
What the sources say
- Not matchedcites Food and Drug Administration, 2007
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites Kaplan & Irvin, 2015 sourceExperimental — accuracy not yet measured
The Discussion (Implications; page not provided) says registration was required for studies of drugs, biologics, or devices treating serious or life-threatening diseases. It also says many journals required prospective registration and that large NHLBI trials published after 2000 were preregistered. It does not support a requirement covering all government-funded medical clinical trials in the United States. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“Artificially dichotomizing continuous measures is rarely conceptually or statistically defensible, and frequently yields misleading results (MacCallum et al., 2002).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Using Continuous Variables Over Artificially Dichotomized Variables
What the sources say
- Supportedcites MacCallum et al., 2002 source
The paper’s opening passage (p. 1) says dichotomization is rarely defensible and often yields misleading results. The Summary and Conclusions (p. 20) explains that common justifications are invalid and lists substantial statistical consequences, supporting the paraphrase. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Yeager and Dweck (2020)suggest that the largest effect one can expect from an educational intervention on real-world outcomes is d = 0.20.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
What the sources say
- Supportedcites Yeager and Dweck (2020) source
In “Controversy #3: Are Mindset Effect Sizes Too Small to Be Interesting?”, the paper says that, when using best-evidence syntheses as the benchmark, about the best effect expected from an educational intervention on real-world outcomes is .20 SD. This supports the citing sentence’s paraphrase. (LLM, conf=0.94)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Relatively few studies demonstrated that the intervention influenced students' mindsets.Therefore, in some cases, not enough effects were available to conduct moderator analyses.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Present Study
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For around ten percent of the studies included in this systematic review, we discovered both published and unpublished versions.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Figure 2
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“That said, as we systematically reviewed the literature, we found multiple instances of practices that inflate the Type I error rate as well as inappropriate interpretations of significance levels.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Controlling for the Familywise Error Rate
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The number of excluded participants ranged from four (2% of the sample) to 6,222 (50% of the sample).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Figure 2
plainn = 5- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Thus, relative to Sisk et al. (2018), the present meta-analysis includes more than double the number of records and nearly double the total number of participants.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Inclusion Criteria and Literature Search
What the sources say
- Not checked — no full text of the sourcecites Sisk et al. (2018) source
plainn = 79- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of the 61 independent records (e.g., articles) included in the present study, 44 were from 2016 or later.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Rate of Growth Mindset Interventions Entering the Literature
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“All studies included in our systematic review and metaanalyses examined the effect of growth mindset interventions on grades (exam grades, course grades, grade averages) and standardized test scores.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Measuring Direct Outcomes Rather Than Indirect Outcomes
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The number of growth mindset intervention studies examining academic achievement appears to be increasing rapidly, see Figure 2.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Rate of Growth Mindset Interventions Entering the Literature
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Including the records previously identified by Sisk et al. (2018), altogether we identified 61 independent records, which included 63 studies and 79 independent samples with a total sample size of 97,672 students.”
- Also stated in: § Criteria For Study Inclusion · plain
“Meta-Analysis 1: No Quality Control 61 independent records 63 studies 79 independent samples 96 effect sizes 97,672 students”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Inclusion Criteria and Literature Search
plainn = 79- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Also stated in: § Criteria For Study Inclusion · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, 89% of the reports in the present study were produced after this date.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Study Hypothesis, Planned Sample (and Stopping Rule), Intervention Design, and
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Counter to this assumption, no theoretically meaningful moderators were significant, indicating that the effect sizes did not differ significantly across levels of the moderator.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Standardized Difference in Means and 95% CI Study Name
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Six other studies reported that they were preregistered, but we did not code them as such for reasons outlined in Table 3.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Figure 4
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Rests on an assumption: Studies without the best-practice characteristics increase the risk to internal validity in individual study results.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For multiple studies reporting significant effects, the researchers assigned students to condition by group (e.g., by classroom) rather than on an individual basis and did so without correction.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Type I Error
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of the 4,832 independent records revealed in our search, 138 were in a language other than English.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This study is the most comprehensive systematic review of the empirical evidence of growth mindset interventions on academic achievement to date, assessing both the quantity and quality of the evidence.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“To our knowledge, no studies have tested whether growth mindset intervention benefits are compounded over longer timescales (i.e., over years).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“most studies included major threats to internal validity, preventing any significant effects from being clearly attributable to growth mindset as the mechanism.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Authors with financial incentives found both positive and null results, yet, often, only their larger, significant effects were published.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Financial Incentives.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“There is no known evidence suggesting there are many non-English articles relevant to the current meta-analysis or that such studies would produce very different results from the studies currently included in the present-meta-analysis.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Additionally, as described in The State of the Literature, claims about growth mindset interventions being particularly beneficial for particular student subgroups are often not properly tested.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Yet, no theoretically meaningful moderators were significant, indicating that the effect sizes did not differ significantly across levels of the moderator.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Standardized Difference in Means and 95% CI Study Name
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“many studies failed to adjust for the design effect, calling into question the veracity of some reported significant effects (e.g., Blackwell et al., 2007)”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
What the sources say
- Not matchedcites Blackwell et al., 2007
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Zero studies that measurably changed students' mindsets met 100% or 90% best practices criteria, one study met 80% best practices criteria, two studies met 70% best practices criteria, and three met 60% best practices criteria.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Meta-Analysis 3: Best Available Evidence
plainn = 6- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Furthermore, most studies collect postintervention measures of mindset within a year of administering a growth mindset intervention.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Porta et al. concluded that using a single statistical approach of either per protocol or intent-to-treat analyses does not protect against bias.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
What the sources say
- Not matchedcites Porta et al.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Reporting a power analysis does not ensure the study is adequately powered.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > A Priori Power Analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Some might argue that insisting on preregistrations will suppress discoveries.This need not be the case.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Following Detailed Preregistered Hypotheses, Design, and Analysis Plans
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Overall, the relationship between students' mindsets and academic achievement appears to be, at most, weak, and not always in the hypothesized direction.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > 3. Do Traits and Behaviors Originating from a Growth Mindset Lead to Higher Levels of Achievement?
What the sources say
- Not checked — no full text of the sourcecites Sisk et al. (2018) source
- Not matchedcites Li & Bates, 2019, 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgedcorrelationaln = 365,915- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Preregistering in psychology is a newer practice-for instance, the badge identifying preregistered studies was introduced by Psychological Science in 2013 (Eich, 2014)-and is not mandated.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Following Detailed Preregistered Hypotheses, Design, and Analysis Plans
What the sources say
- Not matchedcites Eich, 2014
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With a large enough sample, on average, the groups should be roughly equivalent regarding extraneous factors (e.g., ability, personality, motivation) that could affect the outcome of the intervention.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Random Assignment to Condition at the Individual Level
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Otherwise, readers cannot evaluate whether differences between the treatment and control groups are due to the treatment or these extraneous variables.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Blinding
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If reported and followed, conducting a priori power analyses also protects against questionable research practices such as p-hacking and data-peeking.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > A Priori Power Analysis
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, reporting an a priori power analysis requires researchers to determine the expected effect size or smallest effect size of interest and plan the study accordingly.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > A Priori Power Analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Researchers must also keep in mind that manipulation check results are only as valid as their measures.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Testing Whether the Intervention Influenced Treatment Students' Mindsets
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“Blinding study administrators to condition assignment may also help reduce observer-expectancy effects-when study administrators consciously or unconsciously influence participants (e.g., Rosenthal, 1976;Rosenthal & Rubin, 1978).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Blinding
What the sources say
- Not matchedcites Rosenthal, 1976
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites Rosenthal & Rubin, 1978 source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Along with adequate sample sizes, random assignment to conditions at the individual level helps ensure that the treatment and control groups are comparable.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Random Assignment to Condition at the Individual Level
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When the treatment and control groups differ in multiple ways this precludes interpretation of the mechanism driving any effects.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Group Should Be Introduced
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“To determine if the intervention's impact is from a change in growth mindset augmented with encouragement, strategies and/or tips-rather than only due to the encouragement, strategies, and/or tips-the control group needs to receive the same information as the treatment group except information about attribute malleability (growth mindset).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Group Should Be Introduced
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Participants not blinded to condition may also behave according to their beliefs about the study administrators' expectations (i.e., demand characteristics).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Blinding
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Thus, choosing an active (non-fixed-mindset) control group is the best type of comparison group for isolating the critical ingredient of a growth mindset.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention is Compared to an Active Control Condition
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Nonetheless, more trust can be placed in the veracity of results from studies that adhere to detailed preregistrations than similar studies that do not.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Following Detailed Preregistered Hypotheses, Design, and Analysis Plans
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Sisk et al. (2018) found that about 1 /3 of growth mindset intervention studies did not report whether the growth mindset intervention influenced students to have more of a growth mindset.Of those that did, around half failed to demonstrate the intervention changed students' mindsets as intended.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > 1. Can Interventions Teach Students to
What the sources say
- Not checked — no full text of the sourcecites Sisk et al. (2018) source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“An active control group is necessary but not sufficient to attribute differences in achievement to the intervention (Simons et al., 2016).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention is Compared to an Active Control Condition
What the sources say
- Not checked — no full text of the sourcecites Simons et al., 2016 source
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Blinding study administrators to condition assignment may reduce demand characteristics if administrators do not have informed expectations for participants to intuit.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Blinding
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“among the studies that reported manipulation checks, the meta-analytic effect on academic achievement was significant for studies where the manipulation checks failed but non-significant for studies where the manipulation checks succeeded.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Do Growth Mindset Interventions Improve Students' Academic Achievement?
What the sources say
- Not checked — no full text of the sourcecites Sisk et al. (2018) source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The effect on academic achievement was significant for studies that did not report manipulation checks but nonsignificant for studies that did report manipulation checks.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Do Growth Mindset Interventions Improve Students' Academic Achievement?
What the sources say
- Not checked — no full text of the sourcecites Sisk et al. (2018) source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Discoveries can continue to be made via exploratory studies or exploratory analyses.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Following Detailed Preregistered Hypotheses, Design, and Analysis Plans
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If no measures accurately reflect the underlying construct (e.g., due to demand characteristics, variable response processes), then the responsible mechanism cannot be determined until a valid and reliable measure has been developed.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Testing Whether the Intervention Influenced Treatment Students' Mindsets
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Preregistered studies are not necessarily welldesigned studies.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Following Detailed Preregistered Hypotheses, Design, and Analysis Plans
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Passive comparison groups (no-contact, waitlist, and teachingas-usual controls) differ from the treatment group in students' and teachers' expectations, attention, and engagement.Differences between treatment and passive control groups could account for perceived treatment effects, rather than growth mindset messages.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention is Compared to an Active Control Condition
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“They found poor agreement between the two approaches due to the uncertainty that protocol deviations and missing values introduce.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
What the sources say
- Not matchedcites Porta and colleagues (2007)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
None of the sources cited for this claim have been checked yet.
In the paper
“The control condition should be identical to the treatment condition in every way except for the critical ingredient of the treatment (Simons et al., 2016), including matching participant expectations (Boot et al., 2013).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention is Compared to an Active Control Condition
What the sources say
- Not checked — no full text of the sourcecites Simons et al., 2016 source
- Not matchedcites Boot et al., 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
In the paper
“Although psychology has no clear financial conflict of interest standards about this type of monetary earnings, the medical field would consider not disclosing this revenue stream in publications a violation of their ethical guidelines: readers should be alerted to financial interests they might perceive as potentially influencing findings (Chivers, 2019).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
What the sources say
- Not checked — no full text of the sourcecites Chivers, 2019 source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A perceived conflict of interest is introduced when one's income is tied to promoting a particular outcome, in this case, positive effects of growth mindset.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, book authors subsequently conducting research on growth mindsets may be, perhaps without awareness, more likely to look for evidence supporting their book's claims (confirmation bias) and less likely to publish contradictory findings (contributing to publication bias).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In the case of growth mindset interventions in education, much of the time, the outcome of interest is students' academic achievement.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Measuring Direct Outcomes Rather Than Indirect Outcomes
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“Mindset theory holds that academically struggling students (e.g., Paunesku et al., 2015) and students facing situational challenges such as transitioning to a new school (e.g., Blackwell et al., 2007) are especially likely to benefit from a growth mindset, more so than students without these risk factors.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Academic Challenge Status.
What the sources say
- Not matchedcites Paunesku et al., 2015
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Blackwell et al., 2007
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- Not matched
In the paper
“For studies where assignment to condition occurred at the classroom or school level rather than at the student level, we adjusted the variance associated with these effect sizes by applying Kish's (1965) design effect adjustment, which accounts for the average cluster size (e.g., average number of students per cluster) and the intraclass correlation.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Effect Sizes and Associated Variances
What the sources say
- Not matchedcites Kish's (1965)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For instance, when a growth mindset intervention has a null effect, growth mindset proponents with a financial incentive may be likely to question the timing, the training of the administers, contextual factors, or other nuances and assume one of these issues suppressed the result.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“To attribute effects to changes in growth mindset, researchers need to provide evidence that the intervention changed students' mindsets.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Significant Effect Interpretation Issues
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“Despite the assumption that intent-to-treat analyses should yield more conservative estimates than per-protocol analyses, the reported intent-to-treat effects were ds = 0.11 and 0.08: nearly four times and eight times the size of the per protocol results.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
What the sources say
- Not matchedcites Outes et al. (2017)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“This criterion excluded studies where the apparent goal was to induce growth mindsets, but the manipulation only involved praising effort or attributing success to effort.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Inclusion Criteria and Literature Search
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Many mindset researchers have a financial interest in demonstrating the benefits of growth mindsets.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Otherwise, the results may be difficult to interpret (Redick & Webster, 2014).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Equivalent Control Group at Baseline
What the sources say
- Not matchedcites Redick & Webster, 2014
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
- Not matched
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The meta-analytic data are openly available at https://osf.io/ajhxv/.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Method Transparency and Openness
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Critically, if a positive effect is found, this same level of criticism may not be applied.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We coded for student factors and methodological factors that served as preregistered potential moderators (described in the following subsections).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Coding
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If only one significance test is conducted per hypothesis, then there is only a small chance that it will reveal a significant effect when none truly exists.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Controlling for the Familywise Error Rate
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“That said, in the presence of protocol deviations, the conclusion of the effect of treatment cannot rest on either per protocol or intent-to-treat analyses alone (Porta et al., 2007).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of the Participants Who Participated
What the sources say
- Not checked — no full text of the sourcecites Porta et al., 2007 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Though the measurement of indirect effects are useful for testing mediation, conclusions about an unmeasured outcome should not be drawn from indirect effects.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Measuring Direct Outcomes Rather Than Indirect Outcomes
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Like any type of underreporting, selectively excluding the results of subsamples provides an incomplete picture of the treatment effects.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of All Subsamples
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We only included studies where the effect of the growth mindset intervention could be evaluated independently of other interventions' effects.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention of Interest is Isolated from Other Treatments
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Following our preregistration, we used the effect reported in the unpublished version when it contained a larger sample than the published version.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Figure 2
plainn = 5- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Additionally, several growth mindset researchers have co-founded, are employed by, or serve as paid consultants to organizations that sell or promote growth mindset interventions or services.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“This income is not often acknowledged in scientific publications (Chivers, 2019).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
What the sources say
- Not checked — no full text of the sourcecites Chivers, 2019 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“An equivalent control group at baseline is critical for interpreting the treatment mechanism.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Equivalent Control Group at Baseline
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“That is, presumably, companies hire mindset researchers as motivational speakers to hear about the benefits of growth mindsets; knowledge of weak, mixed, null, or counter-evidence to the benefits of growth mindset reduces that appeal, which would reduce the number of invitations for these lucrative speaking engagements.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Mindset researchers suggest that growth mindsets are especially beneficial for students coming from low socioeconomic-status (SES) households (e.g., Claro et al., 2016).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Socioeconomic Status.
What the sources say
- Not matchedcites Claro et al., 2016
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The second is that we only included interventions that directly taught that a human characteristic could change.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Inclusion Criteria and Literature Search
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We only included studies where the growth mindset intervention was administered independent of other intervention protocols.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention of Interest is Isolated from Other Treatments
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“That is, despite random assignment to condition, the treatment and control groups could still differ on pre-intervention academic achievement due to chance.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Equivalent Control Group at Baseline
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Mindset researchers earning income from either type of organization are incentivized to report positive effects of growth mindset in their research.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“A team of three coded the study features.First, each author coded half the studies independently.Second, the first author and a research assistant checked all studies and made any necessary coding adjustments, including a detailed description of the reason for the adjustment.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Coding
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“These inclusion criteria are identical to Sisk et al.'s (2018) inclusion criteria, with two exceptions.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Inclusion Criteria and Literature Search
What the sources say
- Not checked — no full text of the sourcecites Sisk et al.'s (2018) source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Deviations and decisions not explicit in the preregistration are reported in the Appendix.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Method Transparency and Openness
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“We designed the meta-analyses and report the results in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement (Moher et al., 2009) and the American Psychological Association's Quantitative Meta-Analysis Article Reporting Standards (Appelbaum et al., 2018).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Method Transparency and Openness
What the sources say
- Not matchedcites Moher et al., 2009
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites Appelbaum et al., 2018 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If an intervention is combined with another treatment, either by design or during analysis, readers cannot evaluate whether the intervention is effective or whether effects are due to the other treatment or their combination.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention of Interest is Isolated from Other Treatments
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“As such, all studies included in the subsequent systematic review and meta-analyses met these criteria and we do not count them when examining the number of best practices criteria studies met.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices That Were Inclusion Criteria
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Despite the increase in attention paid to some unpublished studies, many unpublished studies are largely unknown, and publication bias remains a major problem in psychological science (Friese & Frankenbach, 2020).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Figure 2
What the sources say
- Not checked — no full text of the sourcecites Friese & Frankenbach, 2020 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“For example, Tillis (2019) randomly assigned students to a treatment group or a control group.The treatment group students received a growth mindset intervention, a stereotype threat intervention, and a relevance and cognitive dissonance intervention.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention of Interest is Isolated from Other Treatments
What the sources say
- Not matchedcites Tillis (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Hypotheses, methods, and planned analyses were preregistered at https://osf.io/ga9jk.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > General Method Transparency and Openness
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Combining all three intervention conditions to compare with the control group obfuscates the effects of the individual treatment conditions as well as the effects of the combined mindset and sense-of-purpose condition.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention of Interest is Isolated from Other Treatments
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Otherwise, the chance of erroneously observing a significant effect increases beyond the alpha level.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Controlling for the Familywise Error Rate
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“According to mindset theory, growth mindset interventions interact with recursive processes (Yeager & Walton, 2011), producing enduring changes that compound benefits over time (Dweck et al., 2014).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Time Interval between the Intervention and the Measure of Academic Achievement.
What the sources say
- Not checked — no full text of the sourcecites Yeager & Walton, 2011 source
- Not checked — no full text of the sourcecites Dweck et al., 2014
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“When possible, we accounted for baseline academic achievement.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Effect Sizes and Associated Variances
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Multiple growth mindset researchers are registered with speakers' bureaus as motivational, inspirational, and keynote speakers, where they charge $10,000 to $50,000 per talk to speak about growth mindset.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Readers cannot evaluate the full set of results when subgroups are excluded.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Reporting the Results of All Subsamples
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“To test the efficacy of a particular intervention, there must be a condition in which participants only receive the intervention of interest for comparison with a control group.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > The Intervention of Interest is Isolated from Other Treatments
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
In the paper
“If a study did not report the intraclass correlation, we used the intraclass correlation default used by the What Works Clearinghouse (2020) for achievement measures (ρ = .20).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Effect Sizes and Associated Variances
What the sources say
- Not matchedcites What Works Clearinghouse (2020)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Testing for group differences when claiming or implying group differences is a best practice in analyses.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Testing for Differences Between Groups When Claiming Group Differences
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The first is that we included studies that only reported intent-to-treat analyses when we could not obtain the effects for students who completed the intervention (i.e., per-protocol analyses).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Inclusion Criteria and Literature Search
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“With millions of books in print, author profits likely exceed $1 million (Peterson, 2019).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
What the sources say
- Not matchedcites Peterson, 2019
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These biases may be unintentional.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Best Practices in Avoiding Financial Conflicts of Interest
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We also were limited in our ability to assess documents in languages other than English.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“A further limitation is that we used Comprehensive Meta-Analysis software and therefore cannot publish our code.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, researchers should be able to reproduce all our results.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When study authors discuss null effects as though they were significant, readers may come away with a mistaken understanding of growth mindset intervention effectiveness.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, we may not be missing any relevant studies for this reason.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Likewise, claims that the effect of holding a growth mindset varies based on students' level of challenge or claims that the benefits of a growth mindset compound over time are undermined by the null results for all theoretical moderators, including student level of challenge and amount of time from the intervention to the measure of achievement.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“The first meta-analysis of growth mindset interventions in 2018 (which did not account for study quality) elicited conflicting conclusions: The meta-analysis authors (Sisk et al., 2018) concluded that effects of growth mindset interventions on academic achievement were small and cautioned they may be due to extraneous factors; Dweck (2018), the developer of mindset theory, concluded that the same”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Conclusions
What the sources say
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“However, post-hoc power does not reflect the true power of the test and is more”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“Cohen's d = 0.05 means there is a 51.4/48.6 chance that a randomly selected student from the treatment group will have a higher score on the measure of academic achievement than a randomly selected student from the control group (Magnusson, 2020).”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
What the sources say
- Not matchedcites Magnusson, 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Based on this percentage, we would expect one additional study to have been included if we were able to evaluate articles written in all languages.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“We concluded,”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Implications
What the sources say
- Not checked — no full text of the sourcecites Burgoyne et al., 2020 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Alternatively, we might be missing more than one otherwise relevant study because non-English articles were likely underrepresented in our search given the databases we used (e.g., APA PsycInfo), though Google Scholar searches across languages.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We provide open data (https://osf.io/ajhxv/)that includes study characteristics, effect sizes, and variances, along with information and explanations for which studies were included in each model.”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Limitations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The authors state this as an assumption.
The second meta-analysis model assumes that measures of mindset are valid and reliable, and that other factors are not the key mechanisms driving effects.
“We note, however, that this model rests on the assumption that measures of mindset are valid and reliable, and that other factors are not the key mechanisms driving effects.”
The authors state this as an assumption.
Construct measures are valid and reliable.
“Assuming construct measures are valid and reliable”
The authors state this as an assumption.
Intent-to-treat analyses should yield more conservative estimates than per-protocol analyses.
“Despite the assumption that intent-to-treat analyses should yield more conservative estimates than per-protocol analyses”
The authors state this as an assumption.
The effect of growth mindset interventions on academic achievement occurs via motivational processes, such as motivation to learn and seek challenges.
“In the case of mindset, the effect of growth mindset interventions on academic achievement is assumed to occur via motivational processes, such as motivation to learn and seek challenges.”
The paper relies on this without support.
Studies without the best-practice characteristics increase the risk to internal validity in individual study results.
“Studies without these characteristics increase the risk to internal validity in individual study results.”
The authors state this as an assumption.
Measures of mindset are valid and reliable.
“Thus, if we assume measures of mindset are valid and reliable, a better test of the importance of growth mindset is to only meta-analyze studies with evidence the intervention influenced students' mindsets as intended.”
The authors state this as an assumption.
Measures of mindset accurately reflect students' beliefs.
“Thus, assuming measures of mindset accurately reflect students' beliefs, studies included in Meta-Analysis 2 meet the minimal standard of evidence to attribute effects to growth mindset.”
The authors state this as an assumption.
Measures of mindset collected before and after an intervention are valid and reliable.
“We based Meta-Analysis 2: Minimal Standard of Evidence and Meta-Analysis 3: Best Available Evidence on the assumption that measures of mindset collected before and after an intervention are valid and reliable.”
Statistics that don’t add up
Each reported p-value recomputed from its test statistic and degrees of freedom.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“χ 2 (1, N = 61) = 0.13, p = .911”
§ DO GROWTH MINDSET INTERVENTIONS WORK? 1 Do Growth Mindset Interventions Impact Students' Academic Achievement? A Systematic Review and Meta-Analysis with Recommendations for Best Practices > Additional information
Reported p = .911 · recomputed p = .718
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Doesn’t add upχ²(1) = 0.13reported p = .911 · recomputed p = .718
“χ 2 (1, N = 61) = 0.13, p = .911”
- Not confirmedt(77) = 1.86reported p = .034 · recomputed p = .067
“t(77) = 1.86, p = .034”
- Not confirmedt(19) = 0.25reported p = .402 · recomputed p = .805
“t(19) = 0.25, p = .402”
- ConsistentQ(1) = 0.96reported p = .328 · recomputed p = .327
“Q(1) = 0.96, p = .328”
- ConsistentQ(1) = 7.9reported p = .005 · recomputed p = .005
“Q(1) = 7.90, p = .005”
- ConsistentQ(1) = 4.04reported p = .044 · recomputed p = .044
“Q(1) = 4.04, p = .044”
- ConsistentF(1, 75) = 6.35reported p = .014 · recomputed p = .014
“F(1, 75) = 6.35, p = .014”
- Consistentχ²(1) = 7.09reported p = .008 · recomputed p = .008
“χ 2 (1, N = 61) = 7.09, p = .008”
- ConsistentQ(2) = 0.47reported p = .791 · recomputed p = .791
“Q(2) = 0.47, p = .791”
- ConsistentQ(2) = 0.28reported p = .87 · recomputed p = .869
“Q(2) = 0.28, p = .870”
- ConsistentQ(1) = 2.1reported p = .147 · recomputed p = .147
“Q(1) = 2.10, p = .147”
- ConsistentQ(1) = 0.21reported p = .647 · recomputed p = .647
“Q(1) = 0.21, p = .647”
- ConsistentQ(1) = 0.39reported p = .534 · recomputed p = .532
“Q(1) = 0.39, p = .534”
- ConsistentQ(1) = 6.01reported p = .014 · recomputed p = .014
“Q(1) = 6.01, p = .014”
- ConsistentQ(3) = 4.33reported p = .228 · recomputed p = .228
“Q(3) = 4.33, p = .228”
- ConsistentQ(3) = 0.4reported p = .939 · recomputed p = .940
“Q(3) = 0.40, p = .939”
- ConsistentQ(1) = 2.99reported p = .084 · recomputed p = .084
“Q(1) = 2.99, p = .084”
- ConsistentQ(3) = 1.61reported p = .657 · recomputed p = .657
“Q(3) = 1.61, p = .657”
- ConsistentQ(1) = 0.18reported p = .674 · recomputed p = .671
“Q(1) = 0.18, p = .674”
- ConsistentQ(1) = 0.16reported p = .686 · recomputed p = .689
“Q(1) = 0.16, p = .686”
- ConsistentQ(2) = 3.98reported p = .137 · recomputed p = .137
“Q(2) = 3.98, p = .137”
- ConsistentQ(1) = 0.04reported p = .838 · recomputed p = .841
“Q(1) = 0.04, p = .838”
- ConsistentQ(1) = 1.29reported p = .256 · recomputed p = .256
“Q(1) = 1.29, p = .256”
- ConsistentQ(1) = 9.66reported p = .002 · recomputed p = .002
“Q(1) = 9.66, p = .002”
- ConsistentQ(1) = 0.08reported p = .781 · recomputed p = .777
“Q(1) = 0.08, p = .781”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Citations
Cites
(2000) · Cited by 9,198
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 1×
“Publication bias is bias in effect size estimates that occurs when the likelihood of publication depends on the direction or magnitude of the study ’ s results (e.g., Dickerson, 2005); typically, null or small effects are systematically suppressed from publication (Rosenthal, 1979).”
BackgroundMindset: The New Psychology of Success
(2006) · Choice Reviews Online · doi:10.5860/choice.44-2397 · Cited by 7,804
Motivational processes affecting learning.
Dweck, C. S. (1986) · American Psychologist · doi:10.1037/0003-066x.41.10.1040 · Cited by 6,971
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
(1999) · Cited by 6,308
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Rosenthal, R., & Jacobson, L. (1968) · The Urban Review · doi:10.1007/bf02322211 · Cited by 3,878
On the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538 · cited 4×
“Although arti fi cial dichotomiza-tion is most often performed on the predictor variable in correlational psychological research (e.g., a median split), some researchers will arti fi cially dichotomize the outcome variable (MacCallum et al., 2002).”
BackgroundInfluentialGarg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Research works printed but not linked: 15
- Barron, Hulleman, Hartka, & Inouye (2017) -M1-M3 Dommett, Devonshire, Sewter, & Greenfield (2013) -S2 Saunders (2013)
- Barron et al. (2017) -M1-M3 Dommett et al. (2013) -S2 Saunders (2013)
- Alimohamadi, Y., & Sepandi, M. (2019). Considering the design effect in cluster sampling. Journal of Cardiovascular and Thoracic Research, 11(1), 78. https://doi.org/10.15171/jcvtr.2019. · DOI
- Burnette, J. L., Hoyt, C. L., Russell, V. M., Lawson, B., Dweck, C. S., & Finkel, E. (2016). A growth mind-set intervention improves interest but not academic performance in the field of computer science. Unpublished preprint of methods and results.
- Dweck, C. S. (2009). Mindsets: Developing talent through a growth mindset. Olympic Coach, 21(1), 4-7.
- Dweck, C. S. (2016). Mindset: The new psychology of success (2 nd ed.). New York: Random House.
- Dweck, C. S., & Yeager, D. S. (2019a). A simple re-analysis overturns a "failure to replicate" and highlights an opportunity to improve scientific practice: Commentary on Li and Bates (in press). Unpublished manuscript. Retrieved from [https://www.researchgate.net/profile/David- Yeager/publication/337856605_A_Simple_Re- Analysis_Overturns_a_Failure_to_Replicate_and_Highlights_an_Opportunity_to_Impro ve_Scientific_Practice_Commentary_on_Li_and_Bates_2019/links/5def33d292851c8364 7068f8/A-Simple-Re-Analysis-Overturns-a-Failure-to-Replicate-and-Highlights-an- Opportunity-to-Improve-Scientific-Practice-Commentary-on-Li-and-Bates-2019.pdf] remedial math. Journal of Counseling and Psychology, 2(1), 3. https://digitalcommons.gardner-webb.edu/jcp/vol2/iss1/3
- Gauthreaux, E. F. (2015). Effect of specific feedback on growth mindset and achievement. (Unpublished doctoral dissertation). Louisiana State University.
- Huffman, G. C. (2017). An intelligence mindset intervention for first semester college students. [Unpublished doctoral dissertation]. Indiana University of Pennsylvania.
- Kish, L. (1965). Survey sampling. New York: Wiley.
- Macnamara, B. N., & Burgoyne, A. P. (2018, August 11). Preregistration for Do growth mindset interventions impact students' academic achievement? A systematic review and meta- analysis with recommendations for best practices. Open Science Framework. <www. osf.io/ga9jk>. https://doi.org/10.17605/osf.io/ga9jk · DOI
- Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine 6(7): e1000097. https://doi.org/10.1371/journal.pmed1000097 underachievement. Psychological Science, 26, 784-793. https://doi.org/10.1177/0956797615571017 · DOI
- Peterson, L. (2018). Can explicit teaching of a growth mindset in early elementary increase student ability? (Unpublished doctoral dissertation). Concordia University.
- Tillis, G. E. (2019). Toward a transformative transition: A critical pedagogical approach to social-psychological interventions in first-year seminar. In J. Hoffman, P. Blessinger, & M. Makhanya (Eds.), Strategies for Fostering Inclusive Classrooms in Higher Education: International Perspectives on Equity and Inclusion (Innovations in Higher Education Teaching and Learning, Vol. 16), (pp. 183-195).
- * Whorrall, A. L. (2018). Academic motivation and achievement of middle school Hispanic students: Exploring the use of mindset and Brainology in education. [Unpublished doctoral dissertation]. Northcentral University.
Cited by
Sorted by citations
Determinants of behaviour and their efficacy as targets of behavioural change interventions
Albarracín, D., Farkhad, B. F., & Samayoa, J. A. G. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00305-0 · Cited by 313
The Psychology of Framing: How Everyday Language Shapes the Way We Think, Feel, and Act
Flusberg, S. J., Holmes, K. J., Thibodeau, P. H., Nabi, R. L., & Matlock, T. (2024) · Gothic.net · doi:10.1177/15291006241246966 · Cited by 120
Zhi, Z., Ping, R., & Yang, Q. (2023) · Journal of Integrated Social Sciences and Humanities · doi:10.62836/jissh.v1i1.159 · Cited by 100
Tipton, E., Bryan, C. J., Murray, J. S., McDaniel, M. A., Schneider, B., & Yeager, D. S. (2023) · Psychological Bulletin · doi:10.1037/bul0000384 · Cited by 90
A meta-analysis on the relationship between climate anxiety and wellbeing
Gago, T., Sargisson, R. J., & Milfont, T. L. (2024) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2024.102230 · Cited by 87
Metadata
- Authors
- Macnamara, B. N., & Burgoyne, A. P.
- Affiliations
- Case Western Reserve University (US)
- Georgia Institute of Technology (US)
- Venue
- Psychological Bulletin
- Published
- 2023-03
- Volume
- 149
- Issue
- 3-4
- Pages
- 133-173
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W4308060187
- Semantic Scholar
- 873e51943c93c47b23e00e8b0b5e9e9a16492056
- Cited by
- 415
- References
- 103
- Citations by year
- 2026: 141 · 2025: 141 · 2024: 88 · 2023: 45
- FWCI
- 68.23
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- cc-by
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- OSF Preprints (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion)
- Funders
- Education Development Trust
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Education, Achievement, and Giftedness
- Social Sciences › Psychology › Social Psychology › Grit, Self-Efficacy, and Motivation
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- growth mindset intervention, academic performance, study design flaws, reporting bias, intervention effectiveness, best practices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-08, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-08 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
