The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index; 19 of the 44 sources its claims cite were checked for support.
Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math
Open accessAbstract
We tested the hypothesis that underrepresented students in active-learning classrooms experience narrower achievement gaps than underrepresented students in traditional lecturing classrooms, averaged across all science, technology, engineering, and mathematics (STEM) fields and courses. We conducted a comprehensive search for both published and unpublished studies that compared the performance of underrepresented students to their overrepresented classmates in active-learning and traditional-lecturing treatments. This search resulted in data on student examination scores from 15 studies (9,238 total students) and data on student failure rates from 26 studies (44,606 total students). Bayesian regression analyses showed that on average, active learning reduced achievement gaps in examination scores by 33% and narrowed gaps in passing rates by 45%. The reported proportion of time that students spend on in-class activities was important, as only classes that implemented high-intensity active learning narrowed achievement gaps. Sensitivity analyses showed that the conclusions are robust to sampling bias and other issues. To explain the extensive variation in efficacy observed among studies, we propose the heads-and-hearts hypothesis, which holds that meaningful reductions in achievement gaps only occur when course designs combine deliberate practice with inclusive teaching. Our results support calls to replace traditional lecturing with evidence-based, active-learning course designs across the STEM disciplines and suggest that innovations in instructional strategies can increase equity in higher education.
Overview
CoChat Summary
TL;DR
This systematic review and individual-participant-data meta-analysis found that active learning reduced achievement gaps for underrepresented/minoritized students in undergraduate STEM courses. Across the analyzed studies, gaps in exam scores and passing rates were smaller in active-learning than in traditional lecturing, with the largest gap reductions seen in high-intensity active learning.
Key findings
- In identical or formally equivalent exams, the standardized achievement gap between MGS and non-MGS students was −0.62 SDs in traditional lecturing and −0.42 SDs with active learning, a 33% reduction in the gap.
- For passing rates, the gap was −7.1% with traditional lecturing and −3.9% with active learning, a 45% reduction in the gap.
- Gap reductions were stronger with high-intensity active learning: exam-score gaps were −0.48 SDs for low-intensity vs −0.36 SDs for high-intensity; passing-rate gaps were −9.6% for low-intensity vs −2.0% for high-intensity.
- In the study-level breakdown, 10 of 15 studies with exam-score data showed disproportionate gains for MGS students under active learning, and 15 of 26 studies with failure-rate data showed disproportionate reductions in failure rates for MGS students.
Methods
- Systematic review plus individual-participant-data (IPD) meta-analysis comparing undergraduate STEM courses taught with traditional lecturing vs active learning in the same course and institution.
- Literature search covered studies published or completed from January 1, 2010 to June 30, 2016; the final analysis included 41 studies with disaggregated data by MGS status.
- Final datasets: 9,238 student records from 15 studies for exam scores and 44,606 student records from 26 studies for failure rates; analyses used hierarchical Bayesian multilevel models with section random effects and sensitivity analyses.
Limitations
- The paper states that the conclusions are “tempered by the limitations of the study’s sample size”: only 41 studies had data for students from MGS, which also made moderator analyses hard to interpret.
- The paper says data on the type of active learning were “poorly resolved” because studies often did not report quantitative details of course interventions.
- The paper notes possible sampling bias in instructor/institution type, overrepresentation of research-intensive institutions, and underrepresentation of teaching-intensive institutions and community colleges.
- Evident from the text: the meta-analysis depends on studies that met specific coding and data-sharing criteria, so the findings may not generalize to STEM courses or settings not represented in the included studies.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
16 Valid · 1 Not valid · 10 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Course grades in most STEM courses are largely driven by performance on examinations, even in active-learning courses that offer many nonexam points (39).”
§ Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math > Discussion
What the sources say
- Partly supportedcites [39] sourceExperimental — accuracy not yet measured
The Methods section (“Exam Impact on Final Course Grade”; page unavailable) says the authors intended exams to remain the primary determinant of grades even when many nonexam points were available. Table 4 in the Results shows that exam points strongly predicted final grades across the introductory biology sections studied. The paper does not establish that this holds in most STEM courses. (LLM, conf=0.88)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“All students benefit from classroom cultures that promote self-efficacy, identity as a scientist, and sense of belonging in STEM (58)”
§ Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math > Discussion
What the sources say
- Partly supportedcites [58] sourceExperimental — accuracy not yet measured
The paper’s sections on self-efficacy, sense of belonging, and science identity link each to student learning or persistence, and its discussion of teaching considers how classroom experiences shape these factors. Its focus is undergraduate biology, however; it does not establish that all students benefit from such classroom cultures across STEM. The indexed passages provide section labels but no page numbers. (LLM, conf=0.82)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“students in active-learning course designs that reduced or eliminated achievement gaps have reported an increased sense of community and self-efficacy compared to their peers in the lecture-intensive version of the same course (22, 23).”
§ Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math > Discussion
What the sources say
- Partly supportedcites [22] sourceExperimental — accuracy not yet measured
In Methods and Results (Study 3, Factor 2; page unavailable), students in the moderate-structure course were twice as likely to report a stronger sense of classroom community than those in the low-structure course. The Introduction mentions self-reported self-efficacy in prior active-learning research, but says that research did not compare students in versions of the same course. This paper therefore does not support the claimed same-course self-efficacy comparison. (LLM, conf=0.88)
- Not matchedcites [23]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Our data on type of active learning are also poorly resolved, because publications still routinely fail to report quantitative data on the nature of course interventions, such as records from classroom observation tools (e.g., ref. 61 and SI Appendix, Table S12).”
§ Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math > Discussion
What the sources say
- Supportedcites [61] source
The citation appears as an example of a classroom observation tool, not as evidence that publications routinely omit quantitative intervention data. The Abstract identifies PORTAAL as a classroom observation tool for assessing active-learning practices, which supports that use of the citation. (LLM, conf=0.91)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“larger gaps are correlated with faculty who have a fixed mindset, which interprets intelligence as innate and immutable and is therefore exclusion or selection-oriented (44).”
§ Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math > Discussion
What the sources say
- Supportedcites [44] source
The Results report that racial achievement gaps in STEM courses were nearly twice as large with fixed- versus growth-mindset faculty. The Introduction defines a fixed mindset as treating intelligence and ability as innate and largely unchangeable, and describes judging students as low-ability and encouraging them to drop difficult courses—supporting the paraphrase 'exclusion or selection-oriented.' (LLM, conf=0.88)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
30 more claims
Create a free account to see all 86 claims and every source verdict.
- It may state two separate claims as one. 30
- Probably not a substantial claim. 36
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These perceptions, along with a likely reduction in stress and anxiety (see Figure 4), could benefit students from underrepresented groups and may thus reduce the achievement gap among underrepresented minorities”
From Two-Stage Final Exams: An Assessment Strategy for Enhanced Collaborative Learning and Reduced Student Stress (2026) · cites this paper as Theobald et al., 2020
Experimental — accuracy not yet measured
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223 · cited 2×
“The protocol for this study, presented in the PRISMA-P format (66) and including annotations regarding modifications that occurred during the course of the research, is available in SI Appendix, SI Materials and Methods.”
Capital in the Twenty-First Century
Piketty, T. (2014) · doi:10.4159/9780674369542 · Cited by 14,437
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Active learning increases student performance in science, engineering, and mathematics
Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319030111 · Cited by 9,787 · cited 6×
“Can interventions in courses themselves—meaning, changes in how science is taught—reduce achievement gaps and promote retention in STEM? A recent metaanalysis concluded that, on average, active learning in STEM leads to higher examination scores and lower failure rates for all students, compared to all students in the…”
InfluentialSelf-citation(2000) · Cited by 9,198
A threat in the air: How stereotypes shape intellectual identity and performance
Steele, C. M. (1997) · American Psychologist · doi:10.1037/0003-066x.52.6.613 · Cited by 6,770 · cited 1×
“Equally important, inclusive teaching emphasizes treating students with dignity and respect (52), communicating confidence in students’ ability to meet high standards (53), and demonstrating a genuine interest in students’ intellectual and personal growth and success (54, 55).”
BackgroundGeneral methods for monitoring convergence of iterative simulations
Brooks, S. P., & Gelman, A. (1998) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1998.10474787 · Cited by 6,045
Research works printed but not linked: 8
- S. F. Reardon, “The widening achievement gap between the rich and the poor: New evidence and possible explanations” in Whither Opportunity? G. J. Duncan, R. J. Murnane, Eds. (Russell Sage Foundation, New York, 2011), pp. 91–115.
- National Student Clearinghouse Research Center, High School Benchmarks 2019: National College Progression Rates (National Student Clearinghouse, Herndon, VA, 2019).
- X. Chen, STEM Attrition: College Students’ Paths Into and Out of STEM Fields (National Center for Education Statistics, Washington, DC, 2013).
- L. S. Vygotsky, Mind in Society (Harvard University Press, Cambridge, MA, 1978).
- S. A. Ginder, J. E. Kelly-Reid, F. B. Mann, Enrollment and Employees in Postsecondary Institutions, Fall 2015 (National Center for Education Statistics, Washington, DC, 2017).
- J. G. Reed, P. M. Baxter, Using Reference Databases. The Handbook of Research Synthesis and Meta-Analysis, H. Cooper, L. V. Hedges, J. C. Valentine, Eds. (Russell Sage Foundation, New York, 2009), pp. 73–101.
- H. Rothstein, S. Hopewell, Grey Literature. The Handbook of Research Synthesis and Meta-Analysis, H. Cooper, L. V. Hedges, J. C. Valentine, Eds. (Russell Sage Foundation, New York, 2009), pp. 103–125.
- H. D. White, Scientific Communication and Literature Retrieval. The Handbook of Research Synthesis and Meta-Analysis, H. Cooper, L. V. Hedges, J. C. Valentine, Eds. (Russell Sage Foundation, New York, 2009), pp. 51–71.
Cited by
Castelli, F. R., & Sarvary, M. A. (2021) · Ecology and Evolution · doi:10.1002/ece3.7123 · Cited by 451
Algorithmic fairness in education
Kizilcec, R. F., & Lee, H. (2022) · The Ethics of Artificial Intelligence in Education · doi:10.4324/9780429329067-10 · Cited by 193
Instructor strategies to aid implementation of active learning: a systematic literature review
Nguyen, K. A., Borrego, M., Finelli, C. J., DeMonbrun, M., Crockett, C., Tharayil, S., Shekhar, P., Waters, C., & Rosenberg, R. (2021) · International Journal of STEM Education · doi:10.1186/s40594-021-00270-7 · Cited by 193
Harris, R. B., Mack, M. R., Bryant, J., Theobald, E. J., & Freeman, S. (2020) · Science Advances · doi:10.1126/sciadv.aaz5687 · Cited by 183
“More specifically, the hypothesis is that courses would better support underrepresented students if they encouraged belonging, science identity, and self-efficacy; emphasized active learning approaches that engage all students and increase exam scores and lower failure rates; and deemphasized inauthentic assessments s…”
BackgroundSelf-citationTo Flip or Not to Flip? A Meta-Analysis of the Efficacy of Flipped Learning in Higher Education
Bredow, C. A., Roehling, P. V., Knorp, A. J., & Sweet, A. M. (2021) · Review of Educational Research · doi:10.3102/00346543211019122 · Cited by 162
Metadata
- Authors
- Theobald, E. J., Hill, M. J., Tran, E., Agrawal, S., Arroyo, E. N., Behling, S., Chambwe, N., Cintrón, D. L., Cooper, J. D., Dunster, G., Grummer, J. A., Hennessey, K., Hsiao, J., Iranon, N., Jones, L., Jordt, H., Keller, M., Lacey, M. E., Littlefield, C. E., Lowe, A., Newman, S., Okolo, V., Olroyd, S., Peecook, B. R., Pickett, S. B., Slager, D. L., Caviedes-Solis, I. W., Stanchak, K. E., Sundaravardan, V., Valdebenito, C., Williams, C. R., Zinsli, K., & Freeman, S.
- Affiliations
- University of Washington (US)
- Institute for Systems Biology (US)
- Shoreline Community College (US)
- Corresponding author
- Theobald, Elli J.
- Freeman, Scott
- ORCID
- Theobald, Elli J.
- Agrawal, Sweta
- Behling, Shawn
- Chambwe, Nyasha
- Cintrón, Dianne Laboy
- Cooper, Jacob D.
- Dunster, Gideon
- Grummer, Jared A.
- Hennessey, Kelly
- Hsiao, Jennifer
- Jones, Leonard
- Jordt, Hannah
- Littlefield, Caitlin E.
- Lowe, Alexander
- Olroyd, Savannah
- Peecook, Brandon R.
- Pickett, Sarah B.
- Slager, David L.
- Caviedes-Solis, Itzue W.
- Stanchak, Kathryn E.
- Williams, Claire R.
- Zinsli, Kaitlin
- Freeman, Scott
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2020-03-09
- Volume
- 117
- Issue
- 12
- Pages
- 6476-6483
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC7104254
- OpenAlex
- W3009483010
- Cited by
- 1,387
- References
- 75
- Citations by year
- 2026: 210 · 2025: 222 · 2024: 272 · 2023: 236 · 2022: 233 · 2021: 154 · 2020: 60
- FWCI
- 258.89
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Funders
- University of Washington College of Arts and Sciences (NA)
- Topics
- Social Sciences › Education › Innovative Teaching Methods
- Social Sciences › Education › Higher Education Research Studies
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- active learning, achievement gap, underrepresented students, STEM education, traditional lecturing, course design, student failure rates, test scores, higher education equity, inclusive pedagogy, deliberate practice
- MeSH terms
- Achievement, Educational Measurement, Engineering, Humans, Mathematics, Minority Groups, Science, Students, Technology, United States, Universities, Problem-Based Learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math. https://app.cochat.ai/papers/10.1073/pnas.1916903117
- The paper
- Theobald, E. J., Hill, M. J., Tran, E., Agrawal, S., Arroyo, E. N., Behling, S., Chambwe, N., Cintrón, D. L., Cooper, J. D., Dunster, G., Grummer, J. A., Hennessey, K., Hsiao, J., Iranon, N., Jones, L., Jordt, H., Keller, M., Lacey, M. E., Littlefield, C. E., . . . Freeman, S. (2020). Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.1916903117
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.