Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index; 19 of the 44 sources its claims cite were checked for support.

Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math

Open access

Abstract

We tested the hypothesis that underrepresented students in active-learning classrooms experience narrower achievement gaps than underrepresented students in traditional lecturing classrooms, averaged across all science, technology, engineering, and mathematics (STEM) fields and courses. We conducted a comprehensive search for both published and unpublished studies that compared the performance of underrepresented students to their overrepresented classmates in active-learning and traditional-lecturing treatments. This search resulted in data on student examination scores from 15 studies (9,238 total students) and data on student failure rates from 26 studies (44,606 total students). Bayesian regression analyses showed that on average, active learning reduced achievement gaps in examination scores by 33% and narrowed gaps in passing rates by 45%. The reported proportion of time that students spend on in-class activities was important, as only classes that implemented high-intensity active learning narrowed achievement gaps. Sensitivity analyses showed that the conclusions are robust to sampling bias and other issues. To explain the extensive variation in efficacy observed among studies, we propose the heads-and-hearts hypothesis, which holds that meaningful reductions in achievement gaps only occur when course designs combine deliberate practice with inclusive teaching. Our results support calls to replace traditional lecturing with evidence-based, active-learning course designs across the STEM disciplines and suggest that innovations in instructional strategies can increase equity in higher education.

Overview

CoChat Summary

TL;DR

This systematic review and individual-participant-data meta-analysis found that active learning reduced achievement gaps for underrepresented/minoritized students in undergraduate STEM courses. Across the analyzed studies, gaps in exam scores and passing rates were smaller in active-learning than in traditional lecturing, with the largest gap reductions seen in high-intensity active learning.

Key findings

  • In identical or formally equivalent exams, the standardized achievement gap between MGS and non-MGS students was −0.62 SDs in traditional lecturing and −0.42 SDs with active learning, a 33% reduction in the gap.
  • For passing rates, the gap was −7.1% with traditional lecturing and −3.9% with active learning, a 45% reduction in the gap.
  • Gap reductions were stronger with high-intensity active learning: exam-score gaps were −0.48 SDs for low-intensity vs −0.36 SDs for high-intensity; passing-rate gaps were −9.6% for low-intensity vs −2.0% for high-intensity.
  • In the study-level breakdown, 10 of 15 studies with exam-score data showed disproportionate gains for MGS students under active learning, and 15 of 26 studies with failure-rate data showed disproportionate reductions in failure rates for MGS students.

Methods

  • Systematic review plus individual-participant-data (IPD) meta-analysis comparing undergraduate STEM courses taught with traditional lecturing vs active learning in the same course and institution.
  • Literature search covered studies published or completed from January 1, 2010 to June 30, 2016; the final analysis included 41 studies with disaggregated data by MGS status.
  • Final datasets: 9,238 student records from 15 studies for exam scores and 44,606 student records from 26 studies for failure rates; analyses used hierarchical Bayesian multilevel models with section random effects and sensitivity analyses.

Limitations

  • The paper states that the conclusions are “tempered by the limitations of the study’s sample size”: only 41 studies had data for students from MGS, which also made moderator analyses hard to interpret.
  • The paper says data on the type of active learning were “poorly resolved” because studies often did not report quantitative details of course interventions.
  • The paper notes possible sampling bias in instructor/institution type, overrepresentation of research-intensive institutions, and underrepresentation of teaching-intensive institutions and community colleges.
  • Evident from the text: the meta-analysis depends on studies that met specific coding and data-sharing criteria, so the findings may not generalize to STEM courses or settings not represented in the included studies.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1073/pnas.1916903117

Cites

75 of 75 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1. Average achievement gaps are smaller in active-learning classes than traditional-lecturing classes. (A) Model-based estimates for the average achievement gaps in examination scores across STEM for students from MGS versus non-MGS under traditional lecturing (gold) and active learning (purple). The data are in units of SDs (SI Appendix, SI Materials and Methods). (B) Model-based estimates for the average achievement gaps in percentage of students passing a STEM course for students from MGS versus non-MGS. In both graphs, points show averages and the vertical bars show 95% Bayesian CIs; the dashed horizontal lines represent no gap in performance.
Fig. 1. Average achievement gaps are smaller in active-learning classes than traditional-lecturing classes. (A) Model-based estimates for the average achievement gaps in examination scores across STEM for students from MGS versus non-MGS under traditional lecturing (gold) and active learning (purple). The data are in units of SDs (SI Appendix, SI Materials and Methods). (B) Model-based estimates for the average achievement gaps in percentage of students passing a STEM course for students from MGS versus non-MGS. In both graphs, points show averages and the vertical bars show 95% Bayesian CIs; the dashed horizontal lines represent no gap in performance.CC BY-NC-ND · PubMed Central
Fig. 2. The magnitude of achievement gaps in active-learning (AL) versus passive-learning (PL) classes varies among studies. Each data point represents a single course; the majority of active-learning courses narrowed the achievement gap. In both panels, the red dashed 1:1 line indicates no difference in the gap between active and passive learning; the white area above the line indicates courses where the gap narrowed. (A) The Upper Left quadrant indicates studies where gaps in examination scores reversed, from students from non-MGS doing better under lecturing to students from MGS doing better under active learning. The Upper Right quadrant represents studies where gaps in examination scores favored students from MGS under both traditional lecturing and active learning. The Bottom Left quadrant signifies studies where students from non-MGS averaged higher examination scores than students from MGS under both passive and active instruction. The Bottom Right quadrant denotes studies where students from non-MGS outperformed students from MGS under active learning, but students from MGS outperformed students from non-MGS under traditional lecturing. Both axes are in units of SDs and indicate difference in performance between MGS and non-MGS students. (B) The Upper Left quadrant indicates studies where gaps in the probability of passing favored students from non-MGS under lecturing but MGS under active learning. The Upper Right quadrant represents studies where the probability of passing was higher for students from MGS versus non-MGS under both passive and active learning. The Lower Left quadrant signifies studies where students from MGS were less likely to pass than students from non-MGS under both modes of instruction. The Lower Right quadrant denotes studies where students from MGS were more likely than non-MGS to pass under traditional lecturing but less likely than non-MGS to pass under active learning. Both axes are percent passing and indicate the difference in performance between MGS and non-MGS students.
Fig. 2. The magnitude of achievement gaps in active-learning (AL) versus passive-learning (PL) classes varies among studies. Each data point represents a single course; the majority of active-learning courses narrowed the achievement gap. In both panels, the red dashed 1:1 line indicates no difference in the gap between active and passive learning; the white area above the line indicates courses where the gap narrowed. (A) The Upper Left quadrant indicates studies where gaps in examination scores reversed, from students from non-MGS doing better under lecturing to students from MGS doing better under active learning. The Upper Right quadrant represents studies where gaps in examination scores favored students from MGS under both traditional lecturing and active learning. The Bottom Left quadrant signifies studies where students from non-MGS averaged higher examination scores than students from MGS under both passive and active instruction. The Bottom Right quadrant denotes studies where students from non-MGS outperformed students from MGS under active learning, but students from MGS outperformed students from non-MGS under traditional lecturing. Both axes are in units of SDs and indicate difference in performance between MGS and non-MGS students. (B) The Upper Left quadrant indicates studies where gaps in the probability of passing favored students from non-MGS under lecturing but MGS under active learning. The Upper Right quadrant represents studies where the probability of passing was higher for students from MGS versus non-MGS under both passive and active learning. The Lower Left quadrant signifies studies where students from MGS were less likely to pass than students from non-MGS under both modes of instruction. The Lower Right quadrant denotes studies where students from MGS were more likely than non-MGS to pass under traditional lecturing but less likely than non-MGS to pass under active learning. Both axes are percent passing and indicate the difference in performance between MGS and non-MGS students.CC BY-NC-ND · PubMed Central
Fig. 3. Results appear robust to sampling bias. Funnel plots were constructed with the vertical axis indicating the 95% CI for the difference, under active learning versus lecturing, in (A) examination score gaps or (B) passing rate gaps, and the horizontal axis indicating the change in gaps. The dashed red vertical line shows no change; the solid black line shows the average change across studies. The histograms show data on (C) examination scores (in SDs) and (D) percent passing. The vertical line at 0 shows no change in the achievement gap. If the analyses reported in this study were heavily impacted by the file drawer effect, the distributions in A–D would be strongly asymmetrical, with low density on the lower left of each funnel plot and much less density to the left of the no-change line on the histograms.
Fig. 3. Results appear robust to sampling bias. Funnel plots were constructed with the vertical axis indicating the 95% CI for the difference, under active learning versus lecturing, in (A) examination score gaps or (B) passing rate gaps, and the horizontal axis indicating the change in gaps. The dashed red vertical line shows no change; the solid black line shows the average change across studies. The histograms show data on (C) examination scores (in SDs) and (D) percent passing. The vertical line at 0 shows no change in the achievement gap. If the analyses reported in this study were heavily impacted by the file drawer effect, the distributions in A–D would be strongly asymmetrical, with low density on the lower left of each funnel plot and much less density to the left of the no-change line on the histograms.CC BY-NC-ND · PubMed Central
Fig. 4. Treatment intensity is positively correlated with narrower gaps. High-intensity active-learning courses have narrower achievement gaps between MGS and non-MGS students. In both graphs, points show averages and the vertical bars show 95% Bayesian CIs; the dashed horizontal lines represent no gap in performance. (A) Examination score gap. (B) Gap in percent passing. Intensity is defined as the reported proportion of time students spent actively engaged on in-class activities (SI Appendix, SI Materials and Methods).
Fig. 4. Treatment intensity is positively correlated with narrower gaps. High-intensity active-learning courses have narrower achievement gaps between MGS and non-MGS students. In both graphs, points show averages and the vertical bars show 95% Bayesian CIs; the dashed horizontal lines represent no gap in performance. (A) Examination score gap. (B) Gap in percent passing. Intensity is defined as the reported proportion of time students spent actively engaged on in-class activities (SI Appendix, SI Materials and Methods).CC BY-NC-ND · PubMed Central

Verification

Claims the paper makes

16 Valid · 1 Not valid · 10 Not checked · 59 Own results and interpretations

30 more claims

Create a free account to see all 86 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 30
  • Probably not a substantial claim. 36

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 75 references

Research works printed but not linked: 8

  1. S. F. Reardon, “The widening achievement gap between the rich and the poor: New evidence and possible explanations” in Whither Opportunity? G. J. Duncan, R. J. Murnane, Eds. (Russell Sage Foundation, New York, 2011), pp. 91–115.
  2. National Student Clearinghouse Research Center, High School Benchmarks 2019: National College Progression Rates (National Student Clearinghouse, Herndon, VA, 2019).
  3. X. Chen, STEM Attrition: College Students’ Paths Into and Out of STEM Fields (National Center for Education Statistics, Washington, DC, 2013).
  4. L. S. Vygotsky, Mind in Society (Harvard University Press, Cambridge, MA, 1978).
  5. S. A. Ginder, J. E. Kelly-Reid, F. B. Mann, Enrollment and Employees in Postsecondary Institutions, Fall 2015 (National Center for Education Statistics, Washington, DC, 2017).
  6. J. G. Reed, P. M. Baxter, Using Reference Databases. The Handbook of Research Synthesis and Meta-Analysis, H. Cooper, L. V. Hedges, J. C. Valentine, Eds. (Russell Sage Foundation, New York, 2009), pp. 73–101.
  7. H. Rothstein, S. Hopewell, Grey Literature. The Handbook of Research Synthesis and Meta-Analysis, H. Cooper, L. V. Hedges, J. C. Valentine, Eds. (Russell Sage Foundation, New York, 2009), pp. 103–125.
  8. H. D. White, Scientific Communication and Literature Retrieval. The Handbook of Research Synthesis and Meta-Analysis, H. Cooper, L. V. Hedges, J. C. Valentine, Eds. (Russell Sage Foundation, New York, 2009), pp. 51–71.

Cited by

See all 1,387

Metadata

Authors
Theobald, E. J., Hill, M. J., Tran, E., Agrawal, S., Arroyo, E. N., Behling, S., Chambwe, N., Cintrón, D. L., Cooper, J. D., Dunster, G., Grummer, J. A., Hennessey, K., Hsiao, J., Iranon, N., Jones, L., Jordt, H., Keller, M., Lacey, M. E., Littlefield, C. E., Lowe, A., Newman, S., Okolo, V., Olroyd, S., Peecook, B. R., Pickett, S. B., Slager, D. L., Caviedes-Solis, I. W., Stanchak, K. E., Sundaravardan, V., Valdebenito, C., Williams, C. R., Zinsli, K., & Freeman, S.
Affiliations
  • University of Washington (US)
  • Institute for Systems Biology (US)
  • Shoreline Community College (US)
Corresponding author
  • Theobald, Elli J.
  • Freeman, Scott
Venue
Proceedings of the National Academy of Sciences
Published
2020-03-09
Volume
117
Issue
12
Pages
6476-6483
ISSN
  • 0027-8424 (ISSN-L)
  • 1091-6490
OpenAlex
W3009483010
Cited by
1,387
References
75
Citations by year
2026: 210 · 2025: 222 · 2024: 272 · 2023: 236 · 2022: 233 · 2021: 154 · 2020: 60
FWCI
258.89
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
Funders
University of Washington College of Arts and Sciences (NA)
Topics
  • Social Sciences › Education › Innovative Teaching Methods
  • Social Sciences › Education › Higher Education Research Studies
  • Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
Keywords
active learning, achievement gap, underrepresented students, STEM education, traditional lecturing, course design, student failure rates, test scores, higher education equity, inclusive pedagogy, deliberate practice
MeSH terms
Achievement, Educational Measurement, Engineering, Humans, Mathematics, Minority Groups, Science, Students, Technology, United States, Universities, Problem-Based Learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math. https://app.cochat.ai/papers/10.1073/pnas.1916903117
The paper
Theobald, E. J., Hill, M. J., Tran, E., Agrawal, S., Arroyo, E. N., Behling, S., Chambwe, N., Cintrón, D. L., Cooper, J. D., Dunster, G., Grummer, J. A., Hennessey, K., Hsiao, J., Iranon, N., Jones, L., Jordt, H., Keller, M., Lacey, M. E., Littlefield, C. E., . . . Freeman, S. (2020). Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.1916903117

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.