The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
The Struggle to Pass Algebra: Online vs. Face-to-Face Credit Recovery for At-Risk Urban Students
Abstract
Students who fail algebra are significantly less likely to graduate on time, and algebra failure rates are consistently high in urban districts. Identifying effective credit recovery strategies is critical for getting students back on track. Online courses are now widely used for credit recovery, yet there is no rigorous evidence about the relative efficacy of online versus face-to-face credit recovery courses. To address this gap, this study randomly assigned 1,224 ninth graders who failed algebra in 17 Chicago public high schools to take an online or face-to-face algebra credit recovery course. Compared to students in face-to-face credit recovery, students in online credit recovery reported that the course was more difficult, were less likely to recover credit, and scored lower on an algebra posttest. There were no statistically significant differences by condition on any outcomes measured during the second year of high school (standardized mathematics test and algebra subtest scores, likelihood of passing subsequent math classes, cumulative math credits, or on-track rates). The benefits and challenges of online learning for credit recovery are discussed in light of the findings to date.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most of the survey items were adapted from items used in a study of student engagement (Skinner et al., 2009) or the earlier credit recovery study that took place in Chicago (Heppen et al., 2017).”
From A Multisite Randomized Study of an Online Learning Approach to High School Credit Recovery: Effects on Student Experiences and Proximal Outcomes (2024) · cites this paper as Heppen et al., 2017
In the citing paper
“Both studies focused on students taking credit recovery during the summer between their first and second year of high school but used different online providers and tested different online models.”
From A Multisite Randomized Study of an Online Learning Approach to High School Credit Recovery: Effects on Student Experiences and Proximal Outcomes (2024) · cites this paper as Heppen et al., 2017
In the citing paper
“In Chicago, there was an online instructor and an in-class”
From A Multisite Randomized Study of an Online Learning Approach to High School Credit Recovery: Effects on Student Experiences and Proximal Outcomes (2024) · cites this paper as Heppen et al., 2017
In the citing paper
“This study and the study in Chicago (Heppen et al., 2017) represent the only two experimental tests of online credit recovery.”
From A Multisite Randomized Study of an Online Learning Approach to High School Credit Recovery: Effects on Student Experiences and Proximal Outcomes (2024) · cites this paper as Heppen et al., 2017
Citations
Cites
(2009) · US Department of Education · Cited by 3,654
The effectiveness of online and blended learning: A meta-analysis of the empirical literature
Means, B., Toyama, Y., Murphy, R., & Baki, M. (2013) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811311500307 · Cited by 1,638 · cited 2×
“(2013) reviewed 45 studies of online learning and found that, on average, online instruction yields positive effects relative to f2f instruction (Means et al., 2013).”
BackgroundMcCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317
Disrupting Class: How Disruptive Innovation Will Change the Way the World Learns
Christensen, C. M., Horn, M. B., & Johnson, C. W. (2008) · doi:10.14507/er.v0.1139 · Cited by 1,103
Inverse probability weighted estimation for general missing data problems
Wooldridge, J. M. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2007.02.002 · Cited by 1,029 · cited 1×
“For cases with missing outcome data, we applied inverse probability weights (IPW) to the impact models (Ridgeway, McCaffrey, Morral, Griffin, & Burgette, 2013; Wooldridge, 2007) to account for potential nonresponse bias and improve our ability to generalize results to the target study population.”
MethodDisrupting class: how disruptive innovation will change the way the world learns
(2009) · Choice Reviews Online · doi:10.5860/choice.46-3377 · Cited by 1,000
Indicator and Stratification Methods for Missing Explanatory Variables in Multiple Linear Regression
Jones, M. P. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476680 · Cited by 361
Effectiveness of Cognitive Tutor Algebra I at Scale
Pane, J. F., Griffin, B. A., McCaffrey, D. F., & Karam, R. (2014) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373713507480 · Cited by 317
Allensworth, E. M., & Easton, J. Q. (2013) · Cited by 305
Self-citationToolkit for Weighting and Analysis of Nonequivalent Groups: A tutorial for the twang package
Ridgeway, G. K., McCarey, D., Morral, A. R., Burgette, L. F., & Grin, B. A. (2014) · Cited by 285
Research works printed but not linked: 8
- Allensworth E. M., 2005, The on-track indicator as a predictor of high school graduation
- Atkins, D., Brown, J. S. & Hammond, A. (2007).A review of the Open Educational Resources (OER) movement: Achievement, challenges and new opportunities(Report for the William and Flora Hewlett Foundation). Retrieved from http://www.hewlett.org/uploads/files/ReviewoftheOERMovement.pdf
- Bakia M., 2013, Supporting K–12 students in online learning: A review of online Algebra I courses
- Greaves T. W., 2008, America's digital schools 2008: Six trends to watch
- Helfand D., 2006, Los Angeles Times
- Herlihy C., 2007, State- and district-level supports for successful transition into high school
- Murin A., 2015, Using online learning for credit recovery: Getting back on track to graduation
- Tucker B., 2007, Laboratories of reform: Virtual high schools and innovation in public education
Cited by
Simamora, R. M. (2020) · Studies in Learning and Teaching · doi:10.46627/silet.v1i2.38 · Cited by 424
“Based on previous research, (Heppen et al., 2017) find that online courses are increasingly used for credit recovery in districts across the country, yet there has been little research about the effectiveness of these courses for students who have previously failed.”
BackgroundThe impact of lockdown on the learning gap: family and school divisions in times of crisis
Bonal, X., & González, S. (2020) · International Review of Education · doi:10.1007/s11159-020-09860-z · Cited by 308
“Furthermore, student outcomes resulting from online learning have been shown to be poorer, on average, than outcomes resulting from face-to-face instruction (Heppen et al. 2017).”
BackgroundTate, T., & Warschauer, M. (2022) · Educational Psychologist · doi:10.1080/00461520.2022.2062597 · Cited by 167
“For example, a randomized control trial of 1,224 9th-grade students in online versus face-to-face credit recovery for atrisk urban students in summer (Heppen et al., 2017) found that the online students reported the course was more difficult (d1⁄4 0.”
BackgroundOnline Learning, Offline Outcomes: Online Course Taking and High School Student Performance
Hart, C. M. D., Berger, D., Jacob, B., Loeb, S., & Hill, M. (2019) · AERA Open · doi:10.1177/2332858419832852 · Cited by 140
“At first blush, our credit recovery results seem considerably more positive than the results of online credit recovery in previous randomized controlled trials (Heppen et al., 2017).”
BackgroundResultInfluentialGoldhaber, D. D., Imberman, S. A., Strunk, K. O., Hopkins, B., Brown, N., Harbatkin, E., & Kilbride, T. (2021) · National Bureau of Economic Research · doi:10.3386/w28455 · Cited by 60
“This is especially true for lower performing students (Hart et al., 2019; Heppen et al., 2017; Loeb, 2020) .”
Background
Metadata
- Authors
- Heppen, J. B., Sorensen, N., Allensworth, E., Walters, K., Rickles, J., Taylor, S. S., & Michelman, V.
- Affiliations
- American Institutes for Research (US)
- University of Chicago (US)
- American Institutes for Research, Washington, DC, USA
- Corresponding author
- Heppen, Jessica B.
- Venue
- Journal of Research on Educational Effectiveness
- Publisher
- Informa UK Limited
- Published
- 2016-03-30
- Volume
- 10
- Issue
- 2
- Pages
- 272-296
- ISSN
- 1934-5739 (ISSN-L)
- 1934-5747
- OpenAlex
- W2323182592
- Cited by
- 101
- References
- 33
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 5 · 2023: 15 · 2022: 16 · 2021: 33 · 2020: 8 · 2019: 12 · 2018: 3 · 2017: 1
- FWCI
- 23.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Research on Educational Effectiveness (publishedVersion)
- Topics
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › School Choice and Performance
- Social Sciences › Education › Mathematics Education and Programs
- Keywords
- credit recovery, online learning, face-to-face teaching, at-risk students, urban high schools, ninth grade students, mathematics achievement, course difficulty, Chicago Public Schools
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Struggle to Pass Algebra: Online vs. Face-to-Face Credit Recovery for At-Risk Urban Students. https://app.cochat.ai/papers/10.1080/19345747.2016.1168500
- The paper
- Heppen, J. B., Sorensen, N., Allensworth, E., Walters, K., Rickles, J., Taylor, S. S., & Michelman, V. (2017). The Struggle to Pass Algebra: Online vs. Face-to-Face Credit Recovery for At-Risk Urban Students. Journal of Research on Educational Effectiveness. https://doi.org/10.1080/19345747.2016.1168500
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.