Cited by 31Education during COVID-19 pandemicCOVID-19 Pandemic ImpactsSchool Choice and Performance

Impacts of the COVID-19 Pandemic on Student Learning and Opportunity Gaps Across the 2020–2021 School Year: A National Survey of Teachers

Open access
Namkung, Jessica M., Goodrich, John Marc, Hebert, Michael, Koziol, Natalie·2022·Frontiers in Education

Abstract

Although many school districts made efforts to provide instruction during the COVID-19 pandemic (including in-person, remote, and blended/hybrid options the length of instruction time and delivery models have varied from district to district. This disruption in education has been projected to result in a significant learning loss, which may be particularly profound for students from disadvantaged backgrounds, leading to widening opportunity gaps. However, there is limited empirical data that can provide important contextual background for understanding the impact of the pandemic on student learning. Therefore, we conducted a national survey with a random sample of 582 elementary school teachers to understand the instructional changes that occurred, the amount of academic content instruction provided to students, and teachers perceptions of the learning supports needed and provided to students during the 2020–2021 school year. Results indicated that most teachers relied on alternative forms of instruction and experienced changes in delivery models but reported low instructional effectiveness. Compared to typical years, teachers reported significant decreases in curriculum coverage; the number of students who received needed interventions, and students who were ready to transition to the next grade level during the 2020–2021 school year. Teachers also reported greater impacts on instruction for students from disadvantaged backgrounds. Follow-up analyses using prior school achievement data corroborated the findings that higher school achievement was associated with smaller impacts on student learning and delivery of instruction.

AI snapshot

Written from the paper’s full text.

TL;DR

A national survey of 582 U.S. elementary teachers found that the 2020–2021 school year brought major instructional-model changes, reduced curriculum coverage, fewer students receiving needed interventions, and lower readiness to transition to the next grade compared with typical years. Teachers reported disproportionately greater negative impacts for students from low-income backgrounds, students with IEPs, and English language learners, with higher school achievement and more in-person instruction associated with smaller reported impacts.

Key findings

  • Instructional models shifted substantially: at the start of 2020–2021, 46.7% of schools offered 100% remote instruction, 30.9% in-person with a remote option, 12.1% hybrid, and 8.6% 100% in-person; by the end, 65.2% offered in-person with a remote option, 16.5% 100% in-person, 13.0% hybrid, and 2.6% 100% remote, with about 60% of teachers experiencing a model change.
  • Curriculum coverage fell sharply: teachers able to cover more than 80% of planned curriculum dropped from 93.3% to 43.8% in reading, 92.8% to 53.2% in mathematics, and 79.5% to 30.9% in writing; 85.4% attributed the change to the pandemic.
  • Fewer students received needed support/intervention: reading fell from 74.9% to 44.3%, mathematics from 71.2% to 49.2%, and writing from 70.2% to 41.9%. Readiness to transition also declined: 68.9% of teachers reported at least 80% of students ready in typical years versus 31.9% in 2020–2021; the authors estimated 32.4% of students were not ready versus 13.9% in previous years, or nearly 3.9 million more students not ready.
  • Teachers rated greater pandemic impacts for students from low-income backgrounds (M = 7.74 vs. 4.83), students with IEPs (M = 7.43 vs. 5.51), and English language learners (M = 7.31 vs. 5.45), all p < 0.001; higher SEDA school achievement and more in-person instruction were associated with smaller negative impacts and greater curriculum coverage.

Methods

  • A national random sample of K-5 teachers was surveyed via Qualtrics; after excluding 289 invalid emails, 9,476 teachers were invited, 595 consented, 13 were excluded for answering no questions, leaving N = 582, with a ±4.1% margin of error at 95% confidence and a 6.14% response rate.
  • The 59-item survey covered teacher/classroom demographics, instructional models, curriculum coverage in reading/mathematics/writing, students needing and receiving extra support, student readiness for transition, perceived pandemic impacts, and remote-instruction effectiveness.
  • Analyses included descriptive statistics, t-tests, zero-order correlations, regression models controlling for typical-year curriculum coverage, and logistic regressions; SEDA school achievement data were available for 490 teachers and covariate data for 515.

Limitations

  • Stated by the paper: the response rate was low, so selection bias is possible despite responders and non-responders being similar on key demographic variables; teachers may have under- or over-estimated classroom variables or been unaware of some services provided by resource and special education teachers.
  • Evident from the text: the study relies on teacher-report perceptions rather than direct student achievement measures, and the analyses are correlational, so causal claims about instructional models or school achievement cannot be established.
  • Evident from the text: SEDA achievement data were averaged over 2008–2009 to 2017–2018, so they are prior school achievement rather than contemporaneous 2020–2021 achievement; the sample also over-represented teachers with over 20 years of experience (32.3% vs. 22.4% nationally) and had regional under-/over-representation.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3389/feduc.2022.921497

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

5 of 21 cited sources checked · 5 supported · 0 flagged

  • Premisecitation

    The learning loss was up to 60% greater among students from disadvantaged backgrounds (less-educated households) in the Netherlands.

    “However, the learning loss was up to 60% greater among students from disadvantaged backgrounds (i.e., students from less-educated households), indicating the disproportionate impact of the pandemic on student learning.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Engzell et al. (2021) source
  • Premisecitation

    Engzell et al. (2021) found a learning loss equivalent to 3 percentile points in the Netherlands despite the relatively short lockdown.

    “Results indicated a learning loss equivalent to 3 percentile points despite the relatively short lockdown.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Engzell et al. (2021) source
  • Findingown data

    Most teachers relied on alternative forms of instruction during the 2020-2021 school year.

    “Results indicated that most teachers relied on alternative forms of instruction and experienced changes in delivery models but reported low instructional effectiveness.”
    Quote in the paperSubstantial claim
  • Findingown data

    Most teachers experienced changes in delivery models during the 2020-2021 school year.

    “Results indicated that most teachers relied on alternative forms of instruction and experienced changes in delivery models but reported low instructional effectiveness.”
    Quote in the paperSubstantial claim
  • Findingown data

    Teachers rated significantly greater impacts for English language learners (M = 7.31, SD = 2.88) compared to non-English language learners (M = 5.45, SD = 2.84), t(389) = 13.78, p < 0.001.

    “Finally, teachers rated significantly greater impacts for English language learners (M = 7.31, SD = 2.88) compared to non-English language learners (M = 5.45, SD = 2.84), t(389) = 13.78,p < 0.001.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 27
  • May combine two claims. 32
  • The quote only partly states this claim. 1
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Students' academic motivation and participation in extracurricular activities, as perceived by their parents, decreased significantly during the COVID-19 pandemic.

    “Moreover, students' academic motivation and participation in extracurricular activities, as perceived by their parents, decreased significantly during the COVID-19 pandemic (Zaccoletti et al., 2020).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Zaccoletti et al., 2020 source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Several studies have demonstrated that student achievement has been lower during the pandemic compared to prior to the pandemic, with estimates ranging from three percentile points in the Netherlands to more than half of a school year in the U.S. state of Illinois.

    “Several studies have demonstrated that student achievement has been lower during the pandemic compared to prior to the pandemic, with estimates ranging from three percentile points in the Netherlands (Engzell et al., 2021) to more than half of a school year in the U.S. state of Illinois (Streich et al., 2021).”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites Engzell et al., 2021 source
    • cites Streich et al., 2021

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Kaffenberger (2021) projected that short-term and long-term efforts can reduce/remediate learning loss.

    “Kaffenberger (2021) projected that short-term (e.g., covering previous year's curriculum before revering to the pre-pandemic curriculum) and long-term efforts (e.g., identifying students' needs using formative assessments, adapting teacher instruction to students' levels and needs) can reduce/remediate the learning loss.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Kaffenberger (2021) source
  • May combine two claims. The quote only partly states this claim.

    Findingown data

    Teachers indicated that distractions in students' homes (71.1%), internet access/availability (61.0%), student attendance (60.8%), lack of face-to-face interactions with students (57.7%), difficulty with evaluating student work (55.7%), difficulty with monitoring student progress (48.8%), managing remote and in-person instruction simultaneously (42.6%), and difficulty with providing feedback on学生?

    “Teachers also indicated that distractions in students' homes (71.1%), internet access/availability (61.0%), student attendance (60.8%), lack of face-to-face interactions with students (57.7%), difficulty with evaluating student work (55.7%), difficulty with monitoring student progress (48.8%), managing remote and in-person instruction simultaneously (42.6%), and difficulty with providing feedback”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Our survey results indicated that most teachers relied on alternative forms of instruction and experienced changes during the 2020-2021 school year.

    “Our survey results indicated that most teachers relied on alternative forms of instruction and experienced changes during the 2020-2021 school year.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The majority of other responses included having parental support at home and students' access to better technology (internet access, remote instruction platform support), and having a teacher dedicated to remote instruction.

    “The majority of other responses included having parental support at home and students' access to better technology (internet access, remote instruction platform support), and having a teacher dedicated to remote instruction.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    At the end of the 2020-2021 school year, most schools offered in-person instruction with an option for remote instruction (65.2%), followed by 100% in-person (16.5%), hybrid (13.0%), and 100% remote (2.6%).

    “At the end of the school year, most schools offered in-person instruction with an option for remote instruction (65.2%), followed by 100% in-person (16.5%), hybrid (13.0%), and 100% remote (2.6%) instruction.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Whereas 68.9% of teachers indicated at least 80% of their students being ready to transition to the next grade in typical years, only about 31.9% reported at least 80% of their students were ready at the end of the 2020-2021 school year.

    “Whereas 68.9% of teachers indicated at least 80% of their students being ready to transition to the next grade in typical years, only about 31.9% of teachers reported at least 80% of their students were ready to transition to the next grade at the end of the 2020-2021 school year.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Approximately 75% of teachers indicated that there were also some positives that came out of the pandemic, including increases in student conscientiousness, prioritization of some academic content, and systems that resulted in more individual attention.

    “Approximately 75% of teachers indicated that there were also some positives that came out of the pandemic, including increases in student conscientiousness, prioritization of some academic content, and systems that resulted in more individual attention.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Using average reported class sizes and teacher responses for students not ready to transition to the next grade level, the authors estimated that 32.4% of students were not ready to transition, as compared to 13.9% in previous years (an increase of 18.5%).

    “Using average reported class sizes and teacher responses for students not ready to transition to the next grade level, we estimated that 32.4% of students were not ready to transition, as compared to 13.9% in previous years (an increase of 18.5%).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.
  • May combine two claims.

    Findingown data

    Use of a 100% in-person instructional model was only significant for mathematics, indicating that teachers who reported using more 100% in-person instruction were less likely to report having students who needed extra mathematics intervention but did not receive it; however, the magnitude of this effect was small.

    “Use of a 100% inperson instructional model was only significant for mathematics, indicating that teachers who reported using more 100% inperson instruction were less likely to report having students who needed extra mathematics intervention but did not receive it; however, the magnitude of this effect was small.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Percentage of time using a 100% in-person instructional model validly measures in-person instruction.
    • Rests on an assumption: Teacher reports of curriculum coverage in typical years accurately reflect typical years.
  • May combine two claims.

    Findingown data

    Other challenges included a lack of parental support/involvement, lack of student engagement, and parents or other household members completing student assignments or assessments.

    “Other challenges included a lack of parental support/involvement, lack of student engagement, and parents or other household members completing student assignments or assessments.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingnone given

    Along with learning losses, many teachers report not covering as much of the academic curricula for students, especially in schools with lower achievement levels.

    “Along with learning losses, many teachers report not covering as much of the academic curricula for students, especially in schools with lower achievement levels.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.
  • May combine two claims.

    Findingown data

    Teachers indicated that some positive takeaways during the 2020-2021 school year were students being more conscientious (68.6%), greater ability to provide individualized attention due to reduced class sizes or alternating days (21.6%), and more time for students to participate in academics due to reductions in extracurricular activities (21.1%).

    “Despite these challenges, teachers indicated that some positive takeaways during the 2020-2021 school year were students being more conscientious (68.6%), greater ability to provide individualized attention due to reduced class sizes or alternating days (21.6%), and more time for students to participate in academics due to reductions in extracurricular activities (21.1%).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Teachers indicated that having a lower teacher-student ratio would contribute to successful remote instruction (61.7%), followed by the structures and scheduling of remote instruction (52.6%), training opportunities (45%), and support personnel (e.g., paraprofessionals, 38.5%).

    “Teachers indicated that having a lower teacher-student ratio would contribute to successful remote instruction (61.7%) followed by the structures and scheduling of remote instruction (52.6%), training opportunities (45%), and support personnel (e.g., paraprofessionals, 38.5%).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The results of this survey suggest that most teachers were not able to cover at least 80% of their reading, writing, and mathematics curriculum, which was significantly lower than their reported ability to cover 80% of the curriculum in previous years.

    “The results of this survey suggest that most teachers were not able to cover at least 80% of their reading, writing, and mathematics curriculum, which was significantly lower than their reported ability to cover 80% of the curriculum in previous years.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.
  • May combine two claims.

    Findingown data

    Both school achievement and percentage of time using a 100% in-person instructional model were significantly predictive of overall impacts of the pandemic and teacher reported coverage of the reading, writing, and mathematics curriculum, even after controlling for teacher reported coverage of the curriculum in typical years.

    “Both school achievement and percentage of time using a 100% in-person instructional model were significantly predictive of overall impacts of the pandemic and teacher reported coverage of the reading, writing, and mathematics curriculum, even after controlling for teacher reported coverage of the curriculum in typical years.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: SEDA school mean achievement validly measures school achievement.
    • Rests on an assumption: Percentage of time using a 100% in-person instructional model validly measures in-person instruction.
    • Rests on an assumption: Teacher reports of curriculum coverage in typical years accurately reflect typical years.
    • Rests on an assumption: The COVID-19 pandemic caused the observed negative impacts on learning and curriculum coverage, rather than other factors.
  • May combine two claims.

    Findingown data

    Our regression analyses corroborate these findings across schools as well, as higher school achievement was associated with smaller negative impacts on the curriculum coverage and fewer students requiring additional intervention.

    “Our regression analyses corroborate these findings across schools as well, as higher school achievement was associated with smaller negative impacts on the curriculum coverage and fewer students requiring additional intervention.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: SEDA school mean achievement validly measures school achievement.
    • Rests on an assumption: Teacher reports of curriculum coverage in typical years accurately reflect typical years.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Kuhfeld et al. (2020) projected that students who did not have access to remote instruction (3 months) in spring 2020 would begin fall 2020 with only 37% to 68% of typical learning gains in reading and mathematics.

    “Kuhfeld et al. (2020) projected that students who did not have access to remote instruction (3 months) in spring 2020 would begin fall 2020 with only 37% to 68% of typical learning gains in reading and mathematics, and some students may be up to one year behind in mathematics.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kuhfeld et al. (2020) source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Prior studies have found that family, school, and peer support increases student engagement, which in turn improves academic competence and achievement.

    “Additionally, prior studies have found that family, school, and peer support increases student engagement, which in turn improves academic competence and achievement (e.g., Elias and Haynes, 2008;Estell and Perdue, 2013).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Elias and Haynes, 2008 source
    • cites Estell and Perdue, 2013 source
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    The current literature and understanding of the impact of the pandemic on student learning is primarily based on model-based projections and limited empirical data comparing student performance prior to and after the lockdown.

    “However, the current literature and our understanding of the impact of the pandemic on student learning is primarily based on model-based projections and limited empirical data comparing student performance prior to and after the lockdown.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Achievement scores on state assessments for students in grades 4 to 8 in 17 school districts in Illinois indicated that students scored significantly lower than expected in mathematics compared to prior to the pandemic, resulting in learning losses as large as 56% of a school year.

    “Similarly, achievement scores on state assessments for students in grades 4 to 8 in 17 school districts in Illinois indicated that students scored significantly lower than expected in mathematics compared to prior to the pandemic, resulting in a learning losses as large as 56% of a school year (Streich et al., 2021).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Streich et al., 2021

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationcitation

    Consistent with teachers' reports in our survey, as well as in Goodrich et al. (2022), more systematic training for school personnel is needed to improve the quality of remote instruction.

    “Consistent with teachers' reports in our survey, as well as in Goodrich et al. (2022), more systematic training for school personnel is needed to improve the quality of remote instruction.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Goodrich et al. (2022) source

      Checked before — its earlier verdict is held back until a new check runs.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Study design and conductnone given

    It is possible that the teachers may have under- or over-estimated other descriptive variables for their classrooms or were unaware of some of the school services provided by resource and special education teachers.

    “It is also possible that the teachers may have under-or over-estimated other descriptive variables for their classrooms or were unaware of some of the school services provided by resource and special education teachers.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    Schools in the United States have a large problem on their hands.

    “Schools in the United States have a large problem on their hands.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    This has likely compounded learning losses already realized during school shutdowns in spring 2020, and some schools still may not be fully covering the academic curriculum in the 2021-2022 school year.

    “This is alarming because it has likely compounded learning losses already realized during school shutdowns in spring of 2020, and some schools still may not be fully covering the academic curriculum in the 2021-2022 school year.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationown data

    Our findings add to the literature in an important way by providing teachers with an opportunity to identify other factors that may have contributed to their ability to cover the curricula and support their students.

    “Our findings also add to the literature in an important way by providing teachers with an opportunity to identify other factors that may have contributed to their ability to cover the curricula and support their students.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Even students who received remote instruction in spring 2020 were projected to begin fall 2020 with 60% to 87% of their typical learning gains.

    “Even students who received remote instruction in spring 2020 were projected to begin fall 2020 with 60% to 87% of their typical learning gains.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Such support from family, school, and peers may be especially important for students from disadvantaged backgrounds.

    “Such support from family, school, and peers may be especially important for students from disadvantaged backgrounds (Elias and Haynes, 2008).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Elias and Haynes, 2008 source
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning

    This is an ongoing problem that is likely to be exacerbated, and it will likely continue to widen the opportunity gaps for minoritized students, low-income students, and students with disabilities.

    “This is an ongoing problem that is likely to be exacerbated, and it will likely continue to widen the opportunity gaps for minoritized students, lowincome students, and students with disabilities.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    Although responders and non-responders were similar in key demographic variables (e.g., SES, school setting, school type, grade level taught), it is possible that low response rate resulted in selection bias.

    “Although responders and non-responders were similar in key demographic variables (e.g., SES, school setting, school type, grade level taught), it is possible that low response rate resulted in selection bias.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    Higher school achievement and more use of a 100% in-person instructional model were associated with smaller negative impacts of the pandemic and greater coverage of academic curricula.

    “Higher school achievement and more use of a 100% in-person instructional model were associated with smaller negative impacts of the pandemic and greater coverage of academic curricula.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: SEDA school mean achievement validly measures school achievement.
    • Rests on an assumption: Percentage of time using a 100% in-person instructional model validly measures in-person instruction.
    • Rests on an assumption: The COVID-19 pandemic caused the observed negative impacts on learning and curriculum coverage, rather than other factors.
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationcitation

    Student engagement during remote instruction may be critical to promoting successful remote learning.

    “As much as in-person school engagement is important to academic achievement and school completion, student engagement during remote instruction may be critical to promoting successful remote learning.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    The pandemic is not over, and with the continued struggle with COVID variants in 2022, students may be falling even further behind.

    “Yet, the pandemic is not over, and with the continued struggle with the COVID variants in 2022 currently, students may be falling even further behind.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Instructional challenges related to COVID-19 are likely to have resulted in less content coverage when school has been in session, compounding learning losses.

    “However, instructional challenges related to COVID-19 are also likely to have resulted in less content coverage when school has been in session, compounding the losses.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The pandemic is projected to exacerbate existing opportunity gaps by 15% to 20%.

    “Dorn et al. (2020) projected that lowincome students would experience 12.4 months of learning loss compared to the overall average learning loss of 6.8 months, exacerbating the existing opportunity gaps by 15% to 20%.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dorn et al. (2020)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    With 21.2 million K-5 students attending school in 2020, nearly 3.9 million more students (6.8 million total) were not ready to transition to the next grade.

    “With 21.2 million K-5 students attending school in 2020 (National Center for Education Statistics, 2021), this means nearly 3.9 million more students (6.8 million total) were not ready to transition to the next grade”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites National Center for Education Statistics, 2021

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • Rests on an assumption: Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.
  • May combine two claims.

    Interpretationown data

    Teachers who used more in-person instruction reported smaller impacts of the pandemic on their ability to cover the curriculum and the percentage of students who needed supplemental intervention for academic skills instruction.

    “indicating that teachers who used more in-person instruction reported smaller impacts of the pandemic on their ability to cover the curriculum and the percentage of students who needed supplemental intervention for academic skills instruction.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    This can offer Federal and State Departments of Education with areas of opportunity for providing teachers with support, funding, or intervention resources.

    “This can offer Federal and State Departments of Education with areas of opportunity for providing teachers with support, funding, or intervention resources.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationown data

    This finding suggests that continued development of high-quality online educational learning and support is needed.

    “This finding suggests that continued development of highquality online educational learning and support is also needed.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Prior research indicated student achievement slows down or even declines over summer breaks.

    “prior research indicated student achievement slows down or even declines over the summer breaks (e.g., von Hippel et al., 2018;Kuhfeld, 2019).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites von Hippel et al., 2018 source
    • cites Kuhfeld, 2019 source
  • May combine two claims.

    Interpretationown data

    This may have played a role in the reported curriculum coverage and associated learning losses, as our results indicated that the amount of in-person instruction significantly contributed to teachers' ability to cover the curriculum.

    “This may have played a role in the reported curriculum coverage and associated learning losses, as our results indicated that the amount of in-person instruction significantly contributed to teachers' ability to cover the curriculum.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Percentage of time using a 100% in-person instructional model validly measures in-person instruction.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Only one teacher from each school was selected to maximize the number of schools.

    “We made sure that only one teacher from each school was selected to maximize the number of schools.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductown data

    The survey used a representative random sample of K-5 educator email addresses proportionally reflective of the number of teachers in each grade (K-5) and representative of the distribution of the United States population across geographic regions.

    “For survey distribution, we obtained a representative random sample of K-5 educator email addresses that was proportionally reflective of the number of teachers in each grade (K-5) as well as representative of the distribution of the United States population across different geographic regions survey distribution from Market Data Retrieval (MDR).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    The COVID-19 induced economic damage and educational budget cuts are likely to have a greater impact on students from disadvantaged backgrounds.

    “Moreover, the COVID-19 induced economic damage and educational budget cuts are likely to have a greater impact on students from disadvantaged backgrounds.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Dorn et al. (2020) projected that low-income students would experience 12.4 months of learning loss compared to the overall average learning loss of 6.8 months.

    “Dorn et al. (2020) projected that lowincome students would experience 12.4 months of learning loss compared to the overall average learning loss of 6.8 months, exacerbating the existing opportunity gaps by 15% to 20%.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dorn et al. (2020)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Study design and conductown data

    After correcting for Type I error rate, the Mid-Atlantic and South-Central regions were significantly under-represented in survey responders, whereas the Mountain and North-Central regions were significantly over-represented among survey responders.

    “After correcting for Type I error rate, there were some statistically significant differences by geographic region.The Mid-Atlantic and South-Central regions were significantly under-represented in survey responders, whereas the Mountain and North-Central regions were significantly over-represented among survey responders.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductown data

    The final sample consisted of 582 teachers, providing a ±4.1% margin of error with a 95% confidence interval.

    “The final sample consisted of 582 teachers, providing this survey with a ± 4.1% margin of error with a 95% confidence interval.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data

    Regression models predicting the amount of curriculum covered in the 2020-2021 school year controlled for teacher reports of the amount of curriculum covered in typical years.

    “Regression models predicting amount of curriculum covered in the 2020-2021 school year controlled for teacher reports of the amount of curriculum covered in typical years.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Teacher reports of curriculum coverage in typical years accurately reflect typical years.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Zhu and Liu (2020) called for more quantitative and qualitative research to evaluate remote teaching and learning, and long-term sustainability.

    “Moreover, Zhu and Liu (2020) called for more quantitative and qualitative research to evaluate remote teaching and learning, and long-term sustainability.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Zhu and Liu (2020) source

      Checked before — its earlier verdict is held back until a new check runs.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    There were likely disproportionate impacts on minoritized students.

    “with likely disproportionate impacts on minoritized students.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Substantial restructuring of current pre-pandemic curricula may be inevitable to minimize the compounded effects.

    “Therefore, substantial restructuring of current pre-pandemic curricula may be inevitable to minimize the compounded effects.”
    Quote in the paperNot a substantial claim
52 of 52
  • The authors state this as an assumption.

    Learning losses from COVID-19 school closures could be similar to losses experienced during other breaks from school.

    “The assumption is that learning losses could be similar to losses experienced during other breaks from school.”
  • The paper relies on this without support.

    Teacher reports of instructional changes and student outcomes accurately reflect actual instructional changes and student learning.

    “we conducted a national survey with a random sample of 582 elementary school teachers to understand the instructional changes that occurred, the amount of academic content instruction provided to students, and teachersŠ perceptions of the learning supports needed and provided to students during the 2020-2021 school year.”
  • The paper relies on this without support.

    SEDA school-level achievement averaged over 2008-2009 to 2017-2018 is a valid measure of prior school achievement for the 2020-2021 school year.

    “SEDA school-level mean mathematics and English language arts achievement data were available for 490 teachers, and covariate data were available for 515 teachers who responded to our survey.”
  • The paper relies on this without support.

    Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.

    “Using average reported class sizes and teacher responses for students not ready to transition to the next grade level, we estimated that 32.4% of students were not ready to transition”
  • The paper relies on this without support.

    SEDA school mean achievement validly measures school achievement.

    “including SEDA school mean achievement and percentage of time in which a 100% in-person instructional model was used.”
  • The paper relies on this without support.

    Percentage of time using a 100% in-person instructional model validly measures in-person instruction.

    “percentage of time using a 100% in-person instructional model”
  • The paper relies on this without support.

    Teacher reports of curriculum coverage in typical years accurately reflect typical years.

    “controlled for teacher reports of the amount of curriculum covered in typical years.”
  • The paper relies on this without support.

    The COVID-19 pandemic caused the observed negative impacts on learning and curriculum coverage, rather than other factors.

    “Both school achievement and percentage of time using a 100% in-person instructional model were significantly predictive of overall impacts of the pandemic”
8 of 8

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Consistentt(457) = 24.04reported p < .001 · recomputed p < .001

    “t(457) = 24.04,p < .001”

  • Consistentt(455) = 15.64reported p < .001 · recomputed p < .001

    “t(455) = 15.64,p < .001”

  • Consistentt(389) = 13.78reported p < .001 · recomputed p < .001

    “t(389) = 13.78,p < .001”

  • Consistentt(432) = -10.17reported p < .001 · recomputed p < .001

    “t(432) = -10.17,p < .001”

  • Consistentt(421) = -11.22reported p < .001 · recomputed p < .001

    “t(421) = -11.22,p < .001”

  • Consistentt(356) = -9.13reported p < .001 · recomputed p < .001

    “t(356) = -9.13,p < .001”

6 of 6

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Discussion misstates the majority finding for mathematics curriculum coverage

    Minor

    The discussion says most teachers could not cover at least 80% of the curriculum in all three subjects. The results instead say 53.2% covered more than 80% of the mathematics curriculum, so a majority met that threshold in mathematics.

1 of 1

Cites

Flagged first, then by citations

Research works printed but not linked: 4

  1. Dorn, 2020, COVID-19 and Student Learning in the United States: The Hurt Could last a Lifetime.
  2. Hussar, 2020, The Condition of Education 2020 (NCES2020-144). U.S. Department of Education.
  3. 2021, State Nonfiscal Survey of Public Elementary/Secondary Education, 1999–2000 Through 2019–20 and 2020–21 Preliminary.
  4. Reardon, 2021, Stanford Education Data Archive (Version 4.1).

Cited by

Sorted by citations

Authors
Namkung, J. M., Goodrich, J. M., Hebert, M., & Koziol, N.
Affiliations
  • University of Delaware (US)
  • Texas A&M University (US)
  • University of California, Irvine (US)
  • University of Nebraska–Lincoln (US)
Corresponding author
Namkung, Jessica M.
Venue
Frontiers in Education
Published
2022-07-07
Volume
7
ISSN
2504-284X (ISSN-L)
OpenAlex
W4284706930
Cited by
31
References
20
Citations by year
2026: 4 · 2025: 14 · 2024: 9 · 2023: 4
FWCI
11.07
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Education (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • EdArXiv (OSF Preprints) (submittedVersion)
  • EdArXiv (OSF Preprints) (submittedVersion, public-domain)
Topics
  • Social Sciences › Education › Education during COVID-19 pandemic
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › COVID-19 Pandemic Impacts
  • Social Sciences › Education › School Choice and Performance
Keywords
COVID-19 pandemic, student learning loss, opportunity gap, primary school teachers, curriculum coverage, academic intervention, disadvantaged students, teacher perceptions, academic performance, 2020-2021 academic year

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-11-06.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-11-06.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review