Impacts of the COVID-19 Pandemic on Student Learning and Opportunity Gaps Across the 2020–2021 School Year: A National Survey of Teachers
Open accessAbstract
Although many school districts made efforts to provide instruction during the COVID-19 pandemic (including in-person, remote, and blended/hybrid options the length of instruction time and delivery models have varied from district to district. This disruption in education has been projected to result in a significant learning loss, which may be particularly profound for students from disadvantaged backgrounds, leading to widening opportunity gaps. However, there is limited empirical data that can provide important contextual background for understanding the impact of the pandemic on student learning. Therefore, we conducted a national survey with a random sample of 582 elementary school teachers to understand the instructional changes that occurred, the amount of academic content instruction provided to students, and teachers perceptions of the learning supports needed and provided to students during the 2020–2021 school year. Results indicated that most teachers relied on alternative forms of instruction and experienced changes in delivery models but reported low instructional effectiveness. Compared to typical years, teachers reported significant decreases in curriculum coverage; the number of students who received needed interventions, and students who were ready to transition to the next grade level during the 2020–2021 school year. Teachers also reported greater impacts on instruction for students from disadvantaged backgrounds. Follow-up analyses using prior school achievement data corroborated the findings that higher school achievement was associated with smaller impacts on student learning and delivery of instruction.
AI snapshot
Written from the paper’s full text.
TL;DR
A national survey of 582 U.S. elementary teachers found that the 2020–2021 school year brought major instructional-model changes, reduced curriculum coverage, fewer students receiving needed interventions, and lower readiness to transition to the next grade compared with typical years. Teachers reported disproportionately greater negative impacts for students from low-income backgrounds, students with IEPs, and English language learners, with higher school achievement and more in-person instruction associated with smaller reported impacts.
Key findings
- Instructional models shifted substantially: at the start of 2020–2021, 46.7% of schools offered 100% remote instruction, 30.9% in-person with a remote option, 12.1% hybrid, and 8.6% 100% in-person; by the end, 65.2% offered in-person with a remote option, 16.5% 100% in-person, 13.0% hybrid, and 2.6% 100% remote, with about 60% of teachers experiencing a model change.
- Curriculum coverage fell sharply: teachers able to cover more than 80% of planned curriculum dropped from 93.3% to 43.8% in reading, 92.8% to 53.2% in mathematics, and 79.5% to 30.9% in writing; 85.4% attributed the change to the pandemic.
- Fewer students received needed support/intervention: reading fell from 74.9% to 44.3%, mathematics from 71.2% to 49.2%, and writing from 70.2% to 41.9%. Readiness to transition also declined: 68.9% of teachers reported at least 80% of students ready in typical years versus 31.9% in 2020–2021; the authors estimated 32.4% of students were not ready versus 13.9% in previous years, or nearly 3.9 million more students not ready.
- Teachers rated greater pandemic impacts for students from low-income backgrounds (M = 7.74 vs. 4.83), students with IEPs (M = 7.43 vs. 5.51), and English language learners (M = 7.31 vs. 5.45), all p < 0.001; higher SEDA school achievement and more in-person instruction were associated with smaller negative impacts and greater curriculum coverage.
Methods
- A national random sample of K-5 teachers was surveyed via Qualtrics; after excluding 289 invalid emails, 9,476 teachers were invited, 595 consented, 13 were excluded for answering no questions, leaving N = 582, with a ±4.1% margin of error at 95% confidence and a 6.14% response rate.
- The 59-item survey covered teacher/classroom demographics, instructional models, curriculum coverage in reading/mathematics/writing, students needing and receiving extra support, student readiness for transition, perceived pandemic impacts, and remote-instruction effectiveness.
- Analyses included descriptive statistics, t-tests, zero-order correlations, regression models controlling for typical-year curriculum coverage, and logistic regressions; SEDA school achievement data were available for 490 teachers and covariate data for 515.
Limitations
- Stated by the paper: the response rate was low, so selection bias is possible despite responders and non-responders being similar on key demographic variables; teachers may have under- or over-estimated classroom variables or been unaware of some services provided by resource and special education teachers.
- Evident from the text: the study relies on teacher-report perceptions rather than direct student achievement measures, and the analyses are correlational, so causal claims about instructional models or school achievement cannot be established.
- Evident from the text: SEDA achievement data were averaged over 2008–2009 to 2017–2018, so they are prior school achievement rather than contemporaneous 2020–2021 achievement; the sample also over-represented teachers with over 20 years of experience (32.3% vs. 22.4% nationally) and had regional under-/over-representation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
5 of 21 cited sources checked · 5 supported · 0 flagged
- Premisecitation
The learning loss was up to 60% greater among students from disadvantaged backgrounds (less-educated households) in the Netherlands.
“However, the learning loss was up to 60% greater among students from disadvantaged backgrounds (i.e., students from less-educated households), indicating the disproportionate impact of the pandemic on student learning.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Engzell et al. (2021) source
- Premisecitation
Engzell et al. (2021) found a learning loss equivalent to 3 percentile points in the Netherlands despite the relatively short lockdown.
“Results indicated a learning loss equivalent to 3 percentile points despite the relatively short lockdown.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Engzell et al. (2021) source
- Findingown data
Most teachers relied on alternative forms of instruction during the 2020-2021 school year.
“Results indicated that most teachers relied on alternative forms of instruction and experienced changes in delivery models but reported low instructional effectiveness.”
Quote in the paperSubstantial claim - Findingown data
Most teachers experienced changes in delivery models during the 2020-2021 school year.
“Results indicated that most teachers relied on alternative forms of instruction and experienced changes in delivery models but reported low instructional effectiveness.”
Quote in the paperSubstantial claim - Findingown data
Teachers rated significantly greater impacts for English language learners (M = 7.31, SD = 2.88) compared to non-English language learners (M = 5.45, SD = 2.84), t(389) = 13.78, p < 0.001.
“Finally, teachers rated significantly greater impacts for English language learners (M = 7.31, SD = 2.88) compared to non-English language learners (M = 5.45, SD = 2.84), t(389) = 13.78,p < 0.001.”
Quote in the paperSubstantial claim
- Findingown data
There was a significant decrease in the percentage of teachers who indicated that students received the needed support during the 2020-2021 school year: 44.3% in reading, 49.2% in mathematics, and 41.9% in writing.
“However, there was a significant decrease in the percentage of teachers who indicated that students received the needed support during the 2020-2021 school year: 44.3% in reading, 49.2% in mathematics, and 41.9% in writing.”
Quote in the paperSubstantial claim - Findingown data
During typical years prior to the COVID-19 pandemic, 93.3% of teachers indicated that they were able to cover more than 80% of planned curriculum in reading compared to only 43.8% during the 2020-2021 school year.
“During typical years prior to the COVID-19 pandemic, 93.3% of teachers indicated that they were able to cover more than 80% of planned curriculum in reading compared to only 43.8% of teachers during the 2020-2021 school year.”
Quote in the paperSubstantial claim - Findingown data
About 30.9% of teachers indicated that they were able to cover more than 80% of planned curriculum in writing during the 2020-2021 school year compared to 79.5% during typical years.
“For writing, about 30.9% of teachers indicated that they were able to cover more than 80% of planned curriculum during the 2020-2021 school year compared to 79.5% of teachers during typical years.”
Quote in the paperSubstantial claim - Findingown data
The majority of teachers (65.5%) indicated that the drop in the percentage of students ready to transition to the next grade was due to the COVID-19 pandemic.
“The majority of teachers (65.5%) indicated that this drop in the percentage of students ready to transition to the next grade was due to the COVID-19 pandemic.”
Quote in the paperSubstantial claim - Findingown data
Teachers indicated that fewer students who needed extra support and/or intervention in academic content areas actually received the support during the 2020-2021 school year compared to typical years.
“Teachers indicated that fewer students who needed extra support and/or intervention in academic content areas actually received the support during the 2020-2021 school year compared to typical years.”
Quote in the paperSubstantial claim - Findingown data
Our findings indicated that many students who needed extra support/intervention in the academic content areas did not receive needed support in the 2020-2021 school year.
“Our findings also indicated that many students who needed extra support/intervention in the academic content areas did not receive needed support in the 2020-2021 school year.”
Quote in the paperSubstantial claim- Rests on an assumption: Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.
- Findingown data
Compared to typical years, teachers reported significant decreases in curriculum coverage during the 2020-2021 school year.
“Compared to typical years, teachers reported significant decreases in curriculum coverage; the number of students who received needed interventions, and students who were ready to transition to the next grade level during the 2020-2021 school year.”
Quote in the paperSubstantial claim - Findingown data
Teachers consistently reported that personnel and training resources can contribute to better implementation of instruction (including remote instruction).
“For example, teachers consistently reported that personnel and training resources can contribute to better implementation of instruction (including remote instruction).”
Quote in the paperSubstantial claim - Findingown data
Compared to typical years, teachers reported significant decreases in the number of students who received needed interventions during the 2020-2021 school year.
“Compared to typical years, teachers reported significant decreases in curriculum coverage; the number of students who received needed interventions, and students who were ready to transition to the next grade level during the 2020-2021 school year.”
Quote in the paperSubstantial claim - Findingown data
Approximately 60% of teachers experienced a change in their instructional model from the beginning to the end of the 2020-2021 school year.
“However, approximately 60% of teachers experienced a change in their instructional model from the beginning to the end of the school year.”
Quote in the paperNot a substantial claim - Findingown data
Teachers indicated significantly greater impacts for students from low-income backgrounds (M = 7.74, SD = 2.59) compared to those not from low-income backgrounds (M = 4.83, SD = 2.59), t(457) = 24.04, p < 0.001.
“Teachers indicated significantly greater impacts for students from low-income backgrounds (M = 7.74, SD = 2.59) compared to those who were not from low-income backgrounds (M = 4.83, SD = 2.59), t(457) = 24.04,p < 0.001.”
Quote in the paperSubstantial claim - Findingown data
In the current survey, teachers reported greater impacts of the pandemic on academic instruction for students with IEPs, low-income students, and English language learners.
“In the current survey, teachers reported greater impacts of the pandemic on academic instruction for students with IEPs, low-income students, and English language learners.”
Quote in the paperSubstantial claim- Rests on an assumption: Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.
- Findingown data
School achievement was correlated with teacher-reported impacts of the pandemic on specific academic content areas, but these correlations were small (rs range from -0.11 to -0.19, all ps < 0.05).
“School achievement was also correlated with teacher-reported impacts of the pandemic on specific academic content areas, but these correlations were small (rs range from -0.11 to -0.19, all ps < 0.05).”
Quote in the paperNot a substantial claim - Findingown data
Teachers also clearly indicated that many fewer students were ready to transition to the next grade level at the end of the 2020-2021 school year.
“Teachers also clearly indicated that many fewer students were ready to transition to the next grade level at the end of the 2020-2021 school year.”
Quote in the paperSubstantial claim- Rests on an assumption: Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.
- Findingown data
Higher school achievement was associated with smaller impacts on student learning and delivery of instruction.
“Follow-up analyses using prior school achievement data corroborated the findings that higher school achievement was associated with smaller impacts on student learning and delivery of instruction.”
Quote in the paperSubstantial claim - Findingown data
There was a small correlation between school achievement and the percentage of time in which a 100% in-person instructional model was used (r = 0.19, p < 0.001).
“There was a small correlation between school achievement and the percentage of time in which a 100% in-person instructional model was used (r = 0.19, p < 0.001), indicating higher achieving schools provided 100% in-person instruction more often than low achieving schools.”
Quote in the paperNot a substantial claim - Findingown data
Teachers reported fewer students were ready to transition to the next grade level at the end of the 2020-2021 school year compared to typical years.
“Teachers reported fewer students were ready to transition to the next grade level at the end of 2020-2021 school year compared to typical years (see Figure 3).”
Quote in the paperSubstantial claim - Findingown data
At the start of the 2020-2021 school year, most schools offered either 100% remote instruction (46.7%) or in-person instruction with an option for remote instruction (30.9%).
“At the start of the school year, most schools offered either 100% remote instruction (46.7%) or in-person instruction with an option for remote instruction (30.9%).”
Quote in the paperNot a substantial claim - Findingown data
Teachers rated remote instruction as significantly more effective for students who were not English language learners (M = 5.45, SD = 2.53) compared to English language learners (M = 3.92, SD = 3.05), t(356) = -9.13, p < 0.001.
“Lastly, teachers rated that remote instruction was significantly more effective for students who were not English language learners (M = 5.45, SD = 2.53) compared to English language learners (M = 3.92, SD = 3.05), t(356) = -9.13,p < 0.001.”
Quote in the paperSubstantial claim - Findingown data
Teachers rated significantly greater impacts for students with IEPs (M = 7.43, SD = 2.90) compared to those without IEPs (M = 5.51, SD = 2.71), t(455) = 15.64, p < 0.001.
“Teachers also rated significantly greater impacts for students with IEPs (M = 7.43, SD = 2.90) compared to those without IEPs (M = 5.51, SD = 2.71), t(455) = 15.64,p < 0.001.”
Quote in the paperSubstantial claim - Findingown data
Compared to typical years, teachers reported significant decreases in students who were ready to transition to the next grade level during the 2020-2021 school year.
“Compared to typical years, teachers reported significant decreases in curriculum coverage; the number of students who received needed interventions, and students who were ready to transition to the next grade level during the 2020-2021 school year.”
Quote in the paperSubstantial claim - Findingown data
Teachers reported greater impacts on instruction for students from disadvantaged backgrounds.
“Teachers also reported greater impacts on instruction for students from disadvantaged backgrounds.”
Quote in the paperSubstantial claim - Findingown data
Overall, the mean rating of the impact of the pandemic on teachers' delivery of academic skills instruction was 6.67 (SD = 2.64) on a 0-10 scale, indicating a moderate to large impact.
“Overall, the mean rating was 6.67 (SD = 2.64), indicating a moderate to large impact of the pandemic on teachers' delivery of academic instruction.”
Quote in the paperSubstantial claim - Findingown data
The overall rating for teacher-reported effectiveness of remote instruction was low (M = 4.74).
“Yet, the overall rating for teacherreported effectiveness of remote instruction was low (M = 4.74).”
Quote in the paperSubstantial claim - Findingown data
Teachers rated remote instruction as more effective for students who were not from low-income backgrounds (M = 5.66, SD = 2.51) compared to students from low-income backgrounds (M = 4.13, SD = 3.02), t(432) = -10.17, p < 0.001.
“Teachers rated remote instruction being more effective for students who were not from low-income backgrounds (M = 5.66, SD = 2.51) compared to students from low-income backgrounds (M = 4.13, SD = 3.02), t(432) = -10.17,p < 0.001.”
Quote in the paperSubstantial claim - Findingown data
About 24.6% of teachers indicated that there were no positive takeaways from the 2020-2021 school year.
“About 24.6% of teachers indicated that there were no positive takeaways from the 2020-2021 school year.”
Quote in the paperNot a substantial claim - Findingown data
There were small correlations between the percent of the year a 100% in-person instructional model was used and teacher-reported impacts of the pandemic (rs range from -0.18 to -0.22, all ps < 0.001).
“There were small correlations between the percent of the year a 100% in-person instructional model was used and teacher-reported impacts of the pandemic (rs range from -0.18 to -0.22, all ps < 0.001)”
Quote in the paperNot a substantial claim - Findingown data
Higher achieving schools were significantly less likely than lower achieving schools to have students who needed additional intervention but did not receive it, even after controlling for students needing but not receiving intervention in typical years.
“In contrast, higher achieving schools were significantly less likely than lower achieving schools to have students who needed additional intervention but did not receive it, even after controlling for students needing but not receiving intervention in typical years.”
Quote in the paperSubstantial claim- Rests on an assumption: SEDA school mean achievement validly measures school achievement.
- Rests on an assumption: Teacher reports of curriculum coverage in typical years accurately reflect typical years.
- Findingown data
School achievement was moderately negatively correlated with teacher-reported impacts of the pandemic on the percentage of students ready to transition to the next grade level (r = -0.30, p < 0.001).
“and with teacher-reported impacts of the pandemic on the percentage of students ready to transition to the next grade level (r = -0.30,p < 0.001).”
Quote in the paperSubstantial claim - Findingown data
Teachers reported a significant decrease in the amount of planned curriculum they were able to cover in reading, mathematics, and writing during the 2020-2021 school year compared to typical years.
“Overall, teachers reported a significant decrease in the amount of planned curriculum they were able to cover in academic content areas (i.e., reading, mathematics, and writing) during the 2020-2021 school year compared to typical years.”
Quote in the paperSubstantial claim - Findingown data
Teachers reported low instructional effectiveness during the 2020-2021 school year.
“Results indicated that most teachers relied on alternative forms of instruction and experienced changes in delivery models but reported low instructional effectiveness.”
Quote in the paperSubstantial claim - Findingown data
Teachers who responded to our survey did note a lack of student engagement and parental support/involvement as a challenge to providing remote instruction.
“Teachers who responded to our survey did note a lack of student engagement and parental support/involvement as a challenge to providing remote instruction.”
Quote in the paperNot a substantial claim - Findingown data
Teachers rated remote instruction as more effective for students without IEPs (M = 5.45, SD = 2.43) than for those with IEPs (M = 3.84, SD = 3.05), t(421) = -11.22, p < 0.001.
“Teachers also rated that remote instruction was more effective for students without IEPs (M = 5.45, SD = 2.43) than it was for those with IEPs (M = 3.84, SD = 3.05), t(421) = -11.22,p < 0.001.”
Quote in the paperSubstantial claim - Findingown data
School achievement was moderately negatively correlated with overall ratings of the impact of the pandemic (r = -0.29, p < 0.001).
“School achievement was moderately negatively correlated with overall ratings of the impact of the pandemic (r = -0.29,p < 0.001)”
Quote in the paperSubstantial claim - Findingown data
Most teachers (85.4%) indicated that the change in their ability to cover the curriculum during the 2020-2021 school year was due to the pandemic.
“Most teachers (85.4%) indicated that this change in their ability to cover the curriculum during the 2020-2021 school year was due to the pandemic.”
Quote in the paperSubstantial claim - Findingown data
Only 53.2% of teachers reported that they were able to cover more than 80% of their planned curriculum in mathematics during the 2020-2021 school year compared to 92.8% in typical years.
“Only 53.2% of teachers reported that they were able to cover more than 80% of their planned curriculum in mathematics compared to 92.8% of teachers in typical years.”
Quote in the paperSubstantial claim - Interpretationown data
Our results indicate that teachers in higher performing schools did not have to alter their instruction as much as teachers in lower performing schools.
“Our results also indicate that teachers in higher performing schools did not have to alter their instruction as much as teachers in lower performing schools.”
Quote in the paperSubstantial claim- Rests on an assumption: SEDA school mean achievement validly measures school achievement.
- Interpretationown data
Higher achieving schools provided 100% in-person instruction more often than low achieving schools.
“There was a small correlation between school achievement and the percentage of time in which a 100% in-person instructional model was used (r = 0.19, p < 0.001), indicating higher achieving schools provided 100% in-person instruction more often than low achieving schools.”
Quote in the paperNot a substantial claim - Study design and conductown data
There were no other significant differences between teachers who did and did not respond to the survey.
“There were no other significant differences.”
Quote in the paperSubstantial claim - Interpretationreasoning
There will be long term and compounded effects if teachers continue to have difficulty implementing the full curriculum.
“This suggests there will be long term and compounded effects if teachers continue to have difficulty implementing the full curriculum.”
Quote in the paperNot a substantial claim - Premisecitation
Special education status, English language learner status, and eligibility for free/reduced price lunch were associated with greater learning losses in mathematics among middle school students.
“Furthermore, special education status, English language learner status, and eligibility for free/reduced price lunch were associated with greater learning losses in mathematics among middle school students.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Streich et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Study design and conductown data
The sample approximated the national averages in terms of gender and race.
“Overall, our sample approximated the national averages in terms of gender and race.”
Quote in the paperSubstantial claim - Interpretationreasoning
Teachers at higher achieving schools reported smaller differences in the number of students ready to transition to the next grade level between the 2020 and 2021 school year and typical years prior to the pandemic.
“and teachers at higher achieving schools reported smaller differences in the number of students ready to transition to the next grade level between the 2020 and 2021 school year and typical years prior to the pandemic.”
Quote in the paperSubstantial claim - Study design and conductown data
Teachers with over 20 years of teaching experience were over-represented in the sample (32.3%) compared to the national average (22.4%).
“However, teachers with over 20 years of teaching experience were over-represented in our samples (32.3%) compared to the national average (22.4%).”
Quote in the paperNot a substantial claim - Premisereasoning
Detailed empirical data that can provide important contextual background for understanding the impact of the pandemic on student learning are missing.
“Detailed empirical data that can provide important contextual background for understanding the impact of the pandemic on student learning are missing.”
Quote in the paperSubstantial claim - Interpretationown data
Teachers at higher achieving schools reported fewer negative effects of the pandemic.
“This pattern of results indicated that teachers at higher achieving schools reported fewer negative effects of the pandemic”
Quote in the paperSubstantial claim - Study design and conductnone given
The samples of teachers who completed our surveys were generally representative of the population of teachers in the United States.
“The samples of teachers who completed our surveys were generally representative of the population of teachers in the United States”
Quote in the paperSubstantial claim - Interpretationown data
Our survey results add to the growing literature that the impacts of the COVID-19 pandemic on academic learning have disproportionately affected low-income students, minoritized students, and students with disabilities.
“Our survey results also add to the growing literature that the impacts of the COVID-19 pandemic on academic learning have disproportionately affected low-income students, minoritized students, and students with disabilities (see Dorn et al., 2020;Goodrich et al., 2022).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Dorn et al., 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Goodrich et al., 2022 source
Checked before — its earlier verdict is held back until a new check runs.
- Premisecitation
Differential access to technology and remote instruction during COVID-19 school closures are projected to exacerbate the impacts of the pandemic for some populations, widening SES-based opportunity gaps.
“In addition, differential access to technology and remote instruction during COVID-19 school closures are projected to exacerbate the impacts of the pandemic for some populations, widening SES-based opportunity gaps.”
Quote in the paperSubstantial claim - Premisereasoning
The delivery models used during the pandemic may not have provided the same quality of education compared to instruction prior to the pandemic.
“Despite the strong efforts of schools and teachers, these delivery models may not have provided the same quality of education compared to instruction prior to the pandemic for several reasons.”
Quote in the paperSubstantial claim - Study design and conductnone given
A large percentage of teachers did not respond to the surveys.
“However, a large percentage of teachers did not respond to the surveys.”
Quote in the paperNot a substantial claim
- Classified as probably not a substantial claim. 27
- May combine two claims. 32
- The quote only partly states this claim. 1
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationStudents' academic motivation and participation in extracurricular activities, as perceived by their parents, decreased significantly during the COVID-19 pandemic.
“Moreover, students' academic motivation and participation in extracurricular activities, as perceived by their parents, decreased significantly during the COVID-19 pandemic (Zaccoletti et al., 2020).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Zaccoletti et al., 2020 source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationSeveral studies have demonstrated that student achievement has been lower during the pandemic compared to prior to the pandemic, with estimates ranging from three percentile points in the Netherlands to more than half of a school year in the U.S. state of Illinois.
“Several studies have demonstrated that student achievement has been lower during the pandemic compared to prior to the pandemic, with estimates ranging from three percentile points in the Netherlands (Engzell et al., 2021) to more than half of a school year in the U.S. state of Illinois (Streich et al., 2021).”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites Engzell et al., 2021 source
- cites Streich et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationKaffenberger (2021) projected that short-term and long-term efforts can reduce/remediate learning loss.
“Kaffenberger (2021) projected that short-term (e.g., covering previous year's curriculum before revering to the pre-pandemic curriculum) and long-term efforts (e.g., identifying students' needs using formative assessments, adapting teacher instruction to students' levels and needs) can reduce/remediate the learning loss.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Kaffenberger (2021) source
May combine two claims. The quote only partly states this claim.
Findingown dataTeachers indicated that distractions in students' homes (71.1%), internet access/availability (61.0%), student attendance (60.8%), lack of face-to-face interactions with students (57.7%), difficulty with evaluating student work (55.7%), difficulty with monitoring student progress (48.8%), managing remote and in-person instruction simultaneously (42.6%), and difficulty with providing feedback on学生?
“Teachers also indicated that distractions in students' homes (71.1%), internet access/availability (61.0%), student attendance (60.8%), lack of face-to-face interactions with students (57.7%), difficulty with evaluating student work (55.7%), difficulty with monitoring student progress (48.8%), managing remote and in-person instruction simultaneously (42.6%), and difficulty with providing feedback”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOur survey results indicated that most teachers relied on alternative forms of instruction and experienced changes during the 2020-2021 school year.
“Our survey results indicated that most teachers relied on alternative forms of instruction and experienced changes during the 2020-2021 school year.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe majority of other responses included having parental support at home and students' access to better technology (internet access, remote instruction platform support), and having a teacher dedicated to remote instruction.
“The majority of other responses included having parental support at home and students' access to better technology (internet access, remote instruction platform support), and having a teacher dedicated to remote instruction.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAt the end of the 2020-2021 school year, most schools offered in-person instruction with an option for remote instruction (65.2%), followed by 100% in-person (16.5%), hybrid (13.0%), and 100% remote (2.6%).
“At the end of the school year, most schools offered in-person instruction with an option for remote instruction (65.2%), followed by 100% in-person (16.5%), hybrid (13.0%), and 100% remote (2.6%) instruction.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataWhereas 68.9% of teachers indicated at least 80% of their students being ready to transition to the next grade in typical years, only about 31.9% reported at least 80% of their students were ready at the end of the 2020-2021 school year.
“Whereas 68.9% of teachers indicated at least 80% of their students being ready to transition to the next grade in typical years, only about 31.9% of teachers reported at least 80% of their students were ready to transition to the next grade at the end of the 2020-2021 school year.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataApproximately 75% of teachers indicated that there were also some positives that came out of the pandemic, including increases in student conscientiousness, prioritization of some academic content, and systems that resulted in more individual attention.
“Approximately 75% of teachers indicated that there were also some positives that came out of the pandemic, including increases in student conscientiousness, prioritization of some academic content, and systems that resulted in more individual attention.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataUsing average reported class sizes and teacher responses for students not ready to transition to the next grade level, the authors estimated that 32.4% of students were not ready to transition, as compared to 13.9% in previous years (an increase of 18.5%).
“Using average reported class sizes and teacher responses for students not ready to transition to the next grade level, we estimated that 32.4% of students were not ready to transition, as compared to 13.9% in previous years (an increase of 18.5%).”
Quote in the paperSubstantial claim- Rests on an assumption: Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.
May combine two claims.
Findingown dataUse of a 100% in-person instructional model was only significant for mathematics, indicating that teachers who reported using more 100% in-person instruction were less likely to report having students who needed extra mathematics intervention but did not receive it; however, the magnitude of this effect was small.
“Use of a 100% inperson instructional model was only significant for mathematics, indicating that teachers who reported using more 100% inperson instruction were less likely to report having students who needed extra mathematics intervention but did not receive it; however, the magnitude of this effect was small.”
Quote in the paperNot a substantial claim- Rests on an assumption: Percentage of time using a 100% in-person instructional model validly measures in-person instruction.
- Rests on an assumption: Teacher reports of curriculum coverage in typical years accurately reflect typical years.
May combine two claims.
Findingown dataOther challenges included a lack of parental support/involvement, lack of student engagement, and parents or other household members completing student assignments or assessments.
“Other challenges included a lack of parental support/involvement, lack of student engagement, and parents or other household members completing student assignments or assessments.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingnone givenAlong with learning losses, many teachers report not covering as much of the academic curricula for students, especially in schools with lower achievement levels.
“Along with learning losses, many teachers report not covering as much of the academic curricula for students, especially in schools with lower achievement levels.”
Quote in the paperSubstantial claim- Rests on an assumption: Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.
May combine two claims.
Findingown dataTeachers indicated that some positive takeaways during the 2020-2021 school year were students being more conscientious (68.6%), greater ability to provide individualized attention due to reduced class sizes or alternating days (21.6%), and more time for students to participate in academics due to reductions in extracurricular activities (21.1%).
“Despite these challenges, teachers indicated that some positive takeaways during the 2020-2021 school year were students being more conscientious (68.6%), greater ability to provide individualized attention due to reduced class sizes or alternating days (21.6%), and more time for students to participate in academics due to reductions in extracurricular activities (21.1%).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataTeachers indicated that having a lower teacher-student ratio would contribute to successful remote instruction (61.7%), followed by the structures and scheduling of remote instruction (52.6%), training opportunities (45%), and support personnel (e.g., paraprofessionals, 38.5%).
“Teachers indicated that having a lower teacher-student ratio would contribute to successful remote instruction (61.7%) followed by the structures and scheduling of remote instruction (52.6%), training opportunities (45%), and support personnel (e.g., paraprofessionals, 38.5%).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe results of this survey suggest that most teachers were not able to cover at least 80% of their reading, writing, and mathematics curriculum, which was significantly lower than their reported ability to cover 80% of the curriculum in previous years.
“The results of this survey suggest that most teachers were not able to cover at least 80% of their reading, writing, and mathematics curriculum, which was significantly lower than their reported ability to cover 80% of the curriculum in previous years.”
Quote in the paperSubstantial claim- Rests on an assumption: Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.
May combine two claims.
Findingown dataBoth school achievement and percentage of time using a 100% in-person instructional model were significantly predictive of overall impacts of the pandemic and teacher reported coverage of the reading, writing, and mathematics curriculum, even after controlling for teacher reported coverage of the curriculum in typical years.
“Both school achievement and percentage of time using a 100% in-person instructional model were significantly predictive of overall impacts of the pandemic and teacher reported coverage of the reading, writing, and mathematics curriculum, even after controlling for teacher reported coverage of the curriculum in typical years.”
Quote in the paperSubstantial claim- Rests on an assumption: SEDA school mean achievement validly measures school achievement.
- Rests on an assumption: Percentage of time using a 100% in-person instructional model validly measures in-person instruction.
- Rests on an assumption: Teacher reports of curriculum coverage in typical years accurately reflect typical years.
- Rests on an assumption: The COVID-19 pandemic caused the observed negative impacts on learning and curriculum coverage, rather than other factors.
May combine two claims.
Findingown dataOur regression analyses corroborate these findings across schools as well, as higher school achievement was associated with smaller negative impacts on the curriculum coverage and fewer students requiring additional intervention.
“Our regression analyses corroborate these findings across schools as well, as higher school achievement was associated with smaller negative impacts on the curriculum coverage and fewer students requiring additional intervention.”
Quote in the paperSubstantial claim- Rests on an assumption: SEDA school mean achievement validly measures school achievement.
- Rests on an assumption: Teacher reports of curriculum coverage in typical years accurately reflect typical years.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationKuhfeld et al. (2020) projected that students who did not have access to remote instruction (3 months) in spring 2020 would begin fall 2020 with only 37% to 68% of typical learning gains in reading and mathematics.
“Kuhfeld et al. (2020) projected that students who did not have access to remote instruction (3 months) in spring 2020 would begin fall 2020 with only 37% to 68% of typical learning gains in reading and mathematics, and some students may be up to one year behind in mathematics.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Kuhfeld et al. (2020) source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationPrior studies have found that family, school, and peer support increases student engagement, which in turn improves academic competence and achievement.
“Additionally, prior studies have found that family, school, and peer support increases student engagement, which in turn improves academic competence and achievement (e.g., Elias and Haynes, 2008;Estell and Perdue, 2013).”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S4 (based).
Premisenone givenThe current literature and understanding of the impact of the pandemic on student learning is primarily based on model-based projections and limited empirical data comparing student performance prior to and after the lockdown.
“However, the current literature and our understanding of the impact of the pandemic on student learning is primarily based on model-based projections and limited empirical data comparing student performance prior to and after the lockdown.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationAchievement scores on state assessments for students in grades 4 to 8 in 17 school districts in Illinois indicated that students scored significantly lower than expected in mathematics compared to prior to the pandemic, resulting in learning losses as large as 56% of a school year.
“Similarly, achievement scores on state assessments for students in grades 4 to 8 in 17 school districts in Illinois indicated that students scored significantly lower than expected in mathematics compared to prior to the pandemic, resulting in a learning losses as large as 56% of a school year (Streich et al., 2021).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Streich et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationcitationConsistent with teachers' reports in our survey, as well as in Goodrich et al. (2022), more systematic training for school personnel is needed to improve the quality of remote instruction.
“Consistent with teachers' reports in our survey, as well as in Goodrich et al. (2022), more systematic training for school personnel is needed to improve the quality of remote instruction.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Goodrich et al. (2022) source
Checked before — its earlier verdict is held back until a new check runs.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Study design and conductnone givenIt is possible that the teachers may have under- or over-estimated other descriptive variables for their classrooms or were unaware of some of the school services provided by resource and special education teachers.
“It is also possible that the teachers may have under-or over-estimated other descriptive variables for their classrooms or were unaware of some of the school services provided by resource and special education teachers.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningSchools in the United States have a large problem on their hands.
“Schools in the United States have a large problem on their hands.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThis has likely compounded learning losses already realized during school shutdowns in spring 2020, and some schools still may not be fully covering the academic curriculum in the 2021-2022 school year.
“This is alarming because it has likely compounded learning losses already realized during school shutdowns in spring of 2020, and some schools still may not be fully covering the academic curriculum in the 2021-2022 school year.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
Interpretationown dataOur findings add to the literature in an important way by providing teachers with an opportunity to identify other factors that may have contributed to their ability to cover the curricula and support their students.
“Our findings also add to the literature in an important way by providing teachers with an opportunity to identify other factors that may have contributed to their ability to cover the curricula and support their students.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationEven students who received remote instruction in spring 2020 were projected to begin fall 2020 with 60% to 87% of their typical learning gains.
“Even students who received remote instruction in spring 2020 were projected to begin fall 2020 with 60% to 87% of their typical learning gains.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationSuch support from family, school, and peers may be especially important for students from disadvantaged backgrounds.
“Such support from family, school, and peers may be especially important for students from disadvantaged backgrounds (Elias and Haynes, 2008).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Elias and Haynes, 2008 source
Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
InterpretationreasoningThis is an ongoing problem that is likely to be exacerbated, and it will likely continue to widen the opportunity gaps for minoritized students, low-income students, and students with disabilities.
“This is an ongoing problem that is likely to be exacerbated, and it will likely continue to widen the opportunity gaps for minoritized students, lowincome students, and students with disabilities.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningAlthough responders and non-responders were similar in key demographic variables (e.g., SES, school setting, school type, grade level taught), it is possible that low response rate resulted in selection bias.
“Although responders and non-responders were similar in key demographic variables (e.g., SES, school setting, school type, grade level taught), it is possible that low response rate resulted in selection bias.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataHigher school achievement and more use of a 100% in-person instructional model were associated with smaller negative impacts of the pandemic and greater coverage of academic curricula.
“Higher school achievement and more use of a 100% in-person instructional model were associated with smaller negative impacts of the pandemic and greater coverage of academic curricula.”
Quote in the paperSubstantial claim- Rests on an assumption: SEDA school mean achievement validly measures school achievement.
- Rests on an assumption: Percentage of time using a 100% in-person instructional model validly measures in-person instruction.
- Rests on an assumption: The COVID-19 pandemic caused the observed negative impacts on learning and curriculum coverage, rather than other factors.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationcitationStudent engagement during remote instruction may be critical to promoting successful remote learning.
“As much as in-person school engagement is important to academic achievement and school completion, student engagement during remote instruction may be critical to promoting successful remote learning.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone givenThe pandemic is not over, and with the continued struggle with COVID variants in 2022, students may be falling even further behind.
“Yet, the pandemic is not over, and with the continued struggle with the COVID variants in 2022 currently, students may be falling even further behind.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningInstructional challenges related to COVID-19 are likely to have resulted in less content coverage when school has been in session, compounding learning losses.
“However, instructional challenges related to COVID-19 are also likely to have resulted in less content coverage when school has been in session, compounding the losses.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe pandemic is projected to exacerbate existing opportunity gaps by 15% to 20%.
“Dorn et al. (2020) projected that lowincome students would experience 12.4 months of learning loss compared to the overall average learning loss of 6.8 months, exacerbating the existing opportunity gaps by 15% to 20%.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Dorn et al. (2020)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
InterpretationreasoningWith 21.2 million K-5 students attending school in 2020, nearly 3.9 million more students (6.8 million total) were not ready to transition to the next grade.
“With 21.2 million K-5 students attending school in 2020 (National Center for Education Statistics, 2021), this means nearly 3.9 million more students (6.8 million total) were not ready to transition to the next grade”
Quote in the paperSubstantial claim0 of 1 sources checked- cites National Center for Education Statistics, 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Rests on an assumption: Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.
May combine two claims.
Interpretationown dataTeachers who used more in-person instruction reported smaller impacts of the pandemic on their ability to cover the curriculum and the percentage of students who needed supplemental intervention for academic skills instruction.
“indicating that teachers who used more in-person instruction reported smaller impacts of the pandemic on their ability to cover the curriculum and the percentage of students who needed supplemental intervention for academic skills instruction.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThis can offer Federal and State Departments of Education with areas of opportunity for providing teachers with support, funding, or intervention resources.
“This can offer Federal and State Departments of Education with areas of opportunity for providing teachers with support, funding, or intervention resources.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
Interpretationown dataThis finding suggests that continued development of high-quality online educational learning and support is needed.
“This finding suggests that continued development of highquality online educational learning and support is also needed.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationPrior research indicated student achievement slows down or even declines over summer breaks.
“prior research indicated student achievement slows down or even declines over the summer breaks (e.g., von Hippel et al., 2018;Kuhfeld, 2019).”
Quote in the paperSubstantial claim0 of 2 sources checkedMay combine two claims.
Interpretationown dataThis may have played a role in the reported curriculum coverage and associated learning losses, as our results indicated that the amount of in-person instruction significantly contributed to teachers' ability to cover the curriculum.
“This may have played a role in the reported curriculum coverage and associated learning losses, as our results indicated that the amount of in-person instruction significantly contributed to teachers' ability to cover the curriculum.”
Quote in the paperSubstantial claim- Rests on an assumption: Percentage of time using a 100% in-person instructional model validly measures in-person instruction.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningOnly one teacher from each school was selected to maximize the number of schools.
“We made sure that only one teacher from each school was selected to maximize the number of schools.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataThe survey used a representative random sample of K-5 educator email addresses proportionally reflective of the number of teachers in each grade (K-5) and representative of the distribution of the United States population across geographic regions.
“For survey distribution, we obtained a representative random sample of K-5 educator email addresses that was proportionally reflective of the number of teachers in each grade (K-5) as well as representative of the distribution of the United States population across different geographic regions survey distribution from Market Data Retrieval (MDR).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenThe COVID-19 induced economic damage and educational budget cuts are likely to have a greater impact on students from disadvantaged backgrounds.
“Moreover, the COVID-19 induced economic damage and educational budget cuts are likely to have a greater impact on students from disadvantaged backgrounds.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationDorn et al. (2020) projected that low-income students would experience 12.4 months of learning loss compared to the overall average learning loss of 6.8 months.
“Dorn et al. (2020) projected that lowincome students would experience 12.4 months of learning loss compared to the overall average learning loss of 6.8 months, exacerbating the existing opportunity gaps by 15% to 20%.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Dorn et al. (2020)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataAfter correcting for Type I error rate, the Mid-Atlantic and South-Central regions were significantly under-represented in survey responders, whereas the Mountain and North-Central regions were significantly over-represented among survey responders.
“After correcting for Type I error rate, there were some statistically significant differences by geographic region.The Mid-Atlantic and South-Central regions were significantly under-represented in survey responders, whereas the Mountain and North-Central regions were significantly over-represented among survey responders.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataThe final sample consisted of 582 teachers, providing a ±4.1% margin of error with a 95% confidence interval.
“The final sample consisted of 582 teachers, providing this survey with a ± 4.1% margin of error with a 95% confidence interval.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductown dataRegression models predicting the amount of curriculum covered in the 2020-2021 school year controlled for teacher reports of the amount of curriculum covered in typical years.
“Regression models predicting amount of curriculum covered in the 2020-2021 school year controlled for teacher reports of the amount of curriculum covered in typical years.”
Quote in the paperSubstantial claim- Rests on an assumption: Teacher reports of curriculum coverage in typical years accurately reflect typical years.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationZhu and Liu (2020) called for more quantitative and qualitative research to evaluate remote teaching and learning, and long-term sustainability.
“Moreover, Zhu and Liu (2020) called for more quantitative and qualitative research to evaluate remote teaching and learning, and long-term sustainability.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Zhu and Liu (2020) source
Checked before — its earlier verdict is held back until a new check runs.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThere were likely disproportionate impacts on minoritized students.
“with likely disproportionate impacts on minoritized students.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningSubstantial restructuring of current pre-pandemic curricula may be inevitable to minimize the compounded effects.
“Therefore, substantial restructuring of current pre-pandemic curricula may be inevitable to minimize the compounded effects.”
Quote in the paperNot a substantial claim
The authors state this as an assumption.
Learning losses from COVID-19 school closures could be similar to losses experienced during other breaks from school.
“The assumption is that learning losses could be similar to losses experienced during other breaks from school.”
The paper relies on this without support.
Teacher reports of instructional changes and student outcomes accurately reflect actual instructional changes and student learning.
“we conducted a national survey with a random sample of 582 elementary school teachers to understand the instructional changes that occurred, the amount of academic content instruction provided to students, and teachersŠ perceptions of the learning supports needed and provided to students during the 2020-2021 school year.”
The paper relies on this without support.
SEDA school-level achievement averaged over 2008-2009 to 2017-2018 is a valid measure of prior school achievement for the 2020-2021 school year.
“SEDA school-level mean mathematics and English language arts achievement data were available for 490 teachers, and covariate data were available for 515 teachers who responded to our survey.”
The paper relies on this without support.
Teacher reports of student readiness, curriculum coverage, and intervention needs accurately reflect actual student outcomes.
“Using average reported class sizes and teacher responses for students not ready to transition to the next grade level, we estimated that 32.4% of students were not ready to transition”
The paper relies on this without support.
SEDA school mean achievement validly measures school achievement.
“including SEDA school mean achievement and percentage of time in which a 100% in-person instructional model was used.”
The paper relies on this without support.
Percentage of time using a 100% in-person instructional model validly measures in-person instruction.
“percentage of time using a 100% in-person instructional model”
The paper relies on this without support.
Teacher reports of curriculum coverage in typical years accurately reflect typical years.
“controlled for teacher reports of the amount of curriculum covered in typical years.”
The paper relies on this without support.
The COVID-19 pandemic caused the observed negative impacts on learning and curriculum coverage, rather than other factors.
“Both school achievement and percentage of time using a 100% in-person instructional model were significantly predictive of overall impacts of the pandemic”
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentt(457) = 24.04reported p < .001 · recomputed p < .001
“t(457) = 24.04,p < .001”
- Consistentt(455) = 15.64reported p < .001 · recomputed p < .001
“t(455) = 15.64,p < .001”
- Consistentt(389) = 13.78reported p < .001 · recomputed p < .001
“t(389) = 13.78,p < .001”
- Consistentt(432) = -10.17reported p < .001 · recomputed p < .001
“t(432) = -10.17,p < .001”
- Consistentt(421) = -11.22reported p < .001 · recomputed p < .001
“t(421) = -11.22,p < .001”
- Consistentt(356) = -9.13reported p < .001 · recomputed p < .001
“t(356) = -9.13,p < .001”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Discussion misstates the majority finding for mathematics curriculum coverage
MinorThe discussion says most teachers could not cover at least 80% of the curriculum in all three subjects. The results instead say 53.2% covered more than 80% of the mathematics curriculum, so a majority met that threshold in mathematics.
“The results of this survey suggest that most teachers were not able to cover at least 80% of their reading, writing, and mathematics curriculum”
“Only 53.2% of teachers reported that they were able to cover more than 80% of their planned curriculum in mathematics compared to 92.8% of teachers in typical years.”
Cites
Mail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,459 · see citing works
Mail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070232 · Cited by 3,240 · see citing works
Learning loss due to school closures during the COVID-19 pandemic
Engzell, P., Frey, A., & Verhagen, M. D. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2022376118 · Cited by 1,848 · see citing works
Learning loss due to school closures during the COVID-19 pandemic
Engzell, P., Frey, A., & Verhagen, M. D. (2020) · doi:10.31235/osf.io/ve4z7 · Cited by 1,739 · see citing works
Projecting the Potential Impact of COVID-19 School Closures on Academic Achievement
Kuhfeld, M., Soland, J., Tarasawa, B., Johnson, A., Ruzek, E., & Liu, J. (2020) · Educational Researcher · doi:10.3102/0013189x20965918 · Cited by 997 · see citing works
Education in and After Covid-19: Immediate Responses and Long-Term Visions
Zhu, X., & Liu, J. (2020) · Postdigital Science and Education · doi:10.1007/s42438-020-00126-3 · Cited by 567 · see citing works
Elias, M. J., & Haynes, N. M. (2008) · School Psychology Quarterly · doi:10.1037/1045-3830.23.4.474 · Cited by 372 · see citing works
Kaffenberger, M. (2021) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2020.102326 · Cited by 308 · see citing works
Family income, school attendance, and academic achievement in elementary school.
Morrissey, T. W., Hutchison, L. A., & Winsler, A. (2013) · Developmental Psychology · doi:10.1037/a0033848 · Cited by 304 · see citing works
Planned Missing Data Designs for Developmental Researchers
Little, T. D., & Rhemtulla, M. (2013) · Child Development Perspectives · doi:10.1111/cdep.12043 · Cited by 296 · see citing works
How teachers experienced the COVID-19 transition to remote instruction
Marshall, D. T., Shannon, D., & Love, S. M. (2020) · Phi Delta Kappan · doi:10.1177/0031721720970702 · Cited by 255 · see citing works
Developing Responsive Teachers: A Challenge for a Demographic Reality
García, E. E., Arias, M. B., Murri, N. J., & Serna, C. (2009) · Journal of Teacher Education · doi:10.1177/0022487109347878 · Cited by 241 · see citing works
Estell, D. B., & Perdue, N. H. (2013) · Psychology in the Schools · doi:10.1002/pits.21681 · Cited by 219 · see citing works
von Hippel, P. T., Workman, J., & Downey, D. B. (2018) · Sociology of Education · doi:10.1177/0038040718801760 · Cited by 214 · see citing works
Zaccoletti, S., Camacho, A., Correia, N., Aguiar, C., Mason, L., Alves, R. A., & Daniel, J. R. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.592670 · Cited by 209 · see citing works
Education in the age of COVID-19: Understanding the consequences
Stanistreet, P., Elfert, M., & Atchoaréna, D. (2020) · International Review of Education · doi:10.1007/s11159-020-09880-9 · Cited by 98 · see citing works
Surprising new evidence on summer learning loss
Kuhfeld, M. (2019) · Phi Delta Kappan · doi:10.1177/0031721719871560 · Cited by 93 · see citing works
Education During COVID-19 and Beyond
Nations, U. (2020) · UN-EOSG policy briefs and papers · doi:10.18356/21e7d903-en · Cited by 86 · see citing works
Too Many Schools Leave Learning to Chance during the Pandemic.
Gross, B., & Opalka, A. (2020) · Center on Reinventing Public Education · Cited by 70 · see citing works
Life Design for Youth as a Creativity-Based Intervention for Transforming a Challenging World
Fusco, L., Parola, A., & Sica, L. S. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.662072 · Cited by 26 · see citing works
Goodrich, J. M., Hebert, M., & Namkung, J. M. (2022) · Frontiers in Education · doi:10.3389/feduc.2021.793285 · Cited by 24 · see citing works
Self-citationvon Hippel, P., Workman, J., & Downey, D. B. (2017) · doi:10.2139/ssrn.3036094
Flagged first, then by citations
Research works printed but not linked: 4
- Dorn, 2020, COVID-19 and Student Learning in the United States: The Hurt Could last a Lifetime.
- Hussar, 2020, The Condition of Education 2020 (NCES2020-144). U.S. Department of Education.
- 2021, State Nonfiscal Survey of Public Elementary/Secondary Education, 1999–2000 Through 2019–20 and 2020–21 Preliminary.
- Reardon, 2021, Stanford Education Data Archive (Version 4.1).
Cited by
Sorted by citations
Teaching and learning challenges due to the COVID-19 pandemic: A systematic review
Tan, C. Y., Jang, S. T., Lam, S. M., An, A. Q., & Lo, U. K. V. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100667 · Cited by 35 · see citing works
Improving student learning and performance through a continuous flipped anatomy teaching model
Xiao, J. (2023) · Anatomical Sciences Education · doi:10.1002/ase.2351 · Cited by 16 · see citing works
Beyond COVID-19 Lockdowns: Rethinking Mathematics Education from a Student Perspective
Almarashdi, H. S. (2024) · Emerging Science Journal · doi:10.28991/esj-2024-sied1-010 · Cited by 16 · see citing works
Grooms, A. A., Peters, A. L., Lopez, E. J., Ogden, K., Childs, J., Martinez, E., & Duran, S. K. (2025) · The Urban Review · doi:10.1007/s11256-025-00738-8 · Cited by 6 · see citing works
Effects of a cognitive strategies intervention on secondary students’ argument writing in history
Steiss, J., Olson, C. B., Baker, T., Graham, S., Kim, Y. G., Tate, T. P., Krishnan, J., Chung, H. Q., Collins, P., Gilbertson, N., et al. (2025) · Reading and Writing · doi:10.1007/s11145-025-10678-0 · Cited by 5 · see citing works
Alibali, M. W., Matthews, P. G., Rodrigues, J., Meng, R., Vest, N. A., Jay, V., Menéndez, D., Murray, J. O., Donovan, A. M., Anthony, L. E., et al. (2024) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2024.106056 · Cited by 5 · see citing works
Ansari, W. E., El-Ansari, K., & Hany, M. (2025) · BMC Research Notes · doi:10.1186/s13104-025-07111-8 · Cited by 3 · see citing works
Samsari, E. P., Παλαιολόγου, Ν., & Νικολάου, Γ. (2024) · Societies · doi:10.3390/soc14050060 · Cited by 3 · see citing works
Hebert, M. A., High, A. E., & Flanigan, J. R. (2025) · Reading and Writing · doi:10.1007/s11145-025-10723-y · Cited by 2 · see citing works
Self-citationDecrepito, M. A. L. (2026) · Journal of Curriculum and Teaching · doi:10.5430/jct.v15n1p146 · Cited by 2 · see citing works
Galvin, S., & Lucitt, M. B. (2025) · European Journal Of Dental Education · doi:10.1111/eje.70062 · Cited by 1 · see citing works
Rosado, J. I., Torres‐Aponte, L., & Wang, Y. (2024) · Journal of School Health · doi:10.1111/josh.13514 · Cited by 1 · see citing works
Tortorelli, L. S., & Strong, J. Z. (2025) · Journal of Research in Reading · doi:10.1111/1467-9817.70004 · Cited by 1 · see citing works
Coronel, J. (2023) · RELC Journal · doi:10.1177/00336882231175762 · Cited by 1 · see citing works
Cervas, M. R., & Ching, D. A. (2023) · International Journal of Research Publications · doi:10.47119/ijrp1001311820235421
Hitching a Ride with Steve Graham Through the Galaxy of Writing Research
Santangelo, T., Hebert, M. A., & Bazis, P. S. (2023) · Literacy studies · doi:10.1007/978-3-031-36472-3_21
Self-citationTowards Resilient Public Places and Buildings to Pandemics
Cheshmehzangi, A., Sedrez, M. R., Dawodu, A., Heath, T., Li, T., & Hang, Z. (2024) · Urban sustainability · doi:10.1007/978-981-99-8672-9_10
Namkung, J. M., & Fuchs, L. S. (2024) · Journal of Learning Disabilities · doi:10.1177/00222194241297051
Self-citationExploring Kuwaiti School Teachers’ Challenges in the Post-COVID-19 Era
Alenezi, E. G., Alshatti, S. A., Almulla, B. A. T. M., & Aldhafiri, N. B. (2024) · doi:10.7176/jep/15-13-06
Misha, T. K., & Yadav, R. K. (2024) · Journal of Advances and Scholarly Researches in Allied Education · doi:10.29070/6p56jh70
Exploring the Impact of Research Conducted by Turkish Researchers on Open and Distance Learning
Usta, İ., Taşçıoğlu, H. P., & Yavuz, T. U. N. A. (2025) · Participatory Educational Research · doi:10.17275/per.25.41.12.3
Clinical Competence and Transition Experiences of Novice Nurses
Dajay, J. A. (2024) · Transaction on Biomedical Engineering Applications and Healthcare · doi:10.36647/tbeah/05.01.a002
Rafol, F. L. M., & Cancio, B. L. (2025) · International Journal of Research Publications · doi:10.47119/ijrp1001741620258110
Fahlevi, F., & Aripin, S. (2025) · Thawalib Jurnal Kependidikan Islam · doi:10.54150/thawalib.v6i1.644
Impact of Cost-Effective Digital Slide Platform on Grades of Romanian Veterinary Students
Fuerea, B. G., Rizac, R. I., Ciocîrlie, N., Soare, T., & Militaru, M. (2025) · Veterinary Sciences · doi:10.3390/vetsci12111064
Punla, C. S., & FARRO, R. C. (2025) · International Journal of Research and Innovation in Social Science · doi:10.47772/ijriss.2025.910000838
Post-pandemic shifts in middle school sexual health education: findings from ‘Sex Ed by Brown Med’
Haddock, P. E., Katz, J., Roberts, M. B., & Magee, S. R. (2025) · Sex Education · doi:10.1080/14681811.2025.2596184
Impact of the Covid-19 pandemic on writing performance: a statewide longitudinal study
Keller-Margulis, M. A., Matta, M., Yagi, K., Messerli, M. C., Navarro, S., Spillman, M. M., & Hut, A. R. (2025) · Reading and Writing · doi:10.1007/s11145-025-10734-9
Kalelıoğlu, F., & Çelik, S. A. (2026) · Large-scale Assessments in Education · doi:10.1186/s40536-026-00292-z
Gardening and farming activities during COVID-19 to bridge informal and formal education
Appaji, N., & Janardhana, G. L. (2026) · International Journal of Learning & Teaching · doi:10.18844/ijlt.v18i1.9545
econdary Teachers' Perceptions of Utilizing AI-Facilitated Small Groups
Cabler, D. (2026) · Journal of Educational Practice and Technology · doi:10.54093/jept.v2i2.2032
- Authors
- Namkung, J. M., Goodrich, J. M., Hebert, M., & Koziol, N.
- Affiliations
- University of Delaware (US)
- Texas A&M University (US)
- University of California, Irvine (US)
- University of Nebraska–Lincoln (US)
- Corresponding author
- Namkung, Jessica M.
- Venue
- Frontiers in Education
- Publisher
- Frontiers Media SA
- Published
- 2022-07-07
- Volume
- 7
- ISSN
- 2504-284X (ISSN-L)
- OpenAlex
- W4284706930
- Semantic Scholar
- bf755a92a159fe3d87a8c228e5ddc0337176990c
- Cited by
- 31
- References
- 20
- Citations by year
- 2026: 4 · 2025: 14 · 2024: 9 · 2023: 4
- FWCI
- 11.07
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Education (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- EdArXiv (OSF Preprints) (submittedVersion)
- EdArXiv (OSF Preprints) (submittedVersion, public-domain)
- Topics
- Social Sciences › Education › Education during COVID-19 pandemic
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › COVID-19 Pandemic Impacts
- Social Sciences › Education › School Choice and Performance
- Keywords
- COVID-19 pandemic, student learning loss, opportunity gap, primary school teachers, curriculum coverage, academic intervention, disadvantaged students, teacher perceptions, academic performance, 2020-2021 academic year
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-11-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-11-06.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review