PROTOCOL: Single-track year-round education for improving academic achievement in us k-12 schools: results of a meta-analysis
Open accessAbstract
Summer learning loss is a prominent concern in academic and public discussions of education. Summer learning loss refers to the fact that students forget material and show measurably decreased competency at the beginning of one school year than at the end of the preceding year. Concerns focus on not only what students forget over summer vacation, but also on the time that must be spent reviewing previously-taught material at the beginning of each school year. Overall, summer learning loss is worse in math than in reading (Cooper, Nye, Charlton, Lindsay, & Greathouse, 1996), likely because students read but do not do math during the summer. Cooper et al.'s (1996) meta-analytic estimate was that achievement declines by about one month of learning (.16 standard deviations in math and .11 in reading) during summer. Summer learning loss appears to be worse for disadvantaged students. Research has documented that low-income students lose ground to higher-SES students during summer months when they cannot access school resources (Burkam, Ready, Lee, & LoGerfo 2004; Entwisle, Alexander, & Olson, 2001). The magnitude of this loss relative to their more-advantaged peers is substantial: low-income students lose as much as three months of learning in reading over the summer (Von Drehle, 2010). Summer learning loss among low-income students may account for as much as two-thirds of the income-based achievement gap (Alexander, Entwisle, & Olson, 2007). The documented losses for disadvantaged students are consistent with research on differences in summer resources and opportunities. Low-income students typically attend lower-performing schools than their wealthier counterparts, but the resource differential in summer may be even greater (Downey, von Hippel, & Broh, 2004). During summer, less affluent children watch more television, converse less with parents, and benefit from less daily parental involvement than wealthier students (Gershenson, 2013). Wealthier students, in contrast, are more likely to engage in more stimulating activities, like taking lessons, visiting libraries, and attending museums, than less affluent students (Alexander et al., 2007). Year-round education is seen as a way to combat summer learning loss by shortening or eliminating the long summer vacation. Year-round education refers to the policy intervention of shortening summer break (and increasing the frequency and/or length of shorter breaks during the school year) in order to distribute instructional time more evenly throughout the year, while retaining the standard 180 instructional days. The National Association for Year-Round Education (NAYRE) defines YRE by saying that it provides “more continuous learning by breaking up the long summer vacation into shorter, more frequent vacations throughout the year…The year-round calendar is organized into instructional periods and vacation weeks that are more evenly balanced across 12 months than the traditional school calendar” (NAYRE, n.d.). One common calendar example alternates 45 instructional days (9 weeks) with 10 days (2 weeks) of vacation; this allocation of time is called a 45–10 calendar, and results in a summer vacation of around 6 weeks instead of 10 or more. Year-round education is sometimes conflated with other calendar and instructional reforms, so it is worth delineating how it is distinct from seemingly similar policies. YRE is distinct from a reform that is typically called extended year, which consists of adding days to the standard American school year of 180 days. YRE also does not refer to after-school programming, tutoring, summer school for remediation, other summer programming, or lengthening the number of instructional hours in each school day. It refers exclusively to re-allocating the 180 instructional days more evenly throughout the year. Single-track YRE calendars can differ from each other on two important axes. Single-track YRE can be implemented in a variety of calendar structures—whether a calendar has 30 days of instruction followed by 5 of vacation (called 30–5), 45 days of instruction followed by 10 of vacation (45–10), 45–15, 60–20, or another alternative—which could moderate the impact of the calendar type on student achievement. Single-track YRE calendars can also differ in the number of weeks to which summer vacation is shortened. Schools shorten their summer from the traditional 10 weeks to lengths ranging from 5 to 8 weeks; given the concern about summer learning loss, it would not be surprising for those lengths to moderate the effectiveness of single-track YRE. The logic of year-round education is fairly simple: if there are fewer weeks for students to forget material, then they will forget less during the summer, need to spend fewer weeks on review, and make more progress in the following year. The thinking of advocates is that the more-frequent short breaks (e.g. of two weeks, in a 45–10 calendar structure) are not long enough to engender learning loss in
AI snapshot
Written from the paper’s full text.
TL;DR
This is a Campbell Collaboration protocol (not a completed review) for a planned meta-analysis of single-track year-round education (YRE) and its effects on math and reading achievement in U.S. K–12 schools. It specifies the rationale, inclusion criteria, search strategy, and analytic plan, but reports no synthesized results.
Key findings
- No meta-analytic results are reported; the document is a protocol. The stated objectives are to estimate the effect of single-track YRE on math and reading achievement, to estimate effects for low-income and minority students separately, and to relate calendar characteristics (structure, length of the longest remaining break) to effect size.
- Background evidence cited: summer learning loss averages about one month of learning (.16 SD in math and .11 in reading; Cooper et al., 1996); low-income students may lose as much as three months of reading learning over summer (Von Drehle, 2010), and summer loss may account for as much as two-thirds of the income-based achievement gap (Alexander et al., 2007).
- Prior meta-analyses cited: Kneese (1996) found positive effects of +0.11 to +0.2 SD; Cooper et al. (2003) found an overall effect of +0.06, +0.11 for studies with statistical or matching controls, +0.16 for single-track YRE, and −0.01 (±.05) for multi-track YRE.
- The protocol argues single- and multi-track YRE should not be pooled, since multi-track is typically implemented for overcrowding and may have negative effects (Graves, 2010; Graves et al., 2013).
Methods
- Design: planned meta-analysis restricted to single-track YRE; includes studies comparing traditional-calendar schools with single-track year-round schools using any comparison approach (matched school- or student-level characteristics, geographic proximity, multivariate/OLS with controls). Pre/post comparisons are excluded, but cohort-comparison studies will be examined in a sensitivity analysis.
- Sample/scope: U.S. K–12 studies dated 2001–2016, excluding multi-track YRE, extended instructional time, special education students, and qualitative research; outcomes are math and reading achievement scores, with subgroup analyses for low-SES and minority students where data permit.
- Analysis: Cohen's d effect sizes (Hedges' g small-sample correction deemed unlikely to be needed since samples are over 100 and none under 50), inverse-variance weighted average with one estimate per study, Q-statistics for heterogeneity, and both fixed- and random-effects estimates reported; publication bias assessed partly by consulting dissertations as primary documents.
Limitations
- Stated by the paper: no experimental studies are expected; the final sample is likely small, which the authors note makes multivariate meta-analysis, three-level meta-analysis, and meta-regression inappropriate, and may not meet the assumptions of a random-effects model. Data extraction will be done by a single reviewer, and some studies may lack the data needed to compute effect sizes (reported only as direction and significance). Formal bias categorization is described as likely inappropriate given the observational nature of the evidence.
- Evident from the text: because this is a protocol, none of the planned estimates, heterogeneity statistics, or subgroup findings are yet available, so no conclusions about the effectiveness of single-track YRE can be drawn from this document.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 22 cited sources checked · 0 supported · 0 flagged
- Findingcitation
Multivariate meta-analysis requires within-study correlation statistics which are not available in any initially-identified studies.
“Multivariate meta‐analysis is the most common approach for addressing dependence among estimates (see Gleser & Olkin, 2009; Hedges & Olkin, 1985; Raudenbush, Becker, & Kalaian, 1988), but it requires within‐study correlation statistics (Becker, Hedges, & Pigott, 2004; Jackson, Riley, & White, 2011) which are not available for which are not available in any initially‐identified studies.”
Quote in the paperSubstantial claim0 of 3 sources checked - Premisecitation
Kneese (1996) found a positive effect of year-round education on achievement varying from +0.11 to +0.2 standard deviations depending on the exact model and analysis used.
“Kneese (1996) included both studies with comparison groups and pre/post studies, and found a positive effect on achievement varying from +0.11 to +0.2 standard deviations depending on the exact model and analysis used.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Kneese (1996)
- Interpretationcitation
Single-track YRE is an academic intervention previously shown to have a modest but significant effect.
“As a result, the current study excludes multi‐track YRE and focuses only on single‐track YRE, because it is an academic intervention previously shown to have a modest but significant effect.”
Quote in the paperSubstantial claim- Rests on an assumption: Single-track YRE is usually implemented as an academic reform to improve student achievement.
- Premisecitation
Individual studies that examined both single- and multi-track YRE found that single-track schools showed larger performance gains.
“Individual studies that examined both single‐ and multi‐track YRE have found that single‐track schools showed larger performance gains (e.g., White & Cantrell, 2001).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites White & Cantrell, 2001
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Summer learning loss among low-income students may account for as much as two-thirds of the income-based achievement gap.
“Summer learning loss among low‐income students may account for as much as two‐thirds of the income‐based achievement gap (Alexander, Entwisle, & Olson, 2007).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Alexander, Entwisle, & Olson, 2007 source
- Premisecitation
Low-income students lose ground to higher-SES students during summer months when they cannot access school resources.
“Research has documented that low‐income students lose ground to higher‐SES students during summer months when they cannot access school resources (Burkam, Ready, Lee, & LoGerfo 2004; Entwisle, Alexander, & Olson, 2001).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Burkam, Ready, Lee, & LoGerfo 2004 source
- cites Entwisle, Alexander, & Olson, 2001
- Premisecitation
The effect of multi-track YRE may actually be negative.
“The effect of multi‐track YRE may actually be negative (Graves, 2010; Graves, McMullen, & Rouse, 2013).”
Quote in the paperSubstantial claim0 of 2 sources checked - Premisecitation
In both the Kneese (1996) and Cooper et al. (2003) meta-analyses, the authors found a larger treatment effect for single-track than multi-track YRE.
“In both the Kneese (1996) and Cooper et al. (2003) meta‐analyses, the authors found a larger treatment effect for single‐track than multi‐track YRE.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Kneese (1996)
- cites Cooper et al. (2003) source
- Premisecitation
Summer learning loss is worse in math than in reading.
“Overall, summer learning loss is worse in math than in reading (Cooper, Nye, Charlton, Lindsay, & Greathouse, 1996), likely because students read but do not do math during the summer.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Cooper, Nye, Charlton, Lindsay, & Greathouse, 1996 source
- Premisecitation
Achievement declines by about one month of learning during summer (.16 standard deviations in math and .11 in reading).
“Cooper et al.'s (1996) meta‐analytic estimate was that achievement declines by about one month of learning (.16 standard deviations in math and .11 in reading) during summer.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Cooper et al.'s (1996) source
- Premisecitation
Low-income students lose as much as three months of learning in reading over the summer.
“The magnitude of this loss relative to their more‐advantaged peers is substantial: low‐income students lose as much as three months of learning in reading over the summer (Von Drehle, 2010).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Von Drehle, 2010
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Wealthier students are more likely to engage in stimulating activities like taking lessons, visiting libraries, and attending museums than less affluent students.
“Wealthier students, in contrast, are more likely to engage in more stimulating activities, like taking lessons, visiting libraries, and attending museums, than less affluent students (Alexander et al., 2007).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Alexander et al., 2007 source
- Classified as probably not a substantial claim. 9
- May combine two claims. 6
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataPreliminary searching indicates that most samples are over 100 and none are under 50, so the small-sample correction is not likely to be needed.
“Preliminary searching indicates that most samples are over 100 and none are under 50, so the small‐sample correction (to use Hedges' g) is not likely to be needed (Hedges, 1981).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Hedges, 1981 source
Probably not a substantial claim: may not pass S4 (based).
Study design and conductnone givenThe restriction to the United States will avoid introducing the confounding variable of number of school days.
“The restriction to the United States will avoid introducing the confounding variable of number of school days.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationKneese stated that single-track calendars appeared to have a larger effect than multi-track calendars.
“Kneese also stated that single‐track calendars appeared to have a larger effect than multi‐track calendars.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Kneese
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationDuring summer, less affluent children watch more television, converse less with parents, and benefit from less daily parental involvement than wealthier students.
“During summer, less affluent children watch more television, converse less with parents, and benefit from less daily parental involvement than wealthier students (Gershenson, 2013).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Gershenson, 2013 source
May combine two claims.
PremisecitationCooper et al. (2003) found multi-track YRE had an effect size of −0.01 (±.05) and single-track YRE had an effect size of +0.16 in fixed-effects unadjusted analyses.
“Cooper et al. (2003) disaggregated by calendar type, and in their fixed‐effects unadjusted analyses found that, although multi‐track YRE had an effect size of just −0.01 (±.05), single‐track YRE had an effect size of +0.16.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Cooper et al. (2003) source
Probably not a substantial claim: may not pass S1 (asserted), S4 (based). May combine two claims.
InterpretationreasoningDistributing vacations and schooling more evenly throughout the year would allow students' year-over-year academic progress to increase, with no additional days of teaching.
“If correct, distributing vacations and schooling more evenly throughout the year would allow for students' year‐over‐year academic progress to increase, with no additional days of teaching.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningThe meta-analysis will conduct at least one sensitivity analysis to assess differences in findings based on matching approach used.
“I will also conduct at least one sensitivity analysis to inform my conclusions around bias based on study design; assessing whether there are differences in findings based on matching approach used (which appears to be the primary distinguishing point in study design in single‐track YRE).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningThe meta-analysis will assess publication bias.
“I will assess publication bias.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationLow-income students typically attend lower-performing schools than wealthier students, but the resource differential in summer may be even greater.
“Low‐income students typically attend lower‐performing schools than their wealthier counterparts, but the resource differential in summer may be even greater (Downey, von Hippel, & Broh, 2004).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Downey, von Hippel, & Broh, 2004 source
Classified as probably not a substantial claim.
Study design and conductreasoningExcluding studies of extended instructional time is necessary because otherwise it would not be possible to identify what share of a change in student performance was due to a year-round calendar and what share was due to additional days of instruction.
“However, it would not be possible to identify what share of a change in student performance was due to a year‐round calendar (i.e. the elimination of summer learning loss) and what share was due to additional days of instruction.”
Quote in the paperSubstantial claim- Rests on an assumption: It is not infrequent for schools or school districts to make multiple changes at once.
May combine two claims.
PremisecitationCooper et al. (2003) found an overall effect size of +0.06 for year-round education, but +0.11 for studies that used statistical or matching controls.
“Cooper, Valentine, Charlton, and Melson (2003) included only studies with comparison groups, and found an overall effect size of +0.06, but +0.11 for studies that used statistical or matching controls.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Cooper, Valentine, Charlton, and Melson (2003) source
Classified as probably not a substantial claim.
Study design and conductreasoningThe meta-analysis will include only studies with a comparison group.
“In general, I will apply an exclusion criteria that studies must include a comparison group; and this will exclude comparisons made to prior performance at the same school(s).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningA second researcher will code 10-25% of search results and 10-25% of full-text downloads to assess whether reliability is at least 90%.
“In order to ensure that coding is being done well, a second researcher will code 10–25% of search results and 10–25% of full‐text downloads, to assess if reliability (both on studies to download and studies to include in final sample) is at least 90%.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
The literature on YRE does not in general include effect sizes that are statistically dependent.
“The literature on YRE does not in general include effect sizes that are statistically dependent.”
The paper relies on this without support.
Many single-track YRE evaluations are initially written as dissertations.
“Many single‐track YRE evaluations are initially written as dissertation.”
The paper relies on this without support.
Single-track YRE is usually implemented as an academic reform to improve student achievement.
“Single‐track YRE is usually implemented as an academic reform to improve student achievement.”
The paper relies on this without support.
Multi-track YRE is typically implemented in response to over-crowding when there is no funding available for additional classroom space.
“In contrast, multi‐track YRE is typically implemented in response to over‐crowding when there is no funding available for additional classroom space.”
The paper relies on this without support.
Since 2001, in the NCLB and post-NCLB era, schooling in America has experienced shifts and interventions that may have introduced systemic differences in the effect of YRE.
“Since 2001, in the NCLB and post‐NCLB era, schooling in America has experienced a broad array of shifts and interventions. These may have introduced systemic differences in the effect of YRE.”
The paper relies on this without support.
It is not infrequent for schools or school districts to make multiple changes at once.
“It is not infrequent for schools or school districts to make multiple changes at once.”
The paper relies on this without support.
The final sample is likely to be small.
“For a meta‐analysis of single‐track YRE, the final sample is likely to be small, but to include studies from various states during the16 years examined.”
The paper relies on this without support.
There are unlikely to be sufficient estimates in the final sample for a three-level model to be appropriate.
“Three‐level meta‐analysis may be able to account for hierarchically structured effect size estimates (Konstantopoulos, 2011), but there are unlikely to be sufficient estimates in this final sample for a three‐level model to be appropriate.”
The paper relies on this without support.
The final sample will not be large enough to meet the assumptions of representativeness undergirding a random effects model.
“However, even if (as current analysis indicates) the heterogeneity present in the estimates would normally point toward using random effects analysis, it is unlikely that the final sample will be large enough to meet the other assumptions of representativeness undergirding a random effects model.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Citation year conflicts with reference list
MinorThe methods section cites Raudenbush, Becker, and Kalaian as a 1988 work, but the corresponding reference lists 1998.
“Raudenbush, Becker, & Kalaian, 1988”
“Raudenbush, S. W., Becker, B. J., & Kalaian, H. (1998) Modelingmultivariate effect sizes.”
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817 · see citing works
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329 · see citing works
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · see citing works
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695 · cited 3× · see citing works
“Preliminary searching indicates that most samples are over 100 and none are under 50, so the small-sample correction (to use Hedges’ g) is not likely to be needed (Hedges, 1981).”
BackgroundMethodInfluentialStatistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,832 · see citing works
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553 · see citing works
Robust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086 · see citing works
Imputing missing standard deviations in meta-analyses can provide accurate results
Furukawa, T. A., Barbui, C., Cipriani, A., Brambilla, P., & Watanabe, N. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.06.006 · Cited by 1,568 · see citing works
Cohen, J. (1983) · Applied Psychological Measurement · doi:10.1177/014662168300700301 · Cited by 1,564 · see citing works
How to select, calculate, and interpret effect sizes.
Durlak, J. (2009) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsp004 · Cited by 1,487 · see citing works
Digital Games, Design, and Learning: A Systematic Review and Meta-Analysis
Clark, D. B., Tanner-Smith, E. E., & Killingsworth, S. S. (2016) · Review of Educational Research · doi:10.3102/0034654315582065 · Cited by 1,274 · see citing works
The Effects of Summer Vacation on Achievement Test Scores: A Narrative and Meta-Analytic Review
Cooper, H., Nye, B., Charlton, K., Lindsay, J., & Greathouse, S. (1996) · Review of Educational Research · doi:10.3102/00346543066003227 · Cited by 991 · cited 6× · see citing works
“My general/starting-point search terms for this meta-analysis include those used by Cooper et al. (2003), augmented by terms used in pertinent research published after that metaanalysis. The basic form of the search terms is: “year-round school*” or “year-round education” or (school AND (“alternative calendar” or “mod…”
BackgroundMethodInfluentialEstimation of a Single Effect Size: Parametric and Nonparametric Methods
Hedges, L. V., & Olkin, I. (1985) · Statistical Methods for Meta-Analysis · doi:10.1016/b978-0-08-057065-5.50010-5 · Cited by 983 · see citing works
Empirical Benchmarks for Interpreting Effect Sizes in Research
Hill, C. J., Bloom, H. S., Black, A. R., & Lipsey, M. W. (2008) · Child Development Perspectives · doi:10.1111/j.1750-8606.2008.00061.x · Cited by 950 · see citing works
Are Schools the Great Equalizer? Cognitive Inequality during the Summer Months and the School Year
Downey, D. B., von Hippel, P. T., & Broh, B. A. (2004) · American Sociological Review · doi:10.1177/000312240406900501 · Cited by 853 · see citing works
Small sample adjustments for robust variance estimation with meta-regression.
Tipton, E. (2015) · Psychological Methods · doi:10.1037/met0000011 · Cited by 810 · see citing works
Generalizations about Using Value-Added Measures of Teacher Quality
Hanushek, E. A., & Rivkin, S. G. (2010) · American Economic Review · doi:10.1257/aer.100.2.267 · Cited by 793 · see citing works
Lasting Consequences of the Summer Learning Gap
Alexander, K. L., Entwisle, D. R., & Olson, L. S. (2007) · American Sociological Review · doi:10.1177/000312240707200202 · Cited by 763 · cited 1× · see citing works
“Wealthier students, in contrast, are more likely to engage in more stimulating activities, like taking lessons, visiting libraries, and attending museums, than less affluent students (Alexander et al., 2007).”
BackgroundEffect-Size Indices for Dichotomized Outcomes in Meta-Analysis.
Sánchez‐Meca, J., Marín‐Martínez, F., & Moscoso, S. C. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.4.448 · Cited by 635 · see citing works
Tanner-Smith, E. E., & Tipton, E. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1091 · Cited by 588 · see citing works
Fixed effects and variance components estimation in three-level meta-analysis
Konstantopoulos, S. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.35 · Cited by 521 · cited 1× · see citing works
“Three-level meta-analysis may be able to account for hierarchically structured effect size estimates (Konstantopoulos, 2011), but there are unlikely to be sufficient estimates in this final sample for a three-level model to be appropriate.”
BackgroundStochastically dependent effect sizes.
Gleser, L. J., & Olkin, I. (1994) · Cited by 485 · see citing works
Bloom, H. S., Hill, C. J., Black, A. R., & Lipsey, M. W. (2008) · Journal of Research on Educational Effectiveness · doi:10.1080/19345740802400072 · Cited by 477 · see citing works
A probability-based measure of effect size: Robustness to base rates and other factors.
Ruscio, J. (2008) · Psychological Methods · doi:10.1037/1082-989x.13.1.19 · Cited by 398 · see citing works
Development of the declarative memory system in the human brain
Ofen, N., Kao, Y.-C., Sokol‐Hessner, P., Kim, H., Whitfield, S., & Gabrieli, J. D. E. (2007) · Nature Neuroscience · doi:10.1038/nn1950 · Cited by 360 · see citing works
Haddock, C., Rindskopf, D., & Shadish, W. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.3.339 · Cited by 349 · see citing works
Episodic memory across the lifespan: The contributions of associative and strategic components
Shing, Y. L., Werkle‐Bergner, M., Brehmer, Y., Müller, V., Li, S., & Lindenberger, U. (2009) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.11.002 · Cited by 348 · see citing works
Dietrichson, J., Bøg, M., Filges, T., & Klint Jørgensen, A.-M. (2017) · Review of Educational Research · doi:10.3102/0034654316687036 · Cited by 288 · see citing works
Moeyaert, M., Ugille, M., Natasha Beretvas, S., Ferron, J., Bunuan, R., & Van den Noortgate, W. (2017) · International Journal of Social Research Methodology · doi:10.1080/13645579.2016.1252189 · Cited by 274 · see citing works
Meta-Analysis With Complex Research Designs
Scammacca, N. K., Roberts, G. J., & Stuebing, K. K. (2013) · Review of Educational Research · doi:10.3102/0034654313500826 · Cited by 269 · see citing works
Conn, K. (2017) · Review of Educational Research · doi:10.3102/0034654317712025 · Cited by 264 · see citing works
Burkam, D. T., Ready, D. D., Lee, V. E., & LoGerfo, L. F. (2004) · Sociology of Education · doi:10.1177/003804070407700101 · Cited by 232 · see citing works
Ghetti, S., & Angelini, L. (2008) · Child Development · doi:10.1111/j.1467-8624.2007.01129.x · Cited by 227 · see citing works
von Hippel, P. T., Workman, J., & Downey, D. B. (2018) · Sociology of Education · doi:10.1177/0038040718801760 · Cited by 214 · see citing works
Reeves, B. C., Wells, G. A., & Waddington, H. S. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.02.016 · Cited by 199 · see citing works
Modeling multivariate effect sizes.
Raudenbush, S. W., Becker, B. J., & Kalaian, H. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.1.111 · Cited by 195 · see citing works
How Effective Are Family Literacy Programs?
van Steensel, R., McElvany, N., Kurvers, J., & Herppich, S. (2010) · Review of Educational Research · doi:10.3102/0034654310388819 · Cited by 185 · see citing works
Higgins, J. P., Ramsay, C., Reeves, B. C., Deeks, J. J., Shea, B., Valentine, J. C., Tugwell, P., & Wells, G. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1056 · Cited by 183 · see citing works
A Review of Meta-Analyses in Education
Ahn, S., Ames, A. J., & Myers, N. D. (2012) · Review of Educational Research · doi:10.3102/0034654312458162 · Cited by 165 · see citing works
Rejoinder to commentaries on ‘Multivariate meta‐analysis: Potential and promise’
Jackson, D., White, I. R., & Riley, R. D. (2011) · Statistics in Medicine · doi:10.1002/sim.4247 · Cited by 161 · see citing works
Effect Sizes for 2×2 Contingency Tables
Olivier, J., & Bell, M. L. (2013) · PLoS ONE · doi:10.1371/journal.pone.0058777 · Cited by 151 · see citing works
von Hippel, P., & Hamrock, C. (2019) · Sociological Science · doi:10.15195/v6.a3 · Cited by 149 · see citing works
Gardella, J. H., Fisher, B. W., & Teurbe-Tolon, A. R. (2017) · Review of Educational Research · doi:10.3102/0034654316689136 · Cited by 139 · see citing works
Title I and Student Achievement: A Meta-Analysis of Federal Evaluation Results
Borman, G. D., & D’Agostino, J. V. (1996) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737018004309 · Cited by 134 · see citing works
Cooper, H., Valentine, J. C., Charlton, K., & Melson, A. (2003) · Review of Educational Research · doi:10.3102/00346543073001001 · Cited by 133 · see citing works
Picard, L., Cousin, S., Guillery‐Girard, B., Eustache, F., & Piolino, P. (2012) · Child Development · doi:10.1111/j.1467-8624.2012.01736.x · Cited by 112 · see citing works
Searching for studies: A guide to information retrieval for Campbell systematic reviews
MacDonald, H. R., Comer, C., Foster, M., Labelle, P., Marsalis, S. E., Nyhan, K., Premji, Z., Rogers, M., Splenda, R., Stansfield, C., et al. (2024) · Campbell Systematic Reviews · doi:10.1002/cl2.1433 · Cited by 105 · see citing works
Do Summer Time-Use Gaps Vary by Socioeconomic Status?
Gershenson, S. (2013) · American Educational Research Journal · doi:10.3102/0002831213502516 · Cited by 104 · cited 2× · see citing works
“The effect of multi-track YRE may actually be negative (Graves, 2010; Graves, McMullen, & Rouse, 2013). In both the Kneese (1996) and Cooper et al.”
BackgroundEffects of Prior Knowledge on Memory: Implications for Education
Shing, Y. L., & Brod, G. (2016) · Mind Brain and Education · doi:10.1111/mbe.12110 · Cited by 102 · see citing works
A Time and Place for Everything: Developmental Differences in the Building Blocks of Episodic Memory
Lee, J. K., Wendelken, C., Bunge, S. A., & Ghetti, S. (2015) · Child Development · doi:10.1111/cdev.12447 · Cited by 99 · see citing works
The development of neural correlates for memory formation
Ofen, N. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.02.016 · Cited by 98 · see citing works
Thiessen‐Philbrook, H., Barrowman, N. J., & Garg, A. X. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.06.018 · Cited by 90 · see citing works
Biased odds ratios from dichotomization of age
Chen, H., Cohen, P. R., & Chen, S. (2006) · Statistics in Medicine · doi:10.1002/sim.2737 · Cited by 73 · see citing works
(2001) · The American Educator · Cited by 71 · see citing works
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386.ch20 · Cited by 68 · see citing works
Paulus, J. K., Dahabreh, I. J., Balk, E. M., Avendano, E. E., Lau, J., & Ip, S. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1101 · Cited by 64 · see citing works
Biases of Success Rate Differences Shown in Binomial Effect Size Displays.
Hsu, L. M. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.2.183 · Cited by 60 · see citing works
The Development of Episodic Memory: Lifespan Lessons
Shing, Y.-L., & Lindenberger, U. (2011) · Child Development Perspectives · doi:10.1111/j.1750-8606.2011.00170.x · Cited by 49 · see citing works
The academic impact of multi-track year-round school calendars: A response to school overcrowding
Graves, J. (2010) · Journal of Urban Economics · doi:10.1016/j.jue.2009.11.004 · Cited by 49 · see citing works
Pathman, T., Samson, Z., Dugas, K., Cabeza, R. E. L., & Bauer, P. J. (2011) · Memory · doi:10.1080/09658211.2011.613839 · Cited by 44 · see citing works
Swanson, E. A., Stevens, E. A., Scammacca, N. K., Capin, P., Stewart, A. A., & Austin, C. R. (2017) · Reading and Writing · doi:10.1007/s11145-017-9743-3 · Cited by 43 · see citing works
Graves, J. (2011) · Economics of Education Review · doi:10.1016/j.econedurev.2011.04.003 · Cited by 40 · see citing works
(1996) · Journal of research and development in education · Cited by 35 · see citing works
Multi-Track Year-Round Schooling as Cost Saving Reform: Not Just a Matter of Time
Graves, J., McMullen, S., & Rouse, K. (2013) · Education Finance and Policy · doi:10.1162/edfp_a_00097 · Cited by 35 · see citing works
Cheng, Q., Greenslade, J. H., Parsonage, W. A., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-009746 · Cited by 35 · see citing works
Student Segregation and Achievement Tracking in Year-Round Schools
Mitchell, R. E., & Mitchell, D. E. (2005) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146810510700401 · Cited by 33 · see citing works
The Neurocognitive Development of Episodic Prospection and Its Implications for Academic Achievement
Prabhakar, J., Coughlin, C. A., & Ghetti, S. (2016) · Mind Brain and Education · doi:10.1111/mbe.12124 · Cited by 28 · see citing works
Stevens, J. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.491 · Cited by 26 · see citing works
Rajan, V., & Bell, M. A. (2014) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2014.10.001 · Cited by 23 · see citing works
Memory and the developing brain: are insights from cognitive neuroscience applicable to education?
Ofen, N., Yu, Q., & Chen, Z. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.05.010 · Cited by 20 · see citing works
What Can We Learn from the Data?
Shields, C. M., & Oberg, S. L. (1999) · Urban Education · doi:10.1177/0042085999342002 · Cited by 17 · see citing works
Rakoff, T. D. (2002) · Harvard University Press eBooks · doi:10.4159/9780674042520 · Cited by 16 · see citing works
The Degree of Dependence Between Multiple-Treatment Effect Sizes
Kim, R. S., & Becker, B. J. (2010) · Multivariate Behavioral Research · doi:10.1080/00273171003680104 · Cited by 15 · see citing works
What Connections Can We Draw Between Research on Long‐Term Memory and Student Learning?
Fandakova, Y., & Bunge, S. A. (2016) · Mind Brain and Education · doi:10.1111/mbe.12123 · Cited by 13 · see citing works
Stenvall, J. T., & Stenvall, M. J. (2001) · Cited by 7 · see citing works
How the Reflection of Linear Correlation in Odds Ratios Depends on the Cut-Off Points
Cohen, P., & Chen, H.-N. (2009) · Communications in statistics. Simulation and computation · doi:10.1080/03610910802592820 · Cited by 7 · see citing works
Okada, K., & Hoshino, T. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1128-0 · Cited by 5 · see citing works
Chan, L. S., Macdonald, M. E., Carnevale, F. A., Steele, R. J., & Shrier, I. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1258 · Cited by 4 · see citing works
Meta-Analytic Evidence for Year-Round Education’s Effect on Science and Social Studies Achievement
Fitzpatrick, D. (2019) · Middle Grades Research Journal · doi:10.1108/mgrj-01-2019-0001 · Cited by 4 · see citing works
Self-citation(2011) · Cited by 3 · see citing works
The Year Round Calendar: An Analysis of Student Outcomes
Moore, K., & Verstegen, D. A. (2004) · Educational Considerations · doi:10.4148/0146-9282.1250 · Cited by 3 · see citing works
McMillan, G. W. (2005) · Cited by 2 · see citing works
Trent, S. E. (2007) · Digital Commons (Liberty University) · Cited by 2 · see citing works
Lindsay-Brown, S. J. (2010) · ProQuest LLC eBooks · Cited by 2 · see citing works
A Computer-Based Method for Student Assignment and Optimal Tract Balancing
McNamara, J. R. (1981) · AEDS Journal · doi:10.1080/00011037.1981.11008290 · Cited by 2 · see citing works
Abakwue, C. I. (2011) · ProQuest LLC eBooks · Cited by 1 · see citing works
A Comparative Study of Year-Round and Traditional Calendar Schools in Chicago
Winkelmann, A. T. (2010) · Loyola eCommons (Loyola University of Chicago) · Cited by 1 · see citing works
Wilmore-Dafonte, C. N. (2013) · ProQuest LLC eBooks · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Von Drehle D. (2010, August 02). The case against summer vacation. Time, 176, 1.
Cited by
Sorted by citations
Meta-Analytic Evidence for Year-Round Education’s Effect on Science and Social Studies Achievement
Fitzpatrick, D. (2019) · Middle Grades Research Journal · doi:10.1108/mgrj-01-2019-0001 · Cited by 4 · see citing works
Self-citation
- Authors
- Fitzpatrick, D., & Burns, J.
- Venue
- Campbell Systematic Reviews: Better Evidence for a Better World
- Publisher
- SAGE Publications
- Published
- 2018-06
- Volume
- 14
- Issue
- 1
- Pages
- 1-15
- ISSN
- 1891-1803 (ISSN-L)
- PMC
- PMC8427981
- OpenAlex
- W2957906412
- Semantic Scholar
- 006f1e5e4334f47aeb4e129e2615eb4907927389
- Cited by
- 1
- References
- 88
- Citations by year
- 2019: 1
- FWCI
- 0.12
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Campbell Systematic Reviews (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Education › School Choice and Performance
- Social Sciences › Education › Early Childhood Education and Development
- Social Sciences › Education › Education during COVID-19 pandemic
- Keywords
- summer learning loss, academic performance, K-12 schools, low-income students, achievement gap, summer vacation, school calendar reform, parental involvement, reading and math achievement, disadvantaged students, school finance, school choice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-14.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-14.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review