Cited by 60Student Assessment and FeedbackEvaluation of Teaching PracticesEducational Research and Methods

ManyClasses 1: Assessing the Generalizable Effect of Immediate Feedback Versus Delayed Feedback Across Many College Classes

Open access
Fyfe, Emily R., de Leeuw, Joshua R., Carvalho, Paulo F., Goldstone, Robert L., Sherman, Janelle, Admiraal, David, Alford, Laura K., Bonner, Alison +40 more·2021·Advances in Methods and Practices in Psychological Science

Abstract

Psychology researchers have long attempted to identify educational practices that improve student learning. However, experimental research on these practices is often conducted in laboratory contexts or in a single course, which threatens the external validity of the results. In this article, we establish an experimental paradigm for evaluating the benefits of recommended practices across a variety of authentic educational contexts—a model we call ManyClasses. The core feature is that researchers examine the same research question and measure the same experimental effect across many classes spanning a range of topics, institutions, teacher implementations, and student populations. We report the first ManyClasses study, in which we examined how the timing of feedback on class assignments, either immediate or delayed by a few days, affected subsequent performance on class assessments. Across 38 classes, the overall estimate for the effect of feedback timing was 0.002 (95% highest density interval = [−0.05, 0.05]), which indicates that there was no effect of immediate feedback compared with delayed feedback on student learning that generalizes across classes. Furthermore, there were no credibly nonzero effects for 40 preregistered moderators related to class-level and student-level characteristics. Yet our results provide hints that in certain kinds of classes, which were undersampled in the current study, there may be modest advantages for delayed feedback. More broadly, these findings provide insights regarding the feasibility of conducting within-class randomized experiments across a range of naturally occurring learning environments.

Integrity signals

Registry

Crossref · 10.1177/25152459211027575

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Fyfe, E. R., de Leeuw, J. R., Carvalho, P. F., Goldstone, R. L., Sherman, J., Admiraal, D., Alford, L. K., Bonner, A., Brassil, C. E., Brooks, C. A., Carbonetto, T., Chang, S. H., Cruz, L., Czymoniewicz-Klippel, M., Daniel, F., Driessen, M., Habashy, N., Hanson-Bradley, C. L., Hirt, E. R., Carbonell, V. H., Jackson, D. K., Jones, S., Keagy, J. L., Keith, B., Malmquist, S. J., McQuarrie, B., Metzger, K. J., Min, M. K., Patil, S., Patrick, R. S., Pelaprat, E., Petrunich-Rutherford, M. L., Porter, M. R., Prescott, K., Reck, C., Renner, T., Robbins, E., Smith, A. R., Stuczynski, P., Thompson, J., Tsotakos, N., Turk, J. K., Unruh, K., Webb, J. D., Whitehead, S. N., Wisniewski, E. C., Zhang, K. A., & Motz, B. A.
Affiliations
  • Indiana University Bloomington (US)
  • Department of Cognitive Science, Vassar College, Poughkeepsie, New York, USA
  • Carnegie Mellon University (US)
  • University of Nebraska–Lincoln (US)
  • University of Michigan (US)
  • Pennsylvania State University (US)
  • Indiana University Southeast (US)
  • Department of Biobehavioral Health, Penn State University, University Park, Pennsylvania, USA
  • Indiana University Northwest (US)
  • University of Minnesota (US)
  • Indiana University Kokomo (US)
  • University of Minnesota Morris (US)
  • University of Minnesota Rochester (US)
  • Unizin, Austin, Texas, USA
  • University of Minnesota, Duluth (US)
  • Indiana University East (US)
Corresponding author
Fyfe, Emily R.
Venue
Advances in Methods and Practices in Psychological Science
Published
2021-07
Volume
4
Issue
3
ISSN
  • 2515-2459 (ISSN-L)
  • 2515-2467
OpenAlex
W3162001182
Cited by
59
References
42
Citations by year
2026: 6 · 2025: 16 · 2024: 13 · 2023: 8 · 2022: 12 · 2021: 4
FWCI
16.25
Type
journal article
Language
en
Open access
Locations
  • Advances in Methods and Practices in Psychological Science (publishedVersion, cc-by-nc)
  • Lincoln (University of Nebraska) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Education › Student Assessment and Feedback
  • Social Sciences › Education › Evaluation of Teaching Practices
  • Social Sciences › Education › Educational Research and Methods
Keywords
immediate feedback, delayed feedback, feedback timing, student learning, generalizability, university courses, class assignment, assessment performance, teaching practice

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review