Cited by 33Innovations in Medical EducationStudent Assessment and FeedbackClinical Reasoning and Diagnostic Skills

Effect of repeated/spaced formative assessments on medical school final exam performance

Open access
Chang, Edward K., Wimmers, Paul F.·2017·Health Professions Education

Abstract

Formative assessments, especially if spaced, encourage effective study habits such as retesting. The individual and combined effect of weekly formative assessments and cumulative assessments on final exam performance was studied. Methods: Students were placed into 6 groups by weekly formative assessment performance and practice exam utilization/ performance. Students who scored below the median on weekly assessments comprised groups 1/3/5. Groups 2/4/6 scored above the median. Groups 1/2 did not use the practice exam. Groups 3/4 scored below the median on the practice exam while Groups 5/6 scored above. Multiple comparisons were made using ANCOVA. Results: Adjusted analysis showed weekly assessment and practice exam performance had a significant relationship with final exam performance (F[7,145]¼18.765, po0.0005). Groups 2/4/6 performed better on the final exam than groups 1/3/5 respectively (1v2, 80.8% vs 88.0%, po0.0005 || 3v4, 83.4% vs 88.6%, po0.0005 || 5v6, 84.1% vs 90.1%, po0.0005). Group 1 performed worse than group 3 (80.8% vs 83.4%, p¼0.072) and group 5 (80.8% vs 84.1%, p¼0.047). Discussion: Performance on weekly formative assessments was predictive of final exam scores. Struggling medical students will benefit from extra cumulative practice exams while students who are excelling do not need extra practice

AI snapshot

Written from the paper’s full text.

TL;DR

In first-year medical students at UCLA, performance on weekly formative assessments and an optional cumulative practice exam was significantly associated with final exam performance after controlling for GPA and MCAT. Students above the median on weekly assessments scored higher on finals, and among lower-performing students, taking the practice exam was associated with higher final scores.

Key findings

  • After accounting for MCAT and GPA, weekly formative assessments and practice exam performance still had a significant effect on final exam performance (F[7,145] = 18.77, p < 0.0005).
  • Students above the median on weekly assessments outperformed their below-median counterparts: Group 1 vs 2, 80.8% vs 88.0%, p < 0.0005; Group 3 vs 4, 83.4% vs 88.6%, p < 0.0005; Group 5 vs 6, 84.1% vs 90.1%, p < 0.0005.
  • Among students below the median on weekly assessments, Group 1 (no practice exam) scored lower than Group 5 (above-median practice exam), 80.78% vs 84.15%, p = 0.047; the difference versus Group 3 (below-median practice exam) was 80.78% vs 83.44%, p = 0.072.
  • There was no statistical difference between Groups 2, 4, and 6 in final exam performance even though Group 2 did not take a practice exam. Pearson correlations with final exam performance were 0.58 for weekly quiz, 0.36 for practice final, 0.59 for MCAT, and 0.50 for GPA (all p < 0.0005 except GPA and MCAT as reported).

Methods

  • Observational study of 153 first-year medical students at David Geffen School of Medicine at UCLA during the first preclinical block; from 178 students, those taking only one or two practice exam parts were excluded, leaving 153 who took all three parts or none.
  • Students were divided into six groups by weekly formative assessment performance (below vs above median) and practice exam status (none, below median, above median): Groups 1/3/5 below median weekly; Groups 2/4/6 above median weekly; Groups 1/2 no practice exam; Groups 3/4 below median practice exam; Groups 5/6 above median practice exam.
  • Analysis used ANCOVA with GPA and MCAT z-scores as covariates, Fisher’s LSD post hoc pairwise comparisons, and alpha = 0.05.

Limitations

  • The paper states the study was only done at DGSOM, so conclusions cannot necessarily be extrapolated to all medical schools; there was no randomly selected control group that did not do weekly assessments; students were encouraged but not forced to take assessments closed-book by themselves; and the study assumes behavior based on performance without knowing if that is true for every individual.
  • Evident from the text: the study is observational and non-randomized, with students self-selecting into practice exam use, and it evaluates only the first block, so causal claims about practice exams or weekly assessments are not established.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1016/j.hpe.2016.08.001

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 12 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    MCAT score correlated with final exam performance (r=0.59, p<0.0005).

    “Pearson correlation for MCAT score or undergraduate GPA to final exam performance was 0.59 (p o 0.0005) and 0.50 (p o 0.0005).”
    Quote in the paperNot a substantial claim
  • Findingown data

    Group 6 had the highest average final exam score among the six groups.

    “Group 6, which consisted of students who scored highest on the weekly assessments and practice exam, had the highest final exam average out of all other groups.”
    Quote in the paperNot a substantial claim
  • Findingown data

    Group 1 (low weekly assessment, no practice exam) scored lower on the final exam than Group 5 (low weekly assessment, high practice exam): 80.8% vs 84.1%, p=0.047.

    “Group 1 performed worse than group 3 (80.8%vs 83.4%, p ¼0.072) and group 5 (80.8% vs 84.1%, p¼ 0.047).”
    • Also stated in: § 3. Results · plain
      “Out of the groups that scored below the median on the weekly assessments, Group 1 (no practice exam) did not perform as well as group 3 which scored below median on practice exam (80.78% vs 83.44%, p ¼ 0.072) and group 5 which scored above median on practice exam (80.78% to 84.15%, p ¼ 0.047).”
    Quote in the paperSubstantial claim
  • Findingown data

    Undergraduate GPA correlated with final exam performance (r=0.50, p<0.0005).

    “Pearson correlation for MCAT score or undergraduate GPA to final exam performance was 0.59 (p o 0.0005) and 0.50 (p o 0.0005).”
    Quote in the paperNot a substantial claim
  • Findingown data

    Group 6 (high weekly assessment, high practice exam) scored higher on the final exam than Group 5 (low weekly assessment, high practice exam): 90.1% vs 84.1%, p<0.0005.

    “Groups 2/4/6 performed better on the final exam than groups 1/3/5 respectively (1v2, 80.8% vs 88.0%, p o 0.0005 || 3v4, 83.4% vs 88.6%, p o0.0005 || 5v6, 84.1% vs 90.1%, p o 0.0005).”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim. 1
  • May combine two claims. 2
  • Classified as probably not a substantial claim. 6
  • The quote only partly states this claim.

    Findingown data

    Practice exam score correlated with final exam performance (r=0.36, p<0.0005).

    “Pearson correlation for practice exam to final exam performance was 0.36 (p o 0.0005).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The difference in GPA and MCAT between students who scored lower than the median and students who scored higher than the median on weekly formative assessments was statistically significant (p<0.0005 for both).

    “The difference in GPA and MCAT between students who scored lower than the median and students who scored higher than the median on the weekly formative assessments was statistically significant (p o 0.0005 for both).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Students chose to utilize the weekly assessments as they wished despite being encouraged to take them closed book by themselves.

    “Another limitation was that even though students were encouraged to take the weekly assessments closed book by themselves, ultimately students chose to utilize the assessments as they wished.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A survey of 254 medical students in two medical schools found that 62.5% crammed for exams.

    “A survey of 254 medical students in two different medical schools revealed that 62.5% of students crammed for exams, only 17% would prepare a list of probable questions and answers before exams, and only 47.8% of students maintained a daily schedule of study hours. 2”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [2] Vu, 1983, How medical students learn, Academic Medicine source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    GPA and MCAT are good predictors for medical school GPA and USMLE scores, with MCAT often being the better predictor.

    “They are good predictors for medical school GPA and USMLE scores with the MCAT often being the better predictor 13 .”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [13] Julian, 2005, Validity of the Medical College Admission Test for predicting medical school performance, Academic Medicine source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Only 17% of surveyed medical students would prepare a list of probable questions and answers before exams.

    “A survey of 254 medical students in two different medical schools revealed that 62.5% of students crammed for exams, only 17% would prepare a list of probable questions and answers before exams, and only 47.8% of students maintained a daily schedule of study hours. 2”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [2] Vu, 1983, How medical students learn, Academic Medicine source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S1 (asserted), S2 (checkable).

    Premisecitation

    The structure and frequency of examinations in a medical school curriculum may inhibit even the most self-confident and independent student from learning his own way.

    “But this strategy may backfire, according to Neame and Powis, because the structure and frequency of examinations in the a medical school curriculum “may inhibit even the most self-confident and independent student from learning his own way” 19 .”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [19] Neame, 1981, Toward independent learning: curricular design for assisting students to learn how to learn, Academic Medicine source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Only 47.8% of surveyed medical students maintained a daily schedule of study hours.

    “A survey of 254 medical students in two different medical schools revealed that 62.5% of students crammed for exams, only 17% would prepare a list of probable questions and answers before exams, and only 47.8% of students maintained a daily schedule of study hours. 2”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [2] Vu, 1983, How medical students learn, Academic Medicine source

      Not checked in the free run.

8 of 8
  • The authors state this as an assumption.

    Students' study behaviors (e.g., spacing, cramming) can be inferred from their performance on weekly assessments.

    “Lastly, our study assumes behavior based on performance but we don't necessarily know if that is the truth for every individual.”
  • The paper relies on this without support.

    At the first block, the medical school has not influenced the students' uses and beliefs about studying.

    “The first block was chosen because at this point, the medical school has not influenced the students' uses and beliefs about studying.”
2 of 2

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Researchers utilized high-impact standardized assessments, such as the USMLE Step 1 and institutional final exams, to measure long-term knowledge retention.

    “Researchers utilized high-impact standardized assessments, such as the USMLE Step 1 and institutional final exams, to measure long-term knowledge retention (Azim et al., 2025;Burel et al., 2025;Chang & Wimmers, 2017;Gilbert et al., 2023;Ward & Vengrin, 2024).”

    From Systematic Review of the Effectiveness of Neurodidactic Spaced Learning Strategies in Long-Term Memory (2026) · cites this paper as Chang & Wimmers, 2017

    Section 2.1 (page unavailable) says the researchers evaluated performance on the medical school's first-block final exam, supporting the institutional-final-exam part. It does not say they used USMLE Step 1 as an outcome or measured long-term retention; Section 2.3 mentions USMLE scores only when discussing predictors of medical-school performance. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • Several studies demonstrated that providing immediate feedback-whether expert-written or AI-generated-during spaced retrieval sessions significantly improved clinical reasoning and reduced academic stress.

    “Several studies demonstrated that providing immediate feedback-whether expert-written or AI-generated-during spaced retrieval sessions significantly improved clinical reasoning and reduced academic stress (Chang & Wimmers, 2017;Çiçek et al., 2025).”

    From Systematic Review of the Effectiveness of Neurodidactic Spaced Learning Strategies in Long-Term Memory (2026) · cites this paper as Chang & Wimmers, 2017

    The Introduction (page unavailable) discusses feedback from spaced, repeated formative assessments, and the Abstract reports a significant relationship between assessment performance and final-exam scores. The paper does not establish that immediate expert-written or AI-generated feedback improved clinical reasoning or reduced academic stress; those outcomes were not reported. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Group 6 final-exam mean differs between abstract and table

    Minor

    The abstract reports Group 6's final-exam mean as 90.1%, whereas Table 1 gives 90.01%, which rounds to 90.0% at one decimal place.

1 of 1

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Chang, E. K., & Wimmers, P. F.
Affiliations
University of California, Los Angeles (US)
Corresponding author
Chang, Edward K.
Venue
Health Professions Education
Published
2017-06
Volume
3
Issue
1
Pages
32-37
ISSN
2452-3011 (ISSN-L)
OpenAlex
W2517372235
Cited by
33
References
22
Citations by year
2025: 3 · 2024: 10 · 2023: 2 · 2022: 2 · 2021: 4 · 2020: 5 · 2019: 3 · 2018: 4
FWCI
2.31
Type
journal article
Language
en
Open access
Locations
  • Health Professions Education (publishedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
  • Social Sciences › Education › Student Assessment and Feedback
  • Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
Keywords
formative assessment, medical students, final exam performance, practice tests, cumulative assessment, weekly assessment, retesting, study habits

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review