Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index; 9 of the 35 sources its claims cite were checked for support.

Testing the testing effect on prolific: when retrieval practice fails to boost learning

Open access
Sigayret, Kevin, Parmentier, Jean-François, Silvestre, Franck · 2026 · Frontiers in Psychology

Abstract

The testing effect-whereby retrieving information through testing improves long-term retention more than restudying-is one of the most robust and well-documented phenomena in educational psychology. However, its replicability in online crowdsourced settings remains uncertain. In this paper, we report two preliminary experiments examining whether the testing effect can be detected in studies conducted on Prolific, a platform widely used for behavioral and educational research. Although not conceived as direct replications, both studies relied on validated learning materials and incorporated key methodological features known to enhance the testing effect, including delayed posttests, corrective feedback, and both factual and application-based outcome measures. In both experiments, participants were randomly assigned to a retrieval-practice (test) or restudy condition. No significant differences were found between groups at delayed test, despite multiple safeguards aimed at promoting participant engagement (e.g., prescreening filters, attention checks, fair compensation). These null findings suggest that investigating learning phenomena that require sustained cognitive engagement may be more challenging with crowdsource samples. We argue that the absence of the testing effect in our studies is unlikely to reflect a theoretical limitation of the effect itself, but rather highlights challenges inherent to online research environments. While platforms like Prolific offer valuable advantages in terms of speed and sample diversity, their constraints should be carefully considered when studying learning effects that depend on deep engagement with learning material.

Overview

CoChat Summary

## TL;DR

Two Prolific-based experiments found no significant testing effect, despite using delayed posttests, corrective feedback, and materials previously known to produce retrieval-practice benefits. The authors argue that crowdsource settings may make it harder to elicit learning effects that depend on sustained engagement.

## Key findings

  • Experiment 1: no significant effect of learning condition on total post-test score, F(1, 66) = 0.13, p = 0.72; also null effects for Definition score [F(1, 66) = 0.94, p = 0.33] and Application score [F(1, 66) = 0.27, p = 0.61].
  • Experiment 2: no significant difference between control and experimental groups on delayed recall, U = 1773, p = 0.17, r = 0.14; means were M = 6.51 (SD = 5.74) for control and M = 7.44 (SD = 4.65) for experimental.
  • Attrition was high in both studies: Experiment 1 had 67/169 (39.6%) complete both phases; Experiment 2 had 129/426 (30.3%) complete the entire experiment.
  • In Experiment 2, 56% of participants failed to comply with the 3-minute recall instruction in the screening phase, indicating engagement problems.

## Methods

  • Two experiments were run on Prolific using the Gorilla Experiment Builder platform; both randomly assigned participants to a retrieval-practice/testing condition or a restudy/control condition.
  • Experiment 1 used two ~500-word texts (Expressionism and Ancient Rome) with 10 key terms each, plus delayed multiple-choice posttests after 10 weeks; 67 participants completed both phases.
  • Experiment 2 used a 2 min 26 s narrated lightning-formation video with 19 key ideas, a preliminary screening phase for prior meteorological knowledge and recall compliance, and a 2-day delayed free-recall test; 129 participants completed the full study.
  • Analysis: linear mixed-effects models for Experiment 1 and Mann–Whitney U test for Experiment 2; scoring in Experiment 2 was done by a trained blind rater.

## Limitations

  • The paper states that many inclusion criteria relied on self-report on Prolific, which may be inaccurate or strategically manipulated.
  • The Experiment 2 sample was not representative of the undergraduate population typically used in testing-effect research, limiting generalizability.
  • Both studies had high attrition, which reduced power and raised self-selection concerns; this limitation is explicitly stated.
  • In Experiment 2, open-ended recall scoring involved subjective judgment, introducing potential unreliability; this is stated in the paper.
  • Evident from the text: the studies are described as preliminary and not direct replications, so the null findings are evidence about these specific online conditions rather than a definitive test of the testing effect.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3389/fpsyg.2026.1727423

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Design of experiment 1.
Figure 1 Design of experiment 1.CC BY · PubMed Central
Figure 2 Design of experiment 2.
Figure 2 Design of experiment 2.CC BY · PubMed Central

Verification

Claims the paper makes

7 Valid · 0 Not valid · 15 Not checked · 51 Own results and interpretations

26 more claims

Create a free account to see all 73 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 36
  • It may state two separate claims as one. 19

Create a free account to see these claims.

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Consistentt(65) = 0.41reported p = .68 · recomputed p = .683

    “t(65) = 0.41, p = .68”

  • ConsistentF(1, 66) = 0.13reported p = .72 · recomputed p = .720

    “F(1, 66) = 0.13, p = .72”

  • ConsistentF(1, 66) = 0.94reported p = .33 · recomputed p = .336

    “F(1, 66) = 0.94, p = .33”

  • ConsistentF(1, 66) = 0.27reported p = .61 · recomputed p = .605

    “F(1, 66) = 0.27, p = .61”

4 of 4

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Self-check results appear here once an independent check has confirmed them.

Citations

Cites

Show all 28 references

Metadata

Authors
Sigayret, K., Parmentier, J.-F., & Silvestre, F.
Affiliations
Centre National de la Recherche Scientifique (FR)
Corresponding author
Sigayret, Kevin
Venue
Frontiers in Psychology
Published
2026-01-29
Volume
17
Pages
1727423-1727423
ISSN
1664-1078 (ISSN-L)
OpenAlex
W7125926383
Cited by
0
References
28
FWCI
0.00
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Psychology (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • HAL (submittedVersion, cc-by)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
  • Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
Keywords
testing effect, retrieval practice, restudying, long-term retention, Prolific, crowdsourced research, online research platform, negative results, corrective feedback, participant engagement

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Testing the testing effect on prolific: when retrieval practice fails to boost learning. https://app.cochat.ai/papers/10.3389/fpsyg.2026.1727423
The paper
Sigayret, K., Parmentier, J.-F., & Silvestre, F. (2026). Testing the testing effect on prolific: when retrieval practice fails to boost learning. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2026.1727423

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.