The DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index; 25 of the 70 sources its claims cite were checked for support.
Worth the Effort: the Start and Stick to Desirable Difficulties (S2D2) Framework
Open accessAbstract
Abstract Desirable difficulties are learning conditions that are often experienced as effortful, but have a positive effect on learning results and transfer of knowledge and skills (Bjork & Bjork, 2011; Bjork, 1994). Learners often do not appreciate the beneficial effects of desirable difficulties, and the negative experiences of high effort and perceived low learning make them resistant to engage in desirable difficulties (Biwer et al., 2020a). This ultimately limits learning outcomes and academic achievement. With the increasing emphasis on self-regulation in education, characterized by higher learner agency and abundant choices in what, when, and how to study, the field of educational psychology is in need of theoretical and empirically testable assumptions that improve self-regulation in desirably difficult learning conditions with the aim to foster self-regulation abilities, learning outcomes, and academic achievement. Here, we present a framework that describes how to support self-regulation of effort when engaging in desirable difficulties: the “Start and Stick to Desirable Difficulties (S2D2)” framework. The framework builds on the Effort Monitoring and Regulation model (de Bruin et al., 2020). The aim of this framework is (1) to describe evidence for the central role of perceived effort and perceived learning in (dis)engagement in desirable difficulties, and (2) to review evidence on, and provide an agenda for research to improve learners’ self-regulated use of desirable difficulties to help them start and persist when learning feels tough, but is actually effective.
Overview
CoChat Summary
TL;DR
This review proposes the Start and Stick to Desirable Difficulties (S2D2) framework to explain why learners avoid, start, or persist in desirable difficulties based on perceived effort and perceived learning. It argues that sustainable use of these strategies requires interventions at the strategy, task, and learner levels to help learners accept, reduce, or silence effort while also seeing actual learning benefits.
Key findings
- The paper identifies three relations that shape engagement in desirable difficulties: perceived effort can directly affect use, perceived effort can be intricately related to perceived learning, and perceived learning can directly affect use.
- In one cited meta-analysis, learners’ effort ratings correlated negatively with judgments of learning during learning, with \(r = -0.355\); the correlation was weaker for prospective than retrospective judgments and stronger for problem-solving than paired-associates tasks.
- In a cited study of human anatomy image-name pairs, learners’ strategy decisions showed that before feedback, effort directly predicted retrieval-practice choices; after performance feedback, strategy decisions were directly affected by effort ratings and indirectly through perceived learning.
- In a cited study comparing blocked and interleaved practice, perceived effort was higher and perceived learning lower for interleaving than blocking at first, but these differences decreased over time; the effect of reduced effort on choosing interleaving was mediated by increased perceived learning.
Methods
- Conceptual review/framework paper: the authors synthesize prior theory and empirical findings rather than report a new primary empirical study.
- The framework builds on the Effort Monitoring and Regulation (EMR) model and focuses on self-regulated learning in authentic self-study environments, especially older adolescents and adult learners.
- The analysis is narrative and integrative, using prior studies and a proposed intervention agenda organized around strategy-level, task-level, and learner-level approaches.
Limitations
- The paper states that it does not explain how teachers can directly incorporate desirable difficulties into teaching; its focus is on students’ self-regulated use in self-study contexts.
- The authors note that their discussion of the relation between perceived effort and learning is limited by the fact that “much [is] still unknown,” including how these perceptions develop across task level and strategy level and over longer time spans.
- Evident from the text: this is a framework/review without a new empirical sample, so the proposed claims are not directly tested in this paper.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
21 Valid · 6 Not valid · 39 Not checked · 92 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“That is, self-reports of effort through ratings on a Likert-type scale should not be viewed as objective reflections of effort based solely on the difficulty of a task.”
What the sources say
- Supportedcites Scheiter et al., 2020 source
The Subjective Effort Measures section describes effort self-reports made on a nine-point Likert scale. The Heuristic Cues Underlying Effort Appraisals section says those appraisals can be influenced by feedback and task position—factors unrelated to the task itself—so they are not objective reflections based solely on task difficulty. Page numbers were not available in our copy. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“These differences between blocking and interleaving decreased after experience with the strategies.”
What the sources say
- Supportedcites Onan et al., 2022 source
The Perceived Effort and Perceived Learning sections report that, over time, effort decreased and perceived learning increased for interleaved practice, while neither changed for blocked practice. Because interleaving initially had higher perceived effort and lower perceived learning, both differences narrowed with experience. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“The Baars etal.'s (2020) meta-analysis shows that the goal-driven approach is less common among learners than the data-driven approach.”
What the sources say
- Could not verifycites Baars et al., 2020 sourceExperimental — accuracy not yet measured
The Data-Driven and Goal-Driven Self-Regulation section describes both approaches but does not compare how commonly learners use them. Limitations and Future Studies says only a small number of included studies manipulated goal-driven self-regulation; that is a statement about the studies, not the prevalence of the approach among learners. Searches for a learner-level frequency comparison found none. (LLM, conf=0.73)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
Every source the paper cites for this claim was checked and supports it.
In the paper
“In the context of desirable difficulties, the negative effect of perceiving effort as costly or aversive was also observed in research by Hui and colleagues (2022).”
What the sources say
- Supportedcites Hui et al., 2022 source
In the Discussion (section 4, Figure 4; page not provided), Hui and colleagues report that perceived mental effort directly informed students’ strategy choices: they tended to choose less effortful restudy for tasks they found taxing. This supports the claim’s broad point that treating effort as a cost can discourage an effortful learning strategy, although the study describes perceived effort rather than directly measuring aversion. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Instead, learners derive them dynamically through several sources of information such as their effort beliefs, prior task experience, current level of fatigue, interest in the task, and fluency of processing.”
What the sources say
- Partly supportedcites Scheiter et al., 2020 sourceExperimental — accuracy not yet measured
The Subjective Effort Measures section (page unavailable) says beliefs about ability may affect how learners assess effort, and the Heuristic Cues Underlying Effort Appraisals section says task experience and other cues can influence ratings. The copy does not establish current fatigue or task interest as sources of effort ratings; it discusses processing fluency chiefly as a cue for judgments of learning, not effort ratings. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Partly supported
62 more claims · 6 with their cited sources checked
Create a free account to see all 158 claims and every source verdict.
- It may state two separate claims as one. 58
- Probably not a substantial claim. 50
Citations
Cites
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Metamemory: A Theoretical Framework and New Findings
Nelson, T. O. (1990) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60053-5 · Cited by 2,583 · cited 1×
“The EMR model finds its base in the Nelson and Narens model (Nelson, 1990; Nelson & 1 3 Narens, 1994), which describes how cycles of monitoring and regulation of learning characterize learning task engagement.”
MethodThe Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791 · cited 1×
“For example, when using retrieval practice, learning effects are not immediately visible but appear only after a delay (Karpicke & Roediger, 2008; Nunes & Karpicke, 2015).”
MethodNakamura, J., & Csikszentmihalyi, M. (2014) · Flow and the Foundations of Positive Psychology · doi:10.1007/978-94-017-9088-8_16 · Cited by 1,608 · cited 2×
“Flowlike experiences can also be interpreted as examples of the extremely goal-driven approach (Nakamura & Csikszentmihalyi, 2014) because under these circumstances perceptions of effort also appear to be silenced (Swann et al., 2016).”
BackgroundGuadagnoli, M. A., & Lee, T. D. (2004) · Journal of Motor Behavior · doi:10.3200/jmbr.36.2.212-224 · Cited by 1,534 · cited 1×
“For these learners, Educational Psychology Review (2023) 35:41 1 3 41 Page 20 of 27 the difficulty of the learning material is probably too high; the desirably difficult strategy itself not benefiting them is less likely (Guadagnoli & Lee, 2004).”
BackgroundAn opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381 · cited 1×
“According to the opportunity cost model (Kurzban et al., 2013), the experienced costs of effort invested in a task are weighed against alternative opportunities.”
MethodMonitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning
Koriat, A. (1997) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.126.4.349 · Cited by 1,363 · cited 1×
“As in the case of metacognitive judgments such as judgments of learning (de Bruin et al., 2017; Koriat, 1997), learners do not have direct access to the effort they actually expend and therefore have to infer their objective effort based on information sources typically termed “cues.””
BackgroundMemory and Metamemory Considerations in the Training of Human Beings
Bjork, R. A. (1994) · Metacognition · doi:10.7551/mitpress/4561.003.0011 · Cited by 1,084 · cited 2×
“Desirable difficulties are learning conditions that are often experienced as effortful, but have a positive effect on learning results and transfer of knowledge and skills (Bjork & Bjork, 2011; Bjork, 1994).”
BackgroundToward a rational and mechanistic account of mental effort
Shenhav, A., Musslick, S., Lieder, F., Kool, W., Griffiths, T. L., Cohen, J. D., & Botvinick, M. M. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031526 · Cited by 1,077
Research works printed but not linked: 3
- Biwer, F. & de Bruin, A.B.H. (2023). Teaching students to ‘Study Smart’ – A training program based on the science of learning. In C. E. Overson, C. M. Hakala, L. L. Kordonowy, & V. A. Benassi (Eds.). In their own words: What scholars want you to know about why and how to apply the science of learning in your academic setting. Society for the Teaching of Psychology. (in press).
- Cirillo, F. (2006). The pomodoro technique (the pomodoro). Agile Processes in Software Engineering, 54(2), 35.
- Metcalfe, J. (2011). Desirable difficulties and studying in the region of proximal learning. In A. S. Benjamin (Ed.) Successful remembering and successful forgetting: A Festschrift in honor of Robert A. Bjork (pp. 259–276). London (UK): Psychology Press.
Cited by
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13544 · Cited by 805
Grund, A., Fries, S., Nückles, M., Renkl, A., & Roelle, J. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09852-7 · Cited by 65
“…that learning requires some sort of cognitive processing in response to a task’s complexity (i.e., effort-by-complexity), at first glance renders it understandable that the phrase “no pain, no gain” is increasingly used in educational contexts (e.g., Metcalfe, 2011; see also de Bruin et al., 2023).”
InfluentialComplexity affects performance, cognitive load, and awareness
Zeitlhofer, I., Zumbach, J., & Schweppe, J. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.102001 · Cited by 77
Halmo, S. M., Yamini, K. A., & Stanton, J. D. (2024) · CBE—Life Sciences Education · doi:10.1187/cbe.23-08-0158 · Cited by 70
“…for each student where a problem is difficult enough to engage their curiosity and motivation to solve some-thing unknown but also does not generate negative emotions associated with failure that could prevent problem solving from moving forward (Zepeda et al. , 2020; de Bruin et al. , 2023).”
Carpenter, S. K. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09811-8 · Cited by 40
Metadata
- Authors
- de Bruin, A. B. H., Biwer, F., Hui, L., Onan, E., David, L., & Wiradhany, W.
- Affiliations
- Maastricht University (NL)
- Imperial College London (GB)
- Binus University (ID)
- Corresponding author
- de Bruin, Anique B. H.
- Venue
- Educational Psychology Review
- Published
- 2023-03-27
- Volume
- 35
- Issue
- 2
- ISSN
- 1040-726X (ISSN-L)
- 1573-336X
- OpenAlex
- W4360985532
- Cited by
- 109
- References
- 80
- Citations by year
- 2026: 53 · 2025: 34 · 2024: 18 · 2023: 4
- FWCI
- 28.90
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Educational Psychology Review (publishedVersion, cc-by)
- Research Publications (Maastricht University) (publishedVersion, cc-by)
- Research Publications (Maastricht University) (submittedVersion, other-oa)
- Funders
- NWO (VI.Vidi.195.135)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- desirable difficulties, self-regulation, effort regulation, perceived effort, perceived learning, student engagement, learning persistence, academic performance, knowledge transfer, learner agency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Worth the Effort: the Start and Stick to Desirable Difficulties (S2D2) Framework. https://app.cochat.ai/papers/10.1007/s10648-023-09766-w
- The paper
- de Bruin, A. B. H., Biwer, F., Hui, L., Onan, E., David, L., & Wiradhany, W. (2023). Worth the Effort: the Start and Stick to Desirable Difficulties (S2D2) Framework. Educational Psychology Review. https://doi.org/10.1007/s10648-023-09766-w
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.